[2025-10-21T17:00:01.974687] [INFO ] [MAIN ] Using last completed trading day: 2025-10-21 [2025-10-21T17:00:02.196160] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-21T17:00:02.196319] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-21T17:00:02.271440] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-21T17:00:02.271868] [WARN ] [STATE ] State set to: RUNNING [2025-10-21T17:00:02.271961] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-21T17:00:02.272018] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-21T17:00:02.272162] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-21T17:00:02.272227] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-21T17:00:04.003231] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-21T17:00:04.003381] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-21T17:00:04.003584] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-21T17:00:04.004133] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-21T17:00:04.004189] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-21T17:00:04.004219] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-21T17:00:04.004273] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-21T17:00:04.004311] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-21T17:00:04.004377] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-21T17:00:04.004800] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-21T17:00:04.004851] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-21T17:00:04.005006] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-21T17:00:04.005037] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-21T17:00:04.005074] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-21T17:00:04.005129] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-21T17:00:04.027546] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-21T17:00:04.050088] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-21T17:00:04.050146] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-21T17:00:04.050177] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-21T17:00:04.050204] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-21T17:00:04.050255] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-21T17:00:04.050594] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-21T17:00:04.050625] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-21T17:00:04.050686] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-21T17:00:04.050729] [INFO ] [MAIN ] Running in parallel mode [2025-10-21T17:00:04.050890] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2366 symbols [2025-10-21T17:00:04.659184] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:04.731959] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:04.721018] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:04.732179] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-10-21T17:00:04.737355] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-10-21T17:00:04.755459] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-21T17:00:04.762010] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:04.758132] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-21T17:00:04.762520] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-21T17:00:04.763110] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-21T17:00:04.762880] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-21T17:00:04.764309] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-21T17:00:04.764486] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-21T17:00:04.764769] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-21T17:00:04.764667] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-21T17:00:04.764863] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-21T17:00:05.079223] [DEBUG] [LOCAL ] AAMI: Loaded 24762 existing records from primary storage. [2025-10-21T17:00:05.179897] [INFO ] [MAIN ] AAMI: Loaded 24762 existing records. [2025-10-21T17:00:05.527785] [DEBUG] [LOCAL ] A: Loaded 50738 existing records from primary storage. [2025-10-21T17:00:05.555175] [INFO ] [MAIN ] A: Loaded 50738 existing records. [2025-10-21T17:00:05.696425] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:05.750892] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-21T17:00:05.852335] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:05.865819] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-21T17:00:05.897380] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-21T17:00:05.901414] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:05.905728] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-21T17:00:05.905807] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-21T17:00:05.905970] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-21T17:00:06.101460] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:06.111932] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-21T17:00:06.117123] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-21T17:00:06.148773] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-21T17:00:06.165933] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-21T17:00:06.381788] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T17:00:06.384402] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-21T17:00:06.522703] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:06.572551] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-21T17:00:06.720237] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:06.720501] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-21T17:00:06.788701] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-21T17:00:06.789535] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-21T17:00:07.188998] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-21T17:00:07.189927] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-21T17:00:07.645083] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T17:00:07.646238] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-21T17:00:07.657620] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T17:00:07.663528] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-21T17:00:07.987402] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-21T17:00:07.997992] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-21T17:00:08.023282] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T17:00:08.024458] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-21T17:00:08.066407] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T17:00:08.076410] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-21T17:00:08.319393] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-21T17:00:08.320541] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-21T17:00:08.668435] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-21T17:00:08.669714] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-21T17:00:08.732674] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T17:00:08.736680] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-21T17:00:09.030628] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-21T17:00:09.032222] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-21T17:00:09.372227] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T17:00:09.373202] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-21T17:00:09.693322] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:00:09.698405] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-21T17:00:09.768228] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-21T17:00:09.768984] [INFO ] [REMOTE ] AAM: Full fetch complete (914 records). [2025-10-21T17:00:09.769060] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-21T17:00:09.974063] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-10-21T17:00:09.974571] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:09.974697] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:09.975192] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-21T17:00:09.975333] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-21T17:00:09.975432] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-21T17:00:09.975565] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-21T17:00:09.975758] [INFO ] [MAIN ] Update Progress: 1/2366 symbols completed. AAM took 5.9s. Estimated remaining: 3h 53m 33s. Rate: 10.1 symbols/min [2025-10-21T17:00:10.093790] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-21T17:00:10.100337] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T17:00:10.153941] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-21T17:00:10.155555] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-21T17:00:10.225750] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:10.282404] [DEBUG] [LOCAL ] AAP: Loaded 51783 existing records from primary storage. [2025-10-21T17:00:10.282751] [INFO ] [MAIN ] AAP: Loaded 51783 existing records. [2025-10-21T17:00:10.459192] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:10.459425] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-21T17:00:10.459494] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-21T17:00:10.459720] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-21T17:00:10.459776] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-21T17:00:10.847040] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:10.847377] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-21T17:00:10.987092] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T17:00:10.993525] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-21T17:00:12.056525] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T17:00:12.067850] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-21T17:00:12.172023] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T17:00:12.178037] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-21T17:00:12.232578] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-21T17:00:12.243600] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-21T17:00:12.275913] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T17:00:12.285867] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-21T17:00:13.261712] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T17:00:13.266834] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-21T17:00:13.782442] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T17:00:13.792338] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-21T17:00:13.825700] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T17:00:13.836993] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-21T17:00:14.235211] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T17:00:14.241242] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-21T17:00:14.976125] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-10-21T17:00:14.987878] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-21T17:00:15.429047] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T17:00:15.434381] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-21T17:00:15.606323] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T17:00:15.617009] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-21T17:00:15.686884] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T17:00:15.698048] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-21T17:00:16.816107] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T17:00:16.827097] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-21T17:00:17.124760] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T17:00:17.130818] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-21T17:00:17.597096] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:00:17.608873] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-21T17:00:17.939174] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T17:00:17.943163] [INFO ] [REMOTE ] AAMI: Full fetch complete (33073 records). [2025-10-21T17:00:17.943272] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-21T17:00:17.943866] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:00:17.943983] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:17.944083] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:17.944192] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-21T17:00:17.944314] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-21T17:00:17.944374] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-21T17:00:17.944557] [DEBUG] [LOCAL ] AAMI: Deleted derivative data file. [2025-10-21T17:00:17.945182] [INFO ] [MAIN ] Update Progress: 2/2366 symbols completed. AAMI took 13.8s. Estimated remaining: 4h 33m 43s. Rate: 8.6 symbols/min [2025-10-21T17:00:18.115706] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:18.147892] [DEBUG] [LOCAL ] AAT: Loaded 30441 existing records from primary storage. [2025-10-21T17:00:18.148153] [INFO ] [MAIN ] AAT: Loaded 30441 existing records. [2025-10-21T17:00:18.336329] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:18.336585] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-21T17:00:18.336667] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-21T17:00:18.336881] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-21T17:00:18.336923] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-21T17:00:18.720817] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:18.721222] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-21T17:00:18.753573] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T17:00:18.764885] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-21T17:00:18.900501] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (3.20 seconds). [2025-10-21T17:00:18.911600] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-21T17:00:19.126805] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:00:19.138525] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-21T17:00:19.990416] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:00:19.995869] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-21T17:00:20.395130] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T17:00:20.406788] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-21T17:00:20.831157] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-21T17:00:20.843871] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-21T17:00:20.861629] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T17:00:20.868491] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-21T17:00:21.478713] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-21T17:00:21.490295] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-21T17:00:22.404379] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T17:00:22.411047] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-21T17:00:22.609428] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T17:00:22.621686] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-21T17:00:22.657279] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-21T17:00:22.670354] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-21T17:00:23.365246] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T17:00:23.377024] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-21T17:00:23.770594] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T17:00:23.782416] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-21T17:00:24.127836] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:00:24.144818] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-21T17:00:24.749249] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T17:00:24.766631] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-21T17:00:25.100470] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T17:00:25.111620] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-21T17:00:25.233234] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:00:25.240257] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-21T17:00:25.545436] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T17:00:25.553426] [INFO ] [REMOTE ] A: Full fetch complete (73227 records). [2025-10-21T17:00:25.553552] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-21T17:00:25.554243] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:00:25.554329] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:25.554371] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:25.554409] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-21T17:00:25.554465] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-10-21T17:00:25.554500] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-10-21T17:00:25.554621] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-10-21T17:00:25.555096] [INFO ] [MAIN ] Update Progress: 3/2366 symbols completed. A took 21.5s. Estimated remaining: 4h 42m 18s. Rate: 8.4 symbols/min [2025-10-21T17:00:25.721541] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:25.721730] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-21T17:00:25.721777] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-21T17:00:25.721887] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-21T17:00:25.721928] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-21T17:00:25.721968] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-21T17:00:25.721999] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-21T17:00:26.075930] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:26.076252] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-21T17:00:26.531077] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:00:26.531392] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-21T17:00:26.531481] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:00:26.531553] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-21T17:00:26.531629] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:00:26.531742] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-21T17:00:26.531811] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-21T17:00:26.531848] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-21T17:00:26.531887] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-21T17:00:26.531938] [INFO ] [MAIN ] Update Progress: 4/2366 symbols completed. AAUC took 1.0s. Estimated remaining: 3h 41m 15s. Rate: 10.7 symbols/min [2025-10-21T17:00:26.636002] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T17:00:26.710040] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-21T17:00:26.744854] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:26.771305] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T17:00:26.781257] [INFO ] [REMOTE ] AA: Full fetch complete (77733 records). [2025-10-21T17:00:26.781461] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-21T17:00:27.065473] [DEBUG] [LOCAL ] AB: Loaded 25030 existing records from primary storage. [2025-10-21T17:00:27.115728] [INFO ] [MAIN ] AB: Loaded 25030 existing records. [2025-10-21T17:00:27.147802] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T17:00:27.270499] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-21T17:00:27.425400] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-21T17:00:27.431001] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-21T17:00:27.440346] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-21T17:00:27.457163] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-21T17:00:27.462167] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:27.462866] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-21T17:00:27.462997] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-21T17:00:27.463375] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-21T17:00:27.463436] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-21T17:00:27.494521] [DEBUG] [LOCAL ] AA: Trimmed 77733 records to 53622 (keeping 200 days of data) [2025-10-21T17:00:28.050079] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:28.051695] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-21T17:00:28.181617] [DEBUG] [LOCAL ] AA: Primary data saved (53622 records). [2025-10-21T17:00:28.182489] [INFO ] [MAIN ] AA: Full history saved. [2025-10-21T17:00:28.183518] [INFO ] [MAIN ] Update Progress: 5/2366 symbols completed. AA took 24.1s. Estimated remaining: 3h 9m 55s. Rate: 12.4 symbols/min [2025-10-21T17:00:28.183357] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T17:00:28.260823] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-21T17:00:28.362749] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:28.362954] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-21T17:00:28.362999] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-21T17:00:28.363108] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-21T17:00:28.363150] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-21T17:00:28.363192] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-21T17:00:28.363225] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-21T17:00:28.742451] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:28.742877] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-21T17:00:29.052812] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T17:00:29.060588] [INFO ] [REMOTE ] AAP: Full fetch complete (75135 records). [2025-10-21T17:00:29.060751] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-21T17:00:29.458607] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-21T17:00:29.458842] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-21T17:00:29.459541] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-21T17:00:29.459620] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-21T17:00:29.461774] [DEBUG] [LOCAL ] AAP: Trimmed 75135 records to 51758 (keeping 200 days of data) [2025-10-21T17:00:29.725324] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T17:00:29.738672] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T17:00:29.747321] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-21T17:00:29.750052] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-21T17:00:29.829407] [DEBUG] [LOCAL ] AAP: Primary data saved (51758 records). [2025-10-21T17:00:29.829529] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-21T17:00:29.829898] [INFO ] [MAIN ] Update Progress: 6/2366 symbols completed. AAP took 19.9s. Estimated remaining: 2h 48m 60s. Rate: 14.0 symbols/min [2025-10-21T17:00:29.999350] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:29.999511] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-21T17:00:29.999548] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-21T17:00:29.999684] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-21T17:00:29.999738] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-21T17:00:29.999780] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-21T17:00:29.999811] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-21T17:00:30.346913] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:30.347273] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-21T17:00:30.829612] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T17:00:30.840448] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-21T17:00:30.859482] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:00:30.866573] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-21T17:00:31.283409] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T17:00:31.292283] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-21T17:00:31.364205] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T17:00:31.370796] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-21T17:00:31.688314] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T17:00:31.693092] [INFO ] [REMOTE ] AAT: Full fetch complete (42854 records). [2025-10-21T17:00:31.693192] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-21T17:00:31.693791] [FATAL] [VALIDATOR ] AAT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:00:31.693874] [FATAL] [MAIN ] AAT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:31.693924] [WARN ] [MAIN ] AAT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:31.694032] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-21T17:00:31.694104] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-10-21T17:00:31.694140] [INFO ] [LOCAL ] AAT: Starting deletion of derivative data. [2025-10-21T17:00:31.694282] [DEBUG] [LOCAL ] AAT: Deleted derivative data file. [2025-10-21T17:00:31.694371] [INFO ] [MAIN ] Update Progress: 7/2366 symbols completed. AAT took 13.7s. Estimated remaining: 2h 35m 16s. Rate: 15.2 symbols/min [2025-10-21T17:00:31.874682] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:31.929187] [DEBUG] [LOCAL ] ABEV: Loaded 53291 existing records from primary storage. [2025-10-21T17:00:31.929524] [INFO ] [MAIN ] ABEV: Loaded 53291 existing records. [2025-10-21T17:00:32.117033] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:32.117244] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-21T17:00:32.117292] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-21T17:00:32.117600] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-21T17:00:32.117714] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-21T17:00:32.482406] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:32.482899] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-21T17:00:32.629353] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:00:32.639605] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-21T17:00:32.672603] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T17:00:32.678734] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-21T17:00:32.900050] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:00:32.910111] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-21T17:00:34.104952] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T17:00:34.112229] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-21T17:00:34.253150] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T17:00:34.263517] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-21T17:00:34.394392] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T17:00:34.405412] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-21T17:00:34.449119] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T17:00:34.457713] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-21T17:00:35.504639] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T17:00:35.512716] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-21T17:00:35.756758] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T17:00:35.762931] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-21T17:00:36.074236] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:00:36.084781] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-21T17:00:36.811178] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T17:00:36.818392] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-21T17:00:36.831960] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T17:00:36.836620] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-21T17:00:37.106505] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-21T17:00:37.117555] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-21T17:00:37.949037] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T17:00:37.954667] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-21T17:00:38.308709] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T17:00:38.319629] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-21T17:00:38.646120] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T17:00:38.651266] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-21T17:00:38.677034] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:00:38.682553] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-21T17:00:38.895810] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T17:00:38.906979] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-21T17:00:39.984035] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T17:00:39.989895] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-21T17:00:40.109629] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T17:00:40.116608] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-21T17:00:40.260489] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T17:00:40.271553] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-21T17:00:40.839472] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T17:00:40.850419] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-21T17:00:41.048664] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T17:00:41.055362] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-21T17:00:41.206477] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T17:00:41.210299] [INFO ] [REMOTE ] AB: Full fetch complete (44147 records). [2025-10-21T17:00:41.210384] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-21T17:00:41.587547] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-21T17:00:41.587670] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-21T17:00:41.588214] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-21T17:00:41.588260] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-21T17:00:41.589363] [DEBUG] [LOCAL ] AB: Trimmed 44147 records to 24859 (keeping 200 days of data) [2025-10-21T17:00:41.743469] [DEBUG] [LOCAL ] AB: Primary data saved (24859 records). [2025-10-21T17:00:41.743605] [INFO ] [MAIN ] AB: Full history saved. [2025-10-21T17:00:41.743710] [INFO ] [MAIN ] Update Progress: 8/2366 symbols completed. AB took 15.2s. Estimated remaining: 3h 5m 10s. Rate: 12.7 symbols/min [2025-10-21T17:00:41.918097] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:41.948025] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:00:41.959399] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-21T17:00:41.972306] [DEBUG] [LOCAL ] ABG: Loaded 18128 existing records from primary storage. [2025-10-21T17:00:41.972517] [INFO ] [MAIN ] ABG: Loaded 18128 existing records. [2025-10-21T17:00:42.149187] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:42.149460] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-21T17:00:42.149535] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-21T17:00:42.149744] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-21T17:00:42.149804] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-21T17:00:42.523949] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:42.524410] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-21T17:00:42.553490] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T17:00:42.560563] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-21T17:00:42.898874] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T17:00:42.910917] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-21T17:00:43.608576] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:00:43.615294] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-21T17:00:43.672962] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T17:00:43.684542] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-21T17:00:43.705576] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T17:00:43.713686] [INFO ] [REMOTE ] ABCB: Full fetch complete (44891 records). [2025-10-21T17:00:43.713823] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-21T17:00:44.091558] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-21T17:00:44.091668] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-21T17:00:44.092130] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-21T17:00:44.092172] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-21T17:00:44.093098] [DEBUG] [LOCAL ] ABCB: Trimmed 44891 records to 30362 (keeping 200 days of data) [2025-10-21T17:00:44.272142] [DEBUG] [LOCAL ] ABCB: Primary data saved (30362 records). [2025-10-21T17:00:44.272270] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-21T17:00:44.272343] [INFO ] [MAIN ] Update Progress: 9/2366 symbols completed. ABCB took 14.4s. Estimated remaining: 2h 55m 34s. Rate: 13.4 symbols/min [2025-10-21T17:00:44.447839] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:44.479950] [DEBUG] [LOCAL ] ABM: Loaded 32177 existing records from primary storage. [2025-10-21T17:00:44.480215] [INFO ] [MAIN ] ABM: Loaded 32177 existing records. [2025-10-21T17:00:44.665078] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:44.665511] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-21T17:00:44.665691] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-21T17:00:44.674560] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-21T17:00:44.674800] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-21T17:00:44.675595] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T17:00:44.715541] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-21T17:00:45.071797] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:45.066576] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T17:00:45.072112] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-21T17:00:45.084172] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-21T17:00:45.847621] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T17:00:45.859792] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-21T17:00:45.873434] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:00:45.878517] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-21T17:00:46.801703] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T17:00:46.807829] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-21T17:00:46.893181] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T17:00:46.902113] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-21T17:00:46.971861] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T17:00:46.983390] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-21T17:00:47.547863] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:00:47.559125] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-21T17:00:47.726855] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T17:00:47.736692] [INFO ] [REMOTE ] ABBV: Full fetch complete (77846 records). [2025-10-21T17:00:47.736846] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-21T17:00:47.944402] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:00:47.980704] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-21T17:00:48.165930] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T17:00:48.189719] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-21T17:00:48.189833] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-21T17:00:48.190586] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-21T17:00:48.190930] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-21T17:00:48.191016] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-21T17:00:48.193080] [DEBUG] [LOCAL ] ABBV: Trimmed 77846 records to 53682 (keeping 200 days of data) [2025-10-21T17:00:48.519602] [DEBUG] [LOCAL ] ABBV: Primary data saved (53682 records). [2025-10-21T17:00:48.519768] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-21T17:00:48.519845] [INFO ] [MAIN ] Update Progress: 10/2366 symbols completed. ABBV took 20.3s. Estimated remaining: 2h 54m 37s. Rate: 13.5 symbols/min [2025-10-21T17:00:48.686474] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:48.738295] [DEBUG] [LOCAL ] ABR: Loaded 51949 existing records from primary storage. [2025-10-21T17:00:48.738610] [INFO ] [MAIN ] ABR: Loaded 51949 existing records. [2025-10-21T17:00:48.916937] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:48.917961] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-21T17:00:48.918067] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-21T17:00:48.918322] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-21T17:00:48.918410] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-21T17:00:49.162865] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T17:00:49.211906] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-21T17:00:49.343454] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:49.343878] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-21T17:00:49.411334] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T17:00:49.423511] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-21T17:00:49.445225] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:00:49.452828] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-21T17:00:50.060478] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T17:00:50.065275] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-21T17:00:50.972141] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:00:50.980341] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-21T17:00:51.042424] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T17:00:51.051272] [INFO ] [REMOTE ] ABEV: Full fetch complete (77342 records). [2025-10-21T17:00:51.051392] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-21T17:00:51.366341] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T17:00:51.376637] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-21T17:00:51.469408] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-21T17:00:51.484070] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-21T17:00:51.485614] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-21T17:00:51.495071] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-21T17:00:51.496919] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-21T17:00:51.507182] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-21T17:00:51.508472] [DEBUG] [LOCAL ] ABEV: Trimmed 77342 records to 53287 (keeping 200 days of data) [2025-10-21T17:00:51.809111] [DEBUG] [LOCAL ] ABEV: Primary data saved (53287 records). [2025-10-21T17:00:51.809438] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-21T17:00:51.809699] [INFO ] [MAIN ] Update Progress: 11/2366 symbols completed. ABEV took 20.1s. Estimated remaining: 2h 50m 25s. Rate: 13.8 symbols/min [2025-10-21T17:00:51.939625] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T17:00:51.966748] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-21T17:00:52.021803] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:52.072395] [DEBUG] [LOCAL ] ABT: Loaded 53622 existing records from primary storage. [2025-10-21T17:00:52.072744] [INFO ] [MAIN ] ABT: Loaded 53622 existing records. [2025-10-21T17:00:52.271188] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:00:52.271447] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-21T17:00:52.271506] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-21T17:00:52.271751] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-21T17:00:52.271819] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-21T17:00:52.664023] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:52.674179] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-21T17:00:52.675269] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T17:00:52.680757] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-21T17:00:53.510519] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T17:00:53.524786] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-21T17:00:53.525545] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T17:00:53.529310] [INFO ] [REMOTE ] ABG: Full fetch complete (26609 records). [2025-10-21T17:00:53.529398] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-21T17:00:53.529951] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:00:53.530096] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:00:53.530139] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:00:53.530207] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-21T17:00:53.530269] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-21T17:00:53.530304] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-21T17:00:53.530504] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-10-21T17:00:53.530595] [INFO ] [MAIN ] Update Progress: 12/2366 symbols completed. ABG took 11.8s. Estimated remaining: 2h 41m 46s. Rate: 14.6 symbols/min [2025-10-21T17:00:53.703917] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:53.704088] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-21T17:00:53.704124] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-21T17:00:53.704231] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-21T17:00:53.704271] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-21T17:00:53.704311] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-21T17:00:53.704342] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-21T17:00:54.073311] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:00:54.073626] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-21T17:00:54.292023] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-10-21T17:00:54.302074] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-21T17:00:55.048108] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T17:00:55.099620] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-21T17:00:55.105835] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-21T17:00:55.123173] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-21T17:00:55.344039] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:00:55.349951] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-21T17:00:56.289853] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:00:56.302470] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-21T17:00:56.472434] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:00:56.480299] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-21T17:00:56.538127] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T17:00:56.543431] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-21T17:00:56.932510] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:00:56.942682] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-21T17:00:57.619225] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:00:57.625878] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-21T17:00:57.706023] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T17:00:57.718437] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-21T17:00:58.112078] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:00:58.123356] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-21T17:00:58.813845] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:00:58.824825] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-21T17:00:58.996490] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T17:00:59.002606] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-21T17:00:59.100128] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:00:59.105288] [INFO ] [REMOTE ] ABM: Full fetch complete (44982 records). [2025-10-21T17:00:59.105389] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-21T17:00:59.484038] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-21T17:00:59.484161] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-21T17:00:59.484611] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-21T17:00:59.484706] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-21T17:00:59.485621] [DEBUG] [LOCAL ] ABM: Trimmed 44982 records to 32115 (keeping 200 days of data) [2025-10-21T17:00:59.679156] [DEBUG] [LOCAL ] ABM: Primary data saved (32115 records). [2025-10-21T17:00:59.679283] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-21T17:00:59.679363] [INFO ] [MAIN ] Update Progress: 13/2366 symbols completed. ABM took 15.4s. Estimated remaining: 2h 47m 49s. Rate: 14.0 symbols/min [2025-10-21T17:00:59.855544] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:00:59.888449] [DEBUG] [LOCAL ] ACCO: Loaded 36838 existing records from primary storage. [2025-10-21T17:00:59.894054] [INFO ] [MAIN ] ACCO: Loaded 36838 existing records. [2025-10-21T17:00:59.981143] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T17:01:00.034944] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-21T17:01:00.096253] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:00.096631] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-21T17:01:00.096806] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-21T17:01:00.097238] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-21T17:01:00.097377] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-21T17:01:00.309245] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-21T17:01:00.428759] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-21T17:01:00.518739] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:00.519054] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-21T17:01:00.799799] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T17:01:00.811185] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-21T17:01:01.276381] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T17:01:01.282144] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-21T17:01:01.949436] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T17:01:01.958246] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-21T17:01:02.102351] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:01:02.113251] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-21T17:01:02.494176] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:01:02.499471] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-21T17:01:02.681470] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:01:02.693060] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-21T17:01:02.961800] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T17:01:02.969110] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-21T17:01:03.637638] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:01:03.644271] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-21T17:01:03.740128] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T17:01:03.751380] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-21T17:01:04.227712] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T17:01:04.236444] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-21T17:01:04.315923] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:01:04.505890] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T17:01:04.951111] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-21T17:01:05.621028] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T17:01:05.750998] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-21T17:01:05.847589] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T17:01:05.988310] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T17:01:05.991868] [INFO ] [REMOTE ] ACA: Full fetch complete (34151 records). [2025-10-21T17:01:05.991987] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-21T17:01:05.992575] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:01:05.992682] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:01:05.992735] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:01:05.992802] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-21T17:01:05.992869] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-21T17:01:05.992905] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-21T17:01:05.992942] [DEBUG] [LOCAL ] ACA: No derivative data file found to delete. [2025-10-21T17:01:05.992995] [INFO ] [MAIN ] Update Progress: 14/2366 symbols completed. ACA took 12.5s. Estimated remaining: 2h 53m 26s. Rate: 13.6 symbols/min [2025-10-21T17:01:06.166337] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:06.212790] [DEBUG] [LOCAL ] ACEL: Loaded 26577 existing records from primary storage. [2025-10-21T17:01:06.213081] [INFO ] [MAIN ] ACEL: Loaded 26577 existing records. [2025-10-21T17:01:06.395871] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:06.396297] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-21T17:01:06.396346] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-21T17:01:06.396802] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-21T17:01:06.396861] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-21T17:01:06.557575] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-21T17:01:06.770769] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:07.351066] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-21T17:01:07.592933] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T17:01:07.743135] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:01:08.151137] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-21T17:01:08.951007] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-21T17:01:09.358835] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T17:01:09.450715] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T17:01:09.751103] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-21T17:01:09.995315] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:01:10.551084] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-21T17:01:11.351080] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-21T17:01:11.735950] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T17:01:11.744741] [INFO ] [REMOTE ] ABR: Full fetch complete (75397 records). [2025-10-21T17:01:11.744905] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-21T17:01:11.958810] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T17:01:12.156326] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-21T17:01:12.207424] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-21T17:01:12.207510] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-21T17:01:12.208303] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-21T17:01:12.208401] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-21T17:01:12.209938] [DEBUG] [LOCAL ] ABR: Trimmed 75397 records to 51919 (keeping 200 days of data) [2025-10-21T17:01:12.545723] [DEBUG] [LOCAL ] ABR: Primary data saved (51919 records). [2025-10-21T17:01:12.545869] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-21T17:01:12.545952] [INFO ] [MAIN ] Update Progress: 15/2366 symbols completed. ABR took 24.0s. Estimated remaining: 2h 58m 55s. Rate: 13.1 symbols/min [2025-10-21T17:01:12.720911] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:12.769963] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-21T17:01:12.770332] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-21T17:01:12.952968] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-21T17:01:12.956703] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:12.958115] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-21T17:01:12.958508] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-21T17:01:12.958863] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-21T17:01:12.958930] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-21T17:01:13.353452] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:01:13.370993] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:13.751075] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-21T17:01:13.827614] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T17:01:14.517055] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T17:01:14.551039] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-21T17:01:15.351052] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-21T17:01:15.536570] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:01:15.990625] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T17:01:16.151079] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-21T17:01:16.769008] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:01:16.867952] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T17:01:16.877721] [INFO ] [REMOTE ] ABT: Full fetch complete (77770 records). [2025-10-21T17:01:16.877907] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-21T17:01:16.956181] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-21T17:01:17.409431] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-21T17:01:17.409585] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-21T17:01:17.410909] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-21T17:01:17.411000] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-21T17:01:17.413116] [DEBUG] [LOCAL ] ABT: Trimmed 77770 records to 53623 (keeping 200 days of data) [2025-10-21T17:01:17.751114] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-21T17:01:17.843135] [DEBUG] [LOCAL ] ABT: Primary data saved (53623 records). [2025-10-21T17:01:17.843284] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-21T17:01:17.843367] [INFO ] [MAIN ] Update Progress: 16/2366 symbols completed. ABT took 26.0s. Estimated remaining: 3h 0m 38s. Rate: 13.0 symbols/min [2025-10-21T17:01:18.033283] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:18.033519] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-10-21T17:01:18.033567] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-10-21T17:01:18.033721] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-21T17:01:18.033776] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-21T17:01:18.033821] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-21T17:01:18.033854] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-21T17:01:18.411173] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:18.432220] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T17:01:18.551037] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-21T17:01:19.083155] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T17:01:19.351049] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-21T17:01:20.151054] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-21T17:01:20.430924] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:01:20.487968] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:01:20.951107] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-21T17:01:21.751115] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-21T17:01:22.551145] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-21T17:01:22.638230] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:01:22.756139] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-21T17:01:23.132844] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:01:23.139241] [INFO ] [REMOTE ] ACCO: Full fetch complete (53994 records). [2025-10-21T17:01:23.139392] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-21T17:01:23.356936] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-21T17:01:23.603189] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-21T17:01:23.603338] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-21T17:01:23.604314] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-21T17:01:23.604425] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-21T17:01:23.605802] [DEBUG] [LOCAL ] ACCO: Trimmed 53994 records to 36747 (keeping 200 days of data) [2025-10-21T17:01:23.714824] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:01:23.849531] [DEBUG] [LOCAL ] ACCO: Primary data saved (36747 records). [2025-10-21T17:01:23.849728] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-21T17:01:23.849879] [INFO ] [MAIN ] Update Progress: 17/2366 symbols completed. ACCO took 24.2s. Estimated remaining: 3h 3m 46s. Rate: 12.8 symbols/min [2025-10-21T17:01:24.041893] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:24.083465] [DEBUG] [LOCAL ] ACM: Loaded 42890 existing records from primary storage. [2025-10-21T17:01:24.083812] [INFO ] [MAIN ] ACM: Loaded 42890 existing records. [2025-10-21T17:01:24.159631] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-21T17:01:24.271173] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:24.271380] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-21T17:01:24.271427] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-21T17:01:24.271621] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-21T17:01:24.271701] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-21T17:01:24.637765] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:24.951094] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-21T17:01:25.397391] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:01:25.751052] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-21T17:01:25.939914] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-21T17:01:26.529748] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:01:26.550989] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-21T17:01:26.843114] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T17:01:27.351055] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-21T17:01:28.151008] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-21T17:01:28.541007] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T17:01:28.545069] [INFO ] [REMOTE ] ACEL: Full fetch complete (38697 records). [2025-10-21T17:01:28.545182] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-21T17:01:28.934068] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-21T17:01:28.934173] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-21T17:01:28.934779] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-21T17:01:28.934900] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-21T17:01:28.936085] [DEBUG] [LOCAL ] ACEL: Trimmed 38697 records to 26474 (keeping 200 days of data) [2025-10-21T17:01:28.992480] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-21T17:01:29.141843] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-21T17:01:29.140173] [DEBUG] [LOCAL ] ACEL: Primary data saved (26474 records). [2025-10-21T17:01:29.153800] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-21T17:01:29.154323] [INFO ] [MAIN ] Update Progress: 18/2366 symbols completed. ACEL took 23.2s. Estimated remaining: 3h 5m 1s. Rate: 12.7 symbols/min [2025-10-21T17:01:29.329599] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:29.392374] [DEBUG] [LOCAL ] ACN: Loaded 53440 existing records from primary storage. [2025-10-21T17:01:29.392842] [INFO ] [MAIN ] ACN: Loaded 53440 existing records. [2025-10-21T17:01:29.589067] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:29.589372] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-21T17:01:29.589442] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-21T17:01:29.589685] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-21T17:01:29.589754] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-21T17:01:29.753169] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-21T17:01:29.978957] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:30.017788] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:01:30.551000] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-21T17:01:30.608938] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T17:01:31.351052] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-21T17:01:32.156229] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-21T17:01:32.184953] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-21T17:01:32.732421] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T17:01:32.951023] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-21T17:01:33.142343] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T17:01:33.751001] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-21T17:01:33.847014] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:01:34.551081] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-21T17:01:35.351004] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-21T17:01:35.626109] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T17:01:35.708630] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-10-21T17:01:35.934568] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:01:36.151032] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-21T17:01:36.949792] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T17:01:36.958629] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-21T17:01:37.751163] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-21T17:01:38.260607] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-21T17:01:38.551078] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-21T17:01:38.722085] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:01:39.351083] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-21T17:01:40.151138] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-21T17:01:40.398015] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-21T17:01:40.596137] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T17:01:40.951080] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-21T17:01:40.988214] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:01:41.650622] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T17:01:41.751092] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-21T17:01:42.551072] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-21T17:01:43.351093] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-21T17:01:43.383678] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T17:01:43.749899] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-10-21T17:01:44.151186] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-21T17:01:44.439957] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:01:44.951242] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-21T17:01:45.354369] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:01:45.751027] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-21T17:01:46.550999] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-21T17:01:46.662321] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T17:01:46.782670] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-21T17:01:47.351088] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-21T17:01:47.621166] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T17:01:48.151024] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-21T17:01:48.418071] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T17:01:48.951863] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-21T17:01:48.957504] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:01:49.751095] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-21T17:01:50.240814] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T17:01:50.249306] [INFO ] [REMOTE ] ACI: Full fetch complete (77233 records). [2025-10-21T17:01:50.249473] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-21T17:01:50.552147] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-21T17:01:50.654766] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-21T17:01:50.654858] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-21T17:01:50.655575] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-21T17:01:50.655621] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-21T17:01:50.657421] [DEBUG] [LOCAL ] ACI: Trimmed 77233 records to 53286 (keeping 200 days of data) [2025-10-21T17:01:50.986337] [DEBUG] [LOCAL ] ACI: Primary data saved (53286 records). [2025-10-21T17:01:50.986464] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-21T17:01:50.986553] [INFO ] [MAIN ] Update Progress: 19/2366 symbols completed. ACI took 33.1s. Estimated remaining: 3h 40m 9s. Rate: 10.7 symbols/min [2025-10-21T17:01:51.163026] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:51.203907] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T17:01:51.226661] [DEBUG] [LOCAL ] ACP: Loaded 31109 existing records from primary storage. [2025-10-21T17:01:51.226935] [INFO ] [MAIN ] ACP: Loaded 31109 existing records. [2025-10-21T17:01:51.365582] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-21T17:01:51.407395] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:01:51.407745] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-21T17:01:51.407843] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-21T17:01:51.408133] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-21T17:01:51.408264] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-21T17:01:51.714883] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:01:51.801533] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:52.151132] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-21T17:01:52.951060] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-21T17:01:53.075241] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-21T17:01:53.503057] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T17:01:53.751115] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-21T17:01:53.868164] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T17:01:54.551087] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-21T17:01:54.664401] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:01:54.671726] [INFO ] [REMOTE ] ACM: Full fetch complete (63285 records). [2025-10-21T17:01:54.671888] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-21T17:01:55.096934] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-21T17:01:55.097026] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-21T17:01:55.097688] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-21T17:01:55.097752] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-21T17:01:55.099237] [DEBUG] [LOCAL ] ACM: Trimmed 63285 records to 42827 (keeping 200 days of data) [2025-10-21T17:01:55.351912] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-21T17:01:55.388227] [DEBUG] [LOCAL ] ACM: Primary data saved (42827 records). [2025-10-21T17:01:55.388677] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-21T17:01:55.390874] [INFO ] [MAIN ] Update Progress: 20/2366 symbols completed. ACM took 31.5s. Estimated remaining: 3h 37m 40s. Rate: 10.8 symbols/min [2025-10-21T17:01:55.581093] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:55.581472] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-21T17:01:55.581589] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-21T17:01:55.581793] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-21T17:01:55.582028] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-21T17:01:55.582205] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-21T17:01:55.582353] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-21T17:01:55.714010] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T17:01:55.990637] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:56.112466] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-21T17:01:56.120470] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-21T17:01:56.120611] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-21T17:01:56.121429] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:01:56.121515] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:01:56.121557] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:01:56.121624] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-21T17:01:56.121745] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-21T17:01:56.121825] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-21T17:01:56.121948] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-10-21T17:01:56.122020] [INFO ] [MAIN ] Update Progress: 21/2366 symbols completed. ACHR took 43.6s. Estimated remaining: 3h 28m 35s. Rate: 11.2 symbols/min [2025-10-21T17:01:56.156150] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-21T17:01:56.299600] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:56.299798] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-10-21T17:01:56.299841] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-10-21T17:01:56.299954] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-21T17:01:56.299995] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-21T17:01:56.300036] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-21T17:01:56.300067] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-21T17:01:56.656494] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:01:56.954075] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-21T17:01:56.954898] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T17:01:57.546261] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-21T17:01:57.751050] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-21T17:01:58.303321] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:01:58.409701] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T17:01:58.418671] [INFO ] [REMOTE ] ACN: Full fetch complete (77405 records). [2025-10-21T17:01:58.418821] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-21T17:01:58.556099] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-21T17:01:58.863040] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-21T17:01:58.863127] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-21T17:01:58.863852] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-21T17:01:58.863918] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-21T17:01:58.865422] [DEBUG] [LOCAL ] ACN: Trimmed 77405 records to 53440 (keeping 200 days of data) [2025-10-21T17:01:59.242330] [DEBUG] [LOCAL ] ACN: Primary data saved (53440 records). [2025-10-21T17:01:59.242480] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-21T17:01:59.244267] [INFO ] [MAIN ] Update Progress: 22/2366 symbols completed. ACN took 30.1s. Estimated remaining: 3h 24m 33s. Rate: 11.5 symbols/min [2025-10-21T17:01:59.351068] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-21T17:01:59.425701] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:01:59.425858] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-21T17:01:59.425897] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-21T17:01:59.426006] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-21T17:01:59.426049] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-21T17:01:59.426091] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-21T17:01:59.426125] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-21T17:01:59.803824] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:00.149240] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:02:00.157358] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-21T17:02:00.385947] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T17:02:00.951044] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-21T17:02:01.704419] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T17:02:01.751006] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-21T17:02:02.160981] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T17:02:02.551095] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-21T17:02:03.351053] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-21T17:02:03.505074] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T17:02:03.505274] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:02:04.151069] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-21T17:02:04.805526] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:02:04.852817] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T17:02:04.951063] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-21T17:02:05.751040] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-21T17:02:06.425089] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T17:02:06.551041] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-21T17:02:06.563445] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T17:02:07.351054] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-21T17:02:07.944770] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T17:02:08.011760] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T17:02:08.151039] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-21T17:02:08.951054] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-21T17:02:09.529680] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T17:02:09.751049] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-21T17:02:09.774410] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T17:02:10.551029] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-21T17:02:11.113469] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T17:02:11.322957] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T17:02:11.350997] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-21T17:02:11.951504] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T17:02:12.151018] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-21T17:02:12.792953] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T17:02:12.951056] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-21T17:02:13.594442] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T17:02:13.751084] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-21T17:02:14.378244] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T17:02:14.551063] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-21T17:02:15.161283] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T17:02:15.351028] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-21T17:02:15.938760] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T17:02:16.151042] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-21T17:02:16.951026] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-21T17:02:17.594787] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T17:02:17.635159] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T17:02:17.751037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-21T17:02:18.375152] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T17:02:18.551046] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-21T17:02:19.006550] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T17:02:19.351037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-21T17:02:19.967056] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T17:02:20.151042] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-21T17:02:20.951029] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-21T17:02:21.459857] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T17:02:21.474231] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T17:02:21.751034] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-21T17:02:22.551109] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-21T17:02:22.676373] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:02:22.678632] [INFO ] [REMOTE ] ACV: Full fetch complete (10460 records). [2025-10-21T17:02:22.678741] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-21T17:02:23.098818] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-21T17:02:23.098928] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-21T17:02:23.099156] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-21T17:02:23.099200] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-21T17:02:23.099688] [DEBUG] [LOCAL ] ACV: Trimmed 10460 records to 7423 (keeping 200 days of data) [2025-10-21T17:02:23.149224] [DEBUG] [LOCAL ] ACV: Primary data saved (7423 records). [2025-10-21T17:02:23.149392] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-21T17:02:23.149496] [INFO ] [MAIN ] Update Progress: 23/2366 symbols completed. ACV took 23.9s. Estimated remaining: 3h 56m 10s. Rate: 9.9 symbols/min [2025-10-21T17:02:23.321122] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:23.351944] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-21T17:02:23.376898] [DEBUG] [LOCAL ] ACVA: Loaded 49252 existing records from primary storage. [2025-10-21T17:02:23.377212] [INFO ] [MAIN ] ACVA: Loaded 49252 existing records. [2025-10-21T17:02:23.569104] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:02:23.569428] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-21T17:02:23.569613] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-21T17:02:23.569927] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-21T17:02:23.569985] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-21T17:02:23.705612] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T17:02:23.758003] [INFO ] [REMOTE ] ACP: Full fetch complete (46437 records). [2025-10-21T17:02:23.784215] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-21T17:02:24.182065] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:24.160272] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-21T17:02:24.387551] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-21T17:02:24.387665] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-21T17:02:24.388174] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-21T17:02:24.388220] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-21T17:02:24.389345] [DEBUG] [LOCAL ] ACP: Trimmed 46437 records to 31078 (keeping 200 days of data) [2025-10-21T17:02:24.567354] [DEBUG] [LOCAL ] ACP: Primary data saved (31078 records). [2025-10-21T17:02:24.567539] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-21T17:02:24.567629] [INFO ] [MAIN ] Update Progress: 24/2366 symbols completed. ACP took 33.6s. Estimated remaining: 3h 48m 32s. Rate: 10.2 symbols/min [2025-10-21T17:02:24.737871] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:24.738157] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-21T17:02:24.738223] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-21T17:02:24.738458] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-21T17:02:24.738515] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-21T17:02:24.738573] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-21T17:02:24.738619] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-21T17:02:24.956083] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-21T17:02:25.016752] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:02:25.133039] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:25.136206] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T17:02:25.137252] [INFO ] [REMOTE ] ACR: Full fetch complete (8529 records). [2025-10-21T17:02:25.137320] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-21T17:02:25.137666] [FATAL] [VALIDATOR ] ACR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:02:25.137747] [FATAL] [MAIN ] ACR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:02:25.137790] [WARN ] [MAIN ] ACR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:02:25.137855] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-21T17:02:25.137915] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-21T17:02:25.137950] [INFO ] [LOCAL ] ACR: Starting deletion of derivative data. [2025-10-21T17:02:25.137988] [DEBUG] [LOCAL ] ACR: No derivative data file found to delete. [2025-10-21T17:02:25.138040] [INFO ] [MAIN ] Update Progress: 25/2366 symbols completed. ACR took 29.7s. Estimated remaining: 3h 40m 11s. Rate: 10.6 symbols/min [2025-10-21T17:02:25.306244] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:25.357421] [DEBUG] [LOCAL ] ADC: Loaded 46431 existing records from primary storage. [2025-10-21T17:02:25.357795] [INFO ] [MAIN ] ADC: Loaded 46431 existing records. [2025-10-21T17:02:25.535171] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:02:25.535410] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-21T17:02:25.535458] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-21T17:02:25.535630] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-21T17:02:25.535715] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-21T17:02:25.756178] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-21T17:02:25.895191] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:26.026404] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:02:26.026833] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-21T17:02:26.026933] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:02:26.027015] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-21T17:02:26.027088] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:02:26.027171] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-21T17:02:26.027250] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-21T17:02:26.027312] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-21T17:02:26.027396] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-21T17:02:26.027482] [INFO ] [MAIN ] Update Progress: 26/2366 symbols completed. AD took 1.5s. Estimated remaining: 3h 32m 58s. Rate: 11.0 symbols/min [2025-10-21T17:02:26.222123] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:26.222266] [DEBUG] [LOCAL ] ADCT: No existing data file found in primary storage. [2025-10-21T17:02:26.222302] [WARN ] [MAIN ] ADCT: No existing data found, performing full refresh instead. [2025-10-21T17:02:26.222410] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-21T17:02:26.222451] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-21T17:02:26.222491] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-10-21T17:02:26.222523] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-21T17:02:26.556242] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-21T17:02:26.621584] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:26.694987] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:02:27.351221] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-21T17:02:28.151192] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-21T17:02:28.223158] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T17:02:28.803983] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T17:02:28.951110] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-21T17:02:29.582587] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:02:29.751061] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-21T17:02:30.560220] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-21T17:02:30.586814] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T17:02:31.303419] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T17:02:31.351034] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-21T17:02:31.935692] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:02:32.151020] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-21T17:02:32.741627] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T17:02:32.951019] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-21T17:02:33.759546] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-21T17:02:33.765899] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:02:34.560620] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-21T17:02:34.598281] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:02:35.266284] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T17:02:35.351023] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-21T17:02:36.151046] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-21T17:02:36.279323] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T17:02:36.703345] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T17:02:36.708605] [INFO ] [REMOTE ] ACRE: Full fetch complete (49397 records). [2025-10-21T17:02:36.708786] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-21T17:02:36.709394] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:02:36.709486] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:02:36.709531] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:02:36.709594] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-21T17:02:36.709714] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-10-21T17:02:36.709780] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-10-21T17:02:36.709836] [DEBUG] [LOCAL ] ACRE: No derivative data file found to delete. [2025-10-21T17:02:36.709913] [INFO ] [MAIN ] Update Progress: 27/2366 symbols completed. ACRE took 40.6s. Estimated remaining: 3h 40m 25s. Rate: 10.6 symbols/min [2025-10-21T17:02:36.879855] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:36.880013] [DEBUG] [LOCAL ] ADM: No existing data file found in primary storage. [2025-10-21T17:02:36.880049] [WARN ] [MAIN ] ADM: No existing data found, performing full refresh instead. [2025-10-21T17:02:36.880159] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-21T17:02:36.880227] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-21T17:02:36.880290] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-10-21T17:02:36.880335] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-21T17:02:36.956219] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-21T17:02:37.244635] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:37.363669] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T17:02:37.751040] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-21T17:02:38.305754] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T17:02:38.551053] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-21T17:02:39.351079] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-21T17:02:39.536075] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T17:02:39.996497] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T17:02:40.151102] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-21T17:02:40.951102] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-21T17:02:41.658096] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T17:02:41.751052] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-21T17:02:42.551078] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-21T17:02:42.684961] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T17:02:42.883844] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T17:02:43.351072] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-21T17:02:43.998869] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T17:02:44.091978] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (4.74 seconds). [2025-10-21T17:02:44.151035] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-21T17:02:44.670773] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T17:02:44.951087] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-21T17:02:45.751097] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-21T17:02:46.098753] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:02:46.551130] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-21T17:02:46.650096] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:02:47.358057] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-21T17:02:47.363296] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:02:48.026428] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:02:48.151053] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-21T17:02:48.951050] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-21T17:02:49.154837] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T17:02:49.751086] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-21T17:02:50.551054] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-21T17:02:50.773961] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T17:02:51.190701] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:02:51.351002] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-21T17:02:51.647440] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (3.50 seconds). [2025-10-21T17:02:52.151045] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-21T17:02:52.652581] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T17:02:52.660542] [INFO ] [REMOTE ] ACVA: Full fetch complete (71017 records). [2025-10-21T17:02:52.660713] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-21T17:02:52.959342] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-21T17:02:53.071034] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-21T17:02:53.071161] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-21T17:02:53.071888] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-21T17:02:53.071951] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-21T17:02:53.073306] [DEBUG] [LOCAL ] ACVA: Trimmed 71017 records to 49262 (keeping 200 days of data) [2025-10-21T17:02:53.372281] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T17:02:53.386318] [DEBUG] [LOCAL ] ACVA: Primary data saved (49262 records). [2025-10-21T17:02:53.386428] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-21T17:02:53.386501] [INFO ] [MAIN ] Update Progress: 28/2366 symbols completed. ACVA took 30.2s. Estimated remaining: 3h 55m 40s. Rate: 9.9 symbols/min [2025-10-21T17:02:53.568915] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:02:53.608681] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T17:02:53.631549] [DEBUG] [LOCAL ] ADNT: Loaded 46530 existing records from primary storage. [2025-10-21T17:02:53.631895] [INFO ] [MAIN ] ADNT: Loaded 46530 existing records. [2025-10-21T17:02:53.756124] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-21T17:02:53.811503] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:02:53.811702] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-21T17:02:53.811757] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-21T17:02:53.811997] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-21T17:02:53.812035] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-21T17:02:54.161059] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:02:54.551080] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-21T17:02:54.987375] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T17:02:55.351050] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-21T17:02:55.385314] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T17:02:56.151022] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-21T17:02:56.288167] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:02:56.957553] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-21T17:02:56.961024] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T17:02:57.751110] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-21T17:02:58.170444] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T17:02:58.306141] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T17:02:58.551043] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-21T17:02:59.277204] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:02:59.284526] [INFO ] [REMOTE ] ADCT: Full fetch complete (51441 records). [2025-10-21T17:02:59.284757] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-21T17:02:59.356165] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-21T17:02:59.684510] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-21T17:02:59.684596] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-21T17:02:59.685127] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-21T17:02:59.685192] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-21T17:02:59.686288] [DEBUG] [LOCAL ] ADCT: Trimmed 51441 records to 35445 (keeping 200 days of data) [2025-10-21T17:02:59.896914] [DEBUG] [LOCAL ] ADCT: Primary data saved (35445 records). [2025-10-21T17:02:59.897146] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-21T17:02:59.897237] [INFO ] [MAIN ] Update Progress: 29/2366 symbols completed. ADCT took 33.9s. Estimated remaining: 3h 56m 11s. Rate: 9.9 symbols/min [2025-10-21T17:03:00.087959] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:00.143440] [DEBUG] [LOCAL ] ADT: Loaded 53438 existing records from primary storage. [2025-10-21T17:03:00.143786] [INFO ] [MAIN ] ADT: Loaded 53438 existing records. [2025-10-21T17:03:00.175858] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-21T17:03:00.300660] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:03:00.342444] [INFO ] [REMOTE ] ADC: Full fetch complete (66676 records). [2025-10-21T17:03:00.361991] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-21T17:03:00.361911] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:00.362259] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-21T17:03:00.362316] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-21T17:03:00.394984] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-21T17:03:00.427567] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-21T17:03:01.150251] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-21T17:03:01.165174] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-21T17:03:01.171320] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-21T17:03:01.170441] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:01.171490] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-21T17:03:01.171853] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-21T17:03:01.173846] [DEBUG] [LOCAL ] ADC: Trimmed 66676 records to 46430 (keeping 200 days of data) [2025-10-21T17:03:01.466426] [DEBUG] [LOCAL ] ADC: Primary data saved (46430 records). [2025-10-21T17:03:01.466562] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-21T17:03:01.467756] [INFO ] [MAIN ] Update Progress: 30/2366 symbols completed. ADC took 36.3s. Estimated remaining: 3h 50m 15s. Rate: 10.1 symbols/min [2025-10-21T17:03:01.651409] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:01.685927] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-21T17:03:01.718434] [DEBUG] [LOCAL ] ADX: Loaded 27841 existing records from primary storage. [2025-10-21T17:03:01.718718] [INFO ] [MAIN ] ADX: Loaded 27841 existing records. [2025-10-21T17:03:01.762515] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-21T17:03:01.915981] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:01.916252] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-21T17:03:01.916306] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-21T17:03:01.917545] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-21T17:03:01.917606] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-21T17:03:02.286440] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-21T17:03:02.353886] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:02.551040] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-21T17:03:03.319614] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-21T17:03:03.350981] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-21T17:03:03.628951] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:03:03.729419] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T17:03:04.151086] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-21T17:03:04.951010] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-21T17:03:05.008242] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:03:05.419209] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:03:05.509688] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T17:03:05.518194] [INFO ] [REMOTE ] ADM: Full fetch complete (77456 records). [2025-10-21T17:03:05.518369] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-21T17:03:05.756226] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-21T17:03:05.965824] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-21T17:03:05.966000] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-21T17:03:05.967035] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-21T17:03:05.967129] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-21T17:03:05.969071] [DEBUG] [LOCAL ] ADM: Trimmed 77456 records to 53400 (keeping 200 days of data) [2025-10-21T17:03:06.293418] [DEBUG] [LOCAL ] ADM: Primary data saved (53400 records). [2025-10-21T17:03:06.293555] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-21T17:03:06.293629] [INFO ] [MAIN ] Update Progress: 31/2366 symbols completed. ADM took 29.6s. Estimated remaining: 3h 48m 47s. Rate: 10.2 symbols/min [2025-10-21T17:03:06.467171] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:06.512636] [DEBUG] [LOCAL ] AEE: Loaded 50155 existing records from primary storage. [2025-10-21T17:03:06.512979] [INFO ] [MAIN ] AEE: Loaded 50155 existing records. [2025-10-21T17:03:06.558059] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-21T17:03:06.704327] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:06.704550] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-21T17:03:06.704602] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-21T17:03:06.705711] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-21T17:03:06.705770] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-21T17:03:07.078425] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:07.350996] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-21T17:03:07.705416] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:03:08.077494] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:03:08.151041] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-21T17:03:08.951036] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-21T17:03:08.990666] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:03:09.435711] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-21T17:03:09.751040] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-21T17:03:10.551055] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-21T17:03:10.810759] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T17:03:11.059475] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:03:11.351025] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-21T17:03:12.151005] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-21T17:03:12.309594] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T17:03:12.489431] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:03:12.951045] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-21T17:03:13.718535] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T17:03:13.750995] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-21T17:03:14.551073] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-21T17:03:14.725225] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T17:03:15.014729] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T17:03:15.351027] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-21T17:03:16.151006] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-21T17:03:16.380728] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T17:03:16.774862] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:03:16.951027] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-21T17:03:17.753265] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-21T17:03:17.759147] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:03:18.282362] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T17:03:18.551026] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-21T17:03:19.351022] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-21T17:03:19.704231] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T17:03:19.915823] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:03:20.151039] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-21T17:03:20.951009] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-21T17:03:21.258839] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T17:03:21.587388] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T17:03:21.751106] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-21T17:03:22.483154] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:03:22.551111] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-21T17:03:23.143030] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T17:03:23.351049] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-21T17:03:23.960059] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T17:03:24.151049] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-21T17:03:24.951034] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-21T17:03:25.241928] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T17:03:25.751007] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-21T17:03:25.942817] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:03:26.521437] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T17:03:26.527765] [INFO ] [REMOTE ] ADNT: Full fetch complete (67653 records). [2025-10-21T17:03:26.527892] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-21T17:03:26.528566] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:03:26.528688] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:03:26.528744] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:03:26.528786] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-21T17:03:26.528844] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-21T17:03:26.528881] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-10-21T17:03:26.529042] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-10-21T17:03:26.529130] [INFO ] [MAIN ] Update Progress: 32/2366 symbols completed. ADNT took 33.1s. Estimated remaining: 4h 6m 8s. Rate: 9.5 symbols/min [2025-10-21T17:03:26.556142] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-21T17:03:26.723423] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:26.734621] [DEBUG] [LOCAL ] AEFC: Loaded 8025 existing records from primary storage. [2025-10-21T17:03:26.734857] [INFO ] [MAIN ] AEFC: Loaded 8025 existing records. [2025-10-21T17:03:26.928946] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:26.929208] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-21T17:03:26.929282] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-21T17:03:26.929479] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-21T17:03:26.929545] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-21T17:03:27.326612] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:27.358780] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-21T17:03:27.367440] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T17:03:27.443929] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T17:03:28.110857] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T17:03:28.151023] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-21T17:03:28.951078] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-21T17:03:29.751046] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-21T17:03:29.943751] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T17:03:30.363504] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T17:03:30.391770] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T17:03:30.551031] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-21T17:03:31.351031] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-21T17:03:32.151001] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-21T17:03:32.223371] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T17:03:32.951001] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-21T17:03:33.153055] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T17:03:33.161549] [INFO ] [REMOTE ] ADT: Full fetch complete (77360 records). [2025-10-21T17:03:33.161730] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-21T17:03:33.570040] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-21T17:03:33.570190] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-21T17:03:33.570989] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-21T17:03:33.571077] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-21T17:03:33.572563] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T17:03:33.577778] [INFO ] [REMOTE ] ADX: Full fetch complete (41925 records). [2025-10-21T17:03:33.577875] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-21T17:03:33.578058] [DEBUG] [LOCAL ] ADT: Trimmed 77360 records to 53436 (keeping 200 days of data) [2025-10-21T17:03:33.764034] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-21T17:03:34.200597] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-21T17:03:34.203751] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-21T17:03:34.204333] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-21T17:03:34.234940] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-21T17:03:34.259525] [DEBUG] [LOCAL ] ADX: Trimmed 41925 records to 27734 (keeping 200 days of data) [2025-10-21T17:03:34.376920] [DEBUG] [LOCAL ] ADT: Primary data saved (53436 records). [2025-10-21T17:03:34.384553] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-21T17:03:34.384757] [INFO ] [MAIN ] Update Progress: 33/2366 symbols completed. ADT took 34.5s. Estimated remaining: 4h 7m 50s. Rate: 9.4 symbols/min [2025-10-21T17:03:34.573823] [DEBUG] [LOCAL ] ADX: Primary data saved (27734 records). [2025-10-21T17:03:34.634217] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:34.630541] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-21T17:03:34.660150] [INFO ] [MAIN ] Update Progress: 34/2366 symbols completed. ADX took 33.2s. Estimated remaining: 4h 0m 45s. Rate: 9.7 symbols/min [2025-10-21T17:03:34.660716] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T17:03:34.662137] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:03:34.681150] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-21T17:03:34.773532] [INFO ] [REMOTE ] AEE: Full fetch complete (73025 records). [2025-10-21T17:03:34.787224] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-21T17:03:34.946979] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:35.069795] [DEBUG] [LOCAL ] AEG: Loaded 49602 existing records from primary storage. [2025-10-21T17:03:35.078495] [INFO ] [MAIN ] AEG: Loaded 49602 existing records. [2025-10-21T17:03:35.531607] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-21T17:03:35.564630] [INFO ] [MAIN ] AEM: Loaded 53477 existing records. [2025-10-21T17:03:35.560146] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:35.565356] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T17:03:35.569059] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-21T17:03:35.569323] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-21T17:03:35.574900] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-21T17:03:35.574816] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-21T17:03:35.605704] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-21T17:03:35.617944] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-21T17:03:35.628612] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-21T17:03:35.653069] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-21T17:03:35.669451] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-21T17:03:35.784857] [DEBUG] [LOCAL ] AEE: Trimmed 73025 records to 50107 (keeping 200 days of data) [2025-10-21T17:03:35.883799] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:35.970674] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-21T17:03:36.002837] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-21T17:03:36.047619] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-21T17:03:36.049699] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-21T17:03:36.539022] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:36.548597] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-21T17:03:36.690317] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T17:03:36.827005] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:36.862052] [DEBUG] [LOCAL ] AEE: Primary data saved (50107 records). [2025-10-21T17:03:36.862155] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-21T17:03:36.862235] [INFO ] [MAIN ] Update Progress: 35/2366 symbols completed. AEE took 30.6s. Estimated remaining: 3h 56m 13s. Rate: 9.9 symbols/min [2025-10-21T17:03:36.960538] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-21T17:03:37.037156] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:37.087361] [DEBUG] [LOCAL ] AEO: Loaded 53565 existing records from primary storage. [2025-10-21T17:03:37.087692] [INFO ] [MAIN ] AEO: Loaded 53565 existing records. [2025-10-21T17:03:37.266461] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:03:37.266718] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-21T17:03:37.266774] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-21T17:03:37.266993] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-21T17:03:37.267049] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-21T17:03:37.633077] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:37.710211] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T17:03:37.751036] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-21T17:03:38.136830] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:03:38.551083] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-21T17:03:39.351047] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-21T17:03:39.611087] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T17:03:40.151059] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-21T17:03:40.244893] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:03:40.248536] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T17:03:40.951044] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-21T17:03:41.743825] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T17:03:41.750966] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-21T17:03:42.166900] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T17:03:42.347423] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T17:03:42.551095] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-21T17:03:43.228075] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-21T17:03:43.230168] [INFO ] [REMOTE ] AEFC: Full fetch complete (11629 records). [2025-10-21T17:03:43.230253] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-21T17:03:43.356197] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-21T17:03:43.598464] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-21T17:03:43.598544] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-21T17:03:43.598768] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-21T17:03:43.598829] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-21T17:03:43.599348] [DEBUG] [LOCAL ] AEFC: Trimmed 11629 records to 7734 (keeping 200 days of data) [2025-10-21T17:03:43.644886] [DEBUG] [LOCAL ] AEFC: Primary data saved (7734 records). [2025-10-21T17:03:43.645009] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-21T17:03:43.645085] [INFO ] [MAIN ] Update Progress: 36/2366 symbols completed. AEFC took 17.1s. Estimated remaining: 3h 56m 53s. Rate: 9.8 symbols/min [2025-10-21T17:03:43.815420] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:03:43.815577] [DEBUG] [LOCAL ] AER: No existing data file found in primary storage. [2025-10-21T17:03:43.815614] [WARN ] [MAIN ] AER: No existing data found, performing full refresh instead. [2025-10-21T17:03:43.815752] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-21T17:03:43.815848] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-21T17:03:43.815917] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-21T17:03:43.815952] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-21T17:03:44.166790] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-21T17:03:44.171286] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:03:44.951085] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-21T17:03:45.574117] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T17:03:45.751051] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-21T17:03:45.948881] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T17:03:46.551053] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-21T17:03:46.695701] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T17:03:47.351090] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-21T17:03:47.465027] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T17:03:48.151050] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-21T17:03:48.539821] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:03:48.921043] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:03:48.950980] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-21T17:03:49.751011] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-21T17:03:50.163675] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T17:03:50.551046] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-21T17:03:50.622802] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T17:03:51.350989] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-21T17:03:51.695404] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T17:03:52.032631] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:03:52.150984] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-21T17:03:52.950018] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T17:03:52.960094] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-21T17:03:53.750994] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-21T17:03:54.069741] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T17:03:54.513257] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:03:54.550987] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-21T17:03:55.351020] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-21T17:03:55.555932] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T17:03:56.043200] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T17:03:56.151038] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-21T17:03:56.951040] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-21T17:03:57.430183] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T17:03:57.751029] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-21T17:03:57.963513] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T17:03:58.551067] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-21T17:03:58.636133] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T17:03:59.351018] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-21T17:03:59.489098] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:04:00.151033] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-21T17:04:00.235855] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:04:00.951077] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-21T17:04:01.470250] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T17:04:01.751029] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-21T17:04:02.134437] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T17:04:02.551058] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-21T17:04:02.967814] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T17:04:03.213861] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T17:04:03.351063] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-21T17:04:04.151063] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-21T17:04:04.321355] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T17:04:04.951107] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-21T17:04:05.384097] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T17:04:05.751036] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-21T17:04:05.983823] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:04:05.992341] [INFO ] [REMOTE ] AEG: Full fetch complete (70660 records). [2025-10-21T17:04:05.992548] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-21T17:04:06.388944] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-21T17:04:06.389027] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-21T17:04:06.389746] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-21T17:04:06.389815] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-21T17:04:06.391154] [DEBUG] [LOCAL ] AEG: Trimmed 70660 records to 49601 (keeping 200 days of data) [2025-10-21T17:04:06.555251] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-21T17:04:06.677638] [DEBUG] [LOCAL ] AEG: Primary data saved (49601 records). [2025-10-21T17:04:06.677898] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-21T17:04:06.678188] [INFO ] [MAIN ] Update Progress: 37/2366 symbols completed. AEG took 32.3s. Estimated remaining: 4h 14m 32s. Rate: 9.1 symbols/min [2025-10-21T17:04:06.715786] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:04:07.351086] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-21T17:04:08.707816] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-21T17:04:08.719775] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-21T17:04:08.760266] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T17:04:08.951074] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-21T17:04:09.863855] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-21T17:04:09.875096] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-21T17:04:10.627959] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T17:04:10.638779] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-21T17:04:10.715146] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T17:04:10.723555] [INFO ] [REMOTE ] AEO: Full fetch complete (77647 records). [2025-10-21T17:04:10.723703] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-21T17:04:11.114990] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-21T17:04:11.115076] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-21T17:04:11.115830] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-21T17:04:11.115893] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-21T17:04:11.117276] [DEBUG] [LOCAL ] AEO: Trimmed 77647 records to 53564 (keeping 200 days of data) [2025-10-21T17:04:11.441010] [DEBUG] [LOCAL ] AEO: Primary data saved (53564 records). [2025-10-21T17:04:11.441198] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-21T17:04:11.441476] [INFO ] [MAIN ] Update Progress: 38/2366 symbols completed. AEO took 34.6s. Estimated remaining: 4h 12m 36s. Rate: 9.2 symbols/min [2025-10-21T17:04:11.583176] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:04:11.591473] [INFO ] [REMOTE ] AEM: Full fetch complete (77458 records). [2025-10-21T17:04:11.591602] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-21T17:04:11.982155] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-21T17:04:11.982239] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-21T17:04:11.982964] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-21T17:04:11.983028] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-21T17:04:11.984420] [DEBUG] [LOCAL ] AEM: Trimmed 77458 records to 53477 (keeping 200 days of data) [2025-10-21T17:04:12.337350] [DEBUG] [LOCAL ] AEM: Primary data saved (53477 records). [2025-10-21T17:04:12.337592] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-21T17:04:12.337741] [INFO ] [MAIN ] Update Progress: 39/2366 symbols completed. AEM took 37.7s. Estimated remaining: 4h 6m 54s. Rate: 9.4 symbols/min [2025-10-21T17:04:12.365359] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T17:04:12.375811] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-21T17:04:13.654441] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T17:04:13.661225] [INFO ] [REMOTE ] AER: Full fetch complete (69585 records). [2025-10-21T17:04:13.661350] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-21T17:04:13.662078] [FATAL] [VALIDATOR ] AER: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:04:13.662162] [FATAL] [MAIN ] AER: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:04:13.662205] [WARN ] [MAIN ] AER: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:04:13.662243] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-21T17:04:13.662298] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-10-21T17:04:13.662334] [INFO ] [LOCAL ] AER: Starting deletion of derivative data. [2025-10-21T17:04:13.662372] [DEBUG] [LOCAL ] AER: No derivative data file found to delete. [2025-10-21T17:04:13.662424] [INFO ] [MAIN ] Update Progress: 40/2366 symbols completed. AER took 30.0s. Estimated remaining: 4h 1m 55s. Rate: 9.6 symbols/min [2025-10-21T17:04:14.250593] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:14.322778] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-21T17:04:14.327521] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:14.351996] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-21T17:04:14.390116] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:14.383994] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-21T17:04:14.421878] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-21T17:04:14.431176] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-21T17:04:14.438922] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-21T17:04:14.462015] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:14.672438] [DEBUG] [LOCAL ] AFB: Loaded 11115 existing records from primary storage. [2025-10-21T17:04:14.673153] [INFO ] [MAIN ] AFB: Loaded 11115 existing records. [2025-10-21T17:04:14.827912] [DEBUG] [LOCAL ] AESI: Loaded 49828 existing records from primary storage. [2025-10-21T17:04:14.894203] [INFO ] [MAIN ] AESI: Loaded 49828 existing records. [2025-10-21T17:04:14.975046] [DEBUG] [LOCAL ] AES: Loaded 53668 existing records from primary storage. [2025-10-21T17:04:15.125524] [INFO ] [MAIN ] AES: Loaded 53668 existing records. [2025-10-21T17:04:15.486530] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:15.561694] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-21T17:04:15.561547] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:15.601517] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-21T17:04:15.584374] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-21T17:04:15.670809] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-21T17:04:15.735936] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-21T17:04:15.779043] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:15.783681] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:15.832724] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-21T17:04:15.860789] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-21T17:04:15.868108] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-21T17:04:15.886245] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-21T17:04:15.886319] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-21T17:04:15.905361] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-21T17:04:15.899591] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:04:15.920975] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-21T17:04:15.937223] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-21T17:04:15.969739] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-21T17:04:16.005464] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:04:16.091109] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-21T17:04:16.147375] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:04:16.166385] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-21T17:04:16.233742] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-21T17:04:16.289186] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-21T17:04:16.319891] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-21T17:04:16.392943] [INFO ] [MAIN ] Update Progress: 41/2366 symbols completed. AEXA took 2.7s. Estimated remaining: 3h 58m 30s. Rate: 9.7 symbols/min [2025-10-21T17:04:16.675793] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:16.855704] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-21T17:04:17.049300] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:17.189038] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:17.193482] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-21T17:04:17.193138] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:17.195134] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-21T17:04:17.228013] [DEBUG] [LOCAL ] AFG: Loaded 31954 existing records from primary storage. [2025-10-21T17:04:17.228283] [INFO ] [MAIN ] AFG: Loaded 31954 existing records. [2025-10-21T17:04:17.416760] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:17.416974] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-21T17:04:17.417023] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-21T17:04:17.417238] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-21T17:04:17.417297] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-21T17:04:17.790302] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:17.790780] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-21T17:04:17.801894] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:04:17.804985] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-21T17:04:18.650195] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T17:04:18.649887] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:04:18.662941] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-21T17:04:18.663815] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-21T17:04:18.839033] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T17:04:18.851155] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-21T17:04:18.870626] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:04:19.351039] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-21T17:04:19.523795] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T17:04:20.151045] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-21T17:04:20.231464] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T17:04:20.529420] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T17:04:20.674235] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-21T17:04:20.868881] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T17:04:20.951051] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-21T17:04:21.751038] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-21T17:04:22.550987] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-21T17:04:22.551282] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T17:04:22.621255] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:04:23.351038] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-21T17:04:24.120011] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T17:04:24.151006] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-21T17:04:24.487218] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T17:04:24.633535] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T17:04:24.951036] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-21T17:04:25.424716] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T17:04:25.751033] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-21T17:04:26.548427] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:04:26.551210] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-21T17:04:27.351042] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-21T17:04:28.150997] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-21T17:04:28.226249] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T17:04:28.288683] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T17:04:28.290826] [INFO ] [REMOTE ] AFB: Full fetch complete (16423 records). [2025-10-21T17:04:28.290896] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-21T17:04:28.646372] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-21T17:04:28.646446] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-21T17:04:28.646719] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-21T17:04:28.646780] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-21T17:04:28.647272] [DEBUG] [LOCAL ] AFB: Trimmed 16423 records to 11097 (keeping 200 days of data) [2025-10-21T17:04:28.711966] [DEBUG] [LOCAL ] AFB: Primary data saved (11097 records). [2025-10-21T17:04:28.712096] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-21T17:04:28.712174] [INFO ] [MAIN ] Update Progress: 42/2366 symbols completed. AFB took 15.0s. Estimated remaining: 4h 4m 5s. Rate: 9.5 symbols/min [2025-10-21T17:04:28.883993] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:28.888815] [DEBUG] [LOCAL ] AFGB: Loaded 2245 existing records from primary storage. [2025-10-21T17:04:28.889004] [INFO ] [MAIN ] AFGB: Loaded 2245 existing records. [2025-10-21T17:04:28.956085] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-21T17:04:29.078909] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:29.079108] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-21T17:04:29.079155] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-21T17:04:29.079275] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-21T17:04:29.079313] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-21T17:04:29.435380] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:29.751020] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-21T17:04:30.071692] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T17:04:30.301818] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T17:04:30.551000] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-21T17:04:30.696813] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:04:31.000152] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T17:04:31.351031] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-21T17:04:31.933719] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T17:04:32.151020] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-21T17:04:32.951001] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-21T17:04:33.001620] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T17:04:33.751024] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-21T17:04:34.238012] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:04:34.551003] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-21T17:04:34.645541] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T17:04:35.351020] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-21T17:04:35.800178] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T17:04:36.151049] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-21T17:04:36.316475] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T17:04:36.951026] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-21T17:04:37.625089] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T17:04:37.751012] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-21T17:04:38.510124] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T17:04:38.550981] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-21T17:04:39.350998] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-21T17:04:39.812438] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-21T17:04:39.903177] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:04:40.151012] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-21T17:04:40.331194] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T17:04:40.951082] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-21T17:04:41.359474] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T17:04:41.751060] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-21T17:04:42.224467] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T17:04:42.551064] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-21T17:04:42.589540] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:04:43.351033] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-21T17:04:44.151010] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-21T17:04:44.374976] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T17:04:44.832250] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T17:04:44.951011] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-21T17:04:45.762273] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-21T17:04:45.767676] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T17:04:46.107358] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-21T17:04:46.369380] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:04:46.551032] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-21T17:04:47.351053] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-21T17:04:48.151030] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-21T17:04:48.340063] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T17:04:48.348163] [INFO ] [REMOTE ] AESI: Full fetch complete (71496 records). [2025-10-21T17:04:48.348314] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-21T17:04:48.744946] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-21T17:04:48.745223] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-21T17:04:48.745942] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-21T17:04:48.746009] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-21T17:04:48.747806] [DEBUG] [LOCAL ] AESI: Trimmed 71496 records to 49822 (keeping 200 days of data) [2025-10-21T17:04:48.951284] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-21T17:04:49.041853] [DEBUG] [LOCAL ] AESI: Primary data saved (49822 records). [2025-10-21T17:04:49.042031] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-21T17:04:49.042131] [INFO ] [MAIN ] Update Progress: 43/2366 symbols completed. AESI took 35.4s. Estimated remaining: 4h 16m 36s. Rate: 9.1 symbols/min [2025-10-21T17:04:49.216171] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:49.249470] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T17:04:49.248082] [DEBUG] [LOCAL ] AFGC: Loaded 2561 existing records from primary storage. [2025-10-21T17:04:49.260780] [INFO ] [MAIN ] AFGC: Loaded 2561 existing records. [2025-10-21T17:04:49.446997] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:49.443432] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T17:04:49.448447] [INFO ] [REMOTE ] AFGB: Full fetch complete (3454 records). [2025-10-21T17:04:49.448558] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-21T17:04:49.447360] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-21T17:04:49.460269] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-21T17:04:49.497862] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-21T17:04:49.514332] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-21T17:04:49.762698] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-21T17:04:49.801076] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T17:04:50.189243] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-21T17:04:50.208908] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-21T17:04:50.208845] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:50.209103] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-21T17:04:50.209181] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-21T17:04:50.209805] [DEBUG] [LOCAL ] AFGB: Trimmed 3454 records to 2236 (keeping 200 days of data) [2025-10-21T17:04:50.223418] [DEBUG] [LOCAL ] AFGB: Primary data saved (2236 records). [2025-10-21T17:04:50.223486] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-21T17:04:50.223551] [INFO ] [MAIN ] Update Progress: 44/2366 symbols completed. AFGB took 21.5s. Estimated remaining: 4h 11m 42s. Rate: 9.2 symbols/min [2025-10-21T17:04:50.396691] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:50.401038] [DEBUG] [LOCAL ] AFGD: Loaded 1775 existing records from primary storage. [2025-10-21T17:04:50.401240] [INFO ] [MAIN ] AFGD: Loaded 1775 existing records. [2025-10-21T17:04:50.557158] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-21T17:04:50.590139] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:50.590376] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-21T17:04:50.590456] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-21T17:04:50.590610] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-21T17:04:50.590699] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-21T17:04:50.961389] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:51.192854] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:04:51.351033] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-21T17:04:52.064345] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T17:04:52.093411] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-21T17:04:52.102005] [INFO ] [REMOTE ] AES: Full fetch complete (77843 records). [2025-10-21T17:04:52.102178] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-21T17:04:52.156271] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-21T17:04:52.496219] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-21T17:04:52.496297] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-21T17:04:52.497048] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-21T17:04:52.497139] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-21T17:04:52.498542] [DEBUG] [LOCAL ] AES: Trimmed 77843 records to 53665 (keeping 200 days of data) [2025-10-21T17:04:52.810023] [DEBUG] [LOCAL ] AES: Primary data saved (53665 records). [2025-10-21T17:04:52.810154] [INFO ] [MAIN ] AES: Full history saved. [2025-10-21T17:04:52.811122] [INFO ] [MAIN ] Update Progress: 45/2366 symbols completed. AES took 39.1s. Estimated remaining: 4h 8m 14s. Rate: 9.4 symbols/min [2025-10-21T17:04:52.956151] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-21T17:04:52.981297] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:52.986218] [DEBUG] [LOCAL ] AFGE: Loaded 2313 existing records from primary storage. [2025-10-21T17:04:52.986380] [INFO ] [MAIN ] AFGE: Loaded 2313 existing records. [2025-10-21T17:04:53.163267] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:04:53.163463] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-21T17:04:53.163509] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-21T17:04:53.163638] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-21T17:04:53.163721] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-21T17:04:53.521240] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:04:53.525475] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T17:04:53.545283] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T17:04:53.751069] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-21T17:04:54.381989] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T17:04:54.551019] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-21T17:04:54.993817] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T17:04:55.351033] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-21T17:04:56.151022] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-21T17:04:56.592248] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:04:56.770685] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T17:04:56.951054] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-21T17:04:57.396567] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T17:04:57.751103] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-21T17:04:58.551023] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-21T17:04:58.917077] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-21T17:04:59.062601] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T17:04:59.067557] [INFO ] [REMOTE ] AFG: Full fetch complete (46781 records). [2025-10-21T17:04:59.067666] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-21T17:04:59.358950] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-21T17:04:59.452149] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-21T17:04:59.452223] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-21T17:04:59.452720] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-21T17:04:59.452783] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-21T17:04:59.453673] [DEBUG] [LOCAL ] AFG: Trimmed 46781 records to 31884 (keeping 200 days of data) [2025-10-21T17:04:59.647329] [DEBUG] [LOCAL ] AFG: Primary data saved (31884 records). [2025-10-21T17:04:59.647451] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-21T17:04:59.647525] [INFO ] [MAIN ] Update Progress: 46/2366 symbols completed. AFG took 43.2s. Estimated remaining: 4h 8m 28s. Rate: 9.3 symbols/min [2025-10-21T17:04:59.821008] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:04:59.872489] [DEBUG] [LOCAL ] AFL: Loaded 53182 existing records from primary storage. [2025-10-21T17:04:59.872816] [INFO ] [MAIN ] AFL: Loaded 53182 existing records. [2025-10-21T17:04:59.948314] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:05:00.072521] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:00.072972] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-21T17:05:00.073032] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-21T17:05:00.073323] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-21T17:05:00.073384] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-21T17:05:00.156222] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-21T17:05:00.432093] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:00.703566] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T17:05:00.951066] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-21T17:05:01.397725] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T17:05:01.751029] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-21T17:05:02.445692] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T17:05:02.551086] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-21T17:05:03.058988] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-21T17:05:03.351037] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-21T17:05:03.983178] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T17:05:04.151030] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-21T17:05:04.828164] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T17:05:04.951046] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-21T17:05:05.299768] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-21T17:05:05.751048] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-21T17:05:06.551055] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-21T17:05:07.094341] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T17:05:07.351058] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-21T17:05:07.555744] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T17:05:07.943901] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T17:05:08.151095] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-21T17:05:08.951088] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-21T17:05:09.567684] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T17:05:09.751071] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-21T17:05:10.094281] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T17:05:10.200029] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T17:05:10.551086] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-21T17:05:11.270842] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T17:05:11.351015] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-21T17:05:12.151060] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-21T17:05:12.792700] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-21T17:05:12.951088] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-21T17:05:13.301183] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:05:13.461621] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-21T17:05:13.751088] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-21T17:05:14.091347] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T17:05:14.551034] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-21T17:05:15.060531] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T17:05:15.061380] [INFO ] [REMOTE ] AFGC: Full fetch complete (3582 records). [2025-10-21T17:05:15.061447] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-21T17:05:15.061823] [FATAL] [VALIDATOR ] AFGC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:05:15.061903] [FATAL] [MAIN ] AFGC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:05:15.061945] [WARN ] [MAIN ] AFGC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:05:15.061983] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-21T17:05:15.062035] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-10-21T17:05:15.062068] [INFO ] [LOCAL ] AFGC: Starting deletion of derivative data. [2025-10-21T17:05:15.062223] [DEBUG] [LOCAL ] AFGC: Deleted derivative data file. [2025-10-21T17:05:15.062308] [INFO ] [MAIN ] Update Progress: 47/2366 symbols completed. AFGC took 26.0s. Estimated remaining: 4h 15m 45s. Rate: 9.1 symbols/min [2025-10-21T17:05:15.229689] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:15.277882] [DEBUG] [LOCAL ] AG: Loaded 53644 existing records from primary storage. [2025-10-21T17:05:15.278196] [INFO ] [MAIN ] AG: Loaded 53644 existing records. [2025-10-21T17:05:15.356094] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-21T17:05:15.460748] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:15.460972] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-21T17:05:15.461018] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-21T17:05:15.461229] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-21T17:05:15.461293] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-21T17:05:15.808749] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:16.151021] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-21T17:05:16.708472] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T17:05:16.951001] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-21T17:05:17.016251] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:05:17.751026] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-21T17:05:18.551060] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-21T17:05:18.999721] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-21T17:05:19.113587] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T17:05:19.114453] [INFO ] [REMOTE ] AFGE: Full fetch complete (3342 records). [2025-10-21T17:05:19.114521] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-21T17:05:19.361533] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-21T17:05:19.480142] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-21T17:05:19.480313] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-21T17:05:19.480473] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-21T17:05:19.480612] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-21T17:05:19.481217] [DEBUG] [LOCAL ] AFGE: Trimmed 3342 records to 2292 (keeping 200 days of data) [2025-10-21T17:05:19.495141] [DEBUG] [LOCAL ] AFGE: Primary data saved (2292 records). [2025-10-21T17:05:19.495201] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-21T17:05:19.495265] [INFO ] [MAIN ] Update Progress: 48/2366 symbols completed. AFGE took 26.7s. Estimated remaining: 4h 13m 53s. Rate: 9.1 symbols/min [2025-10-21T17:05:19.664315] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:19.704972] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T17:05:19.761205] [DEBUG] [LOCAL ] AGCO: Loaded 42303 existing records from primary storage. [2025-10-21T17:05:19.761527] [INFO ] [MAIN ] AGCO: Loaded 42303 existing records. [2025-10-21T17:05:19.947531] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:19.947796] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-21T17:05:19.947858] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-21T17:05:19.948060] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-21T17:05:19.948118] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-21T17:05:20.156212] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-21T17:05:20.323170] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:20.664735] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-21T17:05:20.951008] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-21T17:05:21.008371] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:05:21.751017] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-21T17:05:22.534167] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:05:22.550970] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-21T17:05:23.351014] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-21T17:05:23.612518] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:05:24.051271] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T17:05:24.151042] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-21T17:05:24.661118] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T17:05:24.951053] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-21T17:05:25.751096] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-21T17:05:26.551058] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-21T17:05:26.776595] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:05:27.351035] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-21T17:05:28.010945] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T17:05:28.150992] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-21T17:05:28.889111] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (4.74 seconds). [2025-10-21T17:05:28.950982] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-21T17:05:28.971145] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (3.22 seconds). [2025-10-21T17:05:29.277176] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:05:29.751030] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-21T17:05:29.910094] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:05:30.322180] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T17:05:30.322960] [INFO ] [REMOTE ] AFGD: Full fetch complete (2746 records). [2025-10-21T17:05:30.323028] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-21T17:05:30.552479] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-21T17:05:30.694611] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-21T17:05:30.694746] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-21T17:05:30.694923] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-21T17:05:30.695022] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-21T17:05:30.695429] [DEBUG] [LOCAL ] AFGD: Trimmed 2746 records to 1769 (keeping 200 days of data) [2025-10-21T17:05:30.707291] [DEBUG] [LOCAL ] AFGD: Primary data saved (1769 records). [2025-10-21T17:05:30.707449] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-21T17:05:30.707701] [INFO ] [MAIN ] Update Progress: 49/2366 symbols completed. AFGD took 40.5s. Estimated remaining: 4h 17m 26s. Rate: 9.0 symbols/min [2025-10-21T17:05:30.885185] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:30.919680] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T17:05:30.946062] [DEBUG] [LOCAL ] AGD: Loaded 19307 existing records from primary storage. [2025-10-21T17:05:30.946300] [INFO ] [MAIN ] AGD: Loaded 19307 existing records. [2025-10-21T17:05:31.131025] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:31.131256] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-21T17:05:31.131321] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-21T17:05:31.131590] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-21T17:05:31.131696] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-21T17:05:31.361142] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-21T17:05:31.522372] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:32.151024] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-21T17:05:32.357799] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:05:32.366225] [INFO ] [REMOTE ] AFL: Full fetch complete (77065 records). [2025-10-21T17:05:32.366370] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-21T17:05:32.760925] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-21T17:05:32.761010] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-21T17:05:32.761788] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-21T17:05:32.761853] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-21T17:05:32.763336] [DEBUG] [LOCAL ] AFL: Trimmed 77065 records to 53177 (keeping 200 days of data) [2025-10-21T17:05:32.954156] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-21T17:05:33.024058] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:05:33.124933] [DEBUG] [LOCAL ] AFL: Primary data saved (53177 records). [2025-10-21T17:05:33.125065] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-21T17:05:33.126733] [INFO ] [MAIN ] Update Progress: 50/2366 symbols completed. AFL took 33.5s. Estimated remaining: 4h 14m 3s. Rate: 9.1 symbols/min [2025-10-21T17:05:33.297780] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:33.352523] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-21T17:05:33.352848] [INFO ] [MAIN ] AGI: Loaded 53423 existing records. [2025-10-21T17:05:33.533927] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:33.534142] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-21T17:05:33.534193] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-21T17:05:33.534384] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-21T17:05:33.534422] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-21T17:05:33.766404] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-21T17:05:33.912789] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:34.191587] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-21T17:05:34.261884] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T17:05:34.551034] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-21T17:05:35.351041] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-21T17:05:35.365120] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T17:05:35.468368] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:05:36.151041] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-21T17:05:36.951054] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-21T17:05:37.024699] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T17:05:37.287793] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T17:05:37.751026] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-21T17:05:38.366017] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:05:38.551025] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-21T17:05:39.351009] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-21T17:05:39.510624] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:05:40.151033] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-21T17:05:40.193388] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:05:40.951116] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-21T17:05:41.627712] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T17:05:41.724736] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-21T17:05:41.751027] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-21T17:05:41.895978] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T17:05:42.551010] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-21T17:05:42.940893] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:05:43.351105] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-21T17:05:44.151067] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-21T17:05:44.445748] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T17:05:44.841970] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T17:05:44.900760] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T17:05:44.950989] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-21T17:05:45.751077] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-21T17:05:46.443824] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T17:05:46.551050] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-21T17:05:47.351084] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-21T17:05:47.496245] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:05:47.551060] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T17:05:48.151047] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-21T17:05:48.951104] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-21T17:05:49.648742] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-21T17:05:49.751068] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-21T17:05:50.448151] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-21T17:05:50.551042] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-21T17:05:50.587311] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T17:05:50.594846] [INFO ] [REMOTE ] AGCO: Full fetch complete (61594 records). [2025-10-21T17:05:50.594986] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-21T17:05:51.027134] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-21T17:05:51.027215] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-21T17:05:51.027833] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-21T17:05:51.027896] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-21T17:05:51.029173] [DEBUG] [LOCAL ] AGCO: Trimmed 61594 records to 42188 (keeping 200 days of data) [2025-10-21T17:05:51.314331] [DEBUG] [LOCAL ] AGCO: Primary data saved (42188 records). [2025-10-21T17:05:51.314473] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-21T17:05:51.317026] [INFO ] [MAIN ] Update Progress: 51/2366 symbols completed. AGCO took 31.8s. Estimated remaining: 4h 22m 43s. Rate: 8.8 symbols/min [2025-10-21T17:05:51.356101] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-21T17:05:51.522052] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:51.522169] [DEBUG] [LOCAL ] AGL: No existing data file found in primary storage. [2025-10-21T17:05:51.522207] [WARN ] [MAIN ] AGL: No existing data found, performing full refresh instead. [2025-10-21T17:05:51.522312] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-21T17:05:51.522354] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-21T17:05:51.522395] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-21T17:05:51.522429] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-21T17:05:51.919308] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:51.976605] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-21T17:05:51.985410] [INFO ] [REMOTE ] AG: Full fetch complete (77394 records). [2025-10-21T17:05:51.985558] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-21T17:05:51.986376] [FATAL] [VALIDATOR ] AG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:05:51.986485] [FATAL] [MAIN ] AG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:05:51.986567] [WARN ] [MAIN ] AG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:05:51.986678] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-21T17:05:51.986770] [DEBUG] [LOCAL ] AG: No primary data file found to delete. [2025-10-21T17:05:51.986825] [INFO ] [LOCAL ] AG: Starting deletion of derivative data. [2025-10-21T17:05:51.986959] [DEBUG] [LOCAL ] AG: Deleted derivative data file. [2025-10-21T17:05:51.987047] [INFO ] [MAIN ] Update Progress: 52/2366 symbols completed. AG took 36.9s. Estimated remaining: 4h 18m 3s. Rate: 9.0 symbols/min [2025-10-21T17:05:52.162753] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-21T17:05:52.162634] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:52.176513] [DEBUG] [LOCAL ] AGM: Loaded 10702 existing records from primary storage. [2025-10-21T17:05:52.176849] [INFO ] [MAIN ] AGM: Loaded 10702 existing records. [2025-10-21T17:05:52.385826] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:52.389296] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-21T17:05:52.389428] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-21T17:05:52.389789] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-21T17:05:52.390151] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-21T17:05:52.391114] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T17:05:52.543479] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T17:05:52.772112] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:52.950986] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-21T17:05:53.591831] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:05:53.750999] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-21T17:05:53.920703] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:05:54.436860] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T17:05:54.550996] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-21T17:05:55.351027] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-21T17:05:56.151016] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-21T17:05:56.440029] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T17:05:56.638731] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T17:05:56.642751] [INFO ] [REMOTE ] AGD: Full fetch complete (26621 records). [2025-10-21T17:05:56.642829] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-21T17:05:56.934047] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T17:05:56.956076] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-21T17:05:57.021349] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-21T17:05:57.021425] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-21T17:05:57.021811] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-21T17:05:57.021874] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-21T17:05:57.022594] [DEBUG] [LOCAL ] AGD: Trimmed 26621 records to 19315 (keeping 200 days of data) [2025-10-21T17:05:57.133036] [DEBUG] [LOCAL ] AGD: Primary data saved (19315 records). [2025-10-21T17:05:57.133167] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-21T17:05:57.133243] [INFO ] [MAIN ] Update Progress: 53/2366 symbols completed. AGD took 26.4s. Estimated remaining: 4h 16m 49s. Rate: 9.0 symbols/min [2025-10-21T17:05:57.300016] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:05:57.324933] [DEBUG] [LOCAL ] AGO: Loaded 27832 existing records from primary storage. [2025-10-21T17:05:57.325186] [INFO ] [MAIN ] AGO: Loaded 27832 existing records. [2025-10-21T17:05:57.500575] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:05:57.500832] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-21T17:05:57.500901] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-21T17:05:57.501113] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-21T17:05:57.501152] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-21T17:05:57.756208] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-21T17:05:57.853994] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:05:58.402915] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T17:05:58.551049] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-21T17:05:58.732207] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T17:05:59.351099] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-21T17:06:00.100691] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T17:06:00.151016] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-21T17:06:00.796004] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:06:00.951009] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-21T17:06:01.337356] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T17:06:01.751057] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-21T17:06:02.551055] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-21T17:06:03.184009] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T17:06:03.351051] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-21T17:06:03.445195] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T17:06:03.984412] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (3.03 seconds). [2025-10-21T17:06:04.151032] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-21T17:06:04.752337] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:06:04.951083] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-21T17:06:05.750997] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-21T17:06:05.791328] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:06:06.126287] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:06:06.551013] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-21T17:06:07.350980] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-21T17:06:07.830527] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-21T17:06:08.151014] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-21T17:06:08.669395] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T17:06:08.713188] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:06:08.951039] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-21T17:06:09.751052] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-21T17:06:10.551014] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-21T17:06:10.765813] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T17:06:11.356242] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-21T17:06:11.383147] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (3.23 seconds). [2025-10-21T17:06:11.503990] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T17:06:12.012191] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (3.06 seconds). [2025-10-21T17:06:12.150988] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-21T17:06:12.387456] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T17:06:12.951063] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-21T17:06:13.724287] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T17:06:13.750993] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-21T17:06:14.102920] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T17:06:14.551029] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-21T17:06:15.351072] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-21T17:06:15.748815] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:06:16.150996] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-21T17:06:16.238253] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T17:06:16.247086] [INFO ] [REMOTE ] AGI: Full fetch complete (77313 records). [2025-10-21T17:06:16.247222] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-21T17:06:16.633829] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-21T17:06:16.633938] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-21T17:06:16.634802] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-21T17:06:16.634940] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-21T17:06:16.636491] [DEBUG] [LOCAL ] AGI: Trimmed 77313 records to 53423 (keeping 200 days of data) [2025-10-21T17:06:16.880314] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:06:16.967427] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-21T17:06:16.991963] [DEBUG] [LOCAL ] AGI: Primary data saved (53423 records). [2025-10-21T17:06:16.992092] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-21T17:06:16.993780] [INFO ] [MAIN ] Update Progress: 54/2366 symbols completed. AGI took 43.9s. Estimated remaining: 4h 26m 7s. Rate: 8.7 symbols/min [2025-10-21T17:06:17.171504] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:17.171684] [DEBUG] [LOCAL ] AGRO: No existing data file found in primary storage. [2025-10-21T17:06:17.171736] [WARN ] [MAIN ] AGRO: No existing data found, performing full refresh instead. [2025-10-21T17:06:17.171874] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-21T17:06:17.171940] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-21T17:06:17.171991] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-21T17:06:17.172024] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-21T17:06:17.551928] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:17.751078] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-21T17:06:18.105985] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T17:06:18.109299] [INFO ] [REMOTE ] AGM: Full fetch complete (13315 records). [2025-10-21T17:06:18.109436] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-21T17:06:18.394860] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T17:06:18.556251] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-21T17:06:18.672029] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-21T17:06:18.672140] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-21T17:06:18.672601] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-21T17:06:18.672703] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-21T17:06:18.673564] [DEBUG] [LOCAL ] AGM: Trimmed 13315 records to 10663 (keeping 200 days of data) [2025-10-21T17:06:18.777750] [DEBUG] [LOCAL ] AGM: Primary data saved (10663 records). [2025-10-21T17:06:18.777923] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-21T17:06:18.778036] [INFO ] [MAIN ] Update Progress: 55/2366 symbols completed. AGM took 26.8s. Estimated remaining: 4h 22m 25s. Rate: 8.8 symbols/min [2025-10-21T17:06:18.966682] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:19.003059] [DEBUG] [LOCAL ] AGX: Loaded 32688 existing records from primary storage. [2025-10-21T17:06:19.003362] [INFO ] [MAIN ] AGX: Loaded 32688 existing records. [2025-10-21T17:06:19.198582] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:19.199178] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-21T17:06:19.199294] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-21T17:06:19.199627] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-21T17:06:19.199723] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-21T17:06:19.351795] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-21T17:06:19.598085] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T17:06:19.603594] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:19.627506] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T17:06:20.151035] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-21T17:06:20.951075] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-21T17:06:21.438329] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T17:06:21.493913] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T17:06:21.502051] [INFO ] [REMOTE ] AGL: Full fetch complete (75932 records). [2025-10-21T17:06:21.502177] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-21T17:06:21.759076] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-21T17:06:21.916416] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-21T17:06:21.916494] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-21T17:06:21.917277] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-21T17:06:21.917342] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-21T17:06:21.918800] [DEBUG] [LOCAL ] AGL: Trimmed 75932 records to 52587 (keeping 200 days of data) [2025-10-21T17:06:22.155777] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T17:06:22.237795] [DEBUG] [LOCAL ] AGL: Primary data saved (52587 records). [2025-10-21T17:06:22.237921] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-21T17:06:22.237989] [INFO ] [MAIN ] Update Progress: 56/2366 symbols completed. AGL took 30.9s. Estimated remaining: 4h 20m 0s. Rate: 8.9 symbols/min [2025-10-21T17:06:22.411685] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:22.447680] [DEBUG] [LOCAL ] AHH: Loaded 40379 existing records from primary storage. [2025-10-21T17:06:22.447950] [INFO ] [MAIN ] AHH: Loaded 40379 existing records. [2025-10-21T17:06:22.553672] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-21T17:06:22.633685] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:22.633869] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-21T17:06:22.633917] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-21T17:06:22.634140] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-21T17:06:22.634177] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-21T17:06:22.999473] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:23.017955] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T17:06:23.351025] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-21T17:06:23.764300] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T17:06:24.151029] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-21T17:06:24.569523] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T17:06:24.951023] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-21T17:06:25.269898] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:06:25.751051] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-21T17:06:26.497175] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T17:06:26.551001] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-21T17:06:27.006461] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T17:06:27.011139] [INFO ] [REMOTE ] AGO: Full fetch complete (39755 records). [2025-10-21T17:06:27.011234] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-21T17:06:27.358164] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-21T17:06:27.390426] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-21T17:06:27.390515] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-21T17:06:27.391019] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-21T17:06:27.391087] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-21T17:06:27.392141] [DEBUG] [LOCAL ] AGO: Trimmed 39755 records to 27763 (keeping 200 days of data) [2025-10-21T17:06:27.560839] [DEBUG] [LOCAL ] AGO: Primary data saved (27763 records). [2025-10-21T17:06:27.560967] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-21T17:06:27.561044] [INFO ] [MAIN ] Update Progress: 57/2366 symbols completed. AGO took 30.4s. Estimated remaining: 4h 18m 56s. Rate: 8.9 symbols/min [2025-10-21T17:06:27.727217] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:27.727372] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-21T17:06:27.727408] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-21T17:06:27.727516] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-21T17:06:27.727556] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-21T17:06:27.727596] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-21T17:06:27.727628] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-21T17:06:28.090261] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:28.151002] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-21T17:06:28.231954] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T17:06:28.956955] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-21T17:06:28.979482] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:06:29.193261] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:06:29.193561] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-21T17:06:29.193672] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:06:29.193730] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-21T17:06:29.193773] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:06:29.193836] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-21T17:06:29.193899] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-21T17:06:29.193933] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-21T17:06:29.193971] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-21T17:06:29.194015] [INFO ] [MAIN ] Update Progress: 58/2366 symbols completed. AHL took 1.6s. Estimated remaining: 4h 15m 26s. Rate: 9.0 symbols/min [2025-10-21T17:06:29.362003] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:29.406037] [DEBUG] [LOCAL ] AHR: Loaded 49006 existing records from primary storage. [2025-10-21T17:06:29.406360] [INFO ] [MAIN ] AHR: Loaded 49006 existing records. [2025-10-21T17:06:29.591935] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:29.592199] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-21T17:06:29.592277] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-21T17:06:29.592498] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-21T17:06:29.592624] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-21T17:06:29.751367] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T17:06:29.761784] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-21T17:06:29.973580] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:30.551016] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-21T17:06:31.178272] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:06:31.351021] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-21T17:06:32.106885] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:06:32.150979] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-21T17:06:32.929838] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:06:32.950976] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-21T17:06:33.469420] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T17:06:33.751018] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-21T17:06:34.533091] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:06:34.550978] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-21T17:06:35.151208] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T17:06:35.351082] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-21T17:06:36.049884] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T17:06:36.151026] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-21T17:06:36.951037] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-21T17:06:36.953281] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T17:06:37.682799] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:06:37.750978] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-21T17:06:38.260633] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T17:06:38.551088] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-21T17:06:39.351002] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-21T17:06:39.519776] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T17:06:39.576586] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T17:06:40.151028] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-21T17:06:40.818960] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T17:06:40.951075] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-21T17:06:41.440696] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T17:06:41.751028] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-21T17:06:42.103012] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T17:06:42.551055] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-21T17:06:42.997415] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:06:43.351024] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-21T17:06:44.159370] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-21T17:06:44.177066] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:06:44.539703] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T17:06:44.951071] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-21T17:06:45.561941] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T17:06:45.751064] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-21T17:06:46.502462] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T17:06:46.550989] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-21T17:06:47.349593] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:06:47.355367] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-21T17:06:47.357180] [INFO ] [REMOTE ] AHH: Full fetch complete (59540 records). [2025-10-21T17:06:47.357331] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-21T17:06:47.764192] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-21T17:06:47.764273] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-21T17:06:47.764928] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-21T17:06:47.764990] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-21T17:06:47.766239] [DEBUG] [LOCAL ] AHH: Trimmed 59540 records to 40272 (keeping 200 days of data) [2025-10-21T17:06:47.991125] [DEBUG] [LOCAL ] AHH: Primary data saved (40272 records). [2025-10-21T17:06:47.991245] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-21T17:06:47.991318] [INFO ] [MAIN ] Update Progress: 59/2366 symbols completed. AHH took 25.8s. Estimated remaining: 4h 23m 15s. Rate: 8.8 symbols/min [2025-10-21T17:06:48.152819] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-21T17:06:48.175042] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:48.211871] [DEBUG] [LOCAL ] AHT: Loaded 6438 existing records from primary storage. [2025-10-21T17:06:48.212137] [INFO ] [MAIN ] AHT: Loaded 6438 existing records. [2025-10-21T17:06:48.272131] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T17:06:48.409055] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:48.409246] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-21T17:06:48.409293] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-21T17:06:48.409597] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-21T17:06:48.409680] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-21T17:06:48.810853] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:48.952362] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-21T17:06:48.958558] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T17:06:49.534321] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:06:49.751089] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-21T17:06:50.551042] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-21T17:06:50.632325] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:06:51.052816] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T17:06:51.057531] [INFO ] [REMOTE ] AGX: Full fetch complete (48977 records). [2025-10-21T17:06:51.057636] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-21T17:06:51.359175] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T17:06:51.355806] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-21T17:06:51.450843] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-21T17:06:51.450911] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-21T17:06:51.451421] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-21T17:06:51.451461] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-21T17:06:51.452422] [DEBUG] [LOCAL ] AGX: Trimmed 48977 records to 32682 (keeping 200 days of data) [2025-10-21T17:06:51.645342] [DEBUG] [LOCAL ] AGX: Primary data saved (32682 records). [2025-10-21T17:06:51.645459] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-21T17:06:51.645531] [INFO ] [MAIN ] Update Progress: 60/2366 symbols completed. AGX took 32.9s. Estimated remaining: 4h 21m 5s. Rate: 8.8 symbols/min [2025-10-21T17:06:51.812554] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:51.812718] [DEBUG] [LOCAL ] AI: No existing data file found in primary storage. [2025-10-21T17:06:51.812768] [WARN ] [MAIN ] AI: No existing data found, performing full refresh instead. [2025-10-21T17:06:51.812872] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-21T17:06:51.812912] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-21T17:06:51.812975] [DEBUG] [LOCAL ] AI: No primary data file found to delete. [2025-10-21T17:06:51.813040] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-21T17:06:52.165849] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-21T17:06:52.171139] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:52.905504] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T17:06:52.951016] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-21T17:06:53.114580] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:06:53.751080] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-21T17:06:54.060827] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T17:06:54.065763] [INFO ] [REMOTE ] AGRO: Full fetch complete (48937 records). [2025-10-21T17:06:54.065846] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-21T17:06:54.436610] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-21T17:06:54.436715] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-21T17:06:54.437241] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-21T17:06:54.437282] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-21T17:06:54.438257] [DEBUG] [LOCAL ] AGRO: Trimmed 48937 records to 32640 (keeping 200 days of data) [2025-10-21T17:06:54.552622] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-21T17:06:54.623060] [DEBUG] [LOCAL ] AGRO: Primary data saved (32640 records). [2025-10-21T17:06:54.623172] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-21T17:06:54.623238] [INFO ] [MAIN ] Update Progress: 61/2366 symbols completed. AGRO took 37.6s. Estimated remaining: 4h 18m 34s. Rate: 8.9 symbols/min [2025-10-21T17:06:54.793098] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:06:54.844622] [DEBUG] [LOCAL ] AIG: Loaded 53465 existing records from primary storage. [2025-10-21T17:06:54.844950] [INFO ] [MAIN ] AIG: Loaded 53465 existing records. [2025-10-21T17:06:55.020109] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:06:55.020300] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-21T17:06:55.020346] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-21T17:06:55.020529] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-21T17:06:55.020565] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-21T17:06:55.355044] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-21T17:06:55.367984] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:06:56.151002] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-21T17:06:56.202782] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:06:56.201805] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T17:06:56.323881] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-21T17:06:56.951075] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-21T17:06:57.567952] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T17:06:57.751058] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-21T17:06:58.080827] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:06:58.551059] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-21T17:06:59.351102] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-21T17:07:00.156219] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-21T17:07:00.158038] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T17:07:00.167155] [INFO ] [REMOTE ] AHR: Full fetch complete (70785 records). [2025-10-21T17:07:00.167354] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-21T17:07:00.495200] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-21T17:07:00.601081] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-21T17:07:00.601164] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-21T17:07:00.601877] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-21T17:07:00.601939] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-21T17:07:00.603329] [DEBUG] [LOCAL ] AHR: Trimmed 70785 records to 48969 (keeping 200 days of data) [2025-10-21T17:07:00.893535] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T17:07:00.903151] [DEBUG] [LOCAL ] AHR: Primary data saved (48969 records). [2025-10-21T17:07:00.903257] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-21T17:07:00.903331] [INFO ] [MAIN ] Update Progress: 62/2366 symbols completed. AHR took 31.7s. Estimated remaining: 4h 18m 11s. Rate: 8.9 symbols/min [2025-10-21T17:07:00.958038] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-21T17:07:01.078335] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:01.078508] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-21T17:07:01.078672] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-21T17:07:01.078915] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-21T17:07:01.078962] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-21T17:07:01.087838] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-21T17:07:01.093717] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-21T17:07:01.175062] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T17:07:01.469247] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:01.751027] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-21T17:07:01.969518] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:07:01.969897] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-21T17:07:01.969988] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:07:01.970082] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-21T17:07:01.970152] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:07:01.970222] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-21T17:07:01.970285] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-21T17:07:01.970321] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-21T17:07:01.970360] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-21T17:07:01.970404] [INFO ] [MAIN ] Update Progress: 63/2366 symbols completed. AII took 1.1s. Estimated remaining: 4h 14m 37s. Rate: 9.0 symbols/min [2025-10-21T17:07:02.141580] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:02.165212] [DEBUG] [LOCAL ] AIN: Loaded 24466 existing records from primary storage. [2025-10-21T17:07:02.165455] [INFO ] [MAIN ] AIN: Loaded 24466 existing records. [2025-10-21T17:07:02.343838] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:02.344045] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-21T17:07:02.344092] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-21T17:07:02.344286] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-21T17:07:02.344342] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-21T17:07:02.556325] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-21T17:07:02.697145] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:03.351043] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-21T17:07:03.412455] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-21T17:07:04.151048] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-21T17:07:04.501877] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:07:04.526237] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T17:07:04.951005] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-21T17:07:05.012359] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T17:07:05.751018] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-21T17:07:05.898173] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:07:06.279301] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T17:07:06.551072] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-21T17:07:07.351061] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-21T17:07:07.732260] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T17:07:08.151033] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-21T17:07:08.951004] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-21T17:07:09.338381] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T17:07:09.475945] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T17:07:09.751017] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-21T17:07:10.551072] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-21T17:07:11.099602] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T17:07:11.284452] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T17:07:11.351066] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-21T17:07:11.661045] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T17:07:12.115303] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:07:12.151116] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-21T17:07:12.884122] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T17:07:12.951021] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-21T17:07:13.751031] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-21T17:07:14.551034] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-21T17:07:15.342607] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-21T17:07:15.353324] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-21T17:07:15.478497] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T17:07:15.730887] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T17:07:15.995466] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T17:07:15.997094] [INFO ] [REMOTE ] AHT: Full fetch complete (9104 records). [2025-10-21T17:07:15.997165] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-21T17:07:16.161920] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-21T17:07:16.366377] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-21T17:07:16.366451] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-21T17:07:16.366668] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-21T17:07:16.366728] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-21T17:07:16.367123] [DEBUG] [LOCAL ] AHT: Trimmed 9104 records to 6381 (keeping 200 days of data) [2025-10-21T17:07:16.402484] [DEBUG] [LOCAL ] AHT: Primary data saved (6381 records). [2025-10-21T17:07:16.402574] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-21T17:07:16.402671] [INFO ] [MAIN ] Update Progress: 64/2366 symbols completed. AHT took 28.4s. Estimated remaining: 4h 19m 11s. Rate: 8.9 symbols/min [2025-10-21T17:07:16.567041] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:16.583246] [DEBUG] [LOCAL ] AIO: Loaded 13123 existing records from primary storage. [2025-10-21T17:07:16.583449] [INFO ] [MAIN ] AIO: Loaded 13123 existing records. [2025-10-21T17:07:16.760227] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:16.760467] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-21T17:07:16.760513] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-21T17:07:16.760772] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-21T17:07:16.760829] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-21T17:07:16.962913] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-21T17:07:17.108677] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:17.751109] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-21T17:07:18.105024] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:07:18.273917] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T17:07:18.551047] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-21T17:07:18.816297] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T17:07:19.351033] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-21T17:07:20.151051] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-21T17:07:20.950992] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-21T17:07:20.991584] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-21T17:07:21.012317] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T17:07:21.349481] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T17:07:21.751020] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-21T17:07:21.810719] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T17:07:22.550999] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-21T17:07:22.708725] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:07:23.351011] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-21T17:07:24.151076] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-21T17:07:24.951002] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-21T17:07:25.084286] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-21T17:07:25.108074] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T17:07:25.213839] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T17:07:25.751082] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-21T17:07:26.249172] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T17:07:26.551027] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-21T17:07:27.351025] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-21T17:07:28.151006] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-21T17:07:28.409069] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-21T17:07:28.582445] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T17:07:28.630412] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T17:07:28.634379] [INFO ] [REMOTE ] AIN: Full fetch complete (33707 records). [2025-10-21T17:07:28.634458] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-21T17:07:28.956777] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-21T17:07:29.006752] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-21T17:07:29.006851] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-21T17:07:29.007276] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-21T17:07:29.007321] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-21T17:07:29.008323] [DEBUG] [LOCAL ] AIN: Trimmed 33707 records to 24431 (keeping 200 days of data) [2025-10-21T17:07:29.162672] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T17:07:29.173260] [DEBUG] [LOCAL ] AIN: Primary data saved (24431 records). [2025-10-21T17:07:29.173391] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-21T17:07:29.173470] [INFO ] [MAIN ] Update Progress: 65/2366 symbols completed. AIN took 27.2s. Estimated remaining: 4h 22m 37s. Rate: 8.8 symbols/min [2025-10-21T17:07:29.340476] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:29.367429] [DEBUG] [LOCAL ] AIR: Loaded 28742 existing records from primary storage. [2025-10-21T17:07:29.367681] [INFO ] [MAIN ] AIR: Loaded 28742 existing records. [2025-10-21T17:07:29.543759] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:29.543982] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-21T17:07:29.544033] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-21T17:07:29.544268] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-21T17:07:29.544330] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-21T17:07:29.759004] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-21T17:07:29.894817] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:30.551023] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-21T17:07:30.809910] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T17:07:31.350987] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-21T17:07:31.643983] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.69 seconds). [2025-10-21T17:07:31.653543] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-21T17:07:31.653784] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-21T17:07:32.025215] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T17:07:32.126277] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-21T17:07:32.126406] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-21T17:07:32.127452] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-21T17:07:32.127550] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-21T17:07:32.129948] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53765 (keeping 200 days of data) [2025-10-21T17:07:32.184580] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-21T17:07:32.257036] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T17:07:32.519836] [DEBUG] [LOCAL ] AI: Primary data saved (53765 records). [2025-10-21T17:07:32.520071] [INFO ] [MAIN ] AI: Full history saved. [2025-10-21T17:07:32.520297] [INFO ] [MAIN ] Update Progress: 66/2366 symbols completed. AI took 40.9s. Estimated remaining: 4h 20m 28s. Rate: 8.8 symbols/min [2025-10-21T17:07:32.713495] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:32.740538] [DEBUG] [LOCAL ] AIT: Loaded 26804 existing records from primary storage. [2025-10-21T17:07:32.740916] [INFO ] [MAIN ] AIT: Loaded 26804 existing records. [2025-10-21T17:07:32.922998] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:32.923286] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-21T17:07:32.923357] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-21T17:07:32.923590] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-21T17:07:32.923697] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-21T17:07:32.955256] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-21T17:07:33.091052] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T17:07:33.304955] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:33.671255] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T17:07:33.751038] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-21T17:07:34.549935] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:07:34.552888] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-21T17:07:35.351108] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-21T17:07:35.907885] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T17:07:36.151033] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-21T17:07:36.352740] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T17:07:36.950998] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-21T17:07:37.047196] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:07:37.056343] [INFO ] [REMOTE ] AIG: Full fetch complete (77566 records). [2025-10-21T17:07:37.056501] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-21T17:07:37.458619] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-21T17:07:37.458731] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-21T17:07:37.459510] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-21T17:07:37.459574] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-21T17:07:37.461101] [DEBUG] [LOCAL ] AIG: Trimmed 77566 records to 53461 (keeping 200 days of data) [2025-10-21T17:07:37.765587] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-21T17:07:37.790430] [DEBUG] [LOCAL ] AIG: Primary data saved (53461 records). [2025-10-21T17:07:37.790593] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-21T17:07:37.792120] [INFO ] [MAIN ] Update Progress: 67/2366 symbols completed. AIG took 43.2s. Estimated remaining: 4h 19m 29s. Rate: 8.9 symbols/min [2025-10-21T17:07:37.899843] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T17:07:37.918863] [INFO ] [REMOTE ] AIO: Full fetch complete (20061 records). [2025-10-21T17:07:37.941906] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-21T17:07:38.010803] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:38.348635] [DEBUG] [LOCAL ] AIV: Loaded 41799 existing records from primary storage. [2025-10-21T17:07:38.367570] [INFO ] [MAIN ] AIV: Loaded 41799 existing records. [2025-10-21T17:07:38.561542] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-21T17:07:38.607243] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-21T17:07:38.607421] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-21T17:07:38.634540] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-21T17:07:38.642564] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-21T17:07:38.642375] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:38.643010] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-21T17:07:38.643279] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-21T17:07:38.643734] [DEBUG] [LOCAL ] AIO: Trimmed 20061 records to 13039 (keeping 200 days of data) [2025-10-21T17:07:38.643788] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-21T17:07:38.643944] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-21T17:07:38.896610] [DEBUG] [LOCAL ] AIO: Primary data saved (13039 records). [2025-10-21T17:07:38.916233] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-21T17:07:38.922131] [INFO ] [MAIN ] Update Progress: 68/2366 symbols completed. AIO took 22.5s. Estimated remaining: 4h 16m 12s. Rate: 9.0 symbols/min [2025-10-21T17:07:39.313211] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:07:39.326329] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:39.344480] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:07:39.351115] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-21T17:07:39.382938] [DEBUG] [LOCAL ] AIZ: Loaded 29471 existing records from primary storage. [2025-10-21T17:07:39.383233] [INFO ] [MAIN ] AIZ: Loaded 29471 existing records. [2025-10-21T17:07:39.589253] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:07:39.589518] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-21T17:07:39.589572] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-21T17:07:39.589792] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-21T17:07:39.589851] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-21T17:07:39.978766] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:07:39.982372] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:07:40.151039] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-21T17:07:40.833401] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:07:40.950982] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-21T17:07:41.670432] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:07:41.750986] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-21T17:07:42.366611] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:07:42.551070] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-21T17:07:43.043029] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:07:43.351075] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-21T17:07:44.007273] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T17:07:44.070942] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T17:07:44.151062] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-21T17:07:44.951037] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-21T17:07:45.648659] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T17:07:45.751044] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-21T17:07:46.108206] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:07:46.551087] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-21T17:07:47.151673] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T17:07:47.351015] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-21T17:07:47.993012] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T17:07:48.151035] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-21T17:07:48.904290] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:07:48.951010] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-21T17:07:49.136501] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T17:07:49.751027] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-21T17:07:50.132446] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T17:07:50.551000] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-21T17:07:50.842372] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T17:07:51.351019] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-21T17:07:51.864955] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T17:07:52.151087] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-21T17:07:52.951027] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-21T17:07:53.082064] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T17:07:53.221726] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T17:07:53.751131] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-21T17:07:53.988818] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T17:07:54.551071] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-21T17:07:54.611401] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T17:07:55.351012] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-21T17:07:55.514621] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T17:07:56.151032] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-21T17:07:56.951067] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-21T17:07:57.027048] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:07:57.705071] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T17:07:57.751052] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-21T17:07:58.340435] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T17:07:58.551062] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-21T17:07:58.840491] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T17:07:59.351044] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-21T17:08:00.117878] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T17:08:00.129361] [INFO ] [REMOTE ] AIV: Full fetch complete (60368 records). [2025-10-21T17:08:00.129540] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-21T17:08:00.160064] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-21T17:08:00.574262] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-21T17:08:00.574383] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-21T17:08:00.575061] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-21T17:08:00.590429] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-21T17:08:00.592388] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:08:00.599374] [DEBUG] [LOCAL ] AIV: Trimmed 60368 records to 41856 (keeping 200 days of data) [2025-10-21T17:08:00.836204] [DEBUG] [LOCAL ] AIV: Primary data saved (41856 records). [2025-10-21T17:08:00.836357] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-21T17:08:00.836458] [INFO ] [MAIN ] Update Progress: 69/2366 symbols completed. AIV took 23.0s. Estimated remaining: 4h 24m 32s. Rate: 8.7 symbols/min [2025-10-21T17:08:00.956142] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-21T17:08:01.004995] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:01.010324] [DEBUG] [LOCAL ] AIZN: Loaded 3848 existing records from primary storage. [2025-10-21T17:08:01.010499] [INFO ] [MAIN ] AIZN: Loaded 3848 existing records. [2025-10-21T17:08:01.188522] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:01.188793] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-21T17:08:01.188850] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-21T17:08:01.188986] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-21T17:08:01.189033] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-21T17:08:01.576588] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:01.578037] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:08:01.751003] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-21T17:08:02.036060] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T17:08:02.222781] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-21T17:08:02.551033] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-21T17:08:03.351049] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-21T17:08:03.835142] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T17:08:03.836364] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T17:08:04.151044] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-21T17:08:04.760234] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T17:08:04.951118] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-21T17:08:05.541012] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T17:08:05.751127] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-21T17:08:06.551074] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-21T17:08:07.183053] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:08:07.351012] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-21T17:08:07.700965] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T17:08:07.704724] [INFO ] [REMOTE ] AIT: Full fetch complete (38964 records). [2025-10-21T17:08:07.705087] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-21T17:08:07.705725] [FATAL] [VALIDATOR ] AIT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:08:07.705811] [FATAL] [MAIN ] AIT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:08:07.705854] [WARN ] [MAIN ] AIT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:08:07.705917] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-21T17:08:07.705983] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-10-21T17:08:07.706020] [INFO ] [LOCAL ] AIT: Starting deletion of derivative data. [2025-10-21T17:08:07.706169] [DEBUG] [LOCAL ] AIT: Deleted derivative data file. [2025-10-21T17:08:07.706258] [INFO ] [MAIN ] Update Progress: 70/2366 symbols completed. AIT took 35.2s. Estimated remaining: 4h 24m 24s. Rate: 8.7 symbols/min [2025-10-21T17:08:07.875800] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:07.921748] [DEBUG] [LOCAL ] AJG: Loaded 46490 existing records from primary storage. [2025-10-21T17:08:07.922266] [INFO ] [MAIN ] AJG: Loaded 46490 existing records. [2025-10-21T17:08:08.104522] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:08.104753] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-21T17:08:08.104807] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-21T17:08:08.104991] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-21T17:08:08.105031] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-21T17:08:08.160031] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-21T17:08:08.476435] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:08.552823] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T17:08:08.773271] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T17:08:08.951043] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-21T17:08:09.516818] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T17:08:09.751029] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-21T17:08:10.551023] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-21T17:08:10.652923] [DEBUG] [REMOTE ] AIR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-21T17:08:10.653211] [WARN ] [REMOTE ] AIR: No data returned for month 2025-10 [2025-10-21T17:08:10.653300] [FATAL] [REMOTE ] AIR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:08:10.653377] [FATAL] [MAIN ] AIR: Failed to fetch primary data. [2025-10-21T17:08:10.653412] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:08:10.653452] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-21T17:08:10.653506] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-21T17:08:10.653542] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-21T17:08:10.653712] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-10-21T17:08:10.653793] [INFO ] [MAIN ] Update Progress: 71/2366 symbols completed. AIR took 41.5s. Estimated remaining: 4h 22m 9s. Rate: 8.8 symbols/min [2025-10-21T17:08:10.832774] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:10.833191] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-21T17:08:10.833250] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-21T17:08:10.833363] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-21T17:08:10.833405] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-21T17:08:10.833448] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-21T17:08:10.833482] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-21T17:08:11.213182] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T17:08:11.218174] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:11.223069] [INFO ] [REMOTE ] AIZ: Full fetch complete (42813 records). [2025-10-21T17:08:11.223182] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-21T17:08:11.356127] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-21T17:08:11.657772] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-21T17:08:11.657935] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-21T17:08:11.658598] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-21T17:08:11.658696] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-21T17:08:11.660362] [DEBUG] [LOCAL ] AIZ: Trimmed 42813 records to 29391 (keeping 200 days of data) [2025-10-21T17:08:11.868198] [DEBUG] [LOCAL ] AIZ: Primary data saved (29391 records). [2025-10-21T17:08:11.868483] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-21T17:08:11.868595] [INFO ] [MAIN ] Update Progress: 72/2366 symbols completed. AIZ took 32.9s. Estimated remaining: 4h 19m 2s. Rate: 8.9 symbols/min [2025-10-21T17:08:12.067496] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:12.071784] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T17:08:12.122361] [DEBUG] [LOCAL ] AKR: Loaded 46127 existing records from primary storage. [2025-10-21T17:08:12.122802] [INFO ] [MAIN ] AKR: Loaded 46127 existing records. [2025-10-21T17:08:12.156979] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-21T17:08:12.324690] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:12.325117] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-21T17:08:12.325173] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-21T17:08:12.325438] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-21T17:08:12.325479] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-21T17:08:12.720270] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:12.898923] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T17:08:12.951007] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-21T17:08:13.751033] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-21T17:08:14.551071] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-21T17:08:14.622403] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T17:08:15.019510] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T17:08:15.260448] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T17:08:15.351019] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-21T17:08:16.151038] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-21T17:08:16.745317] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T17:08:16.951067] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-21T17:08:17.069029] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T17:08:17.453210] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T17:08:17.751022] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-21T17:08:18.551079] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-21T17:08:19.126718] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T17:08:19.127901] [INFO ] [REMOTE ] AIZN: Full fetch complete (5805 records). [2025-10-21T17:08:19.127969] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-21T17:08:19.276464] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T17:08:19.357442] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-21T17:08:19.523404] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-21T17:08:19.523475] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-21T17:08:19.523628] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-21T17:08:19.523700] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-21T17:08:19.524057] [DEBUG] [LOCAL ] AIZN: Trimmed 5805 records to 3846 (keeping 200 days of data) [2025-10-21T17:08:19.546517] [DEBUG] [LOCAL ] AIZN: Primary data saved (3846 records). [2025-10-21T17:08:19.546593] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-21T17:08:19.546684] [INFO ] [MAIN ] Update Progress: 73/2366 symbols completed. AIZN took 18.7s. Estimated remaining: 4h 19m 24s. Rate: 8.8 symbols/min [2025-10-21T17:08:19.717622] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:19.758075] [DEBUG] [LOCAL ] AL: Loaded 44827 existing records from primary storage. [2025-10-21T17:08:19.758384] [INFO ] [MAIN ] AL: Loaded 44827 existing records. [2025-10-21T17:08:19.862609] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T17:08:19.940727] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:19.940957] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-21T17:08:19.941024] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-21T17:08:19.941266] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-21T17:08:19.941340] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-21T17:08:20.156230] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-21T17:08:20.291027] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:20.951070] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-21T17:08:21.408144] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T17:08:21.751069] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-21T17:08:21.922429] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T17:08:22.303201] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T17:08:22.551029] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-21T17:08:22.836631] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-21T17:08:23.351032] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-21T17:08:24.151045] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-21T17:08:24.874179] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:08:24.951018] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-21T17:08:25.750995] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-21T17:08:25.837107] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:08:26.382925] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T17:08:26.551012] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-21T17:08:27.350996] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-21T17:08:27.515938] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T17:08:27.697860] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T17:08:28.151018] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-21T17:08:28.523047] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T17:08:28.543331] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-21T17:08:28.951008] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-21T17:08:29.751065] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-21T17:08:30.551055] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-21T17:08:30.653805] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:08:30.892960] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-21T17:08:31.351056] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-21T17:08:31.377206] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T17:08:32.151032] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-21T17:08:32.634348] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T17:08:32.762763] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:08:32.951016] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-21T17:08:33.751130] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-21T17:08:34.564715] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-21T17:08:34.592550] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:08:35.147914] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T17:08:35.149252] [INFO ] [REMOTE ] AKA: Full fetch complete (2814 records). [2025-10-21T17:08:35.149345] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-21T17:08:35.329870] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T17:08:35.330083] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:08:35.330223] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:08:35.330300] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-21T17:08:35.330361] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-21T17:08:35.330399] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-21T17:08:35.330437] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-21T17:08:35.330493] [INFO ] [MAIN ] Update Progress: 74/2366 symbols completed. AKA took 24.7s. Estimated remaining: 4h 23m 56s. Rate: 8.7 symbols/min [2025-10-21T17:08:35.361471] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-21T17:08:35.501874] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:35.550775] [DEBUG] [LOCAL ] ALB: Loaded 53378 existing records from primary storage. [2025-10-21T17:08:35.551096] [INFO ] [MAIN ] ALB: Loaded 53378 existing records. [2025-10-21T17:08:35.730341] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:35.730694] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-21T17:08:35.730755] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-21T17:08:35.738970] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-21T17:08:35.739057] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-21T17:08:35.833282] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-21T17:08:36.120402] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:36.151089] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-21T17:08:36.951052] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-21T17:08:37.161952] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:08:37.751055] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-21T17:08:37.862022] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:08:38.288791] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T17:08:38.551097] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-21T17:08:39.351035] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-21T17:08:39.389011] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:08:40.145694] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T17:08:40.154173] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-21T17:08:40.950991] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-21T17:08:41.291902] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T17:08:41.701046] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:08:41.751108] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-21T17:08:42.551010] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-21T17:08:42.615191] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:08:43.273125] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T17:08:43.350988] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-21T17:08:44.150998] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-21T17:08:44.424270] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:08:44.921330] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T17:08:44.928744] [INFO ] [REMOTE ] AKR: Full fetch complete (65481 records). [2025-10-21T17:08:44.928869] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-21T17:08:44.959619] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-21T17:08:45.314322] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-21T17:08:45.314412] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-21T17:08:45.315070] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-21T17:08:45.315134] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-21T17:08:45.316474] [DEBUG] [LOCAL ] AKR: Trimmed 65481 records to 46115 (keeping 200 days of data) [2025-10-21T17:08:45.598761] [DEBUG] [LOCAL ] AKR: Primary data saved (46115 records). [2025-10-21T17:08:45.598906] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-21T17:08:45.601323] [INFO ] [MAIN ] Update Progress: 75/2366 symbols completed. AKR took 33.7s. Estimated remaining: 4h 25m 32s. Rate: 8.6 symbols/min [2025-10-21T17:08:45.775035] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:45.754297] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-21T17:08:45.841515] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:08:45.868755] [DEBUG] [LOCAL ] ALC: Loaded 51212 existing records from primary storage. [2025-10-21T17:08:45.869060] [INFO ] [MAIN ] ALC: Loaded 51212 existing records. [2025-10-21T17:08:46.048499] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:46.048733] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-21T17:08:46.048787] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-21T17:08:46.049745] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-21T17:08:46.049805] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-21T17:08:46.409036] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:46.551040] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-21T17:08:46.659557] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T17:08:47.351114] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-21T17:08:47.932500] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T17:08:48.151021] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-21T17:08:48.254024] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:08:48.951025] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-21T17:08:49.137167] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:08:49.751062] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-21T17:08:49.881757] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T17:08:50.551047] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-21T17:08:50.957721] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:08:51.012511] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T17:08:51.019986] [INFO ] [REMOTE ] AL: Full fetch complete (63611 records). [2025-10-21T17:08:51.020091] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-21T17:08:51.361056] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-21T17:08:51.406038] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-21T17:08:51.406104] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-21T17:08:51.406730] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-21T17:08:51.406791] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-21T17:08:51.408008] [DEBUG] [LOCAL ] AL: Trimmed 63611 records to 44794 (keeping 200 days of data) [2025-10-21T17:08:51.669536] [DEBUG] [LOCAL ] AL: Primary data saved (44794 records). [2025-10-21T17:08:51.669681] [INFO ] [MAIN ] AL: Full history saved. [2025-10-21T17:08:51.670516] [INFO ] [MAIN ] Update Progress: 76/2366 symbols completed. AL took 32.1s. Estimated remaining: 4h 24m 58s. Rate: 8.6 symbols/min [2025-10-21T17:08:51.843981] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:08:51.876828] [DEBUG] [LOCAL ] ALE: Loaded 32104 existing records from primary storage. [2025-10-21T17:08:51.877071] [INFO ] [MAIN ] ALE: Loaded 32104 existing records. [2025-10-21T17:08:52.064256] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:08:52.064686] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-21T17:08:52.064796] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-21T17:08:52.071296] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-21T17:08:52.081952] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-21T17:08:52.155905] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-21T17:08:52.149940] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:08:52.197341] [INFO ] [REMOTE ] AJG: Full fetch complete (68928 records). [2025-10-21T17:08:52.208234] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-21T17:08:52.739836] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:08:52.853103] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-21T17:08:52.853349] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-21T17:08:52.854067] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-21T17:08:52.854144] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-21T17:08:52.855723] [DEBUG] [LOCAL ] AJG: Trimmed 68928 records to 46428 (keeping 200 days of data) [2025-10-21T17:08:52.954738] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-21T17:08:53.096559] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:08:53.178864] [DEBUG] [LOCAL ] AJG: Primary data saved (46428 records). [2025-10-21T17:08:53.178983] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-21T17:08:53.179055] [INFO ] [MAIN ] Update Progress: 77/2366 symbols completed. AJG took 45.5s. Estimated remaining: 4h 22m 10s. Rate: 8.7 symbols/min [2025-10-21T17:08:53.641034] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T17:08:53.750983] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-21T17:08:54.347701] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T17:08:54.551004] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-21T17:08:55.351036] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-21T17:08:55.683486] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T17:08:55.731915] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T17:08:56.151071] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-21T17:08:56.951053] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-21T17:08:57.287130] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T17:08:57.505145] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:08:57.751024] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-21T17:08:58.454581] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T17:08:58.551121] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-21T17:08:59.181923] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T17:08:59.351021] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-21T17:09:00.151028] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-21T17:09:00.353554] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:09:00.951075] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-21T17:09:01.297790] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T17:09:01.519815] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T17:09:01.751010] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-21T17:09:02.335583] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T17:09:02.551029] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-21T17:09:02.888875] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:09:03.351039] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-21T17:09:04.151045] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-21T17:09:04.396816] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T17:09:04.951061] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-21T17:09:05.015857] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:09:05.751074] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-21T17:09:06.564140] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-21T17:09:06.576891] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-21T17:09:06.911907] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T17:09:07.052362] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T17:09:07.351014] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-21T17:09:07.454451] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T17:09:07.462984] [INFO ] [REMOTE ] ALB: Full fetch complete (77070 records). [2025-10-21T17:09:07.463170] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-21T17:09:07.888837] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-21T17:09:07.888975] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-21T17:09:07.889972] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-21T17:09:07.890046] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-21T17:09:07.891749] [DEBUG] [LOCAL ] ALB: Trimmed 77070 records to 53366 (keeping 200 days of data) [2025-10-21T17:09:08.151749] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-21T17:09:08.239672] [DEBUG] [LOCAL ] ALB: Primary data saved (53366 records). [2025-10-21T17:09:08.239827] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-21T17:09:08.239925] [INFO ] [MAIN ] Update Progress: 78/2366 symbols completed. ALB took 32.9s. Estimated remaining: 4h 26m 3s. Rate: 8.6 symbols/min [2025-10-21T17:09:09.465403] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-21T17:09:09.476731] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-21T17:09:09.580160] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T17:09:09.751007] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-21T17:09:11.311485] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:09:11.329800] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T17:09:11.336388] [INFO ] [REMOTE ] ALE: Full fetch complete (44228 records). [2025-10-21T17:09:11.336544] [INFO ] [REMOTE ] ALC: Full fetch complete (73810 records). [2025-10-21T17:09:11.336698] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-21T17:09:11.336787] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-21T17:09:12.130434] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-21T17:09:12.133973] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-21T17:09:12.134048] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-21T17:09:12.134088] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-21T17:09:12.134588] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-21T17:09:12.135301] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-21T17:09:12.135383] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-21T17:09:12.135453] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-21T17:09:12.137259] [DEBUG] [LOCAL ] ALE: Trimmed 44228 records to 32060 (keeping 200 days of data) [2025-10-21T17:09:12.137375] [DEBUG] [LOCAL ] ALC: Trimmed 73810 records to 51216 (keeping 200 days of data) [2025-10-21T17:09:12.550690] [DEBUG] [LOCAL ] ALC: Primary data saved (51216 records). [2025-10-21T17:09:12.552476] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-21T17:09:12.554461] [INFO ] [MAIN ] Update Progress: 79/2366 symbols completed. ALC took 27.0s. Estimated remaining: 4h 24m 39s. Rate: 8.6 symbols/min [2025-10-21T17:09:12.624731] [DEBUG] [LOCAL ] ALE: Primary data saved (32060 records). [2025-10-21T17:09:12.624868] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-21T17:09:12.625932] [INFO ] [MAIN ] Update Progress: 80/2366 symbols completed. ALE took 21.0s. Estimated remaining: 4h 21m 16s. Rate: 8.7 symbols/min [2025-10-21T17:09:13.263044] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:13.223386] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:13.343168] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-21T17:09:13.343107] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:13.345450] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:13.345576] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-21T17:09:13.346365] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-21T17:09:13.346603] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-21T17:09:13.346701] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-21T17:09:13.346751] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-21T17:09:13.483383] [DEBUG] [LOCAL ] ALG: Loaded 9748 existing records from primary storage. [2025-10-21T17:09:13.515505] [INFO ] [MAIN ] ALG: Loaded 9748 existing records. [2025-10-21T17:09:13.559241] [DEBUG] [LOCAL ] ALEX: Loaded 31005 existing records from primary storage. [2025-10-21T17:09:13.618926] [INFO ] [MAIN ] ALEX: Loaded 31005 existing records. [2025-10-21T17:09:13.877239] [DEBUG] [LOCAL ] ALIT: Loaded 52790 existing records from primary storage. [2025-10-21T17:09:13.915528] [INFO ] [MAIN ] ALIT: Loaded 52790 existing records. [2025-10-21T17:09:14.058620] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:14.125504] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:14.179268] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-21T17:09:14.201479] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-21T17:09:14.206797] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-21T17:09:14.255379] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-21T17:09:14.264295] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:14.273359] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-21T17:09:14.273768] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-21T17:09:14.308481] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-21T17:09:14.343125] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-21T17:09:14.374140] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-21T17:09:14.414528] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:14.466957] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-21T17:09:14.495071] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-21T17:09:14.484573] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:09:14.542338] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-21T17:09:14.542717] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-21T17:09:14.542624] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:09:14.547915] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-21T17:09:14.553230] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-21T17:09:14.616552] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:09:14.731145] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-21T17:09:14.777755] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-21T17:09:14.855976] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-21T17:09:14.938034] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-21T17:09:15.030925] [INFO ] [MAIN ] Update Progress: 81/2366 symbols completed. ALH took 2.4s. Estimated remaining: 4h 19m 3s. Rate: 8.8 symbols/min [2025-10-21T17:09:15.310985] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:15.350811] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-21T17:09:15.601206] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:15.615244] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-21T17:09:15.642235] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:15.656177] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-21T17:09:15.692121] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:15.745151] [DEBUG] [LOCAL ] ALK: Loaded 53085 existing records from primary storage. [2025-10-21T17:09:15.745517] [INFO ] [MAIN ] ALK: Loaded 53085 existing records. [2025-10-21T17:09:15.924826] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:15.925058] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-21T17:09:15.925104] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-21T17:09:15.925889] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-21T17:09:15.925945] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-21T17:09:16.276385] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:16.276734] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-21T17:09:16.380892] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T17:09:16.383914] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-21T17:09:16.956788] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T17:09:16.962753] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-21T17:09:17.224881] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T17:09:17.227847] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-21T17:09:17.470236] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T17:09:17.480849] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-21T17:09:17.851204] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T17:09:17.854842] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-21T17:09:17.929631] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:09:18.091027] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T17:09:18.551061] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-21T17:09:18.624341] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T17:09:18.819483] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:09:19.351052] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-21T17:09:20.151147] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-21T17:09:20.298479] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T17:09:20.951015] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-21T17:09:21.072465] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T17:09:21.465943] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T17:09:21.750999] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-21T17:09:22.551025] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-21T17:09:22.894137] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T17:09:23.304096] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T17:09:23.350986] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-21T17:09:24.160248] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-21T17:09:24.180368] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:09:24.232232] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T17:09:24.951056] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-21T17:09:25.196495] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:09:25.751022] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-21T17:09:26.551053] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-21T17:09:26.734851] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:09:26.822948] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T17:09:27.351030] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-21T17:09:28.151017] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-21T17:09:28.510303] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T17:09:28.797736] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T17:09:28.951022] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-21T17:09:29.466531] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T17:09:29.735482] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T17:09:29.750982] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-21T17:09:30.488713] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T17:09:30.551026] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-21T17:09:31.292622] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T17:09:31.294570] [INFO ] [REMOTE ] ALG: Full fetch complete (15246 records). [2025-10-21T17:09:31.294704] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-21T17:09:31.356191] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-21T17:09:31.677819] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-21T17:09:31.677897] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-21T17:09:31.678144] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-21T17:09:31.678183] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-21T17:09:31.678723] [DEBUG] [LOCAL ] ALG: Trimmed 15246 records to 9723 (keeping 200 days of data) [2025-10-21T17:09:31.742104] [DEBUG] [LOCAL ] ALG: Primary data saved (9723 records). [2025-10-21T17:09:31.742248] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-21T17:09:31.742327] [INFO ] [MAIN ] Update Progress: 82/2366 symbols completed. ALG took 19.1s. Estimated remaining: 4h 23m 32s. Rate: 8.7 symbols/min [2025-10-21T17:09:31.913422] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:31.961988] [DEBUG] [LOCAL ] ALL: Loaded 49721 existing records from primary storage. [2025-10-21T17:09:31.962326] [INFO ] [MAIN ] ALL: Loaded 49721 existing records. [2025-10-21T17:09:32.140081] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:32.140329] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-21T17:09:32.140386] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-21T17:09:32.140806] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-21T17:09:32.140862] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-21T17:09:32.161590] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-21T17:09:32.501855] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:32.950997] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-21T17:09:33.103846] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:09:33.756087] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-21T17:09:33.768773] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:09:33.985190] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T17:09:34.551058] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-21T17:09:35.351031] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-21T17:09:35.717928] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T17:09:35.796361] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:09:36.151075] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-21T17:09:36.950993] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-21T17:09:37.194804] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T17:09:37.689698] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T17:09:37.750992] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-21T17:09:38.243791] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:09:38.551092] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-21T17:09:39.351009] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-21T17:09:39.652550] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T17:09:40.154389] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-21T17:09:40.157180] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:09:40.951019] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-21T17:09:40.993417] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:09:41.751028] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-21T17:09:42.013605] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T17:09:42.118306] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T17:09:42.551051] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-21T17:09:43.351016] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-21T17:09:43.731857] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:09:44.151048] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-21T17:09:44.412621] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T17:09:44.421028] [INFO ] [REMOTE ] ALIT: Full fetch complete (76614 records). [2025-10-21T17:09:44.421154] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-21T17:09:44.823874] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-21T17:09:44.823997] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-21T17:09:44.824825] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-21T17:09:44.824889] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-21T17:09:44.826282] [DEBUG] [LOCAL ] ALIT: Trimmed 76614 records to 52785 (keeping 200 days of data) [2025-10-21T17:09:44.990143] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-21T17:09:45.129359] [DEBUG] [LOCAL ] ALIT: Primary data saved (52785 records). [2025-10-21T17:09:45.129585] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-21T17:09:45.130493] [INFO ] [MAIN ] Update Progress: 83/2366 symbols completed. ALIT took 32.5s. Estimated remaining: 4h 26m 23s. Rate: 8.6 symbols/min [2025-10-21T17:09:45.312550] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:45.346202] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T17:09:45.397612] [DEBUG] [LOCAL ] ALLE: Loaded 44026 existing records from primary storage. [2025-10-21T17:09:45.397938] [INFO ] [MAIN ] ALLE: Loaded 44026 existing records. [2025-10-21T17:09:45.580572] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:45.580894] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-21T17:09:45.580976] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-21T17:09:45.581200] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-21T17:09:45.581258] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-21T17:09:45.760326] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-21T17:09:45.969411] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:45.988373] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T17:09:46.022044] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:09:46.551089] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-21T17:09:47.351076] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-21T17:09:47.781670] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-21T17:09:47.789965] [INFO ] [REMOTE ] ALK: Full fetch complete (77032 records). [2025-10-21T17:09:47.790098] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-21T17:09:48.170907] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-21T17:09:48.197333] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-21T17:09:48.197517] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-21T17:09:48.198403] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-21T17:09:48.198471] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-21T17:09:48.200244] [DEBUG] [LOCAL ] ALK: Trimmed 77032 records to 53087 (keeping 200 days of data) [2025-10-21T17:09:48.448595] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T17:09:48.550070] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-21T17:09:48.550218] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-21T17:09:48.550297] [INFO ] [MAIN ] Update Progress: 84/2366 symbols completed. ALK took 33.5s. Estimated remaining: 4h 24m 39s. Rate: 8.6 symbols/min [2025-10-21T17:09:48.721719] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:48.774671] [DEBUG] [LOCAL ] ALLY: Loaded 53224 existing records from primary storage. [2025-10-21T17:09:48.775031] [INFO ] [MAIN ] ALLY: Loaded 53224 existing records. [2025-10-21T17:09:48.951327] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-21T17:09:48.957098] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:48.958222] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-21T17:09:48.958398] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-21T17:09:48.958596] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-21T17:09:48.958636] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-21T17:09:49.257734] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T17:09:49.370175] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:49.583461] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T17:09:49.589050] [INFO ] [REMOTE ] ALEX: Full fetch complete (44501 records). [2025-10-21T17:09:49.589175] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-21T17:09:49.755015] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-21T17:09:49.964052] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-21T17:09:49.964127] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-21T17:09:49.964621] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-21T17:09:49.964697] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-21T17:09:49.965617] [DEBUG] [LOCAL ] ALEX: Trimmed 44501 records to 30881 (keeping 200 days of data) [2025-10-21T17:09:50.147768] [DEBUG] [LOCAL ] ALEX: Primary data saved (30881 records). [2025-10-21T17:09:50.148002] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-21T17:09:50.148110] [INFO ] [MAIN ] Update Progress: 85/2366 symbols completed. ALEX took 37.5s. Estimated remaining: 4h 22m 8s. Rate: 8.7 symbols/min [2025-10-21T17:09:50.345189] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T17:09:50.348120] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:09:50.394049] [DEBUG] [LOCAL ] ALSN: Loaded 43332 existing records from primary storage. [2025-10-21T17:09:50.394325] [INFO ] [MAIN ] ALSN: Loaded 43332 existing records. [2025-10-21T17:09:50.565575] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-21T17:09:50.593415] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:09:50.593738] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-21T17:09:50.593790] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-21T17:09:50.593995] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-21T17:09:50.594032] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-21T17:09:50.950143] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:09:51.351004] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-21T17:09:51.435207] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:09:52.151040] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-21T17:09:52.201305] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T17:09:52.951018] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-21T17:09:53.346186] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T17:09:53.403409] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T17:09:53.751100] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-21T17:09:54.551019] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-21T17:09:54.622490] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T17:09:55.278191] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T17:09:55.351000] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-21T17:09:56.151016] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-21T17:09:56.430891] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T17:09:56.951023] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-21T17:09:57.029243] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T17:09:57.545237] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T17:09:57.751083] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-21T17:09:58.347860] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T17:09:58.551029] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-21T17:09:59.351058] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-21T17:09:59.412231] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:10:00.156121] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-21T17:10:00.171889] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:10:00.472845] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T17:10:00.951107] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-21T17:10:01.116925] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T17:10:01.124378] [INFO ] [REMOTE ] ALL: Full fetch complete (72487 records). [2025-10-21T17:10:01.124500] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-21T17:10:01.529848] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-21T17:10:01.529938] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-21T17:10:01.530620] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-21T17:10:01.530704] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-21T17:10:01.532105] [DEBUG] [LOCAL ] ALL: Trimmed 72487 records to 49648 (keeping 200 days of data) [2025-10-21T17:10:01.759296] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-21T17:10:01.858711] [DEBUG] [LOCAL ] ALL: Primary data saved (49648 records). [2025-10-21T17:10:01.858877] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-21T17:10:01.860111] [INFO ] [MAIN ] Update Progress: 86/2366 symbols completed. ALL took 30.1s. Estimated remaining: 4h 24m 9s. Rate: 8.6 symbols/min [2025-10-21T17:10:02.058992] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:02.085532] [DEBUG] [LOCAL ] ALTG: Loaded 23275 existing records from primary storage. [2025-10-21T17:10:02.085833] [INFO ] [MAIN ] ALTG: Loaded 23275 existing records. [2025-10-21T17:10:02.275215] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:02.275517] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-21T17:10:02.275572] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-21T17:10:02.275838] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-21T17:10:02.275895] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-21T17:10:02.564139] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-21T17:10:02.684848] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:02.714606] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T17:10:03.351087] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-21T17:10:04.097193] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-21T17:10:04.151044] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-21T17:10:04.433419] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T17:10:04.479108] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:10:04.951041] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-21T17:10:05.742068] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T17:10:05.751059] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-21T17:10:05.961594] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T17:10:06.551005] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-21T17:10:07.351130] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-21T17:10:07.494509] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:10:07.929375] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T17:10:08.151088] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-21T17:10:08.951038] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-21T17:10:09.131277] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T17:10:09.751043] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-21T17:10:09.819006] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T17:10:09.919352] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T17:10:10.551073] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-21T17:10:11.323131] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T17:10:11.329850] [INFO ] [REMOTE ] ALLE: Full fetch complete (64914 records). [2025-10-21T17:10:11.330003] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-21T17:10:11.362850] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-21T17:10:11.746462] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-21T17:10:11.746586] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-21T17:10:11.747447] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-21T17:10:11.747527] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-21T17:10:11.748981] [DEBUG] [LOCAL ] ALLE: Trimmed 64914 records to 43990 (keeping 200 days of data) [2025-10-21T17:10:12.044887] [DEBUG] [LOCAL ] ALLE: Primary data saved (43990 records). [2025-10-21T17:10:12.045023] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-21T17:10:12.045961] [INFO ] [MAIN ] Update Progress: 87/2366 symbols completed. ALLE took 26.9s. Estimated remaining: 4h 25m 27s. Rate: 8.6 symbols/min [2025-10-21T17:10:12.151104] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-21T17:10:12.225483] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:12.236954] [DEBUG] [LOCAL ] ALUR: Loaded 9345 existing records from primary storage. [2025-10-21T17:10:12.237178] [INFO ] [MAIN ] ALUR: Loaded 9345 existing records. [2025-10-21T17:10:12.419760] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:12.420580] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-21T17:10:12.420713] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-21T17:10:12.421150] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-21T17:10:12.421211] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-21T17:10:12.667376] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T17:10:12.684174] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T17:10:12.907571] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:12.951055] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-21T17:10:13.751025] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-21T17:10:13.789310] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:10:14.088488] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:10:14.551059] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-21T17:10:15.351025] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-21T17:10:15.634455] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:10:15.919445] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T17:10:16.151027] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-21T17:10:16.950999] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-21T17:10:17.257311] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T17:10:17.281295] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T17:10:17.751052] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-21T17:10:18.551035] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-21T17:10:18.751103] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T17:10:18.814790] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T17:10:19.267756] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T17:10:19.350981] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-21T17:10:20.151043] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-21T17:10:20.452697] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T17:10:20.458157] [INFO ] [REMOTE ] ALTG: Full fetch complete (33427 records). [2025-10-21T17:10:20.458369] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-21T17:10:20.836230] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-21T17:10:20.836311] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-21T17:10:20.836754] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-21T17:10:20.836821] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-21T17:10:20.837720] [DEBUG] [LOCAL ] ALTG: Trimmed 33427 records to 23188 (keeping 200 days of data) [2025-10-21T17:10:20.957366] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-21T17:10:20.969310] [DEBUG] [LOCAL ] ALTG: Primary data saved (23188 records). [2025-10-21T17:10:20.969445] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-21T17:10:20.969531] [INFO ] [MAIN ] Update Progress: 88/2366 symbols completed. ALTG took 19.1s. Estimated remaining: 4h 26m 10s. Rate: 8.6 symbols/min [2025-10-21T17:10:21.147278] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:21.189398] [DEBUG] [LOCAL ] ALV: Loaded 42190 existing records from primary storage. [2025-10-21T17:10:21.189729] [INFO ] [MAIN ] ALV: Loaded 42190 existing records. [2025-10-21T17:10:21.376470] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:21.387020] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-21T17:10:21.387683] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-21T17:10:21.388223] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T17:10:21.392671] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-21T17:10:21.393287] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-21T17:10:21.755878] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-21T17:10:21.755811] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:22.550995] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-21T17:10:22.578091] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T17:10:22.909161] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T17:10:23.351037] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-21T17:10:23.840877] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T17:10:24.151025] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-21T17:10:24.950990] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-21T17:10:25.428046] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-21T17:10:25.436418] [INFO ] [REMOTE ] ALLY: Full fetch complete (77240 records). [2025-10-21T17:10:25.436545] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-21T17:10:25.758304] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-21T17:10:25.828868] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-21T17:10:25.828994] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-21T17:10:25.829939] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-21T17:10:25.830107] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-21T17:10:25.859846] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:10:25.870029] [DEBUG] [LOCAL ] ALLY: Trimmed 77240 records to 53223 (keeping 200 days of data) [2025-10-21T17:10:26.177829] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T17:10:26.202084] [DEBUG] [LOCAL ] ALLY: Primary data saved (53223 records). [2025-10-21T17:10:26.202204] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-21T17:10:26.202290] [INFO ] [MAIN ] Update Progress: 89/2366 symbols completed. ALLY took 37.7s. Estimated remaining: 4h 25m 17s. Rate: 8.6 symbols/min [2025-10-21T17:10:26.367866] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:26.376595] [DEBUG] [LOCAL ] ALX: Loaded 7183 existing records from primary storage. [2025-10-21T17:10:26.376797] [INFO ] [MAIN ] ALX: Loaded 7183 existing records. [2025-10-21T17:10:26.556845] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-21T17:10:26.562697] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:26.563563] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-21T17:10:26.563626] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-21T17:10:26.563817] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-21T17:10:26.563863] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-21T17:10:26.921704] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:27.350994] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-21T17:10:27.823280] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-21T17:10:27.901818] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:10:27.969904] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T17:10:28.151004] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-21T17:10:28.667578] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T17:10:28.951010] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-21T17:10:29.751011] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-21T17:10:30.211197] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T17:10:30.550995] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-21T17:10:30.628431] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T17:10:31.035297] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T17:10:31.351007] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-21T17:10:31.880377] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-21T17:10:32.151032] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-21T17:10:32.812275] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-21T17:10:32.951004] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-21T17:10:33.751011] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-21T17:10:33.764818] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T17:10:34.551033] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-21T17:10:35.157356] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T17:10:35.209941] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T17:10:35.351067] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-21T17:10:36.151069] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-21T17:10:36.408553] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T17:10:36.951437] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-21T17:10:36.966867] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T17:10:37.750992] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-21T17:10:37.788940] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T17:10:38.551029] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-21T17:10:39.351007] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-21T17:10:39.487520] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T17:10:39.504051] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T17:10:39.905074] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T17:10:40.151032] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-21T17:10:40.951045] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-21T17:10:41.741547] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T17:10:41.743251] [INFO ] [REMOTE ] ALUR: Full fetch complete (18348 records). [2025-10-21T17:10:41.743320] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-21T17:10:41.756329] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-21T17:10:41.903030] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:10:42.177818] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-21T17:10:42.177899] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-21T17:10:42.178192] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-21T17:10:42.178234] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-21T17:10:42.178906] [DEBUG] [LOCAL ] ALUR: Trimmed 18348 records to 9307 (keeping 200 days of data) [2025-10-21T17:10:42.231964] [DEBUG] [LOCAL ] ALUR: Primary data saved (9307 records). [2025-10-21T17:10:42.232104] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-21T17:10:42.232185] [INFO ] [MAIN ] Update Progress: 90/2366 symbols completed. ALUR took 30.2s. Estimated remaining: 4h 28m 59s. Rate: 8.5 symbols/min [2025-10-21T17:10:42.401360] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:42.452182] [DEBUG] [LOCAL ] AM: Loaded 51887 existing records from primary storage. [2025-10-21T17:10:42.452478] [INFO ] [MAIN ] AM: Loaded 51887 existing records. [2025-10-21T17:10:42.554823] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-21T17:10:42.609317] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T17:10:42.619774] [INFO ] [REMOTE ] ALX: Full fetch complete (8047 records). [2025-10-21T17:10:42.648541] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-21T17:10:42.652540] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:42.653028] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-21T17:10:42.697441] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-21T17:10:42.718355] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-21T17:10:42.729745] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-21T17:10:43.356083] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-21T17:10:43.362460] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-21T17:10:43.368667] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-21T17:10:43.368996] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-21T17:10:43.374325] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-21T17:10:43.385936] [DEBUG] [LOCAL ] ALX: Trimmed 8047 records to 7228 (keeping 200 days of data) [2025-10-21T17:10:43.469491] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:43.496063] [DEBUG] [LOCAL ] ALX: Primary data saved (7228 records). [2025-10-21T17:10:43.496193] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-21T17:10:43.496275] [INFO ] [MAIN ] Update Progress: 91/2366 symbols completed. ALX took 17.3s. Estimated remaining: 4h 26m 26s. Rate: 8.5 symbols/min [2025-10-21T17:10:43.666817] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:43.699932] [DEBUG] [LOCAL ] AMBC: Loaded 36189 existing records from primary storage. [2025-10-21T17:10:43.700218] [INFO ] [MAIN ] AMBC: Loaded 36189 existing records. [2025-10-21T17:10:43.883726] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:10:43.884503] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-21T17:10:43.884551] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-21T17:10:43.884938] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-21T17:10:43.884994] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-21T17:10:44.161531] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-21T17:10:44.256204] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:44.367903] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:10:44.376749] [INFO ] [REMOTE ] ALSN: Full fetch complete (62616 records). [2025-10-21T17:10:44.376880] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-21T17:10:44.844344] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-21T17:10:44.844688] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-21T17:10:44.845523] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-21T17:10:44.854455] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-21T17:10:44.870302] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T17:10:44.880226] [DEBUG] [LOCAL ] ALSN: Trimmed 62616 records to 43269 (keeping 200 days of data) [2025-10-21T17:10:44.951153] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-21T17:10:45.150669] [DEBUG] [LOCAL ] ALSN: Primary data saved (43269 records). [2025-10-21T17:10:45.150804] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-21T17:10:45.150888] [INFO ] [MAIN ] Update Progress: 92/2366 symbols completed. ALSN took 55.0s. Estimated remaining: 4h 24m 6s. Rate: 8.6 symbols/min [2025-10-21T17:10:45.318125] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:45.318362] [DEBUG] [LOCAL ] AMBP: No existing data file found in primary storage. [2025-10-21T17:10:45.318409] [WARN ] [MAIN ] AMBP: No existing data found, performing full refresh instead. [2025-10-21T17:10:45.318551] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-21T17:10:45.318593] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-21T17:10:45.318633] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-10-21T17:10:45.318706] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-21T17:10:45.744890] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:10:45.756112] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-21T17:10:45.775119] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T17:10:46.551054] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-21T17:10:46.645162] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T17:10:47.203674] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:10:47.350992] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-21T17:10:48.151008] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-21T17:10:48.311622] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T17:10:48.932876] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T17:10:48.951003] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-21T17:10:49.663841] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T17:10:49.750995] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-21T17:10:50.219227] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:10:50.551036] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-21T17:10:51.351006] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-21T17:10:51.523468] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T17:10:52.078731] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T17:10:52.151019] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-21T17:10:52.499675] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T17:10:52.951027] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-21T17:10:53.751003] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-21T17:10:53.940183] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:10:54.551045] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-21T17:10:54.623057] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T17:10:54.815634] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T17:10:55.351055] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-21T17:10:56.151008] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-21T17:10:56.340557] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T17:10:56.913249] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T17:10:56.950982] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-21T17:10:57.751006] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-21T17:10:57.896415] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:10:58.551055] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-21T17:10:58.680453] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T17:10:58.687863] [INFO ] [REMOTE ] ALV: Full fetch complete (62354 records). [2025-10-21T17:10:58.688040] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-21T17:10:59.101795] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-21T17:10:59.102103] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-21T17:10:59.102765] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-21T17:10:59.102830] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-21T17:10:59.104349] [DEBUG] [LOCAL ] ALV: Trimmed 62354 records to 42182 (keeping 200 days of data) [2025-10-21T17:10:59.132512] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T17:10:59.364770] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-21T17:10:59.406486] [DEBUG] [LOCAL ] ALV: Primary data saved (42182 records). [2025-10-21T17:10:59.406634] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-21T17:10:59.408313] [INFO ] [MAIN ] Update Progress: 93/2366 symbols completed. ALV took 38.4s. Estimated remaining: 4h 26m 58s. Rate: 8.5 symbols/min [2025-10-21T17:10:59.585913] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:10:59.586076] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-21T17:10:59.586115] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-21T17:10:59.586277] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-21T17:10:59.586319] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-21T17:10:59.586359] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-21T17:10:59.586390] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-21T17:10:59.975706] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:00.086431] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T17:11:00.151024] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-21T17:11:00.951057] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-21T17:11:01.118033] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T17:11:01.180802] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:11:01.181216] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-21T17:11:01.181324] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:11:01.181415] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-21T17:11:01.181498] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:11:01.181593] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-21T17:11:01.181708] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-21T17:11:01.181763] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-21T17:11:01.181843] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-21T17:11:01.181905] [INFO ] [MAIN ] Update Progress: 94/2366 symbols completed. AMBQ took 1.8s. Estimated remaining: 4h 24m 43s. Rate: 8.6 symbols/min [2025-10-21T17:11:01.410778] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:01.453189] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T17:11:01.516844] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-21T17:11:01.517282] [INFO ] [MAIN ] AMC: Loaded 53766 existing records. [2025-10-21T17:11:01.758164] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-21T17:11:01.769566] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:01.769917] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-21T17:11:01.770098] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-21T17:11:01.770494] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-21T17:11:01.770571] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-21T17:11:02.298737] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:02.551162] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-21T17:11:03.351084] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-21T17:11:03.682618] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T17:11:04.151029] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-21T17:11:04.698928] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T17:11:04.801259] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T17:11:04.951036] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-21T17:11:05.605269] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:11:05.750994] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-21T17:11:06.508835] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T17:11:06.550989] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-21T17:11:07.109411] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:11:07.351028] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-21T17:11:08.151020] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-21T17:11:08.832703] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T17:11:08.912781] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-21T17:11:08.951078] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-21T17:11:09.751067] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-21T17:11:10.292574] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T17:11:10.372686] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:11:10.551055] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-21T17:11:11.351042] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-21T17:11:12.022276] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-21T17:11:12.150989] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-21T17:11:12.215843] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:11:12.735244] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:11:12.951065] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-21T17:11:13.751098] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-21T17:11:14.437986] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:11:14.444392] [INFO ] [REMOTE ] AMBC: Full fetch complete (51858 records). [2025-10-21T17:11:14.444499] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-21T17:11:14.555015] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-21T17:11:14.787109] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-21T17:11:14.908774] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-21T17:11:14.908865] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-21T17:11:14.909488] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-21T17:11:14.909531] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-21T17:11:14.910585] [DEBUG] [LOCAL ] AMBC: Trimmed 51858 records to 36048 (keeping 200 days of data) [2025-10-21T17:11:15.108454] [DEBUG] [LOCAL ] AMBC: Primary data saved (36048 records). [2025-10-21T17:11:15.108595] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-21T17:11:15.108696] [INFO ] [MAIN ] Update Progress: 95/2366 symbols completed. AMBC took 31.6s. Estimated remaining: 4h 27m 22s. Rate: 8.5 symbols/min [2025-10-21T17:11:15.296736] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:15.297972] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T17:11:15.304964] [INFO ] [REMOTE ] AMBP: Full fetch complete (65070 records). [2025-10-21T17:11:15.305124] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-21T17:11:15.360151] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-21T17:11:15.688561] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-21T17:11:15.695357] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-21T17:11:15.824617] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-21T17:11:15.835768] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-21T17:11:15.836632] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-21T17:11:15.836774] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-21T17:11:15.888720] [DEBUG] [LOCAL ] AMBP: Trimmed 65070 records to 44418 (keeping 200 days of data) [2025-10-21T17:11:15.915311] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:15.915511] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-21T17:11:15.915564] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-21T17:11:15.915796] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-21T17:11:15.915853] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-21T17:11:16.480544] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:16.488916] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-21T17:11:16.537122] [DEBUG] [LOCAL ] AMBP: Primary data saved (44418 records). [2025-10-21T17:11:16.537216] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-21T17:11:16.537287] [INFO ] [MAIN ] Update Progress: 96/2366 symbols completed. AMBP took 31.4s. Estimated remaining: 4h 25m 2s. Rate: 8.6 symbols/min [2025-10-21T17:11:16.706697] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:16.752859] [DEBUG] [LOCAL ] AME: Loaded 48570 existing records from primary storage. [2025-10-21T17:11:16.753182] [INFO ] [MAIN ] AME: Loaded 48570 existing records. [2025-10-21T17:11:16.935669] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:16.935943] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-21T17:11:16.936045] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-21T17:11:16.936476] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-21T17:11:16.936546] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-21T17:11:17.028009] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-21T17:11:17.074743] [INFO ] [REMOTE ] AM: Full fetch complete (75670 records). [2025-10-21T17:11:17.092246] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-21T17:11:17.590352] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:17.628085] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-21T17:11:17.746846] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-21T17:11:17.747027] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-21T17:11:17.747763] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-21T17:11:17.747842] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-21T17:11:17.749476] [DEBUG] [LOCAL ] AM: Trimmed 75670 records to 51857 (keeping 200 days of data) [2025-10-21T17:11:18.096167] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-10-21T17:11:18.118975] [DEBUG] [LOCAL ] AM: Primary data saved (51857 records). [2025-10-21T17:11:18.119192] [INFO ] [MAIN ] AM: Full history saved. [2025-10-21T17:11:18.120416] [INFO ] [MAIN ] Update Progress: 97/2366 symbols completed. AM took 35.9s. Estimated remaining: 4h 22m 48s. Rate: 8.6 symbols/min [2025-10-21T17:11:18.121140] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-21T17:11:18.324845] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:18.327593] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T17:11:18.357668] [DEBUG] [LOCAL ] AMG: Loaded 20174 existing records from primary storage. [2025-10-21T17:11:18.357917] [INFO ] [MAIN ] AMG: Loaded 20174 existing records. [2025-10-21T17:11:18.531794] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:18.531995] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-21T17:11:18.532042] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-21T17:11:18.532212] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-21T17:11:18.532250] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-21T17:11:18.562699] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-21T17:11:18.885728] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:19.152219] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:11:19.350993] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-21T17:11:20.151045] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-21T17:11:20.396678] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T17:11:20.448676] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T17:11:20.563282] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-21T17:11:20.951026] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-21T17:11:21.748951] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:11:21.758304] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-21T17:11:22.066184] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T17:11:22.551041] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-21T17:11:23.350995] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-21T17:11:23.647315] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T17:11:23.779247] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T17:11:24.151026] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-21T17:11:24.951005] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-21T17:11:25.198925] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T17:11:25.751021] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-21T17:11:25.860205] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T17:11:26.319617] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T17:11:26.551040] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-21T17:11:27.345786] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T17:11:27.356155] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-21T17:11:27.663099] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T17:11:28.151006] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-21T17:11:28.951028] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-21T17:11:29.153481] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T17:11:29.746463] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T17:11:29.757882] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-21T17:11:30.476899] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:11:30.551065] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-21T17:11:31.351048] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-21T17:11:31.564428] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:11:32.145195] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T17:11:32.150968] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-21T17:11:32.796487] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-21T17:11:32.950994] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-21T17:11:33.230027] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T17:11:33.751084] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-21T17:11:34.551041] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-21T17:11:35.356111] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-21T17:11:35.373517] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:11:35.432053] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T17:11:35.609121] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-21T17:11:35.617413] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-21T17:11:35.617524] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-21T17:11:36.009718] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-21T17:11:36.009818] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-21T17:11:36.010636] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-21T17:11:36.010728] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-21T17:11:36.012188] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53766 (keeping 200 days of data) [2025-10-21T17:11:36.169429] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-21T17:11:36.316131] [DEBUG] [LOCAL ] AMC: Primary data saved (53766 records). [2025-10-21T17:11:36.316293] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-21T17:11:36.316372] [INFO ] [MAIN ] Update Progress: 98/2366 symbols completed. AMC took 35.1s. Estimated remaining: 4h 27m 1s. Rate: 8.5 symbols/min [2025-10-21T17:11:36.482680] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:36.529948] [DEBUG] [LOCAL ] AMH: Loaded 51831 existing records from primary storage. [2025-10-21T17:11:36.530268] [INFO ] [MAIN ] AMH: Loaded 51831 existing records. [2025-10-21T17:11:36.712689] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:36.713000] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-21T17:11:36.713096] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-21T17:11:36.713531] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-21T17:11:36.713589] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-21T17:11:36.951317] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-21T17:11:37.099956] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:37.129978] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T17:11:37.751080] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-21T17:11:38.136610] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-21T17:11:38.161828] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T17:11:38.166828] [INFO ] [REMOTE ] AMG: Full fetch complete (29598 records). [2025-10-21T17:11:38.166928] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-21T17:11:38.553288] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-21T17:11:38.554327] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-21T17:11:38.554382] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-21T17:11:38.554765] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-21T17:11:38.554825] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-21T17:11:38.555699] [DEBUG] [LOCAL ] AMG: Trimmed 29598 records to 20131 (keeping 200 days of data) [2025-10-21T17:11:38.682327] [DEBUG] [LOCAL ] AMG: Primary data saved (20131 records). [2025-10-21T17:11:38.682445] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-21T17:11:38.682530] [INFO ] [MAIN ] Update Progress: 99/2366 symbols completed. AMG took 20.6s. Estimated remaining: 4h 25m 6s. Rate: 8.6 symbols/min [2025-10-21T17:11:38.848949] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:38.889414] [DEBUG] [LOCAL ] AMN: Loaded 41731 existing records from primary storage. [2025-10-21T17:11:38.889726] [INFO ] [MAIN ] AMN: Loaded 41731 existing records. [2025-10-21T17:11:39.065620] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:39.065862] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-21T17:11:39.065908] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-21T17:11:39.066109] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-21T17:11:39.066164] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-21T17:11:39.352278] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-21T17:11:39.421518] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:39.509629] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:11:39.882346] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:11:40.151100] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-21T17:11:40.951036] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-21T17:11:41.202524] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T17:11:41.751485] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-21T17:11:41.752673] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:11:42.403019] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:11:42.551032] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-21T17:11:43.351012] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-21T17:11:43.686969] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T17:11:44.151046] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-21T17:11:44.238601] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:11:44.951088] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-21T17:11:45.253916] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T17:11:45.602405] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T17:11:45.751035] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-21T17:11:46.416001] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:11:46.551028] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-21T17:11:47.307954] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T17:11:47.351019] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-21T17:11:48.151005] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-21T17:11:48.400957] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T17:11:48.408497] [INFO ] [REMOTE ] AME: Full fetch complete (70000 records). [2025-10-21T17:11:48.408636] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-21T17:11:48.808443] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-21T17:11:48.808540] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-21T17:11:48.809270] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-21T17:11:48.809350] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-21T17:11:48.810638] [DEBUG] [LOCAL ] AME: Trimmed 70000 records to 48489 (keeping 200 days of data) [2025-10-21T17:11:48.991162] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-21T17:11:49.121709] [DEBUG] [LOCAL ] AME: Primary data saved (48489 records). [2025-10-21T17:11:49.121869] [INFO ] [MAIN ] AME: Full history saved. [2025-10-21T17:11:49.121959] [INFO ] [MAIN ] Update Progress: 100/2366 symbols completed. AME took 32.6s. Estimated remaining: 4h 26m 17s. Rate: 8.5 symbols/min [2025-10-21T17:11:49.313001] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:49.349421] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:11:49.391035] [DEBUG] [LOCAL ] AMP: Loaded 31952 existing records from primary storage. [2025-10-21T17:11:49.391447] [INFO ] [MAIN ] AMP: Loaded 31952 existing records. [2025-10-21T17:11:49.579170] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:49.579791] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-21T17:11:49.579964] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-21T17:11:49.590846] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-21T17:11:49.607631] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-21T17:11:49.670439] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:11:49.756121] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-21T17:11:50.006010] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:50.550990] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-21T17:11:50.666462] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:11:51.326334] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T17:11:51.350990] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-21T17:11:52.151010] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-21T17:11:52.353895] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T17:11:52.800358] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T17:11:52.951069] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-21T17:11:53.767422] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-21T17:11:53.770136] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:11:54.541997] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T17:11:54.551122] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-21T17:11:55.301340] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:11:55.351084] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-21T17:11:56.151042] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-21T17:11:56.344405] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T17:11:56.353041] [INFO ] [REMOTE ] AMCR: Full fetch complete (77842 records). [2025-10-21T17:11:56.353203] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-21T17:11:56.741342] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-21T17:11:56.741513] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-21T17:11:56.742353] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-21T17:11:56.742419] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-21T17:11:56.743882] [DEBUG] [LOCAL ] AMCR: Trimmed 77842 records to 53670 (keeping 200 days of data) [2025-10-21T17:11:56.951314] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-21T17:11:57.084588] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T17:11:57.104696] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-21T17:11:57.104809] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-21T17:11:57.107514] [INFO ] [MAIN ] Update Progress: 101/2366 symbols completed. AMCR took 42.0s. Estimated remaining: 4h 26m 31s. Rate: 8.5 symbols/min [2025-10-21T17:11:57.275605] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:11:57.332299] [DEBUG] [LOCAL ] AMPX: Loaded 52385 existing records from primary storage. [2025-10-21T17:11:57.332602] [INFO ] [MAIN ] AMPX: Loaded 52385 existing records. [2025-10-21T17:11:57.514586] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:11:57.514931] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-21T17:11:57.515057] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-21T17:11:57.515357] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-21T17:11:57.515430] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-21T17:11:57.755635] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-21T17:11:57.898947] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:11:57.903189] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:11:58.403818] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T17:11:58.551045] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-21T17:11:59.129458] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:11:59.351033] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-21T17:12:00.070351] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T17:12:00.151007] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-21T17:12:00.951050] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-21T17:12:01.184259] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T17:12:01.751040] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-21T17:12:02.251735] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T17:12:02.501761] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T17:12:02.509439] [INFO ] [REMOTE ] AMN: Full fetch complete (59943 records). [2025-10-21T17:12:02.509606] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-21T17:12:02.510436] [FATAL] [VALIDATOR ] AMN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:12:02.510555] [FATAL] [MAIN ] AMN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:12:02.510630] [WARN ] [MAIN ] AMN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:12:02.510736] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-21T17:12:02.510831] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-10-21T17:12:02.510890] [INFO ] [LOCAL ] AMN: Starting deletion of derivative data. [2025-10-21T17:12:02.511075] [DEBUG] [LOCAL ] AMN: Deleted derivative data file. [2025-10-21T17:12:02.511673] [INFO ] [MAIN ] Update Progress: 102/2366 symbols completed. AMN took 23.8s. Estimated remaining: 4h 25m 47s. Rate: 8.5 symbols/min [2025-10-21T17:12:02.560300] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-21T17:12:02.706202] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:02.746822] [DEBUG] [LOCAL ] AMPY: Loaded 39461 existing records from primary storage. [2025-10-21T17:12:02.747156] [INFO ] [MAIN ] AMPY: Loaded 39461 existing records. [2025-10-21T17:12:02.935321] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:02.935627] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-21T17:12:02.935726] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-21T17:12:02.936032] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-21T17:12:02.936089] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-21T17:12:03.294575] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:03.361326] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-21T17:12:03.367281] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T17:12:03.376451] [INFO ] [REMOTE ] AMH: Full fetch complete (74703 records). [2025-10-21T17:12:03.376682] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-21T17:12:03.377804] [FATAL] [VALIDATOR ] AMH: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:12:03.377901] [FATAL] [MAIN ] AMH: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:12:03.378035] [WARN ] [MAIN ] AMH: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:12:03.378116] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-21T17:12:03.378198] [DEBUG] [LOCAL ] AMH: No primary data file found to delete. [2025-10-21T17:12:03.378288] [INFO ] [LOCAL ] AMH: Starting deletion of derivative data. [2025-10-21T17:12:03.378472] [DEBUG] [LOCAL ] AMH: Deleted derivative data file. [2025-10-21T17:12:03.378566] [INFO ] [MAIN ] Update Progress: 103/2366 symbols completed. AMH took 27.1s. Estimated remaining: 4h 23m 24s. Rate: 8.6 symbols/min [2025-10-21T17:12:03.561877] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:03.605610] [DEBUG] [LOCAL ] AMR: Loaded 28978 existing records from primary storage. [2025-10-21T17:12:03.606176] [INFO ] [MAIN ] AMR: Loaded 28978 existing records. [2025-10-21T17:12:03.802463] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:03.802839] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-21T17:12:03.802895] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-21T17:12:03.803140] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-21T17:12:03.803201] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-21T17:12:04.156205] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-21T17:12:04.189744] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:04.228925] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:12:04.951029] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-21T17:12:05.143845] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T17:12:05.210898] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T17:12:05.751031] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-21T17:12:06.550988] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-21T17:12:06.580222] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:12:06.642291] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T17:12:07.351148] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-21T17:12:07.798818] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T17:12:08.151029] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-21T17:12:08.951061] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-21T17:12:09.078570] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T17:12:09.589148] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T17:12:09.751049] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-21T17:12:10.297795] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T17:12:10.551035] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-21T17:12:11.351000] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-21T17:12:11.766980] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T17:12:11.915723] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:12:12.151027] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-21T17:12:12.740914] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:12:12.951024] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-21T17:12:13.751092] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-21T17:12:14.165286] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:12:14.292882] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-21T17:12:14.551067] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-21T17:12:15.191832] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:12:15.351022] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-21T17:12:15.668331] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T17:12:16.151032] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-21T17:12:16.750785] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T17:12:16.951092] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-21T17:12:17.606354] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T17:12:17.751041] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-21T17:12:18.235410] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T17:12:18.551036] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-21T17:12:19.183786] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T17:12:19.351031] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-21T17:12:20.076242] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T17:12:20.151009] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-21T17:12:20.951029] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-21T17:12:21.150839] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:12:21.516024] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T17:12:21.521286] [INFO ] [REMOTE ] AMP: Full fetch complete (47577 records). [2025-10-21T17:12:21.521399] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-21T17:12:21.756203] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-21T17:12:21.902345] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-21T17:12:21.902441] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-21T17:12:21.903016] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-21T17:12:21.903081] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-21T17:12:21.904190] [DEBUG] [LOCAL ] AMP: Trimmed 47577 records to 31914 (keeping 200 days of data) [2025-10-21T17:12:22.101786] [DEBUG] [LOCAL ] AMP: Primary data saved (31914 records). [2025-10-21T17:12:22.102104] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-21T17:12:22.102203] [INFO ] [MAIN ] Update Progress: 104/2366 symbols completed. AMP took 33.0s. Estimated remaining: 4h 27m 33s. Rate: 8.5 symbols/min [2025-10-21T17:12:22.294721] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T17:12:22.296971] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:22.342593] [DEBUG] [LOCAL ] AMRC: Loaded 38558 existing records from primary storage. [2025-10-21T17:12:22.342904] [INFO ] [MAIN ] AMRC: Loaded 38558 existing records. [2025-10-21T17:12:22.515061] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:22.515293] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-21T17:12:22.515340] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-21T17:12:22.515514] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-21T17:12:22.515552] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-21T17:12:22.556691] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-21T17:12:22.866077] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:23.351078] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-21T17:12:23.658433] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T17:12:24.161103] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-21T17:12:24.183253] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-21T17:12:24.588160] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T17:12:24.951064] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-21T17:12:25.294279] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:12:25.751075] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-21T17:12:26.551019] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-21T17:12:26.881942] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T17:12:27.017702] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:12:27.350997] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-21T17:12:28.151014] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-21T17:12:28.444546] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T17:12:28.453085] [INFO ] [REMOTE ] AMPY: Full fetch complete (53227 records). [2025-10-21T17:12:28.453316] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-21T17:12:28.878104] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-21T17:12:28.878297] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-21T17:12:28.879037] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-21T17:12:28.879177] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-21T17:12:28.880514] [DEBUG] [LOCAL ] AMPY: Trimmed 53227 records to 39389 (keeping 200 days of data) [2025-10-21T17:12:28.958773] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-21T17:12:28.996241] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T17:12:29.133295] [DEBUG] [LOCAL ] AMPY: Primary data saved (39389 records). [2025-10-21T17:12:29.133437] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-21T17:12:29.134087] [INFO ] [MAIN ] Update Progress: 105/2366 symbols completed. AMPY took 26.6s. Estimated remaining: 4h 27m 24s. Rate: 8.5 symbols/min [2025-10-21T17:12:29.304012] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:29.304223] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-21T17:12:29.304267] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-21T17:12:29.304369] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-21T17:12:29.304410] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-21T17:12:29.304449] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-21T17:12:29.304480] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-21T17:12:29.677263] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:12:29.711172] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:29.750990] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-21T17:12:30.551038] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-21T17:12:30.828414] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T17:12:31.145790] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:12:31.146164] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-21T17:12:31.146256] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:12:31.146303] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-21T17:12:31.146339] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:12:31.146403] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-21T17:12:31.146470] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-21T17:12:31.146508] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-21T17:12:31.146548] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-21T17:12:31.146598] [INFO ] [MAIN ] Update Progress: 106/2366 symbols completed. AMRZ took 2.0s. Estimated remaining: 4h 25m 29s. Rate: 8.5 symbols/min [2025-10-21T17:12:31.354177] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-21T17:12:31.359889] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:31.385294] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-21T17:12:31.448034] [DEBUG] [LOCAL ] AMT: Loaded 52454 existing records from primary storage. [2025-10-21T17:12:31.448381] [INFO ] [MAIN ] AMT: Loaded 52454 existing records. [2025-10-21T17:12:31.638561] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:31.638801] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-21T17:12:31.638852] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-21T17:12:31.639239] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-21T17:12:31.639296] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-21T17:12:31.992417] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:32.151031] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-21T17:12:32.718335] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:12:32.951080] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-21T17:12:33.751070] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-21T17:12:33.980222] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T17:12:34.373179] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:12:34.551073] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-21T17:12:35.122988] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T17:12:35.351084] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-21T17:12:35.705832] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T17:12:36.151042] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-21T17:12:36.772271] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T17:12:36.951074] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-21T17:12:37.485849] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:12:37.490344] [INFO ] [REMOTE ] AMR: Full fetch complete (40705 records). [2025-10-21T17:12:37.490446] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-21T17:12:37.756134] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-21T17:12:37.867292] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-21T17:12:37.867368] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-21T17:12:37.867841] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-21T17:12:37.867904] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-21T17:12:37.868808] [DEBUG] [LOCAL ] AMR: Trimmed 40705 records to 28870 (keeping 200 days of data) [2025-10-21T17:12:38.036937] [DEBUG] [LOCAL ] AMR: Primary data saved (28870 records). [2025-10-21T17:12:38.037060] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-21T17:12:38.037137] [INFO ] [MAIN ] Update Progress: 107/2366 symbols completed. AMR took 34.7s. Estimated remaining: 4h 25m 18s. Rate: 8.5 symbols/min [2025-10-21T17:12:38.207245] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:38.228288] [DEBUG] [LOCAL ] AMTB: Loaded 20539 existing records from primary storage. [2025-10-21T17:12:38.228529] [INFO ] [MAIN ] AMTB: Loaded 20539 existing records. [2025-10-21T17:12:38.411076] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:38.411563] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-21T17:12:38.411616] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-21T17:12:38.411938] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-21T17:12:38.411994] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-21T17:12:38.559791] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-21T17:12:38.765707] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:39.351006] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-21T17:12:39.483251] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-21T17:12:39.493270] [INFO ] [REMOTE ] AMPX: Full fetch complete (75235 records). [2025-10-21T17:12:39.493454] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-21T17:12:39.632719] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T17:12:39.938337] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-21T17:12:39.938483] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-21T17:12:39.939297] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-21T17:12:39.939402] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-21T17:12:39.940876] [DEBUG] [LOCAL ] AMPX: Trimmed 75235 records to 52398 (keeping 200 days of data) [2025-10-21T17:12:40.151095] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T17:12:40.151395] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-21T17:12:40.260426] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T17:12:40.285193] [DEBUG] [LOCAL ] AMPX: Primary data saved (52398 records). [2025-10-21T17:12:40.285293] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-21T17:12:40.285362] [INFO ] [MAIN ] Update Progress: 108/2366 symbols completed. AMPX took 43.2s. Estimated remaining: 4h 23m 31s. Rate: 8.6 symbols/min [2025-10-21T17:12:40.459352] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:40.464337] [DEBUG] [LOCAL ] AMTD: Loaded 3824 existing records from primary storage. [2025-10-21T17:12:40.464479] [INFO ] [MAIN ] AMTD: Loaded 3824 existing records. [2025-10-21T17:12:40.637971] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:40.638169] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-21T17:12:40.638216] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-21T17:12:40.638406] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-21T17:12:40.638461] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-21T17:12:40.956091] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-21T17:12:40.992132] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:41.754273] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-21T17:12:41.768130] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:12:41.835136] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:12:42.447124] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T17:12:42.550992] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-21T17:12:43.164386] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T17:12:43.350990] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-21T17:12:44.151060] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-21T17:12:44.951033] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-21T17:12:45.304313] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T17:12:45.651999] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T17:12:45.751036] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-21T17:12:45.812106] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:12:46.224285] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T17:12:46.551023] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-21T17:12:47.351000] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-21T17:12:47.641254] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T17:12:48.151045] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-21T17:12:48.649044] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T17:12:48.927952] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T17:12:48.951049] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-21T17:12:49.751062] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-21T17:12:50.210447] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T17:12:50.534362] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:12:50.550977] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-21T17:12:51.351027] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-21T17:12:52.140375] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T17:12:52.147402] [INFO ] [REMOTE ] AMRC: Full fetch complete (54532 records). [2025-10-21T17:12:52.147546] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-21T17:12:52.159691] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-21T17:12:52.551946] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-21T17:12:52.552490] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-21T17:12:52.552959] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:12:52.558060] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-21T17:12:52.558440] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-21T17:12:52.559469] [DEBUG] [LOCAL ] AMRC: Trimmed 54532 records to 38589 (keeping 200 days of data) [2025-10-21T17:12:52.773975] [DEBUG] [LOCAL ] AMRC: Primary data saved (38589 records). [2025-10-21T17:12:52.774107] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-21T17:12:52.774185] [INFO ] [MAIN ] Update Progress: 109/2366 symbols completed. AMRC took 30.7s. Estimated remaining: 4h 25m 18s. Rate: 8.5 symbols/min [2025-10-21T17:12:52.964668] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-21T17:12:52.967136] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:12:53.011966] [DEBUG] [LOCAL ] AMTM: Loaded 50401 existing records from primary storage. [2025-10-21T17:12:53.012265] [INFO ] [MAIN ] AMTM: Loaded 50401 existing records. [2025-10-21T17:12:53.186969] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:12:53.187316] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-21T17:12:53.187448] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-21T17:12:53.188035] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-21T17:12:53.188094] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-21T17:12:53.545198] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:12:53.751019] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-21T17:12:53.804977] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:12:53.834533] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T17:12:54.511823] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T17:12:54.551059] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-21T17:12:55.351139] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-21T17:12:55.785064] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T17:12:56.151104] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-21T17:12:56.719777] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T17:12:56.951050] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-21T17:12:57.153790] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T17:12:57.398955] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T17:12:57.751112] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-21T17:12:58.551040] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-21T17:12:59.178044] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T17:12:59.351042] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-21T17:12:59.731434] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T17:12:59.971418] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T17:12:59.972691] [INFO ] [REMOTE ] AMTD: Full fetch complete (5444 records). [2025-10-21T17:12:59.972758] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-21T17:13:00.156133] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-21T17:13:00.349915] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-21T17:13:00.349992] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-21T17:13:00.350159] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-21T17:13:00.350198] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-21T17:13:00.350562] [DEBUG] [LOCAL ] AMTD: Trimmed 5444 records to 3827 (keeping 200 days of data) [2025-10-21T17:13:00.371710] [DEBUG] [LOCAL ] AMTD: Primary data saved (3827 records). [2025-10-21T17:13:00.371798] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-21T17:13:00.371873] [INFO ] [MAIN ] Update Progress: 110/2366 symbols completed. AMTD took 20.1s. Estimated remaining: 4h 25m 22s. Rate: 8.5 symbols/min [2025-10-21T17:13:00.544372] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:00.555280] [DEBUG] [LOCAL ] AMWL: Loaded 9705 existing records from primary storage. [2025-10-21T17:13:00.555465] [INFO ] [MAIN ] AMWL: Loaded 9705 existing records. [2025-10-21T17:13:00.739554] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:00.739803] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-21T17:13:00.739853] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-21T17:13:00.740014] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-21T17:13:00.740079] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-21T17:13:00.959270] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-21T17:13:01.116205] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:01.751038] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-21T17:13:02.061616] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:13:02.551047] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-21T17:13:02.917787] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T17:13:03.041112] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T17:13:03.253886] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T17:13:03.350986] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-21T17:13:04.151050] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-21T17:13:04.272223] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:13:04.951087] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-21T17:13:05.751018] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-21T17:13:05.879750] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T17:13:06.003035] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T17:13:06.551021] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-21T17:13:07.350993] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-21T17:13:07.633695] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:13:07.662755] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T17:13:07.666564] [INFO ] [REMOTE ] AMTB: Full fetch complete (29621 records). [2025-10-21T17:13:07.666731] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-21T17:13:08.048157] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-21T17:13:08.048269] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-21T17:13:08.048772] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-21T17:13:08.048836] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-21T17:13:08.049556] [DEBUG] [LOCAL ] AMTB: Trimmed 29621 records to 20430 (keeping 200 days of data) [2025-10-21T17:13:08.160815] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-21T17:13:08.170122] [DEBUG] [LOCAL ] AMTB: Primary data saved (20430 records). [2025-10-21T17:13:08.170247] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-21T17:13:08.170327] [INFO ] [MAIN ] Update Progress: 111/2366 symbols completed. AMTB took 30.1s. Estimated remaining: 4h 25m 30s. Rate: 8.5 symbols/min [2025-10-21T17:13:08.342086] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:08.386716] [DEBUG] [LOCAL ] AMX: Loaded 49207 existing records from primary storage. [2025-10-21T17:13:08.387062] [INFO ] [MAIN ] AMX: Loaded 49207 existing records. [2025-10-21T17:13:08.567129] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:08.567336] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-21T17:13:08.567385] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-21T17:13:08.567707] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-21T17:13:08.567766] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-21T17:13:08.927086] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:08.950981] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-21T17:13:09.019437] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T17:13:09.260191] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T17:13:09.751072] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-21T17:13:10.495931] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T17:13:10.550984] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-21T17:13:10.584374] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T17:13:11.351040] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-21T17:13:11.394025] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T17:13:12.151081] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-21T17:13:12.951055] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-21T17:13:13.139595] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:13:13.751028] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-21T17:13:14.284195] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-21T17:13:14.292426] [INFO ] [REMOTE ] AMT: Full fetch complete (76176 records). [2025-10-21T17:13:14.292565] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-21T17:13:14.558383] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-21T17:13:14.700234] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-21T17:13:14.700336] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-21T17:13:14.701203] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-21T17:13:14.701289] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-21T17:13:14.725604] [DEBUG] [LOCAL ] AMT: Trimmed 76176 records to 52448 (keeping 200 days of data) [2025-10-21T17:13:14.726463] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T17:13:15.089898] [DEBUG] [LOCAL ] AMT: Primary data saved (52448 records). [2025-10-21T17:13:15.090027] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-21T17:13:15.090929] [INFO ] [MAIN ] Update Progress: 112/2366 symbols completed. AMT took 43.9s. Estimated remaining: 4h 25m 20s. Rate: 8.5 symbols/min [2025-10-21T17:13:15.274278] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:15.306730] [DEBUG] [LOCAL ] AN: Loaded 31264 existing records from primary storage. [2025-10-21T17:13:15.306996] [INFO ] [MAIN ] AN: Loaded 31264 existing records. [2025-10-21T17:13:15.352918] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-21T17:13:15.425427] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T17:13:15.507904] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:15.508324] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-21T17:13:15.508521] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-21T17:13:15.508920] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-21T17:13:15.509135] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-21T17:13:15.762344] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:13:15.906738] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:16.150986] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-21T17:13:16.951087] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-21T17:13:17.016798] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T17:13:17.478165] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:13:17.751010] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-21T17:13:18.551011] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-21T17:13:18.802720] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T17:13:19.029550] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T17:13:19.130966] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:13:19.351024] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-21T17:13:20.109750] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:13:20.150978] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-21T17:13:20.896550] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T17:13:20.951018] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-21T17:13:21.751023] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-21T17:13:21.952855] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T17:13:21.955797] [INFO ] [REMOTE ] AMWL: Full fetch complete (14693 records). [2025-10-21T17:13:21.955864] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-21T17:13:22.321834] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-21T17:13:22.321910] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-21T17:13:22.322194] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-21T17:13:22.322234] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-21T17:13:22.322729] [DEBUG] [LOCAL ] AMWL: Trimmed 14693 records to 9764 (keeping 200 days of data) [2025-10-21T17:13:22.375214] [DEBUG] [LOCAL ] AMWL: Primary data saved (9764 records). [2025-10-21T17:13:22.375335] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-21T17:13:22.375423] [INFO ] [MAIN ] Update Progress: 113/2366 symbols completed. AMWL took 22.0s. Estimated remaining: 4h 25m 17s. Rate: 8.5 symbols/min [2025-10-21T17:13:22.545145] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:22.550985] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-21T17:13:22.596419] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-21T17:13:22.596742] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-21T17:13:22.770988] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:22.771195] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-21T17:13:22.771265] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-21T17:13:22.771589] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-21T17:13:22.771634] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-21T17:13:23.119376] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:23.350992] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-21T17:13:23.657914] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T17:13:24.150997] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-21T17:13:24.261403] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T17:13:24.840242] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:13:24.951010] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-21T17:13:25.405876] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T17:13:25.751015] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-21T17:13:26.550991] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-21T17:13:26.826857] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T17:13:27.309241] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T17:13:27.351014] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-21T17:13:28.151015] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-21T17:13:28.209362] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:13:28.951067] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-21T17:13:29.295237] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T17:13:29.756802] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-21T17:13:29.788502] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:13:30.144446] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:13:30.551039] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-21T17:13:31.351016] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-21T17:13:31.490261] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T17:13:31.499138] [INFO ] [REMOTE ] AMTM: Full fetch complete (73658 records). [2025-10-21T17:13:31.499302] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-21T17:13:31.848822] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T17:13:31.938304] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-21T17:13:31.938396] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-21T17:13:31.939160] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-21T17:13:31.939228] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-21T17:13:31.940618] [DEBUG] [LOCAL ] AMTM: Trimmed 73658 records to 50302 (keeping 200 days of data) [2025-10-21T17:13:32.152206] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-21T17:13:32.238795] [DEBUG] [LOCAL ] AMTM: Primary data saved (50302 records). [2025-10-21T17:13:32.238937] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-21T17:13:32.239032] [INFO ] [MAIN ] Update Progress: 114/2366 symbols completed. AMTM took 39.5s. Estimated remaining: 4h 26m 5s. Rate: 8.5 symbols/min [2025-10-21T17:13:32.410782] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:32.458788] [DEBUG] [LOCAL ] ANF: Loaded 52054 existing records from primary storage. [2025-10-21T17:13:32.459087] [INFO ] [MAIN ] ANF: Loaded 52054 existing records. [2025-10-21T17:13:32.643696] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:32.643929] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-21T17:13:32.643979] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-21T17:13:32.644365] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-21T17:13:32.644404] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-21T17:13:32.951214] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-21T17:13:33.026788] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:33.058298] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T17:13:33.751019] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-21T17:13:34.509168] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-21T17:13:34.523075] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T17:13:34.550983] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-21T17:13:35.351057] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-21T17:13:35.573130] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T17:13:35.836781] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T17:13:36.151048] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-21T17:13:36.951093] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-21T17:13:37.323576] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T17:13:37.751027] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-21T17:13:38.099347] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T17:13:38.107271] [INFO ] [REMOTE ] AMX: Full fetch complete (71041 records). [2025-10-21T17:13:38.107402] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-21T17:13:38.535999] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-21T17:13:38.535815] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:13:38.536274] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-21T17:13:38.546551] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-21T17:13:38.546680] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-21T17:13:38.548913] [DEBUG] [LOCAL ] AMX: Trimmed 71041 records to 49203 (keeping 200 days of data) [2025-10-21T17:13:38.601792] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-21T17:13:38.837197] [DEBUG] [LOCAL ] AMX: Primary data saved (49203 records). [2025-10-21T17:13:38.837325] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-21T17:13:38.837399] [INFO ] [MAIN ] Update Progress: 115/2366 symbols completed. AMX took 30.7s. Estimated remaining: 4h 25m 49s. Rate: 8.5 symbols/min [2025-10-21T17:13:39.010479] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:39.010710] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-21T17:13:39.010764] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-21T17:13:39.010881] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-21T17:13:39.010933] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-21T17:13:39.010976] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-21T17:13:39.011031] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-21T17:13:39.363245] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-21T17:13:39.369117] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:39.466573] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T17:13:39.972855] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T17:13:39.977514] [INFO ] [REMOTE ] AN: Full fetch complete (47080 records). [2025-10-21T17:13:39.977596] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-21T17:13:40.152325] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-21T17:13:40.355359] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-21T17:13:40.355440] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-21T17:13:40.355956] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-21T17:13:40.356020] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-21T17:13:40.357017] [DEBUG] [LOCAL ] AN: Trimmed 47080 records to 31126 (keeping 200 days of data) [2025-10-21T17:13:40.535498] [DEBUG] [LOCAL ] AN: Primary data saved (31126 records). [2025-10-21T17:13:40.535637] [INFO ] [MAIN ] AN: Full history saved. [2025-10-21T17:13:40.536339] [INFO ] [MAIN ] Update Progress: 116/2366 symbols completed. AN took 25.4s. Estimated remaining: 4h 23m 57s. Rate: 8.5 symbols/min [2025-10-21T17:13:40.707491] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:13:40.726912] [DEBUG] [LOCAL ] ANRO: Loaded 19540 existing records from primary storage. [2025-10-21T17:13:40.727174] [INFO ] [MAIN ] ANRO: Loaded 19540 existing records. [2025-10-21T17:13:40.898952] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:13:40.899174] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-21T17:13:40.899220] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-21T17:13:40.899427] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-21T17:13:40.899466] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-21T17:13:40.964356] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-21T17:13:41.215713] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:13:41.275170] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-21T17:13:41.280572] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:13:41.280398] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:13:41.281317] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-21T17:13:41.281399] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:13:41.281469] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-21T17:13:41.281533] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-21T17:13:41.281568] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-21T17:13:41.281606] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-21T17:13:41.281679] [INFO ] [MAIN ] Update Progress: 117/2366 symbols completed. ANGX took 2.4s. Estimated remaining: 4h 21m 49s. Rate: 8.6 symbols/min [2025-10-21T17:13:41.730131] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-21T17:13:41.750987] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-21T17:13:41.846388] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:13:42.551021] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-21T17:13:43.351078] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-21T17:13:43.535470] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T17:13:44.020700] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-21T17:13:44.151031] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-21T17:13:44.951074] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-21T17:13:45.277396] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T17:13:45.751079] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-21T17:13:45.995166] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T17:13:46.551039] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-21T17:13:46.696371] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-21T17:13:47.351016] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-21T17:13:47.448068] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:13:47.892183] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:13:48.151058] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-21T17:13:48.951028] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-21T17:13:49.447710] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T17:13:49.592624] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-21T17:13:49.751008] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-21T17:13:50.551007] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-21T17:13:50.751863] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:13:50.795743] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:13:51.351024] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-21T17:13:52.151026] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-21T17:13:52.743953] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T17:13:52.853407] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T17:13:52.951022] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-21T17:13:53.323975] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T17:13:53.751003] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-21T17:13:54.551007] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-21T17:13:54.809589] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T17:13:55.086429] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T17:13:55.351078] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-21T17:13:56.151135] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-21T17:13:56.337038] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T17:13:56.951006] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-21T17:13:57.076357] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T17:13:57.540139] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T17:13:57.751076] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-21T17:13:58.551051] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-21T17:13:58.871349] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T17:13:59.351065] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-21T17:13:59.412622] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T17:14:00.087808] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T17:14:00.151013] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-21T17:14:00.951048] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-21T17:14:01.181095] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:14:01.189426] [INFO ] [REMOTE ] ANF: Full fetch complete (75796 records). [2025-10-21T17:14:01.189581] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-21T17:14:01.620194] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-21T17:14:01.620424] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-21T17:14:01.621390] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-21T17:14:01.626873] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-21T17:14:01.637282] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:14:01.643373] [INFO ] [REMOTE ] ANRO: Full fetch complete (30190 records). [2025-10-21T17:14:01.643711] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-21T17:14:01.643954] [DEBUG] [LOCAL ] ANF: Trimmed 75796 records to 52051 (keeping 200 days of data) [2025-10-21T17:14:02.086016] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T17:14:02.252869] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-21T17:14:02.270370] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-21T17:14:02.421847] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-21T17:14:02.422337] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-21T17:14:02.429149] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-21T17:14:02.449684] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-21T17:14:02.498856] [DEBUG] [LOCAL ] ANRO: Trimmed 30190 records to 19651 (keeping 200 days of data) [2025-10-21T17:14:02.888535] [DEBUG] [LOCAL ] ANRO: Primary data saved (19651 records). [2025-10-21T17:14:02.894552] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-21T17:14:02.928993] [INFO ] [MAIN ] Update Progress: 118/2366 symbols completed. ANRO took 22.4s. Estimated remaining: 4h 26m 21s. Rate: 8.4 symbols/min [2025-10-21T17:14:03.051001] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-21T17:14:03.051667] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-21T17:14:03.053393] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-21T17:14:03.053482] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-21T17:14:03.061605] [DEBUG] [LOCAL ] ANF: Primary data saved (52051 records). [2025-10-21T17:14:03.062024] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-21T17:14:03.062130] [INFO ] [MAIN ] Update Progress: 119/2366 symbols completed. ANF took 30.8s. Estimated remaining: 4h 24m 3s. Rate: 8.5 symbols/min [2025-10-21T17:14:03.062334] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-21T17:14:03.380632] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-21T17:14:03.380816] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-21T17:14:03.380902] [INFO ] [MAIN ] Update Progress: 120/2366 symbols completed. ANET took 41.0s. Estimated remaining: 4h 21m 49s. Rate: 8.6 symbols/min [2025-10-21T17:14:04.043543] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:04.205068] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:04.204097] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:04.205533] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-21T17:14:04.235121] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-21T17:14:04.234980] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:04.235580] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-21T17:14:04.236193] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-21T17:14:04.243369] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-21T17:14:04.243501] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-21T17:14:04.348977] [DEBUG] [LOCAL ] ANVS: Loaded 24001 existing records from primary storage. [2025-10-21T17:14:04.373298] [INFO ] [MAIN ] ANVS: Loaded 24001 existing records. [2025-10-21T17:14:04.386161] [DEBUG] [LOCAL ] AOMR: Loaded 16433 existing records from primary storage. [2025-10-21T17:14:04.402790] [INFO ] [MAIN ] AOMR: Loaded 16433 existing records. [2025-10-21T17:14:04.529441] [DEBUG] [LOCAL ] AOD: Loaded 30963 existing records from primary storage. [2025-10-21T17:14:04.667865] [INFO ] [MAIN ] AOD: Loaded 30963 existing records. [2025-10-21T17:14:05.110946] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:05.191089] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:05.203009] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-21T17:14:05.234417] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-21T17:14:05.234210] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-21T17:14:05.248613] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-21T17:14:05.293299] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:05.297267] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-21T17:14:05.313552] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-21T17:14:05.287265] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-21T17:14:05.321289] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-21T17:14:05.321430] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-21T17:14:05.321126] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:05.369206] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-21T17:14:05.410119] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-21T17:14:05.445963] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-21T17:14:05.496061] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-21T17:14:05.615558] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:14:05.657915] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-21T17:14:05.777225] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:14:05.851223] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-21T17:14:05.861783] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:14:05.875834] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-21T17:14:06.033407] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-21T17:14:06.116992] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-21T17:14:06.190440] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-21T17:14:06.238287] [INFO ] [MAIN ] Update Progress: 121/2366 symbols completed. AOMD took 2.9s. Estimated remaining: 4h 20m 26s. Rate: 8.6 symbols/min [2025-10-21T17:14:06.547598] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:06.594802] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-21T17:14:06.638693] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:06.711602] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-21T17:14:06.736914] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:06.790139] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:06.790973] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-21T17:14:06.832836] [DEBUG] [LOCAL ] AON: Loaded 45175 existing records from primary storage. [2025-10-21T17:14:06.833216] [INFO ] [MAIN ] AON: Loaded 45175 existing records. [2025-10-21T17:14:07.008862] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:07.009044] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-21T17:14:07.009095] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-21T17:14:07.009274] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-21T17:14:07.009313] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-21T17:14:07.361566] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:07.361942] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-21T17:14:07.585146] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T17:14:07.587796] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-21T17:14:08.121710] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:14:08.127426] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-21T17:14:08.231070] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T17:14:08.238492] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-21T17:14:08.555977] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:14:08.560167] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-21T17:14:09.060228] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:14:09.066222] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-21T17:14:09.108891] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T17:14:09.155841] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T17:14:09.587215] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T17:14:09.751034] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-21T17:14:09.999842] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T17:14:10.551073] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-21T17:14:10.870550] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:14:11.351039] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-21T17:14:12.151017] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-21T17:14:12.187153] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:14:12.415047] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T17:14:12.950992] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-21T17:14:12.977626] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T17:14:13.751023] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-21T17:14:14.551001] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-21T17:14:14.884619] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T17:14:14.962273] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T17:14:15.351009] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-21T17:14:15.882673] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:14:16.151013] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-21T17:14:16.951045] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-21T17:14:17.179736] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T17:14:17.270464] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T17:14:17.677251] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T17:14:17.750979] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-21T17:14:18.551010] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-21T17:14:18.657557] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T17:14:19.351023] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-21T17:14:19.891793] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T17:14:20.151017] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-21T17:14:20.823730] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T17:14:20.823415] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T17:14:20.950998] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-21T17:14:21.751062] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-21T17:14:22.171768] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T17:14:22.550995] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-21T17:14:22.742699] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T17:14:23.351019] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-21T17:14:23.872503] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T17:14:24.151002] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-21T17:14:24.291735] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T17:14:24.910572] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T17:14:24.950990] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-21T17:14:25.751005] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-21T17:14:25.883056] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:14:25.885321] [INFO ] [REMOTE ] AOMR: Full fetch complete (23183 records). [2025-10-21T17:14:25.885392] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-21T17:14:26.259924] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-21T17:14:26.260020] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-21T17:14:26.260383] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-21T17:14:26.260456] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-21T17:14:26.261118] [DEBUG] [LOCAL ] AOMR: Trimmed 23183 records to 16383 (keeping 200 days of data) [2025-10-21T17:14:26.354257] [DEBUG] [LOCAL ] AOMR: Primary data saved (16383 records). [2025-10-21T17:14:26.354417] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-21T17:14:26.354504] [INFO ] [MAIN ] Update Progress: 122/2366 symbols completed. AOMR took 23.0s. Estimated remaining: 4h 24m 21s. Rate: 8.5 symbols/min [2025-10-21T17:14:26.524761] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:26.550850] [DEBUG] [LOCAL ] AORT: Loaded 28981 existing records from primary storage. [2025-10-21T17:14:26.550983] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-21T17:14:26.551315] [INFO ] [MAIN ] AORT: Loaded 28981 existing records. [2025-10-21T17:14:26.739974] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:26.740174] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-21T17:14:26.740222] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-21T17:14:26.740396] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-21T17:14:26.740434] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-21T17:14:27.023531] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T17:14:27.140002] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:27.351003] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-21T17:14:27.527746] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T17:14:28.151009] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-21T17:14:28.488559] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:14:28.951017] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-21T17:14:29.751030] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-21T17:14:29.832610] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:14:30.382232] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:14:30.387593] [INFO ] [REMOTE ] ANVS: Full fetch complete (36880 records). [2025-10-21T17:14:30.387726] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-21T17:14:30.562993] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-21T17:14:30.770492] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-21T17:14:30.770568] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-21T17:14:30.771042] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-21T17:14:30.771106] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-21T17:14:30.771904] [DEBUG] [LOCAL ] ANVS: Trimmed 36880 records to 23984 (keeping 200 days of data) [2025-10-21T17:14:30.903470] [DEBUG] [LOCAL ] ANVS: Primary data saved (23984 records). [2025-10-21T17:14:30.903597] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-21T17:14:30.903693] [INFO ] [MAIN ] Update Progress: 123/2366 symbols completed. ANVS took 27.5s. Estimated remaining: 4h 23m 28s. Rate: 8.5 symbols/min [2025-10-21T17:14:31.077072] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:31.093948] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:14:31.140768] [DEBUG] [LOCAL ] AOS: Loaded 48689 existing records from primary storage. [2025-10-21T17:14:31.141083] [INFO ] [MAIN ] AOS: Loaded 48689 existing records. [2025-10-21T17:14:31.319242] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:31.319437] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-21T17:14:31.319483] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-21T17:14:31.319726] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-21T17:14:31.319782] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-21T17:14:31.356143] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-21T17:14:31.670775] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:31.862028] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T17:14:32.151021] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-21T17:14:32.601321] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:14:32.951048] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-21T17:14:33.625612] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T17:14:33.751093] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-21T17:14:34.258047] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:14:34.551052] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-21T17:14:35.094580] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T17:14:35.351031] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-21T17:14:35.992107] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T17:14:36.151023] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-21T17:14:36.951002] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-21T17:14:37.192369] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T17:14:37.407532] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T17:14:37.751072] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-21T17:14:38.551027] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-21T17:14:38.742239] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:14:39.184768] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:14:39.351010] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-21T17:14:39.801454] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:14:40.151035] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-21T17:14:40.755145] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:14:40.951003] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-21T17:14:41.501590] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T17:14:41.751029] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-21T17:14:42.550998] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-21T17:14:42.629601] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:14:43.351016] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-21T17:14:43.447525] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:14:44.151048] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-21T17:14:44.258146] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:14:44.263698] [INFO ] [REMOTE ] AOD: Full fetch complete (44843 records). [2025-10-21T17:14:44.263803] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-21T17:14:44.652079] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-21T17:14:44.652154] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-21T17:14:44.652721] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-21T17:14:44.652784] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-21T17:14:44.653741] [DEBUG] [LOCAL ] AOD: Trimmed 44843 records to 30971 (keeping 200 days of data) [2025-10-21T17:14:44.834750] [DEBUG] [LOCAL ] AOD: Primary data saved (30971 records). [2025-10-21T17:14:44.834937] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-21T17:14:44.835038] [INFO ] [MAIN ] Update Progress: 124/2366 symbols completed. AOD took 41.4s. Estimated remaining: 4h 25m 25s. Rate: 8.4 symbols/min [2025-10-21T17:14:44.960215] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-21T17:14:45.010569] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:45.032859] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:14:45.043464] [DEBUG] [LOCAL ] AP: Loaded 7408 existing records from primary storage. [2025-10-21T17:14:45.043962] [INFO ] [MAIN ] AP: Loaded 7408 existing records. [2025-10-21T17:14:45.228956] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:45.229173] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-21T17:14:45.229219] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-21T17:14:45.229386] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-21T17:14:45.229442] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-21T17:14:45.607282] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:45.755517] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-21T17:14:45.757964] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T17:14:46.550995] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-21T17:14:46.609762] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T17:14:46.616380] [INFO ] [REMOTE ] AON: Full fetch complete (65119 records). [2025-10-21T17:14:46.616496] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-21T17:14:47.002890] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-21T17:14:47.002967] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-21T17:14:47.003604] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-21T17:14:47.003666] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-21T17:14:47.004920] [DEBUG] [LOCAL ] AON: Trimmed 65119 records to 45103 (keeping 200 days of data) [2025-10-21T17:14:47.123215] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T17:14:47.130170] [INFO ] [REMOTE ] AORT: Full fetch complete (42368 records). [2025-10-21T17:14:47.131851] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-21T17:14:47.353961] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-21T17:14:47.702702] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-21T17:14:47.708393] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-21T17:14:47.709393] [DEBUG] [LOCAL ] AON: Primary data saved (45103 records). [2025-10-21T17:14:47.709995] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-21T17:14:47.710094] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-21T17:14:47.710210] [INFO ] [MAIN ] AON: Full history saved. [2025-10-21T17:14:47.710350] [INFO ] [MAIN ] Update Progress: 125/2366 symbols completed. AON took 41.4s. Estimated remaining: 4h 24m 2s. Rate: 8.5 symbols/min [2025-10-21T17:14:47.814971] [DEBUG] [LOCAL ] AORT: Trimmed 42368 records to 28922 (keeping 200 days of data) [2025-10-21T17:14:47.943533] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:48.086615] [DEBUG] [LOCAL ] AORT: Primary data saved (28922 records). [2025-10-21T17:14:48.087062] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-21T17:14:48.087232] [INFO ] [MAIN ] Update Progress: 126/2366 symbols completed. AORT took 21.7s. Estimated remaining: 4h 21m 56s. Rate: 8.6 symbols/min [2025-10-21T17:14:48.151269] [DEBUG] [LOCAL ] APAM: Loaded 36007 existing records from primary storage. [2025-10-21T17:14:48.179527] [INFO ] [MAIN ] APAM: Loaded 36007 existing records. [2025-10-21T17:14:48.259482] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T17:14:48.385300] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:48.376278] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-21T17:14:48.521560] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:48.523060] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-21T17:14:48.525601] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-21T17:14:48.525468] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-21T17:14:48.538622] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-21T17:14:48.539208] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-21T17:14:48.705931] [DEBUG] [LOCAL ] APD: Loaded 45522 existing records from primary storage. [2025-10-21T17:14:48.726634] [INFO ] [MAIN ] APD: Loaded 45522 existing records. [2025-10-21T17:14:48.956521] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-21T17:14:49.082624] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T17:14:49.171084] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:49.166794] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:49.173048] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-21T17:14:49.173109] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-21T17:14:49.173380] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-21T17:14:49.173436] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-21T17:14:49.545314] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:49.751053] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-21T17:14:50.551068] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-21T17:14:50.717607] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T17:14:51.113149] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T17:14:51.351093] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-21T17:14:51.733128] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T17:14:52.151057] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-21T17:14:52.628360] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T17:14:52.951024] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-21T17:14:53.180094] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T17:14:53.487365] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-21T17:14:53.751063] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-21T17:14:54.551092] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-21T17:14:55.325722] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T17:14:55.350988] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-21T17:14:55.368296] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T17:14:56.151065] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-21T17:14:56.893403] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T17:14:56.901195] [INFO ] [REMOTE ] AOS: Full fetch complete (71050 records). [2025-10-21T17:14:56.901363] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-21T17:14:56.961762] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-21T17:14:57.313257] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-21T17:14:57.313337] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-21T17:14:57.314046] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-21T17:14:57.314110] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-21T17:14:57.315435] [DEBUG] [LOCAL ] AOS: Trimmed 71050 records to 48651 (keeping 200 days of data) [2025-10-21T17:14:57.608603] [DEBUG] [LOCAL ] AOS: Primary data saved (48651 records). [2025-10-21T17:14:57.608740] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-21T17:14:57.608820] [INFO ] [MAIN ] Update Progress: 127/2366 symbols completed. AOS took 26.7s. Estimated remaining: 4h 22m 33s. Rate: 8.5 symbols/min [2025-10-21T17:14:57.761604] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-21T17:14:57.796165] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:14:57.805047] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:14:57.834198] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T17:14:57.884928] [DEBUG] [LOCAL ] APG: Loaded 50628 existing records from primary storage. [2025-10-21T17:14:57.885250] [INFO ] [MAIN ] APG: Loaded 50628 existing records. [2025-10-21T17:14:58.069946] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:14:58.070171] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-21T17:14:58.070218] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-21T17:14:58.070701] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-21T17:14:58.070757] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-21T17:14:58.418975] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:14:58.551046] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-21T17:14:59.177059] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:14:59.351055] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-21T17:14:59.908449] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T17:15:00.151075] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-21T17:15:00.951062] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-21T17:15:01.010712] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T17:15:01.751036] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-21T17:15:01.892502] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T17:15:02.551037] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-21T17:15:02.933480] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T17:15:03.351083] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-21T17:15:03.520327] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-21T17:15:04.151100] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-21T17:15:04.510539] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T17:15:04.818007] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T17:15:04.951074] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-21T17:15:05.655211] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T17:15:05.751068] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-21T17:15:06.015501] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:15:06.267723] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T17:15:06.551097] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-21T17:15:07.351060] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-21T17:15:07.965326] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:15:08.151042] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-21T17:15:08.951032] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-21T17:15:09.055414] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:15:09.208487] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T17:15:09.585464] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T17:15:09.587053] [INFO ] [REMOTE ] AP: Full fetch complete (9054 records). [2025-10-21T17:15:09.587125] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-21T17:15:09.754525] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-21T17:15:09.968455] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-21T17:15:09.968541] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-21T17:15:09.968797] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-21T17:15:09.968859] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-21T17:15:09.969282] [DEBUG] [LOCAL ] AP: Trimmed 9054 records to 7409 (keeping 200 days of data) [2025-10-21T17:15:10.014462] [DEBUG] [LOCAL ] AP: Primary data saved (7409 records). [2025-10-21T17:15:10.014610] [INFO ] [MAIN ] AP: Full history saved. [2025-10-21T17:15:10.014725] [INFO ] [MAIN ] Update Progress: 128/2366 symbols completed. AP took 25.2s. Estimated remaining: 4h 24m 0s. Rate: 8.5 symbols/min [2025-10-21T17:15:10.193380] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:10.253704] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-21T17:15:10.254042] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-21T17:15:10.432356] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:10.432568] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-21T17:15:10.432617] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-21T17:15:10.432890] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-21T17:15:10.432983] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-21T17:15:10.556144] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-21T17:15:10.808139] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:11.351068] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-21T17:15:11.452430] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:15:12.151003] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-21T17:15:12.343212] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:15:12.951007] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-21T17:15:13.069693] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T17:15:13.751032] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-21T17:15:13.906570] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:15:14.551059] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-21T17:15:14.580878] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:15:15.352843] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-21T17:15:15.355198] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T17:15:16.150999] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-21T17:15:16.240930] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T17:15:16.951053] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-21T17:15:17.140580] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T17:15:17.214452] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T17:15:17.751036] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-21T17:15:18.558718] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-21T17:15:18.576455] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T17:15:19.351024] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-21T17:15:19.751103] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T17:15:19.776735] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T17:15:19.783572] [INFO ] [REMOTE ] APAM: Full fetch complete (52047 records). [2025-10-21T17:15:19.783742] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-21T17:15:20.156112] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-21T17:15:20.174453] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-21T17:15:20.174521] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-21T17:15:20.175132] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-21T17:15:20.175199] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-21T17:15:20.176377] [DEBUG] [LOCAL ] APAM: Trimmed 52047 records to 35815 (keeping 200 days of data) [2025-10-21T17:15:20.386353] [DEBUG] [LOCAL ] APAM: Primary data saved (35815 records). [2025-10-21T17:15:20.386480] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-21T17:15:20.386557] [INFO ] [MAIN ] Update Progress: 129/2366 symbols completed. APAM took 32.7s. Estimated remaining: 4h 24m 50s. Rate: 8.4 symbols/min [2025-10-21T17:15:20.557117] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:20.604980] [DEBUG] [LOCAL ] APLE: Loaded 51975 existing records from primary storage. [2025-10-21T17:15:20.605278] [INFO ] [MAIN ] APLE: Loaded 51975 existing records. [2025-10-21T17:15:20.786847] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:20.787080] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-21T17:15:20.787140] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-21T17:15:20.787388] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-21T17:15:20.787426] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-21T17:15:20.967560] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-21T17:15:21.158938] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:21.178714] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:15:21.186173] [INFO ] [REMOTE ] APD: Full fetch complete (67377 records). [2025-10-21T17:15:21.186296] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-21T17:15:21.576376] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-21T17:15:21.576449] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-21T17:15:21.577119] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-21T17:15:21.577182] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-21T17:15:21.578440] [DEBUG] [LOCAL ] APD: Trimmed 67377 records to 45477 (keeping 200 days of data) [2025-10-21T17:15:21.760680] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-21T17:15:21.872373] [DEBUG] [LOCAL ] APD: Primary data saved (45477 records). [2025-10-21T17:15:21.872522] [INFO ] [MAIN ] APD: Full history saved. [2025-10-21T17:15:21.872614] [INFO ] [MAIN ] Update Progress: 130/2366 symbols completed. APD took 33.8s. Estimated remaining: 4h 23m 7s. Rate: 8.5 symbols/min [2025-10-21T17:15:22.048477] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:22.048810] [DEBUG] [LOCAL ] APO: No existing data file found in primary storage. [2025-10-21T17:15:22.048912] [WARN ] [MAIN ] APO: No existing data found, performing full refresh instead. [2025-10-21T17:15:22.049054] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-21T17:15:22.049147] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-21T17:15:22.049332] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-21T17:15:22.049504] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-21T17:15:22.440832] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-21T17:15:22.461916] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:22.550998] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-21T17:15:22.885807] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T17:15:23.304980] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T17:15:23.350991] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-21T17:15:24.151024] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-21T17:15:24.714176] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T17:15:24.951003] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-21T17:15:25.001869] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:15:25.751055] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-21T17:15:25.841714] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T17:15:26.551010] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-21T17:15:26.707343] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:15:27.104913] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:15:27.351026] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-21T17:15:28.151065] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-21T17:15:28.330575] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T17:15:28.808160] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:15:28.951070] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-21T17:15:29.751040] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-21T17:15:30.250377] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T17:15:30.333196] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T17:15:30.551029] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-21T17:15:31.351056] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-21T17:15:31.463262] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:15:32.151078] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-21T17:15:32.199315] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:15:32.887567] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T17:15:32.951004] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-21T17:15:33.751033] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-21T17:15:34.550998] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-21T17:15:34.685460] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-21T17:15:34.725722] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T17:15:35.351034] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-21T17:15:35.487484] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T17:15:35.495628] [INFO ] [REMOTE ] APG: Full fetch complete (72162 records). [2025-10-21T17:15:35.495794] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-21T17:15:35.908291] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-21T17:15:35.908373] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-21T17:15:35.909150] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-21T17:15:35.909216] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-21T17:15:35.910580] [DEBUG] [LOCAL ] APG: Trimmed 72162 records to 50625 (keeping 200 days of data) [2025-10-21T17:15:36.152112] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-21T17:15:36.216347] [DEBUG] [LOCAL ] APG: Primary data saved (50625 records). [2025-10-21T17:15:36.216477] [INFO ] [MAIN ] APG: Full history saved. [2025-10-21T17:15:36.216553] [INFO ] [MAIN ] Update Progress: 131/2366 symbols completed. APG took 38.6s. Estimated remaining: 4h 25m 4s. Rate: 8.4 symbols/min [2025-10-21T17:15:36.391104] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:36.427490] [DEBUG] [LOCAL ] APOS: Loaded 7187 existing records from primary storage. [2025-10-21T17:15:36.427864] [INFO ] [MAIN ] APOS: Loaded 7187 existing records. [2025-10-21T17:15:36.462859] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T17:15:36.622198] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:36.622392] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-21T17:15:36.622452] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-21T17:15:36.622627] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-21T17:15:36.622728] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-21T17:15:36.952766] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-21T17:15:37.006738] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:37.039930] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:15:37.751001] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-21T17:15:38.019862] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T17:15:38.551028] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-21T17:15:39.195261] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T17:15:39.351049] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-21T17:15:39.961359] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-21T17:15:40.151037] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-21T17:15:40.280448] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T17:15:40.457706] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T17:15:40.951018] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-21T17:15:41.746626] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T17:15:41.750976] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-21T17:15:41.981580] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T17:15:42.480598] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T17:15:42.551044] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-21T17:15:43.351053] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-21T17:15:44.151127] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-21T17:15:44.621768] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T17:15:44.951050] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-21T17:15:45.309256] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T17:15:45.317708] [INFO ] [REMOTE ] APH: Full fetch complete (77869 records). [2025-10-21T17:15:45.317871] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-21T17:15:45.596245] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T17:15:45.744368] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-21T17:15:45.744480] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-21T17:15:45.745334] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-21T17:15:45.745414] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-21T17:15:45.747016] [DEBUG] [LOCAL ] APH: Trimmed 77869 records to 53691 (keeping 200 days of data) [2025-10-21T17:15:45.802295] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-21T17:15:46.099727] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T17:15:46.133039] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-21T17:15:46.133556] [INFO ] [MAIN ] APH: Full history saved. [2025-10-21T17:15:46.134318] [INFO ] [MAIN ] Update Progress: 132/2366 symbols completed. APH took 36.1s. Estimated remaining: 4h 25m 44s. Rate: 8.4 symbols/min [2025-10-21T17:15:46.307477] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:46.307664] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-21T17:15:46.307720] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-21T17:15:46.307850] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-21T17:15:46.307891] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-21T17:15:46.307932] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-21T17:15:46.307964] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-21T17:15:46.551064] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-21T17:15:46.596923] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T17:15:46.677896] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:47.351022] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-21T17:15:48.144733] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T17:15:48.150975] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-21T17:15:48.575193] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T17:15:48.641627] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T17:15:48.951024] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-21T17:15:49.629716] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T17:15:49.751027] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-21T17:15:50.551097] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-21T17:15:51.351021] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-21T17:15:51.435404] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T17:15:51.737778] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T17:15:51.745340] [INFO ] [REMOTE ] APLE: Full fetch complete (74378 records). [2025-10-21T17:15:51.745460] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-21T17:15:51.746263] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:15:51.746349] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:15:51.746394] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:15:51.746463] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-21T17:15:51.746526] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-21T17:15:51.746562] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-21T17:15:51.746749] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-10-21T17:15:51.746835] [INFO ] [MAIN ] Update Progress: 133/2366 symbols completed. APLE took 31.4s. Estimated remaining: 4h 25m 11s. Rate: 8.4 symbols/min [2025-10-21T17:15:51.915285] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:51.960724] [DEBUG] [LOCAL ] AQN: Loaded 51714 existing records from primary storage. [2025-10-21T17:15:51.961078] [INFO ] [MAIN ] AQN: Loaded 51714 existing records. [2025-10-21T17:15:52.139095] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:52.139319] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-21T17:15:52.139366] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-21T17:15:52.139629] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-21T17:15:52.139707] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-21T17:15:52.160381] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-21T17:15:52.498108] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:52.951003] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-21T17:15:53.133801] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:15:53.180682] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:15:53.182024] [INFO ] [REMOTE ] APOS: Full fetch complete (10222 records). [2025-10-21T17:15:53.182179] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-21T17:15:53.572054] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-21T17:15:53.572134] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-21T17:15:53.572360] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-21T17:15:53.572398] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-21T17:15:53.572885] [DEBUG] [LOCAL ] APOS: Trimmed 10222 records to 7132 (keeping 200 days of data) [2025-10-21T17:15:53.616785] [DEBUG] [LOCAL ] APOS: Primary data saved (7132 records). [2025-10-21T17:15:53.616915] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-21T17:15:53.616992] [INFO ] [MAIN ] Update Progress: 134/2366 symbols completed. APOS took 17.4s. Estimated remaining: 4h 23m 37s. Rate: 8.5 symbols/min [2025-10-21T17:15:53.765390] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-21T17:15:53.799281] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:15:53.806080] [DEBUG] [LOCAL ] AQNB: Loaded 3972 existing records from primary storage. [2025-10-21T17:15:53.806293] [INFO ] [MAIN ] AQNB: Loaded 3972 existing records. [2025-10-21T17:15:53.994475] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:15:53.994762] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-21T17:15:53.994823] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-21T17:15:53.994990] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-21T17:15:53.995046] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-21T17:15:54.353835] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:15:54.551030] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-21T17:15:54.890076] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T17:15:55.351039] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-21T17:15:55.853969] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T17:15:55.968673] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T17:15:56.151011] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-21T17:15:56.265996] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T17:15:56.508507] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-21T17:15:56.951035] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-21T17:15:57.751047] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-21T17:15:58.551106] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-21T17:15:58.708778] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:15:59.109480] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T17:15:59.351006] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-21T17:15:59.611990] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T17:16:00.151068] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-21T17:16:00.951013] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-21T17:16:01.225770] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T17:16:01.751069] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-21T17:16:02.091291] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T17:16:02.389748] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T17:16:02.551032] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-21T17:16:02.982550] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T17:16:02.991461] [INFO ] [REMOTE ] APO: Full fetch complete (77467 records). [2025-10-21T17:16:02.991691] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-21T17:16:03.365563] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-21T17:16:03.425305] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-21T17:16:03.425390] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-21T17:16:03.426183] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-21T17:16:03.426251] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-21T17:16:03.427819] [DEBUG] [LOCAL ] APO: Trimmed 77467 records to 53390 (keeping 200 days of data) [2025-10-21T17:16:03.756809] [DEBUG] [LOCAL ] APO: Primary data saved (53390 records). [2025-10-21T17:16:03.756951] [INFO ] [MAIN ] APO: Full history saved. [2025-10-21T17:16:03.757022] [INFO ] [MAIN ] Update Progress: 135/2366 symbols completed. APO took 41.9s. Estimated remaining: 4h 24m 20s. Rate: 8.4 symbols/min [2025-10-21T17:16:03.929562] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:03.979166] [DEBUG] [LOCAL ] AR: Loaded 53590 existing records from primary storage. [2025-10-21T17:16:03.979495] [INFO ] [MAIN ] AR: Loaded 53590 existing records. [2025-10-21T17:16:04.156111] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-21T17:16:04.161973] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:04.162222] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-21T17:16:04.163035] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-21T17:16:04.163557] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-21T17:16:04.163616] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-21T17:16:04.564218] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:04.559949] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T17:16:04.587378] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T17:16:04.951011] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-21T17:16:05.280487] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T17:16:05.597067] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T17:16:05.751082] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-21T17:16:06.551088] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-21T17:16:07.351063] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-21T17:16:07.619232] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:16:08.104705] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:16:08.151030] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-21T17:16:08.742985] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T17:16:08.951063] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-21T17:16:09.571845] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T17:16:09.599308] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T17:16:09.751020] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-21T17:16:10.311004] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:16:10.551076] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-21T17:16:11.351049] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-21T17:16:12.151046] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-21T17:16:12.286243] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T17:16:12.951022] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-21T17:16:13.067693] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:16:13.751063] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-21T17:16:13.900436] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T17:16:14.083976] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-21T17:16:14.551064] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-21T17:16:14.915365] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:16:15.351067] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-21T17:16:15.808906] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T17:16:15.809837] [INFO ] [REMOTE ] AQNB: Full fetch complete (5412 records). [2025-10-21T17:16:15.809903] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-21T17:16:16.154098] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-21T17:16:16.179109] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-21T17:16:16.179251] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-21T17:16:16.179451] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-21T17:16:16.179537] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-21T17:16:16.180093] [DEBUG] [LOCAL ] AQNB: Trimmed 5412 records to 3940 (keeping 200 days of data) [2025-10-21T17:16:16.203255] [DEBUG] [LOCAL ] AQNB: Primary data saved (3940 records). [2025-10-21T17:16:16.203318] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-21T17:16:16.203387] [INFO ] [MAIN ] Update Progress: 136/2366 symbols completed. AQNB took 22.6s. Estimated remaining: 4h 25m 40s. Rate: 8.4 symbols/min [2025-10-21T17:16:16.371475] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:16.408489] [DEBUG] [LOCAL ] ARCO: Loaded 44434 existing records from primary storage. [2025-10-21T17:16:16.408961] [INFO ] [MAIN ] ARCO: Loaded 44434 existing records. [2025-10-21T17:16:16.610571] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T17:16:16.614848] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:16.615060] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-21T17:16:16.625291] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-21T17:16:16.626055] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-21T17:16:16.626112] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-21T17:16:16.954339] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-21T17:16:16.975616] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:17.751064] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-21T17:16:17.798979] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T17:16:17.807248] [INFO ] [REMOTE ] APTV: Full fetch complete (75853 records). [2025-10-21T17:16:17.807399] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-21T17:16:18.098777] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T17:16:18.232207] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-21T17:16:18.232279] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-21T17:16:18.233000] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-21T17:16:18.233064] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-21T17:16:18.234362] [DEBUG] [LOCAL ] APTV: Trimmed 75853 records to 51874 (keeping 200 days of data) [2025-10-21T17:16:18.523159] [DEBUG] [LOCAL ] APTV: Primary data saved (51874 records). [2025-10-21T17:16:18.523272] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-21T17:16:18.523344] [INFO ] [MAIN ] Update Progress: 137/2366 symbols completed. APTV took 32.4s. Estimated remaining: 4h 24m 15s. Rate: 8.4 symbols/min [2025-10-21T17:16:18.555120] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-21T17:16:18.695973] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:18.711697] [DEBUG] [LOCAL ] ARDC: Loaded 15280 existing records from primary storage. [2025-10-21T17:16:18.711887] [INFO ] [MAIN ] ARDC: Loaded 15280 existing records. [2025-10-21T17:16:18.896052] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:18.896211] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-21T17:16:18.896261] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-21T17:16:18.896440] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-21T17:16:18.896495] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-21T17:16:19.258414] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:19.283178] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:16:19.350974] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-21T17:16:20.151043] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-21T17:16:20.486908] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T17:16:20.951045] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-21T17:16:21.103499] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:16:21.153556] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T17:16:21.751045] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-21T17:16:22.551056] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-21T17:16:22.715991] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:16:23.351068] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-21T17:16:23.853953] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T17:16:24.046250] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T17:16:24.151031] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-21T17:16:24.951047] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-21T17:16:25.169763] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T17:16:25.358360] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T17:16:25.749188] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T17:16:25.752152] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-21T17:16:26.551072] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-21T17:16:27.351022] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-21T17:16:27.704607] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T17:16:27.715596] [INFO ] [REMOTE ] AQN: Full fetch complete (75342 records). [2025-10-21T17:16:27.715805] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-21T17:16:28.049634] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T17:16:28.159048] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-21T17:16:28.160824] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-21T17:16:28.160960] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-21T17:16:28.161764] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-21T17:16:28.162032] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-21T17:16:28.163558] [DEBUG] [LOCAL ] AQN: Trimmed 75342 records to 51684 (keeping 200 days of data) [2025-10-21T17:16:28.393708] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T17:16:28.498634] [DEBUG] [LOCAL ] AQN: Primary data saved (51684 records). [2025-10-21T17:16:28.498798] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-21T17:16:28.498881] [INFO ] [MAIN ] Update Progress: 138/2366 symbols completed. AQN took 36.8s. Estimated remaining: 4h 24m 54s. Rate: 8.4 symbols/min [2025-10-21T17:16:28.666346] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:28.693462] [DEBUG] [LOCAL ] ARDT: Loaded 27434 existing records from primary storage. [2025-10-21T17:16:28.693760] [INFO ] [MAIN ] ARDT: Loaded 27434 existing records. [2025-10-21T17:16:28.868537] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:28.868779] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-21T17:16:28.868832] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-21T17:16:28.869081] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-21T17:16:28.869121] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-21T17:16:28.956153] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-21T17:16:29.256907] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:29.675886] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:16:29.751058] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-21T17:16:29.935364] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T17:16:30.551028] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-21T17:16:31.356231] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-21T17:16:31.374077] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:16:31.920927] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:16:32.151040] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-21T17:16:32.328425] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T17:16:32.951028] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-21T17:16:33.482548] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:16:33.497417] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-21T17:16:33.751053] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-21T17:16:34.551039] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-21T17:16:35.305130] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T17:16:35.351020] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-21T17:16:36.151044] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-21T17:16:36.881563] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T17:16:36.950384] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T17:16:36.961888] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-21T17:16:37.162187] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T17:16:37.751122] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-21T17:16:38.551004] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-21T17:16:38.750483] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T17:16:38.941226] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T17:16:39.290334] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T17:16:39.351032] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-21T17:16:40.151082] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-21T17:16:40.609611] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T17:16:40.951074] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-21T17:16:41.750984] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-21T17:16:42.012168] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T17:16:42.551097] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-21T17:16:42.913204] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:16:42.990266] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T17:16:43.351016] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-21T17:16:43.629439] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T17:16:43.632669] [INFO ] [REMOTE ] ARDC: Full fetch complete (21470 records). [2025-10-21T17:16:43.632742] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-21T17:16:43.989093] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-21T17:16:43.989184] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-21T17:16:43.989523] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-21T17:16:43.989564] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-21T17:16:43.990158] [DEBUG] [LOCAL ] ARDC: Trimmed 21470 records to 15258 (keeping 200 days of data) [2025-10-21T17:16:44.080248] [DEBUG] [LOCAL ] ARDC: Primary data saved (15258 records). [2025-10-21T17:16:44.080362] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-21T17:16:44.080437] [INFO ] [MAIN ] Update Progress: 139/2366 symbols completed. ARDC took 25.6s. Estimated remaining: 4h 27m 2s. Rate: 8.3 symbols/min [2025-10-21T17:16:44.156102] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-21T17:16:44.247106] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:44.294458] [DEBUG] [LOCAL ] ARE: Loaded 50965 existing records from primary storage. [2025-10-21T17:16:44.294797] [INFO ] [MAIN ] ARE: Loaded 50965 existing records. [2025-10-21T17:16:44.466676] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:44.466890] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-21T17:16:44.466937] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-21T17:16:44.467236] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-21T17:16:44.467275] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-21T17:16:44.814748] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:44.951048] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-21T17:16:45.034498] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T17:16:45.042867] [INFO ] [REMOTE ] AR: Full fetch complete (77738 records). [2025-10-21T17:16:45.043006] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-21T17:16:45.426240] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-21T17:16:45.426323] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-21T17:16:45.427092] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-21T17:16:45.427155] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-21T17:16:45.428578] [DEBUG] [LOCAL ] AR: Trimmed 77738 records to 53590 (keeping 200 days of data) [2025-10-21T17:16:45.538806] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:16:45.547747] [INFO ] [REMOTE ] ARCO: Full fetch complete (64768 records). [2025-10-21T17:16:45.549221] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-21T17:16:45.550695] [FATAL] [VALIDATOR ] ARCO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:16:45.561562] [FATAL] [MAIN ] ARCO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:16:45.561695] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:16:45.570243] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-21T17:16:45.570339] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-10-21T17:16:45.570380] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-10-21T17:16:45.570550] [DEBUG] [LOCAL ] ARCO: Deleted derivative data file. [2025-10-21T17:16:45.570699] [INFO ] [MAIN ] Update Progress: 140/2366 symbols completed. ARCO took 29.4s. Estimated remaining: 4h 25m 24s. Rate: 8.4 symbols/min [2025-10-21T17:16:45.754164] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-21T17:16:45.844046] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:45.954743] [DEBUG] [LOCAL ] AR: Primary data saved (53590 records). [2025-10-21T17:16:45.954878] [INFO ] [MAIN ] AR: Full history saved. [2025-10-21T17:16:45.954998] [INFO ] [MAIN ] Update Progress: 141/2366 symbols completed. AR took 42.2s. Estimated remaining: 4h 23m 30s. Rate: 8.4 symbols/min [2025-10-21T17:16:46.079233] [DEBUG] [LOCAL ] ARES: Loaded 49703 existing records from primary storage. [2025-10-21T17:16:46.085110] [INFO ] [MAIN ] ARES: Loaded 49703 existing records. [2025-10-21T17:16:46.222323] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:46.234513] [DEBUG] [LOCAL ] ARI: No existing data file found in primary storage. [2025-10-21T17:16:46.239859] [WARN ] [MAIN ] ARI: No existing data found, performing full refresh instead. [2025-10-21T17:16:46.257392] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-21T17:16:46.263224] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-21T17:16:46.273593] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-21T17:16:46.279045] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-21T17:16:46.397192] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:16:46.406699] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-21T17:16:46.435486] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-21T17:16:46.452282] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-21T17:16:46.538304] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-21T17:16:46.773420] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:16:46.884954] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:46.890538] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-21T17:16:47.131298] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:16:47.351009] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-21T17:16:47.566340] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T17:16:47.939725] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T17:16:48.151093] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-21T17:16:48.857846] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T17:16:48.951014] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-21T17:16:48.982123] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:16:49.751086] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-21T17:16:50.551020] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-21T17:16:50.693106] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T17:16:51.330511] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T17:16:51.350987] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-21T17:16:51.761901] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:16:52.151052] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-21T17:16:52.951070] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-21T17:16:53.219441] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:16:53.342218] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T17:16:53.751066] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-21T17:16:54.196580] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:16:54.551072] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-21T17:16:55.351056] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-21T17:16:55.630440] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:16:55.870797] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T17:16:56.151060] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-21T17:16:56.557882] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T17:16:56.951033] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-21T17:16:57.663023] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T17:16:57.751035] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-21T17:16:58.551048] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-21T17:16:58.858415] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T17:16:58.895344] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T17:16:58.900631] [INFO ] [REMOTE ] ARDT: Full fetch complete (41575 records). [2025-10-21T17:16:58.900789] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-21T17:16:59.284415] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-21T17:16:59.284491] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-21T17:16:59.284968] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-21T17:16:59.285029] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-21T17:16:59.285903] [DEBUG] [LOCAL ] ARDT: Trimmed 41575 records to 27405 (keeping 200 days of data) [2025-10-21T17:16:59.365719] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-21T17:16:59.441834] [DEBUG] [LOCAL ] ARDT: Primary data saved (27405 records). [2025-10-21T17:16:59.441965] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-21T17:16:59.442043] [INFO ] [MAIN ] Update Progress: 142/2366 symbols completed. ARDT took 30.9s. Estimated remaining: 4h 25m 3s. Rate: 8.4 symbols/min [2025-10-21T17:16:59.620867] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:16:59.621044] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-21T17:16:59.621081] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-21T17:16:59.621234] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-21T17:16:59.621276] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-21T17:16:59.621317] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-21T17:16:59.621350] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-21T17:16:59.981585] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:00.151086] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-21T17:17:00.512436] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T17:17:00.951019] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-21T17:17:01.346476] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T17:17:01.751081] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-21T17:17:01.933491] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:17:02.550992] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-21T17:17:02.762044] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T17:17:03.351005] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-21T17:17:03.611823] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:17:03.681939] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T17:17:04.151063] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-21T17:17:04.951031] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-21T17:17:05.105717] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:17:05.675826] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T17:17:05.751075] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-21T17:17:06.551009] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-21T17:17:06.583405] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:17:07.351034] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-21T17:17:07.404739] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T17:17:08.151003] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-21T17:17:08.637998] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T17:17:08.810806] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:17:08.951009] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-21T17:17:09.751063] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-21T17:17:10.066279] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T17:17:10.551036] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-21T17:17:10.858251] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T17:17:11.274109] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:17:11.351077] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-21T17:17:12.109671] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T17:17:12.151022] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-21T17:17:12.632701] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T17:17:12.951018] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-21T17:17:13.673010] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T17:17:13.750984] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-21T17:17:14.551011] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-21T17:17:14.913291] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:17:15.275492] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T17:17:15.351038] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-21T17:17:16.150997] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-21T17:17:16.269110] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T17:17:16.951057] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-21T17:17:17.161836] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:17:17.169863] [INFO ] [REMOTE ] ARE: Full fetch complete (72656 records). [2025-10-21T17:17:17.170031] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-21T17:17:17.170880] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:17.170971] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:17.171014] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:17.171060] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-21T17:17:17.171162] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-21T17:17:17.171211] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-21T17:17:17.171471] [DEBUG] [LOCAL ] ARE: Deleted derivative data file. [2025-10-21T17:17:17.172130] [INFO ] [MAIN ] Update Progress: 143/2366 symbols completed. ARE took 33.1s. Estimated remaining: 4h 27m 40s. Rate: 8.3 symbols/min [2025-10-21T17:17:17.353466] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:17.400174] [DEBUG] [LOCAL ] ARMK: Loaded 50421 existing records from primary storage. [2025-10-21T17:17:17.400529] [INFO ] [MAIN ] ARMK: Loaded 50421 existing records. [2025-10-21T17:17:17.576126] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:17:17.576353] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-21T17:17:17.576442] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-21T17:17:17.576969] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-21T17:17:17.577029] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-21T17:17:17.764909] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-21T17:17:17.795806] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:17:17.985305] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:18.551008] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-21T17:17:18.899195] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T17:17:19.351018] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-21T17:17:19.518576] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:17:20.124194] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T17:17:20.151051] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-21T17:17:20.950999] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-21T17:17:21.473281] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-21T17:17:21.481345] [INFO ] [REMOTE ] ARES: Full fetch complete (71641 records). [2025-10-21T17:17:21.481459] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-21T17:17:21.770908] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-21T17:17:21.878398] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-21T17:17:21.878546] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-21T17:17:21.879327] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-21T17:17:21.879409] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-21T17:17:21.904790] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:17:21.914293] [DEBUG] [LOCAL ] ARES: Trimmed 71641 records to 49679 (keeping 200 days of data) [2025-10-21T17:17:22.216129] [DEBUG] [LOCAL ] ARES: Primary data saved (49679 records). [2025-10-21T17:17:22.216232] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-21T17:17:22.217175] [INFO ] [MAIN ] Update Progress: 144/2366 symbols completed. ARES took 36.6s. Estimated remaining: 4h 26m 59s. Rate: 8.3 symbols/min [2025-10-21T17:17:22.386592] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:22.434112] [DEBUG] [LOCAL ] AROC: Loaded 49092 existing records from primary storage. [2025-10-21T17:17:22.434433] [INFO ] [MAIN ] AROC: Loaded 49092 existing records. [2025-10-21T17:17:22.551913] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-21T17:17:22.622049] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:17:22.622428] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-21T17:17:22.622565] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-21T17:17:22.623303] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-21T17:17:22.623362] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-21T17:17:22.929949] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T17:17:23.016996] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:23.351007] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-21T17:17:23.377107] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T17:17:23.384412] [INFO ] [REMOTE ] ARI: Full fetch complete (62039 records). [2025-10-21T17:17:23.384627] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-21T17:17:23.385672] [FATAL] [VALIDATOR ] ARI: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:23.385768] [FATAL] [MAIN ] ARI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:23.385813] [WARN ] [MAIN ] ARI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:23.385856] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-21T17:17:23.385925] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-10-21T17:17:23.385964] [INFO ] [LOCAL ] ARI: Starting deletion of derivative data. [2025-10-21T17:17:23.386005] [DEBUG] [LOCAL ] ARI: No derivative data file found to delete. [2025-10-21T17:17:23.386076] [INFO ] [MAIN ] Update Progress: 145/2366 symbols completed. ARI took 37.4s. Estimated remaining: 4h 25m 20s. Rate: 8.4 symbols/min [2025-10-21T17:17:23.571315] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:23.571491] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-21T17:17:23.571531] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-21T17:17:23.571661] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-21T17:17:23.571728] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-21T17:17:23.571803] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-21T17:17:23.571847] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-21T17:17:23.915440] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:24.151017] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-21T17:17:24.326432] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T17:17:24.333303] [INFO ] [REMOTE ] ARLO: Full fetch complete (63121 records). [2025-10-21T17:17:24.333450] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-21T17:17:24.719011] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-21T17:17:24.719090] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-21T17:17:24.719735] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-21T17:17:24.719797] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-21T17:17:24.720958] [DEBUG] [LOCAL ] ARLO: Trimmed 63121 records to 43536 (keeping 200 days of data) [2025-10-21T17:17:24.956479] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-21T17:17:24.970994] [DEBUG] [LOCAL ] ARLO: Primary data saved (43536 records). [2025-10-21T17:17:24.971127] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-21T17:17:24.971302] [INFO ] [MAIN ] Update Progress: 146/2366 symbols completed. ARLO took 25.5s. Estimated remaining: 4h 23m 48s. Rate: 8.4 symbols/min [2025-10-21T17:17:25.151489] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:25.191202] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T17:17:25.231448] [DEBUG] [LOCAL ] ARW: Loaded 33236 existing records from primary storage. [2025-10-21T17:17:25.231707] [INFO ] [MAIN ] ARW: Loaded 33236 existing records. [2025-10-21T17:17:25.406324] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:17:25.406526] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-21T17:17:25.406573] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-21T17:17:25.406860] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-21T17:17:25.406915] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-21T17:17:25.761280] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:25.756730] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-21T17:17:26.205380] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-21T17:17:26.551050] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-21T17:17:26.660148] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T17:17:27.351011] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-21T17:17:27.388127] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:17:28.137709] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:17:28.150970] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-21T17:17:28.951005] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-21T17:17:29.255930] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T17:17:29.330343] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T17:17:29.751024] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-21T17:17:30.551017] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-21T17:17:31.005788] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T17:17:31.351012] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-21T17:17:31.444288] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:17:31.984743] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T17:17:32.151054] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-21T17:17:32.952161] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-21T17:17:32.957931] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T17:17:33.432590] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T17:17:33.751047] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-21T17:17:34.551050] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-21T17:17:35.012036] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T17:17:35.351018] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-21T17:17:35.503950] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:17:35.750966] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T17:17:36.151076] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-21T17:17:36.951048] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-21T17:17:37.084326] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T17:17:37.558708] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:17:37.751063] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-21T17:17:38.551008] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-21T17:17:38.597759] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T17:17:39.323352] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T17:17:39.350979] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-21T17:17:40.151055] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-21T17:17:40.224374] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:17:40.837020] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T17:17:40.951021] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-21T17:17:41.751046] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-21T17:17:41.962080] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T17:17:42.551081] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-21T17:17:43.115519] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-21T17:17:43.255194] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:17:43.350998] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-21T17:17:44.151011] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-21T17:17:44.391471] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T17:17:44.930787] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:17:44.950991] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-21T17:17:45.661042] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:17:45.751064] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-21T17:17:46.550993] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-21T17:17:46.636619] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T17:17:47.351089] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-21T17:17:47.989437] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-21T17:17:48.156165] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-21T17:17:48.174504] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T17:17:48.950988] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-21T17:17:49.684712] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:17:49.690184] [INFO ] [REMOTE ] ARW: Full fetch complete (48391 records). [2025-10-21T17:17:49.690315] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-21T17:17:49.690930] [FATAL] [VALIDATOR ] ARW: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:49.691013] [FATAL] [MAIN ] ARW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:49.691058] [WARN ] [MAIN ] ARW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:49.691144] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-21T17:17:49.691234] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-21T17:17:49.691293] [INFO ] [LOCAL ] ARW: Starting deletion of derivative data. [2025-10-21T17:17:49.691431] [DEBUG] [LOCAL ] ARW: Deleted derivative data file. [2025-10-21T17:17:49.691524] [INFO ] [MAIN ] Update Progress: 147/2366 symbols completed. ARW took 24.7s. Estimated remaining: 4h 28m 6s. Rate: 8.3 symbols/min [2025-10-21T17:17:49.752628] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-21T17:17:49.858715] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-10-21T17:17:49.944116] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:49.944366] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-21T17:17:49.944436] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-21T17:17:49.944576] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-21T17:17:49.944671] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-21T17:17:49.944772] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-21T17:17:49.944827] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-21T17:17:50.365984] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:50.512433] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T17:17:50.519822] [INFO ] [REMOTE ] AROC: Full fetch complete (71017 records). [2025-10-21T17:17:50.519928] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-21T17:17:50.520731] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:50.520852] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:50.520895] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:50.520934] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-21T17:17:50.520988] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-10-21T17:17:50.521023] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-10-21T17:17:50.521161] [DEBUG] [LOCAL ] AROC: Deleted derivative data file. [2025-10-21T17:17:50.522100] [INFO ] [MAIN ] Update Progress: 148/2366 symbols completed. AROC took 28.3s. Estimated remaining: 4h 26m 23s. Rate: 8.3 symbols/min [2025-10-21T17:17:50.556249] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-21T17:17:50.695568] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:50.695762] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-10-21T17:17:50.695806] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-10-21T17:17:50.695914] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-21T17:17:50.695954] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-21T17:17:50.695993] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-10-21T17:17:50.696025] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-21T17:17:50.823619] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:17:50.847529] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-21T17:17:50.871104] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:17:50.910075] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-21T17:17:50.921848] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:17:50.948749] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-21T17:17:50.959828] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-21T17:17:50.979113] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-21T17:17:50.981927] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-21T17:17:50.982019] [INFO ] [MAIN ] Update Progress: 149/2366 symbols completed. ARX took 1.3s. Estimated remaining: 4h 24m 35s. Rate: 8.4 symbols/min [2025-10-21T17:17:51.191419] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:51.260748] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:51.260939] [DEBUG] [LOCAL ] ASA: No existing data file found in primary storage. [2025-10-21T17:17:51.260977] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-10-21T17:17:51.261109] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-21T17:17:51.261184] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-21T17:17:51.261237] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-21T17:17:51.261269] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-21T17:17:51.352880] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-21T17:17:51.630444] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:51.658148] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T17:17:52.151080] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-21T17:17:52.765511] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:17:52.951010] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-21T17:17:53.751067] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-21T17:17:54.203946] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T17:17:54.551035] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-21T17:17:54.614716] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T17:17:54.622335] [INFO ] [REMOTE ] ARMK: Full fetch complete (72624 records). [2025-10-21T17:17:54.622473] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-21T17:17:54.623287] [FATAL] [VALIDATOR ] ARMK: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:17:54.623376] [FATAL] [MAIN ] ARMK: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:17:54.623417] [WARN ] [MAIN ] ARMK: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:17:54.623457] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-21T17:17:54.623512] [DEBUG] [LOCAL ] ARMK: No primary data file found to delete. [2025-10-21T17:17:54.623547] [INFO ] [LOCAL ] ARMK: Starting deletion of derivative data. [2025-10-21T17:17:54.623726] [DEBUG] [LOCAL ] ARMK: Deleted derivative data file. [2025-10-21T17:17:54.624315] [INFO ] [MAIN ] Update Progress: 150/2366 symbols completed. ARMK took 37.5s. Estimated remaining: 4h 23m 36s. Rate: 8.4 symbols/min [2025-10-21T17:17:54.804125] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:17:54.824124] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T17:17:54.864313] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-21T17:17:54.864611] [INFO ] [MAIN ] ASAN: Loaded 52732 existing records. [2025-10-21T17:17:55.056061] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:17:55.056324] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-21T17:17:55.056402] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-21T17:17:55.056776] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-21T17:17:55.056844] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-21T17:17:55.356150] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-21T17:17:55.416928] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:17:56.151031] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-21T17:17:56.305547] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:17:56.951045] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-21T17:17:56.995463] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T17:17:57.089441] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T17:17:57.751058] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-21T17:17:58.551030] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-21T17:17:58.834263] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:17:59.086073] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-21T17:17:59.351013] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-21T17:17:59.834285] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-21T17:18:00.151072] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-21T17:18:00.260590] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T17:18:00.951023] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-21T17:18:01.751065] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-21T17:18:01.965288] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T17:18:02.551062] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-21T17:18:02.756438] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:18:02.764445] [INFO ] [REMOTE ] ARR: Full fetch complete (75122 records). [2025-10-21T17:18:02.764601] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-21T17:18:02.765399] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:18:02.765488] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:18:02.765530] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:18:02.765594] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-21T17:18:02.765682] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-21T17:18:02.765737] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-21T17:18:02.765778] [DEBUG] [LOCAL ] ARR: No derivative data file found to delete. [2025-10-21T17:18:02.765837] [INFO ] [MAIN ] Update Progress: 151/2366 symbols completed. ARR took 39.4s. Estimated remaining: 4h 23m 44s. Rate: 8.4 symbols/min [2025-10-21T17:18:02.939154] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:02.939337] [DEBUG] [LOCAL ] ASB: No existing data file found in primary storage. [2025-10-21T17:18:02.939400] [WARN ] [MAIN ] ASB: No existing data found, performing full refresh instead. [2025-10-21T17:18:02.939508] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-21T17:18:02.939549] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-21T17:18:02.939589] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-21T17:18:02.939619] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-21T17:18:03.295697] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:03.351023] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-21T17:18:03.584829] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T17:18:04.151010] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-21T17:18:04.359311] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:18:04.951027] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-21T17:18:05.094739] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:18:05.749518] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T17:18:05.759768] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-21T17:18:05.851107] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T17:18:06.551051] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-21T17:18:07.351048] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-21T17:18:07.378142] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:18:07.632414] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:18:08.151010] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-21T17:18:08.865978] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T17:18:08.951033] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-21T17:18:09.751024] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-21T17:18:09.884926] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T17:18:09.886356] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:18:10.551000] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-21T17:18:11.351083] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-21T17:18:11.436435] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:18:12.011433] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T17:18:12.150986] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-21T17:18:12.330449] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T17:18:12.951016] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-21T17:18:13.751002] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-21T17:18:14.235971] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T17:18:14.287146] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T17:18:14.551023] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-21T17:18:15.351032] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-21T17:18:15.925321] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-21T17:18:16.151132] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-21T17:18:16.351140] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:18:16.951081] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-21T17:18:17.313182] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T17:18:17.750996] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-21T17:18:17.791347] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:18:18.551089] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-21T17:18:18.838498] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T17:18:19.351106] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-21T17:18:19.473134] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T17:18:19.477623] [INFO ] [REMOTE ] ASA: Full fetch complete (20731 records). [2025-10-21T17:18:19.477800] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-21T17:18:19.868769] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-21T17:18:19.868976] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-21T17:18:19.869371] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-21T17:18:19.869452] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-21T17:18:19.870579] [DEBUG] [LOCAL ] ASA: Trimmed 20731 records to 15663 (keeping 200 days of data) [2025-10-21T17:18:19.963614] [DEBUG] [LOCAL ] ASA: Primary data saved (15663 records). [2025-10-21T17:18:19.963932] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-21T17:18:19.964040] [INFO ] [MAIN ] Update Progress: 152/2366 symbols completed. ASA took 29.0s. Estimated remaining: 4h 26m 3s. Rate: 8.3 symbols/min [2025-10-21T17:18:20.179212] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:20.154243] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-21T17:18:20.182998] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T17:18:20.196890] [DEBUG] [LOCAL ] ASBA: Loaded 3520 existing records from primary storage. [2025-10-21T17:18:20.197331] [INFO ] [MAIN ] ASBA: Loaded 3520 existing records. [2025-10-21T17:18:20.379692] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:18:20.379931] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-21T17:18:20.379978] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-21T17:18:20.380146] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-21T17:18:20.380201] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-21T17:18:20.727833] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:20.951013] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-21T17:18:21.314214] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T17:18:21.692219] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T17:18:21.750998] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-21T17:18:21.801356] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:18:22.551058] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-21T17:18:23.157081] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T17:18:23.351052] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-21T17:18:23.583195] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:18:24.151063] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-21T17:18:24.704203] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T17:18:24.816225] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T17:18:24.951070] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-21T17:18:25.751044] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-21T17:18:26.551014] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-21T17:18:26.692589] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T17:18:26.700868] [INFO ] [REMOTE ] AS: Full fetch complete (76916 records). [2025-10-21T17:18:26.700994] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-21T17:18:27.094327] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-21T17:18:27.094415] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-21T17:18:27.095168] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-21T17:18:27.095234] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-21T17:18:27.096618] [DEBUG] [LOCAL ] AS: Trimmed 76916 records to 53198 (keeping 200 days of data) [2025-10-21T17:18:27.363618] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-21T17:18:27.413994] [DEBUG] [LOCAL ] AS: Primary data saved (53198 records). [2025-10-21T17:18:27.427693] [INFO ] [MAIN ] AS: Full history saved. [2025-10-21T17:18:27.437699] [INFO ] [MAIN ] Update Progress: 153/2366 symbols completed. AS took 36.9s. Estimated remaining: 4h 25m 59s. Rate: 8.3 symbols/min [2025-10-21T17:18:27.451422] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T17:18:27.623512] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:27.623700] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-10-21T17:18:27.623749] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-10-21T17:18:27.623860] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-21T17:18:27.623900] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-21T17:18:27.623940] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-21T17:18:27.623971] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-21T17:18:27.973459] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:28.021507] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T17:18:28.150982] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-21T17:18:28.493263] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T17:18:28.951019] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-21T17:18:29.751011] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-21T17:18:29.826602] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:18:30.089771] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T17:18:30.556091] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-21T17:18:30.570586] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:18:31.351036] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-21T17:18:31.816924] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T17:18:32.151030] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-21T17:18:32.206556] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T17:18:32.215139] [INFO ] [REMOTE ] ASAN: Full fetch complete (76633 records). [2025-10-21T17:18:32.215287] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-21T17:18:32.616850] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-21T17:18:32.616955] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-21T17:18:32.617768] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-21T17:18:32.617835] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-21T17:18:32.619310] [DEBUG] [LOCAL ] ASAN: Trimmed 76633 records to 52732 (keeping 200 days of data) [2025-10-21T17:18:32.922872] [DEBUG] [LOCAL ] ASAN: Primary data saved (52732 records). [2025-10-21T17:18:32.922995] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-21T17:18:32.923884] [INFO ] [MAIN ] Update Progress: 154/2366 symbols completed. ASAN took 38.3s. Estimated remaining: 4h 25m 27s. Rate: 8.3 symbols/min [2025-10-21T17:18:32.956070] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-21T17:18:33.099884] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:33.120618] [DEBUG] [LOCAL ] ASG: Loaded 19504 existing records from primary storage. [2025-10-21T17:18:33.120901] [INFO ] [MAIN ] ASG: Loaded 19504 existing records. [2025-10-21T17:18:33.308897] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:18:33.309124] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-21T17:18:33.309172] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-21T17:18:33.309399] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-21T17:18:33.309439] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-21T17:18:33.704432] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:33.751018] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-21T17:18:33.892165] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T17:18:34.330567] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T17:18:34.550992] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-21T17:18:34.888168] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T17:18:34.896404] [INFO ] [REMOTE ] ASB: Full fetch complete (72151 records). [2025-10-21T17:18:34.896548] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-21T17:18:35.289399] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-21T17:18:35.289483] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-21T17:18:35.290233] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-21T17:18:35.290296] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-21T17:18:35.291703] [DEBUG] [LOCAL ] ASB: Trimmed 72151 records to 49698 (keeping 200 days of data) [2025-10-21T17:18:35.352329] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-21T17:18:35.588057] [DEBUG] [LOCAL ] ASB: Primary data saved (49698 records). [2025-10-21T17:18:35.588237] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-21T17:18:35.588348] [INFO ] [MAIN ] Update Progress: 155/2366 symbols completed. ASB took 32.8s. Estimated remaining: 4h 24m 16s. Rate: 8.4 symbols/min [2025-10-21T17:18:35.767560] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:35.789555] [DEBUG] [LOCAL ] ASGI: Loaded 23006 existing records from primary storage. [2025-10-21T17:18:35.789809] [INFO ] [MAIN ] ASGI: Loaded 23006 existing records. [2025-10-21T17:18:35.897383] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T17:18:35.935082] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T17:18:35.996379] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:18:35.996609] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-21T17:18:35.996680] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-21T17:18:35.996949] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-21T17:18:35.997005] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-21T17:18:36.156668] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-21T17:18:36.352494] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:36.753746] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T17:18:36.951040] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-21T17:18:37.751008] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-21T17:18:38.309085] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T17:18:38.551080] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-21T17:18:38.670756] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:18:39.351022] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-21T17:18:39.770333] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T17:18:40.151106] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-21T17:18:40.649854] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:18:40.932525] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T17:18:40.934946] [INFO ] [REMOTE ] ASBA: Full fetch complete (5257 records). [2025-10-21T17:18:40.935156] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-21T17:18:40.956898] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-21T17:18:41.300534] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-21T17:18:41.300610] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-21T17:18:41.300781] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-21T17:18:41.300840] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-21T17:18:41.301188] [DEBUG] [LOCAL ] ASBA: Trimmed 5257 records to 3501 (keeping 200 days of data) [2025-10-21T17:18:41.322001] [DEBUG] [LOCAL ] ASBA: Primary data saved (3501 records). [2025-10-21T17:18:41.322060] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-21T17:18:41.322123] [INFO ] [MAIN ] Update Progress: 156/2366 symbols completed. ASBA took 21.4s. Estimated remaining: 4h 23m 48s. Rate: 8.4 symbols/min [2025-10-21T17:18:41.485541] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:18:41.517236] [DEBUG] [LOCAL ] ASGN: Loaded 36724 existing records from primary storage. [2025-10-21T17:18:41.517498] [INFO ] [MAIN ] ASGN: Loaded 36724 existing records. [2025-10-21T17:18:41.690915] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:18:41.691133] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-21T17:18:41.691179] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-21T17:18:41.691509] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-21T17:18:41.691547] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-21T17:18:41.756186] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-21T17:18:42.047127] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:18:42.551062] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-21T17:18:43.008700] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T17:18:43.351111] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-21T17:18:43.543198] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:18:44.135077] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:18:44.150999] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-21T17:18:44.805319] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:18:44.951036] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-21T17:18:45.098919] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:18:45.751055] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-21T17:18:46.191046] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T17:18:46.551055] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-21T17:18:46.692872] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T17:18:47.351062] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-21T17:18:48.004553] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T17:18:48.151048] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-21T17:18:48.421062] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T17:18:48.876300] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T17:18:48.951058] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-21T17:18:49.751047] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-21T17:18:50.102310] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:18:50.551066] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-21T17:18:51.225891] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T17:18:51.351186] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-21T17:18:51.510788] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T17:18:52.151048] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-21T17:18:52.904594] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T17:18:52.951010] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-21T17:18:53.230123] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T17:18:53.751074] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-21T17:18:54.551006] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-21T17:18:54.582620] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:18:55.285944] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T17:18:55.348372] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T17:18:55.353576] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-21T17:18:56.151051] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-21T17:18:56.930818] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:18:56.950991] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-21T17:18:57.284299] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T17:18:57.751020] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-21T17:18:58.316426] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T17:18:58.551010] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-21T17:18:58.922382] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T17:18:59.311437] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:18:59.351109] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-21T17:19:00.151065] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-21T17:19:00.335095] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T17:19:00.951045] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-21T17:19:01.716871] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T17:19:01.750992] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-21T17:19:02.378953] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:19:02.383048] [INFO ] [REMOTE ] ASGI: Full fetch complete (33174 records). [2025-10-21T17:19:02.383173] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-21T17:19:02.552437] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-21T17:19:02.769927] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-21T17:19:02.770027] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-21T17:19:02.770424] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-21T17:19:02.770466] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-21T17:19:02.771265] [DEBUG] [LOCAL ] ASGI: Trimmed 33174 records to 23005 (keeping 200 days of data) [2025-10-21T17:19:02.913442] [DEBUG] [LOCAL ] ASGI: Primary data saved (23005 records). [2025-10-21T17:19:02.913809] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-21T17:19:02.913945] [INFO ] [MAIN ] Update Progress: 157/2366 symbols completed. ASGI took 27.3s. Estimated remaining: 4h 27m 4s. Rate: 8.3 symbols/min [2025-10-21T17:19:02.935002] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T17:19:02.941001] [INFO ] [REMOTE ] ASC: Full fetch complete (55813 records). [2025-10-21T17:19:02.941150] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-21T17:19:02.941791] [FATAL] [VALIDATOR ] ASC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:19:02.941880] [FATAL] [MAIN ] ASC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:19:02.941922] [WARN ] [MAIN ] ASC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:19:02.941958] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-21T17:19:02.942014] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-21T17:19:02.942049] [INFO ] [LOCAL ] ASC: Starting deletion of derivative data. [2025-10-21T17:19:02.942086] [DEBUG] [LOCAL ] ASC: No derivative data file found to delete. [2025-10-21T17:19:02.942140] [INFO ] [MAIN ] Update Progress: 158/2366 symbols completed. ASC took 35.5s. Estimated remaining: 4h 25m 16s. Rate: 8.3 symbols/min [2025-10-21T17:19:03.351117] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-21T17:19:03.473579] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T17:19:03.479310] [INFO ] [REMOTE ] ASG: Full fetch complete (30847 records). [2025-10-21T17:19:03.479552] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-21T17:19:03.884891] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-21T17:19:03.885062] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-21T17:19:03.885701] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-21T17:19:03.885772] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-21T17:19:03.886727] [DEBUG] [LOCAL ] ASG: Trimmed 30847 records to 19380 (keeping 200 days of data) [2025-10-21T17:19:04.003373] [DEBUG] [LOCAL ] ASG: Primary data saved (19380 records). [2025-10-21T17:19:04.003627] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-21T17:19:04.003834] [INFO ] [MAIN ] Update Progress: 159/2366 symbols completed. ASG took 31.1s. Estimated remaining: 4h 23m 43s. Rate: 8.4 symbols/min [2025-10-21T17:19:04.858938] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T17:19:04.867599] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-21T17:19:06.264340] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:19:06.273004] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-21T17:19:07.609726] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T17:19:07.618036] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-21T17:19:09.089221] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T17:19:09.097571] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-21T17:19:10.676789] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T17:19:10.683563] [INFO ] [REMOTE ] ASGN: Full fetch complete (53492 records). [2025-10-21T17:19:10.683755] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-21T17:19:11.070170] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-21T17:19:11.070254] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-21T17:19:11.070835] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-21T17:19:11.070896] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-21T17:19:11.071989] [DEBUG] [LOCAL ] ASGN: Trimmed 53492 records to 36654 (keeping 200 days of data) [2025-10-21T17:19:11.276496] [DEBUG] [LOCAL ] ASGN: Primary data saved (36654 records). [2025-10-21T17:19:11.276628] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-21T17:19:11.276740] [INFO ] [MAIN ] Update Progress: 160/2366 symbols completed. ASGN took 30.0s. Estimated remaining: 4h 23m 37s. Rate: 8.4 symbols/min [2025-10-21T17:19:12.010189] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:12.003671] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:12.058868] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:12.066289] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:12.067076] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-10-21T17:19:12.067137] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-10-21T17:19:12.069696] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-21T17:19:12.069773] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-21T17:19:12.069834] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-21T17:19:12.069903] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-21T17:19:12.218075] [DEBUG] [LOCAL ] ASIX: Loaded 23205 existing records from primary storage. [2025-10-21T17:19:12.254200] [INFO ] [MAIN ] ASIX: Loaded 23205 existing records. [2025-10-21T17:19:12.276615] [DEBUG] [LOCAL ] ASPN: Loaded 49915 existing records from primary storage. [2025-10-21T17:19:12.265703] [DEBUG] [LOCAL ] ASH: Loaded 37563 existing records from primary storage. [2025-10-21T17:19:12.326258] [INFO ] [MAIN ] ASPN: Loaded 49915 existing records. [2025-10-21T17:19:12.340607] [INFO ] [MAIN ] ASH: Loaded 37563 existing records. [2025-10-21T17:19:13.007687] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:12.972774] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:13.031246] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-21T17:19:13.018488] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-21T17:19:13.054019] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-21T17:19:13.058579] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:13.059377] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-21T17:19:13.064796] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-21T17:19:13.070046] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-21T17:19:13.075321] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-21T17:19:13.064711] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-21T17:19:13.110370] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-21T17:19:13.118015] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-21T17:19:13.199371] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:13.219922] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-21T17:19:13.241357] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-21T17:19:13.253549] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-21T17:19:14.259275] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:14.303748] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-21T17:19:14.312300] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:14.319103] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:19:14.316667] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:14.322499] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-21T17:19:14.322125] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-21T17:19:14.323216] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-21T17:19:15.089148] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:19:15.091175] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-21T17:19:15.397638] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T17:19:15.401601] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-21T17:19:15.555050] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:19:15.562836] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-21T17:19:15.925783] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T17:19:15.927815] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-21T17:19:16.139314] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T17:19:16.149319] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-21T17:19:16.371476] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:19:16.375188] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-21T17:19:16.670445] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T17:19:16.673381] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-21T17:19:17.424314] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T17:19:17.433996] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T17:19:17.444590] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-21T17:19:17.620875] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:19:17.751021] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-21T17:19:17.804666] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:19:18.551026] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-21T17:19:18.730432] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T17:19:19.021829] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:19:19.351054] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-21T17:19:20.151016] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-21T17:19:20.250825] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T17:19:20.296236] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T17:19:20.951036] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-21T17:19:21.158282] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T17:19:21.751007] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-21T17:19:22.461733] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:19:22.550993] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-21T17:19:22.633983] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T17:19:23.351038] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-21T17:19:24.151013] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-21T17:19:24.174341] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T17:19:24.250711] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:19:24.951037] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-21T17:19:25.083867] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T17:19:25.471115] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-21T17:19:25.751008] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-21T17:19:26.551048] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-21T17:19:27.145032] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T17:19:27.351033] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-21T17:19:28.151025] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-21T17:19:28.294512] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:19:28.956113] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-21T17:19:28.970855] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T17:19:29.191735] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T17:19:29.751026] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-21T17:19:30.551007] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-21T17:19:30.772622] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T17:19:30.929800] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T17:19:31.351053] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-21T17:19:31.448738] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T17:19:32.150996] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-21T17:19:32.516975] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T17:19:32.521153] [INFO ] [REMOTE ] ASIX: Full fetch complete (31031 records). [2025-10-21T17:19:32.521257] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-21T17:19:32.960781] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-21T17:19:32.978273] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-21T17:19:32.979794] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-21T17:19:32.980500] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-21T17:19:32.980572] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-21T17:19:32.981856] [DEBUG] [LOCAL ] ASIX: Trimmed 31031 records to 23106 (keeping 200 days of data) [2025-10-21T17:19:33.097605] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T17:19:33.106960] [INFO ] [REMOTE ] ASR: Full fetch complete (12571 records). [2025-10-21T17:19:33.110735] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-21T17:19:33.545580] [DEBUG] [LOCAL ] ASIX: Primary data saved (23106 records). [2025-10-21T17:19:33.545826] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-21T17:19:33.546423] [INFO ] [MAIN ] Update Progress: 161/2366 symbols completed. ASIX took 22.3s. Estimated remaining: 4h 26m 57s. Rate: 8.3 symbols/min [2025-10-21T17:19:33.757143] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-21T17:19:33.777302] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-21T17:19:33.808229] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-21T17:19:33.808630] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-21T17:19:33.808737] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-21T17:19:33.831147] [DEBUG] [LOCAL ] ASR: Trimmed 12571 records to 9484 (keeping 200 days of data) [2025-10-21T17:19:33.950747] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:33.969445] [DEBUG] [LOCAL ] ASR: Primary data saved (9484 records). [2025-10-21T17:19:33.969636] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-21T17:19:33.969939] [INFO ] [MAIN ] Update Progress: 162/2366 symbols completed. ASR took 22.7s. Estimated remaining: 4h 25m 17s. Rate: 8.3 symbols/min [2025-10-21T17:19:34.162217] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:34.179419] [DEBUG] [LOCAL ] ASX: Loaded 52882 existing records from primary storage. [2025-10-21T17:19:34.179811] [INFO ] [MAIN ] ASX: Loaded 52882 existing records. [2025-10-21T17:19:34.380019] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:34.391860] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-21T17:19:34.392118] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-21T17:19:34.392727] [DEBUG] [LOCAL ] ATEN: Loaded 38022 existing records from primary storage. [2025-10-21T17:19:34.392923] [INFO ] [MAIN ] ATEN: Loaded 38022 existing records. [2025-10-21T17:19:34.424689] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-21T17:19:34.448285] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-21T17:19:34.660717] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:34.677505] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-21T17:19:34.677824] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-21T17:19:34.693710] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-21T17:19:34.704124] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-21T17:19:35.156070] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-21T17:19:35.217130] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:35.237053] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-21T17:19:35.347550] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:35.350980] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-21T17:19:35.402489] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T17:19:36.151073] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-21T17:19:36.804997] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:19:36.951093] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-21T17:19:37.210627] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T17:19:37.599994] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T17:19:37.751099] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-21T17:19:38.243286] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:19:38.551060] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-21T17:19:39.351002] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-21T17:19:39.600436] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T17:19:40.151055] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-21T17:19:40.465361] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:19:40.718794] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:19:40.951049] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-21T17:19:41.756187] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-21T17:19:41.777862] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T17:19:41.788867] [INFO ] [REMOTE ] ASPN: Full fetch complete (72613 records). [2025-10-21T17:19:41.789104] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-21T17:19:42.245510] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-21T17:19:42.245664] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-21T17:19:42.246797] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-21T17:19:42.246891] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-21T17:19:42.249324] [DEBUG] [LOCAL ] ASPN: Trimmed 72613 records to 49890 (keeping 200 days of data) [2025-10-21T17:19:42.558188] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-21T17:19:42.566906] [DEBUG] [LOCAL ] ASPN: Primary data saved (49890 records). [2025-10-21T17:19:42.567293] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-21T17:19:42.567486] [INFO ] [MAIN ] Update Progress: 163/2366 symbols completed. ASPN took 31.3s. Estimated remaining: 4h 25m 28s. Rate: 8.3 symbols/min [2025-10-21T17:19:42.767965] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:42.768364] [DEBUG] [LOCAL ] ATGE: No existing data file found in primary storage. [2025-10-21T17:19:42.768475] [WARN ] [MAIN ] ATGE: No existing data found, performing full refresh instead. [2025-10-21T17:19:42.769480] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-21T17:19:42.769528] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-21T17:19:42.769569] [DEBUG] [LOCAL ] ATGE: No primary data file found to delete. [2025-10-21T17:19:42.769602] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-21T17:19:43.004928] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T17:19:43.231101] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:43.351075] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-21T17:19:43.517442] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:19:44.151025] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-21T17:19:44.216906] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:19:44.877720] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:19:44.951061] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-21T17:19:45.758535] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-21T17:19:45.775052] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T17:19:45.903835] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:19:46.551027] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-21T17:19:47.284545] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:19:47.290558] [INFO ] [REMOTE ] ASH: Full fetch complete (55440 records). [2025-10-21T17:19:47.290675] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-21T17:19:47.291293] [FATAL] [VALIDATOR ] ASH: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:19:47.291389] [FATAL] [MAIN ] ASH: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:19:47.291430] [WARN ] [MAIN ] ASH: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:19:47.291499] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-21T17:19:47.291560] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-10-21T17:19:47.291595] [INFO ] [LOCAL ] ASH: Starting deletion of derivative data. [2025-10-21T17:19:47.291747] [DEBUG] [LOCAL ] ASH: Deleted derivative data file. [2025-10-21T17:19:47.291832] [INFO ] [MAIN ] Update Progress: 164/2366 symbols completed. ASH took 36.0s. Estimated remaining: 4h 24m 47s. Rate: 8.3 symbols/min [2025-10-21T17:19:47.356290] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-21T17:19:47.491136] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:19:47.525047] [DEBUG] [LOCAL ] ATHM: Loaded 31516 existing records from primary storage. [2025-10-21T17:19:47.525361] [INFO ] [MAIN ] ATHM: Loaded 31516 existing records. [2025-10-21T17:19:47.698167] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:19:47.698343] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-21T17:19:47.698389] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-21T17:19:47.698985] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-21T17:19:47.699042] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-21T17:19:48.066136] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:19:48.150974] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-21T17:19:48.567892] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T17:19:48.951003] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-21T17:19:49.007441] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:19:49.721075] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:19:49.751068] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-21T17:19:50.126744] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T17:19:50.551043] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-21T17:19:51.351036] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-21T17:19:51.601424] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T17:19:51.836835] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T17:19:52.151028] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-21T17:19:52.790254] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:19:52.951016] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-21T17:19:53.252692] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T17:19:53.751049] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-21T17:19:54.438437] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:19:54.551040] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-21T17:19:55.258735] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:19:55.351037] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-21T17:19:55.952699] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:19:56.151123] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-21T17:19:56.421067] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T17:19:56.951080] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-21T17:19:57.618636] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T17:19:57.751071] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-21T17:19:58.405948] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:19:58.550992] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-21T17:19:59.351016] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-21T17:19:59.696982] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T17:19:59.726213] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T17:20:00.151035] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-21T17:20:00.678535] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T17:20:00.951040] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-21T17:20:01.751009] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-21T17:20:02.056459] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T17:20:02.282340] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:20:02.551053] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-21T17:20:02.610890] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T17:20:03.351029] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-21T17:20:04.041096] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T17:20:04.151006] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-21T17:20:04.577698] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T17:20:04.951044] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-21T17:20:05.297212] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T17:20:05.751019] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-21T17:20:06.551021] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-21T17:20:06.577828] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:20:07.141524] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T17:20:07.146937] [INFO ] [REMOTE ] ATEN: Full fetch complete (56737 records). [2025-10-21T17:20:07.147067] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-21T17:20:07.358371] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-21T17:20:07.529813] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-21T17:20:07.529893] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-21T17:20:07.530507] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-21T17:20:07.530548] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-21T17:20:07.531724] [DEBUG] [LOCAL ] ATEN: Trimmed 56737 records to 37831 (keeping 200 days of data) [2025-10-21T17:20:07.754541] [DEBUG] [LOCAL ] ATEN: Primary data saved (37831 records). [2025-10-21T17:20:07.754748] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-21T17:20:07.754850] [INFO ] [MAIN ] Update Progress: 165/2366 symbols completed. ATEN took 33.8s. Estimated remaining: 4h 27m 37s. Rate: 8.2 symbols/min [2025-10-21T17:20:07.935901] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:07.945138] [DEBUG] [LOCAL ] ATHS: Loaded 6572 existing records from primary storage. [2025-10-21T17:20:07.945388] [INFO ] [MAIN ] ATHS: Loaded 6572 existing records. [2025-10-21T17:20:08.135153] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:08.135467] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-21T17:20:08.135533] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-21T17:20:08.135871] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-21T17:20:08.135937] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-21T17:20:08.167872] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-21T17:20:08.537849] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:08.570465] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T17:20:08.704395] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T17:20:08.950996] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-21T17:20:09.331792] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T17:20:09.751043] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-21T17:20:10.221075] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:20:10.225748] [INFO ] [REMOTE ] ATGE: Full fetch complete (45707 records). [2025-10-21T17:20:10.225869] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-21T17:20:10.564906] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-21T17:20:10.641247] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-21T17:20:10.641335] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-21T17:20:10.641923] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-21T17:20:10.641992] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-21T17:20:10.642954] [DEBUG] [LOCAL ] ATGE: Trimmed 45707 records to 30618 (keeping 200 days of data) [2025-10-21T17:20:10.823099] [DEBUG] [LOCAL ] ATGE: Primary data saved (30618 records). [2025-10-21T17:20:10.823218] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-21T17:20:10.823289] [INFO ] [MAIN ] Update Progress: 166/2366 symbols completed. ATGE took 28.3s. Estimated remaining: 4h 26m 33s. Rate: 8.3 symbols/min [2025-10-21T17:20:10.991775] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:11.038405] [DEBUG] [LOCAL ] ATI: Loaded 51311 existing records from primary storage. [2025-10-21T17:20:11.038755] [INFO ] [MAIN ] ATI: Loaded 51311 existing records. [2025-10-21T17:20:11.213946] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:11.214154] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-21T17:20:11.214208] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-21T17:20:11.214795] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-21T17:20:11.214855] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-21T17:20:11.359584] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-21T17:20:11.464583] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T17:20:11.598713] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:11.789411] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T17:20:11.797966] [INFO ] [REMOTE ] ASX: Full fetch complete (76793 records). [2025-10-21T17:20:11.798105] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-21T17:20:12.156175] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-21T17:20:12.214465] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-21T17:20:12.214560] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-21T17:20:12.215335] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-21T17:20:12.215399] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-21T17:20:12.217047] [DEBUG] [LOCAL ] ASX: Trimmed 76793 records to 52881 (keeping 200 days of data) [2025-10-21T17:20:12.532788] [DEBUG] [LOCAL ] ASX: Primary data saved (52881 records). [2025-10-21T17:20:12.532932] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-21T17:20:12.533014] [INFO ] [MAIN ] Update Progress: 167/2366 symbols completed. ASX took 39.0s. Estimated remaining: 4h 25m 13s. Rate: 8.3 symbols/min [2025-10-21T17:20:12.711205] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:12.746453] [DEBUG] [LOCAL ] ATKR: Loaded 35028 existing records from primary storage. [2025-10-21T17:20:12.746797] [INFO ] [MAIN ] ATKR: Loaded 35028 existing records. [2025-10-21T17:20:12.922721] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:12.922976] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-21T17:20:12.923034] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-21T17:20:12.923619] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-21T17:20:12.923707] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-21T17:20:12.956238] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-21T17:20:13.281715] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:13.531152] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T17:20:13.751079] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-21T17:20:14.485551] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T17:20:14.551058] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-21T17:20:14.956810] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (3.60 seconds). [2025-10-21T17:20:14.961444] [INFO ] [REMOTE ] ATHM: Full fetch complete (49597 records). [2025-10-21T17:20:14.961545] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-21T17:20:15.306001] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T17:20:15.361861] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-21T17:20:15.362708] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-21T17:20:15.363346] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-21T17:20:15.363464] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-21T17:20:15.364638] [DEBUG] [LOCAL ] ATHM: Trimmed 49597 records to 31322 (keeping 200 days of data) [2025-10-21T17:20:15.361678] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-21T17:20:15.570340] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (3.41 seconds). [2025-10-21T17:20:15.591712] [DEBUG] [LOCAL ] ATHM: Primary data saved (31322 records). [2025-10-21T17:20:15.591848] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-21T17:20:15.592510] [INFO ] [MAIN ] Update Progress: 168/2366 symbols completed. ATHM took 28.3s. Estimated remaining: 4h 24m 11s. Rate: 8.3 symbols/min [2025-10-21T17:20:15.761704] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:15.797964] [DEBUG] [LOCAL ] ATMU: Loaded 38808 existing records from primary storage. [2025-10-21T17:20:15.798262] [INFO ] [MAIN ] ATMU: Loaded 38808 existing records. [2025-10-21T17:20:15.975284] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:15.975493] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-21T17:20:15.975538] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-21T17:20:15.976219] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-21T17:20:15.976277] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-21T17:20:16.156144] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-21T17:20:16.336768] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:16.924345] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:20:16.950998] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-21T17:20:16.980357] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T17:20:17.751042] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-21T17:20:18.471263] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T17:20:18.551030] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-21T17:20:18.995482] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T17:20:19.280526] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-21T17:20:19.351040] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-21T17:20:20.151026] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-21T17:20:20.832055] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:20:20.866822] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T17:20:20.951021] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-21T17:20:21.751032] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-21T17:20:22.360455] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T17:20:22.492437] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T17:20:22.551031] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-21T17:20:23.351016] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-21T17:20:24.151007] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-21T17:20:24.359437] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T17:20:24.736136] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:20:24.871921] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T17:20:24.873609] [INFO ] [REMOTE ] ATHS: Full fetch complete (9622 records). [2025-10-21T17:20:24.873720] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-21T17:20:24.956144] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-21T17:20:25.258875] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-21T17:20:25.258954] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-21T17:20:25.259178] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-21T17:20:25.259236] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-21T17:20:25.259688] [DEBUG] [LOCAL ] ATHS: Trimmed 9622 records to 6564 (keeping 200 days of data) [2025-10-21T17:20:25.298337] [DEBUG] [LOCAL ] ATHS: Primary data saved (6564 records). [2025-10-21T17:20:25.298447] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-21T17:20:25.298523] [INFO ] [MAIN ] Update Progress: 169/2366 symbols completed. ATHS took 17.5s. Estimated remaining: 4h 24m 36s. Rate: 8.3 symbols/min [2025-10-21T17:20:25.470013] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:25.509629] [DEBUG] [LOCAL ] ATO: Loaded 41744 existing records from primary storage. [2025-10-21T17:20:25.509961] [INFO ] [MAIN ] ATO: Loaded 41744 existing records. [2025-10-21T17:20:25.694239] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:25.694481] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-21T17:20:25.694539] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-21T17:20:25.695462] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-21T17:20:25.695538] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-21T17:20:25.757277] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-21T17:20:26.165125] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:26.551107] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-21T17:20:26.742246] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:20:27.351074] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-21T17:20:27.398542] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T17:20:28.151036] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-21T17:20:28.188183] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:20:28.951053] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-21T17:20:29.044567] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:20:29.751070] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-21T17:20:29.823637] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T17:20:30.051337] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T17:20:30.550991] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-21T17:20:31.216340] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T17:20:31.351056] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-21T17:20:31.761137] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T17:20:32.151079] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-21T17:20:32.951060] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-21T17:20:33.124311] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T17:20:33.241258] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T17:20:33.751070] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-21T17:20:34.200730] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:20:34.551109] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-21T17:20:35.351044] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-21T17:20:35.439867] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T17:20:36.097058] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:20:36.150980] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-21T17:20:36.656487] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:20:36.951066] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-21T17:20:37.262993] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:20:37.751081] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-21T17:20:38.551005] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-21T17:20:38.673888] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:20:39.351013] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-21T17:20:39.546532] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:20:39.979963] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:20:39.985180] [INFO ] [REMOTE ] ATKR: Full fetch complete (53210 records). [2025-10-21T17:20:39.985270] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-21T17:20:40.153473] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-21T17:20:40.374927] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-21T17:20:40.375037] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-21T17:20:40.375719] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-21T17:20:40.375805] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-21T17:20:40.395091] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:20:40.394361] [DEBUG] [LOCAL ] ATKR: Trimmed 53210 records to 34887 (keeping 200 days of data) [2025-10-21T17:20:40.613883] [DEBUG] [LOCAL ] ATKR: Primary data saved (34887 records). [2025-10-21T17:20:40.614012] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-21T17:20:40.614089] [INFO ] [MAIN ] Update Progress: 170/2366 symbols completed. ATKR took 28.1s. Estimated remaining: 4h 26m 13s. Rate: 8.2 symbols/min [2025-10-21T17:20:40.803736] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:40.832981] [DEBUG] [LOCAL ] ATR: Loaded 30554 existing records from primary storage. [2025-10-21T17:20:40.833238] [INFO ] [MAIN ] ATR: Loaded 30554 existing records. [2025-10-21T17:20:40.956215] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-21T17:20:41.015937] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:41.016082] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-21T17:20:41.016126] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-21T17:20:41.016702] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-21T17:20:41.016758] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-21T17:20:41.384427] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:41.756874] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-21T17:20:41.771264] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:20:42.147822] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T17:20:42.551038] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-21T17:20:43.111779] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T17:20:43.351037] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-21T17:20:44.151012] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-21T17:20:44.212633] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:20:44.768967] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:20:44.951011] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-21T17:20:45.663470] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:20:45.750993] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-21T17:20:46.212293] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T17:20:46.551037] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-21T17:20:47.351089] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-21T17:20:47.584170] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T17:20:47.787361] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:20:48.151024] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-21T17:20:48.951056] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-21T17:20:49.157881] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T17:20:49.500861] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:20:49.751027] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-21T17:20:50.551015] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-21T17:20:50.589034] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T17:20:51.063033] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:20:51.351022] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-21T17:20:52.041613] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:20:52.049758] [INFO ] [REMOTE ] ATMU: Full fetch complete (56880 records). [2025-10-21T17:20:52.049866] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-21T17:20:52.151105] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-21T17:20:52.435070] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-21T17:20:52.435142] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-21T17:20:52.435744] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-21T17:20:52.435807] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-21T17:20:52.436868] [DEBUG] [LOCAL ] ATMU: Trimmed 56880 records to 38780 (keeping 200 days of data) [2025-10-21T17:20:52.664608] [DEBUG] [LOCAL ] ATMU: Primary data saved (38780 records). [2025-10-21T17:20:52.664753] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-21T17:20:52.664837] [INFO ] [MAIN ] Update Progress: 171/2366 symbols completed. ATMU took 37.1s. Estimated remaining: 4h 27m 8s. Rate: 8.2 symbols/min [2025-10-21T17:20:52.835429] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:52.851235] [DEBUG] [LOCAL ] ATS: Loaded 17325 existing records from primary storage. [2025-10-21T17:20:52.851441] [INFO ] [MAIN ] ATS: Loaded 17325 existing records. [2025-10-21T17:20:52.952333] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-21T17:20:53.037197] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:53.037447] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-21T17:20:53.037521] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-21T17:20:53.038175] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-21T17:20:53.038325] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-21T17:20:53.175212] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T17:20:53.447789] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:53.659596] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T17:20:53.750999] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-21T17:20:54.552098] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-21T17:20:54.553765] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:20:54.560935] [INFO ] [REMOTE ] ATO: Full fetch complete (60736 records). [2025-10-21T17:20:54.561081] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-21T17:20:54.955580] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-21T17:20:54.955744] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-21T17:20:54.956420] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-21T17:20:54.956515] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-21T17:20:54.957932] [DEBUG] [LOCAL ] ATO: Trimmed 60736 records to 41624 (keeping 200 days of data) [2025-10-21T17:20:55.114279] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T17:20:55.258913] [DEBUG] [LOCAL ] ATO: Primary data saved (41624 records). [2025-10-21T17:20:55.259031] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-21T17:20:55.259104] [INFO ] [MAIN ] Update Progress: 172/2366 symbols completed. ATO took 30.0s. Estimated remaining: 4h 26m 0s. Rate: 8.2 symbols/min [2025-10-21T17:20:55.356204] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-21T17:20:55.429615] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:55.473587] [DEBUG] [LOCAL ] ATUS: Loaded 49947 existing records from primary storage. [2025-10-21T17:20:55.473917] [INFO ] [MAIN ] ATUS: Loaded 49947 existing records. [2025-10-21T17:20:55.669085] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:55.669304] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-21T17:20:55.669353] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-21T17:20:55.670237] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-21T17:20:55.670295] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-21T17:20:56.035786] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:56.055748] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T17:20:56.151000] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-21T17:20:56.951057] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-21T17:20:57.037202] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T17:20:57.045946] [INFO ] [REMOTE ] ATI: Full fetch complete (74042 records). [2025-10-21T17:20:57.046173] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-21T17:20:57.461517] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-21T17:20:57.461606] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-21T17:20:57.462448] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-21T17:20:57.462520] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-21T17:20:57.464006] [DEBUG] [LOCAL ] ATI: Trimmed 74042 records to 51304 (keeping 200 days of data) [2025-10-21T17:20:57.763286] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-21T17:20:57.784786] [DEBUG] [LOCAL ] ATI: Primary data saved (51304 records). [2025-10-21T17:20:57.785072] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-21T17:20:57.785194] [INFO ] [MAIN ] Update Progress: 173/2366 symbols completed. ATI took 47.0s. Estimated remaining: 4h 24m 53s. Rate: 8.3 symbols/min [2025-10-21T17:20:57.990115] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:20:58.019330] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:20:58.047870] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T17:20:58.097139] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-21T17:20:58.097444] [INFO ] [MAIN ] AU: Loaded 53089 existing records. [2025-10-21T17:20:58.278459] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:20:58.278733] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-21T17:20:58.278797] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-21T17:20:58.279746] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-21T17:20:58.279807] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-21T17:20:58.556689] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-21T17:20:58.650497] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:20:58.903514] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:20:59.351085] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-21T17:20:59.700043] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:21:00.151012] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-21T17:21:00.228283] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:21:00.951062] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-21T17:21:01.751046] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-21T17:21:02.053942] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T17:21:02.551378] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-21T17:21:02.582990] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-21T17:21:02.771785] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T17:21:03.351072] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-21T17:21:04.156434] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-21T17:21:04.172077] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T17:21:04.658411] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T17:21:04.663462] [INFO ] [REMOTE ] ATR: Full fetch complete (43975 records). [2025-10-21T17:21:04.663623] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-21T17:21:04.952941] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-21T17:21:05.047393] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-21T17:21:05.047475] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-21T17:21:05.048202] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-21T17:21:05.048265] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-21T17:21:05.049562] [DEBUG] [LOCAL ] ATR: Trimmed 43975 records to 30495 (keeping 200 days of data) [2025-10-21T17:21:05.239411] [DEBUG] [LOCAL ] ATR: Primary data saved (30495 records). [2025-10-21T17:21:05.239547] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-21T17:21:05.239622] [INFO ] [MAIN ] Update Progress: 174/2366 symbols completed. ATR took 24.6s. Estimated remaining: 4h 24m 48s. Rate: 8.3 symbols/min [2025-10-21T17:21:05.410522] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:05.451203] [DEBUG] [LOCAL ] AUB: Loaded 45950 existing records from primary storage. [2025-10-21T17:21:05.451499] [INFO ] [MAIN ] AUB: Loaded 45950 existing records. [2025-10-21T17:21:05.636597] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:05.636811] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-21T17:21:05.636860] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-21T17:21:05.637529] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-21T17:21:05.637569] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-21T17:21:05.756114] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-21T17:21:06.007591] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:06.051330] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T17:21:06.551000] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-21T17:21:06.578050] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:21:06.822809] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T17:21:07.351046] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-21T17:21:07.972503] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T17:21:08.151041] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-21T17:21:08.883549] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T17:21:08.951081] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-21T17:21:09.751083] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-21T17:21:10.136051] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:21:10.204429] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T17:21:10.551074] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-21T17:21:10.892250] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:21:11.351021] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-21T17:21:12.072237] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T17:21:12.150987] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-21T17:21:12.951044] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-21T17:21:13.639620] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T17:21:13.751045] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-21T17:21:13.847968] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:21:14.551052] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-21T17:21:14.876283] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T17:21:15.351006] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-21T17:21:15.445176] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T17:21:16.030593] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-21T17:21:16.151045] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-21T17:21:16.786154] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T17:21:16.951043] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-21T17:21:17.738842] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T17:21:17.750971] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-21T17:21:18.551040] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-21T17:21:18.702394] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:21:19.351000] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-21T17:21:19.649005] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T17:21:20.121342] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T17:21:20.151028] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-21T17:21:20.561595] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-21T17:21:20.950996] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-21T17:21:21.353399] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T17:21:21.751042] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-21T17:21:22.551018] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-21T17:21:22.797428] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T17:21:23.356203] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-21T17:21:23.373626] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T17:21:23.842997] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T17:21:24.151023] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-21T17:21:24.951018] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-21T17:21:25.043627] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T17:21:25.258025] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T17:21:25.751071] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-21T17:21:26.551002] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-21T17:21:26.658300] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T17:21:26.676533] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:21:26.679089] [INFO ] [REMOTE ] ATS: Full fetch complete (25464 records). [2025-10-21T17:21:26.679185] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-21T17:21:27.097317] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-21T17:21:27.097473] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-21T17:21:27.097906] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-21T17:21:27.097970] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-21T17:21:27.098869] [DEBUG] [LOCAL ] ATS: Trimmed 25464 records to 17169 (keeping 200 days of data) [2025-10-21T17:21:27.203827] [DEBUG] [LOCAL ] ATS: Primary data saved (17169 records). [2025-10-21T17:21:27.203977] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-21T17:21:27.204061] [INFO ] [MAIN ] Update Progress: 175/2366 symbols completed. ATS took 34.5s. Estimated remaining: 4h 27m 45s. Rate: 8.2 symbols/min [2025-10-21T17:21:27.354493] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-21T17:21:27.373678] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:27.380127] [DEBUG] [LOCAL ] AUNA: Loaded 5212 existing records from primary storage. [2025-10-21T17:21:27.380328] [INFO ] [MAIN ] AUNA: Loaded 5212 existing records. [2025-10-21T17:21:27.560594] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:27.560841] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-21T17:21:27.560888] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-21T17:21:27.561160] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-21T17:21:27.561217] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-21T17:21:27.922062] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:28.151008] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-21T17:21:28.473489] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T17:21:28.677027] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-21T17:21:28.951036] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-21T17:21:29.043361] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:21:29.751063] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-21T17:21:30.550990] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-21T17:21:30.551978] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:21:30.560708] [INFO ] [REMOTE ] ATUS: Full fetch complete (71393 records). [2025-10-21T17:21:30.560896] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-21T17:21:30.955541] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-21T17:21:30.955615] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-21T17:21:30.956332] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-21T17:21:30.956392] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-21T17:21:30.957625] [DEBUG] [LOCAL ] ATUS: Trimmed 71393 records to 49928 (keeping 200 days of data) [2025-10-21T17:21:31.239407] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T17:21:31.269289] [DEBUG] [LOCAL ] ATUS: Primary data saved (49928 records). [2025-10-21T17:21:31.269492] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-21T17:21:31.269809] [INFO ] [MAIN ] Update Progress: 176/2366 symbols completed. ATUS took 36.0s. Estimated remaining: 4h 26m 57s. Rate: 8.2 symbols/min [2025-10-21T17:21:31.276707] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T17:21:31.354691] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-21T17:21:31.451942] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:31.488366] [DEBUG] [LOCAL ] AVA: Loaded 38503 existing records from primary storage. [2025-10-21T17:21:31.488664] [INFO ] [MAIN ] AVA: Loaded 38503 existing records. [2025-10-21T17:21:31.665716] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:31.665960] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-21T17:21:31.666006] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-21T17:21:31.666332] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-21T17:21:31.666388] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-21T17:21:32.023557] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:32.151021] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-21T17:21:32.951018] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-21T17:21:33.584698] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T17:21:33.587847] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T17:21:33.617197] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-21T17:21:33.625429] [INFO ] [REMOTE ] AU: Full fetch complete (76610 records). [2025-10-21T17:21:33.625563] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-21T17:21:33.765427] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-21T17:21:34.030616] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-21T17:21:34.030728] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-21T17:21:34.031498] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-21T17:21:34.031539] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-21T17:21:34.032916] [DEBUG] [LOCAL ] AU: Trimmed 76610 records to 53089 (keeping 200 days of data) [2025-10-21T17:21:34.381089] [DEBUG] [LOCAL ] AU: Primary data saved (53089 records). [2025-10-21T17:21:34.381253] [INFO ] [MAIN ] AU: Full history saved. [2025-10-21T17:21:34.382096] [INFO ] [MAIN ] Update Progress: 177/2366 symbols completed. AU took 36.6s. Estimated remaining: 4h 25m 58s. Rate: 8.2 symbols/min [2025-10-21T17:21:34.554666] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:34.553126] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-21T17:21:34.567421] [DEBUG] [LOCAL ] AVAL: Loaded 8528 existing records from primary storage. [2025-10-21T17:21:34.568089] [INFO ] [MAIN ] AVAL: Loaded 8528 existing records. [2025-10-21T17:21:34.753840] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:34.754071] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-21T17:21:34.754118] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-21T17:21:34.754519] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-21T17:21:34.754575] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-21T17:21:35.118770] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:35.181903] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:21:35.351033] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-21T17:21:36.021472] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T17:21:36.029096] [INFO ] [REMOTE ] AUB: Full fetch complete (66311 records). [2025-10-21T17:21:36.029247] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-21T17:21:36.156130] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-21T17:21:36.431108] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-21T17:21:36.431197] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-21T17:21:36.431912] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-21T17:21:36.432099] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-21T17:21:36.433390] [DEBUG] [LOCAL ] AUB: Trimmed 66311 records to 45881 (keeping 200 days of data) [2025-10-21T17:21:36.705478] [DEBUG] [LOCAL ] AUB: Primary data saved (45881 records). [2025-10-21T17:21:36.705607] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-21T17:21:36.705903] [INFO ] [MAIN ] Update Progress: 178/2366 symbols completed. AUB took 31.5s. Estimated remaining: 4h 24m 49s. Rate: 8.3 symbols/min [2025-10-21T17:21:36.883113] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:36.925247] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T17:21:36.926401] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T17:21:36.957040] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-21T17:21:36.976240] [DEBUG] [LOCAL ] AVB: Loaded 42300 existing records from primary storage. [2025-10-21T17:21:36.976503] [INFO ] [MAIN ] AVB: Loaded 42300 existing records. [2025-10-21T17:21:37.151929] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:37.152185] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-21T17:21:37.152249] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-21T17:21:37.152472] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-21T17:21:37.152530] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-21T17:21:37.547939] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:37.607143] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T17:21:37.751097] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-21T17:21:38.551087] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-21T17:21:39.195078] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T17:21:39.335166] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:21:39.350972] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-21T17:21:40.151018] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-21T17:21:40.804166] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:21:40.951053] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-21T17:21:41.751076] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-21T17:21:41.912027] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:21:42.363305] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T17:21:42.458852] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T17:21:42.551020] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-21T17:21:42.930092] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-21T17:21:43.351069] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-21T17:21:44.151057] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-21T17:21:44.933182] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T17:21:44.950983] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-21T17:21:45.710672] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T17:21:45.751084] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-21T17:21:46.448596] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:21:46.551037] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-21T17:21:47.115584] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:21:47.147136] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:21:47.351074] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-21T17:21:48.151026] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-21T17:21:48.951001] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-21T17:21:49.021275] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T17:21:49.125107] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:21:49.751019] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-21T17:21:49.759915] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T17:21:50.466348] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T17:21:50.550996] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-21T17:21:51.351090] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-21T17:21:51.382586] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T17:21:52.151028] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-21T17:21:52.894496] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T17:21:52.895983] [INFO ] [REMOTE ] AUNA: Full fetch complete (7781 records). [2025-10-21T17:21:52.896050] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-21T17:21:52.958339] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-21T17:21:53.284587] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-21T17:21:53.293669] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-21T17:21:53.294286] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-21T17:21:53.295175] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T17:21:53.295281] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-21T17:21:53.304939] [DEBUG] [LOCAL ] AUNA: Trimmed 7781 records to 5226 (keeping 200 days of data) [2025-10-21T17:21:53.338812] [DEBUG] [LOCAL ] AUNA: Primary data saved (5226 records). [2025-10-21T17:21:53.338956] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-21T17:21:53.339046] [INFO ] [MAIN ] Update Progress: 179/2366 symbols completed. AUNA took 26.1s. Estimated remaining: 4h 26m 37s. Rate: 8.2 symbols/min [2025-10-21T17:21:53.516181] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:53.516362] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-21T17:21:53.516404] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-21T17:21:53.516474] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-21T17:21:53.516509] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-21T17:21:53.516548] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-21T17:21:53.516578] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-21T17:21:53.757477] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-21T17:21:53.874896] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:54.280518] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T17:21:54.551018] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-21T17:21:55.132170] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:21:55.351018] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-21T17:21:55.560204] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:21:55.560471] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-21T17:21:55.560576] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:21:55.560699] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-21T17:21:55.560775] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:21:55.560833] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-21T17:21:55.560901] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-21T17:21:55.560952] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-21T17:21:55.561009] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-21T17:21:55.561071] [INFO ] [MAIN ] Update Progress: 180/2366 symbols completed. AVBC took 2.2s. Estimated remaining: 4h 25m 28s. Rate: 8.2 symbols/min [2025-10-21T17:21:55.743444] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:55.763834] [DEBUG] [LOCAL ] AVD: Loaded 21480 existing records from primary storage. [2025-10-21T17:21:55.764093] [INFO ] [MAIN ] AVD: Loaded 21480 existing records. [2025-10-21T17:21:55.954151] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:55.954438] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-21T17:21:55.954512] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-21T17:21:55.954764] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-21T17:21:55.954821] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-21T17:21:56.079758] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:21:56.145081] [INFO ] [REMOTE ] AVA: Full fetch complete (55484 records). [2025-10-21T17:21:56.160887] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-21T17:21:56.194194] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-21T17:21:56.533194] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:56.774320] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-21T17:21:56.774406] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-21T17:21:56.775062] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-21T17:21:56.775126] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-21T17:21:56.776214] [DEBUG] [LOCAL ] AVA: Trimmed 55484 records to 38417 (keeping 200 days of data) [2025-10-21T17:21:56.970609] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-21T17:21:57.003896] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T17:21:57.012670] [DEBUG] [LOCAL ] AVA: Primary data saved (38417 records). [2025-10-21T17:21:57.012770] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-21T17:21:57.012841] [INFO ] [MAIN ] Update Progress: 181/2366 symbols completed. AVA took 25.7s. Estimated remaining: 4h 24m 10s. Rate: 8.3 symbols/min [2025-10-21T17:21:57.190342] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:21:57.208816] [DEBUG] [LOCAL ] AVK: Loaded 18702 existing records from primary storage. [2025-10-21T17:21:57.209060] [INFO ] [MAIN ] AVK: Loaded 18702 existing records. [2025-10-21T17:21:57.389117] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:21:57.389337] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-21T17:21:57.389408] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-21T17:21:57.389599] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-21T17:21:57.389700] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-21T17:21:57.741995] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:21:57.750983] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-21T17:21:58.291544] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T17:21:58.551055] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-21T17:21:58.950061] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T17:21:59.055315] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T17:21:59.351045] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-21T17:22:00.151007] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-21T17:22:00.193241] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T17:22:00.951069] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-21T17:22:01.291883] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T17:22:01.751029] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-21T17:22:02.551074] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-21T17:22:02.631127] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:22:02.722073] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:22:03.295268] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T17:22:03.351034] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-21T17:22:04.151026] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-21T17:22:04.432540] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:22:04.942234] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T17:22:04.950973] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-21T17:22:05.685170] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T17:22:05.687039] [INFO ] [REMOTE ] AVAL: Full fetch complete (14926 records). [2025-10-21T17:22:05.687179] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-21T17:22:05.687578] [FATAL] [VALIDATOR ] AVAL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:22:05.687684] [FATAL] [MAIN ] AVAL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:22:05.687755] [WARN ] [MAIN ] AVAL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:22:05.687829] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-21T17:22:05.687893] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-21T17:22:05.687928] [INFO ] [LOCAL ] AVAL: Starting deletion of derivative data. [2025-10-21T17:22:05.688147] [DEBUG] [LOCAL ] AVAL: Deleted derivative data file. [2025-10-21T17:22:05.688264] [INFO ] [MAIN ] Update Progress: 182/2366 symbols completed. AVAL took 31.3s. Estimated remaining: 4h 24m 20s. Rate: 8.3 symbols/min [2025-10-21T17:22:05.756200] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-21T17:22:05.882116] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:05.918706] [DEBUG] [LOCAL ] AVNS: Loaded 33631 existing records from primary storage. [2025-10-21T17:22:05.918975] [INFO ] [MAIN ] AVNS: Loaded 33631 existing records. [2025-10-21T17:22:06.119470] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:06.119692] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-21T17:22:06.119752] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-21T17:22:06.119959] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-21T17:22:06.120015] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-21T17:22:06.498097] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:06.551006] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-21T17:22:06.867412] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:22:07.351000] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-21T17:22:07.410872] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T17:22:08.151017] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-21T17:22:08.767012] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T17:22:08.951001] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-21T17:22:09.304552] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:22:09.751065] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-21T17:22:10.551058] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-21T17:22:10.700927] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:22:10.823784] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T17:22:11.168739] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T17:22:11.351017] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-21T17:22:12.151066] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-21T17:22:12.431217] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T17:22:12.951030] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-21T17:22:13.615004] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T17:22:13.751028] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-21T17:22:14.090396] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:22:14.551020] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-21T17:22:15.351075] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-21T17:22:15.462800] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T17:22:15.590695] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T17:22:16.151028] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-21T17:22:16.727843] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T17:22:16.951010] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-21T17:22:17.074927] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T17:22:17.751035] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-21T17:22:18.417271] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T17:22:18.551009] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-21T17:22:18.656392] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T17:22:19.351010] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-21T17:22:20.032233] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T17:22:20.151037] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-21T17:22:20.951066] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-21T17:22:21.205150] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T17:22:21.211688] [INFO ] [REMOTE ] AVB: Full fetch complete (59273 records). [2025-10-21T17:22:21.211830] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-21T17:22:21.642392] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T17:22:21.668030] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-21T17:22:21.668544] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-21T17:22:21.669266] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-21T17:22:21.669332] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-21T17:22:21.670622] [DEBUG] [LOCAL ] AVB: Trimmed 59273 records to 42231 (keeping 200 days of data) [2025-10-21T17:22:21.764002] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-21T17:22:21.943712] [DEBUG] [LOCAL ] AVB: Primary data saved (42231 records). [2025-10-21T17:22:21.953432] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-21T17:22:21.955223] [INFO ] [MAIN ] Update Progress: 183/2366 symbols completed. AVB took 45.2s. Estimated remaining: 4h 25m 60s. Rate: 8.2 symbols/min [2025-10-21T17:22:21.955841] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T17:22:22.023740] [INFO ] [REMOTE ] AVK: Full fetch complete (26707 records). [2025-10-21T17:22:22.036118] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-21T17:22:22.284196] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:22.552572] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-21T17:22:22.552142] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-21T17:22:22.565577] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-21T17:22:22.566223] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-21T17:22:22.567390] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-21T17:22:22.568500] [DEBUG] [LOCAL ] AVNT: Loaded 38938 existing records from primary storage. [2025-10-21T17:22:22.569551] [INFO ] [MAIN ] AVNT: Loaded 38938 existing records. [2025-10-21T17:22:22.620102] [DEBUG] [LOCAL ] AVK: Trimmed 26707 records to 18704 (keeping 200 days of data) [2025-10-21T17:22:22.869879] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:22.887333] [DEBUG] [LOCAL ] AVK: Primary data saved (18704 records). [2025-10-21T17:22:22.896254] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-21T17:22:22.896382] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-21T17:22:22.897783] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T17:22:22.897304] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-21T17:22:22.896688] [INFO ] [MAIN ] Update Progress: 184/2366 symbols completed. AVK took 25.9s. Estimated remaining: 4h 24m 37s. Rate: 8.2 symbols/min [2025-10-21T17:22:22.903189] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-21T17:22:22.928502] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-21T17:22:23.241783] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:23.353616] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-21T17:22:23.565707] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:23.567765] [DEBUG] [LOCAL ] AVTR: Loaded 53572 existing records from primary storage. [2025-10-21T17:22:23.568069] [INFO ] [MAIN ] AVTR: Loaded 53572 existing records. [2025-10-21T17:22:23.772076] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:23.772325] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-21T17:22:23.772394] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-21T17:22:23.773425] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-21T17:22:23.773491] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-21T17:22:23.925799] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:22:24.151361] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-21T17:22:24.178575] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:24.486721] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:22:24.951035] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-21T17:22:25.751040] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-21T17:22:25.933758] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:22:25.994769] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T17:22:25.998474] [INFO ] [REMOTE ] AVD: Full fetch complete (32642 records). [2025-10-21T17:22:25.998571] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-21T17:22:26.434739] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-21T17:22:26.434842] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-21T17:22:26.435374] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-21T17:22:26.435415] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-21T17:22:26.436392] [DEBUG] [LOCAL ] AVD: Trimmed 32642 records to 21426 (keeping 200 days of data) [2025-10-21T17:22:26.552558] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-21T17:22:26.558069] [DEBUG] [LOCAL ] AVD: Primary data saved (21426 records). [2025-10-21T17:22:26.558247] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-21T17:22:26.558358] [INFO ] [MAIN ] Update Progress: 185/2366 symbols completed. AVD took 31.0s. Estimated remaining: 4h 23m 47s. Rate: 8.3 symbols/min [2025-10-21T17:22:26.731408] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:26.769716] [DEBUG] [LOCAL ] AVY: Loaded 38172 existing records from primary storage. [2025-10-21T17:22:26.770028] [INFO ] [MAIN ] AVY: Loaded 38172 existing records. [2025-10-21T17:22:26.946281] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:26.964804] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-21T17:22:26.964918] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-21T17:22:26.966232] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T17:22:26.966297] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-21T17:22:26.973306] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-21T17:22:27.326130] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:27.350986] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-21T17:22:28.071677] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:22:28.151008] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-21T17:22:28.951006] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-21T17:22:29.048615] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:22:29.648100] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:22:29.751075] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-21T17:22:30.160709] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T17:22:30.551103] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-21T17:22:31.169424] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T17:22:31.351105] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-21T17:22:32.151176] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-21T17:22:32.246983] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T17:22:32.791318] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T17:22:32.951062] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-21T17:22:33.600734] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T17:22:33.751138] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-21T17:22:34.551198] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-21T17:22:34.638226] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:22:34.826115] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:22:35.351072] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-21T17:22:36.151125] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-21T17:22:36.234890] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T17:22:36.951033] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-21T17:22:37.265779] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T17:22:37.274328] [INFO ] [REMOTE ] AVNS: Full fetch complete (48350 records). [2025-10-21T17:22:37.274551] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-21T17:22:37.687022] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-21T17:22:37.687121] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-21T17:22:37.687718] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-21T17:22:37.687782] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-21T17:22:37.689009] [DEBUG] [LOCAL ] AVNS: Trimmed 48350 records to 33563 (keeping 200 days of data) [2025-10-21T17:22:37.751295] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-21T17:22:37.899211] [DEBUG] [LOCAL ] AVNS: Primary data saved (33563 records). [2025-10-21T17:22:37.899395] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-21T17:22:37.900192] [INFO ] [MAIN ] Update Progress: 186/2366 symbols completed. AVNS took 32.2s. Estimated remaining: 4h 24m 28s. Rate: 8.2 symbols/min [2025-10-21T17:22:38.081861] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:22:38.126616] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:22:38.158757] [DEBUG] [LOCAL ] AWF: Loaded 24036 existing records from primary storage. [2025-10-21T17:22:38.159025] [INFO ] [MAIN ] AWF: Loaded 24036 existing records. [2025-10-21T17:22:38.341967] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:22:38.342316] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-21T17:22:38.342367] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-21T17:22:38.342945] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-21T17:22:38.343002] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-21T17:22:38.552193] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-21T17:22:38.722010] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:22:39.269352] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:22:39.351044] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-21T17:22:39.770120] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-21T17:22:40.151045] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-21T17:22:40.770222] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:22:40.951005] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-21T17:22:41.322358] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-21T17:22:41.728621] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T17:22:41.750986] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-21T17:22:42.291802] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T17:22:42.551043] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-21T17:22:43.351011] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-21T17:22:43.469120] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T17:22:44.135830] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:22:44.150978] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-21T17:22:44.628024] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T17:22:44.951059] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-21T17:22:45.366766] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T17:22:45.751009] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-21T17:22:46.077354] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T17:22:46.551059] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-21T17:22:47.351034] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-21T17:22:47.778030] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T17:22:48.153188] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-21T17:22:48.156699] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:22:48.620079] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T17:22:48.951070] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-21T17:22:49.751033] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-21T17:22:50.551126] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-21T17:22:50.915390] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-21T17:22:51.001229] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T17:22:51.350998] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-21T17:22:51.720113] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-10-21T17:22:52.151062] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-21T17:22:52.951027] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-21T17:23:05.206570] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (13.86 seconds). [2025-10-21T17:23:05.211954] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-21T17:23:05.858833] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (15.31 seconds). [2025-10-21T17:23:05.866937] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-21T17:23:06.159549] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T17:23:06.164554] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-21T17:23:07.020246] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (14.07 seconds). [2025-10-21T17:23:07.025856] [INFO ] [REMOTE ] AVNT: Full fetch complete (56180 records). [2025-10-21T17:23:07.025959] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-21T17:23:07.367249] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T17:23:07.457950] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T17:23:07.476022] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-21T17:23:07.485808] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-21T17:23:07.486091] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-21T17:23:07.486994] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-21T17:23:07.487816] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-21T17:23:07.487998] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-21T17:23:07.500867] [DEBUG] [LOCAL ] AVNT: Trimmed 56180 records to 38781 (keeping 200 days of data) [2025-10-21T17:23:07.525058] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (15.37 seconds). [2025-10-21T17:23:07.623114] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-21T17:23:07.783949] [DEBUG] [LOCAL ] AVNT: Primary data saved (38781 records). [2025-10-21T17:23:07.784102] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-21T17:23:07.784183] [INFO ] [MAIN ] Update Progress: 187/2366 symbols completed. AVNT took 45.8s. Estimated remaining: 4h 28m 44s. Rate: 8.1 symbols/min [2025-10-21T17:23:07.952381] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:07.979033] [DEBUG] [LOCAL ] AWI: Loaded 25285 existing records from primary storage. [2025-10-21T17:23:07.979287] [INFO ] [MAIN ] AWI: Loaded 25285 existing records. [2025-10-21T17:23:08.154639] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:08.154913] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-21T17:23:08.154962] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-21T17:23:08.155387] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-21T17:23:08.155446] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-21T17:23:08.521435] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:08.521769] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-21T17:23:08.582038] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T17:23:08.588093] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-21T17:23:09.302586] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:23:09.313847] [INFO ] [REMOTE ] AVY: Full fetch complete (56647 records). [2025-10-21T17:23:09.334901] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-21T17:23:09.336403] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:23:09.399737] [INFO ] [REMOTE ] AVTR: Full fetch complete (77653 records). [2025-10-21T17:23:09.437408] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-21T17:23:10.081018] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:23:10.081256] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-21T17:23:10.104094] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-21T17:23:10.103940] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-21T17:23:10.118052] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-21T17:23:10.129013] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T17:23:10.139707] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-21T17:23:10.180556] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-21T17:23:10.210693] [DEBUG] [LOCAL ] AVY: Trimmed 56647 records to 38140 (keeping 200 days of data) [2025-10-21T17:23:10.234845] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-21T17:23:10.235367] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-21T17:23:10.236077] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-21T17:23:10.236177] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-21T17:23:10.326622] [DEBUG] [LOCAL ] AVTR: Trimmed 77653 records to 53572 (keeping 200 days of data) [2025-10-21T17:23:10.679079] [DEBUG] [LOCAL ] AVY: Primary data saved (38140 records). [2025-10-21T17:23:10.686704] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-21T17:23:10.697885] [INFO ] [MAIN ] Update Progress: 188/2366 symbols completed. AVY took 44.1s. Estimated remaining: 4h 27m 44s. Rate: 8.1 symbols/min [2025-10-21T17:23:10.900736] [DEBUG] [LOCAL ] AVTR: Primary data saved (53572 records). [2025-10-21T17:23:10.911153] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-21T17:23:10.916403] [INFO ] [MAIN ] Update Progress: 189/2366 symbols completed. AVTR took 48.0s. Estimated remaining: 4h 26m 15s. Rate: 8.2 symbols/min [2025-10-21T17:23:11.045059] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:11.145164] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:11.145360] [DEBUG] [LOCAL ] AWP: No existing data file found in primary storage. [2025-10-21T17:23:11.145430] [WARN ] [MAIN ] AWP: No existing data found, performing full refresh instead. [2025-10-21T17:23:11.145835] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-21T17:23:11.145914] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-21T17:23:11.145961] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-21T17:23:11.145995] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-21T17:23:11.273458] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T17:23:11.367082] [INFO ] [REMOTE ] AWF: Full fetch complete (36033 records). [2025-10-21T17:23:11.388826] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-21T17:23:11.453601] [DEBUG] [LOCAL ] AWK: Loaded 48510 existing records from primary storage. [2025-10-21T17:23:11.524979] [INFO ] [MAIN ] AWK: Loaded 48510 existing records. [2025-10-21T17:23:11.757431] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:23:11.839090] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-21T17:23:11.936280] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:12.059842] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:12.056958] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-21T17:23:12.095444] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-21T17:23:12.101320] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-21T17:23:12.123956] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-21T17:23:12.132181] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-21T17:23:12.441045] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-21T17:23:12.479881] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-21T17:23:12.486480] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-21T17:23:12.492736] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-21T17:23:12.555321] [DEBUG] [LOCAL ] AWF: Trimmed 36033 records to 24135 (keeping 200 days of data) [2025-10-21T17:23:12.714265] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:12.718462] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-21T17:23:12.775426] [DEBUG] [LOCAL ] AWF: Primary data saved (24135 records). [2025-10-21T17:23:12.775523] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-21T17:23:12.775598] [INFO ] [MAIN ] Update Progress: 190/2366 symbols completed. AWF took 34.9s. Estimated remaining: 4h 25m 5s. Rate: 8.2 symbols/min [2025-10-21T17:23:12.954027] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:12.977358] [DEBUG] [LOCAL ] AWR: Loaded 22778 existing records from primary storage. [2025-10-21T17:23:12.977613] [INFO ] [MAIN ] AWR: Loaded 22778 existing records. [2025-10-21T17:23:13.166196] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:13.166462] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-21T17:23:13.166731] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-21T17:23:13.167080] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-21T17:23:13.167142] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-21T17:23:13.328105] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:23:13.407413] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-21T17:23:13.576775] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:13.577854] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T17:23:13.583438] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-21T17:23:13.583920] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-21T17:23:14.221612] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T17:23:14.231837] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-21T17:23:14.294921] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T17:23:14.299067] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-21T17:23:14.815259] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:23:14.820118] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-21T17:23:14.902203] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T17:23:14.908577] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-21T17:23:15.524062] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:23:15.533195] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-21T17:23:15.584136] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T17:23:15.589106] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-21T17:23:15.867926] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T17:23:15.872360] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-21T17:23:15.963325] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T17:23:15.968585] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-21T17:23:16.359543] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T17:23:16.364277] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-21T17:23:16.690909] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T17:23:16.696245] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-21T17:23:16.998142] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T17:23:17.003837] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-21T17:23:17.180270] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T17:23:17.191940] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-21T17:23:17.398823] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T17:23:17.403560] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-21T17:23:17.913054] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T17:23:17.918613] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-21T17:23:17.947837] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:23:17.953812] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-21T17:23:18.098819] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T17:23:18.536670] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T17:23:18.550985] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-21T17:23:18.851475] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T17:23:19.095379] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T17:23:19.351013] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-21T17:23:19.949706] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:23:20.151019] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-21T17:23:20.569676] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T17:23:20.951015] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-21T17:23:21.197288] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T17:23:21.751027] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-21T17:23:22.189146] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T17:23:22.195690] [INFO ] [REMOTE ] AWI: Full fetch complete (36072 records). [2025-10-21T17:23:22.195830] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-21T17:23:22.557150] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-21T17:23:22.597698] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-21T17:23:22.597794] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-21T17:23:22.598358] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-21T17:23:22.598423] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-21T17:23:22.599443] [DEBUG] [LOCAL ] AWI: Trimmed 36072 records to 25268 (keeping 200 days of data) [2025-10-21T17:23:22.755544] [DEBUG] [LOCAL ] AWI: Primary data saved (25268 records). [2025-10-21T17:23:22.755705] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-21T17:23:22.755795] [INFO ] [MAIN ] Update Progress: 191/2366 symbols completed. AWI took 15.0s. Estimated remaining: 4h 25m 28s. Rate: 8.2 symbols/min [2025-10-21T17:23:22.924465] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:22.949448] [DEBUG] [LOCAL ] AX: Loaded 28103 existing records from primary storage. [2025-10-21T17:23:22.949692] [INFO ] [MAIN ] AX: Loaded 28103 existing records. [2025-10-21T17:23:23.129016] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:23.129297] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-21T17:23:23.129353] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-21T17:23:23.129938] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-21T17:23:23.129995] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-21T17:23:23.351510] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-21T17:23:23.577283] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:23.623082] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:23:23.686626] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:23:24.149474] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T17:23:24.156518] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-21T17:23:24.951122] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-21T17:23:25.568962] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:23:25.750999] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-21T17:23:26.551089] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-21T17:23:26.612458] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T17:23:26.680181] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:23:26.684110] [INFO ] [REMOTE ] AWP: Full fetch complete (31744 records). [2025-10-21T17:23:26.684283] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-21T17:23:27.094095] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-21T17:23:27.094256] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-21T17:23:27.094895] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-21T17:23:27.094963] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-21T17:23:27.096150] [DEBUG] [LOCAL ] AWP: Trimmed 31744 records to 21668 (keeping 200 days of data) [2025-10-21T17:23:27.226485] [DEBUG] [LOCAL ] AWP: Primary data saved (21668 records). [2025-10-21T17:23:27.226616] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-21T17:23:27.226720] [INFO ] [MAIN ] Update Progress: 192/2366 symbols completed. AWP took 16.3s. Estimated remaining: 4h 24m 48s. Rate: 8.2 symbols/min [2025-10-21T17:23:27.356901] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-21T17:23:27.410609] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:27.433543] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:23:27.489887] [DEBUG] [LOCAL ] AXL: Loaded 50539 existing records from primary storage. [2025-10-21T17:23:27.490577] [INFO ] [MAIN ] AXL: Loaded 50539 existing records. [2025-10-21T17:23:27.684667] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:27.685014] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-21T17:23:27.685075] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-21T17:23:27.686183] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-21T17:23:27.686246] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-21T17:23:28.067844] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:28.151105] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-21T17:23:28.760839] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:23:28.951056] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-21T17:23:29.230701] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:23:29.751047] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-21T17:23:30.025224] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T17:23:30.551085] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-21T17:23:31.351038] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-21T17:23:31.493225] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:23:32.145945] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T17:23:32.152991] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-21T17:23:32.951020] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-21T17:23:33.206574] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T17:23:33.731725] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T17:23:33.750989] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-21T17:23:34.096339] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T17:23:34.551041] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-21T17:23:35.351547] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-21T17:23:35.354224] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T17:23:36.151055] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-21T17:23:36.188550] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:23:36.652719] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T17:23:36.950999] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-21T17:23:37.751015] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-21T17:23:37.924739] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T17:23:38.551061] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-21T17:23:38.789623] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T17:23:38.793603] [INFO ] [REMOTE ] AWR: Full fetch complete (32472 records). [2025-10-21T17:23:38.793749] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-21T17:23:39.009142] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T17:23:39.221886] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-21T17:23:39.221971] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-21T17:23:39.222439] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-21T17:23:39.222481] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-21T17:23:39.223401] [DEBUG] [LOCAL ] AWR: Trimmed 32472 records to 22805 (keeping 200 days of data) [2025-10-21T17:23:39.351421] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-21T17:23:39.360775] [DEBUG] [LOCAL ] AWR: Primary data saved (22805 records). [2025-10-21T17:23:39.360906] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-21T17:23:39.360985] [INFO ] [MAIN ] Update Progress: 193/2366 symbols completed. AWR took 26.6s. Estimated remaining: 4h 25m 35s. Rate: 8.2 symbols/min [2025-10-21T17:23:39.530007] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:39.578568] [DEBUG] [LOCAL ] AXP: Loaded 53169 existing records from primary storage. [2025-10-21T17:23:39.578910] [INFO ] [MAIN ] AXP: Loaded 53169 existing records. [2025-10-21T17:23:39.757587] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:39.757919] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-21T17:23:39.757967] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-21T17:23:39.758256] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-21T17:23:39.758317] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-21T17:23:40.125440] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:40.159420] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-21T17:23:40.179164] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T17:23:40.951008] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-21T17:23:41.198603] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T17:23:41.206682] [INFO ] [REMOTE ] AWK: Full fetch complete (70938 records). [2025-10-21T17:23:41.206806] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-21T17:23:41.669233] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-21T17:23:41.669345] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-21T17:23:41.670195] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-21T17:23:41.670277] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-21T17:23:41.671931] [DEBUG] [LOCAL ] AWK: Trimmed 70938 records to 48465 (keeping 200 days of data) [2025-10-21T17:23:41.775546] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-21T17:23:42.009428] [DEBUG] [LOCAL ] AWK: Primary data saved (48465 records). [2025-10-21T17:23:42.009554] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-21T17:23:42.010333] [INFO ] [MAIN ] Update Progress: 194/2366 symbols completed. AWK took 31.3s. Estimated remaining: 4h 24m 35s. Rate: 8.2 symbols/min [2025-10-21T17:23:42.225499] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:42.232431] [DEBUG] [LOCAL ] AXR: Loaded 2925 existing records from primary storage. [2025-10-21T17:23:42.232620] [INFO ] [MAIN ] AXR: Loaded 2925 existing records. [2025-10-21T17:23:42.476255] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:42.477032] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-21T17:23:42.477263] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-21T17:23:42.477831] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-21T17:23:42.477942] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-21T17:23:42.641745] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-21T17:23:42.688149] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-21T17:23:42.938063] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-21T17:23:42.967287] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:42.992290] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T17:23:43.351014] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-21T17:23:44.151065] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-21T17:23:44.795019] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:23:44.835156] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-21T17:23:44.950984] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-21T17:23:45.078986] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T17:23:45.751044] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-21T17:23:46.551129] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-21T17:23:47.058811] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-21T17:23:47.280345] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-21T17:23:47.351030] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-21T17:23:47.645988] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T17:23:48.151090] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-21T17:23:48.951024] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-21T17:23:49.751011] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-21T17:23:49.784624] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-21T17:23:50.203446] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T17:23:50.339152] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T17:23:50.398324] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T17:23:50.551029] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-21T17:23:51.138499] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T17:23:51.351082] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-21T17:23:52.151043] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-21T17:23:52.551321] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T17:23:52.951007] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-21T17:23:53.751022] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-21T17:23:54.353745] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-21T17:23:54.550987] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-21T17:23:54.853511] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T17:23:54.861008] [INFO ] [REMOTE ] AXL: Full fetch complete (72723 records). [2025-10-21T17:23:54.861133] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-21T17:23:54.862116] [FATAL] [VALIDATOR ] AXL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:23:54.862203] [FATAL] [MAIN ] AXL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:23:54.862244] [WARN ] [MAIN ] AXL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:23:54.862281] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-21T17:23:54.862336] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-10-21T17:23:54.862369] [INFO ] [LOCAL ] AXL: Starting deletion of derivative data. [2025-10-21T17:23:54.862557] [DEBUG] [LOCAL ] AXL: Deleted derivative data file. [2025-10-21T17:23:54.862675] [INFO ] [MAIN ] Update Progress: 195/2366 symbols completed. AXL took 27.6s. Estimated remaining: 4h 25m 30s. Rate: 8.2 symbols/min [2025-10-21T17:23:55.032852] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:55.072131] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T17:23:55.093485] [DEBUG] [LOCAL ] AXS: Loaded 38702 existing records from primary storage. [2025-10-21T17:23:55.093805] [INFO ] [MAIN ] AXS: Loaded 38702 existing records. [2025-10-21T17:23:55.267992] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:55.268270] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-21T17:23:55.268326] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-21T17:23:55.268975] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-21T17:23:55.269033] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-21T17:23:55.356391] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-21T17:23:55.621102] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:56.151025] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-21T17:23:56.492670] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T17:23:56.677209] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T17:23:56.690052] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:23:56.694989] [INFO ] [REMOTE ] AX: Full fetch complete (42191 records). [2025-10-21T17:23:56.695133] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-21T17:23:56.957926] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-21T17:23:57.085931] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-21T17:23:57.086009] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-21T17:23:57.086522] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-21T17:23:57.086562] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-21T17:23:57.087480] [DEBUG] [LOCAL ] AX: Trimmed 42191 records to 27940 (keeping 200 days of data) [2025-10-21T17:23:57.246775] [DEBUG] [LOCAL ] AX: Primary data saved (27940 records). [2025-10-21T17:23:57.246911] [INFO ] [MAIN ] AX: Full history saved. [2025-10-21T17:23:57.247026] [INFO ] [MAIN ] Update Progress: 196/2366 symbols completed. AX took 34.5s. Estimated remaining: 4h 24m 28s. Rate: 8.2 symbols/min [2025-10-21T17:23:57.417576] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:23:57.464280] [DEBUG] [LOCAL ] AXTA: Loaded 52286 existing records from primary storage. [2025-10-21T17:23:57.464596] [INFO ] [MAIN ] AXTA: Loaded 52286 existing records. [2025-10-21T17:23:57.609638] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T17:23:57.653740] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:23:57.653995] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-21T17:23:57.654047] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-21T17:23:57.654535] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-21T17:23:57.654591] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-21T17:23:57.753814] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-21T17:23:58.008336] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:23:58.551042] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-21T17:23:59.328940] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:23:59.350994] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-21T17:23:59.895524] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T17:24:00.151037] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-21T17:24:00.799666] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T17:24:00.951030] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-21T17:24:01.253815] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T17:24:01.751032] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-21T17:24:02.551041] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-21T17:24:02.989937] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T17:24:03.054212] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:24:03.171247] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-21T17:24:03.351038] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-21T17:24:04.150990] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-21T17:24:04.950999] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-21T17:24:04.991991] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T17:24:05.751077] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-21T17:24:06.336946] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T17:24:06.368594] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T17:24:06.551008] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-21T17:24:06.654027] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:24:07.096060] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T17:24:07.096918] [INFO ] [REMOTE ] AXR: Full fetch complete (4395 records). [2025-10-21T17:24:07.096986] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-21T17:24:07.356197] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-21T17:24:07.466483] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-21T17:24:07.466553] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-21T17:24:07.466705] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-21T17:24:07.466764] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-21T17:24:07.467098] [DEBUG] [LOCAL ] AXR: Trimmed 4395 records to 2916 (keeping 200 days of data) [2025-10-21T17:24:07.483404] [DEBUG] [LOCAL ] AXR: Primary data saved (2916 records). [2025-10-21T17:24:07.483461] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-21T17:24:07.483522] [INFO ] [MAIN ] Update Progress: 197/2366 symbols completed. AXR took 25.5s. Estimated remaining: 4h 24m 52s. Rate: 8.2 symbols/min [2025-10-21T17:24:08.151008] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-21T17:24:08.951014] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-21T17:24:09.289317] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T17:24:09.735964] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T17:24:09.750988] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-21T17:24:10.551038] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-21T17:24:11.191746] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T17:24:11.258121] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-21T17:24:11.268155] [INFO ] [REMOTE ] AXP: Full fetch complete (77118 records). [2025-10-21T17:24:11.271726] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-21T17:24:11.358549] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-21T17:24:11.741606] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-21T17:24:11.741715] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-21T17:24:11.742534] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-21T17:24:11.742576] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-21T17:24:11.743987] [DEBUG] [LOCAL ] AXP: Trimmed 77118 records to 53161 (keeping 200 days of data) [2025-10-21T17:24:12.076085] [DEBUG] [LOCAL ] AXP: Primary data saved (53161 records). [2025-10-21T17:24:12.076225] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-21T17:24:12.076909] [INFO ] [MAIN ] Update Progress: 198/2366 symbols completed. AXP took 32.7s. Estimated remaining: 4h 24m 15s. Rate: 8.2 symbols/min [2025-10-21T17:24:12.286392] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T17:24:12.297268] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-21T17:24:12.654176] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T17:24:12.951019] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-21T17:24:14.033245] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T17:24:14.044974] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-21T17:24:14.705974] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T17:24:14.714822] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-21T17:24:15.583999] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T17:24:15.595622] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-21T17:24:16.170454] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:24:16.180780] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-21T17:24:17.428356] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T17:24:17.445326] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-21T17:24:17.916825] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T17:24:17.926780] [INFO ] [REMOTE ] AXS: Full fetch complete (56110 records). [2025-10-21T17:24:17.926993] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-21T17:24:18.318260] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-21T17:24:18.318348] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-21T17:24:18.319026] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-21T17:24:18.319089] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-21T17:24:18.320585] [DEBUG] [LOCAL ] AXS: Trimmed 56110 records to 38784 (keeping 200 days of data) [2025-10-21T17:24:18.559821] [DEBUG] [LOCAL ] AXS: Primary data saved (38784 records). [2025-10-21T17:24:18.559957] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-21T17:24:18.560034] [INFO ] [MAIN ] Update Progress: 199/2366 symbols completed. AXS took 23.7s. Estimated remaining: 4h 23m 59s. Rate: 8.2 symbols/min [2025-10-21T17:24:19.225625] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T17:24:19.238753] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-21T17:24:20.950902] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T17:24:20.961811] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-21T17:24:22.501761] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T17:24:22.513022] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-21T17:24:24.368686] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T17:24:24.377532] [INFO ] [REMOTE ] AXTA: Full fetch complete (75441 records). [2025-10-21T17:24:24.377753] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-21T17:24:24.791089] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-21T17:24:24.791188] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-21T17:24:24.792043] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-21T17:24:24.792121] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-21T17:24:24.793540] [DEBUG] [LOCAL ] AXTA: Trimmed 75441 records to 52287 (keeping 200 days of data) [2025-10-21T17:24:25.114858] [DEBUG] [LOCAL ] AXTA: Primary data saved (52287 records). [2025-10-21T17:24:25.115018] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-21T17:24:25.115124] [INFO ] [MAIN ] Update Progress: 200/2366 symbols completed. AXTA took 27.9s. Estimated remaining: 4h 23m 43s. Rate: 8.2 symbols/min [2025-10-21T17:24:25.765051] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:25.848248] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:25.845028] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:25.845124] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-21T17:24:25.857710] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-21T17:24:25.857978] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-21T17:24:25.858045] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-21T17:24:25.858096] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-21T17:24:25.858131] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-21T17:24:25.900970] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:25.983310] [DEBUG] [LOCAL ] AZO: Loaded 10945 existing records from primary storage. [2025-10-21T17:24:26.022962] [INFO ] [MAIN ] AZO: Loaded 10945 existing records. [2025-10-21T17:24:26.250340] [DEBUG] [LOCAL ] AYI: Loaded 24589 existing records from primary storage. [2025-10-21T17:24:26.305176] [INFO ] [MAIN ] AYI: Loaded 24589 existing records. [2025-10-21T17:24:26.331978] [DEBUG] [LOCAL ] AZZ: Loaded 22882 existing records from primary storage. [2025-10-21T17:24:26.393110] [INFO ] [MAIN ] AZZ: Loaded 22882 existing records. [2025-10-21T17:24:26.744181] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:26.773000] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:26.784173] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-21T17:24:26.794403] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-21T17:24:26.835920] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-21T17:24:26.867445] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-21T17:24:26.901479] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:26.894681] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-21T17:24:26.902632] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-21T17:24:26.937119] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-21T17:24:27.000291] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-21T17:24:27.072152] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-21T17:24:27.066839] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:27.093178] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-21T17:24:27.115618] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-21T17:24:27.190253] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-21T17:24:27.196116] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-21T17:24:27.841175] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:27.918420] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-21T17:24:28.130286] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:28.130947] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-21T17:24:28.225046] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:28.225912] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-21T17:24:28.242352] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T17:24:28.248494] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-21T17:24:28.447591] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:24:28.447949] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-21T17:24:28.448049] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:24:28.448116] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-21T17:24:28.448220] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:24:28.448294] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-21T17:24:28.448354] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-21T17:24:28.448389] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-21T17:24:28.448426] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-21T17:24:28.448476] [INFO ] [MAIN ] Update Progress: 201/2366 symbols completed. B took 3.3s. Estimated remaining: 4h 22m 53s. Rate: 8.2 symbols/min [2025-10-21T17:24:28.620088] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:28.673723] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-21T17:24:28.674046] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-21T17:24:28.852145] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T17:24:28.863844] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-21T17:24:28.883059] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:28.884027] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-21T17:24:28.884088] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-21T17:24:28.884379] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-21T17:24:28.884418] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-21T17:24:29.370174] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:29.370537] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-21T17:24:29.408475] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T17:24:29.413596] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-21T17:24:29.723969] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:24:29.732233] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-21T17:24:29.739311] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:24:29.741895] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-21T17:24:30.473519] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T17:24:30.478350] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-21T17:24:30.683187] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T17:24:30.686882] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-21T17:24:30.924969] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T17:24:30.933567] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-21T17:24:31.440904] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T17:24:31.445504] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-21T17:24:31.478145] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-21T17:24:31.489383] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-21T17:24:31.576389] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T17:24:32.127747] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-21T17:24:32.151009] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-21T17:24:32.362343] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:24:32.951052] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-21T17:24:33.343409] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T17:24:33.751205] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-21T17:24:33.757475] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-21T17:24:33.776109] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:24:34.551069] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-21T17:24:35.286586] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T17:24:35.350983] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-21T17:24:36.151063] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-21T17:24:36.501184] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:24:36.951063] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-21T17:24:37.121766] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-21T17:24:37.158816] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T17:24:37.751062] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-21T17:24:38.280496] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T17:24:38.551004] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-21T17:24:38.690582] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T17:24:39.351036] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-21T17:24:40.151039] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-21T17:24:40.635837] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T17:24:40.951058] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-21T17:24:41.080945] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T17:24:41.297938] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-10-21T17:24:41.751079] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-21T17:24:42.157067] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T17:24:42.551052] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-21T17:24:42.896715] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T17:24:43.351097] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-21T17:24:43.966488] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T17:24:44.151026] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-21T17:24:44.951023] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-21T17:24:45.219241] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T17:24:45.751025] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-21T17:24:45.907977] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-21T17:24:46.260276] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T17:24:46.551072] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-21T17:24:46.881223] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:24:47.351003] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-21T17:24:47.582520] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T17:24:48.083667] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T17:24:48.085551] [INFO ] [REMOTE ] AZO: Full fetch complete (15868 records). [2025-10-21T17:24:48.085619] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-21T17:24:48.086084] [FATAL] [VALIDATOR ] AZO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:24:48.086170] [FATAL] [MAIN ] AZO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:24:48.086212] [WARN ] [MAIN ] AZO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:24:48.086252] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-21T17:24:48.086339] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-10-21T17:24:48.086401] [INFO ] [LOCAL ] AZO: Starting deletion of derivative data. [2025-10-21T17:24:48.086693] [DEBUG] [LOCAL ] AZO: Deleted derivative data file. [2025-10-21T17:24:48.086800] [INFO ] [MAIN ] Update Progress: 202/2366 symbols completed. AZO took 23.0s. Estimated remaining: 4h 24m 58s. Rate: 8.2 symbols/min [2025-10-21T17:24:48.156201] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-21T17:24:48.257902] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:48.309879] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-21T17:24:48.310236] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-21T17:24:48.486227] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:48.486429] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-21T17:24:48.486497] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-21T17:24:48.487060] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-21T17:24:48.487118] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-21T17:24:48.829518] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:48.950993] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-21T17:24:49.573785] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T17:24:49.579385] [INFO ] [REMOTE ] AYI: Full fetch complete (36898 records). [2025-10-21T17:24:49.579490] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-21T17:24:49.753225] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-21T17:24:49.959592] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-21T17:24:49.959689] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-21T17:24:49.960167] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-21T17:24:49.960207] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-21T17:24:49.960966] [DEBUG] [LOCAL ] AYI: Trimmed 36898 records to 24331 (keeping 200 days of data) [2025-10-21T17:24:50.108909] [DEBUG] [LOCAL ] AYI: Primary data saved (24331 records). [2025-10-21T17:24:50.109024] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-21T17:24:50.109096] [INFO ] [MAIN ] Update Progress: 203/2366 symbols completed. AYI took 25.0s. Estimated remaining: 4h 23m 54s. Rate: 8.2 symbols/min [2025-10-21T17:24:50.275357] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:50.275494] [DEBUG] [LOCAL ] BAC: No existing data file found in primary storage. [2025-10-21T17:24:50.275530] [WARN ] [MAIN ] BAC: No existing data found, performing full refresh instead. [2025-10-21T17:24:50.275634] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-21T17:24:50.275726] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-21T17:24:50.275774] [DEBUG] [LOCAL ] BAC: No primary data file found to delete. [2025-10-21T17:24:50.275806] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-21T17:24:50.556176] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-21T17:24:50.626284] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:51.350997] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-21T17:24:51.628574] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-21T17:24:51.683263] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T17:24:51.688039] [INFO ] [REMOTE ] AZZ: Full fetch complete (32137 records). [2025-10-21T17:24:51.688115] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-21T17:24:52.055399] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-21T17:24:52.055471] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-21T17:24:52.055875] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-21T17:24:52.055935] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-21T17:24:52.056600] [DEBUG] [LOCAL ] AZZ: Trimmed 32137 records to 22911 (keeping 200 days of data) [2025-10-21T17:24:52.154471] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-21T17:24:52.196197] [DEBUG] [LOCAL ] AZZ: Primary data saved (22911 records). [2025-10-21T17:24:52.196304] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-21T17:24:52.196375] [INFO ] [MAIN ] Update Progress: 204/2366 symbols completed. AZZ took 27.1s. Estimated remaining: 4h 22m 51s. Rate: 8.2 symbols/min [2025-10-21T17:24:52.365400] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:24:52.395694] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-21T17:24:52.449720] [DEBUG] [LOCAL ] BAH: Loaded 51683 existing records from primary storage. [2025-10-21T17:24:52.450030] [INFO ] [MAIN ] BAH: Loaded 51683 existing records. [2025-10-21T17:24:52.624067] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:24:52.624233] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-21T17:24:52.624278] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-21T17:24:52.624570] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-21T17:24:52.624607] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-21T17:24:52.955308] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-21T17:24:52.979195] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:24:53.762921] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-21T17:24:53.765528] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-21T17:24:54.550994] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-21T17:24:54.651729] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-21T17:24:55.351071] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-21T17:24:55.543283] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-21T17:24:55.726507] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T17:24:56.151047] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-21T17:24:56.489190] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T17:24:56.951167] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-21T17:24:57.751342] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-21T17:24:57.752585] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:24:57.887999] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-10-21T17:24:58.551014] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-21T17:24:59.351036] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-21T17:24:59.417181] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-21T17:25:00.117112] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-21T17:25:00.151147] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-21T17:25:00.309295] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:25:00.951019] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-21T17:25:01.756745] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-21T17:25:01.762830] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-21T17:25:02.551031] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-21T17:25:02.837342] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-21T17:25:03.074595] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T17:25:03.351043] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-21T17:25:04.151021] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-21T17:25:04.292708] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T17:25:04.301683] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-21T17:25:04.301821] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-21T17:25:04.720007] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-21T17:25:04.730500] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-21T17:25:04.749460] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-21T17:25:04.749623] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-21T17:25:04.752329] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-10-21T17:25:04.764228] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-21T17:25:04.970799] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-21T17:25:05.091065] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-21T17:25:05.091316] [INFO ] [MAIN ] BA: Full history saved. [2025-10-21T17:25:05.091421] [INFO ] [MAIN ] Update Progress: 205/2366 symbols completed. BA took 36.6s. Estimated remaining: 4h 23m 43s. Rate: 8.2 symbols/min [2025-10-21T17:25:05.262593] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:05.299560] [DEBUG] [LOCAL ] BAK: Loaded 39438 existing records from primary storage. [2025-10-21T17:25:05.300176] [INFO ] [MAIN ] BAK: Loaded 39438 existing records. [2025-10-21T17:25:05.446015] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-10-21T17:25:05.541668] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:05.541844] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-21T17:25:05.541891] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-21T17:25:05.542107] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-21T17:25:05.542175] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-21T17:25:05.757713] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-21T17:25:05.926885] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:05.956772] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T17:25:06.551071] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-21T17:25:07.351026] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-21T17:25:07.501235] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-21T17:25:08.151010] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-21T17:25:08.260962] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-21T17:25:08.337806] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T17:25:08.907790] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:25:08.950990] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-21T17:25:09.751023] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-21T17:25:10.419717] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-21T17:25:10.551031] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-21T17:25:11.337878] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:25:11.350979] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-21T17:25:12.131760] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (3.18 seconds). [2025-10-21T17:25:12.151025] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-21T17:25:12.921582] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T17:25:12.951009] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-21T17:25:13.151020] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-21T17:25:13.751014] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-21T17:25:14.550991] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-21T17:25:14.863734] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-21T17:25:15.138301] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-21T17:25:15.334342] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:25:15.351027] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-21T17:25:16.151022] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-21T17:25:16.880906] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-21T17:25:16.951014] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-21T17:25:17.525951] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T17:25:17.751027] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-21T17:25:18.127851] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-10-21T17:25:18.551014] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-21T17:25:18.948498] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:25:19.351028] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-21T17:25:19.418425] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:25:20.151016] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-21T17:25:20.934686] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:25:20.950971] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-21T17:25:21.331801] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-21T17:25:21.340194] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-21T17:25:21.340328] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-21T17:25:21.741073] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-21T17:25:21.741163] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-21T17:25:21.741969] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-21T17:25:21.742033] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-21T17:25:21.743818] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-21T17:25:21.802525] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-21T17:25:22.072575] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-21T17:25:22.072724] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-21T17:25:22.073307] [INFO ] [MAIN ] Update Progress: 206/2366 symbols completed. BABA took 34.0s. Estimated remaining: 4h 25m 17s. Rate: 8.1 symbols/min [2025-10-21T17:25:22.241463] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:22.289989] [DEBUG] [LOCAL ] BALL: Loaded 51927 existing records from primary storage. [2025-10-21T17:25:22.290411] [INFO ] [MAIN ] BALL: Loaded 51927 existing records. [2025-10-21T17:25:22.469417] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:22.469769] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-21T17:25:22.469893] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-21T17:25:22.470808] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-21T17:25:22.470867] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-21T17:25:22.815246] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-21T17:25:22.889802] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:22.890316] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-21T17:25:22.914079] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T17:25:22.922452] [INFO ] [REMOTE ] BAH: Full fetch complete (75212 records). [2025-10-21T17:25:22.922578] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-21T17:25:23.310400] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-21T17:25:23.310580] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-21T17:25:23.311410] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-21T17:25:23.311486] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-21T17:25:23.312947] [DEBUG] [LOCAL ] BAH: Trimmed 75212 records to 51653 (keeping 200 days of data) [2025-10-21T17:25:23.366966] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-21T17:25:23.446064] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:25:23.657807] [DEBUG] [LOCAL ] BAH: Primary data saved (51653 records). [2025-10-21T17:25:23.657947] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-21T17:25:23.658026] [INFO ] [MAIN ] Update Progress: 207/2366 symbols completed. BAH took 31.5s. Estimated remaining: 4h 24m 9s. Rate: 8.2 symbols/min [2025-10-21T17:25:23.839242] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:23.839406] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-21T17:25:23.839443] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-21T17:25:23.839561] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-21T17:25:23.839602] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-21T17:25:23.839699] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-21T17:25:23.839764] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-21T17:25:24.156914] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-21T17:25:24.200811] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:24.764677] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:25:24.951098] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-21T17:25:25.426996] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T17:25:25.751139] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-21T17:25:25.951302] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-21T17:25:25.960000] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-21T17:25:25.960139] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-21T17:25:26.435805] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-21T17:25:26.437057] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T17:25:26.437164] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-21T17:25:26.444075] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-21T17:25:26.444997] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-21T17:25:26.449745] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-21T17:25:26.572728] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-21T17:25:26.891447] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-21T17:25:26.891612] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-21T17:25:26.891761] [INFO ] [MAIN ] Update Progress: 208/2366 symbols completed. BAC took 36.8s. Estimated remaining: 4h 23m 19s. Rate: 8.2 symbols/min [2025-10-21T17:25:27.151957] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:27.154298] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T17:25:27.189400] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T17:25:27.241213] [DEBUG] [LOCAL ] BAM: Loaded 52103 existing records from primary storage. [2025-10-21T17:25:27.241580] [INFO ] [MAIN ] BAM: Loaded 52103 existing records. [2025-10-21T17:25:27.351060] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-21T17:25:27.437524] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:27.437837] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-21T17:25:27.437888] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-21T17:25:27.438317] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-21T17:25:27.438375] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-21T17:25:27.821144] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:28.151051] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-21T17:25:28.951004] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-21T17:25:28.986504] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T17:25:28.992878] [INFO ] [REMOTE ] BAK: Full fetch complete (56859 records). [2025-10-21T17:25:28.992982] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-21T17:25:29.381970] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-21T17:25:29.382070] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-21T17:25:29.382803] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-21T17:25:29.382872] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-21T17:25:29.384779] [DEBUG] [LOCAL ] BAK: Trimmed 56859 records to 39479 (keeping 200 days of data) [2025-10-21T17:25:29.596662] [DEBUG] [LOCAL ] BAK: Primary data saved (39479 records). [2025-10-21T17:25:29.596831] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-21T17:25:29.596916] [INFO ] [MAIN ] Update Progress: 209/2366 symbols completed. BAK took 24.5s. Estimated remaining: 4h 22m 25s. Rate: 8.2 symbols/min [2025-10-21T17:25:29.762969] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-21T17:25:29.765400] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:29.818317] [DEBUG] [LOCAL ] BANC: Loaded 51387 existing records from primary storage. [2025-10-21T17:25:29.818685] [INFO ] [MAIN ] BANC: Loaded 51387 existing records. [2025-10-21T17:25:30.000958] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:30.001332] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-21T17:25:30.001389] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-21T17:25:30.026291] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-21T17:25:30.027721] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:25:30.027784] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-21T17:25:30.401778] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:30.551068] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-21T17:25:30.559028] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T17:25:30.589522] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:25:31.351029] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-21T17:25:31.930247] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T17:25:32.151032] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-21T17:25:32.202436] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:25:32.951062] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-21T17:25:33.652981] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T17:25:33.751025] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-21T17:25:34.551084] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-21T17:25:34.789360] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T17:25:35.155441] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:25:35.351054] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-21T17:25:36.034831] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T17:25:36.150993] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-21T17:25:36.384844] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T17:25:36.951055] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-21T17:25:37.751012] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-21T17:25:37.999011] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T17:25:38.205831] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:25:38.240384] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T17:25:38.551135] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-21T17:25:39.351052] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-21T17:25:40.151014] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-21T17:25:40.208607] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:25:40.917457] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T17:25:40.951039] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-21T17:25:41.169726] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:25:41.751028] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-21T17:25:42.305292] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T17:25:42.551086] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-21T17:25:43.351055] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-21T17:25:43.552715] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:25:44.151053] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-21T17:25:44.269450] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:25:44.767312] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T17:25:44.950995] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-21T17:25:45.280230] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T17:25:45.751064] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-21T17:25:46.556259] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-21T17:25:46.569807] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:25:46.587362] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T17:25:47.351053] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-21T17:25:48.151030] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-21T17:25:48.552492] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T17:25:48.555262] [INFO ] [REMOTE ] BALY: Full fetch complete (16135 records). [2025-10-21T17:25:48.555332] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-21T17:25:48.738936] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T17:25:48.739231] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:25:48.739440] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:25:48.739520] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-21T17:25:48.739604] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-21T17:25:48.739756] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-21T17:25:48.739814] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-21T17:25:48.739872] [INFO ] [MAIN ] Update Progress: 210/2366 symbols completed. BALY took 25.1s. Estimated remaining: 4h 24m 19s. Rate: 8.2 symbols/min [2025-10-21T17:25:48.939502] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:48.941745] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-21T17:25:48.952378] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-21T17:25:48.977318] [DEBUG] [LOCAL ] BAP: Loaded 25879 existing records from primary storage. [2025-10-21T17:25:48.977564] [INFO ] [MAIN ] BAP: Loaded 25879 existing records. [2025-10-21T17:25:49.154634] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:49.154906] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-21T17:25:49.154976] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-21T17:25:49.155161] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-21T17:25:49.155201] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-21T17:25:49.502595] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:25:49.751029] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-21T17:25:50.553197] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-21T17:25:50.566557] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-21T17:25:50.650539] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:25:51.072749] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T17:25:51.351046] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-21T17:25:52.150995] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-21T17:25:52.282681] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T17:25:52.535182] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T17:25:52.951016] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-21T17:25:53.750993] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-21T17:25:54.023326] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T17:25:54.463703] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T17:25:54.551015] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-21T17:25:55.051877] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:25:55.351030] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-21T17:25:56.151017] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-21T17:25:56.319846] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T17:25:56.863516] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:25:56.951055] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-21T17:25:57.751020] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-21T17:25:58.184472] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T17:25:58.192866] [INFO ] [REMOTE ] BALL: Full fetch complete (75631 records). [2025-10-21T17:25:58.193011] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-21T17:25:58.564487] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-21T17:25:58.572593] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-21T17:25:58.671280] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-21T17:25:58.671398] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-21T17:25:58.672326] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-21T17:25:58.672410] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-21T17:25:58.673979] [DEBUG] [LOCAL ] BALL: Trimmed 75631 records to 51939 (keeping 200 days of data) [2025-10-21T17:25:58.996273] [DEBUG] [LOCAL ] BALL: Primary data saved (51939 records). [2025-10-21T17:25:58.996528] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-21T17:25:58.997214] [INFO ] [MAIN ] Update Progress: 211/2366 symbols completed. BALL took 36.9s. Estimated remaining: 4h 24m 41s. Rate: 8.1 symbols/min [2025-10-21T17:25:59.144860] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T17:25:59.222320] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:25:59.263710] [DEBUG] [LOCAL ] BARK: Loaded 38200 existing records from primary storage. [2025-10-21T17:25:59.264003] [INFO ] [MAIN ] BARK: Loaded 38200 existing records. [2025-10-21T17:25:59.356155] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-21T17:25:59.446316] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:25:59.446541] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-21T17:25:59.446589] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-21T17:25:59.446884] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-21T17:25:59.446939] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-21T17:25:59.828462] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:00.150996] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-21T17:26:00.488556] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T17:26:00.591874] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T17:26:00.600262] [INFO ] [REMOTE ] BANC: Full fetch complete (74596 records). [2025-10-21T17:26:00.600412] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-21T17:26:00.951489] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-21T17:26:00.993497] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-21T17:26:00.993625] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-21T17:26:00.994430] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-21T17:26:00.994479] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-21T17:26:00.995850] [DEBUG] [LOCAL ] BANC: Trimmed 74596 records to 51384 (keeping 200 days of data) [2025-10-21T17:26:01.305044] [DEBUG] [LOCAL ] BANC: Primary data saved (51384 records). [2025-10-21T17:26:01.305209] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-21T17:26:01.305298] [INFO ] [MAIN ] Update Progress: 212/2366 symbols completed. BANC took 31.7s. Estimated remaining: 4h 23m 42s. Rate: 8.2 symbols/min [2025-10-21T17:26:01.485785] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:01.538104] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-21T17:26:01.538552] [INFO ] [MAIN ] BAX: Loaded 53537 existing records. [2025-10-21T17:26:01.737028] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:01.737354] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-21T17:26:01.737433] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-21T17:26:01.737870] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-21T17:26:01.738008] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-21T17:26:01.759107] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-21T17:26:02.101218] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T17:26:02.169711] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:02.297439] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T17:26:02.551060] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-21T17:26:03.348922] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:26:03.356687] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-21T17:26:04.151083] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-21T17:26:04.395902] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T17:26:04.598582] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:26:04.951008] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-21T17:26:05.750983] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-21T17:26:06.052729] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T17:26:06.426210] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T17:26:06.551088] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-21T17:26:07.047325] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T17:26:07.351012] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-21T17:26:08.151057] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-21T17:26:08.545978] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T17:26:08.554102] [INFO ] [REMOTE ] BAM: Full fetch complete (75181 records). [2025-10-21T17:26:08.554212] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-21T17:26:08.691916] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T17:26:08.729223] [INFO ] [REMOTE ] BAP: Full fetch complete (37413 records). [2025-10-21T17:26:08.730423] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-21T17:26:08.958417] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-21T17:26:09.232256] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-21T17:26:09.237512] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-21T17:26:09.245219] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-21T17:26:09.261387] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-21T17:26:09.312111] [DEBUG] [LOCAL ] BAM: Trimmed 75181 records to 52090 (keeping 200 days of data) [2025-10-21T17:26:09.420107] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-21T17:26:09.446378] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-21T17:26:09.446807] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-21T17:26:09.448044] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-21T17:26:09.453587] [DEBUG] [LOCAL ] BAP: Trimmed 37413 records to 25766 (keeping 200 days of data) [2025-10-21T17:26:09.638363] [DEBUG] [LOCAL ] BAP: Primary data saved (25766 records). [2025-10-21T17:26:09.641466] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-21T17:26:09.712003] [INFO ] [MAIN ] Update Progress: 213/2366 symbols completed. BAP took 21.0s. Estimated remaining: 4h 23m 46s. Rate: 8.2 symbols/min [2025-10-21T17:26:09.759093] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:26:09.844767] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-21T17:26:10.027106] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:10.032933] [DEBUG] [LOCAL ] BB: No existing data file found in primary storage. [2025-10-21T17:26:10.033280] [WARN ] [MAIN ] BB: No existing data found, performing full refresh instead. [2025-10-21T17:26:10.041676] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-21T17:26:10.042764] [DEBUG] [LOCAL ] BAM: Primary data saved (52090 records). [2025-10-21T17:26:10.042853] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-21T17:26:10.043005] [INFO ] [MAIN ] Update Progress: 214/2366 symbols completed. BAM took 43.2s. Estimated remaining: 4h 22m 28s. Rate: 8.2 symbols/min [2025-10-21T17:26:10.042917] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-21T17:26:10.109011] [DEBUG] [LOCAL ] BB: No primary data file found to delete. [2025-10-21T17:26:10.120687] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-21T17:26:10.366195] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:10.600034] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:10.600482] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-21T17:26:10.622595] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-21T17:26:10.623077] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-21T17:26:10.827342] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:10.829160] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T17:26:10.829246] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-21T17:26:10.838732] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-21T17:26:10.839608] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-21T17:26:10.839704] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-21T17:26:11.177528] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:26:11.238047] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:11.351004] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-21T17:26:12.151078] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-21T17:26:12.530380] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:26:12.709307] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T17:26:12.951036] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-21T17:26:13.696513] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T17:26:13.751031] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-21T17:26:14.551072] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-21T17:26:15.351081] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-21T17:26:15.563068] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-21T17:26:15.778142] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-21T17:26:16.151065] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-21T17:26:16.466026] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T17:26:16.718395] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:26:16.951038] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-21T17:26:17.751017] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-21T17:26:18.551062] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-21T17:26:18.631745] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-21T17:26:18.897709] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T17:26:19.287481] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T17:26:19.351002] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-21T17:26:20.151034] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-21T17:26:20.568947] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T17:26:20.716796] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:26:20.951104] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-21T17:26:21.751084] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-21T17:26:22.551005] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-21T17:26:22.795331] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-21T17:26:23.076874] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T17:26:23.351009] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-21T17:26:23.448026] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:26:24.002812] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T17:26:24.151094] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-21T17:26:24.951057] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-21T17:26:25.751018] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-21T17:26:26.069217] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T17:26:26.551082] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-21T17:26:26.861502] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T17:26:27.351001] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-21T17:26:28.197704] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T17:26:28.209165] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-21T17:26:28.983313] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T17:26:28.994083] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-21T17:26:30.556600] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (7.21 seconds). [2025-10-21T17:26:30.568410] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-21T17:26:31.255746] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-21T17:26:31.268400] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-21T17:26:32.169383] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (6.42 seconds). [2025-10-21T17:26:32.176626] [INFO ] [REMOTE ] BARK: Full fetch complete (56323 records). [2025-10-21T17:26:32.176839] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-21T17:26:32.574122] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-21T17:26:32.574206] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-21T17:26:32.574863] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-21T17:26:32.574927] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-21T17:26:32.576103] [DEBUG] [LOCAL ] BARK: Trimmed 56323 records to 38230 (keeping 200 days of data) [2025-10-21T17:26:32.789819] [DEBUG] [LOCAL ] BARK: Primary data saved (38230 records). [2025-10-21T17:26:32.789950] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-21T17:26:32.790025] [INFO ] [MAIN ] Update Progress: 215/2366 symbols completed. BARK took 33.8s. Estimated remaining: 4h 24m 55s. Rate: 8.1 symbols/min [2025-10-21T17:26:32.966628] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:33.006774] [DEBUG] [LOCAL ] BBAR: Loaded 42660 existing records from primary storage. [2025-10-21T17:26:33.007146] [INFO ] [MAIN ] BBAR: Loaded 42660 existing records. [2025-10-21T17:26:33.190170] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:33.190560] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-21T17:26:33.190676] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-21T17:26:33.190908] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-21T17:26:33.190966] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-21T17:26:33.410487] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-21T17:26:33.493714] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-21T17:26:33.596935] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:33.597228] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-21T17:26:35.364452] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T17:26:35.373578] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-21T17:26:35.900853] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-21T17:26:35.911614] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-21T17:26:36.210234] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (8.00 seconds). [2025-10-21T17:26:36.221530] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-21T17:26:36.776983] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:26:36.785363] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-21T17:26:38.015962] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T17:26:38.024331] [INFO ] [REMOTE ] BAX: Full fetch complete (77618 records). [2025-10-21T17:26:38.024490] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-21T17:26:38.455451] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-21T17:26:38.455601] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-21T17:26:38.456987] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-21T17:26:38.457160] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-21T17:26:38.483497] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T17:26:38.481808] [DEBUG] [LOCAL ] BAX: Trimmed 77618 records to 53537 (keeping 200 days of data) [2025-10-21T17:26:38.492464] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-21T17:26:38.808347] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-21T17:26:38.869802] [DEBUG] [LOCAL ] BAX: Primary data saved (53537 records). [2025-10-21T17:26:38.870456] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-21T17:26:38.870285] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-21T17:26:38.871258] [INFO ] [MAIN ] Update Progress: 216/2366 symbols completed. BAX took 37.6s. Estimated remaining: 4h 24m 34s. Rate: 8.1 symbols/min [2025-10-21T17:26:39.046390] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:39.097185] [DEBUG] [LOCAL ] BBD: Loaded 53276 existing records from primary storage. [2025-10-21T17:26:39.097502] [INFO ] [MAIN ] BBD: Loaded 53276 existing records. [2025-10-21T17:26:39.277134] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:39.277365] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-21T17:26:39.277412] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-21T17:26:39.277639] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-21T17:26:39.277725] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-21T17:26:39.578613] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (8.31 seconds). [2025-10-21T17:26:39.619879] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-21T17:26:39.702787] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:39.703321] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-21T17:26:40.116553] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T17:26:40.125237] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-21T17:26:41.480160] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:26:41.490537] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-21T17:26:41.575032] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:26:41.583987] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-21T17:26:41.628756] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T17:26:41.686801] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-21T17:26:41.751035] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-21T17:26:42.551051] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-21T17:26:43.118811] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:26:43.247541] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T17:26:43.351014] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-21T17:26:43.837036] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T17:26:43.845195] [INFO ] [REMOTE ] BB: Full fetch complete (76979 records). [2025-10-21T17:26:43.845325] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-21T17:26:44.156141] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-21T17:26:44.236162] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-21T17:26:44.236244] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-21T17:26:44.237079] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-21T17:26:44.237147] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-21T17:26:44.238593] [DEBUG] [LOCAL ] BB: Trimmed 76979 records to 52882 (keeping 200 days of data) [2025-10-21T17:26:44.533685] [DEBUG] [LOCAL ] BB: Primary data saved (52882 records). [2025-10-21T17:26:44.533823] [INFO ] [MAIN ] BB: Full history saved. [2025-10-21T17:26:44.533894] [INFO ] [MAIN ] Update Progress: 217/2366 symbols completed. BB took 34.8s. Estimated remaining: 4h 24m 10s. Rate: 8.1 symbols/min [2025-10-21T17:26:44.702624] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:44.734541] [DEBUG] [LOCAL ] BBDC: Loaded 33048 existing records from primary storage. [2025-10-21T17:26:44.734908] [INFO ] [MAIN ] BBDC: Loaded 33048 existing records. [2025-10-21T17:26:44.913727] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:44.914201] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-21T17:26:44.914317] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-21T17:26:44.914577] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-21T17:26:44.914731] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-21T17:26:45.270638] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T17:26:45.378865] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:45.383020] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-21T17:26:45.382566] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-21T17:26:45.751040] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-21T17:26:45.883205] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T17:26:46.551004] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-21T17:26:46.714904] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:26:47.351059] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-21T17:26:47.569459] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:26:48.151051] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-21T17:26:48.655194] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T17:26:48.951076] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-21T17:26:49.751154] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-21T17:26:49.863444] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (3.31 seconds). [2025-10-21T17:26:49.874172] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-21T17:26:49.874459] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-21T17:26:50.282843] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T17:26:50.352561] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-21T17:26:50.352714] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-21T17:26:50.353733] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-21T17:26:50.353802] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-21T17:26:50.355544] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-21T17:26:50.563054] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-21T17:26:50.681766] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-21T17:26:50.681925] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-21T17:26:50.682010] [INFO ] [MAIN ] Update Progress: 218/2366 symbols completed. BBAI took 40.6s. Estimated remaining: 4h 23m 50s. Rate: 8.1 symbols/min [2025-10-21T17:26:50.865294] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:50.872484] [DEBUG] [LOCAL ] BBDO: Loaded 5012 existing records from primary storage. [2025-10-21T17:26:50.872681] [INFO ] [MAIN ] BBDO: Loaded 5012 existing records. [2025-10-21T17:26:51.060242] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:51.060725] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-21T17:26:51.060868] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-21T17:26:51.061193] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-21T17:26:51.061326] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-21T17:26:51.344471] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-21T17:26:51.404378] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-21T17:26:51.484620] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:51.508441] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:26:52.151068] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-21T17:26:52.397241] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T17:26:52.825253] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T17:26:52.951062] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-21T17:26:53.400808] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T17:26:53.751073] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-21T17:26:54.035145] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T17:26:54.551031] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-21T17:26:55.351068] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-21T17:26:55.504544] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:26:55.511953] [INFO ] [REMOTE ] BBAR: Full fetch complete (61317 records). [2025-10-21T17:26:55.512077] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-21T17:26:55.897221] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-21T17:26:55.897298] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-21T17:26:55.897977] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-21T17:26:55.898040] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-21T17:26:55.899304] [DEBUG] [LOCAL ] BBAR: Trimmed 61317 records to 42660 (keeping 200 days of data) [2025-10-21T17:26:56.157930] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-21T17:26:56.157785] [DEBUG] [LOCAL ] BBAR: Primary data saved (42660 records). [2025-10-21T17:26:56.158520] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-21T17:26:56.160136] [INFO ] [MAIN ] Update Progress: 219/2366 symbols completed. BBAR took 23.4s. Estimated remaining: 4h 23m 25s. Rate: 8.2 symbols/min [2025-10-21T17:26:56.334775] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:26:56.377027] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T17:26:56.402724] [DEBUG] [LOCAL ] BBN: Loaded 17924 existing records from primary storage. [2025-10-21T17:26:56.402959] [INFO ] [MAIN ] BBN: Loaded 17924 existing records. [2025-10-21T17:26:56.580709] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:26:56.581152] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-21T17:26:56.581230] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-21T17:26:56.581432] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-21T17:26:56.581492] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-21T17:26:56.928846] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:26:56.972351] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-21T17:26:56.941986] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T17:26:57.013440] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:26:57.751045] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-21T17:26:58.551006] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-21T17:26:58.879083] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:26:59.351040] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-21T17:26:59.944338] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:27:00.061202] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T17:27:00.151003] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-21T17:27:00.951052] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-21T17:27:01.235049] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (4.26 seconds). [2025-10-21T17:27:01.473055] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T17:27:01.751023] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-21T17:27:01.902626] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:27:02.551045] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-21T17:27:02.987891] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:27:03.351044] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-21T17:27:03.507607] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:27:04.151054] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-21T17:27:04.478910] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:27:04.951006] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-21T17:27:04.972841] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T17:27:05.751023] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-21T17:27:06.299021] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T17:27:06.305604] [INFO ] [REMOTE ] BBDC: Full fetch complete (48870 records). [2025-10-21T17:27:06.305763] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-21T17:27:06.556615] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-21T17:27:06.706549] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-21T17:27:06.706866] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-21T17:27:06.707495] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-21T17:27:06.707557] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-21T17:27:06.708534] [DEBUG] [LOCAL ] BBDC: Trimmed 48870 records to 32985 (keeping 200 days of data) [2025-10-21T17:27:06.899206] [DEBUG] [LOCAL ] BBDC: Primary data saved (32985 records). [2025-10-21T17:27:06.899352] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-21T17:27:06.899433] [INFO ] [MAIN ] Update Progress: 220/2366 symbols completed. BBDC took 22.4s. Estimated remaining: 4h 23m 50s. Rate: 8.1 symbols/min [2025-10-21T17:27:07.068092] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:07.068340] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-21T17:27:07.068381] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-21T17:27:07.068519] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-21T17:27:07.068559] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-21T17:27:07.068597] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-21T17:27:07.068627] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-21T17:27:07.355494] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-21T17:27:07.433495] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:07.458715] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T17:27:07.634469] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T17:27:08.151042] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-21T17:27:08.411396] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T17:27:08.610557] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T17:27:08.951045] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-21T17:27:09.402863] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T17:27:09.751073] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-21T17:27:10.362785] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T17:27:10.551028] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-21T17:27:10.750084] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:27:10.750401] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-21T17:27:10.750486] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:27:10.750561] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-21T17:27:10.750626] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:27:10.750718] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-21T17:27:10.750779] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-21T17:27:10.750815] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-21T17:27:10.750854] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-21T17:27:10.750898] [INFO ] [MAIN ] Update Progress: 221/2366 symbols completed. BBT took 3.9s. Estimated remaining: 4h 23m 9s. Rate: 8.2 symbols/min [2025-10-21T17:27:10.930933] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:10.939002] [DEBUG] [LOCAL ] BBU: Loaded 5727 existing records from primary storage. [2025-10-21T17:27:10.939201] [INFO ] [MAIN ] BBU: Loaded 5727 existing records. [2025-10-21T17:27:11.128025] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:11.128294] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-21T17:27:11.128353] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-21T17:27:11.128624] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-21T17:27:11.128855] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-21T17:27:11.356206] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-21T17:27:11.513108] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:12.005776] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T17:27:12.151004] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-21T17:27:12.726626] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T17:27:12.951051] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-21T17:27:13.751085] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-21T17:27:14.550998] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-21T17:27:14.715093] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:27:15.226288] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T17:27:15.351037] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-21T17:27:15.667303] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T17:27:15.677097] [INFO ] [REMOTE ] BBD: Full fetch complete (77271 records). [2025-10-21T17:27:15.677348] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-21T17:27:15.776379] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T17:27:16.147081] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-21T17:27:16.147203] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-21T17:27:16.148410] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-21T17:27:16.148484] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-21T17:27:16.150769] [DEBUG] [LOCAL ] BBD: Trimmed 77271 records to 53271 (keeping 200 days of data) [2025-10-21T17:27:16.151335] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-21T17:27:16.492844] [DEBUG] [LOCAL ] BBD: Primary data saved (53271 records). [2025-10-21T17:27:16.493040] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-21T17:27:16.493818] [INFO ] [MAIN ] Update Progress: 222/2366 symbols completed. BBD took 37.6s. Estimated remaining: 4h 22m 46s. Rate: 8.2 symbols/min [2025-10-21T17:27:16.679889] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:16.699685] [DEBUG] [LOCAL ] BBUC: Loaded 13935 existing records from primary storage. [2025-10-21T17:27:16.700064] [INFO ] [MAIN ] BBUC: Loaded 13935 existing records. [2025-10-21T17:27:16.893765] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:16.894125] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-21T17:27:16.894179] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-21T17:27:16.894453] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-21T17:27:16.894514] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-21T17:27:16.956403] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-21T17:27:16.994900] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T17:27:17.024255] [INFO ] [REMOTE ] BBDO: Full fetch complete (7473 records). [2025-10-21T17:27:17.029546] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-21T17:27:17.541944] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:17.757184] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-21T17:27:17.758504] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-21T17:27:17.758619] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-21T17:27:17.758982] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-21T17:27:17.759046] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-21T17:27:17.759755] [DEBUG] [LOCAL ] BBDO: Trimmed 7473 records to 4986 (keeping 200 days of data) [2025-10-21T17:27:17.801599] [DEBUG] [LOCAL ] BBDO: Primary data saved (4986 records). [2025-10-21T17:27:17.801868] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-21T17:27:17.802022] [INFO ] [MAIN ] Update Progress: 223/2366 symbols completed. BBDO took 27.1s. Estimated remaining: 4h 21m 40s. Rate: 8.2 symbols/min [2025-10-21T17:27:17.994015] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:18.050263] [DEBUG] [LOCAL ] BBVA: Loaded 49119 existing records from primary storage. [2025-10-21T17:27:18.050753] [INFO ] [MAIN ] BBVA: Loaded 49119 existing records. [2025-10-21T17:27:18.194361] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T17:27:18.260006] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:18.260387] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-21T17:27:18.260467] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-21T17:27:18.261503] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-21T17:27:18.261577] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-21T17:27:18.466633] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-21T17:27:18.556150] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-21T17:27:18.670773] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:19.351015] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-21T17:27:19.635018] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T17:27:19.911578] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T17:27:20.151031] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-21T17:27:20.951046] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-21T17:27:21.183558] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T17:27:21.732833] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T17:27:21.750981] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-21T17:27:22.551036] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-21T17:27:23.067573] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T17:27:23.351040] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-21T17:27:23.855481] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T17:27:24.151060] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-21T17:27:24.603225] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-21T17:27:24.951063] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-21T17:27:25.751048] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-21T17:27:26.125487] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T17:27:26.128530] [INFO ] [REMOTE ] BBN: Full fetch complete (25152 records). [2025-10-21T17:27:26.128629] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-21T17:27:26.502411] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-21T17:27:26.502661] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-21T17:27:26.503126] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-21T17:27:26.503204] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-21T17:27:26.504141] [DEBUG] [LOCAL ] BBN: Trimmed 25152 records to 17941 (keeping 200 days of data) [2025-10-21T17:27:26.557864] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-21T17:27:26.615004] [DEBUG] [LOCAL ] BBN: Primary data saved (17941 records). [2025-10-21T17:27:26.615146] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-21T17:27:26.615223] [INFO ] [MAIN ] Update Progress: 224/2366 symbols completed. BBN took 30.5s. Estimated remaining: 4h 21m 47s. Rate: 8.2 symbols/min [2025-10-21T17:27:26.739422] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:27:26.775362] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T17:27:26.837970] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:26.863468] [DEBUG] [LOCAL ] BBW: Loaded 27378 existing records from primary storage. [2025-10-21T17:27:26.863734] [INFO ] [MAIN ] BBW: Loaded 27378 existing records. [2025-10-21T17:27:27.051069] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:27.051263] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-21T17:27:27.051316] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-21T17:27:27.051518] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-21T17:27:27.051573] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-21T17:27:27.155962] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T17:27:27.356104] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-21T17:27:27.417726] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:27.854392] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T17:27:28.151040] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-21T17:27:28.874687] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T17:27:28.951015] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-21T17:27:29.482763] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T17:27:29.751041] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-21T17:27:30.550991] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-21T17:27:30.693312] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T17:27:31.350987] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-21T17:27:31.365533] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T17:27:32.151028] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-21T17:27:32.834693] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:27:32.951055] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-21T17:27:33.682028] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T17:27:33.684391] [INFO ] [REMOTE ] BBU: Full fetch complete (7492 records). [2025-10-21T17:27:33.684457] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-21T17:27:33.756125] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-21T17:27:34.061452] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-21T17:27:34.061573] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-21T17:27:34.062003] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-21T17:27:34.062129] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-21T17:27:34.062854] [DEBUG] [LOCAL ] BBU: Trimmed 7492 records to 5757 (keeping 200 days of data) [2025-10-21T17:27:34.099201] [DEBUG] [LOCAL ] BBU: Primary data saved (5757 records). [2025-10-21T17:27:34.111921] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-21T17:27:34.112619] [INFO ] [MAIN ] Update Progress: 225/2366 symbols completed. BBU took 23.4s. Estimated remaining: 4h 21m 41s. Rate: 8.2 symbols/min [2025-10-21T17:27:34.113162] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T17:27:34.291141] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:34.340167] [DEBUG] [LOCAL ] BBWI: Loaded 53584 existing records from primary storage. [2025-10-21T17:27:34.340480] [INFO ] [MAIN ] BBWI: Loaded 53584 existing records. [2025-10-21T17:27:34.515912] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:34.516242] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-21T17:27:34.516309] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-21T17:27:34.517449] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-21T17:27:34.517540] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-21T17:27:34.561110] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-21T17:27:34.646465] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T17:27:34.889589] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:35.351044] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-21T17:27:36.017409] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T17:27:36.151000] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-21T17:27:36.951012] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-21T17:27:37.081279] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T17:27:37.265257] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T17:27:37.751078] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-21T17:27:38.301230] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T17:27:38.551038] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-21T17:27:39.351347] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-21T17:27:39.354510] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T17:27:40.151080] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-21T17:27:40.313392] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:27:40.381700] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T17:27:40.951000] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-21T17:27:41.181177] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T17:27:41.751101] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-21T17:27:42.551014] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-21T17:27:42.632512] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:27:43.108327] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:27:43.128524] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T17:27:43.351039] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-21T17:27:44.151027] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-21T17:27:44.951004] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-21T17:27:45.131567] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T17:27:45.476844] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:27:45.480587] [INFO ] [REMOTE ] BBUC: Full fetch complete (19213 records). [2025-10-21T17:27:45.480705] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-21T17:27:45.758478] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-21T17:27:45.843362] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-21T17:27:45.843443] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-21T17:27:45.843841] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-21T17:27:45.843903] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-21T17:27:45.844494] [DEBUG] [LOCAL ] BBUC: Trimmed 19213 records to 13958 (keeping 200 days of data) [2025-10-21T17:27:45.925261] [DEBUG] [LOCAL ] BBUC: Primary data saved (13958 records). [2025-10-21T17:27:45.925396] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-21T17:27:45.925474] [INFO ] [MAIN ] Update Progress: 226/2366 symbols completed. BBUC took 29.4s. Estimated remaining: 4h 22m 16s. Rate: 8.2 symbols/min [2025-10-21T17:27:46.091898] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:46.141823] [DEBUG] [LOCAL ] BBY: Loaded 53436 existing records from primary storage. [2025-10-21T17:27:46.142151] [INFO ] [MAIN ] BBY: Loaded 53436 existing records. [2025-10-21T17:27:46.320201] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:46.320394] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-21T17:27:46.320455] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-21T17:27:46.321422] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-21T17:27:46.321493] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-21T17:27:46.559603] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-21T17:27:46.677850] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:46.951197] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T17:27:47.351032] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-21T17:27:47.445475] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:27:47.737318] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T17:27:48.151058] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-21T17:27:48.951039] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-21T17:27:49.192601] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T17:27:49.435505] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T17:27:49.751028] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-21T17:27:50.551023] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-21T17:27:51.073558] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T17:27:51.351078] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-21T17:27:52.151075] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-21T17:27:53.381334] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T17:27:53.387517] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-21T17:27:53.419782] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T17:27:53.751001] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-21T17:27:53.878857] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (4.13 seconds). [2025-10-21T17:27:54.550991] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-21T17:27:54.851914] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:27:55.351042] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-21T17:27:55.433922] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (4.88 seconds). [2025-10-21T17:27:55.496161] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:27:56.151046] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-21T17:27:56.891770] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T17:27:56.898433] [INFO ] [REMOTE ] BBW: Full fetch complete (39628 records). [2025-10-21T17:27:56.898557] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-21T17:27:56.968632] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-21T17:27:57.055212] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-21T17:27:57.320810] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-21T17:27:57.320887] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-21T17:27:57.321374] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-21T17:27:57.321417] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-21T17:27:57.322248] [DEBUG] [LOCAL ] BBW: Trimmed 39628 records to 27246 (keeping 200 days of data) [2025-10-21T17:27:57.492825] [DEBUG] [LOCAL ] BBW: Primary data saved (27246 records). [2025-10-21T17:27:57.492971] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-21T17:27:57.493052] [INFO ] [MAIN ] Update Progress: 227/2366 symbols completed. BBW took 30.9s. Estimated remaining: 4h 22m 49s. Rate: 8.1 symbols/min [2025-10-21T17:27:57.666636] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:27:57.712770] [DEBUG] [LOCAL ] BC: Loaded 43999 existing records from primary storage. [2025-10-21T17:27:57.713026] [INFO ] [MAIN ] BC: Loaded 43999 existing records. [2025-10-21T17:27:57.755596] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-21T17:27:57.897547] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:27:57.897807] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-21T17:27:57.897866] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-21T17:27:57.898608] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-21T17:27:57.898701] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-21T17:27:58.269787] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:27:58.290799] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T17:27:58.551008] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-21T17:27:58.684070] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T17:27:59.351013] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-21T17:27:59.829485] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T17:28:00.117476] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:28:00.150980] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-21T17:28:00.950986] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-21T17:28:01.040856] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T17:28:01.048509] [INFO ] [REMOTE ] BBVA: Full fetch complete (71884 records). [2025-10-21T17:28:01.048622] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-21T17:28:01.439744] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-21T17:28:01.439848] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-21T17:28:01.440597] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-21T17:28:01.440777] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-21T17:28:01.442113] [DEBUG] [LOCAL ] BBVA: Trimmed 71884 records to 49122 (keeping 200 days of data) [2025-10-21T17:28:01.741507] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:28:01.753383] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-21T17:28:01.761992] [DEBUG] [LOCAL ] BBVA: Primary data saved (49122 records). [2025-10-21T17:28:01.762074] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-21T17:28:01.762143] [INFO ] [MAIN ] Update Progress: 228/2366 symbols completed. BBVA took 44.0s. Estimated remaining: 4h 22m 12s. Rate: 8.2 symbols/min [2025-10-21T17:28:01.931946] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:01.964889] [DEBUG] [LOCAL ] BCAT: Loaded 34298 existing records from primary storage. [2025-10-21T17:28:01.965148] [INFO ] [MAIN ] BCAT: Loaded 34298 existing records. [2025-10-21T17:28:02.170393] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:02.170695] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-21T17:28:02.170774] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-21T17:28:02.171055] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-21T17:28:02.171129] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-21T17:28:02.523189] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:02.551041] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-21T17:28:02.905192] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T17:28:03.351005] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-21T17:28:03.641059] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:28:03.791045] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T17:28:04.151098] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-21T17:28:04.950994] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-21T17:28:05.106720] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T17:28:05.439795] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:28:05.751033] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-21T17:28:06.551090] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-21T17:28:06.806841] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:28:07.351068] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-21T17:28:07.734838] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T17:28:07.743508] [INFO ] [REMOTE ] BBWI: Full fetch complete (77631 records). [2025-10-21T17:28:07.743726] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-21T17:28:08.143711] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-21T17:28:08.143810] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-21T17:28:08.144609] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-21T17:28:08.144701] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-21T17:28:08.146183] [DEBUG] [LOCAL ] BBWI: Trimmed 77631 records to 53591 (keeping 200 days of data) [2025-10-21T17:28:08.198592] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-21T17:28:08.280803] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T17:28:08.497069] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-21T17:28:08.497198] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-21T17:28:08.497273] [INFO ] [MAIN ] Update Progress: 229/2366 symbols completed. BBWI took 34.4s. Estimated remaining: 4h 21m 59s. Rate: 8.2 symbols/min [2025-10-21T17:28:08.671087] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:08.699122] [DEBUG] [LOCAL ] BCC: Loaded 28671 existing records from primary storage. [2025-10-21T17:28:08.699433] [INFO ] [MAIN ] BCC: Loaded 28671 existing records. [2025-10-21T17:28:08.885072] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:08.885236] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-21T17:28:08.885284] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-21T17:28:08.885551] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-21T17:28:08.885613] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-21T17:28:08.955988] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-21T17:28:09.259392] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:09.288934] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T17:28:09.751008] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-21T17:28:09.904822] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T17:28:10.044883] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T17:28:10.551024] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-21T17:28:11.351030] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-21T17:28:11.371354] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:28:12.151022] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-21T17:28:12.364895] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:28:12.951024] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-21T17:28:13.022290] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T17:28:13.210240] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T17:28:13.751020] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-21T17:28:14.181357] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T17:28:14.551053] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-21T17:28:15.351034] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-21T17:28:15.877785] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T17:28:15.961393] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:28:16.151038] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-21T17:28:16.719342] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:28:16.951070] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-21T17:28:17.537215] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:28:17.751026] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-21T17:28:18.098731] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T17:28:18.551051] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-21T17:28:19.064343] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T17:28:19.351024] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-21T17:28:20.151014] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-21T17:28:20.377708] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T17:28:20.618487] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T17:28:20.951002] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-21T17:28:21.695854] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T17:28:21.751020] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-21T17:28:22.223551] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T17:28:22.551045] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-21T17:28:23.174894] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:28:23.351088] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-21T17:28:23.930913] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T17:28:24.151077] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-21T17:28:24.951078] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-21T17:28:25.053330] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T17:28:25.064971] [INFO ] [REMOTE ] BBY: Full fetch complete (77009 records). [2025-10-21T17:28:25.065194] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-21T17:28:25.066054] [FATAL] [VALIDATOR ] BBY: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:28:25.066188] [FATAL] [MAIN ] BBY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:28:25.066244] [WARN ] [MAIN ] BBY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:28:25.066314] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-21T17:28:25.066383] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-10-21T17:28:25.066423] [INFO ] [LOCAL ] BBY: Starting deletion of derivative data. [2025-10-21T17:28:25.066578] [DEBUG] [LOCAL ] BBY: Deleted derivative data file. [2025-10-21T17:28:25.066707] [INFO ] [MAIN ] Update Progress: 230/2366 symbols completed. BBY took 39.1s. Estimated remaining: 4h 23m 17s. Rate: 8.1 symbols/min [2025-10-21T17:28:25.240252] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:25.262521] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:28:25.315419] [DEBUG] [LOCAL ] BCE: Loaded 52271 existing records from primary storage. [2025-10-21T17:28:25.315777] [INFO ] [MAIN ] BCE: Loaded 52271 existing records. [2025-10-21T17:28:25.493812] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:25.494045] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-21T17:28:25.494093] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-21T17:28:25.494283] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-21T17:28:25.494325] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-21T17:28:25.758897] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-21T17:28:25.849084] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:26.203333] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:28:26.551051] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-21T17:28:27.351070] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-21T17:28:27.386352] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T17:28:27.392881] [INFO ] [REMOTE ] BCAT: Full fetch complete (50067 records). [2025-10-21T17:28:27.393037] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-21T17:28:27.797807] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-21T17:28:27.797944] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-21T17:28:27.805014] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-21T17:28:27.817214] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T17:28:27.816370] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-21T17:28:27.826282] [DEBUG] [LOCAL ] BCAT: Trimmed 50067 records to 34272 (keeping 200 days of data) [2025-10-21T17:28:28.031415] [DEBUG] [LOCAL ] BCAT: Primary data saved (34272 records). [2025-10-21T17:28:28.031540] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-21T17:28:28.031613] [INFO ] [MAIN ] Update Progress: 231/2366 symbols completed. BCAT took 26.3s. Estimated remaining: 4h 22m 29s. Rate: 8.1 symbols/min [2025-10-21T17:28:28.156176] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-21T17:28:28.199955] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:28.228686] [DEBUG] [LOCAL ] BCH: Loaded 30410 existing records from primary storage. [2025-10-21T17:28:28.228949] [INFO ] [MAIN ] BCH: Loaded 30410 existing records. [2025-10-21T17:28:28.405943] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:28.406268] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-21T17:28:28.406316] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-21T17:28:28.406512] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-21T17:28:28.406567] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-21T17:28:28.756941] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:28.807304] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:28:28.951003] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-21T17:28:29.343458] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T17:28:29.751043] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-21T17:28:29.781924] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T17:28:30.551056] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-21T17:28:31.351011] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-21T17:28:31.663063] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T17:28:31.928513] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:28:31.934022] [INFO ] [REMOTE ] BCC: Full fetch complete (41595 records). [2025-10-21T17:28:31.934113] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-21T17:28:32.161169] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-21T17:28:32.357843] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-21T17:28:32.357934] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-21T17:28:32.358523] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-21T17:28:32.358586] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-21T17:28:32.359616] [DEBUG] [LOCAL ] BCC: Trimmed 41595 records to 28741 (keeping 200 days of data) [2025-10-21T17:28:32.534467] [DEBUG] [LOCAL ] BCC: Primary data saved (28741 records). [2025-10-21T17:28:32.534599] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-21T17:28:32.534706] [INFO ] [MAIN ] Update Progress: 232/2366 symbols completed. BCC took 24.0s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-21T17:28:32.703188] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:32.725235] [DEBUG] [LOCAL ] BCO: Loaded 25219 existing records from primary storage. [2025-10-21T17:28:32.725492] [INFO ] [MAIN ] BCO: Loaded 25219 existing records. [2025-10-21T17:28:32.904925] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:32.905265] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-21T17:28:32.905409] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-21T17:28:32.905832] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-21T17:28:32.905890] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-21T17:28:32.960487] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-21T17:28:33.029618] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T17:28:33.068114] [INFO ] [REMOTE ] BC: Full fetch complete (63684 records). [2025-10-21T17:28:33.090789] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-21T17:28:33.536160] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:33.756677] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-21T17:28:33.757410] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-21T17:28:33.757736] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-21T17:28:33.759351] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-21T17:28:33.759685] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-21T17:28:33.760981] [DEBUG] [LOCAL ] BC: Trimmed 63684 records to 43912 (keeping 200 days of data) [2025-10-21T17:28:34.032815] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T17:28:34.077990] [DEBUG] [LOCAL ] BC: Primary data saved (43912 records). [2025-10-21T17:28:34.078126] [INFO ] [MAIN ] BC: Full history saved. [2025-10-21T17:28:34.078789] [INFO ] [MAIN ] Update Progress: 233/2366 symbols completed. BC took 36.6s. Estimated remaining: 4h 20m 54s. Rate: 8.2 symbols/min [2025-10-21T17:28:34.226617] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:28:34.280086] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:34.280253] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-10-21T17:28:34.280289] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-10-21T17:28:34.280397] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-21T17:28:34.280437] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-21T17:28:34.280475] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-21T17:28:34.280508] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-21T17:28:34.560336] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-21T17:28:34.642101] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:34.803334] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T17:28:35.351035] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-21T17:28:35.900327] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:28:36.138903] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T17:28:36.150986] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-21T17:28:36.951022] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-21T17:28:37.445385] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T17:28:37.751049] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-21T17:28:37.976918] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T17:28:38.551020] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-21T17:28:39.158976] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T17:28:39.351019] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-21T17:28:40.079007] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:28:40.151007] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-21T17:28:40.599685] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T17:28:40.951073] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-21T17:28:41.751001] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-21T17:28:42.102515] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T17:28:42.556087] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-21T17:28:42.565916] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T17:28:42.877874] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T17:28:43.351062] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-21T17:28:43.975886] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:28:44.151008] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-21T17:28:44.951002] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-21T17:28:45.124740] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T17:28:45.746294] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T17:28:45.751047] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-21T17:28:46.551042] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-21T17:28:46.665516] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T17:28:47.351072] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-21T17:28:47.946031] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-21T17:28:47.972768] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:28:48.150996] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-21T17:28:48.951030] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-21T17:28:49.272065] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T17:28:49.751046] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-21T17:28:50.295233] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T17:28:50.538988] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-21T17:28:50.550976] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-21T17:28:51.350985] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-21T17:28:51.500982] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:28:51.836021] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T17:28:52.151021] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-21T17:28:52.951006] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-21T17:28:53.170253] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T17:28:53.373507] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T17:28:53.379074] [INFO ] [REMOTE ] BCH: Full fetch complete (41911 records). [2025-10-21T17:28:53.379185] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-21T17:28:53.752023] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-21T17:28:53.752274] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-21T17:28:53.752487] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-21T17:28:53.753609] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-21T17:28:53.753708] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-21T17:28:53.754729] [DEBUG] [LOCAL ] BCH: Trimmed 41911 records to 30256 (keeping 200 days of data) [2025-10-21T17:28:53.925790] [DEBUG] [LOCAL ] BCH: Primary data saved (30256 records). [2025-10-21T17:28:53.925914] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-21T17:28:53.925987] [INFO ] [MAIN ] Update Progress: 234/2366 symbols completed. BCH took 25.9s. Estimated remaining: 4h 22m 41s. Rate: 8.1 symbols/min [2025-10-21T17:28:54.102599] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:54.118303] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T17:28:54.148125] [DEBUG] [LOCAL ] BCSF: Loaded 28311 existing records from primary storage. [2025-10-21T17:28:54.148437] [INFO ] [MAIN ] BCSF: Loaded 28311 existing records. [2025-10-21T17:28:54.328256] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:54.328497] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-21T17:28:54.328550] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-21T17:28:54.328752] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-21T17:28:54.328808] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-21T17:28:54.556137] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-21T17:28:54.679964] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:55.351050] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-21T17:28:55.619804] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T17:28:56.151008] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-21T17:28:56.318626] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T17:28:56.548148] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T17:28:56.551226] [INFO ] [REMOTE ] BCO: Full fetch complete (36163 records). [2025-10-21T17:28:56.551297] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-21T17:28:56.920050] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-21T17:28:56.920192] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-21T17:28:56.920693] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-21T17:28:56.920752] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-21T17:28:56.921464] [DEBUG] [LOCAL ] BCO: Trimmed 36163 records to 25135 (keeping 200 days of data) [2025-10-21T17:28:56.972819] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-21T17:28:57.071701] [DEBUG] [LOCAL ] BCO: Primary data saved (25135 records). [2025-10-21T17:28:57.071829] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-21T17:28:57.071904] [INFO ] [MAIN ] Update Progress: 235/2366 symbols completed. BCO took 24.5s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-21T17:28:57.239104] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:28:57.259419] [DEBUG] [LOCAL ] BCX: Loaded 22104 existing records from primary storage. [2025-10-21T17:28:57.259661] [INFO ] [MAIN ] BCX: Loaded 22104 existing records. [2025-10-21T17:28:57.433706] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:28:57.433912] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-21T17:28:57.433958] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-21T17:28:57.434177] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-21T17:28:57.434232] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-21T17:28:57.767579] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-21T17:28:57.800684] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:28:57.891894] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T17:28:58.551053] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-21T17:28:58.689872] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T17:28:58.760308] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:28:59.351033] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-21T17:29:00.151008] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-21T17:29:00.204506] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T17:29:00.754920] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T17:29:00.951011] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-21T17:29:01.751088] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-21T17:29:01.809760] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:29:01.841505] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T17:29:02.551030] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-21T17:29:03.350995] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-21T17:29:03.560803] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T17:29:03.761882] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T17:29:04.151006] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-21T17:29:04.473417] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:29:04.951022] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-21T17:29:05.751036] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-21T17:29:05.887233] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T17:29:05.896408] [INFO ] [REMOTE ] BCS: Full fetch complete (77522 records). [2025-10-21T17:29:05.896558] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-21T17:29:06.330878] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T17:29:06.329743] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-21T17:29:06.336998] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-21T17:29:06.337969] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-21T17:29:06.338380] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-21T17:29:06.339857] [DEBUG] [LOCAL ] BCS: Trimmed 77522 records to 53441 (keeping 200 days of data) [2025-10-21T17:29:06.552523] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-21T17:29:06.667393] [DEBUG] [LOCAL ] BCS: Primary data saved (53441 records). [2025-10-21T17:29:06.667538] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-21T17:29:06.667613] [INFO ] [MAIN ] Update Progress: 236/2366 symbols completed. BCS took 32.6s. Estimated remaining: 4h 22m 8s. Rate: 8.1 symbols/min [2025-10-21T17:29:06.845384] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:06.866626] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:29:06.893222] [DEBUG] [LOCAL ] BDC: Loaded 24267 existing records from primary storage. [2025-10-21T17:29:06.893485] [INFO ] [MAIN ] BDC: Loaded 24267 existing records. [2025-10-21T17:29:07.077128] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:07.077340] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-21T17:29:07.077388] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-21T17:29:07.077712] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-21T17:29:07.077769] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-21T17:29:07.352332] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-21T17:29:07.434206] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:07.514590] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T17:29:08.151015] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-21T17:29:08.451119] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T17:29:08.950990] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-21T17:29:09.047142] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T17:29:09.751029] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-21T17:29:10.551085] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-21T17:29:10.594403] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T17:29:10.830112] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T17:29:11.351075] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-21T17:29:11.789690] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T17:29:12.151015] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-21T17:29:12.950999] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-21T17:29:13.193915] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:29:13.202015] [INFO ] [REMOTE ] BCE: Full fetch complete (76118 records). [2025-10-21T17:29:13.202170] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-21T17:29:13.510943] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:29:13.620208] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-21T17:29:13.620291] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-21T17:29:13.621163] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-21T17:29:13.621228] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-21T17:29:13.622627] [DEBUG] [LOCAL ] BCE: Trimmed 76118 records to 52267 (keeping 200 days of data) [2025-10-21T17:29:13.793714] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-21T17:29:13.938915] [DEBUG] [LOCAL ] BCE: Primary data saved (52267 records). [2025-10-21T17:29:13.939099] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-21T17:29:13.939183] [INFO ] [MAIN ] Update Progress: 237/2366 symbols completed. BCE took 48.9s. Estimated remaining: 4h 21m 59s. Rate: 8.1 symbols/min [2025-10-21T17:29:14.277444] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T17:29:14.551099] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-21T17:29:14.901135] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T17:29:15.351009] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-21T17:29:15.649317] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T17:29:16.151018] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-21T17:29:16.510469] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T17:29:16.951050] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-21T17:29:17.283952] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T17:29:17.751048] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-21T17:29:18.180307] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T17:29:18.551093] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-21T17:29:18.892159] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:29:19.351036] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-21T17:29:19.614766] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T17:29:20.150973] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-21T17:29:20.521844] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T17:29:20.951020] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-21T17:29:21.001080] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T17:29:21.751046] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-21T17:29:22.311507] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T17:29:22.551044] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-21T17:29:22.688285] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T17:29:23.351029] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-21T17:29:23.639726] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T17:29:23.644092] [INFO ] [REMOTE ] BCX: Full fetch complete (33678 records). [2025-10-21T17:29:23.644173] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-21T17:29:24.016522] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-21T17:29:24.016596] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-21T17:29:24.017073] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-21T17:29:24.017133] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-21T17:29:24.017860] [DEBUG] [LOCAL ] BCX: Trimmed 33678 records to 22127 (keeping 200 days of data) [2025-10-21T17:29:24.143705] [DEBUG] [LOCAL ] BCX: Primary data saved (22127 records). [2025-10-21T17:29:24.143827] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-21T17:29:24.143900] [INFO ] [MAIN ] Update Progress: 238/2366 symbols completed. BCX took 27.1s. Estimated remaining: 4h 22m 17s. Rate: 8.1 symbols/min [2025-10-21T17:29:24.151004] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-21T17:29:24.791132] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T17:29:24.798566] [INFO ] [REMOTE ] BCSF: Full fetch complete (39760 records). [2025-10-21T17:29:24.798824] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-21T17:29:25.224502] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-21T17:29:25.224616] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-21T17:29:25.225321] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-21T17:29:25.225446] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-21T17:29:25.227320] [DEBUG] [LOCAL ] BCSF: Trimmed 39760 records to 28246 (keeping 200 days of data) [2025-10-21T17:29:25.402186] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:29:25.415385] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-21T17:29:25.423363] [DEBUG] [LOCAL ] BCSF: Primary data saved (28246 records). [2025-10-21T17:29:25.423678] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-21T17:29:25.423778] [INFO ] [MAIN ] Update Progress: 239/2366 symbols completed. BCSF took 31.5s. Estimated remaining: 4h 21m 15s. Rate: 8.1 symbols/min [2025-10-21T17:29:26.420483] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T17:29:26.425664] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-21T17:29:27.611952] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T17:29:27.615758] [INFO ] [REMOTE ] BDC: Full fetch complete (35799 records). [2025-10-21T17:29:27.615832] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-21T17:29:27.998633] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-21T17:29:27.998736] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-21T17:29:27.999426] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-21T17:29:27.999513] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-21T17:29:28.000739] [DEBUG] [LOCAL ] BDC: Trimmed 35799 records to 24193 (keeping 200 days of data) [2025-10-21T17:29:28.147819] [DEBUG] [LOCAL ] BDC: Primary data saved (24193 records). [2025-10-21T17:29:28.147937] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-21T17:29:28.148015] [INFO ] [MAIN ] Update Progress: 240/2366 symbols completed. BDC took 21.5s. Estimated remaining: 4h 20m 27s. Rate: 8.2 symbols/min [2025-10-21T17:29:28.750612] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:28.816256] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:28.825697] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:28.885972] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:28.886491] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-10-21T17:29:28.886543] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-10-21T17:29:28.886631] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-21T17:29:28.886704] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-21T17:29:28.886755] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-21T17:29:28.886787] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-21T17:29:29.088071] [DEBUG] [LOCAL ] BDJ: Loaded 29444 existing records from primary storage. [2025-10-21T17:29:29.150953] [INFO ] [MAIN ] BDJ: Loaded 29444 existing records. [2025-10-21T17:29:29.259035] [DEBUG] [LOCAL ] BDN: Loaded 47639 existing records from primary storage. [2025-10-21T17:29:29.385128] [INFO ] [MAIN ] BDN: Loaded 47639 existing records. [2025-10-21T17:29:29.418503] [DEBUG] [LOCAL ] BDX: Loaded 52166 existing records from primary storage. [2025-10-21T17:29:29.523078] [INFO ] [MAIN ] BDX: Loaded 52166 existing records. [2025-10-21T17:29:29.644484] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:29.695157] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-21T17:29:29.700458] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-21T17:29:29.675673] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:29.733796] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-21T17:29:29.733905] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-21T17:29:29.739152] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-21T17:29:29.997774] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:30.020467] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-21T17:29:30.047239] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-21T17:29:30.058964] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:30.062785] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-21T17:29:30.062728] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-21T17:29:30.063022] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-21T17:29:30.063366] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-21T17:29:30.123069] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-21T17:29:30.216041] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-21T17:29:30.895624] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:30.930577] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-21T17:29:31.124813] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:31.141410] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-21T17:29:31.145354] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:31.145779] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-21T17:29:31.433553] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:29:31.443889] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-21T17:29:31.822123] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T17:29:31.828556] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-21T17:29:32.683698] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T17:29:32.694680] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-21T17:29:32.717872] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T17:29:32.725238] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-21T17:29:32.801720] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T17:29:32.951000] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-21T17:29:33.336497] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T17:29:33.751083] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-21T17:29:33.938936] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:29:34.219256] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:29:34.391579] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T17:29:34.551079] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-21T17:29:35.153788] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:29:35.351036] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-21T17:29:36.151010] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-21T17:29:36.410781] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:29:36.955140] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-21T17:29:36.960964] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:29:37.750999] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-21T17:29:37.992715] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T17:29:38.551002] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-21T17:29:38.688279] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T17:29:39.154849] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:29:39.351021] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-21T17:29:39.953695] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:29:40.151060] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-21T17:29:40.951012] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-21T17:29:41.148620] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:29:41.750988] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-21T17:29:42.322406] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-21T17:29:42.367458] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T17:29:42.551028] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-21T17:29:43.351047] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-21T17:29:43.539242] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T17:29:44.151051] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-21T17:29:44.280083] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T17:29:44.427065] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T17:29:44.951080] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-21T17:29:45.751072] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-21T17:29:46.108574] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-21T17:29:46.551002] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-21T17:29:46.817750] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T17:29:47.351108] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-21T17:29:47.686478] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T17:29:47.734971] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T17:29:48.151044] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-21T17:29:48.812090] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T17:29:48.951159] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-21T17:29:49.517096] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:29:49.751079] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-21T17:29:50.551052] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-21T17:29:51.361186] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-21T17:29:51.363833] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T17:29:51.585030] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-21T17:29:52.151001] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-21T17:29:52.609826] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T17:29:52.769893] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T17:29:52.951045] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-21T17:29:53.119741] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T17:29:53.751036] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-21T17:29:54.551079] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-21T17:29:54.817052] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T17:29:54.824911] [INFO ] [REMOTE ] BDN: Full fetch complete (69435 records). [2025-10-21T17:29:54.825097] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-21T17:29:55.224307] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-21T17:29:55.224424] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-21T17:29:55.225253] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-21T17:29:55.225317] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-21T17:29:55.226667] [DEBUG] [LOCAL ] BDN: Trimmed 69435 records to 47633 (keeping 200 days of data) [2025-10-21T17:29:55.398365] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-21T17:29:55.510804] [DEBUG] [LOCAL ] BDN: Primary data saved (47633 records). [2025-10-21T17:29:55.510947] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-21T17:29:55.511027] [INFO ] [MAIN ] Update Progress: 241/2366 symbols completed. BDN took 27.4s. Estimated remaining: 4h 23m 16s. Rate: 8.1 symbols/min [2025-10-21T17:29:55.693817] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:55.694168] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-21T17:29:55.694241] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-21T17:29:55.699614] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-21T17:29:55.708722] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-21T17:29:55.708955] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-21T17:29:55.709821] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T17:29:55.709328] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-21T17:29:56.092458] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:56.145471] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T17:29:56.152945] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-21T17:29:56.157553] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-21T17:29:56.169066] [INFO ] [REMOTE ] BDX: Full fetch complete (75493 records). [2025-10-21T17:29:56.169931] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-21T17:29:56.567227] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-21T17:29:56.567313] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-21T17:29:56.568138] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-21T17:29:56.568217] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-21T17:29:56.569609] [DEBUG] [LOCAL ] BDX: Trimmed 75493 records to 52157 (keeping 200 days of data) [2025-10-21T17:29:56.670594] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T17:29:56.905180] [DEBUG] [LOCAL ] BDX: Primary data saved (52157 records). [2025-10-21T17:29:56.905314] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-21T17:29:56.906791] [INFO ] [MAIN ] Update Progress: 242/2366 symbols completed. BDX took 28.7s. Estimated remaining: 4h 22m 16s. Rate: 8.1 symbols/min [2025-10-21T17:29:56.956240] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-21T17:29:57.089015] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:29:57.142844] [DEBUG] [LOCAL ] BEKE: Loaded 53198 existing records from primary storage. [2025-10-21T17:29:57.143203] [INFO ] [MAIN ] BEKE: Loaded 53198 existing records. [2025-10-21T17:29:57.325734] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:29:57.325958] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-21T17:29:57.326008] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-21T17:29:57.326195] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-21T17:29:57.326233] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-21T17:29:57.672229] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:29:57.750984] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-21T17:29:58.551047] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-21T17:29:59.351081] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-21T17:29:59.621181] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:29:59.651225] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-10-21T17:29:59.676672] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-21T17:29:59.677075] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T17:29:59.683084] [INFO ] [REMOTE ] BDJ: Full fetch complete (42807 records). [2025-10-21T17:29:59.683180] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-21T17:30:00.054840] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-21T17:30:00.054917] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-21T17:30:00.055510] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-21T17:30:00.055549] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-21T17:30:00.056474] [DEBUG] [LOCAL ] BDJ: Trimmed 42807 records to 29386 (keeping 200 days of data) [2025-10-21T17:30:00.154538] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-21T17:30:00.228850] [DEBUG] [LOCAL ] BDJ: Primary data saved (29386 records). [2025-10-21T17:30:00.228973] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-21T17:30:00.229050] [INFO ] [MAIN ] Update Progress: 243/2366 symbols completed. BDJ took 32.1s. Estimated remaining: 4h 21m 33s. Rate: 8.1 symbols/min [2025-10-21T17:30:00.394600] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:00.394825] [DEBUG] [LOCAL ] BEN: No existing data file found in primary storage. [2025-10-21T17:30:00.394865] [WARN ] [MAIN ] BEN: No existing data found, performing full refresh instead. [2025-10-21T17:30:00.394932] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-21T17:30:00.394968] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-21T17:30:00.395007] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-10-21T17:30:00.395038] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-21T17:30:00.746946] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:00.950982] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-21T17:30:01.751045] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-21T17:30:02.254866] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T17:30:02.551082] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-21T17:30:02.717846] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T17:30:03.351022] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-21T17:30:03.808502] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T17:30:04.151016] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-21T17:30:04.363063] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-21T17:30:04.371045] [INFO ] [REMOTE ] BE: Full fetch complete (77426 records). [2025-10-21T17:30:04.371199] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-21T17:30:04.372050] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:30:04.372141] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:30:04.372185] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:30:04.372255] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-21T17:30:04.372321] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-10-21T17:30:04.372357] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-10-21T17:30:04.372397] [DEBUG] [LOCAL ] BE: No derivative data file found to delete. [2025-10-21T17:30:04.372454] [INFO ] [MAIN ] Update Progress: 244/2366 symbols completed. BE took 36.2s. Estimated remaining: 4h 20m 57s. Rate: 8.1 symbols/min [2025-10-21T17:30:04.550300] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:04.588991] [DEBUG] [LOCAL ] BEP: Loaded 39006 existing records from primary storage. [2025-10-21T17:30:04.589304] [INFO ] [MAIN ] BEP: Loaded 39006 existing records. [2025-10-21T17:30:04.787382] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:04.787662] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-21T17:30:04.799138] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-21T17:30:04.819217] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-21T17:30:04.819371] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-21T17:30:04.913879] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-21T17:30:04.951415] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-21T17:30:05.206168] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:05.443610] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-21T17:30:05.750995] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-21T17:30:06.188295] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-21T17:30:06.551030] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-21T17:30:07.351005] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-21T17:30:07.709868] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T17:30:08.151081] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-21T17:30:08.183912] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:30:08.951080] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-21T17:30:09.078533] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T17:30:09.400026] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T17:30:09.556243] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T17:30:09.751082] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-21T17:30:10.551037] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-21T17:30:11.356132] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-21T17:30:11.368892] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:30:12.106493] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T17:30:12.151007] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-21T17:30:12.951048] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-21T17:30:13.247431] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:30:13.289938] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T17:30:13.751032] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-21T17:30:14.001486] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-21T17:30:14.077677] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T17:30:14.551102] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-21T17:30:15.351031] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-21T17:30:15.597484] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-21T17:30:15.981868] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T17:30:16.151030] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-21T17:30:16.951075] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-21T17:30:17.751023] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-21T17:30:18.031518] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T17:30:18.540748] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T17:30:18.550977] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-21T17:30:19.255383] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T17:30:19.351021] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-21T17:30:19.586550] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:30:20.151022] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-21T17:30:20.951055] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-21T17:30:21.054398] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:30:21.756182] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-21T17:30:21.790245] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:30:22.349262] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T17:30:22.494393] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T17:30:22.551015] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-21T17:30:23.147174] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T17:30:23.148043] [INFO ] [REMOTE ] BEDU: Full fetch complete (1319 records). [2025-10-21T17:30:23.148111] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-21T17:30:23.327832] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-21T17:30:23.328042] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:30:23.328130] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:30:23.328242] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-21T17:30:23.328337] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-21T17:30:23.328385] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-21T17:30:23.328428] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-21T17:30:23.328484] [INFO ] [MAIN ] Update Progress: 245/2366 symbols completed. BEDU took 27.8s. Estimated remaining: 4h 22m 30s. Rate: 8.1 symbols/min [2025-10-21T17:30:23.356967] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-21T17:30:23.510081] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:23.550526] [DEBUG] [LOCAL ] BEPC: Loaded 46428 existing records from primary storage. [2025-10-21T17:30:23.550902] [INFO ] [MAIN ] BEPC: Loaded 46428 existing records. [2025-10-21T17:30:23.736111] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:23.736397] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-21T17:30:23.736454] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-21T17:30:23.736912] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-21T17:30:23.736985] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-21T17:30:24.122415] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:24.151041] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-21T17:30:24.951051] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-21T17:30:25.182202] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:30:25.750995] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-21T17:30:25.869259] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T17:30:26.551056] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-21T17:30:27.001273] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-21T17:30:27.351034] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-21T17:30:27.501208] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:30:28.113140] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T17:30:28.151080] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-21T17:30:28.542153] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T17:30:28.951049] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-21T17:30:29.751090] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-21T17:30:29.900606] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:30:30.551016] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-21T17:30:30.860795] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T17:30:31.233159] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T17:30:31.242034] [INFO ] [REMOTE ] BEN: Full fetch complete (77070 records). [2025-10-21T17:30:31.242193] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-21T17:30:31.356274] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-21T17:30:31.651963] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-21T17:30:31.652064] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-21T17:30:31.652944] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-21T17:30:31.653007] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-21T17:30:31.654437] [DEBUG] [LOCAL ] BEN: Trimmed 77070 records to 53118 (keeping 200 days of data) [2025-10-21T17:30:31.981811] [DEBUG] [LOCAL ] BEN: Primary data saved (53118 records). [2025-10-21T17:30:31.981950] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-21T17:30:31.982023] [INFO ] [MAIN ] Update Progress: 246/2366 symbols completed. BEN took 31.8s. Estimated remaining: 4h 22m 33s. Rate: 8.1 symbols/min [2025-10-21T17:30:32.163451] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:32.160568] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-21T17:30:32.171519] [DEBUG] [LOCAL ] BEPH: Loaded 4950 existing records from primary storage. [2025-10-21T17:30:32.171764] [INFO ] [MAIN ] BEPH: Loaded 4950 existing records. [2025-10-21T17:30:32.382064] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:30:32.387202] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:32.395844] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-21T17:30:32.396055] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-21T17:30:32.396217] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-21T17:30:32.396256] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-21T17:30:32.429038] [INFO ] [REMOTE ] BEKE: Full fetch complete (77334 records). [2025-10-21T17:30:32.464967] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-21T17:30:33.097952] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:33.194769] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-21T17:30:33.141515] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-21T17:30:33.196210] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-21T17:30:33.197793] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-21T17:30:33.198139] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-21T17:30:33.226098] [DEBUG] [LOCAL ] BEKE: Trimmed 77334 records to 53198 (keeping 200 days of data) [2025-10-21T17:30:33.227945] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T17:30:33.459827] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T17:30:33.578037] [DEBUG] [LOCAL ] BEKE: Primary data saved (53198 records). [2025-10-21T17:30:33.578197] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-21T17:30:33.578290] [INFO ] [MAIN ] Update Progress: 247/2366 symbols completed. BEKE took 36.7s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-10-21T17:30:33.750206] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:33.750996] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-21T17:30:33.755934] [DEBUG] [LOCAL ] BEPI: Loaded 3594 existing records from primary storage. [2025-10-21T17:30:33.756169] [INFO ] [MAIN ] BEPI: Loaded 3594 existing records. [2025-10-21T17:30:33.947870] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T17:30:33.951976] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:33.954175] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-21T17:30:33.954233] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-21T17:30:33.954420] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-21T17:30:33.954477] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-21T17:30:34.300388] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:34.551001] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-21T17:30:35.112732] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T17:30:35.351002] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-21T17:30:35.528268] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T17:30:35.537160] [INFO ] [REMOTE ] BEP: Full fetch complete (59312 records). [2025-10-21T17:30:35.537308] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-21T17:30:35.914339] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T17:30:36.016950] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-21T17:30:36.017064] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-21T17:30:36.017906] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-21T17:30:36.017993] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-21T17:30:36.019424] [DEBUG] [LOCAL ] BEP: Trimmed 59312 records to 38965 (keeping 200 days of data) [2025-10-21T17:30:36.152682] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-21T17:30:36.268986] [DEBUG] [LOCAL ] BEP: Primary data saved (38965 records). [2025-10-21T17:30:36.269132] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-21T17:30:36.270006] [INFO ] [MAIN ] Update Progress: 248/2366 symbols completed. BEP took 31.9s. Estimated remaining: 4h 20m 48s. Rate: 8.1 symbols/min [2025-10-21T17:30:36.445398] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:36.450528] [DEBUG] [LOCAL ] BEPJ: Loaded 3084 existing records from primary storage. [2025-10-21T17:30:36.450785] [INFO ] [MAIN ] BEPJ: Loaded 3084 existing records. [2025-10-21T17:30:36.643003] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:36.643219] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-21T17:30:36.643268] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-21T17:30:36.643403] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-21T17:30:36.643441] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-21T17:30:36.806739] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:30:36.956181] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-21T17:30:37.013775] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:37.751015] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-21T17:30:38.414917] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T17:30:38.551050] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-21T17:30:38.680449] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:30:39.221257] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-21T17:30:39.351037] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-21T17:30:40.151043] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-21T17:30:40.318911] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T17:30:40.951074] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-21T17:30:41.427985] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T17:30:41.696243] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:30:41.751045] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-21T17:30:42.551052] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-21T17:30:43.016224] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T17:30:43.351011] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-21T17:30:43.435661] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:30:43.681684] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-21T17:30:44.151039] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-21T17:30:44.593392] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:30:44.951064] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-21T17:30:45.751073] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-21T17:30:46.328880] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T17:30:46.363846] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T17:30:46.551047] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-21T17:30:47.254489] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T17:30:47.351121] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-21T17:30:47.779291] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T17:30:48.151079] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-21T17:30:48.771260] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T17:30:48.951058] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-21T17:30:49.751009] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-21T17:30:50.318905] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T17:30:50.550999] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-21T17:30:50.644312] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T17:30:51.351055] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-21T17:30:51.749734] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:30:52.151004] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-21T17:30:52.264366] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T17:30:52.951043] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-21T17:30:53.420812] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T17:30:53.751036] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-21T17:30:54.235925] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T17:30:54.453322] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T17:30:54.462188] [INFO ] [REMOTE ] BEPC: Full fetch complete (68896 records). [2025-10-21T17:30:54.462446] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-21T17:30:54.556206] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-21T17:30:54.893275] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-21T17:30:54.893370] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-21T17:30:54.894188] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-21T17:30:54.894252] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-21T17:30:54.895631] [DEBUG] [LOCAL ] BEPC: Trimmed 68896 records to 46391 (keeping 200 days of data) [2025-10-21T17:30:55.174783] [DEBUG] [LOCAL ] BEPC: Primary data saved (46391 records). [2025-10-21T17:30:55.174912] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-21T17:30:55.174986] [INFO ] [MAIN ] Update Progress: 249/2366 symbols completed. BEPC took 31.8s. Estimated remaining: 4h 22m 18s. Rate: 8.1 symbols/min [2025-10-21T17:30:55.258970] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T17:30:55.356595] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-21T17:30:55.360345] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:30:55.400063] [DEBUG] [LOCAL ] BFAM: Loaded 33897 existing records from primary storage. [2025-10-21T17:30:55.400428] [INFO ] [MAIN ] BFAM: Loaded 33897 existing records. [2025-10-21T17:30:55.600282] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:30:55.600530] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-21T17:30:55.600581] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-21T17:30:55.600846] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-21T17:30:55.600904] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-21T17:30:55.988145] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:30:55.989527] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T17:30:56.151040] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-21T17:30:56.857826] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T17:30:56.951085] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-21T17:30:57.751032] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-21T17:30:58.298544] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T17:30:58.310717] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T17:30:58.551040] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-21T17:30:59.351095] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-21T17:30:59.784220] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T17:31:00.118024] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T17:31:00.119026] [INFO ] [REMOTE ] BEPI: Full fetch complete (4684 records). [2025-10-21T17:31:00.119091] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-21T17:31:00.156323] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-21T17:31:00.507810] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-21T17:31:00.507898] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-21T17:31:00.508075] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-21T17:31:00.508124] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-21T17:31:00.508580] [DEBUG] [LOCAL ] BEPI: Trimmed 4684 records to 3587 (keeping 200 days of data) [2025-10-21T17:31:00.529980] [DEBUG] [LOCAL ] BEPI: Primary data saved (3587 records). [2025-10-21T17:31:00.530056] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-21T17:31:00.530128] [INFO ] [MAIN ] Update Progress: 250/2366 symbols completed. BEPI took 27.0s. Estimated remaining: 4h 21m 53s. Rate: 8.1 symbols/min [2025-10-21T17:31:00.699473] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:00.736852] [DEBUG] [LOCAL ] BFH: Loaded 41581 existing records from primary storage. [2025-10-21T17:31:00.737174] [INFO ] [MAIN ] BFH: Loaded 41581 existing records. [2025-10-21T17:31:00.916535] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:00.916786] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-21T17:31:00.916835] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-21T17:31:00.917193] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-21T17:31:00.917230] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-21T17:31:00.960369] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-21T17:31:01.286470] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:01.415025] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T17:31:01.554820] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:31:01.750991] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-21T17:31:02.551283] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-21T17:31:03.021083] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T17:31:03.200943] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T17:31:03.351063] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-21T17:31:04.151028] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-21T17:31:04.951046] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-21T17:31:04.995995] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:31:05.131126] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T17:31:05.650940] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T17:31:05.751059] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-21T17:31:06.551059] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-21T17:31:06.582014] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T17:31:06.583307] [INFO ] [REMOTE ] BEPH: Full fetch complete (7517 records). [2025-10-21T17:31:06.583374] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-21T17:31:06.957659] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-21T17:31:06.957748] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-21T17:31:06.957936] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-21T17:31:06.957974] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-21T17:31:06.961258] [DEBUG] [LOCAL ] BEPH: Trimmed 7517 records to 4924 (keeping 200 days of data) [2025-10-21T17:31:06.990277] [DEBUG] [LOCAL ] BEPH: Primary data saved (4924 records). [2025-10-21T17:31:06.990342] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-21T17:31:06.990452] [INFO ] [MAIN ] Update Progress: 251/2366 symbols completed. BEPH took 35.0s. Estimated remaining: 4h 21m 38s. Rate: 8.1 symbols/min [2025-10-21T17:31:07.157378] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:07.157528] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-21T17:31:07.157562] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-21T17:31:07.157691] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-21T17:31:07.157745] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-21T17:31:07.157785] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-21T17:31:07.157817] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-21T17:31:07.361804] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-21T17:31:07.510821] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:08.151011] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-21T17:31:08.426950] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:31:08.811405] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T17:31:08.812738] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4359 records). [2025-10-21T17:31:08.812829] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-21T17:31:08.955469] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-21T17:31:09.210618] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-21T17:31:09.218054] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-21T17:31:09.227921] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-21T17:31:09.230376] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-21T17:31:09.232591] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:31:09.232889] [DEBUG] [LOCAL ] BEPJ: Trimmed 4359 records to 3070 (keeping 200 days of data) [2025-10-21T17:31:09.260293] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3070 records). [2025-10-21T17:31:09.260423] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-21T17:31:09.260502] [INFO ] [MAIN ] Update Progress: 252/2366 symbols completed. BEPJ took 33.0s. Estimated remaining: 4h 20m 47s. Rate: 8.1 symbols/min [2025-10-21T17:31:09.432913] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:09.480112] [DEBUG] [LOCAL ] BFLY: Loaded 51857 existing records from primary storage. [2025-10-21T17:31:09.480458] [INFO ] [MAIN ] BFLY: Loaded 51857 existing records. [2025-10-21T17:31:09.654142] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:09.654359] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-21T17:31:09.654405] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-21T17:31:09.654620] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-21T17:31:09.654717] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-21T17:31:09.754728] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-21T17:31:10.013809] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:10.551029] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-21T17:31:10.592614] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T17:31:10.923551] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T17:31:11.351059] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-21T17:31:11.824081] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T17:31:12.151035] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-21T17:31:12.951000] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-21T17:31:13.218057] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T17:31:13.696235] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T17:31:13.751007] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-21T17:31:13.869251] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:31:14.551019] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-21T17:31:15.351029] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-21T17:31:15.538623] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T17:31:15.994046] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:31:16.151013] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-21T17:31:16.967411] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-21T17:31:16.984348] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T17:31:17.688869] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T17:31:17.751010] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-21T17:31:17.993474] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T17:31:18.482513] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T17:31:18.551025] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-21T17:31:19.351021] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-21T17:31:20.057865] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T17:31:20.150977] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-21T17:31:20.885672] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:31:20.950993] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-21T17:31:21.576758] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:31:21.585082] [INFO ] [REMOTE ] BFAM: Full fetch complete (47361 records). [2025-10-21T17:31:21.585230] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-21T17:31:21.752667] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-21T17:31:21.974926] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-21T17:31:21.975002] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-21T17:31:21.975556] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-21T17:31:21.975615] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-21T17:31:21.976590] [DEBUG] [LOCAL ] BFAM: Trimmed 47361 records to 33837 (keeping 200 days of data) [2025-10-21T17:31:22.176466] [DEBUG] [LOCAL ] BFAM: Primary data saved (33837 records). [2025-10-21T17:31:22.176588] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-21T17:31:22.176702] [INFO ] [MAIN ] Update Progress: 253/2366 symbols completed. BFAM took 27.0s. Estimated remaining: 4h 21m 26s. Rate: 8.1 symbols/min [2025-10-21T17:31:22.377349] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:22.379563] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:31:22.395989] [DEBUG] [LOCAL ] BFS: Loaded 9614 existing records from primary storage. [2025-10-21T17:31:22.396224] [INFO ] [MAIN ] BFS: Loaded 9614 existing records. [2025-10-21T17:31:22.551683] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-21T17:31:22.584286] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:22.584547] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-21T17:31:22.584609] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-21T17:31:22.584822] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-21T17:31:22.584879] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-21T17:31:22.955452] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:23.351032] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-21T17:31:23.689558] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T17:31:24.001501] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T17:31:24.102745] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T17:31:24.151035] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-21T17:31:24.903825] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T17:31:24.951016] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-21T17:31:25.634768] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T17:31:25.750990] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-21T17:31:26.527826] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T17:31:26.551050] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-21T17:31:27.351049] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-21T17:31:27.361092] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T17:31:28.151071] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-21T17:31:28.951002] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-21T17:31:29.180509] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T17:31:29.496852] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T17:31:29.751017] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-21T17:31:29.916375] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T17:31:30.551073] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-21T17:31:30.996200] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T17:31:31.002706] [INFO ] [REMOTE ] BFH: Full fetch complete (60113 records). [2025-10-21T17:31:31.002828] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-21T17:31:31.356155] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-21T17:31:31.408837] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-21T17:31:31.408931] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-21T17:31:31.409730] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-21T17:31:31.409795] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-21T17:31:31.411069] [DEBUG] [LOCAL ] BFH: Trimmed 60113 records to 41425 (keeping 200 days of data) [2025-10-21T17:31:31.654861] [DEBUG] [LOCAL ] BFH: Primary data saved (41425 records). [2025-10-21T17:31:31.654981] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-21T17:31:31.655052] [INFO ] [MAIN ] Update Progress: 254/2366 symbols completed. BFH took 31.1s. Estimated remaining: 4h 21m 35s. Rate: 8.1 symbols/min [2025-10-21T17:31:31.829352] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:31.843280] [DEBUG] [LOCAL ] BFZ: Loaded 12050 existing records from primary storage. [2025-10-21T17:31:31.843520] [INFO ] [MAIN ] BFZ: Loaded 12050 existing records. [2025-10-21T17:31:32.030453] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:32.030776] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-21T17:31:32.030827] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-21T17:31:32.031030] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-21T17:31:32.031087] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-21T17:31:32.155428] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-21T17:31:32.344223] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T17:31:32.472832] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T17:31:32.478309] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:32.644073] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:31:32.951062] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-21T17:31:33.751035] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-21T17:31:34.551061] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-21T17:31:34.621391] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T17:31:34.864627] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T17:31:35.205639] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T17:31:35.351006] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-21T17:31:36.151033] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-21T17:31:36.262626] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T17:31:36.951061] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-21T17:31:37.751040] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-21T17:31:37.812133] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T17:31:37.997141] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T17:31:38.551008] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-21T17:31:38.690157] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T17:31:39.351056] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-21T17:31:40.115537] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:31:40.150993] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-21T17:31:40.507834] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:31:40.765012] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T17:31:40.951038] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-21T17:31:41.751048] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-21T17:31:42.551063] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-21T17:31:42.822139] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T17:31:42.826017] [INFO ] [REMOTE ] BFK: Full fetch complete (19103 records). [2025-10-21T17:31:42.826134] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-21T17:31:43.208832] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-21T17:31:43.208943] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-21T17:31:43.209387] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-21T17:31:43.209608] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-21T17:31:43.233063] [DEBUG] [LOCAL ] BFK: Trimmed 19103 records to 13822 (keeping 200 days of data) [2025-10-21T17:31:43.235438] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-21T17:31:43.304435] [INFO ] [REMOTE ] BFLY: Full fetch complete (75514 records). [2025-10-21T17:31:43.305010] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-21T17:31:43.314885] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T17:31:43.356095] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-21T17:31:43.499578] [DEBUG] [LOCAL ] BFK: Primary data saved (13822 records). [2025-10-21T17:31:43.510504] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-21T17:31:43.510674] [INFO ] [MAIN ] Update Progress: 255/2366 symbols completed. BFK took 36.5s. Estimated remaining: 4h 22m 5s. Rate: 8.1 symbols/min [2025-10-21T17:31:43.894954] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:43.955113] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-21T17:31:43.955248] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-21T17:31:43.956228] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-21T17:31:43.956318] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-21T17:31:43.958115] [DEBUG] [LOCAL ] BFLY: Trimmed 75514 records to 51859 (keeping 200 days of data) [2025-10-21T17:31:44.154670] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-21T17:31:44.158298] [DEBUG] [LOCAL ] BG: Loaded 50585 existing records from primary storage. [2025-10-21T17:31:44.196457] [INFO ] [MAIN ] BG: Loaded 50585 existing records. [2025-10-21T17:31:44.422875] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:31:44.489001] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:44.502583] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-21T17:31:44.506093] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-21T17:31:44.506694] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-21T17:31:44.505992] [DEBUG] [LOCAL ] BFLY: Primary data saved (51859 records). [2025-10-21T17:31:44.506845] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-21T17:31:44.507888] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-21T17:31:44.539514] [INFO ] [MAIN ] Update Progress: 256/2366 symbols completed. BFLY took 35.3s. Estimated remaining: 4h 21m 4s. Rate: 8.1 symbols/min [2025-10-21T17:31:44.872074] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:44.952044] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-21T17:31:45.073625] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:45.074111] [DEBUG] [LOCAL ] BGB: Loaded 17876 existing records from primary storage. [2025-10-21T17:31:45.081686] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T17:31:45.081872] [INFO ] [MAIN ] BGB: Loaded 17876 existing records. [2025-10-21T17:31:45.258386] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:45.258609] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-21T17:31:45.258683] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-21T17:31:45.258861] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-21T17:31:45.258898] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-21T17:31:45.605459] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:45.751014] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-21T17:31:46.015783] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T17:31:46.018081] [INFO ] [REMOTE ] BFS: Full fetch complete (13096 records). [2025-10-21T17:31:46.018173] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-21T17:31:46.411814] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-21T17:31:46.411941] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-21T17:31:46.412374] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-21T17:31:46.412429] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-21T17:31:46.413267] [DEBUG] [LOCAL ] BFS: Trimmed 13096 records to 9585 (keeping 200 days of data) [2025-10-21T17:31:46.479233] [DEBUG] [LOCAL ] BFS: Primary data saved (9585 records). [2025-10-21T17:31:46.479378] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-21T17:31:46.479475] [INFO ] [MAIN ] Update Progress: 257/2366 symbols completed. BFS took 24.3s. Estimated remaining: 4h 20m 12s. Rate: 8.1 symbols/min [2025-10-21T17:31:46.556123] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-21T17:31:46.650740] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:31:46.668523] [DEBUG] [LOCAL ] BGH: Loaded 17201 existing records from primary storage. [2025-10-21T17:31:46.668783] [INFO ] [MAIN ] BGH: Loaded 17201 existing records. [2025-10-21T17:31:46.843507] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:31:46.843772] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-21T17:31:46.843821] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-21T17:31:46.844011] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-21T17:31:46.844068] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-21T17:31:47.195074] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:31:47.351025] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-21T17:31:47.951138] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-21T17:31:48.151068] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-21T17:31:48.173599] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:31:48.211936] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T17:31:48.951021] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-21T17:31:49.245122] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T17:31:49.751051] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-21T17:31:50.550998] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-21T17:31:50.668464] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T17:31:51.002098] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T17:31:51.350997] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-21T17:31:51.471241] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:31:52.155923] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T17:31:52.154849] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-21T17:31:52.951047] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-21T17:31:53.751052] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-21T17:31:54.318872] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T17:31:54.421522] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-21T17:31:54.550988] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-21T17:31:54.565115] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T17:31:55.351049] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-21T17:31:56.151064] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-21T17:31:56.436095] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T17:31:56.805604] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T17:31:56.951084] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-21T17:31:57.016306] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T17:31:57.751036] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-21T17:31:57.990834] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:31:58.430891] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T17:31:58.551014] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-21T17:31:59.351083] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-21T17:32:00.126480] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-21T17:32:00.150992] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-21T17:32:00.343461] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T17:32:00.951050] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-21T17:32:01.287969] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:32:01.751076] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-21T17:32:02.332249] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:32:02.551078] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-21T17:32:03.351048] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-21T17:32:03.460810] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T17:32:03.775770] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T17:32:04.051867] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T17:32:04.151100] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-21T17:32:04.951042] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-21T17:32:05.106269] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T17:32:05.751104] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-21T17:32:06.551033] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-21T17:32:06.610459] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T17:32:06.612535] [INFO ] [REMOTE ] BFZ: Full fetch complete (17449 records). [2025-10-21T17:32:06.612602] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-21T17:32:06.613059] [FATAL] [VALIDATOR ] BFZ: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:32:06.613140] [FATAL] [MAIN ] BFZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:32:06.613214] [WARN ] [MAIN ] BFZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:32:06.613284] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-21T17:32:06.613346] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-21T17:32:06.613380] [INFO ] [LOCAL ] BFZ: Starting deletion of derivative data. [2025-10-21T17:32:06.613535] [DEBUG] [LOCAL ] BFZ: Deleted derivative data file. [2025-10-21T17:32:06.613619] [INFO ] [MAIN ] Update Progress: 258/2366 symbols completed. BFZ took 35.0s. Estimated remaining: 4h 21m 48s. Rate: 8.1 symbols/min [2025-10-21T17:32:06.784802] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:06.815441] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T17:32:06.835733] [DEBUG] [LOCAL ] BGR: Loaded 13505 existing records from primary storage. [2025-10-21T17:32:06.835948] [INFO ] [MAIN ] BGR: Loaded 13505 existing records. [2025-10-21T17:32:07.015169] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:07.015396] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-21T17:32:07.015442] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-21T17:32:07.015674] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-21T17:32:07.015733] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-21T17:32:07.362279] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-21T17:32:07.367968] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:07.428547] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T17:32:08.150997] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-21T17:32:08.951029] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-21T17:32:09.067829] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T17:32:09.088333] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T17:32:09.751393] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-21T17:32:09.753234] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:32:10.551061] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-21T17:32:10.745797] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T17:32:11.351036] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-21T17:32:11.457005] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T17:32:12.151028] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-21T17:32:12.951071] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-21T17:32:13.089169] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T17:32:13.350395] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T17:32:13.751062] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-21T17:32:14.238010] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T17:32:14.241701] [INFO ] [REMOTE ] BGB: Full fetch complete (26708 records). [2025-10-21T17:32:14.241919] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-21T17:32:14.556184] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-21T17:32:14.618977] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-21T17:32:14.619076] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-21T17:32:14.619552] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-21T17:32:14.619623] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-21T17:32:14.620994] [DEBUG] [LOCAL ] BGB: Trimmed 26708 records to 17799 (keeping 200 days of data) [2025-10-21T17:32:14.709452] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T17:32:14.745586] [DEBUG] [LOCAL ] BGB: Primary data saved (17799 records). [2025-10-21T17:32:14.745767] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-21T17:32:14.745856] [INFO ] [MAIN ] Update Progress: 259/2366 symbols completed. BGB took 30.2s. Estimated remaining: 4h 21m 46s. Rate: 8.0 symbols/min [2025-10-21T17:32:14.923143] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:14.970077] [DEBUG] [LOCAL ] BGS: Loaded 50571 existing records from primary storage. [2025-10-21T17:32:14.970441] [INFO ] [MAIN ] BGS: Loaded 50571 existing records. [2025-10-21T17:32:15.151696] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:15.151969] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-21T17:32:15.152018] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-21T17:32:15.152407] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-21T17:32:15.152463] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-21T17:32:15.360032] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-21T17:32:15.512786] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:16.151059] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-21T17:32:16.450957] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T17:32:16.459204] [INFO ] [REMOTE ] BG: Full fetch complete (73104 records). [2025-10-21T17:32:16.459364] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-21T17:32:16.895815] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T17:32:16.921817] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-21T17:32:16.918122] [INFO ] [REMOTE ] BGH: Full fetch complete (22985 records). [2025-10-21T17:32:16.921952] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-21T17:32:16.922060] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-21T17:32:16.923342] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-21T17:32:16.923536] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-21T17:32:16.956095] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-21T17:32:17.030447] [DEBUG] [LOCAL ] BG: Trimmed 73104 records to 50586 (keeping 200 days of data) [2025-10-21T17:32:17.545932] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-21T17:32:17.546379] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-21T17:32:17.546851] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-21T17:32:17.546931] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-21T17:32:17.567564] [DEBUG] [LOCAL ] BGH: Trimmed 22985 records to 17232 (keeping 200 days of data) [2025-10-21T17:32:17.721921] [DEBUG] [LOCAL ] BG: Primary data saved (50586 records). [2025-10-21T17:32:17.722568] [INFO ] [MAIN ] BG: Full history saved. [2025-10-21T17:32:17.722976] [INFO ] [MAIN ] Update Progress: 260/2366 symbols completed. BG took 34.2s. Estimated remaining: 4h 21m 3s. Rate: 8.1 symbols/min [2025-10-21T17:32:17.942536] [DEBUG] [LOCAL ] BGH: Primary data saved (17232 records). [2025-10-21T17:32:17.931290] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:17.944703] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T17:32:17.943708] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-21T17:32:17.949186] [INFO ] [MAIN ] Update Progress: 261/2366 symbols completed. BGH took 31.5s. Estimated remaining: 4h 19m 57s. Rate: 8.1 symbols/min [2025-10-21T17:32:17.948988] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-21T17:32:18.065156] [DEBUG] [LOCAL ] BGSF: Loaded 8128 existing records from primary storage. [2025-10-21T17:32:18.066011] [INFO ] [MAIN ] BGSF: Loaded 8128 existing records. [2025-10-21T17:32:18.199727] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:18.241349] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T17:32:18.375988] [DEBUG] [LOCAL ] BGT: Loaded 16314 existing records from primary storage. [2025-10-21T17:32:18.375184] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:18.376199] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-21T17:32:18.376338] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-21T17:32:18.376448] [INFO ] [MAIN ] BGT: Loaded 16314 existing records. [2025-10-21T17:32:18.408232] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-21T17:32:18.447704] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-21T17:32:18.554463] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-21T17:32:18.694441] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:18.770129] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-21T17:32:18.794391] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-21T17:32:18.829231] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-21T17:32:18.839664] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-21T17:32:19.063598] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:32:19.079461] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:19.327049] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:19.351029] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-21T17:32:20.151063] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-21T17:32:20.242834] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:32:20.291064] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T17:32:20.951037] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-21T17:32:21.419454] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:32:21.751086] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-21T17:32:22.404189] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T17:32:22.551015] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-21T17:32:22.655352] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T17:32:23.019269] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T17:32:23.351012] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-21T17:32:24.151016] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-21T17:32:24.810704] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T17:32:24.951056] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-21T17:32:25.114098] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T17:32:25.632418] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-21T17:32:25.751038] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-21T17:32:26.551077] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-21T17:32:26.753797] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T17:32:26.861716] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-21T17:32:27.351047] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-21T17:32:28.151073] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-21T17:32:28.632514] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-21T17:32:28.951030] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-21T17:32:29.286722] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T17:32:29.751034] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-21T17:32:29.768053] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T17:32:30.551073] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-21T17:32:31.294065] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T17:32:31.351086] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-21T17:32:31.554474] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:32:32.014157] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T17:32:32.151098] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-21T17:32:32.951101] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-21T17:32:33.388799] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T17:32:33.751049] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-21T17:32:34.233245] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T17:32:34.551069] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-21T17:32:34.725798] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T17:32:35.351031] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-21T17:32:36.156216] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-21T17:32:36.169304] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T17:32:36.444257] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T17:32:36.446699] [INFO ] [REMOTE ] BGSF: Full fetch complete (9535 records). [2025-10-21T17:32:36.446771] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-21T17:32:36.447119] [FATAL] [VALIDATOR ] BGSF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:32:36.447199] [FATAL] [MAIN ] BGSF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:32:36.447255] [WARN ] [MAIN ] BGSF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:32:36.447294] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-21T17:32:36.447346] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-10-21T17:32:36.447381] [INFO ] [LOCAL ] BGSF: Starting deletion of derivative data. [2025-10-21T17:32:36.447537] [DEBUG] [LOCAL ] BGSF: Deleted derivative data file. [2025-10-21T17:32:36.447618] [INFO ] [MAIN ] Update Progress: 262/2366 symbols completed. BGSF took 18.7s. Estimated remaining: 4h 21m 19s. Rate: 8.1 symbols/min [2025-10-21T17:32:36.613985] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:36.614131] [DEBUG] [LOCAL ] BGX: No existing data file found in primary storage. [2025-10-21T17:32:36.614166] [WARN ] [MAIN ] BGX: No existing data found, performing full refresh instead. [2025-10-21T17:32:36.614270] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-21T17:32:36.614310] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-21T17:32:36.614349] [DEBUG] [LOCAL ] BGX: No primary data file found to delete. [2025-10-21T17:32:36.614380] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-21T17:32:36.955594] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-21T17:32:36.969987] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:37.094212] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T17:32:37.751081] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-21T17:32:38.551036] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-21T17:32:38.643221] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:32:38.782532] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T17:32:39.065497] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T17:32:39.351057] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-21T17:32:40.151049] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-21T17:32:40.437754] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T17:32:40.951031] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-21T17:32:41.751022] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-21T17:32:41.874812] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T17:32:42.076976] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:32:42.368409] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T17:32:42.551088] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-21T17:32:43.351066] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-21T17:32:43.979292] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T17:32:44.151043] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-21T17:32:44.207300] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T17:32:44.951053] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-21T17:32:45.174723] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:32:45.177431] [INFO ] [REMOTE ] BGR: Full fetch complete (19924 records). [2025-10-21T17:32:45.177513] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-21T17:32:45.567194] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-21T17:32:45.567300] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-21T17:32:45.567837] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-21T17:32:45.567941] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-21T17:32:45.568807] [DEBUG] [LOCAL ] BGR: Trimmed 19924 records to 13494 (keeping 200 days of data) [2025-10-21T17:32:45.651610] [DEBUG] [LOCAL ] BGR: Primary data saved (13494 records). [2025-10-21T17:32:45.651787] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-21T17:32:45.651871] [INFO ] [MAIN ] Update Progress: 263/2366 symbols completed. BGR took 39.0s. Estimated remaining: 4h 21m 25s. Rate: 8.0 symbols/min [2025-10-21T17:32:45.754328] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-21T17:32:45.826392] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:45.847454] [DEBUG] [LOCAL ] BGY: Loaded 21632 existing records from primary storage. [2025-10-21T17:32:45.847744] [INFO ] [MAIN ] BGY: Loaded 21632 existing records. [2025-10-21T17:32:46.025221] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:46.025458] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-21T17:32:46.025515] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-21T17:32:46.025704] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-21T17:32:46.025760] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-21T17:32:46.375735] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:46.551010] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-21T17:32:46.793109] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:32:46.800980] [INFO ] [REMOTE ] BGS: Full fetch complete (72644 records). [2025-10-21T17:32:46.801101] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-21T17:32:46.916022] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T17:32:47.210690] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-21T17:32:47.210787] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-21T17:32:47.211606] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-21T17:32:47.211670] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-21T17:32:47.213097] [DEBUG] [LOCAL ] BGS: Trimmed 72644 records to 50552 (keeping 200 days of data) [2025-10-21T17:32:47.378530] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-21T17:32:47.514065] [DEBUG] [LOCAL ] BGS: Primary data saved (50552 records). [2025-10-21T17:32:47.514210] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-21T17:32:47.515025] [INFO ] [MAIN ] Update Progress: 264/2366 symbols completed. BGS took 32.8s. Estimated remaining: 4h 20m 33s. Rate: 8.1 symbols/min [2025-10-21T17:32:47.700611] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:47.700853] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-10-21T17:32:47.700921] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-10-21T17:32:47.701063] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-21T17:32:47.701125] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-21T17:32:47.701243] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-21T17:32:47.701288] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-21T17:32:47.886856] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T17:32:48.071180] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:48.151005] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-21T17:32:48.452450] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:32:48.950989] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-21T17:32:48.962561] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T17:32:49.751082] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-21T17:32:49.876155] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T17:32:49.879002] [INFO ] [REMOTE ] BGT: Full fetch complete (24258 records). [2025-10-21T17:32:49.879111] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-21T17:32:50.274124] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-21T17:32:50.274203] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-21T17:32:50.274635] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-21T17:32:50.274719] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-21T17:32:50.275393] [DEBUG] [LOCAL ] BGT: Trimmed 24258 records to 16274 (keeping 200 days of data) [2025-10-21T17:32:50.382897] [DEBUG] [LOCAL ] BGT: Primary data saved (16274 records). [2025-10-21T17:32:50.383061] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-21T17:32:50.383183] [INFO ] [MAIN ] Update Progress: 265/2366 symbols completed. BGT took 32.4s. Estimated remaining: 4h 19m 50s. Rate: 8.1 symbols/min [2025-10-21T17:32:50.554413] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-21T17:32:50.581223] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:32:50.622968] [DEBUG] [LOCAL ] BHC: Loaded 46695 existing records from primary storage. [2025-10-21T17:32:50.623273] [INFO ] [MAIN ] BHC: Loaded 46695 existing records. [2025-10-21T17:32:50.801889] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T17:32:50.830352] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:32:50.830945] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-21T17:32:50.831007] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-21T17:32:50.831198] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-21T17:32:50.831237] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-21T17:32:51.216004] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:32:51.350984] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-21T17:32:51.617224] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T17:32:52.151026] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-21T17:32:52.951066] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-21T17:32:52.984747] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T17:32:53.476872] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T17:32:53.599282] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:32:53.751091] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-21T17:32:54.343379] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:32:54.551046] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-21T17:32:55.305219] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T17:32:55.351012] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-21T17:32:56.151019] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-21T17:32:56.631982] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T17:32:56.951026] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-21T17:32:57.326787] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T17:32:57.751364] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-21T17:32:58.207926] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T17:32:58.509966] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T17:32:58.550978] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-21T17:32:59.336189] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T17:32:59.350981] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-21T17:33:00.151051] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-21T17:33:00.330060] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:33:00.951004] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-21T17:33:00.960847] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T17:33:01.751024] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-21T17:33:02.426360] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T17:33:02.551005] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-21T17:33:02.702629] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T17:33:03.351084] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-21T17:33:04.151022] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-21T17:33:04.221895] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:33:04.542991] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T17:33:04.951034] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-21T17:33:05.073609] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T17:33:05.751089] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-21T17:33:06.551000] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-21T17:33:06.594592] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T17:33:06.845508] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T17:33:07.297638] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T17:33:07.351025] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-21T17:33:08.150989] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-21T17:33:08.384337] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T17:33:08.387151] [INFO ] [REMOTE ] BGX: Full fetch complete (16507 records). [2025-10-21T17:33:08.387219] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-21T17:33:08.744191] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-21T17:33:08.744268] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-21T17:33:08.744602] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-21T17:33:08.744659] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-21T17:33:08.745174] [DEBUG] [LOCAL ] BGX: Trimmed 16507 records to 11249 (keeping 200 days of data) [2025-10-21T17:33:08.811373] [DEBUG] [LOCAL ] BGX: Primary data saved (11249 records). [2025-10-21T17:33:08.811505] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-21T17:33:08.811573] [INFO ] [MAIN ] Update Progress: 266/2366 symbols completed. BGX took 32.4s. Estimated remaining: 4h 21m 9s. Rate: 8.0 symbols/min [2025-10-21T17:33:08.957636] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-21T17:33:08.984239] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:09.006728] [DEBUG] [LOCAL ] BHE: Loaded 23853 existing records from primary storage. [2025-10-21T17:33:09.007002] [INFO ] [MAIN ] BHE: Loaded 23853 existing records. [2025-10-21T17:33:09.199452] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:33:09.199798] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-21T17:33:09.199854] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-21T17:33:09.200052] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-21T17:33:09.200108] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-21T17:33:09.596462] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:09.599147] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:33:09.751004] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-21T17:33:10.075368] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T17:33:10.551069] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-21T17:33:11.350996] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-21T17:33:11.439587] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T17:33:11.855221] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T17:33:12.151047] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-21T17:33:12.350119] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T17:33:12.951071] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-21T17:33:12.976957] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T17:33:13.751068] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-21T17:33:14.551060] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-21T17:33:14.607362] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T17:33:14.857171] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T17:33:14.862887] [INFO ] [REMOTE ] BGY: Full fetch complete (32992 records). [2025-10-21T17:33:14.863086] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-21T17:33:15.305021] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-21T17:33:15.305124] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-21T17:33:15.305626] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-21T17:33:15.305710] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-21T17:33:15.306422] [DEBUG] [LOCAL ] BGY: Trimmed 32992 records to 21500 (keeping 200 days of data) [2025-10-21T17:33:15.351874] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-21T17:33:15.429502] [DEBUG] [LOCAL ] BGY: Primary data saved (21500 records). [2025-10-21T17:33:15.429620] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-21T17:33:15.429724] [INFO ] [MAIN ] Update Progress: 267/2366 symbols completed. BGY took 29.8s. Estimated remaining: 4h 20m 55s. Rate: 8.0 symbols/min [2025-10-21T17:33:15.599515] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:15.599788] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-21T17:33:15.599970] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-21T17:33:15.600086] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-21T17:33:15.600128] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-21T17:33:15.600189] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-21T17:33:15.600222] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-21T17:33:15.857356] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T17:33:15.976087] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:16.150999] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-21T17:33:16.592547] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:33:16.951023] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-21T17:33:17.215505] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T17:33:17.751031] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-21T17:33:18.204907] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T17:33:18.551053] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-21T17:33:18.662414] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T17:33:19.351043] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-21T17:33:19.845849] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T17:33:20.151024] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-21T17:33:20.674311] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T17:33:20.951019] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-21T17:33:21.119595] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T17:33:21.751036] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-21T17:33:22.273835] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T17:33:22.550993] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-21T17:33:22.713763] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T17:33:22.716382] [INFO ] [REMOTE ] BH: Full fetch complete (19499 records). [2025-10-21T17:33:22.716456] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-21T17:33:22.716912] [FATAL] [VALIDATOR ] BH: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:33:22.717001] [FATAL] [MAIN ] BH: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:33:22.717043] [WARN ] [MAIN ] BH: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:33:22.717081] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-21T17:33:22.717134] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-21T17:33:22.717170] [INFO ] [LOCAL ] BH: Starting deletion of derivative data. [2025-10-21T17:33:22.717208] [DEBUG] [LOCAL ] BH: No derivative data file found to delete. [2025-10-21T17:33:22.717262] [INFO ] [MAIN ] Update Progress: 268/2366 symbols completed. BH took 35.2s. Estimated remaining: 4h 20m 46s. Rate: 8.0 symbols/min [2025-10-21T17:33:22.883291] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:22.883472] [DEBUG] [LOCAL ] BHP: No existing data file found in primary storage. [2025-10-21T17:33:22.883509] [WARN ] [MAIN ] BHP: No existing data found, performing full refresh instead. [2025-10-21T17:33:22.883617] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-21T17:33:22.883688] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-21T17:33:22.883747] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-10-21T17:33:22.883782] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-21T17:33:23.230709] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:23.351009] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-21T17:33:24.150997] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-21T17:33:24.216252] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T17:33:24.391140] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:33:24.951058] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-21T17:33:25.151518] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T17:33:25.751060] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-21T17:33:25.972610] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T17:33:26.551024] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-21T17:33:27.351046] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-21T17:33:27.736370] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T17:33:27.784202] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T17:33:28.151014] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-21T17:33:28.757449] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T17:33:28.950995] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-21T17:33:29.223624] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:33:29.751005] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-21T17:33:30.551067] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-21T17:33:30.602379] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:33:30.672373] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T17:33:30.675950] [INFO ] [REMOTE ] BHE: Full fetch complete (36397 records). [2025-10-21T17:33:30.676030] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-21T17:33:31.042131] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-21T17:33:31.042204] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-21T17:33:31.042706] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-21T17:33:31.042767] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-21T17:33:31.043514] [DEBUG] [LOCAL ] BHE: Trimmed 36397 records to 23786 (keeping 200 days of data) [2025-10-21T17:33:31.183041] [DEBUG] [LOCAL ] BHE: Primary data saved (23786 records). [2025-10-21T17:33:31.183161] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-21T17:33:31.183234] [INFO ] [MAIN ] Update Progress: 269/2366 symbols completed. BHE took 22.4s. Estimated remaining: 4h 20m 47s. Rate: 8.0 symbols/min [2025-10-21T17:33:31.368820] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-21T17:33:31.371350] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:31.394284] [DEBUG] [LOCAL ] BHR: Loaded 22056 existing records from primary storage. [2025-10-21T17:33:31.394596] [INFO ] [MAIN ] BHR: Loaded 22056 existing records. [2025-10-21T17:33:31.571283] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:33:31.571569] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-21T17:33:31.571685] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-21T17:33:31.571877] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-21T17:33:31.571938] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-21T17:33:31.713140] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T17:33:31.948394] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:32.150998] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-21T17:33:32.951016] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-21T17:33:33.294870] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:33:33.484408] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-21T17:33:33.751035] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-21T17:33:34.551049] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-21T17:33:34.734853] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T17:33:34.742077] [INFO ] [REMOTE ] BHC: Full fetch complete (67517 records). [2025-10-21T17:33:34.742194] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-21T17:33:35.161630] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-21T17:33:35.161804] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-21T17:33:35.162729] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-21T17:33:35.162810] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-21T17:33:35.173618] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T17:33:35.178750] [DEBUG] [LOCAL ] BHC: Trimmed 67517 records to 46640 (keeping 200 days of data) [2025-10-21T17:33:35.369445] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-21T17:33:35.438234] [DEBUG] [LOCAL ] BHC: Primary data saved (46640 records). [2025-10-21T17:33:35.438373] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-21T17:33:35.438450] [INFO ] [MAIN ] Update Progress: 270/2366 symbols completed. BHC took 45.1s. Estimated remaining: 4h 20m 14s. Rate: 8.1 symbols/min [2025-10-21T17:33:35.610543] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:35.610969] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-21T17:33:35.611078] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-21T17:33:35.611245] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-21T17:33:35.611310] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-21T17:33:35.611532] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-21T17:33:35.611605] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-21T17:33:35.995799] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:35.998167] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T17:33:36.151030] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-21T17:33:36.519496] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T17:33:36.950996] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-21T17:33:37.355338] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T17:33:37.751041] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-21T17:33:38.214326] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-21T17:33:38.551053] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-21T17:33:38.916244] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T17:33:39.351069] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-21T17:33:39.695988] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T17:33:39.826063] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T17:33:40.151010] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-21T17:33:40.950994] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-21T17:33:41.193440] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:33:41.751016] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-21T17:33:42.162178] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-21T17:33:42.551010] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-21T17:33:42.694607] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:33:43.351084] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-21T17:33:43.923567] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T17:33:44.151086] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-21T17:33:44.475393] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T17:33:44.951031] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-21T17:33:45.311993] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T17:33:45.751029] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-21T17:33:46.199524] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T17:33:46.296398] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:33:46.551022] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-21T17:33:47.351010] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-21T17:33:48.151047] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-21T17:33:48.569785] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T17:33:48.597554] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T17:33:48.598698] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:33:48.951068] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-21T17:33:49.751034] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-21T17:33:50.241737] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T17:33:50.551091] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-21T17:33:50.888332] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-21T17:33:51.351049] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-21T17:33:51.743161] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-21T17:33:51.745910] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-21T17:33:52.151007] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-21T17:33:52.640956] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T17:33:52.951030] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-21T17:33:53.751029] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-21T17:33:54.551037] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-21T17:33:54.796726] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T17:33:54.805246] [INFO ] [REMOTE ] BHP: Full fetch complete (77437 records). [2025-10-21T17:33:54.805411] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-21T17:33:54.955518] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T17:33:55.002973] [INFO ] [REMOTE ] BHK: Full fetch complete (30498 records). [2025-10-21T17:33:55.028930] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-21T17:33:55.323231] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T17:33:55.358548] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-21T17:33:55.407144] [INFO ] [REMOTE ] BHV: Full fetch complete (1403 records). [2025-10-21T17:33:55.421715] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-21T17:33:55.439725] [FATAL] [VALIDATOR ] BHV: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:33:55.424297] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-21T17:33:55.454342] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-21T17:33:55.460681] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-21T17:33:55.460877] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-21T17:33:55.454456] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:33:55.493413] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:33:55.500772] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-21T17:33:55.534615] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-21T17:33:55.545287] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-21T17:33:55.545414] [DEBUG] [LOCAL ] BHP: Trimmed 77437 records to 53368 (keeping 200 days of data) [2025-10-21T17:33:55.552529] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-21T17:33:55.552700] [INFO ] [MAIN ] Update Progress: 271/2366 symbols completed. BHV took 20.1s. Estimated remaining: 4h 21m 45s. Rate: 8.0 symbols/min [2025-10-21T17:33:55.845608] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-21T17:33:55.854480] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-21T17:33:55.861373] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-21T17:33:55.861467] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-21T17:33:55.907157] [DEBUG] [LOCAL ] BHK: Trimmed 30498 records to 23875 (keeping 200 days of data) [2025-10-21T17:33:55.942259] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:55.943478] [DEBUG] [LOCAL ] BHVN: No existing data file found in primary storage. [2025-10-21T17:33:55.944169] [WARN ] [MAIN ] BHVN: No existing data found, performing full refresh instead. [2025-10-21T17:33:55.993398] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-21T17:33:55.993549] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-21T17:33:56.002583] [DEBUG] [LOCAL ] BHVN: No primary data file found to delete. [2025-10-21T17:33:56.029625] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-21T17:33:56.217176] [DEBUG] [LOCAL ] BHK: Primary data saved (23875 records). [2025-10-21T17:33:56.229354] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-21T17:33:56.230007] [INFO ] [MAIN ] Update Progress: 272/2366 symbols completed. BHK took 40.8s. Estimated remaining: 4h 20m 45s. Rate: 8.0 symbols/min [2025-10-21T17:33:56.717713] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:56.782219] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:56.788795] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-21T17:33:56.855272] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T17:33:56.913366] [DEBUG] [LOCAL ] BHP: Primary data saved (53368 records). [2025-10-21T17:33:56.913597] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-21T17:33:56.913712] [INFO ] [MAIN ] Update Progress: 273/2366 symbols completed. BHP took 34.2s. Estimated remaining: 4h 19m 45s. Rate: 8.1 symbols/min [2025-10-21T17:33:56.957066] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-21T17:33:57.101488] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:33:57.116216] [DEBUG] [LOCAL ] BIO: No existing data file found in primary storage. [2025-10-21T17:33:57.116273] [WARN ] [MAIN ] BIO: No existing data found, performing full refresh instead. [2025-10-21T17:33:57.116960] [DEBUG] [LOCAL ] BILL: Loaded 52513 existing records from primary storage. [2025-10-21T17:33:57.117151] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-21T17:33:57.117296] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-21T17:33:57.117424] [INFO ] [MAIN ] BILL: Loaded 52513 existing records. [2025-10-21T17:33:57.117509] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-21T17:33:57.160607] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-21T17:33:57.454633] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:33:57.538606] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-21T17:33:57.549755] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-21T17:33:57.576327] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-21T17:33:57.576495] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-21T17:33:57.759830] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:57.775823] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-21T17:33:58.053017] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:33:58.067362] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T17:33:58.551137] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-21T17:33:58.643222] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T17:33:58.680565] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T17:33:59.351025] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-21T17:33:59.518946] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T17:34:00.151019] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-21T17:34:00.951560] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-21T17:34:00.951486] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:34:01.387243] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T17:34:01.391257] [INFO ] [REMOTE ] BHR: Full fetch complete (31079 records). [2025-10-21T17:34:01.391335] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-21T17:34:01.391802] [FATAL] [VALIDATOR ] BHR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:34:01.391884] [FATAL] [MAIN ] BHR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:34:01.391926] [WARN ] [MAIN ] BHR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:34:01.391988] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-21T17:34:01.392048] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-21T17:34:01.392087] [INFO ] [LOCAL ] BHR: Starting deletion of derivative data. [2025-10-21T17:34:01.392294] [DEBUG] [LOCAL ] BHR: Deleted derivative data file. [2025-10-21T17:34:01.392376] [INFO ] [MAIN ] Update Progress: 274/2366 symbols completed. BHR took 30.2s. Estimated remaining: 4h 19m 15s. Rate: 8.1 symbols/min [2025-10-21T17:34:01.576719] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:01.576898] [DEBUG] [LOCAL ] BIP: No existing data file found in primary storage. [2025-10-21T17:34:01.576935] [WARN ] [MAIN ] BIP: No existing data found, performing full refresh instead. [2025-10-21T17:34:01.577040] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-21T17:34:01.577080] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-21T17:34:01.577119] [DEBUG] [LOCAL ] BIP: No primary data file found to delete. [2025-10-21T17:34:01.577149] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-21T17:34:01.766522] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-21T17:34:01.969105] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:02.165356] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T17:34:02.551045] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-21T17:34:03.351019] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-21T17:34:03.684125] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T17:34:03.756704] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:34:04.151071] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-21T17:34:04.827759] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:34:04.951037] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-21T17:34:05.686331] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T17:34:05.751048] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-21T17:34:06.379188] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T17:34:06.551017] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-21T17:34:07.351030] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-21T17:34:07.567506] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:34:08.151019] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-21T17:34:08.519534] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T17:34:08.950990] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-21T17:34:09.025694] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:34:09.751003] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-21T17:34:10.018563] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:34:10.551010] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-21T17:34:10.764133] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T17:34:10.905509] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T17:34:11.350977] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-21T17:34:12.151002] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-21T17:34:12.541778] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-21T17:34:12.951065] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-21T17:34:13.215877] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T17:34:13.265795] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:34:13.751078] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-21T17:34:14.306134] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:34:14.550995] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-21T17:34:14.895900] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:34:15.351075] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-21T17:34:16.151027] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-21T17:34:16.506840] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T17:34:16.951036] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-21T17:34:17.318952] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T17:34:17.667018] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:34:17.751010] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-21T17:34:18.550996] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-21T17:34:18.789272] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T17:34:19.341740] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T17:34:19.356788] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-21T17:34:19.938891] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T17:34:20.151056] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-21T17:34:20.720565] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:34:20.951057] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-21T17:34:21.751043] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-21T17:34:21.896021] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T17:34:22.551052] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-21T17:34:22.979100] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T17:34:22.987725] [INFO ] [REMOTE ] BHVN: Full fetch complete (70603 records). [2025-10-21T17:34:22.987853] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-21T17:34:23.315839] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T17:34:23.356204] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-21T17:34:23.442229] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-21T17:34:23.442309] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-21T17:34:23.443059] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-21T17:34:23.443123] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-21T17:34:23.444419] [DEBUG] [LOCAL ] BHVN: Trimmed 70603 records to 50631 (keeping 200 days of data) [2025-10-21T17:34:23.738194] [DEBUG] [LOCAL ] BHVN: Primary data saved (50631 records). [2025-10-21T17:34:23.738359] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-21T17:34:23.738442] [INFO ] [MAIN ] Update Progress: 275/2366 symbols completed. BHVN took 28.2s. Estimated remaining: 4h 21m 1s. Rate: 8.0 symbols/min [2025-10-21T17:34:23.908472] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:23.944755] [DEBUG] [LOCAL ] BIPC: Loaded 41246 existing records from primary storage. [2025-10-21T17:34:23.945072] [INFO ] [MAIN ] BIPC: Loaded 41246 existing records. [2025-10-21T17:34:24.124972] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:24.125240] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-21T17:34:24.125378] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-21T17:34:24.125812] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-21T17:34:24.125869] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-21T17:34:24.156445] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-21T17:34:24.528716] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:24.525455] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T17:34:24.605557] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:34:24.951004] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-21T17:34:25.298249] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:34:25.751093] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-21T17:34:26.429566] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T17:34:26.551017] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-21T17:34:27.333900] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:34:27.350977] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-21T17:34:27.786365] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:34:28.151019] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-21T17:34:28.826978] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T17:34:28.951044] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-21T17:34:29.651633] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T17:34:29.751005] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-21T17:34:29.863288] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:34:29.871970] [INFO ] [REMOTE ] BILL: Full fetch complete (76136 records). [2025-10-21T17:34:29.872118] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-21T17:34:30.265698] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-21T17:34:30.265795] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-21T17:34:30.266613] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-21T17:34:30.266706] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-21T17:34:30.268220] [DEBUG] [LOCAL ] BILL: Trimmed 76136 records to 52510 (keeping 200 days of data) [2025-10-21T17:34:30.555728] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-21T17:34:30.562957] [DEBUG] [LOCAL ] BILL: Primary data saved (52510 records). [2025-10-21T17:34:30.564349] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-21T17:34:30.564448] [INFO ] [MAIN ] Update Progress: 276/2366 symbols completed. BILL took 34.3s. Estimated remaining: 4h 20m 49s. Rate: 8.0 symbols/min [2025-10-21T17:34:30.730282] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:30.735218] [DEBUG] [LOCAL ] BIPH: Loaded 2395 existing records from primary storage. [2025-10-21T17:34:30.735363] [INFO ] [MAIN ] BIPH: Loaded 2395 existing records. [2025-10-21T17:34:30.911042] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:30.911283] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-21T17:34:30.911334] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-21T17:34:30.911476] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-21T17:34:30.911531] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-21T17:34:31.258732] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:31.351331] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-21T17:34:31.354976] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T17:34:32.151060] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-21T17:34:32.200530] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T17:34:32.429936] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T17:34:32.433192] [INFO ] [REMOTE ] BIO: Full fetch complete (34413 records). [2025-10-21T17:34:32.433336] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-21T17:34:32.808230] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-21T17:34:32.808382] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-21T17:34:32.808915] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-21T17:34:32.809323] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-21T17:34:32.810162] [DEBUG] [LOCAL ] BIO: Trimmed 34413 records to 23888 (keeping 200 days of data) [2025-10-21T17:34:32.953105] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-21T17:34:32.955120] [DEBUG] [LOCAL ] BIO: Primary data saved (23888 records). [2025-10-21T17:34:32.956224] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-21T17:34:32.956310] [INFO ] [MAIN ] Update Progress: 277/2366 symbols completed. BIO took 36.0s. Estimated remaining: 4h 20m 3s. Rate: 8.0 symbols/min [2025-10-21T17:34:33.598056] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T17:34:33.611804] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-21T17:34:33.751054] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-21T17:34:34.551026] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-21T17:34:35.001465] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T17:34:35.081891] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T17:34:35.351064] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-21T17:34:36.151084] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-21T17:34:36.779032] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T17:34:36.785600] [INFO ] [REMOTE ] BIP: Full fetch complete (57614 records). [2025-10-21T17:34:36.785785] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-21T17:34:36.963116] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-21T17:34:37.177026] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-21T17:34:37.177105] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-21T17:34:37.177762] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-21T17:34:37.177824] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-21T17:34:37.179005] [DEBUG] [LOCAL ] BIP: Trimmed 57614 records to 39061 (keeping 200 days of data) [2025-10-21T17:34:37.413162] [DEBUG] [LOCAL ] BIP: Primary data saved (39061 records). [2025-10-21T17:34:37.413315] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-21T17:34:37.413397] [INFO ] [MAIN ] Update Progress: 278/2366 symbols completed. BIP took 36.0s. Estimated remaining: 4h 19m 33s. Rate: 8.0 symbols/min [2025-10-21T17:34:37.599952] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T17:34:37.679737] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:34:37.751062] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-21T17:34:38.064841] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-21T17:34:38.551079] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-21T17:34:38.998450] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T17:34:39.351068] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-21T17:34:40.151078] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-21T17:34:40.615415] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-21T17:34:40.933918] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T17:34:40.950978] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-21T17:34:41.750992] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-21T17:34:42.201285] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T17:34:42.268927] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T17:34:42.551032] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-21T17:34:43.351080] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-21T17:34:43.847481] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-21T17:34:44.112557] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T17:34:44.151000] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-21T17:34:44.951029] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-21T17:34:45.409936] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T17:34:45.751074] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-21T17:34:45.789834] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T17:34:45.796388] [INFO ] [REMOTE ] BIPC: Full fetch complete (60268 records). [2025-10-21T17:34:45.796490] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-21T17:34:46.208614] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T17:34:46.208481] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-21T17:34:46.210032] [INFO ] [REMOTE ] BIPH: Full fetch complete (3877 records). [2025-10-21T17:34:46.210140] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-21T17:34:46.208841] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-21T17:34:46.255117] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-21T17:34:46.282234] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-21T17:34:46.343003] [DEBUG] [LOCAL ] BIPC: Trimmed 60268 records to 41184 (keeping 200 days of data) [2025-10-21T17:34:46.697454] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-21T17:34:46.698586] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-21T17:34:46.699107] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-21T17:34:46.699441] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-21T17:34:46.701430] [DEBUG] [LOCAL ] BIPH: Trimmed 3877 records to 2375 (keeping 200 days of data) [2025-10-21T17:34:46.718306] [DEBUG] [LOCAL ] BIPH: Primary data saved (2375 records). [2025-10-21T17:34:46.718968] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-21T17:34:46.719580] [INFO ] [MAIN ] Update Progress: 279/2366 symbols completed. BIPH took 16.2s. Estimated remaining: 4h 19m 39s. Rate: 8.0 symbols/min [2025-10-21T17:34:46.848885] [DEBUG] [LOCAL ] BIPC: Primary data saved (41184 records). [2025-10-21T17:34:46.849007] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-21T17:34:46.849080] [INFO ] [MAIN ] Update Progress: 280/2366 symbols completed. BIPC took 23.1s. Estimated remaining: 4h 18m 37s. Rate: 8.1 symbols/min [2025-10-21T17:34:47.443952] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:47.493981] [DEBUG] [LOCAL ] BIPI: No existing data file found in primary storage. [2025-10-21T17:34:47.548514] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:47.546208] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:47.548637] [WARN ] [MAIN ] BIPI: No existing data found, performing full refresh instead. [2025-10-21T17:34:47.551868] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:34:47.552548] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-21T17:34:47.553205] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-21T17:34:47.553615] [DEBUG] [LOCAL ] BIPI: No primary data file found to delete. [2025-10-21T17:34:47.553976] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-21T17:34:47.621444] [DEBUG] [LOCAL ] BIPJ: Loaded 3133 existing records from primary storage. [2025-10-21T17:34:47.627665] [INFO ] [MAIN ] BIPJ: Loaded 3133 existing records. [2025-10-21T17:34:47.748717] [DEBUG] [LOCAL ] BIT: Loaded 23780 existing records from primary storage. [2025-10-21T17:34:47.775626] [INFO ] [MAIN ] BIT: Loaded 23780 existing records. [2025-10-21T17:34:48.183964] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:48.199961] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-21T17:34:48.215224] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-21T17:34:48.206697] [DEBUG] [LOCAL ] BIRK: Loaded 51198 existing records from primary storage. [2025-10-21T17:34:48.249502] [INFO ] [MAIN ] BIRK: Loaded 51198 existing records. [2025-10-21T17:34:48.249373] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-21T17:34:48.263543] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-21T17:34:48.334298] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:48.367466] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-21T17:34:48.386221] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-21T17:34:48.421566] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-21T17:34:48.590436] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:48.601781] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-21T17:34:48.577892] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-21T17:34:48.810119] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:34:48.831897] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-21T17:34:48.862022] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-21T17:34:48.921989] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-21T17:34:48.959688] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-21T17:34:49.463282] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T17:34:49.555308] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-21T17:34:49.569638] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:49.565270] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:49.595678] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-21T17:34:49.607395] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-21T17:34:49.790513] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:34:49.790876] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-21T17:34:50.073000] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T17:34:50.239096] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:34:50.551063] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-21T17:34:50.835902] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:34:50.931792] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-21T17:34:51.351090] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-21T17:34:51.611435] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T17:34:51.733035] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-21T17:34:52.151048] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-21T17:34:52.858008] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-21T17:34:52.951023] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-21T17:34:53.602395] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T17:34:53.751024] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-21T17:34:54.239747] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:34:54.551039] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-21T17:34:55.022288] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T17:34:55.351021] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-21T17:34:55.859436] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T17:34:56.151021] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-21T17:34:56.758203] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T17:34:56.951026] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-21T17:34:57.503986] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T17:34:57.751037] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-21T17:34:58.551034] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-21T17:34:59.108344] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:34:59.351031] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-21T17:34:59.450907] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T17:35:00.151011] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-21T17:35:00.471758] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T17:35:00.900344] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T17:35:00.950985] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-21T17:35:01.751060] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-21T17:35:02.437164] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T17:35:02.438138] [INFO ] [REMOTE ] BIPI: Full fetch complete (4627 records). [2025-10-21T17:35:02.438234] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-21T17:35:02.556094] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-21T17:35:02.821183] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-21T17:35:02.821316] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-21T17:35:02.821693] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-21T17:35:02.821816] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-21T17:35:02.822566] [DEBUG] [LOCAL ] BIPI: Trimmed 4627 records to 2845 (keeping 200 days of data) [2025-10-21T17:35:02.849135] [DEBUG] [LOCAL ] BIPI: Primary data saved (2845 records). [2025-10-21T17:35:02.849343] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-21T17:35:02.849506] [INFO ] [MAIN ] Update Progress: 281/2366 symbols completed. BIPI took 16.0s. Estimated remaining: 4h 19m 33s. Rate: 8.0 symbols/min [2025-10-21T17:35:02.976411] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T17:35:03.092971] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:03.149541] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T17:35:03.150531] [DEBUG] [LOCAL ] BJ: Loaded 51581 existing records from primary storage. [2025-10-21T17:35:03.153539] [INFO ] [MAIN ] BJ: Loaded 51581 existing records. [2025-10-21T17:35:03.350952] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:03.351297] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-21T17:35:03.351347] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-21T17:35:03.351027] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-21T17:35:03.351738] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-21T17:35:03.352843] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-21T17:35:03.733605] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:04.151029] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-21T17:35:04.551130] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T17:35:04.951084] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-21T17:35:05.671177] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T17:35:05.756133] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-21T17:35:05.774049] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:35:06.551002] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-21T17:35:06.712727] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T17:35:07.351044] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-21T17:35:07.786753] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T17:35:08.149306] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:35:08.158186] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-21T17:35:08.726114] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T17:35:08.951008] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-21T17:35:09.751020] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-21T17:35:10.551010] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-21T17:35:10.657098] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T17:35:10.741447] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T17:35:11.351017] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-21T17:35:12.135385] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:35:12.150974] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-21T17:35:12.179861] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:35:12.769933] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T17:35:12.771028] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4195 records). [2025-10-21T17:35:12.771095] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-21T17:35:12.951078] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-21T17:35:13.140567] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-21T17:35:13.140665] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-21T17:35:13.140830] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-21T17:35:13.140872] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-21T17:35:13.141220] [DEBUG] [LOCAL ] BIPJ: Trimmed 4195 records to 3124 (keeping 200 days of data) [2025-10-21T17:35:13.160704] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3124 records). [2025-10-21T17:35:13.160810] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-21T17:35:13.160886] [INFO ] [MAIN ] Update Progress: 282/2366 symbols completed. BIPJ took 26.3s. Estimated remaining: 4h 19m 46s. Rate: 8.0 symbols/min [2025-10-21T17:35:13.334678] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:13.383356] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-21T17:35:13.383687] [INFO ] [MAIN ] BK: Loaded 53546 existing records. [2025-10-21T17:35:13.580703] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:13.580949] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-21T17:35:13.581009] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-21T17:35:13.581292] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-21T17:35:13.581347] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-21T17:35:13.759803] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-21T17:35:13.944816] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:14.551010] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-21T17:35:14.871292] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T17:35:15.351089] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-21T17:35:15.816006] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T17:35:15.991751] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:35:16.151027] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-21T17:35:16.950097] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T17:35:16.959477] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-21T17:35:17.690086] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T17:35:17.751086] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-21T17:35:18.551050] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-21T17:35:18.852458] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:35:19.351010] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-21T17:35:19.563349] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T17:35:19.830666] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T17:35:20.151101] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-21T17:35:20.956183] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-21T17:35:20.971336] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T17:35:21.187270] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T17:35:21.751043] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-21T17:35:22.551062] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-21T17:35:22.589721] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:35:23.351033] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-21T17:35:23.445905] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:35:23.893293] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T17:35:23.898522] [INFO ] [REMOTE ] BIT: Full fetch complete (32264 records). [2025-10-21T17:35:23.898709] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-21T17:35:24.161254] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-21T17:35:24.290174] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-21T17:35:24.290257] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-21T17:35:24.290780] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-21T17:35:24.290844] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-21T17:35:24.291630] [DEBUG] [LOCAL ] BIT: Trimmed 32264 records to 23895 (keeping 200 days of data) [2025-10-21T17:35:24.433572] [DEBUG] [LOCAL ] BIT: Primary data saved (23895 records). [2025-10-21T17:35:24.433724] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-21T17:35:24.433808] [INFO ] [MAIN ] Update Progress: 283/2366 symbols completed. BIT took 37.6s. Estimated remaining: 4h 20m 7s. Rate: 8.0 symbols/min [2025-10-21T17:35:24.618163] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:24.618355] [DEBUG] [LOCAL ] BKD: No existing data file found in primary storage. [2025-10-21T17:35:24.618397] [WARN ] [MAIN ] BKD: No existing data found, performing full refresh instead. [2025-10-21T17:35:24.618506] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-21T17:35:24.618548] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-21T17:35:24.618588] [DEBUG] [LOCAL ] BKD: No primary data file found to delete. [2025-10-21T17:35:24.618622] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-21T17:35:24.969087] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-21T17:35:25.005370] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:25.044928] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T17:35:25.751060] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-21T17:35:26.154765] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:35:26.551096] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-21T17:35:26.850901] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T17:35:27.351032] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-21T17:35:27.478322] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T17:35:28.139706] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:35:28.150969] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-21T17:35:28.951059] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-21T17:35:29.220349] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T17:35:29.228342] [INFO ] [REMOTE ] BIRK: Full fetch complete (73411 records). [2025-10-21T17:35:29.228469] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-21T17:35:29.618842] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-21T17:35:29.618971] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-21T17:35:29.619971] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-21T17:35:29.620052] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-21T17:35:29.621471] [DEBUG] [LOCAL ] BIRK: Trimmed 73411 records to 51192 (keeping 200 days of data) [2025-10-21T17:35:29.757439] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-21T17:35:29.759352] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T17:35:29.946134] [DEBUG] [LOCAL ] BIRK: Primary data saved (51192 records). [2025-10-21T17:35:29.946285] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-21T17:35:29.946910] [INFO ] [MAIN ] Update Progress: 284/2366 symbols completed. BIRK took 43.1s. Estimated remaining: 4h 19m 45s. Rate: 8.0 symbols/min [2025-10-21T17:35:30.123898] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:30.158438] [DEBUG] [LOCAL ] BKE: Loaded 33953 existing records from primary storage. [2025-10-21T17:35:30.158760] [INFO ] [MAIN ] BKE: Loaded 33953 existing records. [2025-10-21T17:35:30.345550] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:30.345774] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-21T17:35:30.345824] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-21T17:35:30.346036] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-21T17:35:30.346094] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-21T17:35:30.568975] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-21T17:35:30.726947] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:30.758401] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:35:31.094953] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T17:35:31.351030] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-21T17:35:32.151003] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-21T17:35:32.324121] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:35:32.951003] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-21T17:35:33.129562] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T17:35:33.751057] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-21T17:35:33.950820] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T17:35:33.959005] [INFO ] [REMOTE ] BJ: Full fetch complete (74438 records). [2025-10-21T17:35:33.959146] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-21T17:35:34.370518] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T17:35:34.399118] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-21T17:35:34.399933] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-21T17:35:34.400828] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-21T17:35:34.400892] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-21T17:35:34.402177] [DEBUG] [LOCAL ] BJ: Trimmed 74438 records to 51545 (keeping 200 days of data) [2025-10-21T17:35:34.571331] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-21T17:35:34.711541] [DEBUG] [LOCAL ] BJ: Primary data saved (51545 records). [2025-10-21T17:35:34.711704] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-21T17:35:34.711791] [INFO ] [MAIN ] Update Progress: 285/2366 symbols completed. BJ took 31.9s. Estimated remaining: 4h 19m 18s. Rate: 8.0 symbols/min [2025-10-21T17:35:34.878889] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:34.879049] [DEBUG] [LOCAL ] BKH: No existing data file found in primary storage. [2025-10-21T17:35:34.879085] [WARN ] [MAIN ] BKH: No existing data found, performing full refresh instead. [2025-10-21T17:35:34.879216] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-21T17:35:34.879281] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-21T17:35:34.879327] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-21T17:35:34.879358] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-21T17:35:35.243729] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:35.299118] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:35:35.351031] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-21T17:35:36.059714] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T17:35:36.150994] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-21T17:35:36.540085] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T17:35:36.951021] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-21T17:35:37.751010] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-21T17:35:37.821467] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T17:35:38.556146] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-21T17:35:38.577013] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T17:35:39.188184] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:35:39.351084] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-21T17:35:40.054537] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:35:40.151025] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-21T17:35:40.906739] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T17:35:40.951009] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-21T17:35:41.751101] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-21T17:35:41.811470] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T17:35:42.551158] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-21T17:35:42.591053] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:35:43.351054] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-21T17:35:43.681389] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:35:43.865403] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T17:35:44.151008] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-21T17:35:44.951097] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-21T17:35:45.069354] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T17:35:45.751078] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-21T17:35:46.041147] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T17:35:46.113580] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T17:35:46.122487] [INFO ] [REMOTE ] BK: Full fetch complete (77677 records). [2025-10-21T17:35:46.122730] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-21T17:35:46.502760] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-21T17:35:46.502838] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-21T17:35:46.503605] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-21T17:35:46.503672] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-21T17:35:46.505044] [DEBUG] [LOCAL ] BK: Trimmed 77677 records to 53546 (keeping 200 days of data) [2025-10-21T17:35:46.558417] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-21T17:35:46.858624] [DEBUG] [LOCAL ] BK: Primary data saved (53546 records). [2025-10-21T17:35:46.858834] [INFO ] [MAIN ] BK: Full history saved. [2025-10-21T17:35:46.858949] [INFO ] [MAIN ] Update Progress: 286/2366 symbols completed. BK took 33.7s. Estimated remaining: 4h 19m 44s. Rate: 8.0 symbols/min [2025-10-21T17:35:47.042592] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:47.077667] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T17:35:47.118921] [DEBUG] [LOCAL ] BKKT: Loaded 37052 existing records from primary storage. [2025-10-21T17:35:47.119213] [INFO ] [MAIN ] BKKT: Loaded 37052 existing records. [2025-10-21T17:35:47.302542] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:47.302743] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-21T17:35:47.302796] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-21T17:35:47.302963] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-21T17:35:47.303003] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-21T17:35:47.363030] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-21T17:35:47.675677] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:48.150998] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-21T17:35:48.182424] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T17:35:48.951005] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-21T17:35:49.201482] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:35:49.209272] [INFO ] [REMOTE ] BKD: Full fetch complete (72104 records). [2025-10-21T17:35:49.209412] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-21T17:35:49.605934] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-21T17:35:49.606015] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-21T17:35:49.606852] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-21T17:35:49.606916] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-21T17:35:49.608313] [DEBUG] [LOCAL ] BKD: Trimmed 72104 records to 50448 (keeping 200 days of data) [2025-10-21T17:35:49.759916] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-21T17:35:49.886764] [DEBUG] [LOCAL ] BKD: Primary data saved (50448 records). [2025-10-21T17:35:49.887034] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-21T17:35:49.887163] [INFO ] [MAIN ] Update Progress: 287/2366 symbols completed. BKD took 25.5s. Estimated remaining: 4h 19m 4s. Rate: 8.0 symbols/min [2025-10-21T17:35:50.048301] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T17:35:50.087852] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:35:50.096089] [DEBUG] [LOCAL ] BKN: Loaded 7285 existing records from primary storage. [2025-10-21T17:35:50.096247] [INFO ] [MAIN ] BKN: Loaded 7285 existing records. [2025-10-21T17:35:50.273423] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:35:50.273693] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-21T17:35:50.273786] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-21T17:35:50.273974] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-21T17:35:50.274070] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-21T17:35:50.554182] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-21T17:35:50.630698] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T17:35:50.652193] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:35:51.190245] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T17:35:51.351040] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-21T17:35:52.120320] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T17:35:52.137407] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T17:35:52.151039] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-21T17:35:52.951101] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-21T17:35:53.529847] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T17:35:53.751026] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-21T17:35:54.378303] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T17:35:54.395855] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T17:35:54.551014] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-21T17:35:55.351032] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-21T17:35:55.511324] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:35:56.151027] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-21T17:35:56.606691] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T17:35:56.951044] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-21T17:35:57.575458] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T17:35:57.751006] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-21T17:35:58.258622] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T17:35:58.550982] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-21T17:35:59.029971] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T17:35:59.351067] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-21T17:35:59.391777] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T17:36:00.151065] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-21T17:36:00.900150] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:36:00.950996] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-21T17:36:01.663014] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:36:01.751071] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-21T17:36:02.551035] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-21T17:36:02.877788] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:36:03.350990] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-21T17:36:03.498456] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T17:36:03.882800] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:36:04.151028] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-21T17:36:04.165754] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T17:36:04.951027] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-21T17:36:05.444124] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T17:36:05.465584] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T17:36:05.751071] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-21T17:36:06.551034] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-21T17:36:07.095047] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T17:36:07.100349] [INFO ] [REMOTE ] BKE: Full fetch complete (50297 records). [2025-10-21T17:36:07.100445] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-21T17:36:07.356231] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-21T17:36:07.482692] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-21T17:36:07.482795] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-21T17:36:07.483453] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-21T17:36:07.483497] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-21T17:36:07.484624] [DEBUG] [LOCAL ] BKE: Trimmed 50297 records to 33720 (keeping 200 days of data) [2025-10-21T17:36:07.686721] [DEBUG] [LOCAL ] BKE: Primary data saved (33720 records). [2025-10-21T17:36:07.686877] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-21T17:36:07.687283] [INFO ] [MAIN ] Update Progress: 288/2366 symbols completed. BKE took 37.7s. Estimated remaining: 4h 20m 11s. Rate: 8.0 symbols/min [2025-10-21T17:36:07.860139] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:07.905516] [DEBUG] [LOCAL ] BKSY: Loaded 48890 existing records from primary storage. [2025-10-21T17:36:07.905837] [INFO ] [MAIN ] BKSY: Loaded 48890 existing records. [2025-10-21T17:36:08.104619] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:08.105907] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T17:36:08.111605] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-21T17:36:08.111845] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-21T17:36:08.112409] [INFO ] [REMOTE ] BKH: Full fetch complete (53164 records). [2025-10-21T17:36:08.112444] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-21T17:36:08.112570] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-21T17:36:08.112619] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-21T17:36:08.161134] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-21T17:36:08.273056] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T17:36:08.921551] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:08.957579] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-21T17:36:08.987273] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-21T17:36:08.987394] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-21T17:36:08.988340] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-21T17:36:08.988525] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-21T17:36:08.990226] [DEBUG] [LOCAL ] BKH: Trimmed 53164 records to 37390 (keeping 200 days of data) [2025-10-21T17:36:09.245314] [DEBUG] [LOCAL ] BKH: Primary data saved (37390 records). [2025-10-21T17:36:09.245453] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-21T17:36:09.245524] [INFO ] [MAIN ] Update Progress: 289/2366 symbols completed. BKH took 34.5s. Estimated remaining: 4h 19m 21s. Rate: 8.0 symbols/min [2025-10-21T17:36:09.413268] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:09.427529] [DEBUG] [LOCAL ] BKT: Loaded 12778 existing records from primary storage. [2025-10-21T17:36:09.428284] [INFO ] [MAIN ] BKT: Loaded 12778 existing records. [2025-10-21T17:36:09.604177] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:09.604805] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-21T17:36:09.604914] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-21T17:36:09.605171] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-21T17:36:09.605225] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-21T17:36:09.752503] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-21T17:36:09.781821] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T17:36:09.890054] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T17:36:10.027974] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:10.551095] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-21T17:36:11.351057] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-21T17:36:11.436731] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T17:36:11.796352] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-21T17:36:12.151075] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-21T17:36:12.179302] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T17:36:12.951019] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-21T17:36:13.751308] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T17:36:13.751469] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-21T17:36:13.753132] [INFO ] [REMOTE ] BKN: Full fetch complete (11120 records). [2025-10-21T17:36:13.753910] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-21T17:36:14.148811] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-21T17:36:14.149050] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-21T17:36:14.149410] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-21T17:36:14.149490] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-21T17:36:14.150172] [DEBUG] [LOCAL ] BKN: Trimmed 11120 records to 7286 (keeping 200 days of data) [2025-10-21T17:36:14.195117] [DEBUG] [LOCAL ] BKN: Primary data saved (7286 records). [2025-10-21T17:36:14.195235] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-21T17:36:14.195309] [INFO ] [MAIN ] Update Progress: 290/2366 symbols completed. BKN took 24.3s. Estimated remaining: 4h 18m 55s. Rate: 8.0 symbols/min [2025-10-21T17:36:14.376610] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:14.402784] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T17:36:14.445384] [DEBUG] [LOCAL ] BKU: Loaded 42263 existing records from primary storage. [2025-10-21T17:36:14.445701] [INFO ] [MAIN ] BKU: Loaded 42263 existing records. [2025-10-21T17:36:14.560794] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-21T17:36:14.649224] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:14.649459] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-21T17:36:14.649514] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-21T17:36:14.649787] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-21T17:36:14.649843] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-21T17:36:15.004558] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:15.351048] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-21T17:36:15.880067] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-21T17:36:16.151045] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-21T17:36:16.524696] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T17:36:16.853782] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T17:36:16.879547] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:36:16.951050] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-21T17:36:17.751044] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-21T17:36:18.373159] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:36:18.551074] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-21T17:36:19.292027] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T17:36:19.351013] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-21T17:36:19.761226] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T17:36:20.118956] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T17:36:20.150996] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-21T17:36:20.951035] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-21T17:36:20.990298] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T17:36:21.751089] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-21T17:36:22.551013] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-21T17:36:22.594539] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T17:36:22.609817] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T17:36:23.351036] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-21T17:36:24.053244] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T17:36:24.151078] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-21T17:36:24.271813] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T17:36:24.951056] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-21T17:36:25.751009] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-21T17:36:25.797896] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T17:36:26.545369] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T17:36:26.550970] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-21T17:36:26.731225] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T17:36:27.351076] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-21T17:36:27.369913] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T17:36:28.151147] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-21T17:36:28.951054] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-21T17:36:29.055561] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:36:29.407992] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T17:36:29.412033] [INFO ] [REMOTE ] BKT: Full fetch complete (16644 records). [2025-10-21T17:36:29.412148] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-21T17:36:29.759480] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-21T17:36:29.788087] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-21T17:36:29.788926] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-21T17:36:29.789330] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-21T17:36:29.789402] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-21T17:36:29.790260] [DEBUG] [LOCAL ] BKT: Trimmed 16644 records to 12824 (keeping 200 days of data) [2025-10-21T17:36:29.869393] [DEBUG] [LOCAL ] BKT: Primary data saved (12824 records). [2025-10-21T17:36:29.869537] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-21T17:36:29.869613] [INFO ] [MAIN ] Update Progress: 291/2366 symbols completed. BKT took 20.6s. Estimated remaining: 4h 19m 46s. Rate: 8.0 symbols/min [2025-10-21T17:36:30.044530] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:30.071382] [DEBUG] [LOCAL ] BKV: Loaded 29615 existing records from primary storage. [2025-10-21T17:36:30.071703] [INFO ] [MAIN ] BKV: Loaded 29615 existing records. [2025-10-21T17:36:30.248670] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:30.248864] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-21T17:36:30.248910] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-21T17:36:30.249157] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-21T17:36:30.249212] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-21T17:36:30.556122] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-21T17:36:30.618334] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:31.245972] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T17:36:31.351004] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-21T17:36:31.594882] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-21T17:36:31.602920] [INFO ] [REMOTE ] BKKT: Full fetch complete (51831 records). [2025-10-21T17:36:31.603042] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-21T17:36:32.019158] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-21T17:36:32.019254] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-21T17:36:32.019932] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-21T17:36:32.020003] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-21T17:36:32.021136] [DEBUG] [LOCAL ] BKKT: Trimmed 51831 records to 37205 (keeping 200 days of data) [2025-10-21T17:36:32.177356] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-21T17:36:32.238377] [DEBUG] [LOCAL ] BKKT: Primary data saved (37205 records). [2025-10-21T17:36:32.238515] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-21T17:36:32.238592] [INFO ] [MAIN ] Update Progress: 292/2366 symbols completed. BKKT took 45.4s. Estimated remaining: 4h 19m 2s. Rate: 8.0 symbols/min [2025-10-21T17:36:32.412578] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:32.447983] [DEBUG] [LOCAL ] BLCO: Loaded 35097 existing records from primary storage. [2025-10-21T17:36:32.448316] [INFO ] [MAIN ] BLCO: Loaded 35097 existing records. [2025-10-21T17:36:32.637865] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:32.638204] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-21T17:36:32.638404] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-21T17:36:32.638768] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-21T17:36:32.638826] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-21T17:36:32.768022] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T17:36:32.954979] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-21T17:36:33.092927] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:33.095446] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:36:33.393978] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T17:36:33.751063] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-21T17:36:34.551156] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-21T17:36:35.226794] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:36:35.317836] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-21T17:36:35.350995] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-21T17:36:35.825019] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:36:36.151051] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-21T17:36:36.908846] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T17:36:36.951011] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-21T17:36:37.542235] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:36:37.751087] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-21T17:36:38.417332] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T17:36:38.551083] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-21T17:36:38.833237] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T17:36:39.351041] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-21T17:36:40.065493] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T17:36:40.151005] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-21T17:36:40.398699] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T17:36:40.951043] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-21T17:36:41.751108] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-21T17:36:41.790618] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:36:42.551135] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-21T17:36:42.886386] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T17:36:43.202776] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T17:36:43.210160] [INFO ] [REMOTE ] BKU: Full fetch complete (60916 records). [2025-10-21T17:36:43.210275] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-21T17:36:43.356390] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-21T17:36:43.604708] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-21T17:36:43.604792] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-21T17:36:43.605457] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-21T17:36:43.605495] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-21T17:36:43.606597] [DEBUG] [LOCAL ] BKU: Trimmed 60916 records to 42187 (keeping 200 days of data) [2025-10-21T17:36:43.860137] [DEBUG] [LOCAL ] BKU: Primary data saved (42187 records). [2025-10-21T17:36:43.860268] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-21T17:36:43.860344] [INFO ] [MAIN ] Update Progress: 293/2366 symbols completed. BKU took 29.7s. Estimated remaining: 4h 19m 24s. Rate: 8.0 symbols/min [2025-10-21T17:36:43.972357] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:36:44.059726] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:44.086011] [DEBUG] [LOCAL ] BLD: Loaded 27298 existing records from primary storage. [2025-10-21T17:36:44.086259] [INFO ] [MAIN ] BLD: Loaded 27298 existing records. [2025-10-21T17:36:44.161060] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-21T17:36:44.270034] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:44.270287] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-21T17:36:44.270347] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-21T17:36:44.270577] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-21T17:36:44.270634] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-21T17:36:44.652161] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:44.951044] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-21T17:36:45.103316] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:36:45.384344] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T17:36:45.751087] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-21T17:36:46.395807] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T17:36:46.551088] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-21T17:36:47.350986] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-21T17:36:47.442046] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:36:47.808059] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T17:36:48.151074] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-21T17:36:48.951100] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-21T17:36:49.533187] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T17:36:49.541616] [INFO ] [REMOTE ] BKSY: Full fetch complete (70547 records). [2025-10-21T17:36:49.541821] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-21T17:36:49.756117] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-21T17:36:49.979780] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-21T17:36:49.980395] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-21T17:36:49.981203] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-21T17:36:49.982379] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T17:36:49.990787] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-21T17:36:49.992561] [DEBUG] [LOCAL ] BKSY: Trimmed 70547 records to 48901 (keeping 200 days of data) [2025-10-21T17:36:50.292129] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:36:50.306554] [DEBUG] [LOCAL ] BKSY: Primary data saved (48901 records). [2025-10-21T17:36:50.307093] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-21T17:36:50.307541] [INFO ] [MAIN ] Update Progress: 294/2366 symbols completed. BKSY took 42.6s. Estimated remaining: 4h 19m 9s. Rate: 8.0 symbols/min [2025-10-21T17:36:50.479623] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:50.531138] [DEBUG] [LOCAL ] BLDR: Loaded 51892 existing records from primary storage. [2025-10-21T17:36:50.531425] [INFO ] [MAIN ] BLDR: Loaded 51892 existing records. [2025-10-21T17:36:50.562284] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-21T17:36:50.714119] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:50.714408] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-21T17:36:50.714462] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-21T17:36:50.714674] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-21T17:36:50.714729] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-21T17:36:51.087270] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:36:51.091034] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:51.351081] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-21T17:36:51.957895] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:36:52.151074] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-21T17:36:52.951044] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-21T17:36:53.280389] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:36:53.366279] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T17:36:53.751035] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-21T17:36:53.922297] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T17:36:54.551103] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-21T17:36:55.296903] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T17:36:55.302747] [INFO ] [REMOTE ] BKV: Full fetch complete (44875 records). [2025-10-21T17:36:55.302918] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-21T17:36:55.363765] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-21T17:36:55.746530] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-21T17:36:55.746683] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-21T17:36:55.747503] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-21T17:36:55.747551] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-21T17:36:55.749053] [DEBUG] [LOCAL ] BKV: Trimmed 44875 records to 29490 (keeping 200 days of data) [2025-10-21T17:36:55.932854] [DEBUG] [LOCAL ] BKV: Primary data saved (29490 records). [2025-10-21T17:36:55.933213] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-21T17:36:55.933344] [INFO ] [MAIN ] Update Progress: 295/2366 symbols completed. BKV took 26.1s. Estimated remaining: 4h 18m 48s. Rate: 8.0 symbols/min [2025-10-21T17:36:56.074452] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T17:36:56.157417] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:36:56.157525] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-21T17:36:56.176621] [DEBUG] [LOCAL ] BLE: Loaded 13804 existing records from primary storage. [2025-10-21T17:36:56.176965] [INFO ] [MAIN ] BLE: Loaded 13804 existing records. [2025-10-21T17:36:56.369405] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:36:56.369772] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-21T17:36:56.369900] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-21T17:36:56.370115] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-21T17:36:56.370187] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-21T17:36:56.777390] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:36:56.951066] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-21T17:36:57.271143] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:36:57.664906] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:36:57.751005] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-21T17:36:57.866116] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T17:36:58.551099] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-21T17:36:59.285577] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T17:36:59.350989] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-21T17:36:59.465666] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T17:37:00.151039] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-21T17:37:00.411593] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T17:37:00.951038] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-21T17:37:01.649593] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:37:01.751022] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-21T17:37:02.328842] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T17:37:02.551020] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-21T17:37:02.857962] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:37:03.351008] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-21T17:37:03.396173] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T17:37:04.151005] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-21T17:37:04.951025] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-21T17:37:05.174636] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:37:05.588092] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T17:37:05.593233] [INFO ] [REMOTE ] BLCO: Full fetch complete (52344 records). [2025-10-21T17:37:05.593328] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-21T17:37:05.751614] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-21T17:37:05.777891] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T17:37:05.985286] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-21T17:37:05.985359] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-21T17:37:05.985974] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-21T17:37:05.986036] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-21T17:37:05.987004] [DEBUG] [LOCAL ] BLCO: Trimmed 52344 records to 35044 (keeping 200 days of data) [2025-10-21T17:37:06.178670] [DEBUG] [LOCAL ] BLCO: Primary data saved (35044 records). [2025-10-21T17:37:06.178794] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-21T17:37:06.178886] [INFO ] [MAIN ] Update Progress: 296/2366 symbols completed. BLCO took 33.9s. Estimated remaining: 4h 18m 60s. Rate: 8.0 symbols/min [2025-10-21T17:37:06.346974] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:06.347155] [DEBUG] [LOCAL ] BLK: No existing data file found in primary storage. [2025-10-21T17:37:06.347201] [WARN ] [MAIN ] BLK: No existing data found, performing full refresh instead. [2025-10-21T17:37:06.347335] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-21T17:37:06.347390] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-21T17:37:06.347432] [DEBUG] [LOCAL ] BLK: No primary data file found to delete. [2025-10-21T17:37:06.347462] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-21T17:37:06.561052] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-21T17:37:06.695846] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:07.076981] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T17:37:07.350996] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-21T17:37:07.415552] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T17:37:08.151019] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-21T17:37:08.664261] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T17:37:08.950964] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-21T17:37:09.750996] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-21T17:37:09.830974] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T17:37:10.350699] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:37:10.551006] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-21T17:37:11.347261] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T17:37:11.351213] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-21T17:37:11.598521] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T17:37:12.151030] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-21T17:37:12.951129] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-21T17:37:12.974132] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T17:37:13.730994] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:37:13.750981] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-21T17:37:14.264491] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T17:37:14.551023] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-21T17:37:15.351049] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-21T17:37:15.509938] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T17:37:15.933188] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:37:16.151013] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-21T17:37:16.883193] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T17:37:16.951080] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-21T17:37:17.180466] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T17:37:17.751092] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-21T17:37:18.357388] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T17:37:18.361907] [INFO ] [REMOTE ] BLD: Full fetch complete (39874 records). [2025-10-21T17:37:18.362067] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-21T17:37:18.557817] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-21T17:37:18.751314] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T17:37:18.786781] [INFO ] [REMOTE ] BLE: Full fetch complete (19551 records). [2025-10-21T17:37:18.787146] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-21T17:37:18.787415] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-21T17:37:18.788461] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-21T17:37:18.787325] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-21T17:37:18.788845] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-21T17:37:18.887935] [DEBUG] [LOCAL ] BLD: Trimmed 39874 records to 27198 (keeping 200 days of data) [2025-10-21T17:37:19.321209] [DEBUG] [LOCAL ] BLD: Primary data saved (27198 records). [2025-10-21T17:37:19.357437] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-21T17:37:19.375507] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-21T17:37:19.385721] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-21T17:37:19.385943] [INFO ] [MAIN ] Update Progress: 297/2366 symbols completed. BLD took 35.5s. Estimated remaining: 4h 19m 32s. Rate: 8.0 symbols/min [2025-10-21T17:37:19.386061] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-21T17:37:19.386826] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-21T17:37:19.386939] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-21T17:37:19.435601] [DEBUG] [LOCAL ] BLE: Trimmed 19551 records to 13755 (keeping 200 days of data) [2025-10-21T17:37:19.643596] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:19.662321] [DEBUG] [LOCAL ] BLE: Primary data saved (13755 records). [2025-10-21T17:37:19.662690] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-21T17:37:19.663277] [INFO ] [MAIN ] Update Progress: 298/2366 symbols completed. BLE took 23.7s. Estimated remaining: 4h 18m 34s. Rate: 8.0 symbols/min [2025-10-21T17:37:19.849792] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:19.850000] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-21T17:37:19.850044] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-21T17:37:19.850181] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-21T17:37:19.850255] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-21T17:37:19.850315] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-21T17:37:19.850348] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-21T17:37:20.010191] [DEBUG] [LOCAL ] BLND: Loaded 49271 existing records from primary storage. [2025-10-21T17:37:20.024309] [INFO ] [MAIN ] BLND: Loaded 49271 existing records. [2025-10-21T17:37:20.406407] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:20.435173] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:20.435564] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-21T17:37:20.435616] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-21T17:37:20.436406] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-21T17:37:20.436636] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-21T17:37:20.436725] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-21T17:37:20.812192] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:20.835321] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-21T17:37:20.950981] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-21T17:37:21.229876] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:37:21.246858] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-21T17:37:21.247532] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:37:21.248560] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T17:37:21.248673] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-21T17:37:21.259094] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:37:21.259709] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-21T17:37:21.259796] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-21T17:37:21.259835] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-21T17:37:21.259874] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-21T17:37:21.259947] [INFO ] [MAIN ] Update Progress: 299/2366 symbols completed. BLSH took 1.6s. Estimated remaining: 4h 17m 46s. Rate: 8.0 symbols/min [2025-10-21T17:37:21.432235] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:21.445370] [DEBUG] [LOCAL ] BLW: Loaded 13124 existing records from primary storage. [2025-10-21T17:37:21.445592] [INFO ] [MAIN ] BLW: Loaded 13124 existing records. [2025-10-21T17:37:21.623582] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:21.623800] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-21T17:37:21.623848] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-21T17:37:21.624062] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-21T17:37:21.624117] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-21T17:37:21.762049] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-21T17:37:21.979271] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:22.550998] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-21T17:37:22.651090] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:37:23.351051] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-21T17:37:23.522977] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T17:37:24.150991] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-21T17:37:24.271680] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T17:37:24.951883] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T17:37:24.951189] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-21T17:37:25.258062] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T17:37:25.751080] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-21T17:37:26.462307] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T17:37:26.550980] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-21T17:37:27.351069] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-21T17:37:27.791361] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T17:37:27.800105] [INFO ] [REMOTE ] BLDR: Full fetch complete (74710 records). [2025-10-21T17:37:27.800267] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-21T17:37:28.151252] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T17:37:28.151454] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-21T17:37:28.266333] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-21T17:37:28.269327] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-21T17:37:28.270464] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-21T17:37:28.271026] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-21T17:37:28.272594] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T17:37:28.285019] [DEBUG] [LOCAL ] BLDR: Trimmed 74710 records to 51874 (keeping 200 days of data) [2025-10-21T17:37:28.591136] [DEBUG] [LOCAL ] BLDR: Primary data saved (51874 records). [2025-10-21T17:37:28.591272] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-21T17:37:28.591731] [INFO ] [MAIN ] Update Progress: 300/2366 symbols completed. BLDR took 38.3s. Estimated remaining: 4h 17m 37s. Rate: 8.0 symbols/min [2025-10-21T17:37:28.757536] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:28.773732] [DEBUG] [LOCAL ] BLX: Loaded 15575 existing records from primary storage. [2025-10-21T17:37:28.773963] [INFO ] [MAIN ] BLX: Loaded 15575 existing records. [2025-10-21T17:37:28.946714] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:28.946950] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-21T17:37:28.946999] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-21T17:37:28.947169] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-21T17:37:28.947208] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-21T17:37:28.958727] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-21T17:37:29.341772] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:29.751027] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-21T17:37:29.970155] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T17:37:30.086038] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T17:37:30.551071] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-21T17:37:31.351015] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-21T17:37:31.353683] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T17:37:32.148700] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T17:37:32.154417] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-21T17:37:32.166803] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T17:37:32.951071] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-21T17:37:33.751047] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-21T17:37:34.023296] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:37:34.527280] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T17:37:34.550993] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-21T17:37:34.582133] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T17:37:35.351045] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-21T17:37:36.151000] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-21T17:37:36.298583] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T17:37:36.522690] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T17:37:36.529101] [INFO ] [REMOTE ] BLK: Full fetch complete (53050 records). [2025-10-21T17:37:36.529224] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-21T17:37:36.902080] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-21T17:37:36.902185] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-21T17:37:36.902826] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-21T17:37:36.902888] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-21T17:37:36.904078] [DEBUG] [LOCAL ] BLK: Trimmed 53050 records to 34328 (keeping 200 days of data) [2025-10-21T17:37:36.959903] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-21T17:37:37.125075] [DEBUG] [LOCAL ] BLK: Primary data saved (34328 records). [2025-10-21T17:37:37.125214] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-21T17:37:37.125284] [INFO ] [MAIN ] Update Progress: 301/2366 symbols completed. BLK took 30.9s. Estimated remaining: 4h 17m 37s. Rate: 8.0 symbols/min [2025-10-21T17:37:37.292892] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:37.327249] [DEBUG] [LOCAL ] BMA: Loaded 36470 existing records from primary storage. [2025-10-21T17:37:37.327530] [INFO ] [MAIN ] BMA: Loaded 36470 existing records. [2025-10-21T17:37:37.510453] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:37.510768] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-21T17:37:37.510823] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-21T17:37:37.511016] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-21T17:37:37.511073] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-21T17:37:37.619349] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T17:37:37.759200] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-21T17:37:37.929411] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:37.945539] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T17:37:38.550993] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-21T17:37:38.845859] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T17:37:39.351031] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-21T17:37:40.151028] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-21T17:37:40.263695] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:37:40.264520] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T17:37:40.951484] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-21T17:37:40.952397] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T17:37:41.751036] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-21T17:37:42.533560] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T17:37:42.554197] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-21T17:37:42.559326] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T17:37:43.350995] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-21T17:37:43.583147] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T17:37:44.151040] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-21T17:37:44.770744] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:37:44.951049] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-21T17:37:45.751058] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-21T17:37:45.993223] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T17:37:46.018420] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T17:37:46.551058] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-21T17:37:47.054594] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T17:37:47.057314] [INFO ] [REMOTE ] BLW: Full fetch complete (19258 records). [2025-10-21T17:37:47.057390] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-21T17:37:47.351225] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-21T17:37:47.440904] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-21T17:37:47.440986] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-21T17:37:47.441613] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-21T17:37:47.441692] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-21T17:37:47.442576] [DEBUG] [LOCAL ] BLW: Trimmed 19258 records to 13120 (keeping 200 days of data) [2025-10-21T17:37:47.525262] [DEBUG] [LOCAL ] BLW: Primary data saved (13120 records). [2025-10-21T17:37:47.525403] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-21T17:37:47.525484] [INFO ] [MAIN ] Update Progress: 302/2366 symbols completed. BLW took 26.3s. Estimated remaining: 4h 17m 50s. Rate: 8.0 symbols/min [2025-10-21T17:37:47.735932] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:47.749337] [DEBUG] [LOCAL ] BME: Loaded 11258 existing records from primary storage. [2025-10-21T17:37:47.749596] [INFO ] [MAIN ] BME: Loaded 11258 existing records. [2025-10-21T17:37:47.982878] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:47.983482] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-21T17:37:47.983589] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-21T17:37:47.983872] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-21T17:37:47.983944] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-21T17:37:48.155376] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-21T17:37:48.609032] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T17:37:48.607666] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:48.621932] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T17:37:48.951058] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-21T17:37:49.554909] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:37:49.751023] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-21T17:37:50.551072] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-21T17:37:50.741688] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T17:37:50.749585] [INFO ] [REMOTE ] BLND: Full fetch complete (72234 records). [2025-10-21T17:37:50.749764] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-21T17:37:51.153576] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-21T17:37:51.153753] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-21T17:37:51.154852] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-21T17:37:51.154952] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-21T17:37:51.156446] [DEBUG] [LOCAL ] BLND: Trimmed 72234 records to 49223 (keeping 200 days of data) [2025-10-21T17:37:51.269172] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:37:51.355092] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-21T17:37:51.469577] [DEBUG] [LOCAL ] BLND: Primary data saved (49223 records). [2025-10-21T17:37:51.469876] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-21T17:37:51.478312] [INFO ] [MAIN ] Update Progress: 303/2366 symbols completed. BLND took 32.1s. Estimated remaining: 4h 17m 18s. Rate: 8.0 symbols/min [2025-10-21T17:37:51.478672] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T17:37:51.665104] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:37:51.692142] [DEBUG] [LOCAL ] BMEZ: Loaded 25392 existing records from primary storage. [2025-10-21T17:37:51.692413] [INFO ] [MAIN ] BMEZ: Loaded 25392 existing records. [2025-10-21T17:37:51.870638] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:37:51.870887] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-21T17:37:51.870934] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-21T17:37:51.871103] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-21T17:37:51.871140] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-21T17:37:52.156134] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-21T17:37:52.223410] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:37:52.517551] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T17:37:52.950997] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-21T17:37:53.014724] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T17:37:53.751024] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-21T17:37:54.265464] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T17:37:54.551025] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-21T17:37:55.160143] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T17:37:55.351019] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-21T17:37:55.780718] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T17:37:56.151025] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-21T17:37:56.763234] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T17:37:56.951025] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-21T17:37:57.391866] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T17:37:57.751030] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-21T17:37:58.296870] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:37:58.551013] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-21T17:37:59.110207] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T17:37:59.350998] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-21T17:37:59.483551] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T17:38:00.151025] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-21T17:38:00.733979] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T17:38:00.779997] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T17:38:00.951027] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-21T17:38:01.751028] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-21T17:38:01.890884] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T17:38:02.551031] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-21T17:38:02.641883] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T17:38:03.351043] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-21T17:38:04.151015] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-21T17:38:04.527850] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T17:38:04.534827] [INFO ] [REMOTE ] BMA: Full fetch complete (52320 records). [2025-10-21T17:38:04.534948] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-21T17:38:04.828503] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:38:04.950246] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-21T17:38:04.950323] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-21T17:38:04.951049] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-21T17:38:04.950986] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-21T17:38:04.951242] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-21T17:38:04.953159] [DEBUG] [LOCAL ] BMA: Trimmed 52320 records to 36526 (keeping 200 days of data) [2025-10-21T17:38:05.052824] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T17:38:05.189761] [DEBUG] [LOCAL ] BMA: Primary data saved (36526 records). [2025-10-21T17:38:05.189895] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-21T17:38:05.189973] [INFO ] [MAIN ] Update Progress: 304/2366 symbols completed. BMA took 28.1s. Estimated remaining: 4h 17m 53s. Rate: 8.0 symbols/min [2025-10-21T17:38:05.366708] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:05.391033] [DEBUG] [LOCAL ] BMI: Loaded 24793 existing records from primary storage. [2025-10-21T17:38:05.391282] [INFO ] [MAIN ] BMI: Loaded 24793 existing records. [2025-10-21T17:38:05.563773] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:05.563943] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-21T17:38:05.563991] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-21T17:38:05.564154] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-21T17:38:05.564190] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-21T17:38:05.756427] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-21T17:38:05.920028] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:06.115566] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T17:38:06.118448] [INFO ] [REMOTE ] BLX: Full fetch complete (22539 records). [2025-10-21T17:38:06.118540] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-21T17:38:06.506632] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-21T17:38:06.506823] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-21T17:38:06.507782] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-21T17:38:06.507853] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-21T17:38:06.509173] [DEBUG] [LOCAL ] BLX: Trimmed 22539 records to 15521 (keeping 200 days of data) [2025-10-21T17:38:06.558323] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-21T17:38:06.616782] [DEBUG] [LOCAL ] BLX: Primary data saved (15521 records). [2025-10-21T17:38:06.617079] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-21T17:38:06.617224] [INFO ] [MAIN ] Update Progress: 305/2366 symbols completed. BLX took 38.0s. Estimated remaining: 4h 17m 4s. Rate: 8.0 symbols/min [2025-10-21T17:38:06.773369] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T17:38:06.809067] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:06.814072] [DEBUG] [LOCAL ] BMN: Loaded 2592 existing records from primary storage. [2025-10-21T17:38:06.814222] [INFO ] [MAIN ] BMN: Loaded 2592 existing records. [2025-10-21T17:38:06.987862] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:06.988107] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-21T17:38:06.988182] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-21T17:38:06.988391] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-21T17:38:06.988447] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-21T17:38:07.338273] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:07.350982] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-21T17:38:07.820070] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T17:38:07.989812] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:38:08.151025] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-21T17:38:08.703336] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-21T17:38:08.951036] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-21T17:38:09.751007] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-21T17:38:10.041705] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T17:38:10.110103] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-21T17:38:10.551085] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-21T17:38:11.351037] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-21T17:38:11.751209] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:38:11.857241] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T17:38:12.151067] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-21T17:38:12.951003] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-21T17:38:13.103398] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T17:38:13.751076] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-21T17:38:14.112301] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:38:14.317028] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T17:38:14.551072] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-21T17:38:15.351029] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-21T17:38:15.800229] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T17:38:15.840172] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T17:38:16.151058] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-21T17:38:16.590709] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T17:38:16.951110] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-21T17:38:17.751054] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-21T17:38:18.079524] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T17:38:18.551044] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-21T17:38:18.657761] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T17:38:19.351004] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-21T17:38:19.759991] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T17:38:20.151051] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-21T17:38:20.205793] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T17:38:20.600747] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T17:38:20.951021] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-21T17:38:21.751067] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-21T17:38:21.946363] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T17:38:21.948768] [INFO ] [REMOTE ] BME: Full fetch complete (15732 records). [2025-10-21T17:38:21.948835] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-21T17:38:22.308127] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-21T17:38:22.308231] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-21T17:38:22.308592] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-21T17:38:22.308629] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-21T17:38:22.309142] [DEBUG] [LOCAL ] BME: Trimmed 15732 records to 11279 (keeping 200 days of data) [2025-10-21T17:38:22.376322] [DEBUG] [LOCAL ] BME: Primary data saved (11279 records). [2025-10-21T17:38:22.376426] [INFO ] [MAIN ] BME: Full history saved. [2025-10-21T17:38:22.376497] [INFO ] [MAIN ] Update Progress: 306/2366 symbols completed. BME took 34.9s. Estimated remaining: 4h 17m 52s. Rate: 8.0 symbols/min [2025-10-21T17:38:22.551732] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-21T17:38:22.551622] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:22.591481] [DEBUG] [LOCAL ] BMO: Loaded 41223 existing records from primary storage. [2025-10-21T17:38:22.591793] [INFO ] [MAIN ] BMO: Loaded 41223 existing records. [2025-10-21T17:38:22.773170] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:22.773521] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-21T17:38:22.773598] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-21T17:38:22.774089] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-21T17:38:22.774264] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-21T17:38:22.892582] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:38:23.149673] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:23.351067] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-21T17:38:23.588698] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T17:38:24.151038] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-21T17:38:24.937693] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:38:24.950982] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-21T17:38:25.331111] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T17:38:25.751079] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-21T17:38:26.216804] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T17:38:26.551051] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-21T17:38:26.890716] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:38:27.351014] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-21T17:38:28.151063] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-21T17:38:28.168714] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T17:38:28.496789] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-21T17:38:28.720702] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:38:28.951007] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-21T17:38:29.751113] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-21T17:38:30.321443] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T17:38:30.551053] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-21T17:38:30.703150] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T17:38:30.707329] [INFO ] [REMOTE ] BMEZ: Full fetch complete (39755 records). [2025-10-21T17:38:30.707442] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-21T17:38:31.110698] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-21T17:38:31.110780] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-21T17:38:31.111329] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-21T17:38:31.111368] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-21T17:38:31.112137] [DEBUG] [LOCAL ] BMEZ: Trimmed 39755 records to 25212 (keeping 200 days of data) [2025-10-21T17:38:31.263380] [DEBUG] [LOCAL ] BMEZ: Primary data saved (25212 records). [2025-10-21T17:38:31.263496] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-21T17:38:31.263605] [INFO ] [MAIN ] Update Progress: 307/2366 symbols completed. BMEZ took 39.8s. Estimated remaining: 4h 17m 54s. Rate: 8.0 symbols/min [2025-10-21T17:38:31.361195] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-21T17:38:31.435749] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:31.483050] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-21T17:38:31.483373] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-21T17:38:31.667302] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:31.667470] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-21T17:38:31.667518] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-21T17:38:31.668101] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-21T17:38:31.668184] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-21T17:38:32.074863] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:32.156176] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-21T17:38:32.173519] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:38:32.332113] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T17:38:32.337504] [INFO ] [REMOTE ] BMI: Full fetch complete (33983 records). [2025-10-21T17:38:32.337825] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-21T17:38:32.739938] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-21T17:38:32.740094] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-21T17:38:32.740903] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-21T17:38:32.740983] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-21T17:38:32.742174] [DEBUG] [LOCAL ] BMI: Trimmed 33983 records to 24889 (keeping 200 days of data) [2025-10-21T17:38:32.839857] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T17:38:32.901114] [DEBUG] [LOCAL ] BMI: Primary data saved (24889 records). [2025-10-21T17:38:32.901250] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-21T17:38:32.901352] [INFO ] [MAIN ] Update Progress: 308/2366 symbols completed. BMI took 27.7s. Estimated remaining: 4h 17m 7s. Rate: 8.0 symbols/min [2025-10-21T17:38:32.956317] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-21T17:38:33.070053] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:33.118075] [DEBUG] [LOCAL ] BN: Loaded 52986 existing records from primary storage. [2025-10-21T17:38:33.118468] [INFO ] [MAIN ] BN: Loaded 52986 existing records. [2025-10-21T17:38:33.291216] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:33.291389] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-21T17:38:33.291435] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-21T17:38:33.292327] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-21T17:38:33.292384] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-21T17:38:33.670992] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:33.751056] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-21T17:38:34.313010] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T17:38:34.313943] [INFO ] [REMOTE ] BMN: Full fetch complete (3655 records). [2025-10-21T17:38:34.314009] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-21T17:38:34.561509] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-21T17:38:34.680584] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-21T17:38:34.680775] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-21T17:38:34.681045] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-21T17:38:34.681145] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-21T17:38:34.681876] [DEBUG] [LOCAL ] BMN: Trimmed 3655 records to 2581 (keeping 200 days of data) [2025-10-21T17:38:34.698447] [DEBUG] [LOCAL ] BMN: Primary data saved (2581 records). [2025-10-21T17:38:34.698538] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-21T17:38:34.698615] [INFO ] [MAIN ] Update Progress: 309/2366 symbols completed. BMN took 28.1s. Estimated remaining: 4h 16m 22s. Rate: 8.0 symbols/min [2025-10-21T17:38:34.871474] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:34.903029] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T17:38:34.935331] [DEBUG] [LOCAL ] BNED: Loaded 28483 existing records from primary storage. [2025-10-21T17:38:34.935611] [INFO ] [MAIN ] BNED: Loaded 28483 existing records. [2025-10-21T17:38:35.109825] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:35.110051] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-21T17:38:35.110110] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-21T17:38:35.110305] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-21T17:38:35.110344] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-21T17:38:35.356140] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-21T17:38:35.455743] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:36.151971] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-21T17:38:36.154885] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:38:36.951045] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-21T17:38:37.270218] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:38:37.751041] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-21T17:38:37.940099] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:38:38.551112] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-21T17:38:38.760575] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:38:39.351066] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-21T17:38:39.527124] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T17:38:40.008476] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T17:38:40.151045] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-21T17:38:40.957302] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-21T17:38:41.061185] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T17:38:41.751084] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-21T17:38:42.255198] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T17:38:42.424112] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T17:38:42.551080] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-21T17:38:43.281939] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T17:38:43.351060] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-21T17:38:44.151016] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-21T17:38:44.702891] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T17:38:44.943208] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T17:38:44.952006] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-21T17:38:45.751003] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-21T17:38:46.025730] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T17:38:46.550999] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-21T17:38:46.984543] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T17:38:47.191725] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T17:38:47.351029] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-21T17:38:47.916882] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T17:38:48.151026] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-21T17:38:48.951073] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-21T17:38:49.012965] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:38:49.259968] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T17:38:49.751014] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-21T17:38:50.551116] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-21T17:38:50.695384] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T17:38:51.084285] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T17:38:51.351079] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-21T17:38:52.129298] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T17:38:52.135776] [INFO ] [REMOTE ] BMO: Full fetch complete (59770 records). [2025-10-21T17:38:52.135922] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-21T17:38:52.136540] [FATAL] [VALIDATOR ] BMO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:38:52.136672] [FATAL] [MAIN ] BMO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:38:52.136734] [WARN ] [MAIN ] BMO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:38:52.136801] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-21T17:38:52.136865] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-10-21T17:38:52.136901] [INFO ] [LOCAL ] BMO: Starting deletion of derivative data. [2025-10-21T17:38:52.137053] [DEBUG] [LOCAL ] BMO: Deleted derivative data file. [2025-10-21T17:38:52.137901] [INFO ] [MAIN ] Update Progress: 310/2366 symbols completed. BMO took 29.8s. Estimated remaining: 4h 17m 20s. Rate: 8.0 symbols/min [2025-10-21T17:38:52.160923] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-21T17:38:52.318702] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:38:52.327066] [DEBUG] [LOCAL ] BNH: Loaded 4731 existing records from primary storage. [2025-10-21T17:38:52.327298] [INFO ] [MAIN ] BNH: Loaded 4731 existing records. [2025-10-21T17:38:52.510401] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:38:52.510592] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-21T17:38:52.510664] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-21T17:38:52.510856] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-21T17:38:52.510912] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-21T17:38:52.767507] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:38:52.940155] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:38:52.950991] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-21T17:38:53.604315] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T17:38:53.751042] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-21T17:38:54.223333] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T17:38:54.341376] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T17:38:54.551008] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-21T17:38:55.225083] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-21T17:38:55.351018] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-21T17:38:56.151021] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-21T17:38:56.951006] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-21T17:38:57.098097] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T17:38:57.227894] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T17:38:57.751025] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-21T17:38:58.297548] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T17:38:58.551019] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-21T17:38:59.351040] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-21T17:38:59.810819] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T17:38:59.819134] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-21T17:38:59.926335] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T17:39:00.151062] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-21T17:39:00.728303] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T17:39:00.951032] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-21T17:39:01.528967] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T17:39:01.751026] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-21T17:39:02.353105] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T17:39:02.551035] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-21T17:39:03.351071] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-21T17:39:04.151044] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-21T17:39:04.518829] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T17:39:04.550262] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T17:39:04.734876] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T17:39:04.950998] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-21T17:39:05.650917] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T17:39:05.652247] [INFO ] [REMOTE ] BNH: Full fetch complete (6854 records). [2025-10-21T17:39:05.652314] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-21T17:39:05.757519] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-21T17:39:06.022584] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-21T17:39:06.022689] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-21T17:39:06.022898] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-21T17:39:06.022938] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-21T17:39:06.023305] [DEBUG] [LOCAL ] BNH: Trimmed 6854 records to 4741 (keeping 200 days of data) [2025-10-21T17:39:06.051903] [DEBUG] [LOCAL ] BNH: Primary data saved (4741 records). [2025-10-21T17:39:06.052005] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-21T17:39:06.052080] [INFO ] [MAIN ] Update Progress: 311/2366 symbols completed. BNH took 13.9s. Estimated remaining: 4h 17m 55s. Rate: 8.0 symbols/min [2025-10-21T17:39:06.227933] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:06.232625] [DEBUG] [LOCAL ] BNJ: Loaded 2531 existing records from primary storage. [2025-10-21T17:39:06.232924] [INFO ] [MAIN ] BNJ: Loaded 2531 existing records. [2025-10-21T17:39:06.416114] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:06.416309] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-21T17:39:06.416371] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-21T17:39:06.416528] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-21T17:39:06.416567] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-21T17:39:06.564860] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-21T17:39:06.790082] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:07.351001] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-21T17:39:07.626446] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T17:39:08.013776] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T17:39:08.151004] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-21T17:39:08.950986] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-21T17:39:09.461155] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-21T17:39:09.513021] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T17:39:09.751076] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-21T17:39:10.551002] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-21T17:39:10.650414] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:39:10.659085] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-21T17:39:10.659233] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-21T17:39:10.994806] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-21T17:39:11.100025] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-21T17:39:11.100190] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-21T17:39:11.101098] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-21T17:39:11.101241] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-21T17:39:11.133738] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-21T17:39:11.136018] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-21T17:39:11.145922] [INFO ] [REMOTE ] BN: Full fetch complete (76954 records). [2025-10-21T17:39:11.146094] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-21T17:39:11.354842] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-21T17:39:11.772126] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-21T17:39:11.775681] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-21T17:39:11.777551] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-21T17:39:11.778154] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-21T17:39:11.798373] [DEBUG] [LOCAL ] BN: Trimmed 76954 records to 52984 (keeping 200 days of data) [2025-10-21T17:39:11.999690] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-21T17:39:12.000769] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-21T17:39:12.001159] [INFO ] [MAIN ] Update Progress: 312/2366 symbols completed. BMY took 40.7s. Estimated remaining: 4h 17m 37s. Rate: 8.0 symbols/min [2025-10-21T17:39:12.180885] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-21T17:39:12.285091] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:12.427008] [DEBUG] [LOCAL ] BN: Primary data saved (52984 records). [2025-10-21T17:39:12.427671] [DEBUG] [LOCAL ] BNL: Loaded 47210 existing records from primary storage. [2025-10-21T17:39:12.428005] [INFO ] [MAIN ] BN: Full history saved. [2025-10-21T17:39:12.428301] [INFO ] [MAIN ] BNL: Loaded 47210 existing records. [2025-10-21T17:39:12.428174] [INFO ] [MAIN ] Update Progress: 313/2366 symbols completed. BN took 39.5s. Estimated remaining: 4h 16m 43s. Rate: 8.0 symbols/min [2025-10-21T17:39:12.797847] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:12.831218] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:39:12.830044] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-21T17:39:12.830947] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T17:39:12.829830] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:12.831949] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-21T17:39:12.837402] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-21T17:39:12.837484] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-21T17:39:12.837346] [INFO ] [REMOTE ] BNED: Full fetch complete (42099 records). [2025-10-21T17:39:12.868887] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-21T17:39:12.967334] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-21T17:39:13.456954] [DEBUG] [LOCAL ] BNS: Loaded 51449 existing records from primary storage. [2025-10-21T17:39:13.559789] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:13.556049] [INFO ] [MAIN ] BNS: Loaded 51449 existing records. [2025-10-21T17:39:13.727981] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-21T17:39:13.720160] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T17:39:13.749044] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-21T17:39:13.751353] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-21T17:39:13.752194] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-21T17:39:13.753455] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-21T17:39:13.833986] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:13.829513] [DEBUG] [LOCAL ] BNED: Trimmed 42099 records to 28324 (keeping 200 days of data) [2025-10-21T17:39:13.834223] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-21T17:39:13.834522] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-21T17:39:13.834756] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-21T17:39:13.834817] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-21T17:39:14.277213] [DEBUG] [LOCAL ] BNED: Primary data saved (28324 records). [2025-10-21T17:39:14.283068] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-21T17:39:14.288387] [INFO ] [MAIN ] Update Progress: 314/2366 symbols completed. BNED took 39.6s. Estimated remaining: 4h 15m 59s. Rate: 8.0 symbols/min [2025-10-21T17:39:14.388684] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:14.455784] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T17:39:14.537436] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:14.542273] [DEBUG] [LOCAL ] BNT: Loaded 3553 existing records from primary storage. [2025-10-21T17:39:14.542410] [INFO ] [MAIN ] BNT: Loaded 3553 existing records. [2025-10-21T17:39:14.556241] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-21T17:39:14.734399] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:14.734616] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-21T17:39:14.734695] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-21T17:39:14.734870] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-21T17:39:14.734924] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-21T17:39:15.097783] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:15.351025] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-21T17:39:16.000189] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T17:39:16.150996] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-21T17:39:16.451574] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T17:39:16.579466] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-21T17:39:16.951018] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-21T17:39:17.751087] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-21T17:39:18.551054] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-21T17:39:18.816557] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T17:39:18.977575] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T17:39:19.117272] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T17:39:19.351036] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-21T17:39:20.151016] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-21T17:39:20.905427] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T17:39:20.950990] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-21T17:39:21.500442] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:39:21.751072] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-21T17:39:22.451701] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T17:39:22.451571] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T17:39:22.551020] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-21T17:39:23.351083] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-21T17:39:24.151030] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-21T17:39:24.194384] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T17:39:24.721857] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T17:39:24.951039] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-21T17:39:25.175104] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T17:39:25.386133] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:39:25.751057] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-21T17:39:26.307420] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T17:39:26.551026] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-21T17:39:27.184127] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T17:39:27.351020] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-21T17:39:27.845751] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:39:28.151052] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-21T17:39:28.951093] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-21T17:39:29.513006] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-21T17:39:29.751082] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-21T17:39:29.846448] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T17:39:30.063343] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-21T17:39:30.551049] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-21T17:39:31.151999] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T17:39:31.152968] [INFO ] [REMOTE ] BNJ: Full fetch complete (3888 records). [2025-10-21T17:39:31.153034] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-21T17:39:31.356263] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-21T17:39:31.503971] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-21T17:39:31.504042] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-21T17:39:31.504167] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-21T17:39:31.504204] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-21T17:39:31.504525] [DEBUG] [LOCAL ] BNJ: Trimmed 3888 records to 2517 (keeping 200 days of data) [2025-10-21T17:39:31.520973] [DEBUG] [LOCAL ] BNJ: Primary data saved (2517 records). [2025-10-21T17:39:31.521089] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-21T17:39:31.521171] [INFO ] [MAIN ] Update Progress: 315/2366 symbols completed. BNJ took 25.5s. Estimated remaining: 4h 16m 55s. Rate: 8.0 symbols/min [2025-10-21T17:39:31.686245] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:31.695086] [DEBUG] [LOCAL ] BNY: Loaded 7267 existing records from primary storage. [2025-10-21T17:39:31.695246] [INFO ] [MAIN ] BNY: Loaded 7267 existing records. [2025-10-21T17:39:31.875079] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:31.875272] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-21T17:39:31.875330] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-21T17:39:31.875466] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-21T17:39:31.875505] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-21T17:39:31.980505] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T17:39:32.156131] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-21T17:39:32.242510] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:32.647526] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-21T17:39:32.951018] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-21T17:39:33.538275] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T17:39:33.751041] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-21T17:39:34.551054] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-21T17:39:35.219760] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T17:39:35.221080] [INFO ] [REMOTE ] BNT: Full fetch complete (4815 records). [2025-10-21T17:39:35.221148] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-21T17:39:35.372555] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-21T17:39:35.583441] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-21T17:39:35.583669] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-21T17:39:35.583848] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-21T17:39:35.592778] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-21T17:39:35.608145] [DEBUG] [LOCAL ] BNT: Trimmed 4815 records to 3550 (keeping 200 days of data) [2025-10-21T17:39:35.609987] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:39:35.640022] [DEBUG] [LOCAL ] BNT: Primary data saved (3550 records). [2025-10-21T17:39:35.640136] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-21T17:39:35.640211] [INFO ] [MAIN ] Update Progress: 316/2366 symbols completed. BNT took 21.3s. Estimated remaining: 4h 16m 25s. Rate: 8.0 symbols/min [2025-10-21T17:39:35.826726] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:39:35.843425] [DEBUG] [LOCAL ] BOC: Loaded 18418 existing records from primary storage. [2025-10-21T17:39:35.843625] [INFO ] [MAIN ] BOC: Loaded 18418 existing records. [2025-10-21T17:39:36.017453] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:39:36.017621] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-21T17:39:36.017695] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-21T17:39:36.017953] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-21T17:39:36.018008] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-21T17:39:36.156258] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-21T17:39:36.304175] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T17:39:36.382830] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:39:36.951074] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-21T17:39:37.699404] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T17:39:37.760390] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-21T17:39:37.765588] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:39:38.521100] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T17:39:38.550974] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-21T17:39:39.147204] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T17:39:39.351055] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-21T17:39:40.048297] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T17:39:40.151059] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-21T17:39:40.951017] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-21T17:39:41.226620] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T17:39:41.751084] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-21T17:39:42.551062] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-21T17:39:42.726979] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T17:39:43.350997] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-21T17:39:43.419966] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T17:39:43.439185] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T17:39:43.737940] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-21T17:39:44.151042] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-21T17:39:44.951035] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-21T17:39:45.751010] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-21T17:39:45.915988] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:39:46.084694] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T17:39:46.551077] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-21T17:39:47.351046] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-21T17:39:47.494076] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T17:39:48.155889] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-21T17:39:48.159199] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T17:39:48.472408] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T17:39:48.951105] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-21T17:39:49.758291] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-21T17:39:49.764259] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:39:49.969145] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T17:39:50.551021] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-21T17:39:51.301406] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T17:39:51.351025] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-21T17:39:51.509509] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:39:51.517979] [INFO ] [REMOTE ] BNL: Full fetch complete (67225 records). [2025-10-21T17:39:51.518199] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-21T17:39:51.934581] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-21T17:39:51.934696] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-21T17:39:51.935509] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-21T17:39:51.935553] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-21T17:39:51.936960] [DEBUG] [LOCAL ] BNL: Trimmed 67225 records to 47118 (keeping 200 days of data) [2025-10-21T17:39:52.153954] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-21T17:39:52.219292] [DEBUG] [LOCAL ] BNL: Primary data saved (47118 records). [2025-10-21T17:39:52.219444] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-21T17:39:52.219531] [INFO ] [MAIN ] Update Progress: 317/2366 symbols completed. BNL took 40.2s. Estimated remaining: 4h 17m 16s. Rate: 8.0 symbols/min [2025-10-21T17:39:52.951053] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-21T17:39:53.043382] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T17:39:53.207923] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T17:39:53.416135] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T17:39:53.751085] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-21T17:39:54.551076] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-21T17:39:54.674682] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T17:39:55.351001] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-21T17:39:55.424906] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T17:39:55.426801] [INFO ] [REMOTE ] BNY: Full fetch complete (10389 records). [2025-10-21T17:39:55.426868] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-21T17:39:55.782742] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-21T17:39:55.782816] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-21T17:39:55.783049] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-21T17:39:55.783086] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-21T17:39:55.783534] [DEBUG] [LOCAL ] BNY: Trimmed 10389 records to 7268 (keeping 200 days of data) [2025-10-21T17:39:55.825216] [DEBUG] [LOCAL ] BNY: Primary data saved (7268 records). [2025-10-21T17:39:55.825316] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-21T17:39:55.825387] [INFO ] [MAIN ] Update Progress: 318/2366 symbols completed. BNY took 24.3s. Estimated remaining: 4h 16m 44s. Rate: 8.0 symbols/min [2025-10-21T17:39:56.150997] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-21T17:39:56.489200] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:39:56.951096] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-21T17:39:57.970704] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T17:39:57.979159] [INFO ] [REMOTE ] BNS: Full fetch complete (74653 records). [2025-10-21T17:39:57.979305] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-21T17:39:58.156779] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T17:39:58.244932] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-21T17:39:58.402807] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-21T17:39:58.402894] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-21T17:39:58.403696] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-21T17:39:58.403758] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-21T17:39:58.405188] [DEBUG] [LOCAL ] BNS: Trimmed 74653 records to 51426 (keeping 200 days of data) [2025-10-21T17:39:58.712574] [DEBUG] [LOCAL ] BNS: Primary data saved (51426 records). [2025-10-21T17:39:58.712751] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-21T17:39:58.712839] [INFO ] [MAIN ] Update Progress: 319/2366 symbols completed. BNS took 46.3s. Estimated remaining: 4h 16m 6s. Rate: 8.0 symbols/min [2025-10-21T17:39:59.379471] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:39:59.383609] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-21T17:40:01.729325] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-21T17:40:01.734413] [INFO ] [REMOTE ] BOC: Full fetch complete (25774 records). [2025-10-21T17:40:01.734594] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-21T17:40:02.131938] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-21T17:40:02.132023] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-21T17:40:02.132452] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-21T17:40:02.132493] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-21T17:40:02.133336] [DEBUG] [LOCAL ] BOC: Trimmed 25774 records to 18280 (keeping 200 days of data) [2025-10-21T17:40:02.238689] [DEBUG] [LOCAL ] BOC: Primary data saved (18280 records). [2025-10-21T17:40:02.238847] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-21T17:40:02.238932] [INFO ] [MAIN ] Update Progress: 320/2366 symbols completed. BOC took 26.6s. Estimated remaining: 4h 15m 33s. Rate: 8.0 symbols/min [2025-10-21T17:40:02.830212] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:02.954081] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:03.001900] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:03.042416] [DEBUG] [LOCAL ] BOE: Loaded 18109 existing records from primary storage. [2025-10-21T17:40:03.041715] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:03.042722] [DEBUG] [LOCAL ] BOH: No existing data file found in primary storage. [2025-10-21T17:40:03.043096] [INFO ] [MAIN ] BOE: Loaded 18109 existing records. [2025-10-21T17:40:03.042969] [WARN ] [MAIN ] BOH: No existing data found, performing full refresh instead. [2025-10-21T17:40:03.043371] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-21T17:40:03.043426] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-21T17:40:03.043470] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-10-21T17:40:03.043503] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-21T17:40:03.427689] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:03.440308] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-21T17:40:03.440485] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-21T17:40:03.456771] [DEBUG] [LOCAL ] BOND: Loaded 32481 existing records from primary storage. [2025-10-21T17:40:03.484383] [INFO ] [MAIN ] BOND: Loaded 32481 existing records. [2025-10-21T17:40:03.476711] [DEBUG] [LOCAL ] BOOT: Loaded 39698 existing records from primary storage. [2025-10-21T17:40:03.563676] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-21T17:40:03.541937] [INFO ] [MAIN ] BOOT: Loaded 39698 existing records. [2025-10-21T17:40:03.635435] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-21T17:40:04.005624] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:04.142999] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-21T17:40:04.195130] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:04.191582] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:04.229269] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-21T17:40:04.254568] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-21T17:40:04.271260] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-21T17:40:04.291005] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-21T17:40:04.296729] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-21T17:40:04.303693] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-21T17:40:04.318918] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-21T17:40:04.349138] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-21T17:40:04.678344] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:04.695191] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-21T17:40:05.098451] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:05.125211] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-21T17:40:05.202875] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:05.203172] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-21T17:40:06.204124] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T17:40:06.211547] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-21T17:40:06.254441] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:40:06.258984] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-21T17:40:06.284483] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T17:40:06.291214] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-21T17:40:07.029143] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T17:40:07.038068] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-21T17:40:07.081517] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:40:07.085715] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-21T17:40:07.112956] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T17:40:07.121213] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-21T17:40:07.541680] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T17:40:07.549469] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-21T17:40:08.015482] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T17:40:08.150992] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-21T17:40:08.215843] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T17:40:08.299183] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T17:40:08.835142] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T17:40:08.950987] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-21T17:40:08.951589] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T17:40:09.751004] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-21T17:40:10.362489] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T17:40:10.551057] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-21T17:40:11.328584] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T17:40:11.351030] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-21T17:40:11.788809] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T17:40:12.151002] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-21T17:40:12.554224] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:40:12.951010] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-21T17:40:13.339225] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T17:40:13.751064] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-21T17:40:14.063215] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T17:40:14.551091] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-21T17:40:15.262355] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:40:15.350984] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-21T17:40:15.552236] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T17:40:16.151052] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-21T17:40:16.951027] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-21T17:40:17.082756] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T17:40:17.751139] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-21T17:40:18.551100] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-21T17:40:19.076919] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T17:40:19.351110] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-21T17:40:19.602160] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (3.45 seconds). [2025-10-21T17:40:20.151072] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-21T17:40:20.650969] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (3.70 seconds). [2025-10-21T17:40:20.690519] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T17:40:20.951082] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-21T17:40:21.507117] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:40:21.751074] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-21T17:40:22.549533] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (3.20 seconds). [2025-10-21T17:40:22.555027] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-21T17:40:22.556044] [INFO ] [REMOTE ] BOND: Full fetch complete (46608 records). [2025-10-21T17:40:22.556115] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-21T17:40:22.993290] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T17:40:22.991622] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-21T17:40:23.004303] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-21T17:40:23.005391] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-21T17:40:23.005521] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-21T17:40:23.023895] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T17:40:23.023069] [DEBUG] [LOCAL ] BOND: Trimmed 46608 records to 32458 (keeping 200 days of data) [2025-10-21T17:40:23.225389] [DEBUG] [LOCAL ] BOND: Primary data saved (32458 records). [2025-10-21T17:40:23.225501] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-21T17:40:23.225574] [INFO ] [MAIN ] Update Progress: 321/2366 symbols completed. BOND took 21.0s. Estimated remaining: 4h 16m 52s. Rate: 8.0 symbols/min [2025-10-21T17:40:23.355739] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-21T17:40:23.411395] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:23.428260] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T17:40:23.469922] [DEBUG] [LOCAL ] BORR: Loaded 51118 existing records from primary storage. [2025-10-21T17:40:23.470247] [INFO ] [MAIN ] BORR: Loaded 51118 existing records. [2025-10-21T17:40:23.645476] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:23.645746] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-21T17:40:23.645803] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-21T17:40:23.646120] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-21T17:40:23.646176] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-21T17:40:23.995483] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:24.151034] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-21T17:40:24.951007] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-21T17:40:25.172995] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T17:40:25.514528] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:40:25.751032] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-21T17:40:26.400458] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T17:40:26.551039] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-21T17:40:26.794448] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:40:27.351057] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-21T17:40:28.151022] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-21T17:40:28.950996] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-21T17:40:29.057713] [DEBUG] [REMOTE ] BOE: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-21T17:40:29.058059] [WARN ] [REMOTE ] BOE: No data returned for month 2025-09 [2025-10-21T17:40:29.058187] [FATAL] [REMOTE ] BOE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:40:29.058305] [FATAL] [MAIN ] BOE: Failed to fetch primary data. [2025-10-21T17:40:29.058390] [WARN ] [MAIN ] BOE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:40:29.058482] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-21T17:40:29.058562] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-21T17:40:29.058601] [INFO ] [LOCAL ] BOE: Starting deletion of derivative data. [2025-10-21T17:40:29.058777] [DEBUG] [LOCAL ] BOE: Deleted derivative data file. [2025-10-21T17:40:29.058863] [INFO ] [MAIN ] Update Progress: 322/2366 symbols completed. BOE took 26.8s. Estimated remaining: 4h 16m 34s. Rate: 8.0 symbols/min [2025-10-21T17:40:29.267354] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:29.269387] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T17:40:29.296670] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-21T17:40:29.302818] [INFO ] [REMOTE ] BOH: Full fetch complete (45383 records). [2025-10-21T17:40:29.303033] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-21T17:40:29.446398] [DEBUG] [LOCAL ] BOW: Loaded 22961 existing records from primary storage. [2025-10-21T17:40:29.467291] [INFO ] [MAIN ] BOW: Loaded 22961 existing records. [2025-10-21T17:40:29.779462] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-21T17:40:29.833542] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:29.833958] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-21T17:40:29.849984] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-21T17:40:29.860447] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-21T17:40:29.860932] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-21T17:40:29.966513] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-21T17:40:29.992323] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-21T17:40:30.009720] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-21T17:40:30.009826] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-21T17:40:30.065738] [DEBUG] [LOCAL ] BOH: Trimmed 45383 records to 30727 (keeping 200 days of data) [2025-10-21T17:40:30.249452] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T17:40:30.451852] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:30.528759] [DEBUG] [LOCAL ] BOH: Primary data saved (30727 records). [2025-10-21T17:40:30.528888] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-21T17:40:30.528956] [INFO ] [MAIN ] Update Progress: 323/2366 symbols completed. BOH took 28.3s. Estimated remaining: 4h 15m 48s. Rate: 8.0 symbols/min [2025-10-21T17:40:30.558236] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-21T17:40:30.700732] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:30.746133] [DEBUG] [LOCAL ] BOX: Loaded 50187 existing records from primary storage. [2025-10-21T17:40:30.746418] [INFO ] [MAIN ] BOX: Loaded 50187 existing records. [2025-10-21T17:40:30.930096] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:30.930280] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-21T17:40:30.930326] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-21T17:40:30.930705] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-21T17:40:30.930762] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-21T17:40:31.298597] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:31.350983] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-21T17:40:31.733890] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T17:40:32.151072] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-21T17:40:32.582904] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T17:40:32.951059] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-21T17:40:33.406140] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T17:40:33.739249] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T17:40:33.750981] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-21T17:40:34.278176] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:40:34.551072] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-21T17:40:35.351088] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-21T17:40:35.569376] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T17:40:36.154733] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-21T17:40:36.158165] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T17:40:36.193339] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:40:36.951041] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-21T17:40:37.575086] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T17:40:37.751031] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-21T17:40:38.551018] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-21T17:40:38.972084] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T17:40:39.351024] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-21T17:40:39.820915] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T17:40:39.826851] [INFO ] [REMOTE ] BOOT: Full fetch complete (60010 records). [2025-10-21T17:40:39.827023] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-21T17:40:40.153425] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-21T17:40:40.234014] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-21T17:40:40.234606] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-21T17:40:40.235343] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-21T17:40:40.235480] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-21T17:40:40.236942] [DEBUG] [LOCAL ] BOOT: Trimmed 60010 records to 39541 (keeping 200 days of data) [2025-10-21T17:40:40.271548] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T17:40:40.516053] [DEBUG] [LOCAL ] BOOT: Primary data saved (39541 records). [2025-10-21T17:40:40.516202] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-21T17:40:40.516323] [INFO ] [MAIN ] Update Progress: 324/2366 symbols completed. BOOT took 38.3s. Estimated remaining: 4h 15m 56s. Rate: 8.0 symbols/min [2025-10-21T17:40:40.691147] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:40.739250] [DEBUG] [LOCAL ] BP: Loaded 53708 existing records from primary storage. [2025-10-21T17:40:40.739747] [INFO ] [MAIN ] BP: Loaded 53708 existing records. [2025-10-21T17:40:40.919711] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:40.920091] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-21T17:40:40.920166] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-21T17:40:40.931591] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-21T17:40:40.952438] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-21T17:40:40.952722] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-21T17:40:40.967999] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T17:40:41.337070] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:41.519903] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T17:40:41.751059] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-21T17:40:42.550997] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-21T17:40:42.656815] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:40:42.826571] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T17:40:43.351101] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-21T17:40:44.151070] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-21T17:40:44.863553] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-21T17:40:44.951084] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-21T17:40:45.242341] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T17:40:45.305611] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:40:45.751103] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-21T17:40:46.551069] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-21T17:40:47.015324] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T17:40:47.274216] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T17:40:47.350993] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-21T17:40:47.556105] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T17:40:48.151040] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-21T17:40:48.951025] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-21T17:40:49.026509] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:40:49.751048] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-21T17:40:50.245487] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T17:40:50.551013] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-21T17:40:50.947986] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T17:40:51.187912] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T17:40:51.351067] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-21T17:40:51.845887] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T17:40:52.151048] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-21T17:40:52.951002] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-21T17:40:53.074148] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T17:40:53.751079] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-21T17:40:54.024831] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T17:40:54.032702] [INFO ] [REMOTE ] BORR: Full fetch complete (74534 records). [2025-10-21T17:40:54.032831] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-21T17:40:54.439409] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-21T17:40:54.439493] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-21T17:40:54.440299] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-21T17:40:54.440361] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-21T17:40:54.441751] [DEBUG] [LOCAL ] BORR: Trimmed 74534 records to 51097 (keeping 200 days of data) [2025-10-21T17:40:54.553718] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-21T17:40:54.736795] [DEBUG] [LOCAL ] BORR: Primary data saved (51097 records). [2025-10-21T17:40:54.736932] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-21T17:40:54.737010] [INFO ] [MAIN ] Update Progress: 325/2366 symbols completed. BORR took 31.5s. Estimated remaining: 4h 16m 30s. Rate: 8.0 symbols/min [2025-10-21T17:40:54.918992] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:54.954026] [DEBUG] [LOCAL ] BR: Loaded 34741 existing records from primary storage. [2025-10-21T17:40:54.954299] [INFO ] [MAIN ] BR: Loaded 34741 existing records. [2025-10-21T17:40:55.145287] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:55.145533] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-21T17:40:55.145602] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-21T17:40:55.146386] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-21T17:40:55.146443] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-21T17:40:55.562829] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:55.563204] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-21T17:40:55.593843] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-21T17:40:55.781076] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T17:40:55.938866] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-21T17:40:55.950722] [INFO ] [REMOTE ] BOX: Full fetch complete (72314 records). [2025-10-21T17:40:55.950941] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-21T17:40:56.161486] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-21T17:40:56.355573] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-21T17:40:56.355673] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-21T17:40:56.356454] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-21T17:40:56.356503] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-21T17:40:56.357859] [DEBUG] [LOCAL ] BOX: Trimmed 72314 records to 50139 (keeping 200 days of data) [2025-10-21T17:40:56.654380] [DEBUG] [LOCAL ] BOX: Primary data saved (50139 records). [2025-10-21T17:40:56.654551] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-21T17:40:56.655404] [INFO ] [MAIN ] Update Progress: 326/2366 symbols completed. BOX took 26.1s. Estimated remaining: 4h 15m 48s. Rate: 8.0 symbols/min [2025-10-21T17:40:56.833847] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:40:56.883014] [DEBUG] [LOCAL ] BRBR: Loaded 51831 existing records from primary storage. [2025-10-21T17:40:56.883348] [INFO ] [MAIN ] BRBR: Loaded 51831 existing records. [2025-10-21T17:40:56.951974] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-21T17:40:57.078810] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:40:57.079083] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-21T17:40:57.079133] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-21T17:40:57.079556] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-21T17:40:57.079612] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-21T17:40:57.400799] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T17:40:57.483725] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:40:57.751009] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-21T17:40:58.088891] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:40:58.537569] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-21T17:40:58.550985] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-21T17:40:59.351035] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-21T17:40:59.403665] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T17:41:00.151028] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-21T17:41:00.719058] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T17:41:00.756863] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T17:41:00.950993] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-21T17:41:01.185197] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T17:41:01.751023] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-21T17:41:02.551070] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-21T17:41:03.351003] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-21T17:41:03.688500] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-21T17:41:03.964540] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T17:41:04.150992] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-21T17:41:04.551319] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T17:41:04.556627] [INFO ] [REMOTE ] BOW: Full fetch complete (32131 records). [2025-10-21T17:41:04.556776] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-21T17:41:04.680045] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T17:41:04.966771] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-21T17:41:05.030295] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-21T17:41:05.030450] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-21T17:41:05.031265] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-21T17:41:05.031347] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-21T17:41:05.032753] [DEBUG] [LOCAL ] BOW: Trimmed 32131 records to 22908 (keeping 200 days of data) [2025-10-21T17:41:05.165635] [DEBUG] [LOCAL ] BOW: Primary data saved (22908 records). [2025-10-21T17:41:05.165808] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-21T17:41:05.165921] [INFO ] [MAIN ] Update Progress: 327/2366 symbols completed. BOW took 36.1s. Estimated remaining: 4h 15m 46s. Rate: 8.0 symbols/min [2025-10-21T17:41:05.337824] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:05.355101] [DEBUG] [LOCAL ] BRC: Loaded 18533 existing records from primary storage. [2025-10-21T17:41:05.355345] [INFO ] [MAIN ] BRC: Loaded 18533 existing records. [2025-10-21T17:41:05.550372] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:05.550636] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-21T17:41:05.550725] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-21T17:41:05.551233] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-21T17:41:05.551293] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-21T17:41:05.771355] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-21T17:41:05.926066] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:06.508198] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T17:41:06.551006] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-21T17:41:06.831350] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:41:07.350999] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-21T17:41:07.760631] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T17:41:08.151039] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-21T17:41:08.762593] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T17:41:08.951011] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-21T17:41:09.003140] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-21T17:41:09.679761] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:41:09.751063] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-21T17:41:10.249218] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T17:41:10.551105] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-21T17:41:11.003493] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T17:41:11.351055] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-21T17:41:11.550744] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T17:41:12.151091] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-21T17:41:12.865636] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:41:12.951082] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-21T17:41:13.751048] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-21T17:41:14.013952] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:41:14.171556] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T17:41:14.551094] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-21T17:41:14.746066] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T17:41:15.351085] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-21T17:41:16.085034] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T17:41:16.151043] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-21T17:41:16.951071] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-21T17:41:17.640566] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-21T17:41:17.650191] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-21T17:41:17.650350] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-21T17:41:17.753448] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-21T17:41:18.069361] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T17:41:18.117429] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-21T17:41:18.117538] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-21T17:41:18.118780] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-21T17:41:18.118845] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-21T17:41:18.120218] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 53706 (keeping 200 days of data) [2025-10-21T17:41:18.419370] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T17:41:18.476204] [DEBUG] [LOCAL ] BP: Primary data saved (53706 records). [2025-10-21T17:41:18.476491] [INFO ] [MAIN ] BP: Full history saved. [2025-10-21T17:41:18.476911] [INFO ] [MAIN ] Update Progress: 328/2366 symbols completed. BP took 38.0s. Estimated remaining: 4h 16m 15s. Rate: 8.0 symbols/min [2025-10-21T17:41:18.477060] [INFO ] [REMOTE ] BR: Full fetch complete (50006 records). [2025-10-21T17:41:18.520901] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-21T17:41:18.553738] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-21T17:41:18.787822] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:19.122070] [DEBUG] [LOCAL ] BRCC: Loaded 40137 existing records from primary storage. [2025-10-21T17:41:19.119422] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-21T17:41:19.122618] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-21T17:41:19.122812] [INFO ] [MAIN ] BRCC: Loaded 40137 existing records. [2025-10-21T17:41:19.129008] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-21T17:41:19.129277] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-21T17:41:19.248277] [DEBUG] [LOCAL ] BR: Trimmed 50006 records to 34606 (keeping 200 days of data) [2025-10-21T17:41:19.250271] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T17:41:19.363944] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-21T17:41:19.437605] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:19.449068] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-21T17:41:19.467696] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-21T17:41:19.473908] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-21T17:41:19.475859] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-21T17:41:19.755365] [DEBUG] [LOCAL ] BR: Primary data saved (34606 records). [2025-10-21T17:41:19.791016] [INFO ] [MAIN ] BR: Full history saved. [2025-10-21T17:41:19.834538] [INFO ] [MAIN ] Update Progress: 329/2366 symbols completed. BR took 25.1s. Estimated remaining: 4h 15m 29s. Rate: 8.0 symbols/min [2025-10-21T17:41:20.058110] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:20.129880] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:20.157911] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-21T17:41:20.182245] [DEBUG] [LOCAL ] BRO: Loaded 52094 existing records from primary storage. [2025-10-21T17:41:20.182596] [INFO ] [MAIN ] BRO: Loaded 52094 existing records. [2025-10-21T17:41:20.369312] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:20.369928] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-21T17:41:20.369987] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-21T17:41:20.370961] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-21T17:41:20.371028] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-21T17:41:20.566496] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T17:41:20.802673] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T17:41:20.826528] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:20.951021] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-21T17:41:21.540214] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T17:41:21.750986] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-21T17:41:22.001989] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T17:41:22.551050] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-21T17:41:22.871451] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T17:41:23.351041] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-21T17:41:23.937338] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T17:41:24.151007] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-21T17:41:24.385155] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T17:41:24.951094] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-21T17:41:25.751066] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-21T17:41:25.815227] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:41:26.484026] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T17:41:26.551004] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-21T17:41:26.734852] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T17:41:27.351064] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-21T17:41:27.971528] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:41:28.151055] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-21T17:41:28.951031] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-21T17:41:29.500165] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T17:41:29.626849] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-21T17:41:29.751004] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-21T17:41:30.551061] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-21T17:41:30.995289] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T17:41:31.351069] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-21T17:41:31.505718] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:41:32.131847] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T17:41:32.150983] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-21T17:41:32.950979] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-21T17:41:33.283804] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T17:41:33.635490] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T17:41:33.750979] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-21T17:41:33.865012] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T17:41:33.868240] [INFO ] [REMOTE ] BRC: Full fetch complete (28434 records). [2025-10-21T17:41:33.868338] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-21T17:41:34.248659] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-21T17:41:34.248780] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-21T17:41:34.249246] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-21T17:41:34.249288] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-21T17:41:34.250091] [DEBUG] [LOCAL ] BRC: Trimmed 28434 records to 18420 (keeping 200 days of data) [2025-10-21T17:41:34.360284] [DEBUG] [LOCAL ] BRC: Primary data saved (18420 records). [2025-10-21T17:41:34.360422] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-21T17:41:34.360501] [INFO ] [MAIN ] Update Progress: 330/2366 symbols completed. BRC took 29.2s. Estimated remaining: 4h 16m 4s. Rate: 8.0 symbols/min [2025-10-21T17:41:34.530602] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:34.556394] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-21T17:41:34.578895] [DEBUG] [LOCAL ] BROS: Loaded 53300 existing records from primary storage. [2025-10-21T17:41:34.579191] [INFO ] [MAIN ] BROS: Loaded 53300 existing records. [2025-10-21T17:41:34.761260] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:34.761458] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-21T17:41:34.761508] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-21T17:41:34.762397] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-21T17:41:34.762455] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-21T17:41:35.143987] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:35.160451] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T17:41:35.351013] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-21T17:41:36.151090] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-21T17:41:36.276150] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T17:41:36.284499] [INFO ] [REMOTE ] BRBR: Full fetch complete (73162 records). [2025-10-21T17:41:36.284710] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-21T17:41:36.683756] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-21T17:41:36.683906] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-21T17:41:36.684732] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-21T17:41:36.684804] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-21T17:41:36.686130] [DEBUG] [LOCAL ] BRBR: Trimmed 73162 records to 51828 (keeping 200 days of data) [2025-10-21T17:41:36.965320] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-21T17:41:37.004848] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T17:41:37.028076] [DEBUG] [LOCAL ] BRBR: Primary data saved (51828 records). [2025-10-21T17:41:37.028453] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-21T17:41:37.029260] [INFO ] [MAIN ] Update Progress: 331/2366 symbols completed. BRBR took 40.4s. Estimated remaining: 4h 15m 27s. Rate: 8.0 symbols/min [2025-10-21T17:41:37.207737] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:37.207962] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-21T17:41:37.208004] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-21T17:41:37.208111] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-21T17:41:37.208178] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-21T17:41:37.208232] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-21T17:41:37.208264] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-21T17:41:37.562165] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:37.751049] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-21T17:41:37.935153] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:41:37.949056] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:41:37.949398] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-21T17:41:37.949509] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:41:37.949553] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-21T17:41:37.949588] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:41:37.949677] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-21T17:41:37.949756] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-21T17:41:37.949792] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-21T17:41:37.949831] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-21T17:41:37.949876] [INFO ] [MAIN ] Update Progress: 332/2366 symbols completed. BRSL took 0.9s. Estimated remaining: 4h 14m 39s. Rate: 8.0 symbols/min [2025-10-21T17:41:38.127002] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:38.162760] [DEBUG] [LOCAL ] BRSP: Loaded 36685 existing records from primary storage. [2025-10-21T17:41:38.163084] [INFO ] [MAIN ] BRSP: Loaded 36685 existing records. [2025-10-21T17:41:38.347885] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:38.348091] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-21T17:41:38.348355] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-21T17:41:38.349328] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-21T17:41:38.349388] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-21T17:41:38.561689] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-21T17:41:38.752147] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:38.788778] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T17:41:39.351128] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-21T17:41:39.935215] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T17:41:40.151023] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-21T17:41:40.951038] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-21T17:41:41.458839] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T17:41:41.751002] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-21T17:41:42.181077] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-21T17:41:42.431530] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:41:42.551005] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-21T17:41:43.351024] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-21T17:41:43.685022] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T17:41:43.718256] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T17:41:44.151051] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-21T17:41:44.951003] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-21T17:41:45.382282] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T17:41:45.751066] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-21T17:41:45.862505] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:41:45.868639] [INFO ] [REMOTE ] BRCC: Full fetch complete (57324 records). [2025-10-21T17:41:45.868841] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-21T17:41:46.247871] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-21T17:41:46.247946] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-21T17:41:46.248616] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-21T17:41:46.248702] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-21T17:41:46.249768] [DEBUG] [LOCAL ] BRCC: Trimmed 57324 records to 40061 (keeping 200 days of data) [2025-10-21T17:41:46.463101] [DEBUG] [LOCAL ] BRCC: Primary data saved (40061 records). [2025-10-21T17:41:46.463215] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-21T17:41:46.463286] [INFO ] [MAIN ] Update Progress: 333/2366 symbols completed. BRCC took 28.0s. Estimated remaining: 4h 14m 37s. Rate: 8.0 symbols/min [2025-10-21T17:41:46.552971] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-21T17:41:46.634880] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:46.641828] [DEBUG] [LOCAL ] BRT: Loaded 5249 existing records from primary storage. [2025-10-21T17:41:46.642027] [INFO ] [MAIN ] BRT: Loaded 5249 existing records. [2025-10-21T17:41:46.822130] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:46.822695] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-21T17:41:46.833219] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-21T17:41:46.852074] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-21T17:41:46.853584] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T17:41:46.853669] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-21T17:41:47.223214] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:47.245178] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:41:47.351015] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-21T17:41:48.151043] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-21T17:41:48.652942] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T17:41:48.806741] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T17:41:48.951043] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-21T17:41:49.519791] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T17:41:49.675286] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T17:41:49.751044] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-21T17:41:50.223565] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T17:41:50.551049] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-21T17:41:51.351025] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-21T17:41:52.151007] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-21T17:41:52.192224] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:41:52.951001] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-21T17:41:53.286800] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T17:41:53.295104] [INFO ] [REMOTE ] BRO: Full fetch complete (75076 records). [2025-10-21T17:41:53.295256] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-21T17:41:53.536447] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:41:53.622896] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T17:41:53.724666] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-21T17:41:53.724762] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-21T17:41:53.725555] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-21T17:41:53.725595] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-21T17:41:53.727000] [DEBUG] [LOCAL ] BRO: Trimmed 75076 records to 52096 (keeping 200 days of data) [2025-10-21T17:41:53.782839] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-21T17:41:54.051405] [DEBUG] [LOCAL ] BRO: Primary data saved (52096 records). [2025-10-21T17:41:54.051542] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-21T17:41:54.052417] [INFO ] [MAIN ] Update Progress: 334/2366 symbols completed. BRO took 34.2s. Estimated remaining: 4h 14m 30s. Rate: 8.0 symbols/min [2025-10-21T17:41:54.221371] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:41:54.243281] [DEBUG] [LOCAL ] BRW: Loaded 20943 existing records from primary storage. [2025-10-21T17:41:54.243520] [INFO ] [MAIN ] BRW: Loaded 20943 existing records. [2025-10-21T17:41:54.394239] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T17:41:54.429254] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:41:54.429439] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-21T17:41:54.429485] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-21T17:41:54.429665] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-21T17:41:54.429722] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-21T17:41:54.556173] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-21T17:41:54.789170] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:41:55.351044] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-21T17:41:55.913755] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T17:41:56.027114] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-21T17:41:56.151030] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-21T17:41:56.951052] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-21T17:41:57.525000] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T17:41:57.751027] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-21T17:41:58.551083] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-21T17:41:58.781996] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T17:41:59.226748] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T17:41:59.350989] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-21T17:41:59.827570] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T17:42:00.008538] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T17:42:00.151035] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-21T17:42:00.865511] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-21T17:42:00.951033] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-21T17:42:01.751016] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-21T17:42:02.551009] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-21T17:42:02.704566] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:42:03.104289] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:42:03.351017] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-21T17:42:03.918302] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T17:42:04.151037] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-21T17:42:04.951014] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-21T17:42:05.442701] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T17:42:05.686990] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T17:42:05.756343] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-21T17:42:05.765637] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T17:42:05.772167] [INFO ] [REMOTE ] BRSP: Full fetch complete (54050 records). [2025-10-21T17:42:05.772364] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-21T17:42:06.160773] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-21T17:42:06.160850] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-21T17:42:06.161507] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-21T17:42:06.161547] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-21T17:42:06.162574] [DEBUG] [LOCAL ] BRSP: Trimmed 54050 records to 36602 (keeping 200 days of data) [2025-10-21T17:42:06.366097] [DEBUG] [LOCAL ] BRSP: Primary data saved (36602 records). [2025-10-21T17:42:06.366224] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-21T17:42:06.366802] [INFO ] [MAIN ] Update Progress: 335/2366 symbols completed. BRSP took 28.4s. Estimated remaining: 4h 14m 52s. Rate: 8.0 symbols/min [2025-10-21T17:42:06.548756] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:06.551028] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-21T17:42:06.610963] [DEBUG] [LOCAL ] BRX: Loaded 51836 existing records from primary storage. [2025-10-21T17:42:06.611388] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T17:42:06.616417] [INFO ] [MAIN ] BRX: Loaded 51836 existing records. [2025-10-21T17:42:06.798051] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:06.798299] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-21T17:42:06.798349] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-21T17:42:06.798534] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-21T17:42:06.798574] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-21T17:42:07.152564] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:07.351038] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-21T17:42:07.792047] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T17:42:08.151018] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-21T17:42:08.629030] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-21T17:42:08.951041] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-21T17:42:09.074282] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:42:09.751021] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-21T17:42:10.551037] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-21T17:42:11.059183] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T17:42:11.067742] [INFO ] [REMOTE ] BROS: Full fetch complete (77271 records). [2025-10-21T17:42:11.067899] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-21T17:42:11.361553] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-21T17:42:11.474495] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-21T17:42:11.474854] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-21T17:42:11.476082] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-21T17:42:11.476183] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-21T17:42:11.477943] [DEBUG] [LOCAL ] BROS: Trimmed 77271 records to 53301 (keeping 200 days of data) [2025-10-21T17:42:11.596798] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T17:42:11.641787] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T17:42:11.845251] [DEBUG] [LOCAL ] BROS: Primary data saved (53301 records). [2025-10-21T17:42:11.845386] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-21T17:42:11.845486] [INFO ] [MAIN ] Update Progress: 336/2366 symbols completed. BROS took 37.5s. Estimated remaining: 4h 14m 32s. Rate: 8.0 symbols/min [2025-10-21T17:42:12.013712] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:12.043377] [DEBUG] [LOCAL ] BSAC: Loaded 32970 existing records from primary storage. [2025-10-21T17:42:12.043683] [INFO ] [MAIN ] BSAC: Loaded 32970 existing records. [2025-10-21T17:42:12.156092] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-21T17:42:12.229504] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:12.233488] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-21T17:42:12.234023] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-21T17:42:12.234201] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T17:42:12.235578] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-21T17:42:12.236233] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-21T17:42:12.590215] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:12.951125] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-21T17:42:13.317569] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:42:13.751083] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-21T17:42:14.469534] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T17:42:14.550992] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-21T17:42:14.878189] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:42:15.351064] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-21T17:42:16.083237] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T17:42:16.150993] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-21T17:42:16.178851] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T17:42:16.180569] [INFO ] [REMOTE ] BRT: Full fetch complete (7106 records). [2025-10-21T17:42:16.180636] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-21T17:42:16.539176] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-21T17:42:16.539272] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-21T17:42:16.539529] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-21T17:42:16.539572] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-21T17:42:16.540025] [DEBUG] [LOCAL ] BRT: Trimmed 7106 records to 5264 (keeping 200 days of data) [2025-10-21T17:42:16.571892] [DEBUG] [LOCAL ] BRT: Primary data saved (5264 records). [2025-10-21T17:42:16.572008] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-21T17:42:16.572087] [INFO ] [MAIN ] Update Progress: 337/2366 symbols completed. BRT took 30.1s. Estimated remaining: 4h 14m 8s. Rate: 8.0 symbols/min [2025-10-21T17:42:16.741782] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:16.775578] [DEBUG] [LOCAL ] BSBR: Loaded 35912 existing records from primary storage. [2025-10-21T17:42:16.775867] [INFO ] [MAIN ] BSBR: Loaded 35912 existing records. [2025-10-21T17:42:16.957625] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:16.954383] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-21T17:42:16.959032] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-21T17:42:16.959100] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-21T17:42:16.959346] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-21T17:42:16.959405] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-21T17:42:17.320045] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:17.751057] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-21T17:42:17.840461] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T17:42:18.025922] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T17:42:18.551089] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-21T17:42:18.575135] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:42:19.351078] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-21T17:42:19.832129] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T17:42:20.151038] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-21T17:42:20.951089] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-21T17:42:20.986249] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:42:21.605313] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T17:42:21.751032] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-21T17:42:22.411971] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T17:42:22.416490] [INFO ] [REMOTE ] BRW: Full fetch complete (30168 records). [2025-10-21T17:42:22.416578] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-21T17:42:22.560797] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-21T17:42:22.793340] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-21T17:42:22.793410] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-21T17:42:22.793894] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-21T17:42:22.793955] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-21T17:42:22.794686] [DEBUG] [LOCAL ] BRW: Trimmed 30168 records to 21018 (keeping 200 days of data) [2025-10-21T17:42:22.915073] [DEBUG] [LOCAL ] BRW: Primary data saved (21018 records). [2025-10-21T17:42:22.915188] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-21T17:42:22.915261] [INFO ] [MAIN ] Update Progress: 338/2366 symbols completed. BRW took 28.9s. Estimated remaining: 4h 13m 53s. Rate: 8.0 symbols/min [2025-10-21T17:42:23.088123] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:23.098610] [DEBUG] [LOCAL ] BSL: Loaded 8235 existing records from primary storage. [2025-10-21T17:42:23.098864] [INFO ] [MAIN ] BSL: Loaded 8235 existing records. [2025-10-21T17:42:23.306693] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:23.308070] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T17:42:23.316370] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-21T17:42:23.316756] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-21T17:42:23.317169] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-21T17:42:23.317226] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-21T17:42:23.358883] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-21T17:42:23.671109] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:23.979991] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:42:24.151094] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-21T17:42:24.885666] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:42:24.951001] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-21T17:42:25.030507] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T17:42:25.751056] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-21T17:42:26.475741] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:42:26.551029] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-21T17:42:27.072449] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:42:27.351020] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-21T17:42:27.926308] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T17:42:28.151003] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-21T17:42:28.951003] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-21T17:42:29.066775] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T17:42:29.138006] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T17:42:29.454129] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T17:42:29.751034] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-21T17:42:30.539156] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T17:42:30.550978] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-21T17:42:31.351439] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-21T17:42:31.351350] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T17:42:32.151102] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-21T17:42:32.605101] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:42:32.951083] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-21T17:42:33.588002] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T17:42:33.681349] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T17:42:33.751032] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-21T17:42:34.551046] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-21T17:42:35.355418] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-21T17:42:35.386595] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T17:42:35.387548] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:42:36.151055] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-21T17:42:36.813792] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:42:36.951038] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-21T17:42:37.640943] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T17:42:37.751000] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-21T17:42:38.551000] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-21T17:42:38.628581] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:42:38.766931] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:42:38.773013] [INFO ] [REMOTE ] BSAC: Full fetch complete (45113 records). [2025-10-21T17:42:38.773189] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-21T17:42:39.141990] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-21T17:42:39.142138] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-21T17:42:39.142802] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-21T17:42:39.142924] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-21T17:42:39.144148] [DEBUG] [LOCAL ] BSAC: Trimmed 45113 records to 32912 (keeping 200 days of data) [2025-10-21T17:42:39.306237] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T17:42:39.348452] [DEBUG] [LOCAL ] BSAC: Primary data saved (32912 records). [2025-10-21T17:42:39.348585] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-21T17:42:39.348684] [INFO ] [MAIN ] Update Progress: 339/2366 symbols completed. BSAC took 27.5s. Estimated remaining: 4h 14m 39s. Rate: 8.0 symbols/min [2025-10-21T17:42:39.359807] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-21T17:42:39.533838] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:39.564970] [DEBUG] [LOCAL ] BSM: Loaded 32482 existing records from primary storage. [2025-10-21T17:42:39.565229] [INFO ] [MAIN ] BSM: Loaded 32482 existing records. [2025-10-21T17:42:39.741767] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:39.741979] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-21T17:42:39.742025] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-21T17:42:39.742220] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-21T17:42:39.742274] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-21T17:42:40.100890] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:40.150992] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-21T17:42:40.729566] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T17:42:40.951080] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-21T17:42:41.751001] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-21T17:42:41.970177] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T17:42:41.978613] [INFO ] [REMOTE ] BRX: Full fetch complete (75133 records). [2025-10-21T17:42:41.978780] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-21T17:42:42.376126] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-21T17:42:42.376295] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-21T17:42:42.377186] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-21T17:42:42.377268] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-21T17:42:42.394603] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T17:42:42.401736] [DEBUG] [LOCAL ] BRX: Trimmed 75133 records to 51823 (keeping 200 days of data) [2025-10-21T17:42:42.586737] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-21T17:42:42.727521] [DEBUG] [LOCAL ] BRX: Primary data saved (51823 records). [2025-10-21T17:42:42.727684] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-21T17:42:42.728441] [INFO ] [MAIN ] Update Progress: 340/2366 symbols completed. BRX took 36.4s. Estimated remaining: 4h 14m 7s. Rate: 8.0 symbols/min [2025-10-21T17:42:42.897198] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:42.918421] [DEBUG] [LOCAL ] BST: Loaded 18723 existing records from primary storage. [2025-10-21T17:42:42.918675] [INFO ] [MAIN ] BST: Loaded 18723 existing records. [2025-10-21T17:42:43.055220] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T17:42:43.124439] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:43.125062] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-21T17:42:43.125112] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-21T17:42:43.125547] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-21T17:42:43.125604] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-21T17:42:43.230919] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-21T17:42:43.356212] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-21T17:42:43.501020] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:43.957303] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T17:42:44.151024] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-21T17:42:44.839290] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T17:42:44.841904] [INFO ] [REMOTE ] BSL: Full fetch complete (13023 records). [2025-10-21T17:42:44.842062] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-21T17:42:44.956233] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-21T17:42:45.245171] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-21T17:42:45.245248] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-21T17:42:45.245573] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-21T17:42:45.245612] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-21T17:42:45.246171] [DEBUG] [LOCAL ] BSL: Trimmed 13023 records to 8084 (keeping 200 days of data) [2025-10-21T17:42:45.297528] [DEBUG] [LOCAL ] BSL: Primary data saved (8084 records). [2025-10-21T17:42:45.297670] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-21T17:42:45.297767] [INFO ] [MAIN ] Update Progress: 341/2366 symbols completed. BSL took 22.4s. Estimated remaining: 4h 13m 30s. Rate: 8.0 symbols/min [2025-10-21T17:42:45.489496] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:45.514439] [DEBUG] [LOCAL ] BSTZ: Loaded 24687 existing records from primary storage. [2025-10-21T17:42:45.514706] [INFO ] [MAIN ] BSTZ: Loaded 24687 existing records. [2025-10-21T17:42:45.688757] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:45.688975] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-21T17:42:45.689022] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-21T17:42:45.689472] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-21T17:42:45.689528] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-21T17:42:45.756787] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-21T17:42:46.076951] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:46.097940] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T17:42:46.551025] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-21T17:42:46.957736] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T17:42:47.351044] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-21T17:42:47.826780] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-21T17:42:48.151031] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-21T17:42:48.951007] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-21T17:42:49.101712] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T17:42:49.257723] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T17:42:49.751024] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-21T17:42:49.942605] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T17:42:50.551038] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-21T17:42:50.984146] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:42:51.351030] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-21T17:42:51.883795] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T17:42:52.151070] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-21T17:42:52.763819] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T17:42:52.951017] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-21T17:42:53.274243] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T17:42:53.751042] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-21T17:42:54.307397] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T17:42:54.550991] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-21T17:42:54.951435] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T17:42:55.350996] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-21T17:42:55.389547] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-21T17:42:56.151020] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-21T17:42:56.852425] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T17:42:56.950996] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-21T17:42:57.238773] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T17:42:57.244543] [INFO ] [REMOTE ] BSBR: Full fetch complete (51150 records). [2025-10-21T17:42:57.244669] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-21T17:42:57.627888] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-21T17:42:57.627969] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-21T17:42:57.628760] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-21T17:42:57.628824] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-21T17:42:57.629887] [DEBUG] [LOCAL ] BSBR: Trimmed 51150 records to 35863 (keeping 200 days of data) [2025-10-21T17:42:57.777223] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-21T17:42:57.830735] [DEBUG] [LOCAL ] BSBR: Primary data saved (35863 records). [2025-10-21T17:42:57.830847] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-21T17:42:57.831204] [INFO ] [MAIN ] Update Progress: 342/2366 symbols completed. BSBR took 41.3s. Estimated remaining: 4h 13m 52s. Rate: 8.0 symbols/min [2025-10-21T17:42:58.001134] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:42:58.051843] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-21T17:42:58.052172] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-21T17:42:58.242719] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:42:58.249202] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T17:42:58.249308] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-21T17:42:58.254711] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-21T17:42:58.255503] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-21T17:42:58.255572] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-21T17:42:58.556139] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-21T17:42:58.626790] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:42:59.164596] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T17:42:59.351066] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-21T17:42:59.424138] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T17:43:00.151024] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-21T17:43:00.951058] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-21T17:43:01.425162] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T17:43:01.453974] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T17:43:01.751042] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-21T17:43:02.267622] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T17:43:02.551059] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-21T17:43:03.045448] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T17:43:03.351049] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-21T17:43:04.151060] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-21T17:43:04.215445] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:43:04.362856] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T17:43:04.951046] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-21T17:43:04.977959] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T17:43:05.751061] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-21T17:43:06.551015] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-21T17:43:06.833559] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:43:07.197895] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T17:43:07.351067] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-21T17:43:07.816180] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T17:43:08.151009] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-21T17:43:08.683672] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T17:43:08.951036] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-21T17:43:09.237007] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T17:43:09.751028] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-21T17:43:10.004861] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T17:43:10.008910] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36470 records). [2025-10-21T17:43:10.008993] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-21T17:43:10.376248] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-21T17:43:10.376328] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-21T17:43:10.376862] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-21T17:43:10.376925] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-21T17:43:10.377766] [DEBUG] [LOCAL ] BSTZ: Trimmed 36470 records to 24579 (keeping 200 days of data) [2025-10-21T17:43:10.526793] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24579 records). [2025-10-21T17:43:10.526954] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-21T17:43:10.527056] [INFO ] [MAIN ] Update Progress: 343/2366 symbols completed. BSTZ took 25.2s. Estimated remaining: 4h 14m 15s. Rate: 8.0 symbols/min [2025-10-21T17:43:10.556281] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-21T17:43:10.697856] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:10.705886] [DEBUG] [LOCAL ] BTA: Loaded 5756 existing records from primary storage. [2025-10-21T17:43:10.706095] [INFO ] [MAIN ] BTA: Loaded 5756 existing records. [2025-10-21T17:43:10.834112] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T17:43:10.900078] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:10.900284] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-21T17:43:10.900331] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-21T17:43:10.900465] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-21T17:43:10.900502] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-21T17:43:11.247179] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:11.351060] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-21T17:43:12.151091] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-21T17:43:12.448974] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T17:43:12.637173] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T17:43:12.951073] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-21T17:43:13.701905] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T17:43:13.750979] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-21T17:43:14.551024] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-21T17:43:14.694138] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:43:15.126471] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:43:15.131305] [INFO ] [REMOTE ] BSM: Full fetch complete (46929 records). [2025-10-21T17:43:15.131406] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-21T17:43:15.357784] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-21T17:43:15.341340] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T17:43:15.617769] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-21T17:43:15.617855] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-21T17:43:15.618577] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-21T17:43:15.618667] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-21T17:43:15.619672] [DEBUG] [LOCAL ] BSM: Trimmed 46929 records to 32421 (keeping 200 days of data) [2025-10-21T17:43:15.818743] [DEBUG] [LOCAL ] BSM: Primary data saved (32421 records). [2025-10-21T17:43:15.818888] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-21T17:43:15.818969] [INFO ] [MAIN ] Update Progress: 344/2366 symbols completed. BSM took 36.5s. Estimated remaining: 4h 13m 54s. Rate: 8.0 symbols/min [2025-10-21T17:43:15.983526] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:16.029039] [DEBUG] [LOCAL ] BTE: Loaded 52728 existing records from primary storage. [2025-10-21T17:43:16.029332] [INFO ] [MAIN ] BTE: Loaded 52728 existing records. [2025-10-21T17:43:16.166499] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-21T17:43:16.205583] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:16.205761] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-21T17:43:16.205812] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-21T17:43:16.206291] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-21T17:43:16.206366] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-21T17:43:16.556371] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:16.951005] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-21T17:43:16.994514] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T17:43:17.262322] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T17:43:17.265449] [INFO ] [REMOTE ] BST: Full fetch complete (28343 records). [2025-10-21T17:43:17.265526] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-21T17:43:17.641841] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-21T17:43:17.641926] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-21T17:43:17.642391] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-21T17:43:17.642432] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-21T17:43:17.643078] [DEBUG] [LOCAL ] BST: Trimmed 28343 records to 18592 (keeping 200 days of data) [2025-10-21T17:43:17.752846] [DEBUG] [LOCAL ] BST: Primary data saved (18592 records). [2025-10-21T17:43:17.752945] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-21T17:43:17.753122] [INFO ] [MAIN ] BST: Full history saved. [2025-10-21T17:43:17.753233] [INFO ] [MAIN ] Update Progress: 345/2366 symbols completed. BST took 35.0s. Estimated remaining: 4h 13m 14s. Rate: 8.0 symbols/min [2025-10-21T17:43:17.935660] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:17.983871] [DEBUG] [LOCAL ] BTI: Loaded 53594 existing records from primary storage. [2025-10-21T17:43:17.984159] [INFO ] [MAIN ] BTI: Loaded 53594 existing records. [2025-10-21T17:43:18.185561] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:18.185867] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-21T17:43:18.185920] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-21T17:43:18.186619] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-21T17:43:18.186713] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-21T17:43:18.553972] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-21T17:43:18.612434] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:18.859325] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T17:43:19.180705] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T17:43:19.351054] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-21T17:43:19.454020] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T17:43:20.033910] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T17:43:20.150990] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-21T17:43:20.654071] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-21T17:43:20.951034] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-21T17:43:21.393124] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T17:43:21.751003] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-21T17:43:22.358818] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T17:43:22.551077] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-21T17:43:23.238522] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T17:43:23.351076] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-21T17:43:24.151052] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-21T17:43:24.951106] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-21T17:43:25.571091] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-21T17:43:25.751042] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-21T17:43:25.845805] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:43:26.380614] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T17:43:26.551027] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-21T17:43:26.749984] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T17:43:27.351029] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-21T17:43:28.151057] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-21T17:43:28.222462] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T17:43:28.905738] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T17:43:28.907358] [INFO ] [REMOTE ] BTA: Full fetch complete (9400 records). [2025-10-21T17:43:28.907424] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-21T17:43:28.961337] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-21T17:43:29.277057] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-21T17:43:29.277169] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-21T17:43:29.277422] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-21T17:43:29.277553] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-21T17:43:29.278238] [DEBUG] [LOCAL ] BTA: Trimmed 9400 records to 5770 (keeping 200 days of data) [2025-10-21T17:43:29.312214] [DEBUG] [LOCAL ] BTA: Primary data saved (5770 records). [2025-10-21T17:43:29.312415] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-21T17:43:29.312527] [INFO ] [MAIN ] Update Progress: 346/2366 symbols completed. BTA took 18.8s. Estimated remaining: 4h 13m 30s. Rate: 8.0 symbols/min [2025-10-21T17:43:29.456969] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T17:43:29.522053] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:29.532188] [DEBUG] [LOCAL ] BTO: Loaded 8905 existing records from primary storage. [2025-10-21T17:43:29.532394] [INFO ] [MAIN ] BTO: Loaded 8905 existing records. [2025-10-21T17:43:29.709292] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:29.709535] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-21T17:43:29.709589] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-21T17:43:29.709875] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-21T17:43:29.709932] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-21T17:43:29.762980] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-21T17:43:30.056807] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:30.551010] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-21T17:43:31.350997] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-21T17:43:31.458722] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T17:43:31.458449] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-21T17:43:31.461736] [DEBUG] [REMOTE ] BTI: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-21T17:43:31.473031] [WARN ] [REMOTE ] BTI: No data returned for month 2025-03 [2025-10-21T17:43:31.473875] [FATAL] [REMOTE ] BTI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:43:31.474202] [FATAL] [MAIN ] BTI: Failed to fetch primary data. [2025-10-21T17:43:31.474307] [WARN ] [MAIN ] BTI: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:43:31.474728] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-21T17:43:31.474834] [DEBUG] [LOCAL ] BTI: No primary data file found to delete. [2025-10-21T17:43:31.474894] [INFO ] [LOCAL ] BTI: Starting deletion of derivative data. [2025-10-21T17:43:31.475091] [DEBUG] [LOCAL ] BTI: Deleted derivative data file. [2025-10-21T17:43:31.475894] [INFO ] [MAIN ] Update Progress: 347/2366 symbols completed. BTI took 13.7s. Estimated remaining: 4h 12m 51s. Rate: 8.0 symbols/min [2025-10-21T17:43:31.652455] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:31.669624] [DEBUG] [LOCAL ] BTT: Loaded 15488 existing records from primary storage. [2025-10-21T17:43:31.670087] [INFO ] [MAIN ] BTT: Loaded 15488 existing records. [2025-10-21T17:43:31.794385] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T17:43:31.919970] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:31.920195] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-21T17:43:31.920254] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-21T17:43:31.920626] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-21T17:43:31.920722] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-21T17:43:32.159290] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-21T17:43:32.280160] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:32.951037] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-21T17:43:33.534990] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T17:43:33.751041] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-21T17:43:33.982073] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T17:43:34.551027] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-21T17:43:35.339387] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T17:43:35.350973] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-21T17:43:35.552906] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:43:36.070040] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T17:43:36.150989] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-21T17:43:36.951017] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-21T17:43:37.143817] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T17:43:37.751069] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-21T17:43:37.848119] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:43:37.856390] [INFO ] [REMOTE ] BSX: Full fetch complete (77861 records). [2025-10-21T17:43:37.856513] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-21T17:43:38.240775] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-21T17:43:38.240877] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-21T17:43:38.241701] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-21T17:43:38.241763] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-21T17:43:38.243134] [DEBUG] [LOCAL ] BSX: Trimmed 77861 records to 53688 (keeping 200 days of data) [2025-10-21T17:43:38.553750] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-21T17:43:38.558236] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-21T17:43:38.558347] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-21T17:43:38.559519] [INFO ] [MAIN ] Update Progress: 348/2366 symbols completed. BSX took 40.7s. Estimated remaining: 4h 12m 41s. Rate: 8.0 symbols/min [2025-10-21T17:43:38.738103] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:38.748524] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T17:43:38.798874] [DEBUG] [LOCAL ] BTU: Loaded 53336 existing records from primary storage. [2025-10-21T17:43:38.799169] [INFO ] [MAIN ] BTU: Loaded 53336 existing records. [2025-10-21T17:43:38.976212] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:38.976419] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-21T17:43:38.976467] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-21T17:43:38.977316] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-21T17:43:38.977373] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-21T17:43:39.346739] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:39.350981] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-21T17:43:40.151031] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-21T17:43:40.234426] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T17:43:40.915950] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T17:43:40.950996] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-21T17:43:41.037775] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T17:43:41.751040] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-21T17:43:41.799336] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T17:43:42.551019] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-21T17:43:43.351049] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-21T17:43:43.433797] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T17:43:43.554095] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T17:43:44.138633] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T17:43:44.150970] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-21T17:43:44.951014] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-21T17:43:44.972154] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T17:43:45.751105] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-21T17:43:46.532966] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T17:43:46.550985] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-21T17:43:46.860138] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:43:47.351029] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-21T17:43:48.045045] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T17:43:48.061095] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T17:43:48.151004] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-21T17:43:48.951004] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-21T17:43:49.751058] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-21T17:43:49.855604] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:43:49.857703] [INFO ] [REMOTE ] BTO: Full fetch complete (13276 records). [2025-10-21T17:43:49.857772] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-21T17:43:49.994182] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:43:50.044493] [INFO ] [REMOTE ] BTE: Full fetch complete (75982 records). [2025-10-21T17:43:50.060430] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-21T17:43:50.109430] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:43:50.147275] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:43:50.168628] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:43:50.168837] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-21T17:43:50.168963] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-21T17:43:50.174609] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-21T17:43:50.210959] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-21T17:43:50.226467] [INFO ] [MAIN ] Update Progress: 349/2366 symbols completed. BTE took 34.4s. Estimated remaining: 4h 12m 58s. Rate: 8.0 symbols/min [2025-10-21T17:43:50.289122] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-21T17:43:50.302199] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-21T17:43:50.316568] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-21T17:43:50.325672] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-21T17:43:50.362089] [DEBUG] [LOCAL ] BTO: Trimmed 13276 records to 8841 (keeping 200 days of data) [2025-10-21T17:43:50.475066] [DEBUG] [LOCAL ] BTO: Primary data saved (8841 records). [2025-10-21T17:43:50.475204] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-21T17:43:50.476060] [INFO ] [MAIN ] Update Progress: 350/2366 symbols completed. BTO took 21.2s. Estimated remaining: 4h 12m 8s. Rate: 8.0 symbols/min [2025-10-21T17:43:50.539365] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:50.559882] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-21T17:43:50.560129] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-21T17:43:50.559971] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-21T17:43:50.577753] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-21T17:43:50.600521] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-21T17:43:50.600690] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-21T17:43:50.601053] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-21T17:43:50.751578] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:50.968438] [DEBUG] [LOCAL ] BTZ: Loaded 22556 existing records from primary storage. [2025-10-21T17:43:50.979189] [INFO ] [MAIN ] BTZ: Loaded 22556 existing records. [2025-10-21T17:43:51.184502] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:51.245996] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:51.246224] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-21T17:43:51.246298] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-21T17:43:51.246833] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-21T17:43:51.246894] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-21T17:43:51.356120] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-21T17:43:51.604531] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:51.634789] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:43:51.635028] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-21T17:43:51.635115] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:43:51.635182] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-21T17:43:51.635246] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:43:51.635315] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-21T17:43:51.635375] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-21T17:43:51.635411] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-21T17:43:51.635450] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-21T17:43:51.635495] [INFO ] [MAIN ] Update Progress: 351/2366 symbols completed. BTX took 1.4s. Estimated remaining: 4h 11m 24s. Rate: 8.0 symbols/min [2025-10-21T17:43:51.787151] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T17:43:51.836432] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:43:51.850098] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T17:43:51.912113] [DEBUG] [LOCAL ] BUD: Loaded 52605 existing records from primary storage. [2025-10-21T17:43:51.912389] [INFO ] [MAIN ] BUD: Loaded 52605 existing records. [2025-10-21T17:43:52.090175] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:43:52.090361] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-21T17:43:52.090408] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-21T17:43:52.091271] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-21T17:43:52.091328] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-21T17:43:52.156215] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-21T17:43:52.448210] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:43:52.951071] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-21T17:43:53.334507] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T17:43:53.751050] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-21T17:43:54.551103] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-21T17:43:54.735163] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:43:54.772188] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T17:43:55.351071] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-21T17:43:56.151060] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-21T17:43:56.300477] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T17:43:56.479480] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:43:56.951048] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-21T17:43:57.751063] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-21T17:43:58.053638] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T17:43:58.463936] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-21T17:43:58.550988] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-21T17:43:59.351049] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-21T17:43:59.501746] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T17:43:59.945237] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T17:44:00.069475] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:44:00.151010] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-21T17:44:00.951027] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-21T17:44:01.751047] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-21T17:44:02.176269] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T17:44:02.199868] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T17:44:02.551040] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-21T17:44:03.035578] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T17:44:03.037893] [INFO ] [REMOTE ] BTT: Full fetch complete (22501 records). [2025-10-21T17:44:03.037963] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-21T17:44:03.356157] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-21T17:44:03.421553] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-21T17:44:03.421633] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-21T17:44:03.422119] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-21T17:44:03.422167] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-21T17:44:03.422823] [DEBUG] [LOCAL ] BTT: Trimmed 22501 records to 15421 (keeping 200 days of data) [2025-10-21T17:44:03.514390] [DEBUG] [LOCAL ] BTT: Primary data saved (15421 records). [2025-10-21T17:44:03.514523] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-21T17:44:03.514597] [INFO ] [MAIN ] Update Progress: 352/2366 symbols completed. BTT took 32.0s. Estimated remaining: 4h 11m 42s. Rate: 8.0 symbols/min [2025-10-21T17:44:03.683401] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:03.695782] [DEBUG] [LOCAL ] BUI: Loaded 11949 existing records from primary storage. [2025-10-21T17:44:03.696020] [INFO ] [MAIN ] BUI: Loaded 11949 existing records. [2025-10-21T17:44:03.875390] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:03.876340] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-21T17:44:03.876627] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-21T17:44:03.892921] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-21T17:44:03.893567] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:44:03.893687] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-21T17:44:04.156236] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-21T17:44:04.324039] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:04.951036] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-21T17:44:05.605947] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-21T17:44:05.750993] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-21T17:44:06.011671] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T17:44:06.550990] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-21T17:44:07.043676] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-10-21T17:44:07.095613] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T17:44:07.350995] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-21T17:44:07.634639] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T17:44:08.079631] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T17:44:08.150999] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-21T17:44:08.951008] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-21T17:44:09.010267] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T17:44:09.751038] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-21T17:44:10.550991] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-21T17:44:10.995244] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T17:44:11.083416] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:44:11.351003] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-21T17:44:11.553869] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T17:44:12.151025] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-21T17:44:12.939320] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T17:44:12.950970] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-21T17:44:13.219888] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T17:44:13.751055] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-21T17:44:13.843792] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-21T17:44:14.551000] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-21T17:44:14.953877] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:44:15.351034] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-21T17:44:16.151005] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-21T17:44:16.319447] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T17:44:16.923108] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-21T17:44:16.931541] [INFO ] [REMOTE ] BTU: Full fetch complete (77296 records). [2025-10-21T17:44:16.931740] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-21T17:44:16.963065] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-21T17:44:17.344076] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-21T17:44:17.344164] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-21T17:44:17.345093] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-21T17:44:17.345160] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-21T17:44:17.346671] [DEBUG] [LOCAL ] BTU: Trimmed 77296 records to 53337 (keeping 200 days of data) [2025-10-21T17:44:17.452799] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T17:44:17.678182] [DEBUG] [LOCAL ] BTU: Primary data saved (53337 records). [2025-10-21T17:44:17.678319] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-21T17:44:17.678916] [INFO ] [MAIN ] Update Progress: 353/2366 symbols completed. BTU took 39.1s. Estimated remaining: 4h 12m 12s. Rate: 8.0 symbols/min [2025-10-21T17:44:17.757141] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-21T17:44:17.861029] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:17.876354] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T17:44:17.920514] [DEBUG] [LOCAL ] BUR: Loaded 45494 existing records from primary storage. [2025-10-21T17:44:17.920864] [INFO ] [MAIN ] BUR: Loaded 45494 existing records. [2025-10-21T17:44:18.094210] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:18.094398] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-21T17:44:18.094443] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-21T17:44:18.095268] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-21T17:44:18.095326] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-21T17:44:18.449325] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:18.550990] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-21T17:44:18.651007] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T17:44:19.351077] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-21T17:44:19.407483] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T17:44:20.151050] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-21T17:44:20.950996] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-21T17:44:21.318610] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T17:44:21.499617] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T17:44:21.751027] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-21T17:44:22.176536] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T17:44:22.179090] [INFO ] [REMOTE ] BUI: Full fetch complete (16577 records). [2025-10-21T17:44:22.179183] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-21T17:44:22.568423] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-21T17:44:22.579559] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-21T17:44:22.579631] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-21T17:44:22.580097] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-21T17:44:22.580173] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-21T17:44:22.580906] [DEBUG] [LOCAL ] BUI: Trimmed 16577 records to 11926 (keeping 200 days of data) [2025-10-21T17:44:22.656234] [DEBUG] [LOCAL ] BUI: Primary data saved (11926 records). [2025-10-21T17:44:22.656355] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-21T17:44:22.656426] [INFO ] [MAIN ] Update Progress: 354/2366 symbols completed. BUI took 19.1s. Estimated remaining: 4h 11m 50s. Rate: 8.0 symbols/min [2025-10-21T17:44:22.820474] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:22.862439] [DEBUG] [LOCAL ] BURL: Loaded 45583 existing records from primary storage. [2025-10-21T17:44:22.862753] [INFO ] [MAIN ] BURL: Loaded 45583 existing records. [2025-10-21T17:44:23.033953] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:23.034160] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-21T17:44:23.034226] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-21T17:44:23.035062] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-21T17:44:23.035124] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-21T17:44:23.360009] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-21T17:44:23.388997] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:23.555125] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T17:44:24.143205] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T17:44:24.151055] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-21T17:44:24.641213] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T17:44:24.951072] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-21T17:44:25.562983] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:44:25.751076] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-21T17:44:26.474619] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T17:44:26.551015] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-21T17:44:27.350997] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-21T17:44:27.623772] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T17:44:28.152229] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-21T17:44:28.157163] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T17:44:28.927130] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T17:44:28.951009] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-21T17:44:29.647204] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:44:29.651401] [INFO ] [REMOTE ] BTZ: Full fetch complete (33360 records). [2025-10-21T17:44:29.651532] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-21T17:44:29.757846] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-21T17:44:30.036242] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-21T17:44:30.036315] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-21T17:44:30.036805] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-21T17:44:30.036865] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-21T17:44:30.037556] [DEBUG] [LOCAL ] BTZ: Trimmed 33360 records to 22540 (keeping 200 days of data) [2025-10-21T17:44:30.173579] [DEBUG] [LOCAL ] BTZ: Primary data saved (22540 records). [2025-10-21T17:44:30.173723] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-21T17:44:30.173809] [INFO ] [MAIN ] Update Progress: 355/2366 symbols completed. BTZ took 39.7s. Estimated remaining: 4h 11m 43s. Rate: 8.0 symbols/min [2025-10-21T17:44:30.370228] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:30.386129] [DEBUG] [LOCAL ] BUXX: Loaded 15466 existing records from primary storage. [2025-10-21T17:44:30.386345] [INFO ] [MAIN ] BUXX: Loaded 15466 existing records. [2025-10-21T17:44:30.552329] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-21T17:44:30.595616] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:30.596580] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-21T17:44:30.596770] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-21T17:44:30.597288] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-21T17:44:30.597406] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-21T17:44:30.875756] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T17:44:31.003563] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:31.351009] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-21T17:44:31.932995] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T17:44:31.985497] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T17:44:32.151004] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-21T17:44:32.411825] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:44:32.951047] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-21T17:44:33.683861] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T17:44:33.750995] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-21T17:44:33.870353] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T17:44:34.551046] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-21T17:44:35.351061] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-21T17:44:35.415976] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T17:44:35.519637] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T17:44:36.151073] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-21T17:44:36.951079] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-21T17:44:37.185979] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T17:44:37.335216] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T17:44:37.343682] [INFO ] [REMOTE ] BUD: Full fetch complete (76491 records). [2025-10-21T17:44:37.343805] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-21T17:44:37.732210] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-21T17:44:37.732308] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-21T17:44:37.733140] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-21T17:44:37.733207] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-21T17:44:37.734623] [DEBUG] [LOCAL ] BUD: Trimmed 76491 records to 52604 (keeping 200 days of data) [2025-10-21T17:44:37.785203] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-21T17:44:38.042235] [DEBUG] [LOCAL ] BUD: Primary data saved (52604 records). [2025-10-21T17:44:38.043185] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-21T17:44:38.043287] [INFO ] [MAIN ] Update Progress: 356/2366 symbols completed. BUD took 46.4s. Estimated remaining: 4h 11m 38s. Rate: 8.0 symbols/min [2025-10-21T17:44:38.224818] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:44:38.259662] [DEBUG] [LOCAL ] BV: Loaded 38556 existing records from primary storage. [2025-10-21T17:44:38.259948] [INFO ] [MAIN ] BV: Loaded 38556 existing records. [2025-10-21T17:44:38.442006] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:44:38.442290] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-21T17:44:38.442491] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-21T17:44:38.443232] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-21T17:44:38.443295] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-21T17:44:38.554768] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-21T17:44:38.629878] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T17:44:38.852720] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:44:39.350995] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-21T17:44:39.630543] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T17:44:39.788777] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T17:44:40.151075] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-21T17:44:40.608975] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T17:44:40.950998] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-21T17:44:41.187176] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T17:44:41.751102] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-21T17:44:42.274302] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:44:42.551042] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-21T17:44:43.351059] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-21T17:44:43.460383] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T17:44:44.151100] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-21T17:44:44.198463] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T17:44:44.517827] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T17:44:44.951088] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-21T17:44:45.754040] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-21T17:44:45.759341] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:44:46.447896] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:44:46.550986] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-21T17:44:46.957544] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T17:44:47.351039] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-21T17:44:48.151012] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-21T17:44:48.198405] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:44:48.741424] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T17:44:48.942464] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T17:44:48.950983] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-21T17:44:49.750997] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-21T17:44:49.867291] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T17:44:50.551029] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-21T17:44:51.290990] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T17:44:51.350992] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-21T17:44:51.566692] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:44:51.570583] [INFO ] [REMOTE ] BUXX: Full fetch complete (20728 records). [2025-10-21T17:44:51.570699] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-21T17:44:51.979017] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-21T17:44:51.979146] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-21T17:44:51.979695] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-21T17:44:51.979758] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-21T17:44:51.980587] [DEBUG] [LOCAL ] BUXX: Trimmed 20728 records to 15430 (keeping 200 days of data) [2025-10-21T17:44:52.080414] [DEBUG] [LOCAL ] BUXX: Primary data saved (15430 records). [2025-10-21T17:44:52.080548] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-21T17:44:52.080625] [INFO ] [MAIN ] Update Progress: 357/2366 symbols completed. BUXX took 21.9s. Estimated remaining: 4h 12m 7s. Rate: 8.0 symbols/min [2025-10-21T17:44:52.151002] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-21T17:44:52.891728] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T17:44:52.951056] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-21T17:44:53.751101] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-21T17:44:54.084218] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T17:44:54.551013] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-21T17:44:54.979568] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T17:44:54.987729] [INFO ] [REMOTE ] BURL: Full fetch complete (65820 records). [2025-10-21T17:44:54.987957] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-21T17:44:55.175478] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T17:44:55.356114] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-21T17:44:55.449003] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-21T17:44:55.449118] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-21T17:44:55.450224] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-21T17:44:55.450307] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-21T17:44:55.452462] [DEBUG] [LOCAL ] BURL: Trimmed 65820 records to 45509 (keeping 200 days of data) [2025-10-21T17:44:55.740203] [DEBUG] [LOCAL ] BURL: Primary data saved (45509 records). [2025-10-21T17:44:55.740384] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-21T17:44:55.741281] [INFO ] [MAIN ] Update Progress: 358/2366 symbols completed. BURL took 33.1s. Estimated remaining: 4h 11m 38s. Rate: 8.0 symbols/min [2025-10-21T17:44:55.920864] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T17:44:55.929300] [INFO ] [REMOTE ] BUR: Full fetch complete (64423 records). [2025-10-21T17:44:55.929435] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-21T17:44:56.375188] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-21T17:44:56.375285] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-21T17:44:56.376149] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-21T17:44:56.376237] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-21T17:44:56.377625] [DEBUG] [LOCAL ] BUR: Trimmed 64423 records to 45478 (keeping 200 days of data) [2025-10-21T17:44:56.656034] [DEBUG] [LOCAL ] BUR: Primary data saved (45478 records). [2025-10-21T17:44:56.656230] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-21T17:44:56.656632] [INFO ] [MAIN ] Update Progress: 359/2366 symbols completed. BUR took 39.0s. Estimated remaining: 4h 10m 53s. Rate: 8.0 symbols/min [2025-10-21T17:44:56.886155] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:44:56.894802] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-21T17:44:58.463446] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T17:44:58.473458] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-21T17:44:59.733210] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T17:44:59.742088] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-21T17:45:01.449977] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:45:01.456263] [INFO ] [REMOTE ] BV: Full fetch complete (54908 records). [2025-10-21T17:45:01.456379] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-21T17:45:01.868779] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-21T17:45:01.868883] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-21T17:45:01.869876] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-21T17:45:01.869942] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-21T17:45:01.871222] [DEBUG] [LOCAL ] BV: Trimmed 54908 records to 38499 (keeping 200 days of data) [2025-10-21T17:45:02.121919] [DEBUG] [LOCAL ] BV: Primary data saved (38499 records). [2025-10-21T17:45:02.122074] [INFO ] [MAIN ] BV: Full history saved. [2025-10-21T17:45:02.122178] [INFO ] [MAIN ] Update Progress: 360/2366 symbols completed. BV took 24.1s. Estimated remaining: 4h 10m 34s. Rate: 8.0 symbols/min [2025-10-21T17:45:02.815135] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:02.841808] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:02.933785] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:02.953749] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:02.969366] [DEBUG] [LOCAL ] BWG: Loaded 12624 existing records from primary storage. [2025-10-21T17:45:02.969836] [INFO ] [MAIN ] BWG: Loaded 12624 existing records. [2025-10-21T17:45:03.170789] [DEBUG] [LOCAL ] BVN: Loaded 44477 existing records from primary storage. [2025-10-21T17:45:03.209042] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:03.220866] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-21T17:45:03.223088] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-21T17:45:03.222869] [INFO ] [MAIN ] BVN: Loaded 44477 existing records. [2025-10-21T17:45:03.228624] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-21T17:45:03.258114] [DEBUG] [LOCAL ] BW: Loaded 40452 existing records from primary storage. [2025-10-21T17:45:03.284011] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-21T17:45:03.308542] [INFO ] [MAIN ] BW: Loaded 40452 existing records. [2025-10-21T17:45:03.418051] [DEBUG] [LOCAL ] BWA: Loaded 52108 existing records from primary storage. [2025-10-21T17:45:03.452237] [INFO ] [MAIN ] BWA: Loaded 52108 existing records. [2025-10-21T17:45:03.699838] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:03.715761] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-21T17:45:03.772514] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-21T17:45:03.821276] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-21T17:45:03.846501] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-21T17:45:04.017959] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:04.047229] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-21T17:45:04.056849] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-21T17:45:04.184034] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-21T17:45:04.211634] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-21T17:45:04.260534] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:04.277090] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-21T17:45:04.328944] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-21T17:45:04.536476] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-21T17:45:04.536632] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-21T17:45:04.541262] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:04.580044] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-21T17:45:04.983450] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:05.023633] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-21T17:45:05.360503] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:05.377381] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-21T17:45:05.380729] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:05.381773] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-21T17:45:05.776845] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T17:45:05.780406] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-21T17:45:06.641857] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T17:45:06.644408] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-21T17:45:07.097675] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T17:45:07.106004] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-21T17:45:07.287344] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T17:45:07.295830] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-21T17:45:07.336062] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T17:45:07.346318] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-21T17:45:07.395314] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T17:45:07.397596] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-21T17:45:08.299092] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T17:45:08.302060] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-21T17:45:08.530569] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:45:08.540686] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-21T17:45:08.791369] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T17:45:08.801233] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-21T17:45:08.902082] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T17:45:08.951032] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-21T17:45:09.350471] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-21T17:45:09.433864] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T17:45:09.751104] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-21T17:45:10.379295] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:45:10.461940] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T17:45:10.551030] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-21T17:45:10.854738] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T17:45:11.351026] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-21T17:45:12.151037] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-21T17:45:12.248747] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T17:45:12.444189] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T17:45:12.951025] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-21T17:45:13.634794] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:45:13.751000] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-21T17:45:14.206885] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T17:45:14.551085] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-21T17:45:15.351031] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-21T17:45:15.568740] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T17:45:16.135265] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T17:45:16.151003] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-21T17:45:16.951003] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-21T17:45:16.968912] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T17:45:16.970625] [INFO ] [REMOTE ] BWG: Full fetch complete (17716 records). [2025-10-21T17:45:16.970721] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-21T17:45:17.340098] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-21T17:45:17.340173] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-21T17:45:17.340572] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-21T17:45:17.340615] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-21T17:45:17.341183] [DEBUG] [LOCAL ] BWG: Trimmed 17716 records to 12632 (keeping 200 days of data) [2025-10-21T17:45:17.424788] [DEBUG] [LOCAL ] BWG: Primary data saved (12632 records). [2025-10-21T17:45:17.424973] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-21T17:45:17.425102] [INFO ] [MAIN ] Update Progress: 361/2366 symbols completed. BWG took 15.3s. Estimated remaining: 4h 11m 10s. Rate: 8.0 symbols/min [2025-10-21T17:45:17.631288] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:17.661971] [DEBUG] [LOCAL ] BWLP: Loaded 32227 existing records from primary storage. [2025-10-21T17:45:17.662248] [INFO ] [MAIN ] BWLP: Loaded 32227 existing records. [2025-10-21T17:45:17.756229] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-21T17:45:17.845039] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:17.845276] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-21T17:45:17.845325] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-21T17:45:17.845922] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-21T17:45:17.845981] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-21T17:45:18.242589] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:18.263466] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T17:45:18.551091] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-21T17:45:19.099284] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T17:45:19.350998] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-21T17:45:19.466093] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T17:45:19.901566] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T17:45:20.151021] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-21T17:45:20.951055] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-21T17:45:21.071331] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T17:45:21.757177] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-21T17:45:21.762793] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T17:45:22.430863] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T17:45:22.551028] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-21T17:45:23.351020] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-21T17:45:23.479153] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T17:45:23.954548] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:45:24.151078] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-21T17:45:24.951014] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-21T17:45:25.046494] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:45:25.706795] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T17:45:25.751019] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-21T17:45:26.551013] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-21T17:45:26.736948] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:45:27.351021] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-21T17:45:27.437947] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T17:45:27.890212] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:45:28.151114] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-21T17:45:28.951004] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-21T17:45:29.145180] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:45:29.575536] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T17:45:29.751033] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-21T17:45:30.551008] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-21T17:45:30.963194] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-21T17:45:31.351039] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-21T17:45:32.131184] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (2.38 seconds). [2025-10-21T17:45:32.139001] [INFO ] [REMOTE ] BW: Full fetch complete (59373 records). [2025-10-21T17:45:32.139141] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-21T17:45:32.174624] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-21T17:45:32.549570] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-21T17:45:32.549740] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-21T17:45:32.550477] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-21T17:45:32.550556] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-21T17:45:32.551834] [DEBUG] [LOCAL ] BW: Trimmed 59373 records to 40403 (keeping 200 days of data) [2025-10-21T17:45:32.773060] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:45:32.805066] [DEBUG] [LOCAL ] BW: Primary data saved (40403 records). [2025-10-21T17:45:32.805312] [INFO ] [MAIN ] BW: Full history saved. [2025-10-21T17:45:32.805417] [INFO ] [MAIN ] Update Progress: 362/2366 symbols completed. BW took 30.7s. Estimated remaining: 4h 11m 46s. Rate: 8.0 symbols/min [2025-10-21T17:45:32.952023] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-21T17:45:32.946785] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (2.40 seconds). [2025-10-21T17:45:33.007601] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:33.008863] [INFO ] [REMOTE ] BVN: Full fetch complete (63089 records). [2025-10-21T17:45:33.008987] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-21T17:45:33.009921] [FATAL] [VALIDATOR ] BVN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:45:33.010004] [FATAL] [MAIN ] BVN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:45:33.010046] [WARN ] [MAIN ] BVN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:45:33.010113] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-21T17:45:33.010176] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-21T17:45:33.010211] [INFO ] [LOCAL ] BVN: Starting deletion of derivative data. [2025-10-21T17:45:33.010467] [DEBUG] [LOCAL ] BVN: Deleted derivative data file. [2025-10-21T17:45:33.010566] [INFO ] [MAIN ] Update Progress: 363/2366 symbols completed. BVN took 30.9s. Estimated remaining: 4h 10m 58s. Rate: 8.0 symbols/min [2025-10-21T17:45:33.116446] [DEBUG] [LOCAL ] BWMX: Loaded 7887 existing records from primary storage. [2025-10-21T17:45:33.119560] [INFO ] [MAIN ] BWMX: Loaded 7887 existing records. [2025-10-21T17:45:33.302771] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:33.378357] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:33.381242] [DEBUG] [LOCAL ] BWNB: Loaded 4101 existing records from primary storage. [2025-10-21T17:45:33.381552] [INFO ] [MAIN ] BWNB: Loaded 4101 existing records. [2025-10-21T17:45:33.412978] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-21T17:45:33.445620] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-21T17:45:33.473707] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-21T17:45:33.484472] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-21T17:45:33.679487] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:33.685268] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-21T17:45:33.690481] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-21T17:45:33.701033] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-21T17:45:33.701302] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-21T17:45:34.102678] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:34.144490] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-21T17:45:34.344293] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-21T17:45:34.357524] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:34.551035] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-21T17:45:34.927356] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T17:45:35.289342] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:45:35.351028] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-21T17:45:35.858034] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-21T17:45:36.151042] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-21T17:45:36.475578] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T17:45:36.484188] [INFO ] [REMOTE ] BWA: Full fetch complete (75892 records). [2025-10-21T17:45:36.484317] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-21T17:45:36.751577] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T17:45:36.885338] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-21T17:45:36.885420] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-21T17:45:36.886249] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-21T17:45:36.886311] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-21T17:45:36.887698] [DEBUG] [LOCAL ] BWA: Trimmed 75892 records to 52084 (keeping 200 days of data) [2025-10-21T17:45:36.973279] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-21T17:45:37.198716] [DEBUG] [LOCAL ] BWA: Primary data saved (52084 records). [2025-10-21T17:45:37.198861] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-21T17:45:37.198943] [INFO ] [MAIN ] Update Progress: 364/2366 symbols completed. BWA took 35.1s. Estimated remaining: 4h 10m 32s. Rate: 8.0 symbols/min [2025-10-21T17:45:37.369301] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:37.376123] [DEBUG] [LOCAL ] BWSN: Loaded 5120 existing records from primary storage. [2025-10-21T17:45:37.376362] [INFO ] [MAIN ] BWSN: Loaded 5120 existing records. [2025-10-21T17:45:37.558151] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:37.558374] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-21T17:45:37.558421] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-21T17:45:37.558697] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-21T17:45:37.558753] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-21T17:45:37.761297] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-21T17:45:37.936484] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:37.956066] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T17:45:38.458312] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T17:45:38.551030] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-21T17:45:39.067983] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T17:45:39.351041] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-21T17:45:40.151022] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-21T17:45:40.736096] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T17:45:40.912234] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T17:45:40.951038] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-21T17:45:41.699294] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T17:45:41.751037] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-21T17:45:42.551039] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-21T17:45:42.654944] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T17:45:43.351020] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-21T17:45:43.914359] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:45:44.136518] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T17:45:44.150981] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-21T17:45:44.776491] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T17:45:44.951032] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-21T17:45:45.592325] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:45:45.751027] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-21T17:45:46.339223] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T17:45:46.551051] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-21T17:45:46.995524] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T17:45:47.351060] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-21T17:45:47.958607] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T17:45:48.151028] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-21T17:45:48.951034] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-21T17:45:49.751022] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-21T17:45:49.772428] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T17:45:49.820233] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T17:45:50.305782] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T17:45:50.551022] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-21T17:45:51.351020] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-21T17:45:51.951150] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T17:45:51.952224] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T17:45:52.151030] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-21T17:45:52.649554] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-21T17:45:52.951043] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-21T17:45:53.553444] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T17:45:53.751033] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-21T17:45:54.332976] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T17:45:54.551058] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-21T17:45:55.351030] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-21T17:45:55.951956] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T17:45:55.956905] [INFO ] [REMOTE ] BWLP: Full fetch complete (47605 records). [2025-10-21T17:45:55.956983] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-21T17:45:55.957507] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:45:55.957587] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:45:55.957628] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:45:55.957713] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-21T17:45:55.957773] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-21T17:45:55.957806] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-10-21T17:45:55.957956] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-10-21T17:45:55.958038] [INFO ] [MAIN ] Update Progress: 365/2366 symbols completed. BWLP took 38.5s. Estimated remaining: 4h 11m 26s. Rate: 8.0 symbols/min [2025-10-21T17:45:56.063365] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T17:45:56.065334] [INFO ] [REMOTE ] BWMX: Full fetch complete (9939 records). [2025-10-21T17:45:56.076262] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-21T17:45:56.152979] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-21T17:45:56.210415] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:56.587536] [DEBUG] [LOCAL ] BWXT: Loaded 47285 existing records from primary storage. [2025-10-21T17:45:56.594462] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-21T17:45:56.594737] [INFO ] [MAIN ] BWXT: Loaded 47285 existing records. [2025-10-21T17:45:56.599995] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-21T17:45:56.600383] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-21T17:45:56.619752] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-21T17:45:56.691513] [DEBUG] [LOCAL ] BWMX: Trimmed 9939 records to 7868 (keeping 200 days of data) [2025-10-21T17:45:56.846010] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:56.849894] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-21T17:45:56.850017] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-21T17:45:56.857835] [DEBUG] [LOCAL ] BWMX: Primary data saved (7868 records). [2025-10-21T17:45:56.858076] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-21T17:45:56.858265] [INFO ] [MAIN ] Update Progress: 366/2366 symbols completed. BWMX took 24.1s. Estimated remaining: 4h 10m 43s. Rate: 8.0 symbols/min [2025-10-21T17:45:56.870209] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-21T17:45:56.870399] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-21T17:45:56.888802] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T17:45:56.974050] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-21T17:45:57.274876] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:45:57.479112] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:57.517354] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-21T17:45:57.517708] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-21T17:45:57.626015] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T17:45:57.703102] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:45:57.703359] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-21T17:45:57.703406] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-21T17:45:57.704166] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-21T17:45:57.704224] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-21T17:45:57.756166] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-21T17:45:58.057085] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:45:58.463324] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T17:45:58.551037] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-21T17:45:59.351032] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-21T17:46:00.151026] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-21T17:46:00.295787] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:46:00.341696] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T17:46:00.342940] [INFO ] [REMOTE ] BWNB: Full fetch complete (5588 records). [2025-10-21T17:46:00.343022] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-21T17:46:00.756696] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-21T17:46:00.756801] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-21T17:46:00.757011] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-21T17:46:00.757053] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-21T17:46:00.757559] [DEBUG] [LOCAL ] BWNB: Trimmed 5588 records to 4079 (keeping 200 days of data) [2025-10-21T17:46:00.783493] [DEBUG] [LOCAL ] BWNB: Primary data saved (4079 records). [2025-10-21T17:46:00.783625] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-21T17:46:00.783741] [INFO ] [MAIN ] Update Progress: 367/2366 symbols completed. BWNB took 27.8s. Estimated remaining: 4h 10m 16s. Rate: 8.0 symbols/min [2025-10-21T17:46:00.950964] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:00.951039] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-21T17:46:00.968250] [DEBUG] [LOCAL ] BXC: Loaded 13571 existing records from primary storage. [2025-10-21T17:46:00.968500] [INFO ] [MAIN ] BXC: Loaded 13571 existing records. [2025-10-21T17:46:01.144148] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:01.144382] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-21T17:46:01.144429] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-21T17:46:01.144603] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-21T17:46:01.144709] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-21T17:46:01.441042] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T17:46:01.521661] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:01.751052] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-21T17:46:02.300878] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T17:46:02.551017] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-21T17:46:02.645877] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-21T17:46:03.351065] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-21T17:46:03.673187] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T17:46:03.899401] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T17:46:04.151018] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-21T17:46:04.950988] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-21T17:46:05.021141] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T17:46:05.022443] [INFO ] [REMOTE ] BWSN: Full fetch complete (6342 records). [2025-10-21T17:46:05.022510] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-21T17:46:05.022881] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:46:05.022965] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:46:05.023042] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:46:05.023114] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-21T17:46:05.023175] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-10-21T17:46:05.023210] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-10-21T17:46:05.023356] [DEBUG] [LOCAL ] BWSN: Deleted derivative data file. [2025-10-21T17:46:05.023441] [INFO ] [MAIN ] Update Progress: 368/2366 symbols completed. BWSN took 27.8s. Estimated remaining: 4h 9m 50s. Rate: 8.0 symbols/min [2025-10-21T17:46:05.193123] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:05.235475] [DEBUG] [LOCAL ] BXMT: Loaded 47292 existing records from primary storage. [2025-10-21T17:46:05.235805] [INFO ] [MAIN ] BXMT: Loaded 47292 existing records. [2025-10-21T17:46:05.412188] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:05.412797] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-21T17:46:05.412856] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-21T17:46:05.413126] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-21T17:46:05.413162] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-21T17:46:05.787821] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:05.751971] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-21T17:46:05.790157] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T17:46:06.551064] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-21T17:46:07.351001] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-21T17:46:07.451472] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T17:46:07.744008] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-21T17:46:08.151043] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-21T17:46:08.951065] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-21T17:46:09.082920] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T17:46:09.751002] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-21T17:46:09.822607] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T17:46:09.956754] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T17:46:10.551096] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-21T17:46:11.351035] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-21T17:46:11.678297] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T17:46:11.700785] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:46:12.151111] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-21T17:46:12.951032] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-21T17:46:13.132959] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T17:46:13.261592] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T17:46:13.751063] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-21T17:46:14.551029] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-21T17:46:14.632366] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T17:46:15.350998] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-21T17:46:15.608050] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T17:46:16.151021] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-21T17:46:16.403593] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T17:46:16.640505] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T17:46:16.951083] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-21T17:46:17.530968] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T17:46:17.751013] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-21T17:46:17.794443] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T17:46:18.551031] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-21T17:46:19.351022] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-21T17:46:19.765968] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:46:20.152569] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-21T17:46:20.154754] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:46:20.411386] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:46:20.951097] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-21T17:46:21.751063] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-21T17:46:21.824208] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:46:22.064575] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T17:46:22.066818] [INFO ] [REMOTE ] BXC: Full fetch complete (18336 records). [2025-10-21T17:46:22.066887] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-21T17:46:22.419680] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-21T17:46:22.419763] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-21T17:46:22.420154] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-21T17:46:22.420191] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-21T17:46:22.420731] [DEBUG] [LOCAL ] BXC: Trimmed 18336 records to 13531 (keeping 200 days of data) [2025-10-21T17:46:22.496718] [DEBUG] [LOCAL ] BXC: Primary data saved (13531 records). [2025-10-21T17:46:22.496838] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-21T17:46:22.496911] [INFO ] [MAIN ] Update Progress: 369/2366 symbols completed. BXC took 21.7s. Estimated remaining: 4h 10m 37s. Rate: 8.0 symbols/min [2025-10-21T17:46:22.563770] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-21T17:46:22.671749] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:22.690795] [DEBUG] [LOCAL ] BXMX: Loaded 19355 existing records from primary storage. [2025-10-21T17:46:22.691023] [INFO ] [MAIN ] BXMX: Loaded 19355 existing records. [2025-10-21T17:46:22.886989] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:22.887182] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-21T17:46:22.887227] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-21T17:46:22.887709] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-21T17:46:22.887766] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-21T17:46:23.242201] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:23.320538] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T17:46:23.350982] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-21T17:46:24.151082] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-21T17:46:24.516572] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T17:46:24.537788] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T17:46:24.951016] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-21T17:46:25.751049] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-21T17:46:26.254001] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T17:46:26.551033] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-21T17:46:26.912348] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T17:46:27.045337] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T17:46:27.324533] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:46:27.350981] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-21T17:46:28.151028] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-21T17:46:28.244111] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T17:46:28.951072] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-21T17:46:29.756174] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-21T17:46:29.761972] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T17:46:30.551079] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-21T17:46:30.984974] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T17:46:31.351060] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-21T17:46:31.590415] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:46:32.151019] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-21T17:46:32.233360] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T17:46:32.951048] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-21T17:46:33.255475] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T17:46:33.746604] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T17:46:33.751564] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-21T17:46:34.120636] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T17:46:34.551075] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-21T17:46:35.351094] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-21T17:46:35.949414] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-21T17:46:35.957272] [INFO ] [REMOTE ] BWXT: Full fetch complete (68071 records). [2025-10-21T17:46:35.957431] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-21T17:46:36.163380] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-21T17:46:36.282498] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T17:46:36.378608] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-21T17:46:36.378707] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-21T17:46:36.379432] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-21T17:46:36.379478] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-21T17:46:36.380719] [DEBUG] [LOCAL ] BWXT: Trimmed 68071 records to 47258 (keeping 200 days of data) [2025-10-21T17:46:36.669468] [DEBUG] [LOCAL ] BWXT: Primary data saved (47258 records). [2025-10-21T17:46:36.669689] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-21T17:46:36.669785] [INFO ] [MAIN ] Update Progress: 370/2366 symbols completed. BWXT took 40.7s. Estimated remaining: 4h 11m 5s. Rate: 7.9 symbols/min [2025-10-21T17:46:36.872476] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-21T17:46:36.874055] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:36.874277] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-10-21T17:46:36.882131] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-10-21T17:46:36.882373] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-21T17:46:36.882429] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-21T17:46:36.882473] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-21T17:46:36.882506] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-21T17:46:36.926671] [INFO ] [REMOTE ] BX: Full fetch complete (77596 records). [2025-10-21T17:46:36.949024] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-21T17:46:36.960195] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-21T17:46:37.602355] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:37.679220] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-21T17:46:37.679385] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-21T17:46:37.680394] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-21T17:46:37.680474] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-21T17:46:37.705202] [DEBUG] [LOCAL ] BX: Trimmed 77596 records to 53483 (keeping 200 days of data) [2025-10-21T17:46:37.706875] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T17:46:37.770627] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-21T17:46:38.040668] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-21T17:46:38.040886] [INFO ] [MAIN ] BX: Full history saved. [2025-10-21T17:46:38.041691] [INFO ] [MAIN ] Update Progress: 371/2366 symbols completed. BX took 41.2s. Estimated remaining: 4h 10m 24s. Rate: 8.0 symbols/min [2025-10-21T17:46:38.211340] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:38.224130] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T17:46:38.267010] [DEBUG] [LOCAL ] BXSL: Loaded 48208 existing records from primary storage. [2025-10-21T17:46:38.267289] [INFO ] [MAIN ] BXSL: Loaded 48208 existing records. [2025-10-21T17:46:38.444955] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:38.445165] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-21T17:46:38.445222] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-21T17:46:38.445478] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-21T17:46:38.445514] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-21T17:46:38.556216] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-21T17:46:38.795905] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:39.351073] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-21T17:46:39.678892] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T17:46:40.151069] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-21T17:46:40.206619] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T17:46:40.512451] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:46:40.951051] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-21T17:46:41.751028] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-21T17:46:41.858765] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T17:46:41.926335] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T17:46:42.551078] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-21T17:46:43.351039] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-21T17:46:43.455299] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T17:46:43.463134] [INFO ] [REMOTE ] BXMT: Full fetch complete (69883 records). [2025-10-21T17:46:43.463248] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-21T17:46:43.860747] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-21T17:46:43.860948] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-21T17:46:43.861866] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-21T17:46:43.861929] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-21T17:46:43.863215] [DEBUG] [LOCAL ] BXMT: Trimmed 69883 records to 47278 (keeping 200 days of data) [2025-10-21T17:46:44.151439] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-21T17:46:44.180136] [DEBUG] [LOCAL ] BXMT: Primary data saved (47278 records). [2025-10-21T17:46:44.180312] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-21T17:46:44.181172] [INFO ] [MAIN ] Update Progress: 372/2366 symbols completed. BXMT took 39.2s. Estimated remaining: 4h 10m 9s. Rate: 8.0 symbols/min [2025-10-21T17:46:44.183872] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:46:44.361113] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:44.383408] [DEBUG] [LOCAL ] BY: Loaded 21868 existing records from primary storage. [2025-10-21T17:46:44.383678] [INFO ] [MAIN ] BY: Loaded 21868 existing records. [2025-10-21T17:46:44.563999] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:46:44.564220] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-21T17:46:44.564265] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-21T17:46:44.564464] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-21T17:46:44.564518] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-21T17:46:44.941152] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:44.950980] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-21T17:46:44.995814] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T17:46:45.167369] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T17:46:45.751087] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-21T17:46:46.164720] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T17:46:46.551078] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-21T17:46:47.351018] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-21T17:46:47.466452] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:46:47.619120] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:46:48.151031] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-21T17:46:48.682193] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T17:46:48.951051] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-21T17:46:49.037635] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T17:46:49.040882] [INFO ] [REMOTE ] BXMX: Full fetch complete (28569 records). [2025-10-21T17:46:49.040969] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-21T17:46:49.407509] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-21T17:46:49.407599] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-21T17:46:49.408107] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-21T17:46:49.408182] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-21T17:46:49.408865] [DEBUG] [LOCAL ] BXMX: Trimmed 28569 records to 19175 (keeping 200 days of data) [2025-10-21T17:46:49.520489] [DEBUG] [LOCAL ] BXMX: Primary data saved (19175 records). [2025-10-21T17:46:49.520621] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-21T17:46:49.520744] [INFO ] [MAIN ] Update Progress: 373/2366 symbols completed. BXMX took 27.0s. Estimated remaining: 4h 9m 50s. Rate: 8.0 symbols/min [2025-10-21T17:46:49.687422] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:46:49.687577] [DEBUG] [LOCAL ] BYD: No existing data file found in primary storage. [2025-10-21T17:46:49.687612] [WARN ] [MAIN ] BYD: No existing data found, performing full refresh instead. [2025-10-21T17:46:49.687769] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-21T17:46:49.687859] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-21T17:46:49.687927] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-21T17:46:49.687962] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-21T17:46:49.756199] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-21T17:46:50.047554] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:46:50.551054] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-21T17:46:50.695933] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T17:46:50.729721] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T17:46:51.351019] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-21T17:46:52.150990] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-21T17:46:52.359468] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:46:52.951047] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-21T17:46:53.231894] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T17:46:53.375237] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T17:46:53.751023] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-21T17:46:54.552061] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-21T17:46:54.551832] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T17:46:54.604270] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T17:46:55.351051] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-21T17:46:56.151008] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-21T17:46:56.206634] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:46:56.594807] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T17:46:56.951023] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-21T17:46:57.676062] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:46:57.751038] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-21T17:46:58.551036] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-21T17:46:58.668368] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T17:46:58.860148] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T17:46:59.351012] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-21T17:46:59.915844] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T17:47:00.150999] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-21T17:47:00.951007] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-21T17:47:01.382112] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T17:47:01.751081] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-21T17:47:01.950672] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T17:47:02.551087] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-21T17:47:02.712737] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T17:47:03.027420] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T17:47:03.351086] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-21T17:47:04.020272] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T17:47:04.150995] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-21T17:47:04.951001] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-21T17:47:05.124960] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T17:47:05.151297] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T17:47:05.751024] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-21T17:47:06.551008] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-21T17:47:07.021072] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-21T17:47:07.209391] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T17:47:07.350994] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-21T17:47:07.662452] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T17:47:07.670819] [INFO ] [REMOTE ] BXSL: Full fetch complete (70040 records). [2025-10-21T17:47:07.670933] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-21T17:47:08.074181] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-21T17:47:08.074263] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-21T17:47:08.075035] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-21T17:47:08.075097] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-21T17:47:08.076347] [DEBUG] [LOCAL ] BXSL: Trimmed 70040 records to 48203 (keeping 200 days of data) [2025-10-21T17:47:08.163245] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-21T17:47:08.369270] [DEBUG] [LOCAL ] BXSL: Primary data saved (48203 records). [2025-10-21T17:47:08.369364] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-21T17:47:08.369437] [INFO ] [MAIN ] Update Progress: 374/2366 symbols completed. BXSL took 30.3s. Estimated remaining: 4h 10m 43s. Rate: 7.9 symbols/min [2025-10-21T17:47:08.539605] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:08.552819] [DEBUG] [LOCAL ] BYM: Loaded 11543 existing records from primary storage. [2025-10-21T17:47:08.553020] [INFO ] [MAIN ] BYM: Loaded 11543 existing records. [2025-10-21T17:47:08.738577] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:08.738786] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-21T17:47:08.738840] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-21T17:47:08.738997] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-21T17:47:08.739053] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-21T17:47:08.953484] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-21T17:47:09.112727] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:09.225420] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T17:47:09.297006] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:47:09.751015] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-21T17:47:10.551014] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-21T17:47:10.703271] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:47:10.762223] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T17:47:11.350999] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-21T17:47:12.151071] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-21T17:47:12.246342] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T17:47:12.922556] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:47:12.950985] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-21T17:47:12.980229] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:47:13.751058] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-21T17:47:14.180134] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T17:47:14.551089] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-21T17:47:14.880073] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T17:47:14.883680] [INFO ] [REMOTE ] BY: Full fetch complete (29622 records). [2025-10-21T17:47:14.883769] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-21T17:47:15.264715] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-21T17:47:15.264795] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-21T17:47:15.265241] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-21T17:47:15.265280] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-21T17:47:15.265974] [DEBUG] [LOCAL ] BY: Trimmed 29622 records to 21802 (keeping 200 days of data) [2025-10-21T17:47:15.352965] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-21T17:47:15.399176] [DEBUG] [LOCAL ] BY: Primary data saved (21802 records). [2025-10-21T17:47:15.399290] [INFO ] [MAIN ] BY: Full history saved. [2025-10-21T17:47:15.399362] [INFO ] [MAIN ] Update Progress: 375/2366 symbols completed. BY took 31.2s. Estimated remaining: 4h 10m 33s. Rate: 7.9 symbols/min [2025-10-21T17:47:15.570683] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:15.601581] [DEBUG] [LOCAL ] BZH: Loaded 32291 existing records from primary storage. [2025-10-21T17:47:15.601909] [INFO ] [MAIN ] BZH: Loaded 32291 existing records. [2025-10-21T17:47:15.784792] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:15.785014] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-21T17:47:15.785068] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-21T17:47:15.785388] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-21T17:47:15.785453] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-21T17:47:16.152811] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:16.152899] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-21T17:47:16.484499] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T17:47:16.514001] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T17:47:16.951079] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-21T17:47:17.751016] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-21T17:47:17.796913] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T17:47:17.804747] [INFO ] [REMOTE ] BXP: Full fetch complete (72240 records). [2025-10-21T17:47:17.804885] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-21T17:47:18.202682] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-21T17:47:18.202821] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-21T17:47:18.203619] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-21T17:47:18.203777] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-21T17:47:18.205083] [DEBUG] [LOCAL ] BXP: Trimmed 72240 records to 49875 (keeping 200 days of data) [2025-10-21T17:47:18.429749] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:47:18.527519] [DEBUG] [LOCAL ] BXP: Primary data saved (49875 records). [2025-10-21T17:47:18.527662] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-21T17:47:18.527753] [INFO ] [MAIN ] Update Progress: 376/2366 symbols completed. BXP took 41.9s. Estimated remaining: 4h 10m 2s. Rate: 8.0 symbols/min [2025-10-21T17:47:18.557241] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-21T17:47:18.699484] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:18.699738] [DEBUG] [LOCAL ] C: No existing data file found in primary storage. [2025-10-21T17:47:18.699784] [WARN ] [MAIN ] C: No existing data found, performing full refresh instead. [2025-10-21T17:47:18.699891] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-21T17:47:18.699930] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-21T17:47:18.699970] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-10-21T17:47:18.700005] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-21T17:47:19.052826] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:19.351076] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-21T17:47:19.493929] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T17:47:19.645105] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T17:47:19.652093] [INFO ] [REMOTE ] BYD: Full fetch complete (65381 records). [2025-10-21T17:47:19.652225] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-21T17:47:20.044918] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-21T17:47:20.044986] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-21T17:47:20.045728] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-21T17:47:20.045788] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-21T17:47:20.047020] [DEBUG] [LOCAL ] BYD: Trimmed 65381 records to 44943 (keeping 200 days of data) [2025-10-21T17:47:20.151103] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-21T17:47:20.315926] [DEBUG] [LOCAL ] BYD: Primary data saved (44943 records). [2025-10-21T17:47:20.316049] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-21T17:47:20.316115] [INFO ] [MAIN ] Update Progress: 377/2366 symbols completed. BYD took 30.8s. Estimated remaining: 4h 9m 24s. Rate: 8.0 symbols/min [2025-10-21T17:47:20.486373] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:20.506137] [DEBUG] [LOCAL ] CAAP: Loaded 19913 existing records from primary storage. [2025-10-21T17:47:20.506354] [INFO ] [MAIN ] CAAP: Loaded 19913 existing records. [2025-10-21T17:47:20.681612] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:20.681837] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-21T17:47:20.681890] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-21T17:47:20.682026] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-21T17:47:20.682062] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-21T17:47:20.953675] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-21T17:47:21.032764] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:21.511164] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T17:47:21.664799] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T17:47:21.751050] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-21T17:47:21.948076] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T17:47:22.551029] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-21T17:47:23.079171] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T17:47:23.351013] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-21T17:47:23.457951] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T17:47:24.151086] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-21T17:47:24.475540] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T17:47:24.952082] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-21T17:47:24.953048] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T17:47:25.751054] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-21T17:47:26.551009] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-21T17:47:26.570424] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:47:26.881625] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T17:47:27.351075] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-21T17:47:27.600475] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T17:47:28.151090] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-21T17:47:28.951250] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T17:47:28.951338] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-21T17:47:29.181168] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T17:47:29.751030] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-21T17:47:30.226867] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T17:47:30.551014] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-21T17:47:30.616709] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T17:47:30.619145] [INFO ] [REMOTE ] BYM: Full fetch complete (17327 records). [2025-10-21T17:47:30.619218] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-21T17:47:31.013736] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-21T17:47:31.013821] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-21T17:47:31.014178] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-21T17:47:31.014217] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-21T17:47:31.014730] [DEBUG] [LOCAL ] BYM: Trimmed 17327 records to 11430 (keeping 200 days of data) [2025-10-21T17:47:31.081440] [DEBUG] [LOCAL ] BYM: Primary data saved (11430 records). [2025-10-21T17:47:31.081567] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-21T17:47:31.081668] [INFO ] [MAIN ] Update Progress: 378/2366 symbols completed. BYM took 22.7s. Estimated remaining: 4h 9m 33s. Rate: 8.0 symbols/min [2025-10-21T17:47:31.249062] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:31.268106] [DEBUG] [LOCAL ] CABO: Loaded 16723 existing records from primary storage. [2025-10-21T17:47:31.268402] [INFO ] [MAIN ] CABO: Loaded 16723 existing records. [2025-10-21T17:47:31.360051] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-21T17:47:31.453804] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:31.454032] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-21T17:47:31.454081] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-21T17:47:31.454285] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-21T17:47:31.454342] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-21T17:47:31.830274] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:32.151056] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-21T17:47:32.534086] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T17:47:32.740352] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-21T17:47:32.951086] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-21T17:47:33.172077] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T17:47:33.751082] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-21T17:47:33.836059] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T17:47:34.551060] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-21T17:47:35.351003] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-21T17:47:35.610734] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T17:47:35.868362] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T17:47:36.151094] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-21T17:47:36.581193] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T17:47:36.951055] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-21T17:47:37.750982] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-21T17:47:37.997706] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T17:47:38.059815] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T17:47:38.425140] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-21T17:47:38.551018] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-21T17:47:39.351021] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-21T17:47:39.908710] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T17:47:40.151033] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-21T17:47:40.426235] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:47:40.951077] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-21T17:47:41.236531] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T17:47:41.751085] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-21T17:47:42.470372] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T17:47:42.550989] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-21T17:47:42.704970] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T17:47:43.351061] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-21T17:47:44.151015] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-21T17:47:44.309466] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T17:47:44.951055] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-21T17:47:45.026770] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-21T17:47:45.065900] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T17:47:45.751034] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-21T17:47:46.101188] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T17:47:46.551024] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-21T17:47:47.081117] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:47:47.086926] [INFO ] [REMOTE ] BZH: Full fetch complete (46963 records). [2025-10-21T17:47:47.087081] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-21T17:47:47.087829] [FATAL] [VALIDATOR ] BZH: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:47:47.087938] [FATAL] [MAIN ] BZH: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:47:47.088006] [WARN ] [MAIN ] BZH: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:47:47.088086] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-21T17:47:47.088203] [DEBUG] [LOCAL ] BZH: No primary data file found to delete. [2025-10-21T17:47:47.088275] [INFO ] [LOCAL ] BZH: Starting deletion of derivative data. [2025-10-21T17:47:47.088479] [DEBUG] [LOCAL ] BZH: Deleted derivative data file. [2025-10-21T17:47:47.088967] [INFO ] [MAIN ] Update Progress: 379/2366 symbols completed. BZH took 31.7s. Estimated remaining: 4h 10m 10s. Rate: 7.9 symbols/min [2025-10-21T17:47:47.263191] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:47.286043] [DEBUG] [LOCAL ] CACI: Loaded 22704 existing records from primary storage. [2025-10-21T17:47:47.286278] [INFO ] [MAIN ] CACI: Loaded 22704 existing records. [2025-10-21T17:47:47.359723] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-21T17:47:47.466797] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:47.467050] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-21T17:47:47.477850] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-21T17:47:47.478191] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-21T17:47:47.478931] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T17:47:47.478552] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-21T17:47:47.855449] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:48.151022] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-21T17:47:48.951038] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-21T17:47:49.545269] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T17:47:49.690807] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T17:47:49.711320] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T17:47:49.750990] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-21T17:47:50.551059] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-21T17:47:51.130003] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:47:51.351000] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-21T17:47:51.563802] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T17:47:52.151031] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-21T17:47:52.512681] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T17:47:52.951078] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-21T17:47:53.751015] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-21T17:47:54.225091] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:47:54.228943] [INFO ] [REMOTE ] CAAP: Full fetch complete (27898 records). [2025-10-21T17:47:54.229025] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-21T17:47:54.551378] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-21T17:47:54.639255] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-21T17:47:54.640190] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-21T17:47:54.640744] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-21T17:47:54.640857] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-21T17:47:54.643532] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-21T17:47:54.655850] [DEBUG] [LOCAL ] CAAP: Trimmed 27898 records to 19895 (keeping 200 days of data) [2025-10-21T17:47:54.767489] [DEBUG] [LOCAL ] CAAP: Primary data saved (19895 records). [2025-10-21T17:47:54.767616] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-21T17:47:54.767720] [INFO ] [MAIN ] Update Progress: 380/2366 symbols completed. CAAP took 34.5s. Estimated remaining: 4h 10m 3s. Rate: 7.9 symbols/min [2025-10-21T17:47:54.940068] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:54.984318] [DEBUG] [LOCAL ] CADE: Loaded 49658 existing records from primary storage. [2025-10-21T17:47:54.984611] [INFO ] [MAIN ] CADE: Loaded 49658 existing records. [2025-10-21T17:47:55.162401] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:55.162614] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-21T17:47:55.162699] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-21T17:47:55.163450] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-21T17:47:55.163507] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-21T17:47:55.356662] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-21T17:47:55.445496] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T17:47:55.548232] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T17:47:55.569009] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:56.151071] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-21T17:47:56.951025] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-21T17:47:57.660522] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:47:57.751001] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-21T17:47:57.898477] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-21T17:47:57.906973] [INFO ] [REMOTE ] C: Full fetch complete (77918 records). [2025-10-21T17:47:57.907103] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-21T17:47:58.328569] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-21T17:47:58.328687] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-21T17:47:58.329523] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-21T17:47:58.329566] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-21T17:47:58.330962] [DEBUG] [LOCAL ] C: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-21T17:47:58.557096] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-21T17:47:58.660300] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-10-21T17:47:58.660626] [INFO ] [MAIN ] C: Full history saved. [2025-10-21T17:47:58.660854] [INFO ] [MAIN ] Update Progress: 381/2366 symbols completed. C took 40.1s. Estimated remaining: 4h 9m 37s. Rate: 8.0 symbols/min [2025-10-21T17:47:58.747216] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T17:47:58.857611] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:47:58.883693] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:47:58.924060] [DEBUG] [LOCAL ] CAE: Loaded 39223 existing records from primary storage. [2025-10-21T17:47:58.924334] [INFO ] [MAIN ] CAE: Loaded 39223 existing records. [2025-10-21T17:47:59.102038] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:47:59.102261] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-21T17:47:59.102307] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-21T17:47:59.102705] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-21T17:47:59.102762] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-21T17:47:59.361337] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-21T17:47:59.456346] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:47:59.656718] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T17:47:59.658789] [INFO ] [REMOTE ] CABO: Full fetch complete (23157 records). [2025-10-21T17:47:59.658857] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-21T17:48:00.030607] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-21T17:48:00.030768] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-21T17:48:00.031301] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-21T17:48:00.031363] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-21T17:48:00.032034] [DEBUG] [LOCAL ] CABO: Trimmed 23157 records to 16710 (keeping 200 days of data) [2025-10-21T17:48:00.130383] [DEBUG] [LOCAL ] CABO: Primary data saved (16710 records). [2025-10-21T17:48:00.130515] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-21T17:48:00.130592] [INFO ] [MAIN ] Update Progress: 382/2366 symbols completed. CABO took 29.0s. Estimated remaining: 4h 8m 58s. Rate: 8.0 symbols/min [2025-10-21T17:48:00.164899] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-21T17:48:00.299934] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:00.300114] [DEBUG] [LOCAL ] CAF: No existing data file found in primary storage. [2025-10-21T17:48:00.300150] [WARN ] [MAIN ] CAF: No existing data found, performing full refresh instead. [2025-10-21T17:48:00.300257] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-21T17:48:00.300297] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-21T17:48:00.300336] [DEBUG] [LOCAL ] CAF: No primary data file found to delete. [2025-10-21T17:48:00.300367] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-21T17:48:00.648928] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:00.950997] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-21T17:48:01.192589] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T17:48:01.414769] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T17:48:01.588626] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:48:01.751053] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-21T17:48:02.551051] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-21T17:48:02.680838] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T17:48:03.351027] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-21T17:48:03.956104] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T17:48:04.085913] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:48:04.150988] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-21T17:48:04.951037] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-21T17:48:05.554597] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:48:05.751029] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-21T17:48:06.545486] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T17:48:06.554704] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-21T17:48:07.351100] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-21T17:48:07.802452] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T17:48:07.967792] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T17:48:08.043218] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T17:48:08.151046] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-21T17:48:08.951040] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-21T17:48:09.750991] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-21T17:48:09.799901] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T17:48:09.880317] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T17:48:10.551021] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-21T17:48:11.281782] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T17:48:11.350990] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-21T17:48:12.151045] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-21T17:48:12.951060] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-21T17:48:12.995902] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T17:48:13.751035] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-21T17:48:13.892369] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T17:48:14.070412] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T17:48:14.073336] [INFO ] [REMOTE ] CACI: Full fetch complete (38287 records). [2025-10-21T17:48:14.073427] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-21T17:48:14.450379] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-21T17:48:14.450459] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-21T17:48:14.451009] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-21T17:48:14.451071] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-21T17:48:14.451865] [DEBUG] [LOCAL ] CACI: Trimmed 38287 records to 22510 (keeping 200 days of data) [2025-10-21T17:48:14.551683] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-21T17:48:14.587666] [DEBUG] [LOCAL ] CACI: Primary data saved (22510 records). [2025-10-21T17:48:14.587787] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-21T17:48:14.587868] [INFO ] [MAIN ] Update Progress: 383/2366 symbols completed. CACI took 27.5s. Estimated remaining: 4h 9m 26s. Rate: 8.0 symbols/min [2025-10-21T17:48:14.760279] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:14.815777] [DEBUG] [LOCAL ] CAG: Loaded 53665 existing records from primary storage. [2025-10-21T17:48:14.816089] [INFO ] [MAIN ] CAG: Loaded 53665 existing records. [2025-10-21T17:48:14.994872] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:14.995173] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-21T17:48:14.995234] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-21T17:48:14.996078] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-21T17:48:14.996138] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-21T17:48:15.359781] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:15.360133] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-21T17:48:15.447102] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T17:48:16.151115] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-21T17:48:16.431702] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T17:48:16.951048] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-21T17:48:17.402863] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T17:48:17.461447] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T17:48:17.511247] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (6.96 seconds). [2025-10-21T17:48:17.751037] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-21T17:48:18.551072] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-21T17:48:18.655452] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:48:19.137477] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T17:48:19.351069] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-21T17:48:20.151049] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-21T17:48:20.435281] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-21T17:48:20.905124] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:48:20.950988] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-21T17:48:21.750984] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-21T17:48:22.028450] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T17:48:22.447582] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T17:48:22.551043] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-21T17:48:23.351036] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-21T17:48:23.621670] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:48:23.774312] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T17:48:23.879578] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T17:48:24.151102] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-21T17:48:24.951032] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-21T17:48:25.751000] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-21T17:48:25.995461] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T17:48:26.003746] [INFO ] [REMOTE ] CADE: Full fetch complete (70705 records). [2025-10-21T17:48:26.003882] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-21T17:48:26.287272] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T17:48:26.395173] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-21T17:48:26.395259] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-21T17:48:26.396264] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-21T17:48:26.396893] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-21T17:48:26.398485] [DEBUG] [LOCAL ] CADE: Trimmed 70705 records to 49677 (keeping 200 days of data) [2025-10-21T17:48:26.576294] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-21T17:48:26.713719] [DEBUG] [LOCAL ] CADE: Primary data saved (49677 records). [2025-10-21T17:48:26.713951] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-21T17:48:26.714086] [INFO ] [MAIN ] Update Progress: 384/2366 symbols completed. CADE took 31.9s. Estimated remaining: 4h 9m 42s. Rate: 7.9 symbols/min [2025-10-21T17:48:26.905342] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:26.963704] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T17:48:26.992523] [DEBUG] [LOCAL ] CAH: Loaded 51463 existing records from primary storage. [2025-10-21T17:48:26.992898] [INFO ] [MAIN ] CAH: Loaded 51463 existing records. [2025-10-21T17:48:27.110188] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T17:48:27.197101] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:27.197319] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-21T17:48:27.197367] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-21T17:48:27.197986] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-21T17:48:27.198046] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-21T17:48:27.352393] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-21T17:48:27.550595] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:28.151040] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-21T17:48:28.951052] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-21T17:48:29.410618] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T17:48:29.515753] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T17:48:29.751060] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-21T17:48:29.869460] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T17:48:29.875799] [INFO ] [REMOTE ] CAE: Full fetch complete (56225 records). [2025-10-21T17:48:29.875926] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-21T17:48:29.876528] [FATAL] [VALIDATOR ] CAE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:48:29.876615] [FATAL] [MAIN ] CAE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:48:29.876693] [WARN ] [MAIN ] CAE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:48:29.876769] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-21T17:48:29.876866] [DEBUG] [LOCAL ] CAE: No primary data file found to delete. [2025-10-21T17:48:29.876939] [INFO ] [LOCAL ] CAE: Starting deletion of derivative data. [2025-10-21T17:48:29.877118] [DEBUG] [LOCAL ] CAE: Deleted derivative data file. [2025-10-21T17:48:29.877208] [INFO ] [MAIN ] Update Progress: 385/2366 symbols completed. CAE took 31.2s. Estimated remaining: 4h 9m 12s. Rate: 7.9 symbols/min [2025-10-21T17:48:30.075166] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:30.116807] [DEBUG] [LOCAL ] CAL: Loaded 42891 existing records from primary storage. [2025-10-21T17:48:30.117126] [INFO ] [MAIN ] CAL: Loaded 42891 existing records. [2025-10-21T17:48:30.303124] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:30.303332] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-21T17:48:30.303379] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-21T17:48:30.304148] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-21T17:48:30.304205] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-21T17:48:30.556196] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-21T17:48:30.653701] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:31.270844] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T17:48:31.272083] [INFO ] [REMOTE ] CAF: Full fetch complete (5525 records). [2025-10-21T17:48:31.272150] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-21T17:48:31.355579] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-21T17:48:31.656822] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-21T17:48:31.656930] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-21T17:48:31.657136] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-21T17:48:31.657261] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-21T17:48:31.657918] [DEBUG] [LOCAL ] CAF: Trimmed 5525 records to 3490 (keeping 200 days of data) [2025-10-21T17:48:31.694380] [DEBUG] [LOCAL ] CAF: Primary data saved (3490 records). [2025-10-21T17:48:31.705787] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-21T17:48:31.706035] [INFO ] [MAIN ] Update Progress: 386/2366 symbols completed. CAF took 31.6s. Estimated remaining: 4h 8m 35s. Rate: 8.0 symbols/min [2025-10-21T17:48:31.719910] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T17:48:31.897738] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:31.932022] [DEBUG] [LOCAL ] CALX: Loaded 37496 existing records from primary storage. [2025-10-21T17:48:31.932329] [INFO ] [MAIN ] CALX: Loaded 37496 existing records. [2025-10-21T17:48:32.114046] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:32.114258] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-21T17:48:32.114306] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-21T17:48:32.114979] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-21T17:48:32.115041] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-21T17:48:32.158040] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-21T17:48:32.517555] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:32.951039] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-21T17:48:33.028542] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T17:48:33.751058] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-21T17:48:33.907501] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T17:48:34.551081] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-21T17:48:34.589126] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:48:35.161776] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T17:48:35.351022] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-21T17:48:36.151039] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-21T17:48:36.276388] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T17:48:36.835023] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T17:48:36.951036] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-21T17:48:37.120484] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:48:37.751038] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-21T17:48:38.350088] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:48:38.551072] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-21T17:48:39.351033] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-21T17:48:39.698864] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T17:48:40.151043] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-21T17:48:40.450770] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T17:48:40.939230] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T17:48:40.950968] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-21T17:48:41.667054] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T17:48:41.750988] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-21T17:48:42.362857] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T17:48:42.551025] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-21T17:48:42.803099] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T17:48:43.351037] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-21T17:48:44.080941] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:48:44.151046] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-21T17:48:44.880966] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T17:48:44.951007] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-21T17:48:45.750999] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-21T17:48:46.111956] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T17:48:46.551038] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-21T17:48:46.624374] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T17:48:47.257280] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T17:48:47.351034] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-21T17:48:48.039031] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T17:48:48.151006] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-21T17:48:48.686109] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T17:48:48.951073] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-21T17:48:49.751087] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-21T17:48:49.983492] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T17:48:50.480302] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:48:50.550986] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-21T17:48:50.871537] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T17:48:51.351099] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-21T17:48:52.091249] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T17:48:52.150997] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-21T17:48:52.951046] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-21T17:48:53.118592] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T17:48:53.222894] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T17:48:53.231797] [INFO ] [REMOTE ] CAG: Full fetch complete (77826 records). [2025-10-21T17:48:53.231954] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-21T17:48:53.626093] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-21T17:48:53.626181] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-21T17:48:53.627061] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-21T17:48:53.627126] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-21T17:48:53.628615] [DEBUG] [LOCAL ] CAG: Trimmed 77826 records to 53666 (keeping 200 days of data) [2025-10-21T17:48:53.754760] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-21T17:48:53.962337] [DEBUG] [LOCAL ] CAG: Primary data saved (53666 records). [2025-10-21T17:48:53.962473] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-21T17:48:53.962959] [INFO ] [MAIN ] Update Progress: 387/2366 symbols completed. CAG took 39.4s. Estimated remaining: 4h 9m 43s. Rate: 7.9 symbols/min [2025-10-21T17:48:54.139630] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:54.168368] [DEBUG] [LOCAL ] CANG: Loaded 27136 existing records from primary storage. [2025-10-21T17:48:54.168677] [INFO ] [MAIN ] CANG: Loaded 27136 existing records. [2025-10-21T17:48:54.358588] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:54.377328] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-21T17:48:54.377559] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-21T17:48:54.378954] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T17:48:54.386071] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-21T17:48:54.386569] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-21T17:48:54.563384] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-21T17:48:54.744739] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:55.351056] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-21T17:48:55.386985] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T17:48:56.021764] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T17:48:56.029386] [INFO ] [REMOTE ] CALX: Full fetch complete (54069 records). [2025-10-21T17:48:56.029531] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-21T17:48:56.156157] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-21T17:48:56.428860] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-21T17:48:56.428961] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-21T17:48:56.429578] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-21T17:48:56.429615] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-21T17:48:56.430616] [DEBUG] [LOCAL ] CALX: Trimmed 54069 records to 37319 (keeping 200 days of data) [2025-10-21T17:48:56.636447] [DEBUG] [LOCAL ] CALX: Primary data saved (37319 records). [2025-10-21T17:48:56.636567] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-21T17:48:56.636660] [INFO ] [MAIN ] Update Progress: 388/2366 symbols completed. CALX took 24.9s. Estimated remaining: 4h 9m 10s. Rate: 7.9 symbols/min [2025-10-21T17:48:56.804727] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:56.804850] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-10-21T17:48:56.804886] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-10-21T17:48:56.804988] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-21T17:48:56.805029] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-21T17:48:56.805068] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-21T17:48:56.805098] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-21T17:48:56.953119] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-21T17:48:57.170037] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:48:57.203191] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T17:48:57.750999] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-21T17:48:57.917609] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T17:48:57.924323] [INFO ] [REMOTE ] CAL: Full fetch complete (61826 records). [2025-10-21T17:48:57.924432] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-21T17:48:58.333112] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-21T17:48:58.333240] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-21T17:48:58.334140] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-21T17:48:58.334224] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-21T17:48:58.335566] [DEBUG] [LOCAL ] CAL: Trimmed 61826 records to 42780 (keeping 200 days of data) [2025-10-21T17:48:58.551543] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-21T17:48:58.568607] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:48:58.589594] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T17:48:58.631165] [DEBUG] [LOCAL ] CAL: Primary data saved (42780 records). [2025-10-21T17:48:58.631289] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-21T17:48:58.631375] [INFO ] [MAIN ] Update Progress: 389/2366 symbols completed. CAL took 28.8s. Estimated remaining: 4h 8m 34s. Rate: 8.0 symbols/min [2025-10-21T17:48:58.798358] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:48:58.846741] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-21T17:48:58.847028] [INFO ] [MAIN ] CARR: Loaded 53603 existing records. [2025-10-21T17:48:59.023894] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:48:59.024100] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-21T17:48:59.024146] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-21T17:48:59.024993] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-21T17:48:59.025060] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-21T17:48:59.352828] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-21T17:48:59.381390] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:00.038994] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T17:49:00.151012] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-21T17:49:00.304830] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:49:00.951032] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-21T17:49:01.440389] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T17:49:01.751037] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-21T17:49:02.505077] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T17:49:02.551077] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-21T17:49:03.173088] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-21T17:49:03.181010] [INFO ] [REMOTE ] CAH: Full fetch complete (74840 records). [2025-10-21T17:49:03.181120] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-21T17:49:03.355686] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-21T17:49:03.573482] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-21T17:49:03.573554] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-21T17:49:03.574367] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-21T17:49:03.574429] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-21T17:49:03.575765] [DEBUG] [LOCAL ] CAH: Trimmed 74840 records to 51443 (keeping 200 days of data) [2025-10-21T17:49:03.887141] [DEBUG] [LOCAL ] CAH: Primary data saved (51443 records). [2025-10-21T17:49:03.887298] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-21T17:49:03.888222] [INFO ] [MAIN ] Update Progress: 390/2366 symbols completed. CAH took 37.2s. Estimated remaining: 4h 8m 15s. Rate: 8.0 symbols/min [2025-10-21T17:49:04.067830] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:04.112177] [DEBUG] [LOCAL ] CARS: Loaded 39802 existing records from primary storage. [2025-10-21T17:49:04.112491] [INFO ] [MAIN ] CARS: Loaded 39802 existing records. [2025-10-21T17:49:04.156745] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-21T17:49:04.288060] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T17:49:04.309299] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:04.312105] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-21T17:49:04.312208] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-21T17:49:04.313081] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-21T17:49:04.313141] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-21T17:49:04.674915] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:04.702406] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-21T17:49:04.951057] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-21T17:49:05.166369] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T17:49:05.349454] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-21T17:49:05.751047] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-21T17:49:06.551049] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-21T17:49:06.890341] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T17:49:07.351062] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-21T17:49:08.151029] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-21T17:49:08.237601] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T17:49:08.843572] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T17:49:08.871259] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T17:49:08.951004] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-21T17:49:09.623178] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T17:49:09.751031] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-21T17:49:10.551038] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-21T17:49:11.029914] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-21T17:49:11.351014] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-21T17:49:11.582625] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T17:49:11.861134] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-21T17:49:12.151004] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-21T17:49:12.951081] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-21T17:49:13.751074] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-21T17:49:14.334119] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T17:49:14.448739] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T17:49:14.551002] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-21T17:49:14.740606] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T17:49:14.742051] [INFO ] [REMOTE ] CAPL: Full fetch complete (8709 records). [2025-10-21T17:49:14.742124] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-21T17:49:15.115180] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-21T17:49:15.115257] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-21T17:49:15.115467] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-21T17:49:15.115525] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-21T17:49:15.115983] [DEBUG] [LOCAL ] CAPL: Trimmed 8709 records to 5485 (keeping 200 days of data) [2025-10-21T17:49:15.147887] [DEBUG] [LOCAL ] CAPL: Primary data saved (5485 records). [2025-10-21T17:49:15.148001] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-21T17:49:15.148067] [INFO ] [MAIN ] Update Progress: 391/2366 symbols completed. CAPL took 18.5s. Estimated remaining: 4h 8m 26s. Rate: 7.9 symbols/min [2025-10-21T17:49:15.316196] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:15.364692] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-21T17:49:15.367594] [DEBUG] [LOCAL ] CAT: Loaded 52966 existing records from primary storage. [2025-10-21T17:49:15.368006] [INFO ] [MAIN ] CAT: Loaded 52966 existing records. [2025-10-21T17:49:15.563940] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:15.564120] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-21T17:49:15.564168] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-21T17:49:15.564828] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-21T17:49:15.564885] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-21T17:49:15.957303] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:16.151065] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-21T17:49:16.410229] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:49:16.951045] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-21T17:49:17.327834] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T17:49:17.512319] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T17:49:17.751095] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-21T17:49:18.551084] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-21T17:49:19.200403] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T17:49:19.351038] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-21T17:49:19.612259] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:49:19.716115] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T17:49:20.151049] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-21T17:49:20.951061] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-21T17:49:21.165160] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:49:21.751019] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-21T17:49:22.085537] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T17:49:22.113155] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T17:49:22.551033] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-21T17:49:22.886531] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T17:49:23.351006] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-21T17:49:23.708511] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T17:49:24.151018] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-21T17:49:24.800861] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:49:24.951029] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-21T17:49:25.751113] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-21T17:49:25.906880] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:49:26.524694] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T17:49:26.551009] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-21T17:49:27.351014] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-21T17:49:27.594702] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T17:49:28.068401] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T17:49:28.151036] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-21T17:49:28.750367] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T17:49:28.951045] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-21T17:49:29.566589] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T17:49:29.751050] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-21T17:49:30.257402] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T17:49:30.262095] [INFO ] [REMOTE ] CANG: Full fetch complete (39685 records). [2025-10-21T17:49:30.262169] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-21T17:49:30.557390] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-21T17:49:30.656062] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-21T17:49:30.656130] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-21T17:49:30.656691] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-21T17:49:30.656751] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-21T17:49:30.657676] [DEBUG] [LOCAL ] CANG: Trimmed 39685 records to 27080 (keeping 200 days of data) [2025-10-21T17:49:30.801753] [DEBUG] [LOCAL ] CANG: Primary data saved (27080 records). [2025-10-21T17:49:30.801924] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-21T17:49:30.802008] [INFO ] [MAIN ] Update Progress: 392/2366 symbols completed. CANG took 36.8s. Estimated remaining: 4h 8m 60s. Rate: 7.9 symbols/min [2025-10-21T17:49:30.944434] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T17:49:30.999192] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:31.006163] [DEBUG] [LOCAL ] CATO: Loaded 6648 existing records from primary storage. [2025-10-21T17:49:31.006303] [INFO ] [MAIN ] CATO: Loaded 6648 existing records. [2025-10-21T17:49:31.179224] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:31.179422] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-21T17:49:31.179467] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-21T17:49:31.179606] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-21T17:49:31.179676] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-21T17:49:31.357122] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-21T17:49:31.556137] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:32.151018] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-21T17:49:32.932304] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-21T17:49:32.956593] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-21T17:49:32.960149] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T17:49:32.966749] [INFO ] [REMOTE ] CARS: Full fetch complete (56100 records). [2025-10-21T17:49:32.966848] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-21T17:49:32.967478] [FATAL] [VALIDATOR ] CARS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:49:32.967562] [FATAL] [MAIN ] CARS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:49:32.967603] [WARN ] [MAIN ] CARS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:49:32.967693] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-21T17:49:32.967760] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-21T17:49:32.967794] [INFO ] [LOCAL ] CARS: Starting deletion of derivative data. [2025-10-21T17:49:32.967942] [DEBUG] [LOCAL ] CARS: Deleted derivative data file. [2025-10-21T17:49:32.968097] [INFO ] [MAIN ] Update Progress: 393/2366 symbols completed. CARS took 29.1s. Estimated remaining: 4h 8m 25s. Rate: 7.9 symbols/min [2025-10-21T17:49:33.135280] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:33.186456] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-10-21T17:49:33.186767] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-10-21T17:49:33.387221] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:33.387390] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-21T17:49:33.387435] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-21T17:49:33.387604] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-21T17:49:33.387670] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-21T17:49:33.744602] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:33.750977] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-21T17:49:33.933938] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T17:49:34.551013] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-21T17:49:35.351002] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-21T17:49:35.458862] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-21T17:49:35.923588] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-21T17:49:36.151006] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-21T17:49:36.170878] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T17:49:36.377592] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T17:49:36.386808] [INFO ] [REMOTE ] CARR: Full fetch complete (77772 records). [2025-10-21T17:49:36.387018] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-21T17:49:36.791809] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-21T17:49:36.791888] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-21T17:49:36.792751] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-21T17:49:36.792848] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-21T17:49:36.794261] [DEBUG] [LOCAL ] CARR: Trimmed 77772 records to 53603 (keeping 200 days of data) [2025-10-21T17:49:36.966499] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-21T17:49:37.114918] [DEBUG] [LOCAL ] CARR: Primary data saved (53603 records). [2025-10-21T17:49:37.115056] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-21T17:49:37.115133] [INFO ] [MAIN ] Update Progress: 394/2366 symbols completed. CARR took 38.5s. Estimated remaining: 4h 8m 0s. Rate: 8.0 symbols/min [2025-10-21T17:49:37.286918] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:37.332843] [DEBUG] [LOCAL ] CB: Loaded 49967 existing records from primary storage. [2025-10-21T17:49:37.333172] [INFO ] [MAIN ] CB: Loaded 49967 existing records. [2025-10-21T17:49:37.511938] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:37.512175] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-21T17:49:37.512223] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-21T17:49:37.512406] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-21T17:49:37.512444] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-21T17:49:37.755393] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-21T17:49:37.866541] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T17:49:37.909302] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:38.180845] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T17:49:38.551018] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-21T17:49:39.351042] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-21T17:49:39.487854] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T17:49:40.151061] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-21T17:49:40.705482] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T17:49:40.951046] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-21T17:49:41.016702] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T17:49:41.591316] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T17:49:41.750992] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-21T17:49:41.910327] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T17:49:42.551025] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-21T17:49:43.361335] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-21T17:49:43.366683] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T17:49:44.151053] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-21T17:49:44.548266] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T17:49:44.658226] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T17:49:44.951052] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-21T17:49:45.570464] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-21T17:49:45.751045] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-21T17:49:46.551030] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-21T17:49:47.134694] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T17:49:47.150768] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T17:49:47.351027] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-21T17:49:47.781360] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T17:49:48.151045] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-21T17:49:48.951001] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-21T17:49:49.474979] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-21T17:49:49.751085] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-21T17:49:49.919359] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T17:49:49.927804] [INFO ] [REMOTE ] CAT: Full fetch complete (76886 records). [2025-10-21T17:49:49.927936] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-21T17:49:50.319757] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-21T17:49:50.319841] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-21T17:49:50.320688] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-21T17:49:50.320909] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-21T17:49:50.322420] [DEBUG] [LOCAL ] CAT: Trimmed 76886 records to 52953 (keeping 200 days of data) [2025-10-21T17:49:50.555707] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-21T17:49:50.652238] [DEBUG] [LOCAL ] CAT: Primary data saved (52953 records). [2025-10-21T17:49:50.652534] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-21T17:49:50.653207] [INFO ] [MAIN ] Update Progress: 395/2366 symbols completed. CAT took 35.5s. Estimated remaining: 4h 8m 23s. Rate: 7.9 symbols/min [2025-10-21T17:49:50.825556] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:50.860824] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T17:49:50.881661] [DEBUG] [LOCAL ] CBAN: Loaded 10299 existing records from primary storage. [2025-10-21T17:49:50.881911] [INFO ] [MAIN ] CBAN: Loaded 10299 existing records. [2025-10-21T17:49:51.058380] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:51.058725] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-21T17:49:51.058782] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-21T17:49:51.058937] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-21T17:49:51.058976] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-21T17:49:51.280210] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T17:49:51.354399] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-21T17:49:51.437894] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:51.889347] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T17:49:52.047142] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-21T17:49:52.151024] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-21T17:49:52.911851] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T17:49:52.951043] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-21T17:49:53.751044] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-21T17:49:54.517333] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T17:49:54.551016] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-21T17:49:54.876739] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T17:49:55.056067] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T17:49:55.057513] [INFO ] [REMOTE ] CATO: Full fetch complete (10694 records). [2025-10-21T17:49:55.057579] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-21T17:49:55.356186] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-21T17:49:55.413939] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-21T17:49:55.414016] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-21T17:49:55.414273] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-21T17:49:55.414311] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-21T17:49:55.414765] [DEBUG] [LOCAL ] CATO: Trimmed 10694 records to 6616 (keeping 200 days of data) [2025-10-21T17:49:55.450253] [DEBUG] [LOCAL ] CATO: Primary data saved (6616 records). [2025-10-21T17:49:55.450347] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-21T17:49:55.450416] [INFO ] [MAIN ] Update Progress: 396/2366 symbols completed. CATO took 24.6s. Estimated remaining: 4h 8m 1s. Rate: 7.9 symbols/min [2025-10-21T17:49:55.614932] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:49:55.630039] [DEBUG] [LOCAL ] CBL: Loaded 16230 existing records from primary storage. [2025-10-21T17:49:55.630251] [INFO ] [MAIN ] CBL: Loaded 16230 existing records. [2025-10-21T17:49:55.802046] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:49:55.802277] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-21T17:49:55.802322] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-21T17:49:55.802531] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-21T17:49:55.802568] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-21T17:49:56.149432] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:49:56.150978] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-21T17:49:56.951010] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-21T17:49:57.195888] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T17:49:57.271288] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T17:49:57.751045] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-21T17:49:58.551069] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-21T17:49:58.724231] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T17:49:59.241489] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T17:49:59.351010] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-21T17:50:00.151019] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-21T17:50:00.190243] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T17:50:00.951034] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-21T17:50:01.186900] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T17:50:01.613607] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-21T17:50:01.751017] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-21T17:50:01.904746] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T17:50:02.551108] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-21T17:50:02.810339] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T17:50:03.346870] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T17:50:03.350974] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-21T17:50:04.151021] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-21T17:50:04.284170] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T17:50:04.951033] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-21T17:50:05.751038] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-21T17:50:06.447780] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T17:50:06.457003] [INFO ] [REMOTE ] CAVA: Full fetch complete (77452 records). [2025-10-21T17:50:06.457215] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-21T17:50:06.560087] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-21T17:50:06.883284] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T17:50:06.945198] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-21T17:50:06.945411] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-21T17:50:06.946583] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-21T17:50:06.946712] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-21T17:50:06.948726] [DEBUG] [LOCAL ] CAVA: Trimmed 77452 records to 53551 (keeping 200 days of data) [2025-10-21T17:50:07.125838] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T17:50:07.346441] [DEBUG] [LOCAL ] CAVA: Primary data saved (53551 records). [2025-10-21T17:50:07.346599] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-21T17:50:07.347593] [INFO ] [MAIN ] Update Progress: 397/2366 symbols completed. CAVA took 34.4s. Estimated remaining: 4h 8m 15s. Rate: 7.9 symbols/min [2025-10-21T17:50:07.350999] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-21T17:50:07.482696] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:50:08.151053] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-21T17:50:08.951022] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-21T17:50:09.294176] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T17:50:09.315032] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T17:50:09.751032] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-21T17:50:09.860147] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T17:50:10.551108] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-21T17:50:11.351018] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-21T17:50:11.464320] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T17:50:11.715401] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T17:50:12.151088] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-21T17:50:12.164045] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T17:50:12.951002] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-21T17:50:13.322461] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T17:50:13.751078] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-21T17:50:14.550997] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-21T17:50:14.766916] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T17:50:14.995755] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T17:50:15.006717] [INFO ] [REMOTE ] CB: Full fetch complete (72856 records). [2025-10-21T17:50:15.006887] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-21T17:50:15.293138] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T17:50:15.356122] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-21T17:50:15.437516] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-21T17:50:15.437808] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-21T17:50:15.438788] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-21T17:50:15.438854] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-21T17:50:15.440332] [DEBUG] [LOCAL ] CB: Trimmed 72856 records to 49973 (keeping 200 days of data) [2025-10-21T17:50:15.749739] [DEBUG] [LOCAL ] CB: Primary data saved (49973 records). [2025-10-21T17:50:15.749875] [INFO ] [MAIN ] CB: Full history saved. [2025-10-21T17:50:15.749953] [INFO ] [MAIN ] Update Progress: 398/2366 symbols completed. CB took 38.6s. Estimated remaining: 4h 8m 12s. Rate: 7.9 symbols/min [2025-10-21T17:50:16.024625] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-21T17:50:16.151027] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-21T17:50:16.950991] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-21T17:50:17.261541] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T17:50:17.751008] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-21T17:50:19.708718] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-21T17:50:19.711116] [INFO ] [REMOTE ] CBAN: Full fetch complete (16155 records). [2025-10-21T17:50:19.711199] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-21T17:50:19.711605] [FATAL] [VALIDATOR ] CBAN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:50:19.711709] [FATAL] [MAIN ] CBAN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:50:19.711775] [WARN ] [MAIN ] CBAN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:50:19.712060] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-21T17:50:19.712120] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-21T17:50:19.712155] [INFO ] [LOCAL ] CBAN: Starting deletion of derivative data. [2025-10-21T17:50:19.712451] [DEBUG] [LOCAL ] CBAN: Deleted derivative data file. [2025-10-21T17:50:19.712541] [INFO ] [MAIN ] Update Progress: 399/2366 symbols completed. CBAN took 29.1s. Estimated remaining: 4h 7m 47s. Rate: 7.9 symbols/min [2025-10-21T17:50:20.473779] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-21T17:50:20.476367] [INFO ] [REMOTE ] CBL: Full fetch complete (24733 records). [2025-10-21T17:50:20.476440] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-21T17:50:20.476890] [FATAL] [VALIDATOR ] CBL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:50:20.476971] [FATAL] [MAIN ] CBL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:50:20.477012] [WARN ] [MAIN ] CBL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:50:20.477074] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-21T17:50:20.477134] [DEBUG] [LOCAL ] CBL: No primary data file found to delete. [2025-10-21T17:50:20.477168] [INFO ] [LOCAL ] CBL: Starting deletion of derivative data. [2025-10-21T17:50:20.477283] [DEBUG] [LOCAL ] CBL: Deleted derivative data file. [2025-10-21T17:50:20.477453] [INFO ] [MAIN ] Update Progress: 400/2366 symbols completed. CBL took 25.0s. Estimated remaining: 4h 7m 6s. Rate: 8.0 symbols/min [2025-10-21T17:50:21.099854] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:21.108994] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:21.197224] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:21.225668] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:21.226580] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-21T17:50:21.229078] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-21T17:50:21.230350] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-21T17:50:21.229953] [DEBUG] [LOCAL ] CBNA: Loaded 2900 existing records from primary storage. [2025-10-21T17:50:21.230435] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-21T17:50:21.230784] [INFO ] [MAIN ] CBNA: Loaded 2900 existing records. [2025-10-21T17:50:21.230587] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-21T17:50:21.251067] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-21T17:50:21.519063] [DEBUG] [LOCAL ] CBT: Loaded 31150 existing records from primary storage. [2025-10-21T17:50:21.549444] [INFO ] [MAIN ] CBT: Loaded 31150 existing records. [2025-10-21T17:50:21.622133] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:21.670857] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-21T17:50:21.693198] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-21T17:50:21.759924] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-21T17:50:21.787324] [DEBUG] [LOCAL ] CBRE: Loaded 50305 existing records from primary storage. [2025-10-21T17:50:21.780628] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-21T17:50:21.877591] [INFO ] [MAIN ] CBRE: Loaded 50305 existing records. [2025-10-21T17:50:22.136745] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:22.267100] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-21T17:50:22.267218] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-21T17:50:22.266931] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:22.283302] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-21T17:50:22.288482] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-21T17:50:22.334952] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-21T17:50:22.430612] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:22.508054] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-21T17:50:22.522932] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-21T17:50:22.566504] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-21T17:50:22.566578] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-21T17:50:22.675472] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:50:22.746208] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-21T17:50:22.821702] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:50:22.913509] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:22.918963] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-21T17:50:22.887776] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-21T17:50:22.972180] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:50:22.993356] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-21T17:50:23.006675] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-21T17:50:23.009759] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-21T17:50:23.033152] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-21T17:50:23.039567] [INFO ] [MAIN ] Update Progress: 401/2366 symbols completed. CBO took 2.6s. Estimated remaining: 4h 6m 34s. Rate: 8.0 symbols/min [2025-10-21T17:50:23.330349] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:23.358220] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-21T17:50:23.479511] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:23.499335] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:23.496966] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-21T17:50:23.522526] [DEBUG] [LOCAL ] CBU: Loaded 22862 existing records from primary storage. [2025-10-21T17:50:23.522815] [INFO ] [MAIN ] CBU: Loaded 22862 existing records. [2025-10-21T17:50:23.619011] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T17:50:23.631423] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-21T17:50:23.709174] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:23.709356] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-21T17:50:23.709404] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-21T17:50:23.709625] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-21T17:50:23.709700] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-21T17:50:24.054104] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:24.054435] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-21T17:50:24.201444] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T17:50:24.203376] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-21T17:50:24.643792] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:50:24.644984] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-21T17:50:24.994812] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T17:50:25.001542] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-21T17:50:25.044905] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T17:50:25.104142] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T17:50:25.273525] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T17:50:25.751065] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-21T17:50:26.029207] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T17:50:26.441805] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T17:50:26.551057] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-21T17:50:27.351032] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-21T17:50:28.148465] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T17:50:28.158076] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-21T17:50:28.254711] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T17:50:28.951078] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-21T17:50:29.554337] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:50:29.750993] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-21T17:50:29.933684] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T17:50:30.323941] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T17:50:30.551043] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-21T17:50:31.351072] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-21T17:50:31.577853] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T17:50:32.151058] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-21T17:50:32.458468] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T17:50:32.951018] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-21T17:50:33.758104] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-21T17:50:33.781100] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:50:34.040053] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T17:50:34.551027] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-21T17:50:35.280385] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T17:50:35.296041] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T17:50:35.350995] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-21T17:50:35.992529] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T17:50:36.151009] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-21T17:50:36.951031] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-21T17:50:37.483283] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T17:50:37.751017] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-21T17:50:38.551000] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-21T17:50:38.671173] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T17:50:38.994263] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:50:39.109260] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T17:50:39.351030] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-21T17:50:40.151065] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-21T17:50:40.670071] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:50:40.951020] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-21T17:50:41.222017] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:50:41.307539] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-21T17:50:41.751048] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-21T17:50:42.551045] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-21T17:50:42.629928] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T17:50:43.351037] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-21T17:50:44.151036] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-21T17:50:44.450092] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T17:50:44.481179] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T17:50:44.951033] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-21T17:50:45.051849] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:50:45.055984] [INFO ] [REMOTE ] CBU: Full fetch complete (32714 records). [2025-10-21T17:50:45.056065] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-21T17:50:45.426430] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-21T17:50:45.426507] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-21T17:50:45.427015] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-21T17:50:45.427076] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-21T17:50:45.427834] [DEBUG] [LOCAL ] CBU: Trimmed 32714 records to 22773 (keeping 200 days of data) [2025-10-21T17:50:45.561855] [DEBUG] [LOCAL ] CBU: Primary data saved (22773 records). [2025-10-21T17:50:45.562005] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-21T17:50:45.562098] [INFO ] [MAIN ] Update Progress: 402/2366 symbols completed. CBU took 22.5s. Estimated remaining: 4h 7m 40s. Rate: 7.9 symbols/min [2025-10-21T17:50:45.748829] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:45.749009] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-21T17:50:45.749058] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-21T17:50:45.749168] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-21T17:50:45.749210] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-21T17:50:45.749251] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-21T17:50:45.749283] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-21T17:50:45.760638] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-21T17:50:45.788836] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T17:50:45.814929] [INFO ] [REMOTE ] CBNA: Full fetch complete (4328 records). [2025-10-21T17:50:45.830731] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-21T17:50:46.472661] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:46.540058] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-21T17:50:46.540138] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-21T17:50:46.540278] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-21T17:50:46.540316] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-21T17:50:46.540683] [DEBUG] [LOCAL ] CBNA: Trimmed 4328 records to 2888 (keeping 200 days of data) [2025-10-21T17:50:46.557375] [DEBUG] [LOCAL ] CBNA: Primary data saved (2888 records). [2025-10-21T17:50:46.553021] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-21T17:50:46.557469] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-21T17:50:46.557727] [INFO ] [MAIN ] Update Progress: 403/2366 symbols completed. CBNA took 26.1s. Estimated remaining: 4h 6m 60s. Rate: 7.9 symbols/min [2025-10-21T17:50:46.736571] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:46.773299] [DEBUG] [LOCAL ] CBZ: Loaded 34284 existing records from primary storage. [2025-10-21T17:50:46.773592] [INFO ] [MAIN ] CBZ: Loaded 34284 existing records. [2025-10-21T17:50:46.872853] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:50:46.875611] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-21T17:50:46.886177] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:50:46.914425] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-21T17:50:46.919759] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:50:46.927855] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-21T17:50:46.934876] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-21T17:50:46.935676] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-21T17:50:46.956001] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:46.956186] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-21T17:50:46.956420] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-21T17:50:46.956611] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-21T17:50:46.956761] [INFO ] [MAIN ] Update Progress: 404/2366 symbols completed. CBX took 1.4s. Estimated remaining: 4h 6m 18s. Rate: 8.0 symbols/min [2025-10-21T17:50:46.970875] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-21T17:50:46.991544] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-21T17:50:47.275299] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:47.358072] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-21T17:50:47.550257] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:47.598923] [DEBUG] [LOCAL ] CC: Loaded 53030 existing records from primary storage. [2025-10-21T17:50:47.601008] [INFO ] [MAIN ] CC: Loaded 53030 existing records. [2025-10-21T17:50:47.600858] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T17:50:47.794312] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:47.794622] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-21T17:50:47.794707] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-21T17:50:47.794905] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-21T17:50:47.794943] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-21T17:50:48.151687] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-21T17:50:48.153772] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:48.762243] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T17:50:48.951096] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-21T17:50:49.751092] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-21T17:50:49.989515] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T17:50:50.039394] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T17:50:50.551023] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-21T17:50:51.211942] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T17:50:51.351047] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-21T17:50:51.684263] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T17:50:52.151092] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-21T17:50:52.943295] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:50:52.952438] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-21T17:50:53.509279] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T17:50:53.514337] [INFO ] [REMOTE ] CBT: Full fetch complete (45793 records). [2025-10-21T17:50:53.514416] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-21T17:50:53.762200] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-21T17:50:53.899269] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-21T17:50:53.899362] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-21T17:50:53.900010] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-21T17:50:53.900114] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-21T17:50:53.901207] [DEBUG] [LOCAL ] CBT: Trimmed 45793 records to 31053 (keeping 200 days of data) [2025-10-21T17:50:54.093416] [DEBUG] [LOCAL ] CBT: Primary data saved (31053 records). [2025-10-21T17:50:54.093556] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-21T17:50:54.094135] [INFO ] [MAIN ] Update Progress: 405/2366 symbols completed. CBT took 33.6s. Estimated remaining: 4h 6m 8s. Rate: 8.0 symbols/min [2025-10-21T17:50:54.266542] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:50:54.319111] [DEBUG] [LOCAL ] CCI: Loaded 53116 existing records from primary storage. [2025-10-21T17:50:54.319438] [INFO ] [MAIN ] CCI: Loaded 53116 existing records. [2025-10-21T17:50:54.498349] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:50:54.498632] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-21T17:50:54.498730] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-21T17:50:54.499141] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-21T17:50:54.499197] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-21T17:50:54.566707] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-21T17:50:54.865477] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:50:54.898415] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T17:50:55.255889] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:50:55.351045] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-21T17:50:56.151026] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-21T17:50:56.414366] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T17:50:56.826963] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T17:50:56.951058] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-21T17:50:57.591367] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T17:50:57.751035] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-21T17:50:58.243973] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T17:50:58.551013] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-21T17:50:59.350998] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-21T17:50:59.448464] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T17:51:00.150995] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-21T17:51:00.511323] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T17:51:00.796954] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T17:51:00.951011] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-21T17:51:01.750992] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-21T17:51:02.245622] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-21T17:51:02.377306] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T17:51:02.551264] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-21T17:51:03.147055] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:51:03.351122] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-21T17:51:04.151028] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-21T17:51:04.388892] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T17:51:04.950983] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-21T17:51:05.193010] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T17:51:05.751064] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-21T17:51:05.801189] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T17:51:06.551096] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-21T17:51:07.060495] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T17:51:07.351017] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-21T17:51:07.857415] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T17:51:07.865795] [INFO ] [REMOTE ] CBRE: Full fetch complete (73767 records). [2025-10-21T17:51:07.865951] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-21T17:51:08.161405] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-21T17:51:08.290040] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-21T17:51:08.290192] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-21T17:51:08.291137] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-21T17:51:08.291242] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-21T17:51:08.292566] [DEBUG] [LOCAL ] CBRE: Trimmed 73767 records to 50283 (keeping 200 days of data) [2025-10-21T17:51:08.548467] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T17:51:08.636943] [DEBUG] [LOCAL ] CBRE: Primary data saved (50283 records). [2025-10-21T17:51:08.637068] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-21T17:51:08.637144] [INFO ] [MAIN ] Update Progress: 406/2366 symbols completed. CBRE took 48.2s. Estimated remaining: 4h 6m 35s. Rate: 7.9 symbols/min [2025-10-21T17:51:08.819340] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:08.819515] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-21T17:51:08.819556] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-21T17:51:08.819688] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-21T17:51:08.819741] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-21T17:51:08.819783] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-21T17:51:08.819816] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-21T17:51:08.960416] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-21T17:51:09.181394] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:09.211582] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T17:51:09.718802] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T17:51:09.751039] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-21T17:51:10.551032] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-21T17:51:11.134453] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T17:51:11.137141] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T17:51:11.351019] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-21T17:51:11.409758] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T17:51:11.415407] [INFO ] [REMOTE ] CBZ: Full fetch complete (46282 records). [2025-10-21T17:51:11.415496] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-21T17:51:11.795963] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-21T17:51:11.798813] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-21T17:51:11.798936] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T17:51:11.800935] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-21T17:51:11.801000] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-21T17:51:11.801942] [DEBUG] [LOCAL ] CBZ: Trimmed 46282 records to 34322 (keeping 200 days of data) [2025-10-21T17:51:11.997004] [DEBUG] [LOCAL ] CBZ: Primary data saved (34322 records). [2025-10-21T17:51:11.997125] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-21T17:51:11.997212] [INFO ] [MAIN ] Update Progress: 407/2366 symbols completed. CBZ took 25.4s. Estimated remaining: 4h 6m 7s. Rate: 8.0 symbols/min [2025-10-21T17:51:12.155563] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-21T17:51:12.164703] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:12.179514] [DEBUG] [LOCAL ] CCIF: Loaded 15294 existing records from primary storage. [2025-10-21T17:51:12.179763] [INFO ] [MAIN ] CCIF: Loaded 15294 existing records. [2025-10-21T17:51:12.351480] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:12.351725] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-21T17:51:12.351798] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-21T17:51:12.352032] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-21T17:51:12.352078] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-21T17:51:12.699754] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:12.951010] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-21T17:51:13.751051] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-21T17:51:13.998587] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T17:51:14.182954] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T17:51:14.551052] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-21T17:51:15.351029] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-21T17:51:15.970958] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T17:51:16.002152] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-21T17:51:16.151010] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-21T17:51:16.458768] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T17:51:16.578840] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-21T17:51:16.951042] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-21T17:51:17.751036] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-21T17:51:18.527603] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T17:51:18.536241] [INFO ] [REMOTE ] CC: Full fetch complete (76191 records). [2025-10-21T17:51:18.536390] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-21T17:51:18.558148] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-21T17:51:18.931559] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-21T17:51:18.931663] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-21T17:51:18.932503] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-21T17:51:18.932546] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-21T17:51:18.933976] [DEBUG] [LOCAL ] CC: Trimmed 76191 records to 53021 (keeping 200 days of data) [2025-10-21T17:51:19.252581] [DEBUG] [LOCAL ] CC: Primary data saved (53021 records). [2025-10-21T17:51:19.252740] [INFO ] [MAIN ] CC: Full history saved. [2025-10-21T17:51:19.252846] [INFO ] [MAIN ] Update Progress: 408/2366 symbols completed. CC took 32.3s. Estimated remaining: 4h 5m 58s. Rate: 8.0 symbols/min [2025-10-21T17:51:19.354534] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-21T17:51:19.439497] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:19.475778] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T17:51:19.500074] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-21T17:51:19.500421] [INFO ] [MAIN ] CCJ: Loaded 53690 existing records. [2025-10-21T17:51:19.704543] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:19.704909] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-21T17:51:19.726331] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-21T17:51:19.739308] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-21T17:51:19.740740] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T17:51:19.740882] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-21T17:51:19.966844] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T17:51:20.156515] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-21T17:51:20.190774] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:20.951018] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-21T17:51:21.050297] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T17:51:21.751047] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-21T17:51:22.551061] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-21T17:51:22.932219] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:51:23.154567] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T17:51:23.351097] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-21T17:51:23.968676] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T17:51:24.079849] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T17:51:24.151063] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-21T17:51:24.951038] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-21T17:51:25.751061] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-21T17:51:25.979336] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T17:51:26.064774] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T17:51:26.551047] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-21T17:51:27.351035] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-21T17:51:27.830097] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T17:51:27.859165] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T17:51:27.867535] [INFO ] [REMOTE ] CCI: Full fetch complete (77095 records). [2025-10-21T17:51:27.867703] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-21T17:51:28.153029] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-21T17:51:28.289342] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-21T17:51:28.289492] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-21T17:51:28.290439] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-21T17:51:28.290523] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-21T17:51:28.292106] [DEBUG] [LOCAL ] CCI: Trimmed 77095 records to 53111 (keeping 200 days of data) [2025-10-21T17:51:28.640837] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T17:51:28.667855] [DEBUG] [LOCAL ] CCI: Primary data saved (53111 records). [2025-10-21T17:51:28.668010] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-21T17:51:28.668378] [INFO ] [MAIN ] Update Progress: 409/2366 symbols completed. CCI took 34.6s. Estimated remaining: 4h 5m 59s. Rate: 8.0 symbols/min [2025-10-21T17:51:28.842847] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:28.884733] [DEBUG] [LOCAL ] CCK: Loaded 46482 existing records from primary storage. [2025-10-21T17:51:28.885036] [INFO ] [MAIN ] CCK: Loaded 46482 existing records. [2025-10-21T17:51:28.958745] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-21T17:51:29.067336] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:29.067620] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-21T17:51:29.067710] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-21T17:51:29.068173] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-21T17:51:29.068247] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-21T17:51:29.338060] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T17:51:29.446627] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:29.751042] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-21T17:51:30.551044] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-21T17:51:30.846129] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T17:51:30.872187] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-21T17:51:31.047174] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T17:51:31.351019] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-21T17:51:32.151031] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-21T17:51:32.951006] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-21T17:51:33.122928] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T17:51:33.356112] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:51:33.751042] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-21T17:51:34.202358] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T17:51:34.551003] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-21T17:51:34.700348] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T17:51:34.820599] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-21T17:51:35.351013] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-21T17:51:36.151016] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-21T17:51:36.938335] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T17:51:36.939264] [INFO ] [REMOTE ] CCIA: Full fetch complete (2178 records). [2025-10-21T17:51:36.939330] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-21T17:51:36.960721] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-21T17:51:37.124853] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T17:51:37.125056] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:51:37.125123] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:51:37.125195] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-21T17:51:37.125270] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-21T17:51:37.125324] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-21T17:51:37.125366] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-21T17:51:37.125425] [INFO ] [MAIN ] Update Progress: 410/2366 symbols completed. CCIA took 28.5s. Estimated remaining: 4h 5m 56s. Rate: 8.0 symbols/min [2025-10-21T17:51:37.291067] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:37.341473] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-21T17:51:37.341797] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-21T17:51:37.527816] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:37.528052] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-21T17:51:37.528137] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-21T17:51:37.529171] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-21T17:51:37.529243] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-21T17:51:37.755895] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-21T17:51:37.848134] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T17:51:37.866515] [INFO ] [REMOTE ] CCIF: Full fetch complete (21880 records). [2025-10-21T17:51:37.892988] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-21T17:51:38.059839] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:38.068620] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-21T17:51:38.355963] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-21T17:51:38.356037] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-21T17:51:38.356352] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-21T17:51:38.356390] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-21T17:51:38.356991] [DEBUG] [LOCAL ] CCIF: Trimmed 21880 records to 15216 (keeping 200 days of data) [2025-10-21T17:51:38.440975] [DEBUG] [LOCAL ] CCIF: Primary data saved (15216 records). [2025-10-21T17:51:38.441094] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-21T17:51:38.441168] [INFO ] [MAIN ] Update Progress: 411/2366 symbols completed. CCIF took 26.4s. Estimated remaining: 4h 5m 19s. Rate: 8.0 symbols/min [2025-10-21T17:51:38.556210] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-21T17:51:38.612236] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:38.654762] [DEBUG] [LOCAL ] CCO: Loaded 48483 existing records from primary storage. [2025-10-21T17:51:38.655043] [INFO ] [MAIN ] CCO: Loaded 48483 existing records. [2025-10-21T17:51:38.829960] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:38.830180] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-21T17:51:38.830236] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-21T17:51:38.831061] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-21T17:51:38.831121] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-21T17:51:39.192140] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:39.351005] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-21T17:51:39.385732] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:51:40.151015] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-21T17:51:40.879105] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T17:51:40.950986] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-21T17:51:41.119349] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-21T17:51:41.375314] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T17:51:41.751019] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-21T17:51:42.418922] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T17:51:42.550988] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-21T17:51:43.351010] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-21T17:51:44.027977] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T17:51:44.079453] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T17:51:44.150982] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-21T17:51:44.951001] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-21T17:51:45.034449] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T17:51:45.751041] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-21T17:51:46.295562] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T17:51:46.445381] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T17:51:46.551013] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-21T17:51:47.351015] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-21T17:51:47.716047] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T17:51:48.162827] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-21T17:51:48.196690] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T17:51:48.951019] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-21T17:51:49.547707] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T17:51:49.751012] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-21T17:51:50.543490] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T17:51:50.552849] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-21T17:51:50.648932] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-21T17:51:51.351017] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-21T17:51:52.150991] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-21T17:51:52.179181] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-10-21T17:51:52.188540] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-21T17:51:52.188725] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-21T17:51:52.565948] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-21T17:51:52.679938] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-21T17:51:52.680035] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-21T17:51:52.681177] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-21T17:51:52.681246] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-21T17:51:52.683041] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53690 (keeping 200 days of data) [2025-10-21T17:51:52.956693] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-21T17:51:52.998920] [DEBUG] [LOCAL ] CCJ: Primary data saved (53690 records). [2025-10-21T17:51:52.999071] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-21T17:51:52.999154] [INFO ] [MAIN ] Update Progress: 412/2366 symbols completed. CCJ took 33.7s. Estimated remaining: 4h 5m 45s. Rate: 8.0 symbols/min [2025-10-21T17:51:53.163442] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:51:53.174282] [DEBUG] [LOCAL ] CCRD: Loaded 9603 existing records from primary storage. [2025-10-21T17:51:53.174476] [INFO ] [MAIN ] CCRD: Loaded 9603 existing records. [2025-10-21T17:51:53.348281] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:51:53.348596] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-21T17:51:53.348685] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-21T17:51:53.348868] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-21T17:51:53.348929] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-21T17:51:53.707015] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:51:53.732458] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:51:53.750987] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-21T17:51:54.039738] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-21T17:51:54.551087] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-21T17:51:54.592285] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T17:51:55.190027] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T17:51:55.351017] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-21T17:51:55.939905] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-21T17:51:56.150997] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-21T17:51:56.684948] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T17:51:56.951075] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-21T17:51:57.759210] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-21T17:51:57.779038] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:51:58.551050] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-21T17:51:58.939773] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-21T17:51:59.141807] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T17:51:59.351002] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-21T17:51:59.422299] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:52:00.151026] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-21T17:52:00.951024] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-21T17:52:01.751020] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-21T17:52:01.845580] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-21T17:52:01.897896] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T17:52:02.327818] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T17:52:02.551008] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-21T17:52:02.629060] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T17:52:03.351017] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-21T17:52:04.151029] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-21T17:52:04.897947] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T17:52:04.929952] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-21T17:52:04.950971] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-21T17:52:05.103201] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:52:05.110922] [INFO ] [REMOTE ] CCO: Full fetch complete (67273 records). [2025-10-21T17:52:05.111042] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-21T17:52:05.504258] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-21T17:52:05.504333] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-21T17:52:05.505100] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-21T17:52:05.505162] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-21T17:52:05.506386] [DEBUG] [LOCAL ] CCO: Trimmed 67273 records to 48523 (keeping 200 days of data) [2025-10-21T17:52:05.760534] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-21T17:52:05.769151] [DEBUG] [LOCAL ] CCO: Primary data saved (48523 records). [2025-10-21T17:52:05.769225] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-21T17:52:05.769974] [INFO ] [MAIN ] Update Progress: 413/2366 symbols completed. CCO took 27.3s. Estimated remaining: 4h 6m 2s. Rate: 7.9 symbols/min [2025-10-21T17:52:05.936286] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:05.968456] [DEBUG] [LOCAL ] CCS: Loaded 30084 existing records from primary storage. [2025-10-21T17:52:05.968739] [INFO ] [MAIN ] CCS: Loaded 30084 existing records. [2025-10-21T17:52:06.146846] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:06.147078] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-21T17:52:06.147130] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-21T17:52:06.147327] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-21T17:52:06.147383] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-21T17:52:06.507739] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:06.550982] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-21T17:52:07.324734] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-21T17:52:07.350986] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-21T17:52:07.897965] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T17:52:07.905417] [INFO ] [REMOTE ] CCK: Full fetch complete (68086 records). [2025-10-21T17:52:07.905535] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-21T17:52:08.102750] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T17:52:08.162996] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-21T17:52:08.331102] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-21T17:52:08.331183] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-21T17:52:08.332030] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-21T17:52:08.332094] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-21T17:52:08.333487] [DEBUG] [LOCAL ] CCK: Trimmed 68086 records to 46497 (keeping 200 days of data) [2025-10-21T17:52:08.610176] [DEBUG] [LOCAL ] CCK: Primary data saved (46497 records). [2025-10-21T17:52:08.610304] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-21T17:52:08.610867] [INFO ] [MAIN ] Update Progress: 414/2366 symbols completed. CCK took 39.9s. Estimated remaining: 4h 5m 32s. Rate: 7.9 symbols/min [2025-10-21T17:52:08.780938] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:08.804555] [DEBUG] [LOCAL ] CCU: Loaded 21982 existing records from primary storage. [2025-10-21T17:52:08.804818] [INFO ] [MAIN ] CCU: Loaded 21982 existing records. [2025-10-21T17:52:08.959085] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-21T17:52:08.990460] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:08.991302] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-21T17:52:08.991355] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-21T17:52:08.991502] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-21T17:52:08.991540] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-21T17:52:09.079587] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:52:09.366663] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:09.751050] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-21T17:52:09.800797] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-21T17:52:09.810431] [INFO ] [REMOTE ] CCL: Full fetch complete (77590 records). [2025-10-21T17:52:09.810617] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-21T17:52:09.811542] [FATAL] [VALIDATOR ] CCL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:52:09.811637] [FATAL] [MAIN ] CCL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:52:09.811719] [WARN ] [MAIN ] CCL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:52:09.811764] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-21T17:52:09.811824] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-10-21T17:52:09.811861] [INFO ] [LOCAL ] CCL: Starting deletion of derivative data. [2025-10-21T17:52:09.812018] [DEBUG] [LOCAL ] CCL: Deleted derivative data file. [2025-10-21T17:52:09.812901] [INFO ] [MAIN ] Update Progress: 415/2366 symbols completed. CCL took 32.7s. Estimated remaining: 4h 4m 55s. Rate: 8.0 symbols/min [2025-10-21T17:52:09.990420] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:09.990615] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-21T17:52:09.990693] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-21T17:52:09.990811] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-21T17:52:09.990854] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-21T17:52:09.990894] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-21T17:52:09.990925] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-21T17:52:10.374325] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:10.395928] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:52:10.550996] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-21T17:52:10.918220] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T17:52:10.932096] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-21T17:52:11.351071] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-21T17:52:12.151106] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-21T17:52:12.650518] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:52:12.951126] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-21T17:52:13.111519] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T17:52:13.751054] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-21T17:52:14.298144] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T17:52:14.551003] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-21T17:52:14.611625] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T17:52:14.818073] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-21T17:52:15.351050] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-21T17:52:16.151121] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-21T17:52:16.172474] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T17:52:16.387191] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-21T17:52:16.951029] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-21T17:52:17.265713] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-21T17:52:17.751045] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-21T17:52:18.551100] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-21T17:52:18.747984] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T17:52:19.351002] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-21T17:52:19.579529] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-21T17:52:19.649390] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T17:52:20.151039] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-21T17:52:20.951031] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-21T17:52:21.485014] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:52:21.751014] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-21T17:52:21.872326] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T17:52:22.115588] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:52:22.115907] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-21T17:52:22.115996] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:52:22.116070] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-21T17:52:22.116131] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:52:22.116203] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-21T17:52:22.116264] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-21T17:52:22.116299] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-21T17:52:22.116339] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-21T17:52:22.116385] [INFO ] [MAIN ] Update Progress: 416/2366 symbols completed. CCZ took 12.3s. Estimated remaining: 4h 5m 10s. Rate: 8.0 symbols/min [2025-10-21T17:52:22.286099] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:22.340283] [DEBUG] [LOCAL ] CDE: Loaded 53643 existing records from primary storage. [2025-10-21T17:52:22.340574] [INFO ] [MAIN ] CDE: Loaded 53643 existing records. [2025-10-21T17:52:22.523209] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:22.523410] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-21T17:52:22.523457] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-21T17:52:22.523822] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-21T17:52:22.523880] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-21T17:52:22.556129] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-21T17:52:22.894062] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:23.162153] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T17:52:23.163998] [INFO ] [REMOTE ] CCRD: Full fetch complete (11799 records). [2025-10-21T17:52:23.164066] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-21T17:52:23.356173] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-21T17:52:23.525120] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-21T17:52:23.525204] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-21T17:52:23.525466] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-21T17:52:23.525549] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-21T17:52:23.526104] [DEBUG] [LOCAL ] CCRD: Trimmed 11799 records to 9582 (keeping 200 days of data) [2025-10-21T17:52:23.580820] [DEBUG] [LOCAL ] CCRD: Primary data saved (9582 records). [2025-10-21T17:52:23.580956] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-21T17:52:23.581035] [INFO ] [MAIN ] Update Progress: 417/2366 symbols completed. CCRD took 30.6s. Estimated remaining: 4h 4m 34s. Rate: 8.0 symbols/min [2025-10-21T17:52:23.747082] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:23.758274] [DEBUG] [LOCAL ] CDLR: Loaded 10221 existing records from primary storage. [2025-10-21T17:52:23.758464] [INFO ] [MAIN ] CDLR: Loaded 10221 existing records. [2025-10-21T17:52:23.930285] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:23.930493] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-21T17:52:23.930540] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-21T17:52:23.930702] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-21T17:52:23.930758] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-21T17:52:24.156166] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-21T17:52:24.291765] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:24.840011] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T17:52:24.951018] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-21T17:52:25.330514] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T17:52:25.751024] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-21T17:52:26.237537] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T17:52:26.551057] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-21T17:52:27.233484] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:52:27.258506] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T17:52:27.351045] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-21T17:52:28.151067] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-21T17:52:28.951058] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-21T17:52:29.283404] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T17:52:29.497102] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T17:52:29.751052] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-21T17:52:30.024319] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T17:52:30.293739] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-21T17:52:30.551054] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-21T17:52:31.351035] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-21T17:52:31.794981] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:52:32.151116] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-21T17:52:32.602729] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T17:52:32.951062] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-21T17:52:33.144058] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T17:52:33.526620] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T17:52:33.751060] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-21T17:52:34.551004] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-21T17:52:35.351062] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-21T17:52:35.588247] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T17:52:36.034119] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T17:52:36.049630] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T17:52:36.151010] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-21T17:52:36.951020] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-21T17:52:37.487631] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T17:52:37.492249] [INFO ] [REMOTE ] CCS: Full fetch complete (44757 records). [2025-10-21T17:52:37.492353] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-21T17:52:37.611293] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T17:52:37.756203] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-21T17:52:37.900248] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-21T17:52:37.900333] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-21T17:52:37.900971] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-21T17:52:37.901057] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-21T17:52:37.902120] [DEBUG] [LOCAL ] CCS: Trimmed 44757 records to 30011 (keeping 200 days of data) [2025-10-21T17:52:38.081712] [DEBUG] [LOCAL ] CCS: Primary data saved (30011 records). [2025-10-21T17:52:38.081840] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-21T17:52:38.081915] [INFO ] [MAIN ] Update Progress: 418/2366 symbols completed. CCS took 32.3s. Estimated remaining: 4h 4m 59s. Rate: 8.0 symbols/min [2025-10-21T17:52:38.248660] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:38.248841] [DEBUG] [LOCAL ] CDP: No existing data file found in primary storage. [2025-10-21T17:52:38.248886] [WARN ] [MAIN ] CDP: No existing data found, performing full refresh instead. [2025-10-21T17:52:38.249049] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-21T17:52:38.249091] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-21T17:52:38.249130] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-10-21T17:52:38.249159] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-21T17:52:38.565014] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-21T17:52:38.606140] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:38.818956] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T17:52:38.822341] [INFO ] [REMOTE ] CCU: Full fetch complete (32490 records). [2025-10-21T17:52:38.822474] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-21T17:52:39.194231] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-21T17:52:39.194313] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-21T17:52:39.194867] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-21T17:52:39.194929] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-21T17:52:39.195725] [DEBUG] [LOCAL ] CCU: Trimmed 32490 records to 21804 (keeping 200 days of data) [2025-10-21T17:52:39.321425] [DEBUG] [LOCAL ] CCU: Primary data saved (21804 records). [2025-10-21T17:52:39.321555] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-21T17:52:39.321631] [INFO ] [MAIN ] Update Progress: 419/2366 symbols completed. CCU took 30.7s. Estimated remaining: 4h 4m 22s. Rate: 8.0 symbols/min [2025-10-21T17:52:39.352869] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-21T17:52:39.432556] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T17:52:39.519061] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:39.544748] [DEBUG] [LOCAL ] CDRE: Loaded 24879 existing records from primary storage. [2025-10-21T17:52:39.545020] [INFO ] [MAIN ] CDRE: Loaded 24879 existing records. [2025-10-21T17:52:39.735217] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:39.735509] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-21T17:52:39.735566] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-21T17:52:39.736342] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-21T17:52:39.736401] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-21T17:52:40.091077] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:40.151063] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-21T17:52:40.933718] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:52:40.950973] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-21T17:52:41.751060] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-21T17:52:42.128116] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:52:42.348298] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:52:42.551051] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-21T17:52:42.960007] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T17:52:43.351068] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-21T17:52:44.151001] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-21T17:52:44.307971] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T17:52:44.490750] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T17:52:44.951030] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-21T17:52:45.690485] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T17:52:45.751014] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-21T17:52:45.874861] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T17:52:46.551006] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-21T17:52:47.351010] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-21T17:52:47.482400] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T17:52:47.772707] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T17:52:48.151071] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-21T17:52:48.189550] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:52:48.951031] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-21T17:52:49.398890] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T17:52:49.751039] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-21T17:52:50.551016] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-21T17:52:50.624093] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T17:52:50.849153] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T17:52:51.351051] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-21T17:52:52.116370] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T17:52:52.151022] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-21T17:52:52.199970] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T17:52:52.951002] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-21T17:52:53.000026] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T17:52:53.751028] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-21T17:52:54.551011] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-21T17:52:54.904039] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T17:52:55.046409] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T17:52:55.350990] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-21T17:52:55.568792] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T17:52:55.571586] [INFO ] [REMOTE ] CDLR: Full fetch complete (14179 records). [2025-10-21T17:52:55.571722] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-21T17:52:55.940936] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-21T17:52:55.941010] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-21T17:52:55.941304] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-21T17:52:55.941340] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-21T17:52:55.941841] [DEBUG] [LOCAL ] CDLR: Trimmed 14179 records to 10233 (keeping 200 days of data) [2025-10-21T17:52:56.000046] [DEBUG] [LOCAL ] CDLR: Primary data saved (10233 records). [2025-10-21T17:52:56.000181] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-21T17:52:56.000255] [INFO ] [MAIN ] Update Progress: 420/2366 symbols completed. CDLR took 32.4s. Estimated remaining: 4h 4m 57s. Rate: 7.9 symbols/min [2025-10-21T17:52:56.151913] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-21T17:52:56.170611] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:52:56.216448] [DEBUG] [LOCAL ] CE: Loaded 51312 existing records from primary storage. [2025-10-21T17:52:56.216778] [INFO ] [MAIN ] CE: Loaded 51312 existing records. [2025-10-21T17:52:56.397092] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:52:56.397342] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-21T17:52:56.397431] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-21T17:52:56.398059] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-21T17:52:56.398144] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-21T17:52:56.660218] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T17:52:56.775418] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:52:56.951015] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-21T17:52:57.760316] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-21T17:52:57.765332] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T17:52:58.551047] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-21T17:52:58.766632] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T17:52:58.987227] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T17:52:59.351090] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-21T17:53:00.151012] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-21T17:53:00.529783] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:53:00.774121] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:53:00.951028] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-21T17:53:01.757995] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-21T17:53:01.775921] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T17:53:02.550992] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-21T17:53:02.824735] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T17:53:02.945235] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T17:53:03.351034] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-21T17:53:04.151077] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-21T17:53:04.951104] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-21T17:53:04.999292] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-21T17:53:05.009129] [INFO ] [REMOTE ] CDE: Full fetch complete (77788 records). [2025-10-21T17:53:05.009337] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-21T17:53:05.655966] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:53:05.665235] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-21T17:53:05.701490] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-21T17:53:05.707728] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-21T17:53:05.707942] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-21T17:53:05.712292] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-21T17:53:05.727013] [DEBUG] [LOCAL ] CDE: Trimmed 77788 records to 53644 (keeping 200 days of data) [2025-10-21T17:53:05.787688] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-21T17:53:06.161978] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-21T17:53:06.162144] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-21T17:53:06.162977] [INFO ] [MAIN ] Update Progress: 421/2366 symbols completed. CDE took 44.0s. Estimated remaining: 4h 5m 1s. Rate: 7.9 symbols/min [2025-10-21T17:53:06.368458] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:06.406710] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T17:53:06.419923] [DEBUG] [LOCAL ] CEE: Loaded 5304 existing records from primary storage. [2025-10-21T17:53:06.420573] [INFO ] [MAIN ] CEE: Loaded 5304 existing records. [2025-10-21T17:53:06.556166] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-21T17:53:06.616038] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:06.616426] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-21T17:53:06.616477] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-21T17:53:06.616632] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-21T17:53:06.616713] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-21T17:53:06.944958] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T17:53:07.014802] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:07.351021] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-21T17:53:07.948958] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T17:53:07.956386] [INFO ] [REMOTE ] CDP: Full fetch complete (62036 records). [2025-10-21T17:53:07.956614] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-21T17:53:08.158347] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-21T17:53:08.370345] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-21T17:53:08.370468] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-21T17:53:08.371298] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-21T17:53:08.371363] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-21T17:53:08.372703] [DEBUG] [LOCAL ] CDP: Trimmed 62036 records to 42295 (keeping 200 days of data) [2025-10-21T17:53:08.634066] [DEBUG] [LOCAL ] CDP: Primary data saved (42295 records). [2025-10-21T17:53:08.634193] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-21T17:53:08.634260] [INFO ] [MAIN ] Update Progress: 422/2366 symbols completed. CDP took 30.6s. Estimated remaining: 4h 4m 30s. Rate: 8.0 symbols/min [2025-10-21T17:53:08.823349] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:08.830908] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T17:53:08.846471] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T17:53:08.851951] [INFO ] [REMOTE ] CDRE: Full fetch complete (35010 records). [2025-10-21T17:53:08.852185] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-21T17:53:08.951414] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-21T17:53:08.983349] [DEBUG] [LOCAL ] CEPU: Loaded 26925 existing records from primary storage. [2025-10-21T17:53:09.010183] [INFO ] [MAIN ] CEPU: Loaded 26925 existing records. [2025-10-21T17:53:09.393521] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:09.418673] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-21T17:53:09.428927] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-21T17:53:09.439342] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-21T17:53:09.456521] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-21T17:53:09.504040] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-21T17:53:09.516544] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-21T17:53:09.530309] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-21T17:53:09.530396] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-21T17:53:09.581709] [DEBUG] [LOCAL ] CDRE: Trimmed 35010 records to 24817 (keeping 200 days of data) [2025-10-21T17:53:09.755068] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-21T17:53:09.943538] [DEBUG] [LOCAL ] CDRE: Primary data saved (24817 records). [2025-10-21T17:53:09.972099] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-21T17:53:10.011721] [INFO ] [MAIN ] Update Progress: 423/2366 symbols completed. CDRE took 30.7s. Estimated remaining: 4h 3m 54s. Rate: 8.0 symbols/min [2025-10-21T17:53:10.015616] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T17:53:10.018761] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:10.205163] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:10.262244] [DEBUG] [LOCAL ] CF: Loaded 52126 existing records from primary storage. [2025-10-21T17:53:10.262798] [INFO ] [MAIN ] CF: Loaded 52126 existing records. [2025-10-21T17:53:10.453018] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:10.453318] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-21T17:53:10.453433] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-21T17:53:10.454115] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-21T17:53:10.454175] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-21T17:53:10.560958] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-21T17:53:10.833938] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:11.350985] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-21T17:53:11.716044] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:53:11.891995] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-21T17:53:12.151030] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-21T17:53:12.721094] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T17:53:12.888706] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T17:53:12.951129] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-21T17:53:13.344594] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-21T17:53:13.750995] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-21T17:53:14.551028] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-21T17:53:15.351016] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-21T17:53:15.692796] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T17:53:16.151091] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-21T17:53:16.768715] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-21T17:53:16.956189] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-21T17:53:16.968882] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T17:53:17.751028] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-21T17:53:17.939586] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:53:18.380020] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T17:53:18.556119] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-21T17:53:18.578076] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T17:53:19.125785] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T17:53:19.351039] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-21T17:53:20.151077] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-21T17:53:20.951031] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-21T17:53:21.349112] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T17:53:21.722286] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T17:53:21.751034] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-21T17:53:21.948624] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T17:53:22.551097] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-21T17:53:22.603792] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T17:53:23.351079] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-21T17:53:24.151095] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-21T17:53:24.596680] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T17:53:24.951066] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-21T17:53:25.106561] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T17:53:25.405508] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T17:53:25.751086] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-21T17:53:26.551072] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-21T17:53:26.575186] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T17:53:26.583093] [INFO ] [REMOTE ] CE: Full fetch complete (74831 records). [2025-10-21T17:53:26.583218] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-21T17:53:26.972283] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-21T17:53:26.972440] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-21T17:53:26.973315] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-21T17:53:26.973394] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-21T17:53:26.993948] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T17:53:27.001236] [DEBUG] [LOCAL ] CE: Trimmed 74831 records to 51289 (keeping 200 days of data) [2025-10-21T17:53:27.302972] [DEBUG] [LOCAL ] CE: Primary data saved (51289 records). [2025-10-21T17:53:27.303109] [INFO ] [MAIN ] CE: Full history saved. [2025-10-21T17:53:27.303206] [INFO ] [MAIN ] Update Progress: 424/2366 symbols completed. CE took 31.3s. Estimated remaining: 4h 4m 32s. Rate: 7.9 symbols/min [2025-10-21T17:53:27.356772] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-21T17:53:27.414094] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T17:53:27.486265] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:27.535769] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-21T17:53:27.536096] [INFO ] [MAIN ] CFG: Loaded 53623 existing records. [2025-10-21T17:53:27.710798] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:27.711007] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-21T17:53:27.711085] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-21T17:53:27.711296] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-21T17:53:27.711334] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-21T17:53:28.064448] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:28.151020] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-21T17:53:28.444782] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T17:53:28.951016] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-21T17:53:29.655443] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T17:53:29.751008] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-21T17:53:30.077069] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:53:30.551031] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-21T17:53:31.197275] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T17:53:31.198527] [INFO ] [REMOTE ] CEE: Full fetch complete (10176 records). [2025-10-21T17:53:31.198600] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-21T17:53:31.355932] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-21T17:53:31.583741] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-21T17:53:31.583876] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-21T17:53:31.584202] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-21T17:53:31.584279] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-21T17:53:31.595266] [DEBUG] [LOCAL ] CEE: Trimmed 10176 records to 5247 (keeping 200 days of data) [2025-10-21T17:53:31.614412] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T17:53:31.657664] [DEBUG] [LOCAL ] CEE: Primary data saved (5247 records). [2025-10-21T17:53:31.657855] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-21T17:53:31.657949] [INFO ] [MAIN ] Update Progress: 425/2366 symbols completed. CEE took 25.5s. Estimated remaining: 4h 4m 9s. Rate: 7.9 symbols/min [2025-10-21T17:53:31.836386] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:31.836604] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-21T17:53:31.836663] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-21T17:53:31.836787] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-21T17:53:31.836828] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-21T17:53:31.836868] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-21T17:53:31.836899] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-21T17:53:32.156226] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-21T17:53:32.194523] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:32.643523] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T17:53:32.951085] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-21T17:53:33.757847] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-21T17:53:33.781769] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:53:33.998354] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:53:33.998683] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-21T17:53:33.998768] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:53:33.998813] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-21T17:53:33.998871] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:53:33.998940] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-21T17:53:33.999001] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-21T17:53:33.999036] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-21T17:53:33.999102] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-21T17:53:33.999170] [INFO ] [MAIN ] Update Progress: 426/2366 symbols completed. CFND took 2.3s. Estimated remaining: 4h 3m 38s. Rate: 8.0 symbols/min [2025-10-21T17:53:34.173356] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T17:53:34.190990] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:34.234268] [DEBUG] [LOCAL ] CFR: Loaded 32637 existing records from primary storage. [2025-10-21T17:53:34.234552] [INFO ] [MAIN ] CFR: Loaded 32637 existing records. [2025-10-21T17:53:34.418556] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:34.418813] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-21T17:53:34.418873] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-21T17:53:34.419427] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-21T17:53:34.419484] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-21T17:53:34.562069] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-21T17:53:34.809538] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:35.351055] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-21T17:53:36.151025] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-21T17:53:36.553538] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:53:36.612114] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T17:53:36.951028] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-21T17:53:37.751068] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-21T17:53:37.913848] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T17:53:38.551081] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-21T17:53:38.926580] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T17:53:39.239324] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T17:53:39.244760] [INFO ] [REMOTE ] CEPU: Full fetch complete (39758 records). [2025-10-21T17:53:39.244864] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-21T17:53:39.356093] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-21T17:53:39.630948] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-21T17:53:39.631025] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-21T17:53:39.631612] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-21T17:53:39.631679] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-21T17:53:39.632576] [DEBUG] [LOCAL ] CEPU: Trimmed 39758 records to 27014 (keeping 200 days of data) [2025-10-21T17:53:39.784982] [DEBUG] [LOCAL ] CEPU: Primary data saved (27014 records). [2025-10-21T17:53:39.785150] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-21T17:53:39.785263] [INFO ] [MAIN ] Update Progress: 427/2366 symbols completed. CEPU took 31.2s. Estimated remaining: 4h 3m 23s. Rate: 8.0 symbols/min [2025-10-21T17:53:39.958471] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:39.996864] [DEBUG] [LOCAL ] CGAU: Loaded 43818 existing records from primary storage. [2025-10-21T17:53:39.997151] [INFO ] [MAIN ] CGAU: Loaded 43818 existing records. [2025-10-21T17:53:40.164859] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T17:53:40.164016] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-21T17:53:40.208614] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:40.209300] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-21T17:53:40.209354] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-21T17:53:40.209631] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-21T17:53:40.209719] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-21T17:53:40.570358] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:40.951017] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-21T17:53:41.198431] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T17:53:41.751094] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-21T17:53:42.176276] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T17:53:42.315923] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T17:53:42.551086] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-21T17:53:43.139138] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T17:53:43.351093] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-21T17:53:44.151029] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-21T17:53:44.186224] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T17:53:44.774032] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:53:44.951058] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-21T17:53:45.417717] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T17:53:45.751041] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-21T17:53:46.551077] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-21T17:53:46.652565] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:53:47.351017] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-21T17:53:47.687144] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T17:53:48.038182] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T17:53:48.151027] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-21T17:53:48.951052] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-21T17:53:49.009218] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T17:53:49.017259] [INFO ] [REMOTE ] CF: Full fetch complete (75580 records). [2025-10-21T17:53:49.017382] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-21T17:53:49.323780] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T17:53:49.446815] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-21T17:53:49.446904] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-21T17:53:49.447757] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-21T17:53:49.447821] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-21T17:53:49.449221] [DEBUG] [LOCAL ] CF: Trimmed 75580 records to 52111 (keeping 200 days of data) [2025-10-21T17:53:49.752909] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-21T17:53:49.761264] [DEBUG] [LOCAL ] CF: Primary data saved (52111 records). [2025-10-21T17:53:49.761346] [INFO ] [MAIN ] CF: Full history saved. [2025-10-21T17:53:49.761770] [INFO ] [MAIN ] Update Progress: 428/2366 symbols completed. CF took 39.7s. Estimated remaining: 4h 3m 26s. Rate: 8.0 symbols/min [2025-10-21T17:53:49.934794] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:49.938002] [DEBUG] [LOCAL ] CGV: Loaded 1384 existing records from primary storage. [2025-10-21T17:53:49.938178] [INFO ] [MAIN ] CGV: Loaded 1384 existing records. [2025-10-21T17:53:50.119163] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:50.119356] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-21T17:53:50.119493] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-21T17:53:50.119743] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-21T17:53:50.119810] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-21T17:53:50.286928] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T17:53:50.504558] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:50.551006] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-21T17:53:51.075530] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T17:53:51.351000] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-21T17:53:51.516343] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T17:53:52.151080] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-21T17:53:52.540107] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:53:52.951076] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-21T17:53:53.751091] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-21T17:53:54.290054] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T17:53:54.298429] [INFO ] [REMOTE ] CFG: Full fetch complete (77763 records). [2025-10-21T17:53:54.298553] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-21T17:53:54.562724] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-21T17:53:54.669722] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T17:53:54.724963] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-21T17:53:54.725043] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-21T17:53:54.725923] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-21T17:53:54.725988] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-21T17:53:54.727365] [DEBUG] [LOCAL ] CFG: Trimmed 77763 records to 53623 (keeping 200 days of data) [2025-10-21T17:53:55.041175] [DEBUG] [LOCAL ] CFG: Primary data saved (53623 records). [2025-10-21T17:53:55.041307] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-21T17:53:55.041382] [INFO ] [MAIN ] Update Progress: 429/2366 symbols completed. CFG took 27.7s. Estimated remaining: 4h 3m 8s. Rate: 8.0 symbols/min [2025-10-21T17:53:55.108528] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-21T17:53:55.216690] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:53:55.239935] [DEBUG] [LOCAL ] CHCT: Loaded 24343 existing records from primary storage. [2025-10-21T17:53:55.240195] [INFO ] [MAIN ] CHCT: Loaded 24343 existing records. [2025-10-21T17:53:55.361859] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-21T17:53:55.418177] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:53:55.418389] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-21T17:53:55.419382] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-21T17:53:55.420097] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-10-21T17:53:55.420191] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-21T17:53:55.558209] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T17:53:55.818801] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:53:55.821551] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T17:53:56.151032] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-21T17:53:56.951038] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-21T17:53:57.392298] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T17:53:57.751036] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-21T17:53:58.179272] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-21T17:53:58.298454] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T17:53:58.551069] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-21T17:53:59.351022] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-21T17:54:00.150995] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-21T17:54:00.212794] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:54:00.491507] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T17:54:00.553967] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:54:00.951048] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-21T17:54:01.751055] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-21T17:54:02.089056] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T17:54:02.551100] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-21T17:54:03.118237] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:54:03.351027] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-21T17:54:03.903548] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-21T17:54:04.151017] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-21T17:54:04.239807] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T17:54:04.951045] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-21T17:54:05.631062] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T17:54:05.751025] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-21T17:54:06.035896] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T17:54:06.551027] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-21T17:54:07.284406] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T17:54:07.351007] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-21T17:54:07.869299] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T17:54:08.151033] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-21T17:54:08.341027] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T17:54:08.951033] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-21T17:54:09.751077] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-21T17:54:10.031866] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T17:54:10.071906] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T17:54:10.079915] [INFO ] [REMOTE ] CGAU: Full fetch complete (62006 records). [2025-10-21T17:54:10.080049] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-21T17:54:10.472446] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-21T17:54:10.472527] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-21T17:54:10.473333] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-21T17:54:10.473396] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-21T17:54:10.474664] [DEBUG] [LOCAL ] CGAU: Trimmed 62006 records to 43896 (keeping 200 days of data) [2025-10-21T17:54:10.556498] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-21T17:54:10.726325] [DEBUG] [LOCAL ] CGAU: Primary data saved (43896 records). [2025-10-21T17:54:10.726451] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-21T17:54:10.726525] [INFO ] [MAIN ] Update Progress: 430/2366 symbols completed. CGAU took 30.9s. Estimated remaining: 4h 3m 38s. Rate: 7.9 symbols/min [2025-10-21T17:54:10.896922] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:10.947412] [DEBUG] [LOCAL ] CHD: Loaded 52329 existing records from primary storage. [2025-10-21T17:54:10.947727] [INFO ] [MAIN ] CHD: Loaded 52329 existing records. [2025-10-21T17:54:11.025212] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T17:54:11.129679] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:11.129900] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-21T17:54:11.129947] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-21T17:54:11.130743] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-21T17:54:11.130799] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-21T17:54:11.359291] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-21T17:54:11.473326] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T17:54:11.509954] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:11.510209] [INFO ] [REMOTE ] CFR: Full fetch complete (48548 records). [2025-10-21T17:54:11.510768] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-21T17:54:11.882522] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-21T17:54:11.882601] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-21T17:54:11.883267] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-21T17:54:11.883329] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-21T17:54:11.884277] [DEBUG] [LOCAL ] CFR: Trimmed 48548 records to 32535 (keeping 200 days of data) [2025-10-21T17:54:12.082594] [DEBUG] [LOCAL ] CFR: Primary data saved (32535 records). [2025-10-21T17:54:12.082779] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-21T17:54:12.083689] [INFO ] [MAIN ] Update Progress: 431/2366 symbols completed. CFR took 38.1s. Estimated remaining: 4h 3m 2s. Rate: 8.0 symbols/min [2025-10-21T17:54:12.158779] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-21T17:54:12.257739] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:12.278409] [DEBUG] [LOCAL ] CHE: Loaded 15304 existing records from primary storage. [2025-10-21T17:54:12.278712] [INFO ] [MAIN ] CHE: Loaded 15304 existing records. [2025-10-21T17:54:12.473481] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:12.473850] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-21T17:54:12.473986] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-21T17:54:12.479463] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-21T17:54:12.487660] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-21T17:54:12.522090] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T17:54:12.875988] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:12.951018] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-21T17:54:13.388174] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T17:54:13.751003] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-21T17:54:14.079995] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T17:54:14.551058] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-21T17:54:14.672880] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T17:54:15.020038] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T17:54:15.351048] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-21T17:54:16.151009] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-21T17:54:16.208479] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T17:54:16.951023] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-21T17:54:17.636892] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T17:54:17.637746] [INFO ] [REMOTE ] CGV: Full fetch complete (2217 records). [2025-10-21T17:54:17.637816] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-21T17:54:17.752935] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-21T17:54:18.052468] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T17:54:18.050907] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-21T17:54:18.061637] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-21T17:54:18.062818] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-21T17:54:18.062955] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-21T17:54:18.063602] [DEBUG] [LOCAL ] CGV: Trimmed 2217 records to 1377 (keeping 200 days of data) [2025-10-21T17:54:18.072591] [DEBUG] [LOCAL ] CGV: Primary data saved (1377 records). [2025-10-21T17:54:18.072693] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-21T17:54:18.072784] [INFO ] [MAIN ] Update Progress: 432/2366 symbols completed. CGV took 28.3s. Estimated remaining: 4h 2m 48s. Rate: 8.0 symbols/min [2025-10-21T17:54:18.239585] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:18.284391] [DEBUG] [LOCAL ] CHGG: Loaded 47673 existing records from primary storage. [2025-10-21T17:54:18.284700] [INFO ] [MAIN ] CHGG: Loaded 47673 existing records. [2025-10-21T17:54:18.459295] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:18.459512] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-21T17:54:18.459558] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-21T17:54:18.460332] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-21T17:54:18.460390] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-21T17:54:18.551682] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-21T17:54:18.822907] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:18.963692] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:54:19.351086] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-21T17:54:20.150996] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-21T17:54:20.237224] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T17:54:20.495095] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:54:20.951084] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-21T17:54:21.751057] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-21T17:54:21.943526] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T17:54:22.028359] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:54:22.551024] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-21T17:54:23.351004] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-21T17:54:23.548501] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T17:54:23.554332] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T17:54:24.151093] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-21T17:54:24.219321] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T17:54:24.951044] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-21T17:54:25.172370] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T17:54:25.751040] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-21T17:54:26.551032] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-21T17:54:26.860097] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T17:54:27.284925] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-21T17:54:27.350994] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-21T17:54:27.412947] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T17:54:28.150998] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-21T17:54:28.298203] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T17:54:28.950998] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-21T17:54:29.198698] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T17:54:29.683711] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T17:54:29.750985] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-21T17:54:30.551032] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-21T17:54:30.919499] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T17:54:30.922787] [INFO ] [REMOTE ] CHE: Full fetch complete (20437 records). [2025-10-21T17:54:30.922921] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-21T17:54:31.314403] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-21T17:54:31.314750] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-21T17:54:31.315182] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-21T17:54:31.315223] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-21T17:54:31.315962] [DEBUG] [LOCAL ] CHE: Trimmed 20437 records to 15306 (keeping 200 days of data) [2025-10-21T17:54:31.356884] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-21T17:54:31.414576] [DEBUG] [LOCAL ] CHE: Primary data saved (15306 records). [2025-10-21T17:54:31.414741] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-21T17:54:31.414828] [INFO ] [MAIN ] Update Progress: 433/2366 symbols completed. CHE took 19.3s. Estimated remaining: 4h 3m 6s. Rate: 8.0 symbols/min [2025-10-21T17:54:31.583025] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:31.615338] [DEBUG] [LOCAL ] CHH: Loaded 32329 existing records from primary storage. [2025-10-21T17:54:31.615598] [INFO ] [MAIN ] CHH: Loaded 32329 existing records. [2025-10-21T17:54:31.794010] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:31.794285] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-21T17:54:31.794331] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-21T17:54:31.795101] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-21T17:54:31.795159] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-21T17:54:32.151571] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-21T17:54:32.155455] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:32.388369] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T17:54:32.439578] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T17:54:32.444363] [INFO ] [REMOTE ] CHCT: Full fetch complete (34767 records). [2025-10-21T17:54:32.444494] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-21T17:54:32.812508] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-21T17:54:32.812586] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-21T17:54:32.813120] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-21T17:54:32.813180] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-21T17:54:32.813946] [DEBUG] [LOCAL ] CHCT: Trimmed 34767 records to 24339 (keeping 200 days of data) [2025-10-21T17:54:32.952273] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-21T17:54:32.957195] [DEBUG] [LOCAL ] CHCT: Primary data saved (24339 records). [2025-10-21T17:54:32.957319] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-21T17:54:32.957406] [INFO ] [MAIN ] Update Progress: 434/2366 symbols completed. CHCT took 37.9s. Estimated remaining: 4h 2m 32s. Rate: 8.0 symbols/min [2025-10-21T17:54:33.130147] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:33.150759] [DEBUG] [LOCAL ] CHMI: Loaded 21466 existing records from primary storage. [2025-10-21T17:54:33.151009] [INFO ] [MAIN ] CHMI: Loaded 21466 existing records. [2025-10-21T17:54:33.334151] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:33.334382] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-21T17:54:33.334430] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-21T17:54:33.334798] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-21T17:54:33.334856] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-21T17:54:33.683263] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:33.751049] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-21T17:54:34.034865] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:54:34.551036] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-21T17:54:34.755179] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T17:54:35.307715] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T17:54:35.350979] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-21T17:54:36.151059] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-21T17:54:36.215674] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:54:36.285159] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T17:54:36.951133] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-21T17:54:37.605760] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T17:54:37.751023] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-21T17:54:38.182879] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:54:38.551042] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-21T17:54:39.351026] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-21T17:54:39.591385] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T17:54:39.686535] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T17:54:40.151072] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-21T17:54:40.951075] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-21T17:54:41.139748] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T17:54:41.751008] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-21T17:54:41.896822] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:54:41.905772] [INFO ] [REMOTE ] CHD: Full fetch complete (74986 records). [2025-10-21T17:54:41.905962] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-21T17:54:42.098299] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T17:54:42.352743] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-21T17:54:42.352826] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-21T17:54:42.353702] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-21T17:54:42.353766] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-21T17:54:42.355156] [DEBUG] [LOCAL ] CHD: Trimmed 74986 records to 52328 (keeping 200 days of data) [2025-10-21T17:54:42.566252] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-21T17:54:42.671187] [DEBUG] [LOCAL ] CHD: Primary data saved (52328 records). [2025-10-21T17:54:42.671325] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-21T17:54:42.672226] [INFO ] [MAIN ] Update Progress: 435/2366 symbols completed. CHD took 31.9s. Estimated remaining: 4h 2m 34s. Rate: 8.0 symbols/min [2025-10-21T17:54:42.847469] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:42.855413] [DEBUG] [LOCAL ] CHN: Loaded 5002 existing records from primary storage. [2025-10-21T17:54:42.855668] [INFO ] [MAIN ] CHN: Loaded 5002 existing records. [2025-10-21T17:54:43.042935] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:43.043225] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-21T17:54:43.043287] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-21T17:54:43.043458] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-21T17:54:43.043497] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-21T17:54:43.356177] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-21T17:54:43.363775] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T17:54:43.455164] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:54:43.850768] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T17:54:44.151088] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-21T17:54:44.951040] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-21T17:54:44.976260] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T17:54:45.313442] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-21T17:54:45.751088] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-21T17:54:46.556977] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-21T17:54:46.561556] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T17:54:46.814543] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T17:54:46.990377] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T17:54:47.351019] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-21T17:54:48.151042] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-21T17:54:48.489022] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T17:54:48.721524] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T17:54:48.951081] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-21T17:54:49.751042] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-21T17:54:50.481229] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:54:50.551015] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-21T17:54:50.807390] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T17:54:51.351037] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-21T17:54:51.918610] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T17:54:52.045108] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T17:54:52.151098] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-21T17:54:52.594362] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T17:54:52.951056] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-21T17:54:53.751075] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-21T17:54:54.377938] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T17:54:54.379103] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T17:54:54.551020] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-21T17:54:55.351042] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-21T17:54:56.151014] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-21T17:54:56.479239] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T17:54:56.559026] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T17:54:56.951083] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-21T17:54:57.647046] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T17:54:57.751022] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-21T17:54:58.551012] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-21T17:54:58.670472] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T17:54:58.709044] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T17:54:58.712759] [INFO ] [REMOTE ] CHMI: Full fetch complete (31554 records). [2025-10-21T17:54:58.712833] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-21T17:54:59.069565] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-21T17:54:59.069662] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-21T17:54:59.070191] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-21T17:54:59.070233] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-21T17:54:59.070928] [DEBUG] [LOCAL ] CHMI: Trimmed 31554 records to 21355 (keeping 200 days of data) [2025-10-21T17:54:59.190091] [DEBUG] [LOCAL ] CHMI: Primary data saved (21355 records). [2025-10-21T17:54:59.190212] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-21T17:54:59.190285] [INFO ] [MAIN ] Update Progress: 436/2366 symbols completed. CHMI took 26.2s. Estimated remaining: 4h 3m 6s. Rate: 7.9 symbols/min [2025-10-21T17:54:59.356285] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-21T17:54:59.358809] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:54:59.406291] [DEBUG] [LOCAL ] CHPT: Loaded 47293 existing records from primary storage. [2025-10-21T17:54:59.406627] [INFO ] [MAIN ] CHPT: Loaded 47293 existing records. [2025-10-21T17:54:59.637294] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:54:59.637565] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-21T17:54:59.637732] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-21T17:54:59.638624] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-21T17:54:59.638720] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-21T17:54:59.986674] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T17:55:00.050753] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:00.151056] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-21T17:55:00.951029] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-21T17:55:01.352178] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T17:55:01.516245] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T17:55:01.751047] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-21T17:55:02.551036] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-21T17:55:02.986442] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.84 seconds). [2025-10-21T17:55:03.164354] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T17:55:03.351015] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-21T17:55:03.797716] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T17:55:03.804615] [INFO ] [REMOTE ] CHGG: Full fetch complete (69785 records). [2025-10-21T17:55:03.804753] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-21T17:55:03.805448] [FATAL] [VALIDATOR ] CHGG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:55:03.805536] [FATAL] [MAIN ] CHGG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:55:03.805580] [WARN ] [MAIN ] CHGG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:55:03.805688] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-21T17:55:03.805776] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-21T17:55:03.805823] [INFO ] [LOCAL ] CHGG: Starting deletion of derivative data. [2025-10-21T17:55:03.806029] [DEBUG] [LOCAL ] CHGG: Deleted derivative data file. [2025-10-21T17:55:03.806482] [INFO ] [MAIN ] Update Progress: 437/2366 symbols completed. CHGG took 45.7s. Estimated remaining: 4h 2m 46s. Rate: 7.9 symbols/min [2025-10-21T17:55:03.876036] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T17:55:04.151025] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-21T17:55:04.951020] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-21T17:55:05.708067] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T17:55:05.714465] [INFO ] [REMOTE ] CHH: Full fetch complete (47465 records). [2025-10-21T17:55:05.714596] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-21T17:55:05.763389] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-21T17:55:06.141420] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-21T17:55:06.141543] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-21T17:55:06.142318] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-21T17:55:06.142385] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-21T17:55:06.143473] [DEBUG] [LOCAL ] CHH: Trimmed 47465 records to 32272 (keeping 200 days of data) [2025-10-21T17:55:06.362077] [DEBUG] [LOCAL ] CHH: Primary data saved (32272 records). [2025-10-21T17:55:06.362264] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-21T17:55:06.363104] [INFO ] [MAIN ] Update Progress: 438/2366 symbols completed. CHH took 34.9s. Estimated remaining: 4h 2m 16s. Rate: 8.0 symbols/min [2025-10-21T17:55:06.538280] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T17:55:06.550976] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-21T17:55:07.250059] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-21T17:55:07.268888] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T17:55:07.270407] [INFO ] [REMOTE ] CHN: Full fetch complete (7535 records). [2025-10-21T17:55:07.270480] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-21T17:55:07.356298] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-21T17:55:07.651837] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-21T17:55:07.651920] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-21T17:55:07.652124] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-21T17:55:07.652163] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-21T17:55:07.652559] [DEBUG] [LOCAL ] CHN: Trimmed 7535 records to 4994 (keeping 200 days of data) [2025-10-21T17:55:07.680516] [DEBUG] [LOCAL ] CHN: Primary data saved (4994 records). [2025-10-21T17:55:07.680599] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-21T17:55:07.680694] [INFO ] [MAIN ] Update Progress: 439/2366 symbols completed. CHN took 25.0s. Estimated remaining: 4h 1m 41s. Rate: 8.0 symbols/min [2025-10-21T17:55:09.556243] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-21T17:55:09.567571] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-21T17:55:11.785033] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T17:55:11.796190] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-21T17:55:14.201926] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-21T17:55:14.214237] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-21T17:55:16.306323] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-21T17:55:16.316930] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-21T17:55:19.035588] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-21T17:55:19.047328] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-21T17:55:20.681507] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:55:20.692429] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-21T17:55:22.305840] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T17:55:22.314664] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-21T17:55:24.217072] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T17:55:24.224185] [INFO ] [REMOTE ] CHPT: Full fetch complete (71261 records). [2025-10-21T17:55:24.224425] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-21T17:55:24.637670] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-21T17:55:24.637784] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-21T17:55:24.638726] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-21T17:55:24.638790] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-21T17:55:24.640169] [DEBUG] [LOCAL ] CHPT: Trimmed 71261 records to 47136 (keeping 200 days of data) [2025-10-21T17:55:24.925682] [DEBUG] [LOCAL ] CHPT: Primary data saved (47136 records). [2025-10-21T17:55:24.925819] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-21T17:55:24.925895] [INFO ] [MAIN ] Update Progress: 440/2366 symbols completed. CHPT took 25.7s. Estimated remaining: 4h 2m 16s. Rate: 7.9 symbols/min [2025-10-21T17:55:25.479395] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:25.511164] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:25.544365] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-21T17:55:25.553005] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-21T17:55:25.559365] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-21T17:55:25.580857] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-21T17:55:25.662145] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:25.656179] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-21T17:55:25.668339] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-21T17:55:25.721834] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:25.828155] [DEBUG] [LOCAL ] CIA: Loaded 16550 existing records from primary storage. [2025-10-21T17:55:25.834198] [INFO ] [MAIN ] CIA: Loaded 16550 existing records. [2025-10-21T17:55:26.074146] [DEBUG] [LOCAL ] CI: Loaded 49691 existing records from primary storage. [2025-10-21T17:55:26.140121] [INFO ] [MAIN ] CI: Loaded 49691 existing records. [2025-10-21T17:55:26.352015] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:26.374085] [DEBUG] [LOCAL ] CHWY: Loaded 53656 existing records from primary storage. [2025-10-21T17:55:26.392633] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-21T17:55:26.403093] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-21T17:55:26.428841] [INFO ] [MAIN ] CHWY: Loaded 53656 existing records. [2025-10-21T17:55:26.453335] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-21T17:55:26.471111] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-21T17:55:26.500818] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:26.610417] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-21T17:55:26.675026] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:26.702008] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-21T17:55:26.795811] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-21T17:55:26.880924] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:26.874733] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-21T17:55:26.934239] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-21T17:55:26.934155] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-21T17:55:26.954242] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-21T17:55:26.974570] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-21T17:55:26.986953] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-21T17:55:27.394953] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:27.461235] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-21T17:55:27.771344] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:27.798076] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-21T17:55:27.849624] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:27.850776] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-21T17:55:27.878782] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T17:55:27.882401] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-21T17:55:28.530614] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T17:55:28.534023] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-21T17:55:28.859178] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T17:55:28.863183] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-21T17:55:29.351329] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T17:55:29.355259] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-21T17:55:29.526525] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T17:55:29.537396] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-21T17:55:29.653394] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T17:55:29.664865] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-21T17:55:30.078023] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T17:55:30.082926] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-21T17:55:30.316629] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T17:55:30.320386] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-21T17:55:31.217535] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T17:55:31.249175] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-21T17:55:31.248631] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T17:55:31.269252] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T17:55:31.268669] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-21T17:55:31.275325] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-21T17:55:31.310902] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T17:55:31.321092] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-21T17:55:32.133863] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T17:55:32.137362] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-21T17:55:32.410584] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T17:55:32.415442] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-21T17:55:33.239802] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T17:55:33.250730] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T17:55:33.263193] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-21T17:55:33.262762] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-21T17:55:33.293905] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T17:55:33.321471] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-21T17:55:33.325918] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T17:55:33.332793] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-21T17:55:34.346398] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T17:55:34.351127] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-21T17:55:34.448484] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T17:55:34.453612] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-21T17:55:35.280286] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T17:55:35.291608] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-21T17:55:35.399385] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T17:55:35.403192] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-21T17:55:35.446723] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T17:55:35.457341] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-21T17:55:35.487053] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T17:55:35.491956] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-21T17:55:36.321885] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T17:55:36.325673] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-21T17:55:36.551499] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T17:55:36.818030] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T17:55:36.950999] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-21T17:55:37.313074] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T17:55:37.318486] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T17:55:37.327272] [INFO ] [REMOTE ] CIA: Full fetch complete (23364 records). [2025-10-21T17:55:37.327348] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-21T17:55:37.689539] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-21T17:55:37.689614] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-21T17:55:37.690059] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-21T17:55:37.690121] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-21T17:55:37.690714] [DEBUG] [LOCAL ] CIA: Trimmed 23364 records to 16533 (keeping 200 days of data) [2025-10-21T17:55:37.755957] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-21T17:55:37.784125] [DEBUG] [LOCAL ] CIA: Primary data saved (16533 records). [2025-10-21T17:55:37.784242] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-21T17:55:37.784334] [INFO ] [MAIN ] Update Progress: 441/2366 symbols completed. CIA took 12.8s. Estimated remaining: 4h 2m 32s. Rate: 7.9 symbols/min [2025-10-21T17:55:37.951184] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:37.980032] [DEBUG] [LOCAL ] CIB: Loaded 30372 existing records from primary storage. [2025-10-21T17:55:37.980298] [INFO ] [MAIN ] CIB: Loaded 30372 existing records. [2025-10-21T17:55:38.154415] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:38.154675] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-21T17:55:38.154733] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-21T17:55:38.155196] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-10-21T17:55:38.155252] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-21T17:55:38.504125] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:38.551009] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-21T17:55:38.973174] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T17:55:39.010222] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T17:55:39.013492] [INFO ] [REMOTE ] CHT: Full fetch complete (27674 records). [2025-10-21T17:55:39.013568] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-21T17:55:39.363534] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-21T17:55:39.376871] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-21T17:55:39.376942] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-21T17:55:39.377478] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-21T17:55:39.377682] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-21T17:55:39.378447] [DEBUG] [LOCAL ] CHT: Trimmed 27674 records to 19274 (keeping 200 days of data) [2025-10-21T17:55:39.489812] [DEBUG] [LOCAL ] CHT: Primary data saved (19274 records). [2025-10-21T17:55:39.489936] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-21T17:55:39.490004] [INFO ] [MAIN ] Update Progress: 442/2366 symbols completed. CHT took 14.6s. Estimated remaining: 4h 1m 59s. Rate: 8.0 symbols/min [2025-10-21T17:55:39.659216] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:39.659358] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-21T17:55:39.659393] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-21T17:55:39.659498] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-21T17:55:39.659538] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-21T17:55:39.659578] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-21T17:55:39.659609] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-21T17:55:40.014764] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:40.032852] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T17:55:40.151000] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-21T17:55:40.508770] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-21T17:55:40.686416] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:55:40.951047] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-21T17:55:41.751093] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-21T17:55:42.294125] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T17:55:42.551027] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-21T17:55:42.984137] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T17:55:43.351068] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-21T17:55:43.540525] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T17:55:43.793869] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:55:44.151090] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-21T17:55:44.951019] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-21T17:55:45.751085] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-21T17:55:45.979548] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T17:55:46.551057] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-21T17:55:47.092533] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-21T17:55:47.099295] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T17:55:47.123766] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T17:55:47.351014] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-21T17:55:48.151020] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-21T17:55:48.506302] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-21T17:55:48.786122] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T17:55:48.951033] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-21T17:55:49.286761] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T17:55:49.751025] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-21T17:55:50.551049] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-21T17:55:51.351027] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-21T17:55:51.647579] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T17:55:51.887114] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T17:55:51.913865] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T17:55:52.151058] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-21T17:55:52.505193] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-21T17:55:52.951034] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-21T17:55:53.751006] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-21T17:55:54.352911] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T17:55:54.551026] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-21T17:55:55.351025] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-21T17:55:55.542680] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T17:55:56.150991] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-21T17:55:56.431596] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T17:55:56.509820] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:55:56.950990] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-21T17:55:57.750997] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-21T17:55:58.192567] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T17:55:58.367781] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T17:55:58.405549] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-21T17:55:58.414882] [INFO ] [REMOTE ] CHWY: Full fetch complete (77781 records). [2025-10-21T17:55:58.415038] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-21T17:55:58.557443] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-21T17:55:58.810312] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-21T17:55:58.810418] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-21T17:55:58.811289] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-21T17:55:58.811354] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-21T17:55:58.812811] [DEBUG] [LOCAL ] CHWY: Trimmed 77781 records to 53656 (keeping 200 days of data) [2025-10-21T17:55:59.117113] [DEBUG] [LOCAL ] CHWY: Primary data saved (53656 records). [2025-10-21T17:55:59.117254] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-21T17:55:59.117922] [INFO ] [MAIN ] Update Progress: 443/2366 symbols completed. CHWY took 34.2s. Estimated remaining: 4h 2m 44s. Rate: 7.9 symbols/min [2025-10-21T17:55:59.286211] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:55:59.336572] [DEBUG] [LOCAL ] CIEN: Loaded 52129 existing records from primary storage. [2025-10-21T17:55:59.336907] [INFO ] [MAIN ] CIEN: Loaded 52129 existing records. [2025-10-21T17:55:59.357317] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-21T17:55:59.513784] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:55:59.514018] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-21T17:55:59.514065] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-21T17:55:59.514792] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-21T17:55:59.514848] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-21T17:55:59.867701] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T17:55:59.867586] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:55:59.868633] [INFO ] [REMOTE ] CICB: Full fetch complete (1950 records). [2025-10-21T17:55:59.868731] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-21T17:56:00.047042] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-21T17:56:00.047198] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:56:00.047280] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:56:00.047349] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-21T17:56:00.047520] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-21T17:56:00.047615] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-21T17:56:00.047712] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-21T17:56:00.047782] [INFO ] [MAIN ] Update Progress: 444/2366 symbols completed. CICB took 20.6s. Estimated remaining: 4h 2m 8s. Rate: 7.9 symbols/min [2025-10-21T17:56:00.128242] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T17:56:00.151198] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-21T17:56:00.242053] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:00.247171] [DEBUG] [LOCAL ] CIF: Loaded 4025 existing records from primary storage. [2025-10-21T17:56:00.247314] [INFO ] [MAIN ] CIF: Loaded 4025 existing records. [2025-10-21T17:56:00.419632] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:00.419803] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-21T17:56:00.419848] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-21T17:56:00.420021] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-21T17:56:00.420077] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-21T17:56:00.763599] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:00.950980] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-21T17:56:01.676794] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T17:56:01.751098] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-21T17:56:02.412304] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-21T17:56:02.551075] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-21T17:56:03.129868] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T17:56:03.134514] [INFO ] [REMOTE ] CIB: Full fetch complete (45177 records). [2025-10-21T17:56:03.134615] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-21T17:56:03.135217] [FATAL] [VALIDATOR ] CIB: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:56:03.135308] [FATAL] [MAIN ] CIB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:56:03.135378] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:56:03.135464] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-21T17:56:03.135540] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-21T17:56:03.135588] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-21T17:56:03.135802] [DEBUG] [LOCAL ] CIB: Deleted derivative data file. [2025-10-21T17:56:03.135909] [INFO ] [MAIN ] Update Progress: 445/2366 symbols completed. CIB took 25.4s. Estimated remaining: 4h 1m 41s. Rate: 7.9 symbols/min [2025-10-21T17:56:03.302499] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:03.342493] [DEBUG] [LOCAL ] CIG: Loaded 44324 existing records from primary storage. [2025-10-21T17:56:03.342818] [INFO ] [MAIN ] CIG: Loaded 44324 existing records. [2025-10-21T17:56:03.356155] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-21T17:56:03.525709] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:03.525896] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-21T17:56:03.525942] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-21T17:56:03.526567] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-21T17:56:03.526625] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-21T17:56:03.876364] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:04.151020] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-21T17:56:04.182195] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:56:04.260573] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T17:56:04.267885] [INFO ] [REMOTE ] CI: Full fetch complete (72071 records). [2025-10-21T17:56:04.267999] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-21T17:56:04.572240] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-21T17:56:04.660664] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-21T17:56:04.660751] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-21T17:56:04.661543] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-21T17:56:04.661582] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-21T17:56:04.662869] [DEBUG] [LOCAL ] CI: Trimmed 72071 records to 49617 (keeping 200 days of data) [2025-10-21T17:56:04.954780] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-21T17:56:04.965796] [DEBUG] [LOCAL ] CI: Primary data saved (49617 records). [2025-10-21T17:56:04.965863] [INFO ] [MAIN ] CI: Full history saved. [2025-10-21T17:56:04.966868] [INFO ] [MAIN ] Update Progress: 446/2366 symbols completed. CI took 40.0s. Estimated remaining: 4h 1m 9s. Rate: 8.0 symbols/min [2025-10-21T17:56:05.134478] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:05.152907] [DEBUG] [LOCAL ] CII: Loaded 15328 existing records from primary storage. [2025-10-21T17:56:05.153131] [INFO ] [MAIN ] CII: Loaded 15328 existing records. [2025-10-21T17:56:05.329197] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:05.329453] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-21T17:56:05.329506] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-21T17:56:05.329711] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-21T17:56:05.329766] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-21T17:56:05.676632] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:05.751017] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-21T17:56:06.550999] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-21T17:56:06.872672] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T17:56:06.922329] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T17:56:07.351053] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-21T17:56:08.098197] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T17:56:08.150433] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T17:56:08.157751] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-21T17:56:08.816255] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T17:56:08.951090] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-21T17:56:09.592083] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T17:56:09.751104] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-21T17:56:10.330782] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T17:56:10.551026] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-21T17:56:11.351060] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-21T17:56:11.405510] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T17:56:12.151014] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-21T17:56:12.776042] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T17:56:12.951058] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-21T17:56:13.751068] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-21T17:56:13.999354] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T17:56:14.020390] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T17:56:14.459403] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T17:56:14.550998] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-21T17:56:15.351003] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-21T17:56:15.592753] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T17:56:16.026832] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T17:56:16.151007] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-21T17:56:16.821932] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T17:56:16.823022] [INFO ] [REMOTE ] CIF: Full fetch complete (6533 records). [2025-10-21T17:56:16.823089] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-21T17:56:16.823435] [FATAL] [VALIDATOR ] CIF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T17:56:16.823515] [FATAL] [MAIN ] CIF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:56:16.823571] [WARN ] [MAIN ] CIF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:56:16.823680] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-21T17:56:16.823770] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-10-21T17:56:16.823818] [INFO ] [LOCAL ] CIF: Starting deletion of derivative data. [2025-10-21T17:56:16.823961] [DEBUG] [LOCAL ] CIF: Deleted derivative data file. [2025-10-21T17:56:16.824061] [INFO ] [MAIN ] Update Progress: 447/2366 symbols completed. CIF took 16.8s. Estimated remaining: 4h 1m 20s. Rate: 8.0 symbols/min [2025-10-21T17:56:16.960290] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-21T17:56:16.991301] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:17.027773] [DEBUG] [LOCAL ] CIM: Loaded 37626 existing records from primary storage. [2025-10-21T17:56:17.028066] [INFO ] [MAIN ] CIM: Loaded 37626 existing records. [2025-10-21T17:56:17.205092] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:17.205353] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-21T17:56:17.205407] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-21T17:56:17.206120] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-21T17:56:17.206177] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-21T17:56:17.549170] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:17.751019] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-21T17:56:18.056822] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T17:56:18.551064] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-21T17:56:19.351036] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-21T17:56:19.983437] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-21T17:56:20.122603] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T17:56:20.150983] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-21T17:56:20.839058] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T17:56:20.951024] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-21T17:56:21.751012] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-21T17:56:21.916928] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T17:56:21.998216] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T17:56:22.551053] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-21T17:56:23.351023] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-21T17:56:23.383473] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:56:23.524264] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T17:56:24.150990] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-21T17:56:24.917055] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:56:24.950999] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-21T17:56:25.050590] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T17:56:25.751083] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-21T17:56:26.409250] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T17:56:26.551047] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-21T17:56:26.939787] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T17:56:27.351024] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-21T17:56:28.151034] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-21T17:56:28.505329] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T17:56:28.880128] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T17:56:28.951004] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-21T17:56:29.227871] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T17:56:29.751011] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-21T17:56:30.434889] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T17:56:30.551056] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-21T17:56:30.819973] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T17:56:30.823772] [INFO ] [REMOTE ] CII: Full fetch complete (22868 records). [2025-10-21T17:56:30.823861] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-21T17:56:31.216421] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-21T17:56:31.216512] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-21T17:56:31.217014] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-21T17:56:31.217106] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-21T17:56:31.217859] [DEBUG] [LOCAL ] CII: Trimmed 22868 records to 15235 (keeping 200 days of data) [2025-10-21T17:56:31.310053] [DEBUG] [LOCAL ] CII: Primary data saved (15235 records). [2025-10-21T17:56:31.310202] [INFO ] [MAIN ] CII: Full history saved. [2025-10-21T17:56:31.310280] [INFO ] [MAIN ] Update Progress: 448/2366 symbols completed. CII took 26.3s. Estimated remaining: 4h 1m 42s. Rate: 7.9 symbols/min [2025-10-21T17:56:31.356185] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-21T17:56:31.483780] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:31.488603] [DEBUG] [LOCAL ] CIMN: Loaded 2756 existing records from primary storage. [2025-10-21T17:56:31.488778] [INFO ] [MAIN ] CIMN: Loaded 2756 existing records. [2025-10-21T17:56:31.661844] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:31.662061] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-21T17:56:31.662109] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-21T17:56:31.662269] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-21T17:56:31.662325] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-21T17:56:32.032990] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:32.151008] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-21T17:56:32.292330] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T17:56:32.722711] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T17:56:32.940493] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T17:56:32.950969] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-21T17:56:33.751024] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-21T17:56:34.468498] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T17:56:34.551031] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-21T17:56:35.351127] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-21T17:56:35.647828] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T17:56:36.151005] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-21T17:56:36.183522] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T17:56:36.522696] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T17:56:36.951097] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-21T17:56:37.751006] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-21T17:56:38.141546] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T17:56:38.150032] [INFO ] [REMOTE ] CIEN: Full fetch complete (75837 records). [2025-10-21T17:56:38.150182] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-21T17:56:38.549284] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-21T17:56:38.549402] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-21T17:56:38.550367] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-21T17:56:38.550526] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-21T17:56:38.551019] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-21T17:56:38.580379] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T17:56:38.589753] [DEBUG] [LOCAL ] CIEN: Trimmed 75837 records to 52126 (keeping 200 days of data) [2025-10-21T17:56:38.880666] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T17:56:38.969597] [DEBUG] [LOCAL ] CIEN: Primary data saved (52126 records). [2025-10-21T17:56:38.969816] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-21T17:56:38.970799] [INFO ] [MAIN ] Update Progress: 449/2366 symbols completed. CIEN took 39.9s. Estimated remaining: 4h 1m 35s. Rate: 7.9 symbols/min [2025-10-21T17:56:39.080933] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T17:56:39.153179] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:39.153353] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-21T17:56:39.153391] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-21T17:56:39.153539] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-21T17:56:39.153581] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-21T17:56:39.153622] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-21T17:56:39.153689] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-21T17:56:39.356224] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-21T17:56:39.514054] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:40.151066] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-21T17:56:40.882555] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T17:56:40.950980] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-21T17:56:41.751071] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-21T17:56:42.015094] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T17:56:42.022849] [INFO ] [REMOTE ] CIG: Full fetch complete (62632 records). [2025-10-21T17:56:42.022957] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-21T17:56:42.376011] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T17:56:42.475306] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-21T17:56:42.475403] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-21T17:56:42.476208] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-21T17:56:42.476281] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-21T17:56:42.477603] [DEBUG] [LOCAL ] CIG: Trimmed 62632 records to 44458 (keeping 200 days of data) [2025-10-21T17:56:42.559417] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-21T17:56:42.569615] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T17:56:42.732912] [DEBUG] [LOCAL ] CIG: Primary data saved (44458 records). [2025-10-21T17:56:42.733037] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-21T17:56:42.733121] [INFO ] [MAIN ] Update Progress: 450/2366 symbols completed. CIG took 39.6s. Estimated remaining: 4h 1m 11s. Rate: 7.9 symbols/min [2025-10-21T17:56:42.930322] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:42.930485] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-21T17:56:42.930521] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-21T17:56:42.930635] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-21T17:56:42.930712] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-21T17:56:42.930761] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-21T17:56:42.930796] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-21T17:56:43.281863] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:43.351014] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-21T17:56:43.541485] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:56:43.541899] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-21T17:56:43.542015] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:56:43.542060] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-21T17:56:43.542127] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:56:43.542194] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-21T17:56:43.542268] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-21T17:56:43.542321] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-21T17:56:43.542364] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-21T17:56:43.542409] [INFO ] [MAIN ] Update Progress: 451/2366 symbols completed. CIMP took 0.8s. Estimated remaining: 4h 0m 35s. Rate: 8.0 symbols/min [2025-10-21T17:56:43.710703] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:43.730602] [DEBUG] [LOCAL ] CINT: Loaded 20229 existing records from primary storage. [2025-10-21T17:56:43.730889] [INFO ] [MAIN ] CINT: Loaded 20229 existing records. [2025-10-21T17:56:43.907752] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:43.908118] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-21T17:56:43.908257] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-21T17:56:43.908815] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-21T17:56:43.908872] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-21T17:56:44.164393] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-21T17:56:44.217133] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T17:56:44.301873] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:44.659274] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T17:56:44.951007] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-21T17:56:45.751063] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-21T17:56:45.940542] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T17:56:46.189059] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T17:56:46.551067] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-21T17:56:47.113950] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T17:56:47.351047] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-21T17:56:48.151038] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-21T17:56:48.373807] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T17:56:48.685151] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-21T17:56:48.951031] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-21T17:56:49.519544] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T17:56:49.751028] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-21T17:56:50.217814] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T17:56:50.551024] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-21T17:56:50.892712] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T17:56:51.351021] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-21T17:56:51.922775] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T17:56:52.151009] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-21T17:56:52.951076] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-21T17:56:53.087622] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T17:56:53.387196] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T17:56:53.751056] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-21T17:56:54.049237] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-21T17:56:54.551060] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-21T17:56:55.123532] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T17:56:55.351079] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-21T17:56:56.151034] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-21T17:56:56.411357] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T17:56:56.903757] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T17:56:56.951004] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-21T17:56:57.583984] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T17:56:57.585268] [INFO ] [REMOTE ] CIMO: Full fetch complete (4580 records). [2025-10-21T17:56:57.585340] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-21T17:56:57.762804] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-21T17:56:57.769458] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T17:56:57.770804] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T17:56:57.770875] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T17:56:57.770944] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-21T17:56:57.771008] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-21T17:56:57.771043] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-21T17:56:57.771080] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-21T17:56:57.771138] [INFO ] [MAIN ] Update Progress: 452/2366 symbols completed. CIMO took 18.8s. Estimated remaining: 4h 0m 55s. Rate: 7.9 symbols/min [2025-10-21T17:56:57.941504] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:56:57.965416] [DEBUG] [LOCAL ] CIO: Loaded 21090 existing records from primary storage. [2025-10-21T17:56:57.965756] [INFO ] [MAIN ] CIO: Loaded 21090 existing records. [2025-10-21T17:56:58.157110] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:56:58.157332] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-21T17:56:58.157379] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-21T17:56:58.157603] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-21T17:56:58.157675] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-21T17:56:58.513566] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:56:58.550981] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-21T17:56:59.351027] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-21T17:56:59.563765] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T17:56:59.570074] [INFO ] [REMOTE ] CIM: Full fetch complete (54845 records). [2025-10-21T17:56:59.570174] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-21T17:56:59.849100] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T17:56:59.968142] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-21T17:56:59.968224] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-21T17:56:59.968916] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-21T17:56:59.968977] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-21T17:56:59.970025] [DEBUG] [LOCAL ] CIM: Trimmed 54845 records to 37513 (keeping 200 days of data) [2025-10-21T17:57:00.167857] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-21T17:57:00.201044] [DEBUG] [LOCAL ] CIM: Primary data saved (37513 records). [2025-10-21T17:57:00.201178] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-21T17:57:00.201677] [INFO ] [MAIN ] Update Progress: 453/2366 symbols completed. CIM took 43.4s. Estimated remaining: 4h 0m 26s. Rate: 8.0 symbols/min [2025-10-21T17:57:00.326733] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T17:57:00.390180] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:00.418815] [DEBUG] [LOCAL ] CION: Loaded 28316 existing records from primary storage. [2025-10-21T17:57:00.419083] [INFO ] [MAIN ] CION: Loaded 28316 existing records. [2025-10-21T17:57:00.602883] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:00.603093] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-21T17:57:00.603142] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-21T17:57:00.603439] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-21T17:57:00.603497] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-21T17:57:00.698978] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T17:57:00.957034] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-21T17:57:00.965787] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:01.751084] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-21T17:57:02.088705] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T17:57:02.551023] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-21T17:57:02.733694] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T17:57:03.351008] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-21T17:57:03.525057] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T17:57:03.835068] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-21T17:57:04.151024] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-21T17:57:04.655285] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T17:57:04.951022] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-21T17:57:05.751036] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-21T17:57:06.251820] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T17:57:06.551006] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-21T17:57:06.917202] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T17:57:07.145913] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T17:57:07.146934] [INFO ] [REMOTE ] CIMN: Full fetch complete (3945 records). [2025-10-21T17:57:07.147000] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-21T17:57:07.359779] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-21T17:57:07.548678] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-21T17:57:07.548765] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-21T17:57:07.548899] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-21T17:57:07.548938] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-21T17:57:07.549313] [DEBUG] [LOCAL ] CIMN: Trimmed 3945 records to 2746 (keeping 200 days of data) [2025-10-21T17:57:07.565826] [DEBUG] [LOCAL ] CIMN: Primary data saved (2746 records). [2025-10-21T17:57:07.565933] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-21T17:57:07.566009] [INFO ] [MAIN ] Update Progress: 454/2366 symbols completed. CIMN took 36.3s. Estimated remaining: 4h 0m 18s. Rate: 8.0 symbols/min [2025-10-21T17:57:07.738101] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:07.787026] [DEBUG] [LOCAL ] CIVI: Loaded 52736 existing records from primary storage. [2025-10-21T17:57:07.787338] [INFO ] [MAIN ] CIVI: Loaded 52736 existing records. [2025-10-21T17:57:07.961570] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:07.961811] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-21T17:57:07.961858] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-21T17:57:07.962720] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-21T17:57:07.963150] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-21T17:57:08.157278] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-21T17:57:08.322156] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:08.338329] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T17:57:08.951050] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-21T17:57:09.213975] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T17:57:09.751078] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-21T17:57:10.222815] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:57:10.227699] [INFO ] [REMOTE ] CINT: Full fetch complete (28331 records). [2025-10-21T17:57:10.227801] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-21T17:57:10.555288] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-21T17:57:10.615969] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-21T17:57:10.627084] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-21T17:57:10.629800] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-21T17:57:10.630951] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T17:57:10.630440] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-21T17:57:10.637787] [DEBUG] [LOCAL ] CINT: Trimmed 28331 records to 20318 (keeping 200 days of data) [2025-10-21T17:57:10.756717] [DEBUG] [LOCAL ] CINT: Primary data saved (20318 records). [2025-10-21T17:57:10.756899] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-21T17:57:10.756987] [INFO ] [MAIN ] Update Progress: 455/2366 symbols completed. CINT took 27.2s. Estimated remaining: 3h 59m 52s. Rate: 8.0 symbols/min [2025-10-21T17:57:10.953639] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:11.002683] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-21T17:57:11.003068] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-21T17:57:11.203404] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:11.203607] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-21T17:57:11.203681] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-21T17:57:11.204563] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-21T17:57:11.204620] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-21T17:57:11.377416] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-21T17:57:11.561940] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:12.151063] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-21T17:57:12.482957] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T17:57:12.523979] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T17:57:12.950994] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-21T17:57:13.160860] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T17:57:13.751067] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-21T17:57:14.319483] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T17:57:14.551058] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-21T17:57:14.662784] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T17:57:15.351038] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-21T17:57:16.151052] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-21T17:57:16.951001] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-21T17:57:17.167433] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-21T17:57:17.267243] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T17:57:17.311514] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T17:57:17.751008] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-21T17:57:18.156134] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:57:18.551000] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-21T17:57:18.856115] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T17:57:19.351052] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-21T17:57:19.698371] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T17:57:20.151065] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-21T17:57:20.951007] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-21T17:57:21.318260] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T17:57:21.397379] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T17:57:21.751027] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-21T17:57:22.459294] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T17:57:22.551034] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-21T17:57:22.962862] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:57:23.351050] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-21T17:57:24.151000] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-21T17:57:24.435094] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T17:57:24.951052] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-21T17:57:25.358557] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T17:57:25.382209] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T17:57:25.751070] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-21T17:57:26.551080] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-21T17:57:27.026293] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T17:57:27.053022] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T17:57:27.059176] [INFO ] [REMOTE ] CIO: Full fetch complete (29675 records). [2025-10-21T17:57:27.059280] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-21T17:57:27.356542] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-21T17:57:27.438160] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-21T17:57:27.438261] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-21T17:57:27.438814] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-21T17:57:27.438880] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-21T17:57:27.439791] [DEBUG] [LOCAL ] CIO: Trimmed 29675 records to 21132 (keeping 200 days of data) [2025-10-21T17:57:27.555465] [DEBUG] [LOCAL ] CIO: Primary data saved (21132 records). [2025-10-21T17:57:27.555596] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-21T17:57:27.555692] [INFO ] [MAIN ] Update Progress: 456/2366 symbols completed. CIO took 29.8s. Estimated remaining: 4h 0m 23s. Rate: 7.9 symbols/min [2025-10-21T17:57:27.724512] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:27.757247] [DEBUG] [LOCAL ] CLB: Loaded 33606 existing records from primary storage. [2025-10-21T17:57:27.757527] [INFO ] [MAIN ] CLB: Loaded 33606 existing records. [2025-10-21T17:57:27.925409] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:57:27.973719] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:27.973938] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-21T17:57:27.974010] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-21T17:57:27.974626] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-21T17:57:27.974721] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-21T17:57:28.152202] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-21T17:57:28.346608] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:28.951067] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-21T17:57:29.163064] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T17:57:29.751000] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-21T17:57:29.949298] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T17:57:30.130931] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T17:57:30.550995] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-21T17:57:31.231215] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T17:57:31.351010] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-21T17:57:32.151020] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-21T17:57:32.300686] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T17:57:32.951056] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-21T17:57:33.155141] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T17:57:33.390029] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T17:57:33.751065] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-21T17:57:34.557022] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-21T17:57:34.571149] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T17:57:35.351006] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-21T17:57:35.568038] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T17:57:35.761154] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T17:57:36.151081] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-21T17:57:36.951010] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-21T17:57:37.044858] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T17:57:37.547035] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T17:57:37.751092] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-21T17:57:38.551017] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-21T17:57:38.726912] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T17:57:39.024479] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:57:39.029027] [INFO ] [REMOTE ] CION: Full fetch complete (40640 records). [2025-10-21T17:57:39.029116] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-21T17:57:39.356240] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-21T17:57:39.394820] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-21T17:57:39.394953] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-21T17:57:39.395527] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-21T17:57:39.395570] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-21T17:57:39.396466] [DEBUG] [LOCAL ] CION: Trimmed 40640 records to 28277 (keeping 200 days of data) [2025-10-21T17:57:39.561510] [DEBUG] [LOCAL ] CION: Primary data saved (28277 records). [2025-10-21T17:57:39.561687] [INFO ] [MAIN ] CION: Full history saved. [2025-10-21T17:57:39.561779] [INFO ] [MAIN ] Update Progress: 457/2366 symbols completed. CION took 39.4s. Estimated remaining: 4h 0m 35s. Rate: 7.9 symbols/min [2025-10-21T17:57:39.751542] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:39.765275] [DEBUG] [LOCAL ] CLCO: Loaded 13189 existing records from primary storage. [2025-10-21T17:57:39.765548] [INFO ] [MAIN ] CLCO: Loaded 13189 existing records. [2025-10-21T17:57:39.937499] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:39.937699] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-21T17:57:39.937755] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-21T17:57:39.938001] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-21T17:57:39.938055] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-21T17:57:40.156326] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-21T17:57:40.300214] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:40.531798] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:57:40.951049] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-21T17:57:40.987415] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T17:57:41.750986] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-21T17:57:41.903008] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T17:57:41.911353] [INFO ] [REMOTE ] CIVI: Full fetch complete (76064 records). [2025-10-21T17:57:41.911466] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-21T17:57:42.082135] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:57:42.316261] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-21T17:57:42.316343] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-21T17:57:42.317196] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-21T17:57:42.317260] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-21T17:57:42.318677] [DEBUG] [LOCAL ] CIVI: Trimmed 76064 records to 52734 (keeping 200 days of data) [2025-10-21T17:57:42.551285] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-21T17:57:42.630420] [DEBUG] [LOCAL ] CIVI: Primary data saved (52734 records). [2025-10-21T17:57:42.630519] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-21T17:57:42.631300] [INFO ] [MAIN ] Update Progress: 458/2366 symbols completed. CIVI took 35.1s. Estimated remaining: 4h 0m 8s. Rate: 7.9 symbols/min [2025-10-21T17:57:42.800858] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:42.827925] [DEBUG] [LOCAL ] CLDT: Loaded 25365 existing records from primary storage. [2025-10-21T17:57:42.828220] [INFO ] [MAIN ] CLDT: Loaded 25365 existing records. [2025-10-21T17:57:43.004504] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:43.004736] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-21T17:57:43.004789] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-21T17:57:43.005149] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-21T17:57:43.005205] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-21T17:57:43.351109] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-21T17:57:43.373782] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:43.698728] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T17:57:43.707134] [INFO ] [REMOTE ] CL: Full fetch complete (77817 records). [2025-10-21T17:57:43.707276] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-21T17:57:43.999017] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T17:57:44.127864] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-21T17:57:44.127958] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-21T17:57:44.129027] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-21T17:57:44.129126] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-21T17:57:44.130872] [DEBUG] [LOCAL ] CL: Trimmed 77817 records to 53649 (keeping 200 days of data) [2025-10-21T17:57:44.183916] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-21T17:57:44.479121] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-21T17:57:44.479308] [INFO ] [MAIN ] CL: Full history saved. [2025-10-21T17:57:44.479528] [INFO ] [MAIN ] Update Progress: 459/2366 symbols completed. CL took 33.7s. Estimated remaining: 3h 59m 37s. Rate: 8.0 symbols/min [2025-10-21T17:57:44.558265] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T17:57:44.668210] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:57:44.716873] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-21T17:57:44.717172] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-21T17:57:44.894039] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:57:44.894215] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-21T17:57:44.894262] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-21T17:57:44.895050] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-21T17:57:44.895110] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-21T17:57:44.958399] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-21T17:57:45.256899] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:57:45.415284] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T17:57:45.750997] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-21T17:57:46.237354] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T17:57:46.551014] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-21T17:57:47.125638] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T17:57:47.351040] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-21T17:57:47.722090] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T17:57:48.151107] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-21T17:57:48.335980] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T17:57:48.951130] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-21T17:57:49.751060] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-21T17:57:50.291609] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T17:57:50.351561] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T17:57:50.551109] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-21T17:57:50.748723] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T17:57:51.351049] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-21T17:57:51.751360] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T17:57:52.151027] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-21T17:57:52.951022] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-21T17:57:53.040814] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T17:57:53.163359] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T17:57:53.751042] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-21T17:57:53.946151] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T17:57:54.551087] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-21T17:57:54.574019] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T17:57:55.351076] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-21T17:57:55.690758] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T17:57:56.151024] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-21T17:57:56.560529] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T17:57:56.950975] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-21T17:57:57.191399] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T17:57:57.751008] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-21T17:57:58.282027] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T17:57:58.301564] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-21T17:57:58.551024] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-21T17:57:59.351068] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-21T17:57:59.552392] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T17:58:00.151017] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-21T17:58:00.951019] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-21T17:58:01.101812] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T17:58:01.106243] [INFO ] [REMOTE ] CLDT: Full fetch complete (37584 records). [2025-10-21T17:58:01.106320] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-21T17:58:01.488317] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-21T17:58:01.488500] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-21T17:58:01.489129] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-21T17:58:01.489242] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-21T17:58:01.490088] [DEBUG] [LOCAL ] CLDT: Trimmed 37584 records to 25283 (keeping 200 days of data) [2025-10-21T17:58:01.634535] [DEBUG] [LOCAL ] CLDT: Primary data saved (25283 records). [2025-10-21T17:58:01.634745] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-21T17:58:01.634948] [INFO ] [MAIN ] Update Progress: 460/2366 symbols completed. CLDT took 19.0s. Estimated remaining: 4h 0m 9s. Rate: 7.9 symbols/min [2025-10-21T17:58:01.774539] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T17:58:01.770337] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-21T17:58:01.790845] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-21T17:58:01.861768] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:01.887757] [DEBUG] [LOCAL ] CLH: Loaded 27808 existing records from primary storage. [2025-10-21T17:58:01.888005] [INFO ] [MAIN ] CLH: Loaded 27808 existing records. [2025-10-21T17:58:02.065167] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:02.065338] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-21T17:58:02.065390] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-21T17:58:02.066064] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-21T17:58:02.066156] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-21T17:58:02.412962] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:02.550995] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-21T17:58:02.852320] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T17:58:03.351044] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-21T17:58:04.133688] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T17:58:04.150969] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-21T17:58:04.951030] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-21T17:58:05.591543] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T17:58:05.675818] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-21T17:58:05.750980] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-21T17:58:06.283008] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T17:58:06.288364] [INFO ] [REMOTE ] CLB: Full fetch complete (47236 records). [2025-10-21T17:58:06.288443] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-21T17:58:06.559325] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-21T17:58:06.693616] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-21T17:58:06.693737] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-21T17:58:06.694662] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-21T17:58:06.694729] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-21T17:58:06.695856] [DEBUG] [LOCAL ] CLB: Trimmed 47236 records to 33495 (keeping 200 days of data) [2025-10-21T17:58:06.909881] [DEBUG] [LOCAL ] CLB: Primary data saved (33495 records). [2025-10-21T17:58:06.910018] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-21T17:58:06.910730] [INFO ] [MAIN ] Update Progress: 461/2366 symbols completed. CLB took 39.4s. Estimated remaining: 3h 59m 52s. Rate: 7.9 symbols/min [2025-10-21T17:58:07.101921] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:07.114359] [DEBUG] [LOCAL ] CLPR: Loaded 10162 existing records from primary storage. [2025-10-21T17:58:07.114586] [INFO ] [MAIN ] CLPR: Loaded 10162 existing records. [2025-10-21T17:58:07.317890] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:07.318162] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-21T17:58:07.318229] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-21T17:58:07.318503] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-21T17:58:07.318544] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-21T17:58:07.365357] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-21T17:58:07.631419] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T17:58:07.723954] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:07.754841] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T17:58:08.151016] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-21T17:58:08.706446] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T17:58:08.951018] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-21T17:58:09.751055] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-21T17:58:10.216193] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T17:58:10.219958] [INFO ] [REMOTE ] CLCO: Full fetch complete (22816 records). [2025-10-21T17:58:10.220033] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-21T17:58:10.551572] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-21T17:58:10.553293] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-21T17:58:10.643889] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-21T17:58:10.644392] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-21T17:58:10.644868] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-21T17:58:10.644943] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-21T17:58:10.645612] [DEBUG] [LOCAL ] CLCO: Trimmed 22816 records to 13154 (keeping 200 days of data) [2025-10-21T17:58:10.704911] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T17:58:10.727833] [DEBUG] [LOCAL ] CLCO: Primary data saved (13154 records). [2025-10-21T17:58:10.727919] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-21T17:58:10.727984] [INFO ] [MAIN ] Update Progress: 462/2366 symbols completed. CLCO took 31.2s. Estimated remaining: 3h 59m 29s. Rate: 8.0 symbols/min [2025-10-21T17:58:10.898896] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:10.950426] [DEBUG] [LOCAL ] CLS: Loaded 53569 existing records from primary storage. [2025-10-21T17:58:10.950752] [INFO ] [MAIN ] CLS: Loaded 53569 existing records. [2025-10-21T17:58:11.129982] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:11.130185] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-21T17:58:11.130231] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-21T17:58:11.131093] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-21T17:58:11.131148] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-21T17:58:11.356267] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-21T17:58:11.495414] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:12.151013] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-21T17:58:12.243557] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T17:58:12.951022] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-21T17:58:13.594125] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T17:58:13.750991] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-21T17:58:14.017200] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T17:58:14.401222] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T17:58:14.551014] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-21T17:58:14.959130] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-21T17:58:15.351027] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-21T17:58:15.855347] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T17:58:16.151020] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-21T17:58:16.596452] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T17:58:16.951030] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-21T17:58:16.998039] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T17:58:17.751038] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-21T17:58:18.373299] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T17:58:18.551051] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-21T17:58:19.351080] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-21T17:58:20.151006] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-21T17:58:20.312407] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-21T17:58:20.825876] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T17:58:20.936256] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T17:58:20.950987] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-21T17:58:21.073475] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T17:58:21.751077] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-21T17:58:22.551049] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-21T17:58:23.010867] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T17:58:23.351018] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-21T17:58:23.443468] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T17:58:23.976685] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-21T17:58:24.151024] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-21T17:58:24.951004] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-21T17:58:25.091560] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T17:58:25.741821] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-21T17:58:25.750136] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-21T17:58:25.750261] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-21T17:58:25.751018] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-21T17:58:26.144003] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-21T17:58:26.144147] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-21T17:58:26.145043] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-21T17:58:26.145106] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-21T17:58:26.146566] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-21T17:58:26.377601] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T17:58:26.478265] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-21T17:58:26.478411] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-21T17:58:26.478506] [INFO ] [MAIN ] Update Progress: 463/2366 symbols completed. CLF took 42.0s. Estimated remaining: 3h 59m 56s. Rate: 7.9 symbols/min [2025-10-21T17:58:26.552781] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-21T17:58:26.649799] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:26.685469] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T17:58:26.708129] [DEBUG] [LOCAL ] CLVT: Loaded 51923 existing records from primary storage. [2025-10-21T17:58:26.708441] [INFO ] [MAIN ] CLVT: Loaded 51923 existing records. [2025-10-21T17:58:26.880254] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:26.880463] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-21T17:58:26.880510] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-21T17:58:26.880755] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-21T17:58:26.880810] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-21T17:58:27.229992] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:27.351036] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-21T17:58:28.021194] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T17:58:28.027517] [INFO ] [REMOTE ] CLH: Full fetch complete (42206 records). [2025-10-21T17:58:28.027689] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-21T17:58:28.156131] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-21T17:58:28.402053] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-21T17:58:28.402129] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-21T17:58:28.402723] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-21T17:58:28.402783] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-21T17:58:28.403617] [DEBUG] [LOCAL ] CLH: Trimmed 42206 records to 27711 (keeping 200 days of data) [2025-10-21T17:58:28.566920] [DEBUG] [LOCAL ] CLH: Primary data saved (27711 records). [2025-10-21T17:58:28.567057] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-21T17:58:28.567138] [INFO ] [MAIN ] Update Progress: 464/2366 symbols completed. CLH took 26.9s. Estimated remaining: 3h 59m 25s. Rate: 7.9 symbols/min [2025-10-21T17:58:28.742098] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:28.752628] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T17:58:28.771041] [DEBUG] [LOCAL ] CLW: Loaded 21460 existing records from primary storage. [2025-10-21T17:58:28.771310] [INFO ] [MAIN ] CLW: Loaded 21460 existing records. [2025-10-21T17:58:28.955632] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-21T17:58:28.961550] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:28.962448] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-21T17:58:28.962519] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-21T17:58:28.962917] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-21T17:58:28.963025] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-21T17:58:29.087433] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T17:58:29.357459] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:29.751047] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-21T17:58:30.551093] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-21T17:58:31.306678] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T17:58:31.351052] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-21T17:58:31.435803] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T17:58:31.437445] [INFO ] [REMOTE ] CLPR: Full fetch complete (15943 records). [2025-10-21T17:58:31.437511] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-21T17:58:31.813441] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-21T17:58:31.813571] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-21T17:58:31.814188] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-21T17:58:31.814253] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-21T17:58:31.814901] [DEBUG] [LOCAL ] CLPR: Trimmed 15943 records to 10065 (keeping 200 days of data) [2025-10-21T17:58:31.893628] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-10-21T17:58:31.917011] [DEBUG] [LOCAL ] CLPR: Primary data saved (10065 records). [2025-10-21T17:58:31.917134] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-21T17:58:31.917209] [INFO ] [MAIN ] Update Progress: 465/2366 symbols completed. CLPR took 25.0s. Estimated remaining: 3h 59m 1s. Rate: 8.0 symbols/min [2025-10-21T17:58:32.086896] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:32.140745] [DEBUG] [LOCAL ] CLX: Loaded 51778 existing records from primary storage. [2025-10-21T17:58:32.141048] [INFO ] [MAIN ] CLX: Loaded 51778 existing records. [2025-10-21T17:58:32.161039] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-21T17:58:32.318477] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:32.318704] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-21T17:58:32.318760] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-21T17:58:32.319131] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-21T17:58:32.319192] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-21T17:58:32.681158] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:32.957682] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-21T17:58:32.977531] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T17:58:33.221707] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T17:58:33.751071] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-21T17:58:34.551037] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-21T17:58:34.747113] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T17:58:35.351060] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-21T17:58:35.408079] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T17:58:35.435608] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T17:58:36.151080] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-21T17:58:36.951007] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-21T17:58:37.532482] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T17:58:37.751001] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-21T17:58:37.954973] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T17:58:38.112410] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T17:58:38.551056] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-21T17:58:39.351060] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-21T17:58:39.899473] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T17:58:40.146888] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T17:58:40.156405] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-21T17:58:40.488866] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T17:58:40.951101] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-21T17:58:41.751084] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-21T17:58:42.549210] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-21T17:58:42.560440] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-21T17:58:42.650909] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T17:58:43.341540] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:58:43.351208] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-21T17:58:43.809151] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T17:58:44.151018] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-21T17:58:44.951042] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-21T17:58:45.103271] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T17:58:45.751078] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-21T17:58:45.934244] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:58:46.432369] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-21T17:58:46.551027] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-21T17:58:47.351062] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-21T17:58:47.547989] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T17:58:48.151058] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-21T17:58:48.370211] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T17:58:48.624543] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T17:58:48.951028] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-21T17:58:49.751045] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-21T17:58:49.938775] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T17:58:50.551091] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-21T17:58:50.932528] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:58:51.351022] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-21T17:58:52.023235] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-21T17:58:52.032495] [INFO ] [REMOTE ] CLS: Full fetch complete (77697 records). [2025-10-21T17:58:52.032625] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-21T17:58:52.154272] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-21T17:58:52.450033] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-21T17:58:52.450177] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-21T17:58:52.451262] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-21T17:58:52.451394] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-21T17:58:52.452947] [DEBUG] [LOCAL ] CLS: Trimmed 77697 records to 53563 (keeping 200 days of data) [2025-10-21T17:58:52.574246] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T17:58:52.810436] [DEBUG] [LOCAL ] CLS: Primary data saved (53563 records). [2025-10-21T17:58:52.810572] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-21T17:58:52.810919] [INFO ] [MAIN ] Update Progress: 466/2366 symbols completed. CLS took 42.1s. Estimated remaining: 3h 59m 48s. Rate: 7.9 symbols/min [2025-10-21T17:58:52.951808] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-21T17:58:52.984835] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:53.028238] [DEBUG] [LOCAL ] CM: Loaded 48575 existing records from primary storage. [2025-10-21T17:58:53.028536] [INFO ] [MAIN ] CM: Loaded 48575 existing records. [2025-10-21T17:58:53.213880] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:53.228711] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-21T17:58:53.228845] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-21T17:58:53.235811] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T17:58:53.235861] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-21T17:58:53.243679] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-21T17:58:53.276071] [INFO ] [REMOTE ] CLVT: Full fetch complete (75388 records). [2025-10-21T17:58:53.315446] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-21T17:58:53.527316] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T17:58:53.757814] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-21T17:58:53.965527] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:54.080339] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-21T17:58:54.080423] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-21T17:58:54.081351] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-21T17:58:54.081414] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-21T17:58:54.082816] [DEBUG] [LOCAL ] CLVT: Trimmed 75388 records to 51913 (keeping 200 days of data) [2025-10-21T17:58:54.365264] [DEBUG] [LOCAL ] CLVT: Primary data saved (51913 records). [2025-10-21T17:58:54.365393] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-21T17:58:54.365470] [INFO ] [MAIN ] Update Progress: 467/2366 symbols completed. CLVT took 27.9s. Estimated remaining: 3h 59m 16s. Rate: 7.9 symbols/min [2025-10-21T17:58:54.542429] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:58:54.550998] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-21T17:58:54.586745] [DEBUG] [LOCAL ] CMA: Loaded 50177 existing records from primary storage. [2025-10-21T17:58:54.587120] [INFO ] [MAIN ] CMA: Loaded 50177 existing records. [2025-10-21T17:58:54.771280] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:58:54.771596] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-21T17:58:54.771690] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-21T17:58:54.772169] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-21T17:58:54.772231] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-21T17:58:55.006766] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T17:58:55.152749] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T17:58:55.248027] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:58:55.351052] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-21T17:58:56.125687] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T17:58:56.151004] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-21T17:58:56.951068] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-21T17:58:57.235125] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T17:58:57.742632] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T17:58:57.751375] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-21T17:58:58.551024] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-21T17:58:58.829627] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T17:58:59.351026] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-21T17:58:59.382479] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T17:58:59.586611] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T17:58:59.590195] [INFO ] [REMOTE ] CLW: Full fetch complete (33715 records). [2025-10-21T17:58:59.590273] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-21T17:58:59.963131] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-21T17:58:59.963204] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-21T17:58:59.963701] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-21T17:58:59.963761] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-21T17:58:59.964535] [DEBUG] [LOCAL ] CLW: Trimmed 33715 records to 21289 (keeping 200 days of data) [2025-10-21T17:59:00.084350] [DEBUG] [LOCAL ] CLW: Primary data saved (21289 records). [2025-10-21T17:59:00.084467] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-21T17:59:00.084547] [INFO ] [MAIN ] Update Progress: 468/2366 symbols completed. CLW took 31.5s. Estimated remaining: 3h 59m 1s. Rate: 7.9 symbols/min [2025-10-21T17:59:00.160068] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-21T17:59:00.256448] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:00.281185] [DEBUG] [LOCAL ] CMBT: Loaded 27012 existing records from primary storage. [2025-10-21T17:59:00.281433] [INFO ] [MAIN ] CMBT: Loaded 27012 existing records. [2025-10-21T17:59:00.455283] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:00.455479] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-21T17:59:00.455525] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-21T17:59:00.455733] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-21T17:59:00.455788] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-21T17:59:00.809414] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:00.951068] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-21T17:59:01.254788] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T17:59:01.691723] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T17:59:01.751032] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-21T17:59:02.020204] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T17:59:02.551037] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-21T17:59:02.724565] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T17:59:03.351021] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-21T17:59:04.151041] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-21T17:59:04.469326] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T17:59:04.951049] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-21T17:59:05.201855] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T17:59:05.504396] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T17:59:05.751035] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-21T17:59:06.551003] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-21T17:59:06.760573] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T17:59:07.351014] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-21T17:59:07.551926] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T17:59:08.150999] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-21T17:59:08.238632] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T17:59:08.246563] [INFO ] [REMOTE ] CLX: Full fetch complete (73768 records). [2025-10-21T17:59:08.246702] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-21T17:59:08.647950] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-21T17:59:08.648024] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-21T17:59:08.648822] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-21T17:59:08.648884] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-21T17:59:08.650194] [DEBUG] [LOCAL ] CLX: Trimmed 73768 records to 51811 (keeping 200 days of data) [2025-10-21T17:59:08.802990] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-10-21T17:59:08.967590] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-21T17:59:09.009712] [DEBUG] [LOCAL ] CLX: Primary data saved (51811 records). [2025-10-21T17:59:09.009820] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-21T17:59:09.010564] [INFO ] [MAIN ] Update Progress: 469/2366 symbols completed. CLX took 37.1s. Estimated remaining: 3h 58m 59s. Rate: 7.9 symbols/min [2025-10-21T17:59:09.175541] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:09.215904] [DEBUG] [LOCAL ] CMC: Loaded 45569 existing records from primary storage. [2025-10-21T17:59:09.216183] [INFO ] [MAIN ] CMC: Loaded 45569 existing records. [2025-10-21T17:59:09.391552] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:09.391744] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-21T17:59:09.391793] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-21T17:59:09.392531] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-21T17:59:09.392588] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-21T17:59:09.762504] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:09.753693] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-21T17:59:09.826445] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:59:10.091528] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T17:59:10.551031] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-21T17:59:11.335557] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T17:59:11.351032] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-21T17:59:12.151110] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-21T17:59:12.348262] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T17:59:12.393564] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:59:12.951041] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-21T17:59:13.698048] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T17:59:13.750980] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-21T17:59:14.355402] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T17:59:14.551045] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-21T17:59:15.150752] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T17:59:15.351006] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-21T17:59:16.151002] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-21T17:59:16.208768] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T17:59:16.951000] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-21T17:59:17.233876] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T17:59:17.751056] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-21T17:59:17.809760] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T17:59:17.929192] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T17:59:18.551059] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-21T17:59:19.260968] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T17:59:19.350996] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-21T17:59:20.151030] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-21T17:59:20.366358] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T17:59:20.951052] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-21T17:59:21.340610] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T17:59:21.751006] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-21T17:59:21.911276] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T17:59:22.115869] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T17:59:22.551072] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-21T17:59:23.351046] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-21T17:59:23.489081] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T17:59:24.151096] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-21T17:59:24.254919] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T17:59:24.951034] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-21T17:59:25.063183] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T17:59:25.751003] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-21T17:59:25.878301] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T17:59:25.885701] [INFO ] [REMOTE ] CM: Full fetch complete (69823 records). [2025-10-21T17:59:25.885812] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-21T17:59:26.290468] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-21T17:59:26.290606] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-21T17:59:26.291484] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-21T17:59:26.291574] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-21T17:59:26.292925] [DEBUG] [LOCAL ] CM: Trimmed 69823 records to 48468 (keeping 200 days of data) [2025-10-21T17:59:26.551692] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-21T17:59:26.606669] [DEBUG] [LOCAL ] CM: Primary data saved (48468 records). [2025-10-21T17:59:26.606784] [INFO ] [MAIN ] CM: Full history saved. [2025-10-21T17:59:26.607133] [INFO ] [MAIN ] Update Progress: 470/2366 symbols completed. CM took 33.8s. Estimated remaining: 3h 59m 32s. Rate: 7.9 symbols/min [2025-10-21T17:59:26.783282] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:26.790907] [DEBUG] [LOCAL ] CMCM: Loaded 4827 existing records from primary storage. [2025-10-21T17:59:26.791118] [INFO ] [MAIN ] CMCM: Loaded 4827 existing records. [2025-10-21T17:59:26.974426] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:26.974753] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-21T17:59:26.974806] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-21T17:59:26.974996] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-21T17:59:26.975078] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-21T17:59:27.149959] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-21T17:59:27.201095] [INFO ] [REMOTE ] CMA: Full fetch complete (73502 records). [2025-10-21T17:59:27.240675] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-21T17:59:27.488397] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:27.488753] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-21T17:59:27.727399] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T17:59:27.820901] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-21T17:59:27.820982] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-21T17:59:27.821862] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-21T17:59:27.821924] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-21T17:59:27.823193] [DEBUG] [LOCAL ] CMA: Trimmed 73502 records to 50177 (keeping 200 days of data) [2025-10-21T17:59:28.125277] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T17:59:28.128412] [DEBUG] [LOCAL ] CMA: Primary data saved (50177 records). [2025-10-21T17:59:28.128482] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-21T17:59:28.128551] [INFO ] [MAIN ] Update Progress: 471/2366 symbols completed. CMA took 33.8s. Estimated remaining: 3h 58m 60s. Rate: 7.9 symbols/min [2025-10-21T17:59:28.159243] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-21T17:59:28.303633] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:28.303852] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-21T17:59:28.303907] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-21T17:59:28.304025] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-21T17:59:28.304082] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-21T17:59:28.304149] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-21T17:59:28.304184] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-21T17:59:28.642633] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T17:59:28.714536] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:28.821167] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T17:59:28.951057] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-21T17:59:29.610528] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T17:59:29.751078] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-21T17:59:30.252513] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T17:59:30.551044] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-21T17:59:31.351041] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-21T17:59:31.567804] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T17:59:31.568137] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-21T17:59:31.568231] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T17:59:31.568304] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-21T17:59:31.568367] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T17:59:31.568450] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-21T17:59:31.568513] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-21T17:59:31.568549] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-21T17:59:31.568592] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-21T17:59:31.568635] [INFO ] [MAIN ] Update Progress: 472/2366 symbols completed. CMDB took 3.4s. Estimated remaining: 3h 58m 35s. Rate: 7.9 symbols/min [2025-10-21T17:59:31.739907] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:31.740099] [DEBUG] [LOCAL ] CMG: No existing data file found in primary storage. [2025-10-21T17:59:31.740135] [WARN ] [MAIN ] CMG: No existing data found, performing full refresh instead. [2025-10-21T17:59:31.740240] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-21T17:59:31.740280] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-21T17:59:31.740320] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-21T17:59:31.740350] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-21T17:59:32.100181] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:32.151012] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-21T17:59:32.361293] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T17:59:32.369105] [INFO ] [REMOTE ] CMBT: Full fetch complete (33583 records). [2025-10-21T17:59:32.369207] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-21T17:59:32.645482] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T17:59:32.754097] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-21T17:59:32.754177] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-21T17:59:32.754757] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-21T17:59:32.754818] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-21T17:59:32.755788] [DEBUG] [LOCAL ] CMBT: Trimmed 33583 records to 27244 (keeping 200 days of data) [2025-10-21T17:59:32.920610] [DEBUG] [LOCAL ] CMBT: Primary data saved (27244 records). [2025-10-21T17:59:32.920769] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-21T17:59:32.920878] [INFO ] [MAIN ] Update Progress: 473/2366 symbols completed. CMBT took 32.8s. Estimated remaining: 3h 58m 3s. Rate: 8.0 symbols/min [2025-10-21T17:59:32.952870] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-21T17:59:33.093869] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:33.094052] [DEBUG] [LOCAL ] CMI: No existing data file found in primary storage. [2025-10-21T17:59:33.094139] [WARN ] [MAIN ] CMI: No existing data found, performing full refresh instead. [2025-10-21T17:59:33.094222] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-21T17:59:33.094259] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-21T17:59:33.094299] [DEBUG] [LOCAL ] CMI: No primary data file found to delete. [2025-10-21T17:59:33.094330] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-21T17:59:33.450330] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:33.751027] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-21T17:59:34.283868] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T17:59:34.506884] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T17:59:34.550987] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-21T17:59:35.351021] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-21T17:59:36.007681] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T17:59:36.151042] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-21T17:59:36.601882] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T17:59:36.871253] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T17:59:36.951060] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-21T17:59:37.751049] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-21T17:59:37.829192] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T17:59:38.551052] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-21T17:59:39.351027] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-21T17:59:39.460854] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T17:59:39.468543] [INFO ] [REMOTE ] CMC: Full fetch complete (67283 records). [2025-10-21T17:59:39.468678] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-21T17:59:39.850476] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-21T17:59:39.850588] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-21T17:59:39.851551] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-21T17:59:39.851610] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-21T17:59:39.852925] [DEBUG] [LOCAL ] CMC: Trimmed 67283 records to 45567 (keeping 200 days of data) [2025-10-21T17:59:40.115803] [DEBUG] [LOCAL ] CMC: Primary data saved (45567 records). [2025-10-21T17:59:40.115929] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-21T17:59:40.116589] [INFO ] [MAIN ] Update Progress: 474/2366 symbols completed. CMC took 31.1s. Estimated remaining: 3h 57m 54s. Rate: 8.0 symbols/min [2025-10-21T17:59:40.159138] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-21T17:59:40.292167] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:40.326602] [DEBUG] [LOCAL ] CMP: Loaded 35799 existing records from primary storage. [2025-10-21T17:59:40.326901] [INFO ] [MAIN ] CMP: Loaded 35799 existing records. [2025-10-21T17:59:40.502266] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:40.502548] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-21T17:59:40.502608] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-21T17:59:40.503159] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-21T17:59:40.503219] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-21T17:59:40.893144] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:40.896578] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-21T17:59:40.945279] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T17:59:40.954406] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-21T17:59:41.122546] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T17:59:41.124082] [INFO ] [REMOTE ] CMCM: Full fetch complete (7050 records). [2025-10-21T17:59:41.124150] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-21T17:59:41.528687] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-21T17:59:41.528775] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-21T17:59:41.529017] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-21T17:59:41.529056] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-21T17:59:41.529497] [DEBUG] [LOCAL ] CMCM: Trimmed 7050 records to 4857 (keeping 200 days of data) [2025-10-21T17:59:41.557813] [DEBUG] [LOCAL ] CMCM: Primary data saved (4857 records). [2025-10-21T17:59:41.557938] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-21T17:59:41.558021] [INFO ] [MAIN ] Update Progress: 475/2366 symbols completed. CMCM took 15.0s. Estimated remaining: 3h 57m 22s. Rate: 8.0 symbols/min [2025-10-21T17:59:41.740748] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T17:59:41.751041] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-21T17:59:41.779825] [DEBUG] [LOCAL ] CMPO: Loaded 38711 existing records from primary storage. [2025-10-21T17:59:41.780138] [INFO ] [MAIN ] CMPO: Loaded 38711 existing records. [2025-10-21T17:59:41.964543] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T17:59:41.964792] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-21T17:59:41.964874] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-21T17:59:41.965559] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-21T17:59:41.965620] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-21T17:59:42.333239] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T17:59:42.551063] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-21T17:59:42.838058] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T17:59:42.877688] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T17:59:43.351033] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-21T17:59:44.151016] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-21T17:59:44.222937] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T17:59:44.731011] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T17:59:44.951051] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-21T17:59:45.751085] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-21T17:59:46.300807] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T17:59:46.367262] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T17:59:46.551020] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-21T17:59:47.351085] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-21T17:59:47.537378] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T17:59:47.590843] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T17:59:48.151102] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-21T17:59:48.848948] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T17:59:48.951046] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-21T17:59:49.751058] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-21T17:59:50.331111] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T17:59:50.504567] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T17:59:50.550980] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-21T17:59:51.166438] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T17:59:51.351100] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-21T17:59:51.878922] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T17:59:52.151052] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-21T17:59:52.815770] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T17:59:52.951033] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-21T17:59:53.703909] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T17:59:53.750995] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-21T17:59:53.993320] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T17:59:54.551032] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-21T17:59:55.075042] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T17:59:55.351026] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-21T17:59:55.892336] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T17:59:56.151024] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-21T17:59:56.951010] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-21T17:59:57.026067] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T17:59:57.523091] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T17:59:57.751083] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-21T17:59:58.500831] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T17:59:58.551004] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-21T17:59:58.804224] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T17:59:59.351023] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-21T18:00:00.089971] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T18:00:00.151027] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-21T18:00:00.868288] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:00:00.951024] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-21T18:00:01.751033] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-21T18:00:02.189165] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T18:00:02.551039] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-21T18:00:02.773231] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:00:03.351022] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-21T18:00:04.070231] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-21T18:00:04.151166] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-21T18:00:04.598233] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T18:00:04.608247] [INFO ] [REMOTE ] CMI: Full fetch complete (61124 records). [2025-10-21T18:00:04.608393] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-21T18:00:04.959559] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-21T18:00:05.015736] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-21T18:00:05.015852] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-21T18:00:05.016603] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-21T18:00:05.016682] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-21T18:00:05.017978] [DEBUG] [LOCAL ] CMI: Trimmed 61124 records to 41706 (keeping 200 days of data) [2025-10-21T18:00:05.285381] [DEBUG] [LOCAL ] CMI: Primary data saved (41706 records). [2025-10-21T18:00:05.285627] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-21T18:00:05.285768] [INFO ] [MAIN ] Update Progress: 476/2366 symbols completed. CMI took 32.4s. Estimated remaining: 3h 58m 19s. Rate: 7.9 symbols/min [2025-10-21T18:00:05.393089] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T18:00:05.432192] [INFO ] [REMOTE ] CMPO: Full fetch complete (58204 records). [2025-10-21T18:00:05.442579] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-21T18:00:05.577815] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:05.840034] [DEBUG] [LOCAL ] CMRE: Loaded 35844 existing records from primary storage. [2025-10-21T18:00:05.855785] [INFO ] [MAIN ] CMRE: Loaded 35844 existing records. [2025-10-21T18:00:06.009290] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-21T18:00:06.032835] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-21T18:00:06.039057] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-21T18:00:06.047037] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-21T18:00:06.123334] [DEBUG] [LOCAL ] CMPO: Trimmed 58204 records to 38539 (keeping 200 days of data) [2025-10-21T18:00:06.165808] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:06.167016] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-21T18:00:06.167251] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-21T18:00:06.168169] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-21T18:00:06.168231] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-21T18:00:06.662691] [DEBUG] [LOCAL ] CMPO: Primary data saved (38539 records). [2025-10-21T18:00:06.676014] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-21T18:00:06.730186] [INFO ] [MAIN ] Update Progress: 477/2366 symbols completed. CMPO took 25.2s. Estimated remaining: 3h 57m 47s. Rate: 7.9 symbols/min [2025-10-21T18:00:06.731056] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-21T18:00:06.768992] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-21T18:00:06.821746] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:06.822101] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-21T18:00:07.519812] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-10-21T18:00:07.530369] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-21T18:00:08.354217] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:00:08.360595] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-21T18:00:08.460957] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T18:00:08.951098] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-21T18:00:09.709484] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:00:09.750986] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-21T18:00:10.389259] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T18:00:10.503974] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-21T18:00:10.550984] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-21T18:00:10.727557] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T18:00:11.351082] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-21T18:00:12.151075] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-21T18:00:13.211360] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T18:00:13.219875] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-21T18:00:13.641855] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-10-21T18:00:13.751054] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-21T18:00:15.000752] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (2.85 seconds). [2025-10-21T18:00:15.007508] [INFO ] [REMOTE ] CMP: Full fetch complete (51636 records). [2025-10-21T18:00:15.007994] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-21T18:00:15.164367] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T18:00:15.253568] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-21T18:00:15.460786] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-21T18:00:15.460887] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-21T18:00:15.461590] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-21T18:00:15.461634] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-21T18:00:15.462822] [DEBUG] [LOCAL ] CMP: Trimmed 51636 records to 35783 (keeping 200 days of data) [2025-10-21T18:00:15.671360] [DEBUG] [LOCAL ] CMP: Primary data saved (35783 records). [2025-10-21T18:00:15.671485] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-21T18:00:15.672145] [INFO ] [MAIN ] Update Progress: 478/2366 symbols completed. CMP took 35.6s. Estimated remaining: 3h 57m 45s. Rate: 7.9 symbols/min [2025-10-21T18:00:16.958860] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:00:16.968390] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-21T18:00:17.083803] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (3.33 seconds). [2025-10-21T18:00:17.095190] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-21T18:00:18.766129] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T18:00:18.774076] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-21T18:00:20.137198] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:00:20.145919] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-21T18:00:20.391883] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (3.30 seconds). [2025-10-21T18:00:20.399949] [INFO ] [REMOTE ] CMG: Full fetch complete (77503 records). [2025-10-21T18:00:20.400123] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-21T18:00:20.401050] [FATAL] [VALIDATOR ] CMG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:00:20.401141] [FATAL] [MAIN ] CMG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:00:20.401187] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:00:20.401240] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-21T18:00:20.401343] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-21T18:00:20.401403] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-10-21T18:00:20.401491] [DEBUG] [LOCAL ] CMG: No derivative data file found to delete. [2025-10-21T18:00:20.401602] [INFO ] [MAIN ] Update Progress: 479/2366 symbols completed. CMG took 48.8s. Estimated remaining: 3h 57m 26s. Rate: 7.9 symbols/min [2025-10-21T18:00:21.572065] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T18:00:21.579443] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-21T18:00:24.411998] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-21T18:00:24.417895] [INFO ] [REMOTE ] CMRE: Full fetch complete (51030 records). [2025-10-21T18:00:24.418038] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-21T18:00:24.418922] [FATAL] [VALIDATOR ] CMRE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:00:24.419040] [FATAL] [MAIN ] CMRE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:00:24.419115] [WARN ] [MAIN ] CMRE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:00:24.419204] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-21T18:00:24.419283] [DEBUG] [LOCAL ] CMRE: No primary data file found to delete. [2025-10-21T18:00:24.419322] [INFO ] [LOCAL ] CMRE: Starting deletion of derivative data. [2025-10-21T18:00:24.419474] [DEBUG] [LOCAL ] CMRE: Deleted derivative data file. [2025-10-21T18:00:24.419567] [INFO ] [MAIN ] Update Progress: 480/2366 symbols completed. CMRE took 19.1s. Estimated remaining: 3h 57m 5s. Rate: 8.0 symbols/min [2025-10-21T18:00:25.038791] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:25.081667] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:25.093275] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:25.153332] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:25.160034] [DEBUG] [LOCAL ] CMSA: Loaded 3515 existing records from primary storage. [2025-10-21T18:00:25.161305] [INFO ] [MAIN ] CMSA: Loaded 3515 existing records. [2025-10-21T18:00:25.179458] [DEBUG] [LOCAL ] CMSC: Loaded 4847 existing records from primary storage. [2025-10-21T18:00:25.200060] [INFO ] [MAIN ] CMSC: Loaded 4847 existing records. [2025-10-21T18:00:25.259738] [DEBUG] [LOCAL ] CMSD: Loaded 7682 existing records from primary storage. [2025-10-21T18:00:25.294597] [INFO ] [MAIN ] CMSD: Loaded 7682 existing records. [2025-10-21T18:00:25.614726] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:25.689146] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-21T18:00:25.708210] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-21T18:00:25.772178] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-21T18:00:25.759125] [DEBUG] [LOCAL ] CMS: Loaded 52585 existing records from primary storage. [2025-10-21T18:00:25.772095] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:25.773093] [INFO ] [MAIN ] CMS: Loaded 52585 existing records. [2025-10-21T18:00:25.778911] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-21T18:00:25.778987] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-21T18:00:25.772303] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-21T18:00:25.802692] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-21T18:00:25.838219] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:25.862000] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-21T18:00:25.999264] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-21T18:00:26.013422] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-21T18:00:26.089309] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-21T18:00:26.162291] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-21T18:00:26.214504] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:26.255681] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-21T18:00:26.346911] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-21T18:00:26.530894] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-21T18:00:26.582347] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-21T18:00:27.117542] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:27.169967] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-21T18:00:27.226473] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:27.250630] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-21T18:00:27.417039] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:27.433358] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-21T18:00:27.536359] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:27.536693] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-21T18:00:28.287120] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T18:00:28.288885] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-21T18:00:28.346091] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:00:28.347557] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-21T18:00:28.437820] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:00:28.440519] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-21T18:00:28.933370] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T18:00:28.935233] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-21T18:00:28.976720] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:00:28.977920] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-21T18:00:29.088348] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T18:00:29.090038] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-21T18:00:29.473421] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-21T18:00:29.474794] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-21T18:00:29.560164] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T18:00:29.563192] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-21T18:00:29.573045] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T18:00:29.575396] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-21T18:00:29.742371] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-21T18:00:29.752468] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-21T18:00:30.072538] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T18:00:30.139025] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T18:00:30.323387] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T18:00:30.551087] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-21T18:00:31.258487] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:00:31.277847] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T18:00:31.351025] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-21T18:00:31.914133] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T18:00:32.151008] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-21T18:00:32.869609] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:00:32.951022] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-21T18:00:33.367311] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-21T18:00:33.751022] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-21T18:00:34.457560] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-21T18:00:34.551002] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-21T18:00:34.927317] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-21T18:00:35.351028] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-21T18:00:35.825864] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T18:00:36.151028] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-21T18:00:36.791815] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T18:00:36.951068] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-21T18:00:37.601914] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T18:00:37.751117] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-21T18:00:38.546304] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T18:00:38.551716] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-21T18:00:39.351061] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-21T18:00:40.051767] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T18:00:40.151042] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-21T18:00:40.546258] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T18:00:40.572032] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T18:00:40.951022] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-21T18:00:41.751027] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-21T18:00:42.384509] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T18:00:42.386064] [INFO ] [REMOTE ] CMSD: Full fetch complete (11490 records). [2025-10-21T18:00:42.386148] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-21T18:00:42.558288] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-21T18:00:42.799721] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T18:00:42.843210] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-21T18:00:42.843423] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-21T18:00:42.844020] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-21T18:00:42.844129] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-21T18:00:42.845091] [DEBUG] [LOCAL ] CMSD: Trimmed 11490 records to 7668 (keeping 200 days of data) [2025-10-21T18:00:42.900488] [DEBUG] [LOCAL ] CMSD: Primary data saved (7668 records). [2025-10-21T18:00:42.900678] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-21T18:00:42.900796] [INFO ] [MAIN ] Update Progress: 481/2366 symbols completed. CMSD took 18.5s. Estimated remaining: 3h 57m 40s. Rate: 7.9 symbols/min [2025-10-21T18:00:43.074905] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:43.075101] [DEBUG] [LOCAL ] CMTG: No existing data file found in primary storage. [2025-10-21T18:00:43.075139] [WARN ] [MAIN ] CMTG: No existing data found, performing full refresh instead. [2025-10-21T18:00:43.075250] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-21T18:00:43.075314] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-21T18:00:43.075354] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-21T18:00:43.075385] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-21T18:00:43.356051] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-21T18:00:43.358038] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T18:00:43.440752] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:44.151043] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-21T18:00:44.852432] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T18:00:44.951125] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-21T18:00:45.181528] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:00:45.604470] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T18:00:45.751055] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-21T18:00:46.456322] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T18:00:46.457492] [INFO ] [REMOTE ] CMSC: Full fetch complete (6954 records). [2025-10-21T18:00:46.457558] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-21T18:00:46.556192] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-21T18:00:46.809868] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-21T18:00:46.809939] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-21T18:00:46.810100] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-21T18:00:46.810137] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-21T18:00:46.810520] [DEBUG] [LOCAL ] CMSC: Trimmed 6954 records to 4835 (keeping 200 days of data) [2025-10-21T18:00:46.838601] [DEBUG] [LOCAL ] CMSC: Primary data saved (4835 records). [2025-10-21T18:00:46.838694] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-21T18:00:46.838774] [INFO ] [MAIN ] Update Progress: 482/2366 symbols completed. CMSC took 22.4s. Estimated remaining: 3h 57m 19s. Rate: 7.9 symbols/min [2025-10-21T18:00:47.013904] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:47.022361] [DEBUG] [LOCAL ] CMU: Loaded 6357 existing records from primary storage. [2025-10-21T18:00:47.022531] [INFO ] [MAIN ] CMU: Loaded 6357 existing records. [2025-10-21T18:00:47.207147] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:47.207382] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-21T18:00:47.207429] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-21T18:00:47.207606] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-21T18:00:47.207701] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-21T18:00:47.356194] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-21T18:00:47.578279] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:48.151088] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-21T18:00:48.210204] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:00:48.739068] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:00:48.740560] [INFO ] [REMOTE ] CMSA: Full fetch complete (4846 records). [2025-10-21T18:00:48.740665] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-21T18:00:48.956187] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-21T18:00:49.131933] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T18:00:49.144932] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-21T18:00:49.145539] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-21T18:00:49.145899] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-21T18:00:49.145961] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-21T18:00:49.146356] [DEBUG] [LOCAL ] CMSA: Trimmed 4846 records to 3497 (keeping 200 days of data) [2025-10-21T18:00:49.170491] [DEBUG] [LOCAL ] CMSA: Primary data saved (3497 records). [2025-10-21T18:00:49.170617] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-21T18:00:49.170729] [INFO ] [MAIN ] Update Progress: 483/2366 symbols completed. CMSA took 24.7s. Estimated remaining: 3h 56m 51s. Rate: 8.0 symbols/min [2025-10-21T18:00:49.336999] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:00:49.369056] [DEBUG] [LOCAL ] CNA: Loaded 32763 existing records from primary storage. [2025-10-21T18:00:49.369313] [INFO ] [MAIN ] CNA: Loaded 32763 existing records. [2025-10-21T18:00:49.550479] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:00:49.550762] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-21T18:00:49.550825] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-21T18:00:49.551071] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-21T18:00:49.551142] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-21T18:00:49.723958] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T18:00:49.757482] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-21T18:00:49.932734] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:00:50.551011] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-21T18:00:51.351055] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-21T18:00:51.711296] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:00:51.882756] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T18:00:51.884239] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T18:00:52.151027] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-21T18:00:52.950998] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-21T18:00:53.502974] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T18:00:53.762971] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-21T18:00:53.768412] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T18:00:54.527552] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T18:00:54.550973] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-21T18:00:55.115080] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T18:00:55.351046] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-21T18:00:56.151036] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-21T18:00:56.763811] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T18:00:56.951037] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-21T18:00:57.751012] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-21T18:00:57.937674] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:00:58.354455] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:00:58.551056] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-21T18:00:58.896014] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T18:00:59.265154] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T18:00:59.351032] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-21T18:01:00.151033] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-21T18:01:00.950995] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-21T18:01:01.114601] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T18:01:01.196016] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:01:01.751081] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-21T18:01:02.551017] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-21T18:01:03.256255] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:01:03.351007] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-21T18:01:03.470536] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-21T18:01:03.478234] [INFO ] [REMOTE ] CMS: Full fetch complete (75877 records). [2025-10-21T18:01:03.478395] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-21T18:01:03.479202] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:01:03.479321] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:01:03.479397] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:01:03.479496] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-21T18:01:03.479576] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-21T18:01:03.479614] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-21T18:01:03.479926] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-21T18:01:03.480024] [INFO ] [MAIN ] Update Progress: 484/2366 symbols completed. CMS took 39.1s. Estimated remaining: 3h 57m 9s. Rate: 7.9 symbols/min [2025-10-21T18:01:03.655115] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:03.704222] [DEBUG] [LOCAL ] CNC: Loaded 53778 existing records from primary storage. [2025-10-21T18:01:03.704539] [INFO ] [MAIN ] CNC: Loaded 53778 existing records. [2025-10-21T18:01:03.901519] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T18:01:03.915244] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:03.923554] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-21T18:01:03.924023] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-21T18:01:03.924512] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-21T18:01:03.924566] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-21T18:01:04.156636] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-21T18:01:04.286107] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:04.811091] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T18:01:04.950981] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-21T18:01:05.751028] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-21T18:01:05.810790] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:01:06.356156] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:01:06.551016] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-21T18:01:07.133342] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:01:07.351003] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-21T18:01:07.468468] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T18:01:08.151027] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-21T18:01:08.850009] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:01:08.951024] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-21T18:01:09.751033] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-21T18:01:09.876592] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T18:01:10.551013] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-21T18:01:10.665303] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:01:11.322558] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:01:11.351023] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-21T18:01:12.151052] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-21T18:01:12.305692] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T18:01:12.855923] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T18:01:12.857103] [INFO ] [REMOTE ] CMU: Full fetch complete (9444 records). [2025-10-21T18:01:12.857173] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-21T18:01:12.857528] [FATAL] [VALIDATOR ] CMU: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:01:12.857611] [FATAL] [MAIN ] CMU: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:01:12.857692] [WARN ] [MAIN ] CMU: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:01:12.857778] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-21T18:01:12.857854] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-21T18:01:12.857905] [INFO ] [LOCAL ] CMU: Starting deletion of derivative data. [2025-10-21T18:01:12.858104] [DEBUG] [LOCAL ] CMU: Deleted derivative data file. [2025-10-21T18:01:12.858212] [INFO ] [MAIN ] Update Progress: 485/2366 symbols completed. CMU took 26.0s. Estimated remaining: 3h 57m 9s. Rate: 7.9 symbols/min [2025-10-21T18:01:12.960246] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-21T18:01:13.058982] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:13.059575] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-21T18:01:13.060891] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:01:13.059685] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-21T18:01:13.069527] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-21T18:01:13.069730] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-21T18:01:13.069797] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-21T18:01:13.070100] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-21T18:01:13.444114] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:13.751024] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-21T18:01:14.551021] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-21T18:01:14.902211] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T18:01:15.009370] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-21T18:01:15.351056] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-21T18:01:15.621882] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T18:01:16.151042] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-21T18:01:16.951011] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-21T18:01:17.360072] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T18:01:17.400475] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T18:01:17.632488] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T18:01:17.751040] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-21T18:01:18.271958] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T18:01:18.551041] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-21T18:01:19.351034] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-21T18:01:19.359161] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:01:20.150990] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-21T18:01:20.764594] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T18:01:20.769407] [INFO ] [REMOTE ] CMTG: Full fetch complete (53028 records). [2025-10-21T18:01:20.769503] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-21T18:01:20.957527] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-21T18:01:21.151079] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-21T18:01:21.151156] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-21T18:01:21.151816] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-21T18:01:21.151877] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-21T18:01:21.152908] [DEBUG] [LOCAL ] CMTG: Trimmed 53028 records to 35328 (keeping 200 days of data) [2025-10-21T18:01:21.351093] [DEBUG] [LOCAL ] CMTG: Primary data saved (35328 records). [2025-10-21T18:01:21.351220] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-21T18:01:21.351288] [INFO ] [MAIN ] Update Progress: 486/2366 symbols completed. CMTG took 38.5s. Estimated remaining: 3h 57m 5s. Rate: 7.9 symbols/min [2025-10-21T18:01:21.554254] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:21.550086] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:01:21.618346] [DEBUG] [LOCAL ] CNH: Loaded 53548 existing records from primary storage. [2025-10-21T18:01:21.618761] [INFO ] [MAIN ] CNH: Loaded 53548 existing records. [2025-10-21T18:01:21.756124] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-21T18:01:21.827972] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:21.828261] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-21T18:01:21.828317] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-21T18:01:21.828745] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-21T18:01:21.828805] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-21T18:01:22.238086] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:22.416916] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T18:01:22.550982] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-21T18:01:22.886714] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T18:01:23.351047] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-21T18:01:23.399963] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T18:01:24.151029] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-21T18:01:24.951018] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-21T18:01:25.751001] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-21T18:01:25.866141] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-21T18:01:26.551052] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-21T18:01:26.679458] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T18:01:26.684710] [INFO ] [REMOTE ] CNA: Full fetch complete (46126 records). [2025-10-21T18:01:26.684856] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-21T18:01:26.849532] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T18:01:27.089788] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-21T18:01:27.089936] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-21T18:01:27.090866] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-21T18:01:27.091044] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-21T18:01:27.124265] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-21T18:01:27.124424] [DEBUG] [LOCAL ] CNA: Trimmed 46126 records to 32604 (keeping 200 days of data) [2025-10-21T18:01:27.351601] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-21T18:01:27.354622] [DEBUG] [LOCAL ] CNA: Primary data saved (32604 records). [2025-10-21T18:01:27.354745] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-21T18:01:27.356344] [INFO ] [MAIN ] Update Progress: 487/2366 symbols completed. CNA took 38.2s. Estimated remaining: 3h 56m 51s. Rate: 7.9 symbols/min [2025-10-21T18:01:27.523931] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:27.577691] [DEBUG] [LOCAL ] CNI: Loaded 51678 existing records from primary storage. [2025-10-21T18:01:27.577992] [INFO ] [MAIN ] CNI: Loaded 51678 existing records. [2025-10-21T18:01:27.751680] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:27.751899] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-21T18:01:27.751949] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-21T18:01:27.752503] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-21T18:01:27.752560] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-21T18:01:28.119380] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:28.151523] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-21T18:01:28.159002] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T18:01:28.951107] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-21T18:01:29.751053] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-21T18:01:30.070830] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T18:01:30.147985] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-21T18:01:30.550993] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-21T18:01:30.623892] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T18:01:30.851186] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T18:01:31.351031] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-21T18:01:32.151035] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-21T18:01:32.770636] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T18:01:32.950990] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-21T18:01:33.003143] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:01:33.244940] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T18:01:33.526240] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T18:01:33.534521] [INFO ] [REMOTE ] CNC: Full fetch complete (77856 records). [2025-10-21T18:01:33.534636] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-21T18:01:33.756136] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-21T18:01:33.936294] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-21T18:01:33.936389] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-21T18:01:33.937292] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-21T18:01:33.937358] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-21T18:01:33.938914] [DEBUG] [LOCAL ] CNC: Trimmed 77856 records to 53779 (keeping 200 days of data) [2025-10-21T18:01:34.245227] [DEBUG] [LOCAL ] CNC: Primary data saved (53779 records). [2025-10-21T18:01:34.245363] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-21T18:01:34.245738] [INFO ] [MAIN ] Update Progress: 488/2366 symbols completed. CNC took 30.8s. Estimated remaining: 3h 56m 41s. Rate: 7.9 symbols/min [2025-10-21T18:01:34.410857] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:34.460346] [DEBUG] [LOCAL ] CNK: Loaded 52920 existing records from primary storage. [2025-10-21T18:01:34.460685] [INFO ] [MAIN ] CNK: Loaded 52920 existing records. [2025-10-21T18:01:34.556169] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-21T18:01:34.637198] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:34.637401] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-21T18:01:34.637474] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-21T18:01:34.638367] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-21T18:01:34.638426] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-21T18:01:34.988611] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:35.350997] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-21T18:01:35.481376] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T18:01:35.674675] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:01:36.151040] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-21T18:01:36.951005] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-21T18:01:36.992958] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T18:01:36.994543] [INFO ] [REMOTE ] CNF: Full fetch complete (13026 records). [2025-10-21T18:01:36.994636] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-21T18:01:37.404686] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-21T18:01:37.404936] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-21T18:01:37.405579] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-21T18:01:37.416148] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-21T18:01:37.440236] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T18:01:37.440707] [DEBUG] [LOCAL ] CNF: Trimmed 13026 records to 10592 (keeping 200 days of data) [2025-10-21T18:01:37.517487] [DEBUG] [LOCAL ] CNF: Primary data saved (10592 records). [2025-10-21T18:01:37.517664] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-21T18:01:37.517760] [INFO ] [MAIN ] Update Progress: 489/2366 symbols completed. CNF took 24.7s. Estimated remaining: 3h 56m 17s. Rate: 7.9 symbols/min [2025-10-21T18:01:37.720826] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:37.758724] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-21T18:01:37.794696] [DEBUG] [LOCAL ] CNM: Loaded 51031 existing records from primary storage. [2025-10-21T18:01:37.795178] [INFO ] [MAIN ] CNM: Loaded 51031 existing records. [2025-10-21T18:01:38.078494] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:01:38.078784] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-21T18:01:38.078845] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-21T18:01:38.079107] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-21T18:01:38.079156] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-21T18:01:38.559902] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-21T18:01:38.566994] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:01:38.630281] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T18:01:39.351044] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-21T18:01:39.400962] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:01:40.151031] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-21T18:01:40.321787] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:01:40.951089] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-21T18:01:41.175540] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:01:41.751075] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-21T18:01:41.983089] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:01:42.308143] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T18:01:42.551091] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-21T18:01:43.351065] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-21T18:01:43.498333] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T18:01:44.151040] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-21T18:01:44.213343] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:01:44.951069] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-21T18:01:45.078393] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T18:01:45.756160] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-21T18:01:45.773532] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:01:46.551072] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-21T18:01:46.612100] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T18:01:47.350990] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-21T18:01:47.571167] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T18:01:48.156119] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-21T18:01:48.183075] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T18:01:48.951032] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-21T18:01:49.161015] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:01:49.751084] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-21T18:01:49.974106] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:01:50.551067] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-21T18:01:50.581145] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T18:01:51.351062] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-21T18:01:51.418623] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:01:52.151039] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-21T18:01:52.232371] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T18:01:52.951051] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-21T18:01:53.332552] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:01:53.616531] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T18:01:53.751053] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-21T18:01:54.551047] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-21T18:01:54.686661] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T18:01:55.353955] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-21T18:01:55.357043] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T18:01:56.003205] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:01:56.151025] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-21T18:01:56.951067] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-21T18:01:57.006722] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:01:57.500683] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T18:01:57.751042] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-21T18:01:58.551048] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-21T18:01:58.936790] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:01:58.944801] [INFO ] [REMOTE ] CNI: Full fetch complete (74834 records). [2025-10-21T18:01:58.944959] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-21T18:01:59.351822] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-21T18:01:59.352090] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-21T18:01:59.351959] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-21T18:01:59.353444] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-21T18:01:59.354713] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-21T18:01:59.356383] [DEBUG] [LOCAL ] CNI: Trimmed 74834 records to 51658 (keeping 200 days of data) [2025-10-21T18:01:59.618593] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T18:01:59.727572] [DEBUG] [LOCAL ] CNI: Primary data saved (51658 records). [2025-10-21T18:01:59.727743] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-21T18:01:59.728537] [INFO ] [MAIN ] Update Progress: 490/2366 symbols completed. CNI took 32.4s. Estimated remaining: 3h 57m 6s. Rate: 7.9 symbols/min [2025-10-21T18:01:59.895070] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:01:59.895228] [DEBUG] [LOCAL ] CNMD: No existing data file found in primary storage. [2025-10-21T18:01:59.895285] [WARN ] [MAIN ] CNMD: No existing data found, performing full refresh instead. [2025-10-21T18:01:59.895392] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-21T18:01:59.895433] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-21T18:01:59.895472] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-21T18:01:59.895502] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-21T18:02:00.152072] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-21T18:02:00.262217] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:00.321974] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T18:02:00.330708] [INFO ] [REMOTE ] CNH: Full fetch complete (77704 records). [2025-10-21T18:02:00.330869] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-21T18:02:00.781946] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-21T18:02:00.782051] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-21T18:02:00.782927] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-21T18:02:00.782989] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-21T18:02:00.784506] [DEBUG] [LOCAL ] CNH: Trimmed 77704 records to 53547 (keeping 200 days of data) [2025-10-21T18:02:00.954994] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-21T18:02:01.107335] [DEBUG] [LOCAL ] CNH: Primary data saved (53547 records). [2025-10-21T18:02:01.107476] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-21T18:02:01.108318] [INFO ] [MAIN ] Update Progress: 491/2366 symbols completed. CNH took 39.8s. Estimated remaining: 3h 56m 34s. Rate: 7.9 symbols/min [2025-10-21T18:02:01.279117] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:01.279360] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-21T18:02:01.279459] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-21T18:02:01.279571] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-21T18:02:01.279720] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-21T18:02:01.279832] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-21T18:02:01.279904] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-21T18:02:01.627420] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-21T18:02:01.754146] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-21T18:02:01.758428] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:01.815036] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:02:02.526059] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T18:02:02.550977] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-21T18:02:03.351015] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-21T18:02:03.624072] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T18:02:03.632335] [INFO ] [REMOTE ] CNK: Full fetch complete (76221 records). [2025-10-21T18:02:03.632469] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-21T18:02:04.045888] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-21T18:02:04.045991] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-21T18:02:04.046959] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-21T18:02:04.047042] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-21T18:02:04.078667] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T18:02:04.077139] [DEBUG] [LOCAL ] CNK: Trimmed 76221 records to 52908 (keeping 200 days of data) [2025-10-21T18:02:04.176563] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-21T18:02:04.403722] [DEBUG] [LOCAL ] CNK: Primary data saved (52908 records). [2025-10-21T18:02:04.403884] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-21T18:02:04.404192] [INFO ] [MAIN ] Update Progress: 492/2366 symbols completed. CNK took 30.2s. Estimated remaining: 3h 56m 11s. Rate: 7.9 symbols/min [2025-10-21T18:02:04.573723] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:04.611745] [DEBUG] [LOCAL ] CNO: Loaded 40510 existing records from primary storage. [2025-10-21T18:02:04.612006] [INFO ] [MAIN ] CNO: Loaded 40510 existing records. [2025-10-21T18:02:04.801926] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T18:02:04.806830] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:02:04.806982] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-21T18:02:04.812630] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-21T18:02:04.813070] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-21T18:02:04.813126] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-21T18:02:04.956235] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-21T18:02:05.167914] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:05.750993] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-21T18:02:05.982272] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T18:02:06.551038] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-21T18:02:07.014255] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T18:02:07.088930] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T18:02:07.351071] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-21T18:02:07.792985] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T18:02:08.151028] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-21T18:02:08.678902] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T18:02:08.951078] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-21T18:02:09.469131] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T18:02:09.751022] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-21T18:02:10.313607] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T18:02:10.551019] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-21T18:02:11.350999] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-21T18:02:11.500402] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T18:02:11.511817] [INFO ] [REMOTE ] CNM: Full fetch complete (73769 records). [2025-10-21T18:02:11.511995] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-21T18:02:11.937607] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-21T18:02:11.937996] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-21T18:02:11.939351] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-21T18:02:11.940051] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:02:11.946442] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-21T18:02:11.948094] [DEBUG] [LOCAL ] CNM: Trimmed 73769 records to 51017 (keeping 200 days of data) [2025-10-21T18:02:12.151796] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-21T18:02:12.240272] [DEBUG] [LOCAL ] CNM: Primary data saved (51017 records). [2025-10-21T18:02:12.240419] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-21T18:02:12.240511] [INFO ] [MAIN ] Update Progress: 493/2366 symbols completed. CNM took 34.7s. Estimated remaining: 3h 56m 4s. Rate: 7.9 symbols/min [2025-10-21T18:02:12.411387] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:12.411519] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-10-21T18:02:12.411555] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-10-21T18:02:12.411682] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-21T18:02:12.411735] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-21T18:02:12.411776] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-21T18:02:12.411806] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-21T18:02:12.763637] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:12.950982] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-21T18:02:13.020307] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:02:13.751075] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-21T18:02:13.786941] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:02:14.551003] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-21T18:02:14.599157] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:02:15.269860] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T18:02:15.351013] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-21T18:02:16.151017] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-21T18:02:16.449207] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T18:02:16.951075] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-21T18:02:17.248490] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T18:02:17.567330] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T18:02:17.751070] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-21T18:02:18.155702] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T18:02:18.551073] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-21T18:02:19.351005] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-21T18:02:19.662633] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T18:02:20.151024] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-21T18:02:20.250328] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:02:20.700575] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T18:02:20.951074] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-21T18:02:21.470995] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T18:02:21.751012] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-21T18:02:22.550995] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-21T18:02:22.845587] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:02:23.176697] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:02:23.181424] [INFO ] [REMOTE ] CNMD: Full fetch complete (47316 records). [2025-10-21T18:02:23.181509] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-21T18:02:23.354423] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-21T18:02:23.557747] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-21T18:02:23.557866] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-21T18:02:23.558499] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-21T18:02:23.558559] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-21T18:02:23.559606] [DEBUG] [LOCAL ] CNMD: Trimmed 47316 records to 32081 (keeping 200 days of data) [2025-10-21T18:02:23.749419] [DEBUG] [LOCAL ] CNMD: Primary data saved (32081 records). [2025-10-21T18:02:23.749536] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-21T18:02:23.749603] [INFO ] [MAIN ] Update Progress: 494/2366 symbols completed. CNMD took 24.0s. Estimated remaining: 3h 56m 11s. Rate: 7.9 symbols/min [2025-10-21T18:02:23.919359] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:23.967378] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T18:02:23.991803] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-10-21T18:02:23.992105] [INFO ] [MAIN ] CNQ: Loaded 53583 existing records. [2025-10-21T18:02:24.160125] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-21T18:02:24.164586] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:02:24.165411] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-21T18:02:24.165461] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-21T18:02:24.166134] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-21T18:02:24.166190] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-21T18:02:24.519991] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:24.951059] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-21T18:02:25.428741] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T18:02:25.613596] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:02:25.751030] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-21T18:02:26.551081] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-21T18:02:27.337563] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-21T18:02:27.350984] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-21T18:02:27.856201] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T18:02:28.151073] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-21T18:02:28.951088] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-21T18:02:29.320838] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-21T18:02:29.391088] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T18:02:29.656240] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-21T18:02:29.751048] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-21T18:02:30.556259] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-21T18:02:30.590626] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:02:31.351101] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-21T18:02:31.450782] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T18:02:32.003822] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T18:02:32.151050] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-21T18:02:32.951061] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-21T18:02:33.117245] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T18:02:33.543056] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T18:02:33.751130] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-21T18:02:34.551024] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-21T18:02:34.818813] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:02:35.351043] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-21T18:02:35.655488] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T18:02:36.120449] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:02:36.151025] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-21T18:02:36.951031] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-21T18:02:37.055917] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T18:02:37.481144] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T18:02:37.486802] [INFO ] [REMOTE ] CNNE: Full fetch complete (50552 records). [2025-10-21T18:02:37.486899] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-21T18:02:37.756274] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-21T18:02:37.861247] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-21T18:02:37.861332] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-21T18:02:37.862000] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-21T18:02:37.862060] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-21T18:02:37.863050] [DEBUG] [LOCAL ] CNNE: Trimmed 50552 records to 35869 (keeping 200 days of data) [2025-10-21T18:02:38.073584] [DEBUG] [LOCAL ] CNNE: Primary data saved (35869 records). [2025-10-21T18:02:38.073742] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-21T18:02:38.073821] [INFO ] [MAIN ] Update Progress: 495/2366 symbols completed. CNNE took 37.0s. Estimated remaining: 3h 56m 29s. Rate: 7.9 symbols/min [2025-10-21T18:02:38.265345] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:38.265534] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-21T18:02:38.265573] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-21T18:02:38.265716] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-21T18:02:38.265765] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-21T18:02:38.265807] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-21T18:02:38.265840] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-21T18:02:38.553625] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-21T18:02:38.623442] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:38.645924] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T18:02:38.653120] [INFO ] [REMOTE ] CNO: Full fetch complete (60824 records). [2025-10-21T18:02:38.653241] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-21T18:02:39.041966] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-21T18:02:39.042067] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-21T18:02:39.042879] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-21T18:02:39.042966] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-21T18:02:39.044263] [DEBUG] [LOCAL ] CNO: Trimmed 60824 records to 40420 (keeping 200 days of data) [2025-10-21T18:02:39.291274] [DEBUG] [LOCAL ] CNO: Primary data saved (40420 records). [2025-10-21T18:02:39.291454] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-21T18:02:39.291844] [INFO ] [MAIN ] Update Progress: 496/2366 symbols completed. CNO took 34.9s. Estimated remaining: 3h 55m 58s. Rate: 7.9 symbols/min [2025-10-21T18:02:39.357201] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-21T18:02:39.477383] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:39.494847] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-10-21T18:02:39.497369] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-10-21T18:02:39.499387] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T18:02:39.498421] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-21T18:02:39.507198] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-21T18:02:39.507391] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-21T18:02:39.507436] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-21T18:02:39.572735] [INFO ] [REMOTE ] CNP: Full fetch complete (77160 records). [2025-10-21T18:02:39.611409] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-21T18:02:39.633338] [FATAL] [VALIDATOR ] CNP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:02:39.669913] [FATAL] [MAIN ] CNP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:02:39.703711] [WARN ] [MAIN ] CNP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:02:39.749941] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-21T18:02:39.758997] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-10-21T18:02:39.764280] [INFO ] [LOCAL ] CNP: Starting deletion of derivative data. [2025-10-21T18:02:39.771018] [DEBUG] [LOCAL ] CNP: No derivative data file found to delete. [2025-10-21T18:02:39.781414] [INFO ] [MAIN ] Update Progress: 497/2366 symbols completed. CNP took 27.5s. Estimated remaining: 3h 55m 24s. Rate: 7.9 symbols/min [2025-10-21T18:02:39.998881] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:40.092207] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:40.092412] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-21T18:02:40.092628] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-21T18:02:40.093050] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-21T18:02:40.094515] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-21T18:02:40.105813] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-21T18:02:40.106153] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-21T18:02:40.106207] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-21T18:02:40.162355] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-21T18:02:40.487206] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:40.804070] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T18:02:40.951055] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-21T18:02:41.750991] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-21T18:02:42.106332] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T18:02:42.180411] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T18:02:42.551073] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-21T18:02:43.353821] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-21T18:02:43.370101] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:02:43.513754] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:02:44.151044] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-21T18:02:44.951008] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-21T18:02:45.196606] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T18:02:45.754294] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-21T18:02:45.757687] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T18:02:45.848729] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T18:02:46.551063] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-21T18:02:47.351078] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-21T18:02:47.481239] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T18:02:47.616066] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T18:02:48.151028] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-21T18:02:48.935804] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T18:02:48.950974] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-21T18:02:49.734465] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T18:02:49.750988] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-21T18:02:50.464552] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:02:50.551045] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-21T18:02:51.351036] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-21T18:02:51.758592] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T18:02:51.767828] [INFO ] [REMOTE ] CNQ: Full fetch complete (77740 records). [2025-10-21T18:02:51.767958] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-21T18:02:52.162491] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-21T18:02:52.183058] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-21T18:02:52.183321] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-21T18:02:52.184373] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-21T18:02:52.184695] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-21T18:02:52.187887] [DEBUG] [LOCAL ] CNQ: Trimmed 77740 records to 53582 (keeping 200 days of data) [2025-10-21T18:02:52.312090] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T18:02:52.341350] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:02:52.575861] [DEBUG] [LOCAL ] CNQ: Primary data saved (53582 records). [2025-10-21T18:02:52.575995] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-21T18:02:52.576739] [INFO ] [MAIN ] Update Progress: 498/2366 symbols completed. CNQ took 28.8s. Estimated remaining: 3h 55m 36s. Rate: 7.9 symbols/min [2025-10-21T18:02:52.744162] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:02:52.784075] [DEBUG] [LOCAL ] CODI: Loaded 41816 existing records from primary storage. [2025-10-21T18:02:52.784353] [INFO ] [MAIN ] CODI: Loaded 41816 existing records. [2025-10-21T18:02:52.958733] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:02:52.958833] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-21T18:02:52.960179] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-21T18:02:52.960258] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-21T18:02:52.961206] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-21T18:02:52.961267] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-21T18:02:53.317273] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:02:53.751032] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-21T18:02:53.885570] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:02:54.551046] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-21T18:02:54.712040] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T18:02:54.768840] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T18:02:55.351060] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-21T18:02:56.018430] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T18:02:56.151012] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-21T18:02:56.174612] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T18:02:56.951009] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-21T18:02:57.265491] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T18:02:57.751050] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-21T18:02:58.083158] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:02:58.551026] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-21T18:02:59.351029] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-21T18:02:59.397431] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T18:02:59.455503] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T18:03:00.150999] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-21T18:03:00.223630] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T18:03:00.951045] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-21T18:03:01.638495] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:03:01.751024] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-21T18:03:02.261891] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T18:03:02.266616] [INFO ] [REMOTE ] CNS: Full fetch complete (31041 records). [2025-10-21T18:03:02.266775] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-21T18:03:02.267289] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:03:02.267388] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:03:02.267464] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:03:02.267540] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-21T18:03:02.267604] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-21T18:03:02.267639] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-21T18:03:02.267741] [DEBUG] [LOCAL ] CNS: No derivative data file found to delete. [2025-10-21T18:03:02.267813] [INFO ] [MAIN ] Update Progress: 499/2366 symbols completed. CNS took 23.0s. Estimated remaining: 3h 55m 36s. Rate: 7.9 symbols/min [2025-10-21T18:03:02.443505] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:02.500435] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-21T18:03:02.500778] [INFO ] [MAIN ] COF: Loaded 53625 existing records. [2025-10-21T18:03:02.563406] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-21T18:03:02.678038] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:02.678270] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-21T18:03:02.678325] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-21T18:03:02.679309] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-21T18:03:02.679367] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-21T18:03:03.041064] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:03.351030] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-21T18:03:03.664948] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T18:03:04.151034] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-21T18:03:04.221836] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:03:04.944838] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:03:04.955173] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-21T18:03:05.738235] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:03:05.750973] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-21T18:03:06.551074] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-21T18:03:06.661433] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T18:03:07.351055] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-21T18:03:07.671493] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T18:03:08.120393] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:03:08.150980] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-21T18:03:08.951042] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-21T18:03:09.141499] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:03:09.751014] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-21T18:03:09.807838] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T18:03:09.815145] [INFO ] [REMOTE ] CNR: Full fetch complete (62554 records). [2025-10-21T18:03:09.815259] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-21T18:03:10.015028] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-21T18:03:10.015665] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:03:10.015740] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:03:10.015789] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-21T18:03:10.015845] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-21T18:03:10.015888] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-21T18:03:10.015926] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-21T18:03:10.015981] [INFO ] [MAIN ] Update Progress: 500/2366 symbols completed. CNR took 31.9s. Estimated remaining: 3h 55m 29s. Rate: 7.9 symbols/min [2025-10-21T18:03:10.186279] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:10.186433] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-21T18:03:10.186470] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-21T18:03:10.186580] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-21T18:03:10.186620] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-21T18:03:10.186696] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-21T18:03:10.186743] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-21T18:03:10.542532] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:10.550987] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-21T18:03:10.947877] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T18:03:11.034492] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T18:03:11.351093] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-21T18:03:12.151010] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-21T18:03:12.389460] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T18:03:12.951047] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-21T18:03:13.477831] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T18:03:13.751066] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-21T18:03:14.489250] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T18:03:14.531607] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-21T18:03:14.550985] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-21T18:03:14.930526] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T18:03:15.351064] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-21T18:03:16.150996] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-21T18:03:16.612282] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T18:03:16.951020] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-21T18:03:17.262903] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T18:03:17.604005] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T18:03:17.750996] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-21T18:03:18.551059] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-21T18:03:18.947515] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T18:03:19.022813] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T18:03:19.351055] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-21T18:03:20.151003] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-21T18:03:20.436988] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T18:03:20.444218] [INFO ] [REMOTE ] CODI: Full fetch complete (53564 records). [2025-10-21T18:03:20.444324] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-21T18:03:20.827503] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-21T18:03:20.827619] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-21T18:03:20.828498] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-21T18:03:20.828582] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-21T18:03:20.829791] [DEBUG] [LOCAL ] CODI: Trimmed 53564 records to 41906 (keeping 200 days of data) [2025-10-21T18:03:20.990612] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-21T18:03:21.076992] [DEBUG] [LOCAL ] CODI: Primary data saved (41906 records). [2025-10-21T18:03:21.077266] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-21T18:03:21.077991] [INFO ] [MAIN ] Update Progress: 501/2366 symbols completed. CODI took 28.5s. Estimated remaining: 3h 55m 35s. Rate: 7.9 symbols/min [2025-10-21T18:03:21.252109] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:21.284044] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T18:03:21.341390] [DEBUG] [LOCAL ] COLD: Loaded 52476 existing records from primary storage. [2025-10-21T18:03:21.341719] [INFO ] [MAIN ] COLD: Loaded 52476 existing records. [2025-10-21T18:03:21.517511] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:21.517744] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-21T18:03:21.517794] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-21T18:03:21.518637] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-21T18:03:21.518751] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-21T18:03:21.776719] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-21T18:03:21.901574] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:21.929285] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:03:22.551047] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-21T18:03:23.054863] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T18:03:23.311551] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:03:23.351030] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-21T18:03:24.151064] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-21T18:03:24.267365] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T18:03:24.276045] [INFO ] [REMOTE ] CNX: Full fetch complete (74960 records). [2025-10-21T18:03:24.276239] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-21T18:03:24.679981] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-21T18:03:24.680095] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-21T18:03:24.681269] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-21T18:03:24.681341] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-21T18:03:24.683492] [DEBUG] [LOCAL ] CNX: Trimmed 74960 records to 51346 (keeping 200 days of data) [2025-10-21T18:03:24.963816] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-21T18:03:25.010084] [DEBUG] [LOCAL ] CNX: Primary data saved (51346 records). [2025-10-21T18:03:25.010304] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-21T18:03:25.010399] [INFO ] [MAIN ] Update Progress: 502/2366 symbols completed. CNX took 45.2s. Estimated remaining: 3h 55m 14s. Rate: 7.9 symbols/min [2025-10-21T18:03:25.195233] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:25.249077] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-21T18:03:25.249543] [INFO ] [MAIN ] COMP: Loaded 53404 existing records. [2025-10-21T18:03:25.443839] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:25.444299] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-21T18:03:25.444416] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-21T18:03:25.457630] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-21T18:03:25.472445] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-21T18:03:25.550790] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-21T18:03:25.755713] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-21T18:03:25.887590] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:26.030853] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T18:03:26.556203] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-21T18:03:26.572772] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T18:03:27.350991] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-21T18:03:27.857426] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-21T18:03:28.151097] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-21T18:03:28.951022] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-21T18:03:29.068947] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-21T18:03:29.566805] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-21T18:03:29.751034] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-21T18:03:30.304491] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T18:03:30.313339] [INFO ] [REMOTE ] COF: Full fetch complete (77305 records). [2025-10-21T18:03:30.313461] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-21T18:03:30.314272] [FATAL] [VALIDATOR ] COF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:03:30.314359] [FATAL] [MAIN ] COF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:03:30.314402] [WARN ] [MAIN ] COF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:03:30.314466] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-21T18:03:30.314548] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-10-21T18:03:30.314587] [INFO ] [LOCAL ] COF: Starting deletion of derivative data. [2025-10-21T18:03:30.314766] [DEBUG] [LOCAL ] COF: Deleted derivative data file. [2025-10-21T18:03:30.315489] [INFO ] [MAIN ] Update Progress: 503/2366 symbols completed. COF took 28.0s. Estimated remaining: 3h 54m 58s. Rate: 7.9 symbols/min [2025-10-21T18:03:30.484908] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:30.524011] [DEBUG] [LOCAL ] CON: Loaded 38877 existing records from primary storage. [2025-10-21T18:03:30.524286] [INFO ] [MAIN ] CON: Loaded 38877 existing records. [2025-10-21T18:03:30.555500] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-21T18:03:30.703910] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:30.704171] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-21T18:03:30.704266] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-21T18:03:30.714085] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-21T18:03:30.727159] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-21T18:03:30.806194] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-10-21T18:03:31.098974] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:31.351001] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-21T18:03:31.776518] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T18:03:32.151073] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-21T18:03:32.412977] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:03:32.951056] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-21T18:03:33.195138] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T18:03:33.751017] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-21T18:03:34.243135] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:03:34.543882] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:03:34.554321] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-21T18:03:35.351041] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-21T18:03:35.404361] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:03:36.110211] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:03:36.150997] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-21T18:03:36.951085] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-21T18:03:37.329001] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T18:03:37.751043] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-21T18:03:37.887806] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T18:03:38.379384] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T18:03:38.551028] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-21T18:03:39.345618] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:03:39.355565] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-21T18:03:40.151082] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-21T18:03:40.381197] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:03:40.951093] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-21T18:03:41.517303] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T18:03:41.751179] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-21T18:03:41.958569] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:03:42.266025] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:03:42.551088] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-21T18:03:43.266784] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T18:03:43.351087] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-21T18:03:44.151090] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-21T18:03:44.539833] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T18:03:44.951100] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-21T18:03:45.415100] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T18:03:45.751068] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-21T18:03:45.788688] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:03:46.551066] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-21T18:03:46.742464] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:03:47.351009] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-21T18:03:47.758076] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-21T18:03:48.150992] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-21T18:03:48.235757] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T18:03:48.343205] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T18:03:48.353250] [INFO ] [REMOTE ] COHR: Full fetch complete (77463 records). [2025-10-21T18:03:48.353564] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-21T18:03:48.778851] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-21T18:03:48.778940] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-21T18:03:48.779806] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-21T18:03:48.779871] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-21T18:03:48.781275] [DEBUG] [LOCAL ] COHR: Trimmed 77463 records to 53377 (keeping 200 days of data) [2025-10-21T18:03:48.958727] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-21T18:03:49.104571] [DEBUG] [LOCAL ] COHR: Primary data saved (53377 records). [2025-10-21T18:03:49.104734] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-21T18:03:49.104813] [INFO ] [MAIN ] Update Progress: 504/2366 symbols completed. COHR took 39.1s. Estimated remaining: 3h 55m 31s. Rate: 7.9 symbols/min [2025-10-21T18:03:49.287800] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:49.312134] [DEBUG] [LOCAL ] COOK: Loaded 24923 existing records from primary storage. [2025-10-21T18:03:49.312372] [INFO ] [MAIN ] COOK: Loaded 24923 existing records. [2025-10-21T18:03:49.486979] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:49.487161] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-21T18:03:49.487207] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-21T18:03:49.487596] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-21T18:03:49.487701] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-21T18:03:49.763128] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-21T18:03:49.859156] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:50.114279] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T18:03:50.191498] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T18:03:50.551045] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-21T18:03:51.351012] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-21T18:03:51.544048] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:03:52.005936] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T18:03:52.151072] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-21T18:03:52.950988] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-21T18:03:53.089826] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:03:53.097543] [INFO ] [REMOTE ] COLD: Full fetch complete (74426 records). [2025-10-21T18:03:53.097692] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-21T18:03:53.098501] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:03:53.098582] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:03:53.098674] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:03:53.098738] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-21T18:03:53.098797] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-21T18:03:53.098830] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-21T18:03:53.098963] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-21T18:03:53.099537] [INFO ] [MAIN ] Update Progress: 505/2366 symbols completed. COLD took 32.0s. Estimated remaining: 3h 55m 11s. Rate: 7.9 symbols/min [2025-10-21T18:03:53.267890] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:53.318869] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-21T18:03:53.319163] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-21T18:03:53.499735] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:53.500008] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-21T18:03:53.500083] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-21T18:03:53.500715] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-21T18:03:53.500773] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-21T18:03:53.756199] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-21T18:03:53.897985] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:53.894004] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T18:03:54.057372] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T18:03:54.551022] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-21T18:03:55.351059] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-21T18:03:55.373441] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T18:03:55.906384] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-21T18:03:55.914807] [INFO ] [REMOTE ] COMP: Full fetch complete (77397 records). [2025-10-21T18:03:55.914956] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-21T18:03:56.161916] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-21T18:03:56.338035] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-21T18:03:56.338161] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-21T18:03:56.339119] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-21T18:03:56.339186] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-21T18:03:56.340683] [DEBUG] [LOCAL ] COMP: Trimmed 77397 records to 53404 (keeping 200 days of data) [2025-10-21T18:03:56.648547] [DEBUG] [LOCAL ] COMP: Primary data saved (53404 records). [2025-10-21T18:03:56.648783] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-21T18:03:56.648881] [INFO ] [MAIN ] Update Progress: 506/2366 symbols completed. COMP took 31.6s. Estimated remaining: 3h 54m 48s. Rate: 7.9 symbols/min [2025-10-21T18:03:56.841156] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:56.850385] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-10-21T18:03:56.850501] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-10-21T18:03:56.850667] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-21T18:03:56.850791] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-21T18:03:56.851312] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-21T18:03:56.852365] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T18:03:56.852445] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-21T18:03:56.960126] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-21T18:03:57.254060] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:03:57.373837] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T18:03:57.751056] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-21T18:03:58.551041] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-21T18:03:58.662536] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T18:03:58.669809] [INFO ] [REMOTE ] CON: Full fetch complete (56702 records). [2025-10-21T18:03:58.669962] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-21T18:03:58.791826] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T18:03:59.081800] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-21T18:03:59.081885] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-21T18:03:59.082604] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-21T18:03:59.082666] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-21T18:03:59.083989] [DEBUG] [LOCAL ] CON: Trimmed 56702 records to 38811 (keeping 200 days of data) [2025-10-21T18:03:59.316564] [DEBUG] [LOCAL ] CON: Primary data saved (38811 records). [2025-10-21T18:03:59.316755] [INFO ] [MAIN ] CON: Full history saved. [2025-10-21T18:03:59.317262] [INFO ] [MAIN ] Update Progress: 507/2366 symbols completed. CON took 29.0s. Estimated remaining: 3h 54m 23s. Rate: 7.9 symbols/min [2025-10-21T18:03:59.351215] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-21T18:03:59.500941] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:03:59.550868] [DEBUG] [LOCAL ] COTY: Loaded 53275 existing records from primary storage. [2025-10-21T18:03:59.551175] [INFO ] [MAIN ] COTY: Loaded 53275 existing records. [2025-10-21T18:03:59.726290] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:03:59.726490] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-21T18:03:59.726537] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-21T18:03:59.727406] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-21T18:03:59.727466] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-21T18:04:00.080077] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:00.150981] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-21T18:04:00.198997] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:04:00.589798] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T18:04:00.951030] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-21T18:04:01.751035] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-21T18:04:02.372354] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T18:04:02.551019] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-21T18:04:02.613694] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:04:03.351009] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-21T18:04:04.065135] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-21T18:04:04.151011] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-21T18:04:04.229515] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T18:04:04.951066] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-21T18:04:05.181445] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:04:05.751054] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-21T18:04:06.066189] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T18:04:06.395299] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:04:06.551039] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-21T18:04:07.356122] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-21T18:04:07.376759] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T18:04:07.691044] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T18:04:08.151082] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-21T18:04:08.951064] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-21T18:04:09.309453] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:04:09.751051] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-21T18:04:09.937697] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T18:04:10.090058] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T18:04:10.551093] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-21T18:04:11.351078] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-21T18:04:11.444189] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T18:04:11.774240] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T18:04:12.151038] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-21T18:04:12.951048] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-21T18:04:13.251296] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:04:13.258110] [INFO ] [REMOTE ] COOK: Full fetch complete (33129 records). [2025-10-21T18:04:13.258269] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-21T18:04:13.467576] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T18:04:13.680132] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-21T18:04:13.680210] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-21T18:04:13.680779] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-21T18:04:13.680844] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-21T18:04:13.681601] [DEBUG] [LOCAL ] COOK: Trimmed 33129 records to 24899 (keeping 200 days of data) [2025-10-21T18:04:13.759528] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-21T18:04:13.820271] [DEBUG] [LOCAL ] COOK: Primary data saved (24899 records). [2025-10-21T18:04:13.820406] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-21T18:04:13.820485] [INFO ] [MAIN ] Update Progress: 508/2366 symbols completed. COOK took 24.7s. Estimated remaining: 3h 54m 40s. Rate: 7.9 symbols/min [2025-10-21T18:04:13.993504] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:14.043072] [DEBUG] [LOCAL ] COUR: Loaded 49404 existing records from primary storage. [2025-10-21T18:04:14.043387] [INFO ] [MAIN ] COUR: Loaded 49404 existing records. [2025-10-21T18:04:14.224627] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:04:14.224923] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-21T18:04:14.224976] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-21T18:04:14.225878] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-21T18:04:14.225935] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-21T18:04:14.554984] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-21T18:04:14.577889] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:15.049791] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T18:04:15.351025] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-21T18:04:15.429070] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T18:04:16.141947] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T18:04:16.153071] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-21T18:04:16.951003] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-21T18:04:17.309232] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T18:04:17.751042] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-21T18:04:18.028155] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T18:04:18.551067] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-21T18:04:18.997616] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T18:04:19.351066] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-21T18:04:19.628486] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T18:04:19.765262] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T18:04:20.151075] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-21T18:04:20.951025] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-21T18:04:21.463584] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T18:04:21.751053] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-21T18:04:22.049000] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:04:22.551045] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-21T18:04:22.624024] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:04:23.351050] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-21T18:04:23.763731] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T18:04:24.139965] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T18:04:24.151098] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-21T18:04:24.797226] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:04:24.804039] [INFO ] [REMOTE ] COR: Full fetch complete (68528 records). [2025-10-21T18:04:24.804187] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-21T18:04:24.959327] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-21T18:04:25.210468] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-21T18:04:25.210537] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-21T18:04:25.211402] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-21T18:04:25.211469] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-21T18:04:25.212748] [DEBUG] [LOCAL ] COR: Trimmed 68528 records to 46340 (keeping 200 days of data) [2025-10-21T18:04:25.501110] [DEBUG] [LOCAL ] COR: Primary data saved (46340 records). [2025-10-21T18:04:25.501233] [INFO ] [MAIN ] COR: Full history saved. [2025-10-21T18:04:25.501298] [INFO ] [MAIN ] Update Progress: 509/2366 symbols completed. COR took 28.9s. Estimated remaining: 3h 54m 48s. Rate: 7.9 symbols/min [2025-10-21T18:04:25.670492] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:25.670834] [DEBUG] [LOCAL ] CP: No existing data file found in primary storage. [2025-10-21T18:04:25.670905] [WARN ] [MAIN ] CP: No existing data found, performing full refresh instead. [2025-10-21T18:04:25.671122] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-21T18:04:25.671192] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-21T18:04:25.671311] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-21T18:04:25.671404] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-21T18:04:25.761282] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-21T18:04:25.979822] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:04:26.065609] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:26.551068] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-21T18:04:27.351006] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-21T18:04:27.437773] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-21T18:04:28.156122] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-21T18:04:28.177468] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-21T18:04:28.950999] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-21T18:04:29.142841] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-21T18:04:29.511776] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T18:04:29.751072] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-21T18:04:30.551090] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-21T18:04:30.662773] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-21T18:04:30.751185] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T18:04:31.351055] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-21T18:04:31.596859] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:04:31.933419] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T18:04:32.151005] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-21T18:04:32.951003] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-21T18:04:33.215015] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T18:04:33.223885] [INFO ] [REMOTE ] COTY: Full fetch complete (76908 records). [2025-10-21T18:04:33.224019] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-21T18:04:33.224965] [FATAL] [VALIDATOR ] COTY: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:04:33.225053] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:04:33.225096] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:04:33.225134] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-21T18:04:33.225190] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-10-21T18:04:33.225230] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-10-21T18:04:33.225433] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-10-21T18:04:33.225942] [INFO ] [MAIN ] Update Progress: 510/2366 symbols completed. COTY took 33.9s. Estimated remaining: 3h 54m 41s. Rate: 7.9 symbols/min [2025-10-21T18:04:33.422526] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:33.452177] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:04:33.491102] [DEBUG] [LOCAL ] CPA: Loaded 28158 existing records from primary storage. [2025-10-21T18:04:33.491385] [INFO ] [MAIN ] CPA: Loaded 28158 existing records. [2025-10-21T18:04:33.675812] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:04:33.676021] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-21T18:04:33.676066] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-21T18:04:33.676455] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-21T18:04:33.676511] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-21T18:04:33.756111] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-21T18:04:34.051314] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:34.551114] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-21T18:04:34.691694] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:04:34.743272] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T18:04:34.758027] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-10-21T18:04:34.758352] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-21T18:04:35.307304] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-21T18:04:35.307404] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-21T18:04:35.308395] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-21T18:04:35.308464] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-21T18:04:35.310207] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 53727 (keeping 200 days of data) [2025-10-21T18:04:35.371763] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-21T18:04:35.654341] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-10-21T18:04:35.654485] [INFO ] [MAIN ] COP: Full history saved. [2025-10-21T18:04:35.655216] [INFO ] [MAIN ] Update Progress: 511/2366 symbols completed. COP took 42.6s. Estimated remaining: 3h 54m 14s. Rate: 7.9 symbols/min [2025-10-21T18:04:35.821129] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:35.821314] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-21T18:04:35.821350] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-21T18:04:35.821455] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-21T18:04:35.821495] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-21T18:04:35.821534] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-21T18:04:35.821564] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-21T18:04:36.164039] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-21T18:04:36.168630] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:36.465583] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T18:04:36.742946] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:04:36.951087] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-21T18:04:37.528214] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T18:04:37.751017] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-21T18:04:37.928396] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:04:38.043807] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-21T18:04:38.551025] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-21T18:04:39.351038] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-21T18:04:39.791942] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T18:04:40.151107] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-21T18:04:40.951072] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-21T18:04:41.288833] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T18:04:41.508066] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T18:04:41.751036] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-21T18:04:41.858427] [DEBUG] [REMOTE ] CPA: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T18:04:41.858775] [WARN ] [REMOTE ] CPA: No data returned for month 2025-04 [2025-10-21T18:04:41.858948] [FATAL] [REMOTE ] CPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:04:41.859037] [FATAL] [MAIN ] CPA: Failed to fetch primary data. [2025-10-21T18:04:41.859082] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:04:41.859122] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-21T18:04:41.859177] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-21T18:04:41.859212] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-10-21T18:04:41.859413] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-10-21T18:04:41.859499] [INFO ] [MAIN ] Update Progress: 512/2366 symbols completed. CPA took 8.6s. Estimated remaining: 3h 54m 2s. Rate: 7.9 symbols/min [2025-10-21T18:04:42.036857] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:42.069845] [DEBUG] [LOCAL ] CPAY: Loaded 30345 existing records from primary storage. [2025-10-21T18:04:42.070131] [INFO ] [MAIN ] CPAY: Loaded 30345 existing records. [2025-10-21T18:04:42.248316] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:04:42.248506] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-21T18:04:42.248552] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-21T18:04:42.249195] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-21T18:04:42.249252] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-21T18:04:42.556138] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-21T18:04:42.609224] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:42.974722] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T18:04:43.351017] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-21T18:04:44.129596] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:04:44.151000] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-21T18:04:44.381388] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T18:04:44.506885] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:04:44.951032] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-21T18:04:45.751017] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-21T18:04:46.107097] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T18:04:46.551050] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-21T18:04:46.951393] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T18:04:46.959020] [INFO ] [REMOTE ] COUR: Full fetch complete (70743 records). [2025-10-21T18:04:46.959156] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-21T18:04:46.959952] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:04:46.960047] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:04:46.960089] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:04:46.960126] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-21T18:04:46.960180] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-21T18:04:46.960214] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-10-21T18:04:46.960352] [DEBUG] [LOCAL ] COUR: Deleted derivative data file. [2025-10-21T18:04:46.961119] [INFO ] [MAIN ] Update Progress: 513/2366 symbols completed. COUR took 33.1s. Estimated remaining: 3h 53m 45s. Rate: 7.9 symbols/min [2025-10-21T18:04:47.137234] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:04:47.156359] [DEBUG] [LOCAL ] CPF: Loaded 15307 existing records from primary storage. [2025-10-21T18:04:47.156604] [INFO ] [MAIN ] CPF: Loaded 15307 existing records. [2025-10-21T18:04:47.345146] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:04:47.345391] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-21T18:04:47.345446] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-21T18:04:47.345635] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-21T18:04:47.345730] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-21T18:04:47.351044] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-21T18:04:47.713846] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:04:47.888518] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T18:04:47.970264] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:04:48.151029] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-21T18:04:48.951014] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-21T18:04:49.333689] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:04:49.751052] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-21T18:04:50.120550] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-21T18:04:50.413148] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T18:04:50.551031] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-21T18:04:51.351031] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-21T18:04:51.989904] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T18:04:52.151028] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-21T18:04:52.334358] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:04:52.427888] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-21T18:04:52.951023] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-21T18:04:53.751006] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-21T18:04:54.016713] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T18:04:54.551017] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-21T18:04:55.251945] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:04:55.270251] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T18:04:55.350993] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-21T18:04:56.151053] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-21T18:04:56.327637] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T18:04:56.951027] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-21T18:04:57.457553] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:04:57.751032] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-21T18:04:58.191869] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T18:04:58.551031] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-21T18:04:58.833731] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T18:04:59.002943] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T18:04:59.351029] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-21T18:04:59.845419] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T18:04:59.846550] [INFO ] [REMOTE ] CPAC: Full fetch complete (1790 records). [2025-10-21T18:04:59.846627] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-21T18:05:00.030620] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T18:05:00.030817] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:05:00.030883] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:05:00.030954] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-21T18:05:00.031014] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-21T18:05:00.031049] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-21T18:05:00.031088] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-21T18:05:00.031144] [INFO ] [MAIN ] Update Progress: 514/2366 symbols completed. CPAC took 24.4s. Estimated remaining: 3h 53m 58s. Rate: 7.9 symbols/min [2025-10-21T18:05:00.156087] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-21T18:05:00.202885] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:00.223501] [DEBUG] [LOCAL ] CPK: Loaded 14051 existing records from primary storage. [2025-10-21T18:05:00.223744] [INFO ] [MAIN ] CPK: Loaded 14051 existing records. [2025-10-21T18:05:00.396246] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:00.396434] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-21T18:05:00.396481] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-21T18:05:00.396789] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-21T18:05:00.396852] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-21T18:05:00.741725] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:00.950983] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-21T18:05:01.371216] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T18:05:01.754669] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-21T18:05:01.756594] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T18:05:02.551022] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-21T18:05:03.352766] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-21T18:05:03.353848] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T18:05:03.624027] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T18:05:04.151026] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-21T18:05:04.767286] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T18:05:04.781769] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T18:05:04.951066] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-21T18:05:05.751027] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-21T18:05:06.551024] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-21T18:05:06.785035] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T18:05:06.851452] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T18:05:07.351053] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-21T18:05:07.700305] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T18:05:08.151076] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-21T18:05:08.961454] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-21T18:05:08.985531] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T18:05:09.022685] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T18:05:09.751002] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-21T18:05:10.383108] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T18:05:10.551001] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-21T18:05:10.635026] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T18:05:11.351042] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-21T18:05:12.151013] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-21T18:05:12.433790] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T18:05:12.444248] [INFO ] [REMOTE ] CP: Full fetch complete (77303 records). [2025-10-21T18:05:12.444507] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-21T18:05:12.905450] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-21T18:05:12.905297] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T18:05:12.905736] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-21T18:05:12.913473] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-21T18:05:12.913823] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-21T18:05:12.916833] [DEBUG] [LOCAL ] CP: Trimmed 77303 records to 53233 (keeping 200 days of data) [2025-10-21T18:05:12.970518] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-21T18:05:13.157769] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T18:05:13.278964] [DEBUG] [LOCAL ] CP: Primary data saved (53233 records). [2025-10-21T18:05:13.279109] [INFO ] [MAIN ] CP: Full history saved. [2025-10-21T18:05:13.279185] [INFO ] [MAIN ] Update Progress: 515/2366 symbols completed. CP took 47.8s. Estimated remaining: 3h 54m 10s. Rate: 7.9 symbols/min [2025-10-21T18:05:13.478410] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:13.530354] [DEBUG] [LOCAL ] CPNG: Loaded 53680 existing records from primary storage. [2025-10-21T18:05:13.530701] [INFO ] [MAIN ] CPNG: Loaded 53680 existing records. [2025-10-21T18:05:13.715697] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:13.715927] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-21T18:05:13.715973] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-21T18:05:13.716793] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-21T18:05:13.716852] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-21T18:05:13.751237] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-21T18:05:14.041835] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T18:05:14.110009] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:14.551071] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-21T18:05:15.156816] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T18:05:15.161364] [INFO ] [REMOTE ] CPAY: Full fetch complete (44855 records). [2025-10-21T18:05:15.161449] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-21T18:05:15.360327] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-21T18:05:15.561679] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:05:15.582403] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-21T18:05:15.582909] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-21T18:05:15.584032] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-21T18:05:15.584119] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-21T18:05:15.585509] [DEBUG] [LOCAL ] CPAY: Trimmed 44855 records to 30239 (keeping 200 days of data) [2025-10-21T18:05:15.763921] [DEBUG] [LOCAL ] CPAY: Primary data saved (30239 records). [2025-10-21T18:05:15.764019] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-21T18:05:15.764097] [INFO ] [MAIN ] Update Progress: 516/2366 symbols completed. CPAY took 33.9s. Estimated remaining: 3h 53m 45s. Rate: 7.9 symbols/min [2025-10-21T18:05:15.939734] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:15.989729] [DEBUG] [LOCAL ] CPRI: Loaded 52442 existing records from primary storage. [2025-10-21T18:05:15.990045] [INFO ] [MAIN ] CPRI: Loaded 52442 existing records. [2025-10-21T18:05:16.157733] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-21T18:05:16.162359] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:16.163436] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-21T18:05:16.163510] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-21T18:05:16.164412] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-21T18:05:16.164473] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-21T18:05:16.508953] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:16.951020] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-21T18:05:17.034200] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T18:05:17.710123] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-21T18:05:17.750988] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-21T18:05:18.551009] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-21T18:05:18.707538] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T18:05:18.712377] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T18:05:19.351044] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-21T18:05:19.697555] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T18:05:19.700411] [INFO ] [REMOTE ] CPF: Full fetch complete (23335 records). [2025-10-21T18:05:19.700482] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-21T18:05:19.701148] [FATAL] [VALIDATOR ] CPF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:05:19.701235] [FATAL] [MAIN ] CPF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:05:19.701283] [WARN ] [MAIN ] CPF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:05:19.701351] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-21T18:05:19.701412] [DEBUG] [LOCAL ] CPF: No primary data file found to delete. [2025-10-21T18:05:19.701447] [INFO ] [LOCAL ] CPF: Starting deletion of derivative data. [2025-10-21T18:05:19.701596] [DEBUG] [LOCAL ] CPF: Deleted derivative data file. [2025-10-21T18:05:19.701704] [INFO ] [MAIN ] Update Progress: 517/2366 symbols completed. CPF took 32.7s. Estimated remaining: 3h 53m 24s. Rate: 7.9 symbols/min [2025-10-21T18:05:20.151026] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-21T18:05:20.960563] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-21T18:05:20.966240] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:05:21.751002] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-21T18:05:22.230494] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-21T18:05:22.272827] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T18:05:22.276145] [INFO ] [REMOTE ] CPK: Full fetch complete (18684 records). [2025-10-21T18:05:22.276222] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-21T18:05:22.557250] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-21T18:05:22.638235] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-21T18:05:22.638310] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-21T18:05:22.638755] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-21T18:05:22.638816] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-21T18:05:22.639365] [DEBUG] [LOCAL ] CPK: Trimmed 18684 records to 13991 (keeping 200 days of data) [2025-10-21T18:05:22.725695] [DEBUG] [LOCAL ] CPK: Primary data saved (13991 records). [2025-10-21T18:05:22.725833] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-21T18:05:22.725909] [INFO ] [MAIN ] Update Progress: 518/2366 symbols completed. CPK took 22.7s. Estimated remaining: 3h 53m 0s. Rate: 7.9 symbols/min [2025-10-21T18:05:23.447547] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:05:23.458510] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-21T18:05:24.483791] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T18:05:24.495201] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-21T18:05:25.213978] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:05:25.225633] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-21T18:05:26.675471] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T18:05:26.687379] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-21T18:05:26.880944] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T18:05:26.892815] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-21T18:05:28.667141] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:05:28.677633] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-21T18:05:29.136625] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-21T18:05:29.147957] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-21T18:05:30.525393] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T18:05:30.536493] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-21T18:05:31.320275] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T18:05:31.331973] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-21T18:05:32.265971] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T18:05:32.276835] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-21T18:05:33.658021] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T18:05:33.669885] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-21T18:05:33.739117] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:05:33.750317] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-21T18:05:35.577491] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:05:35.585987] [INFO ] [REMOTE ] CPRI: Full fetch complete (76222 records). [2025-10-21T18:05:35.586245] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-21T18:05:35.771682] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T18:05:35.812021] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-21T18:05:36.025061] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-21T18:05:36.025134] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-21T18:05:36.025982] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-21T18:05:36.026045] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-21T18:05:36.027336] [DEBUG] [LOCAL ] CPRI: Trimmed 76222 records to 52438 (keeping 200 days of data) [2025-10-21T18:05:36.328341] [DEBUG] [LOCAL ] CPRI: Primary data saved (52438 records). [2025-10-21T18:05:36.328536] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-21T18:05:36.329018] [INFO ] [MAIN ] Update Progress: 519/2366 symbols completed. CPRI took 20.6s. Estimated remaining: 3h 53m 14s. Rate: 7.9 symbols/min [2025-10-21T18:05:38.210878] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-21T18:05:38.222147] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-21T18:05:41.047601] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.83 seconds). [2025-10-21T18:05:41.059682] [INFO ] [REMOTE ] CPNG: Full fetch complete (77788 records). [2025-10-21T18:05:41.059877] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-21T18:05:41.474287] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-21T18:05:41.474373] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-21T18:05:41.475370] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-21T18:05:41.475437] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-21T18:05:41.476911] [DEBUG] [LOCAL ] CPNG: Trimmed 77788 records to 53679 (keeping 200 days of data) [2025-10-21T18:05:41.783567] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-21T18:05:41.783725] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-21T18:05:41.783811] [INFO ] [MAIN ] Update Progress: 520/2366 symbols completed. CPNG took 28.5s. Estimated remaining: 3h 52m 59s. Rate: 7.9 symbols/min [2025-10-21T18:05:42.483044] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:42.475767] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:42.539851] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:42.541544] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:05:42.543232] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-21T18:05:42.543389] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-21T18:05:42.543522] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-21T18:05:42.543582] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-21T18:05:42.543689] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-21T18:05:42.543762] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-21T18:05:42.740110] [DEBUG] [LOCAL ] CPS: Loaded 25047 existing records from primary storage. [2025-10-21T18:05:42.758604] [INFO ] [MAIN ] CPS: Loaded 25047 existing records. [2025-10-21T18:05:42.800247] [DEBUG] [LOCAL ] CR: Loaded 24066 existing records from primary storage. [2025-10-21T18:05:42.955882] [DEBUG] [LOCAL ] CPT: Loaded 44551 existing records from primary storage. [2025-10-21T18:05:42.992447] [INFO ] [MAIN ] CR: Loaded 24066 existing records. [2025-10-21T18:05:43.001812] [INFO ] [MAIN ] CPT: Loaded 44551 existing records. [2025-10-21T18:05:43.236224] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:43.269912] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-21T18:05:43.286714] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-21T18:05:43.346194] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:43.367055] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-21T18:05:43.366639] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-21T18:05:43.391601] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-21T18:05:43.551292] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:43.617691] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-21T18:05:43.628112] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-21T18:05:43.622831] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:05:43.645916] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-21T18:05:43.649012] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-21T18:05:43.646026] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-21T18:05:43.659927] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-21T18:05:43.769878] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-21T18:05:43.790663] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-21T18:05:44.306082] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:44.358237] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-21T18:05:44.542848] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:44.548724] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-21T18:05:44.626551] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:05:44.626860] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-21T18:05:44.760306] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T18:05:44.766021] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-21T18:05:45.525822] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:05:45.530512] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-21T18:05:45.657620] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T18:05:45.662922] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-21T18:05:45.912256] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T18:05:45.919485] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-21T18:05:46.484868] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T18:05:46.493743] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-21T18:05:46.717618] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-21T18:05:46.724636] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-21T18:05:46.838608] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T18:05:46.845861] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-21T18:05:47.022818] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T18:05:47.027296] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-21T18:05:47.637567] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T18:05:47.641752] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-21T18:05:47.746753] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T18:05:47.753964] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-21T18:05:48.097691] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:05:48.106483] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-21T18:05:48.165836] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T18:05:48.171586] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-21T18:05:48.776913] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T18:05:48.781904] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-21T18:05:48.929147] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:05:48.936287] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-21T18:05:49.536527] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T18:05:49.543187] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-21T18:05:49.664433] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T18:05:49.750759] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:05:49.753990] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-21T18:05:49.896348] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T18:05:50.550997] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-21T18:05:50.635260] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T18:05:50.714192] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T18:05:51.351083] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-21T18:05:51.964997] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:05:52.150991] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-21T18:05:52.395518] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:05:52.951068] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-21T18:05:53.660669] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:05:53.750983] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-21T18:05:53.800404] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T18:05:54.551076] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-21T18:05:55.040477] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T18:05:55.351022] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-21T18:05:55.739101] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T18:05:56.151076] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-21T18:05:56.910360] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T18:05:56.951012] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-21T18:05:57.351892] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T18:05:57.751025] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-21T18:05:58.551036] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-21T18:05:58.614537] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:05:59.005225] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T18:05:59.319915] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T18:05:59.350975] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-21T18:06:00.151022] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-21T18:06:00.191191] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T18:06:00.951038] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-21T18:06:01.539942] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T18:06:01.751026] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-21T18:06:02.166638] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T18:06:02.169511] [INFO ] [REMOTE ] CQP: Full fetch complete (29756 records). [2025-10-21T18:06:02.169638] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-21T18:06:02.552734] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-21T18:06:02.552431] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-21T18:06:02.553932] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-21T18:06:02.554466] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-21T18:06:02.554510] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-21T18:06:02.555370] [DEBUG] [LOCAL ] CQP: Trimmed 29756 records to 18719 (keeping 200 days of data) [2025-10-21T18:06:02.665519] [DEBUG] [LOCAL ] CQP: Primary data saved (18719 records). [2025-10-21T18:06:02.665681] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-21T18:06:02.665769] [INFO ] [MAIN ] Update Progress: 521/2366 symbols completed. CQP took 20.9s. Estimated remaining: 3h 53m 39s. Rate: 7.9 symbols/min [2025-10-21T18:06:02.833433] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:02.843220] [DEBUG] [LOCAL ] CRBD: Loaded 8858 existing records from primary storage. [2025-10-21T18:06:02.843431] [INFO ] [MAIN ] CRBD: Loaded 8858 existing records. [2025-10-21T18:06:03.020047] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:03.020269] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-21T18:06:03.020326] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-21T18:06:03.020588] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-21T18:06:03.020671] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-21T18:06:03.357175] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-21T18:06:03.388859] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:03.430269] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T18:06:03.684295] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:06:04.151043] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-21T18:06:04.500136] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T18:06:04.504211] [INFO ] [REMOTE ] CPS: Full fetch complete (36502 records). [2025-10-21T18:06:04.504346] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-21T18:06:04.905521] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-21T18:06:04.905665] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-21T18:06:04.906294] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-21T18:06:04.906357] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-21T18:06:04.907392] [DEBUG] [LOCAL ] CPS: Trimmed 36502 records to 24974 (keeping 200 days of data) [2025-10-21T18:06:04.954417] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-21T18:06:05.057496] [DEBUG] [LOCAL ] CPS: Primary data saved (24974 records). [2025-10-21T18:06:05.057632] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-21T18:06:05.057763] [INFO ] [MAIN ] Update Progress: 522/2366 symbols completed. CPS took 23.3s. Estimated remaining: 3h 53m 13s. Rate: 7.9 symbols/min [2025-10-21T18:06:05.242260] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:05.317118] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T18:06:05.325431] [DEBUG] [LOCAL ] CRBG: Loaded 52602 existing records from primary storage. [2025-10-21T18:06:05.326175] [INFO ] [MAIN ] CRBG: Loaded 52602 existing records. [2025-10-21T18:06:05.518204] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:05.518433] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-21T18:06:05.518482] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-21T18:06:05.519374] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-21T18:06:05.519439] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-21T18:06:05.757395] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-21T18:06:05.883198] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:06.551055] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-21T18:06:06.704883] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T18:06:06.711912] [INFO ] [REMOTE ] CPT: Full fetch complete (64630 records). [2025-10-21T18:06:06.712050] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-21T18:06:07.034358] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:06:07.051685] [INFO ] [REMOTE ] CR: Full fetch complete (34781 records). [2025-10-21T18:06:07.062395] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-21T18:06:07.234292] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-21T18:06:07.245481] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-21T18:06:07.254936] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-21T18:06:07.257736] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-21T18:06:07.312162] [DEBUG] [LOCAL ] CPT: Trimmed 64630 records to 44521 (keeping 200 days of data) [2025-10-21T18:06:07.357270] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-21T18:06:07.697346] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-21T18:06:07.699595] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-21T18:06:07.704335] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-21T18:06:07.704426] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-21T18:06:07.710449] [DEBUG] [LOCAL ] CR: Trimmed 34781 records to 23996 (keeping 200 days of data) [2025-10-21T18:06:07.980772] [DEBUG] [LOCAL ] CR: Primary data saved (23996 records). [2025-10-21T18:06:07.982020] [INFO ] [MAIN ] CR: Full history saved. [2025-10-21T18:06:07.982566] [INFO ] [MAIN ] Update Progress: 523/2366 symbols completed. CR took 26.2s. Estimated remaining: 3h 52m 49s. Rate: 7.9 symbols/min [2025-10-21T18:06:08.189561] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:08.260462] [DEBUG] [LOCAL ] CPT: Primary data saved (44521 records). [2025-10-21T18:06:08.263280] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:06:08.261092] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-21T18:06:08.274864] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-21T18:06:08.274001] [INFO ] [MAIN ] Update Progress: 524/2366 symbols completed. CPT took 26.5s. Estimated remaining: 3h 52m 15s. Rate: 7.9 symbols/min [2025-10-21T18:06:08.418711] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:06:08.517465] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:08.519059] [DEBUG] [LOCAL ] CRC: Loaded 44124 existing records from primary storage. [2025-10-21T18:06:08.519324] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-21T18:06:08.519740] [INFO ] [MAIN ] CRC: Loaded 44124 existing records. [2025-10-21T18:06:08.519558] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-21T18:06:08.588629] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-21T18:06:08.594576] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-21T18:06:08.620367] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-21T18:06:08.620497] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-21T18:06:08.857114] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:08.902009] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-21T18:06:08.929612] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-21T18:06:08.967204] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-21T18:06:08.974666] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-21T18:06:08.991450] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-21T18:06:09.208372] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:09.462937] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:09.750993] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-21T18:06:09.829104] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T18:06:10.120408] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T18:06:10.551074] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-21T18:06:10.875238] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T18:06:11.351081] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-21T18:06:12.031229] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T18:06:12.151023] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-21T18:06:12.933043] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T18:06:12.951032] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-21T18:06:13.124798] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T18:06:13.701882] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T18:06:13.751094] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-21T18:06:14.503728] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T18:06:14.551045] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-21T18:06:15.347130] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T18:06:15.350982] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-21T18:06:15.995871] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T18:06:16.151027] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-21T18:06:16.951038] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-21T18:06:17.751058] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-21T18:06:17.826213] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T18:06:17.947341] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:06:17.947743] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-21T18:06:17.947829] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:06:17.947885] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-21T18:06:17.947955] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:06:17.948067] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-21T18:06:17.948165] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-21T18:06:17.948242] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-21T18:06:17.948322] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-21T18:06:17.948378] [INFO ] [MAIN ] Update Progress: 525/2366 symbols completed. CRCL took 9.7s. Estimated remaining: 3h 52m 15s. Rate: 7.9 symbols/min [2025-10-21T18:06:18.118940] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:18.167134] [DEBUG] [LOCAL ] CRGY: Loaded 52514 existing records from primary storage. [2025-10-21T18:06:18.167431] [INFO ] [MAIN ] CRGY: Loaded 52514 existing records. [2025-10-21T18:06:18.350016] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:18.350296] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-21T18:06:18.350347] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-21T18:06:18.350522] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-21T18:06:18.350573] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-21T18:06:18.561305] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-21T18:06:18.715753] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:18.747336] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T18:06:19.351025] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-21T18:06:20.054024] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:06:20.151002] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-21T18:06:20.812378] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T18:06:20.907789] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T18:06:20.951085] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-21T18:06:21.751072] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-21T18:06:22.550999] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-21T18:06:22.567544] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T18:06:22.599323] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T18:06:23.351081] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-21T18:06:23.958194] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T18:06:24.151056] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-21T18:06:24.737452] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:06:24.739062] [INFO ] [REMOTE ] CRBD: Full fetch complete (12973 records). [2025-10-21T18:06:24.739128] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-21T18:06:24.739488] [FATAL] [VALIDATOR ] CRBD: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:06:24.739567] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:06:24.739608] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:06:24.739695] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-21T18:06:24.739761] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-21T18:06:24.739796] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-10-21T18:06:24.739945] [DEBUG] [LOCAL ] CRBD: Deleted derivative data file. [2025-10-21T18:06:24.740027] [INFO ] [MAIN ] Update Progress: 526/2366 symbols completed. CRBD took 22.1s. Estimated remaining: 3h 52m 5s. Rate: 7.9 symbols/min [2025-10-21T18:06:24.918080] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:24.951276] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-21T18:06:24.968418] [DEBUG] [LOCAL ] CRH: Loaded 53439 existing records from primary storage. [2025-10-21T18:06:24.968856] [INFO ] [MAIN ] CRH: Loaded 53439 existing records. [2025-10-21T18:06:25.152603] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:25.152961] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-21T18:06:25.153033] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-21T18:06:25.153561] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-21T18:06:25.168533] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-21T18:06:25.262551] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T18:06:25.565899] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:25.751046] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-21T18:06:26.550995] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-21T18:06:26.672730] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:06:26.836759] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T18:06:27.351039] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-21T18:06:28.151038] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-21T18:06:28.574412] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T18:06:28.844379] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:06:28.951062] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-21T18:06:29.751011] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-21T18:06:30.020408] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T18:06:30.551002] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-21T18:06:30.751931] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T18:06:31.317887] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T18:06:31.351024] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-21T18:06:31.900170] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T18:06:32.151046] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-21T18:06:32.950981] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-21T18:06:33.398319] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T18:06:33.657398] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T18:06:33.751013] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-21T18:06:34.551105] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-21T18:06:34.840027] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:06:35.082568] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T18:06:35.351043] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-21T18:06:35.824998] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T18:06:36.151040] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-21T18:06:36.951926] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T18:06:36.952036] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-21T18:06:37.751064] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-21T18:06:37.819175] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T18:06:38.551045] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-21T18:06:38.809504] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T18:06:38.817747] [INFO ] [REMOTE ] CRBG: Full fetch complete (76042 records). [2025-10-21T18:06:38.817864] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-21T18:06:39.201010] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-21T18:06:39.201170] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-21T18:06:39.202097] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-21T18:06:39.202159] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-21T18:06:39.203491] [DEBUG] [LOCAL ] CRBG: Trimmed 76042 records to 52602 (keeping 200 days of data) [2025-10-21T18:06:39.375800] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-21T18:06:39.532555] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T18:06:39.563754] [DEBUG] [LOCAL ] CRBG: Primary data saved (52602 records). [2025-10-21T18:06:39.563867] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-21T18:06:39.564569] [INFO ] [MAIN ] Update Progress: 527/2366 symbols completed. CRBG took 34.5s. Estimated remaining: 3h 52m 23s. Rate: 7.9 symbols/min [2025-10-21T18:06:39.732405] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:39.776680] [DEBUG] [LOCAL ] CRI: Loaded 49604 existing records from primary storage. [2025-10-21T18:06:39.776968] [INFO ] [MAIN ] CRI: Loaded 49604 existing records. [2025-10-21T18:06:39.950233] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:39.950415] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-21T18:06:39.950460] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-21T18:06:39.950920] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-21T18:06:39.950975] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-21T18:06:40.159612] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-21T18:06:40.312817] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:40.464236] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T18:06:40.879399] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T18:06:40.886279] [INFO ] [REMOTE ] CRC: Full fetch complete (62937 records). [2025-10-21T18:06:40.886394] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-21T18:06:40.959804] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-21T18:06:41.268576] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-21T18:06:41.268694] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-21T18:06:41.269469] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-21T18:06:41.269510] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-21T18:06:41.270769] [DEBUG] [LOCAL ] CRC: Trimmed 62937 records to 44159 (keeping 200 days of data) [2025-10-21T18:06:41.531573] [DEBUG] [LOCAL ] CRC: Primary data saved (44159 records). [2025-10-21T18:06:41.531715] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-21T18:06:41.531799] [INFO ] [MAIN ] Update Progress: 528/2366 symbols completed. CRC took 33.5s. Estimated remaining: 3h 51m 55s. Rate: 7.9 symbols/min [2025-10-21T18:06:41.697940] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:41.748468] [DEBUG] [LOCAL ] CRK: Loaded 52250 existing records from primary storage. [2025-10-21T18:06:41.748819] [INFO ] [MAIN ] CRK: Loaded 52250 existing records. [2025-10-21T18:06:41.764680] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-21T18:06:41.961950] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:41.962204] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-21T18:06:41.962277] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-21T18:06:41.963167] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-21T18:06:41.963225] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-21T18:06:42.284851] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-21T18:06:42.400007] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:42.551031] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-21T18:06:42.812674] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T18:06:43.351000] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-21T18:06:43.524617] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:06:44.151067] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-21T18:06:44.326195] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T18:06:44.951025] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-21T18:06:45.206025] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T18:06:45.751010] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-21T18:06:45.884882] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:06:46.527880] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:06:46.551022] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-21T18:06:47.088083] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:06:47.351069] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-21T18:06:48.150998] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-21T18:06:48.189363] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:06:48.951073] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-21T18:06:49.115902] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T18:06:49.423411] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T18:06:49.751059] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-21T18:06:50.269054] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T18:06:50.551056] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-21T18:06:51.351102] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-21T18:06:51.649862] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T18:06:51.658252] [INFO ] [REMOTE ] CRGY: Full fetch complete (76149 records). [2025-10-21T18:06:51.658364] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-21T18:06:52.053285] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-21T18:06:52.053424] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-21T18:06:52.054305] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-21T18:06:52.054368] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-21T18:06:52.055765] [DEBUG] [LOCAL ] CRGY: Trimmed 76149 records to 52503 (keeping 200 days of data) [2025-10-21T18:06:52.152702] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-21T18:06:52.374999] [DEBUG] [LOCAL ] CRGY: Primary data saved (52503 records). [2025-10-21T18:06:52.375188] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-21T18:06:52.376032] [INFO ] [MAIN ] Update Progress: 529/2366 symbols completed. CRGY took 34.4s. Estimated remaining: 3h 51m 59s. Rate: 7.9 symbols/min [2025-10-21T18:06:52.559404] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:06:52.589562] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T18:06:52.641792] [DEBUG] [LOCAL ] CRL: Loaded 42666 existing records from primary storage. [2025-10-21T18:06:52.642113] [INFO ] [MAIN ] CRL: Loaded 42666 existing records. [2025-10-21T18:06:52.831789] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:06:52.832083] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-21T18:06:52.832133] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-21T18:06:52.832790] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-21T18:06:52.832850] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-21T18:06:52.956138] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-21T18:06:53.205740] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:06:53.238752] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:06:53.751077] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-21T18:06:53.917192] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T18:06:54.550987] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-21T18:06:54.652109] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T18:06:55.350995] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-21T18:06:55.640159] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T18:06:56.161531] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-21T18:06:56.167185] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T18:06:56.917400] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T18:06:56.950980] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-21T18:06:57.751000] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-21T18:06:57.908631] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T18:06:58.550996] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-21T18:06:58.654958] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T18:06:59.351094] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-21T18:06:59.723612] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T18:06:59.736111] [INFO ] [REMOTE ] CRH: Full fetch complete (77549 records). [2025-10-21T18:06:59.736317] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-21T18:07:00.166498] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-21T18:07:00.193726] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-21T18:07:00.195604] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:07:00.194440] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-21T18:07:00.208067] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-21T18:07:00.208682] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-21T18:07:00.210418] [DEBUG] [LOCAL ] CRH: Trimmed 77549 records to 53435 (keeping 200 days of data) [2025-10-21T18:07:00.539592] [DEBUG] [LOCAL ] CRH: Primary data saved (53435 records). [2025-10-21T18:07:00.539758] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-21T18:07:00.540301] [INFO ] [MAIN ] Update Progress: 530/2366 symbols completed. CRH took 35.8s. Estimated remaining: 3h 51m 54s. Rate: 7.9 symbols/min [2025-10-21T18:07:00.706371] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:00.763607] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-21T18:07:00.764496] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-21T18:07:00.942054] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:00.942440] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-21T18:07:00.942629] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-21T18:07:00.943991] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-21T18:07:00.944055] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-21T18:07:00.973990] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-21T18:07:01.335636] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:01.339071] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T18:07:01.751011] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-21T18:07:01.915035] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T18:07:02.551005] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-21T18:07:02.655812] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T18:07:03.100512] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T18:07:03.351021] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-21T18:07:04.151054] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-21T18:07:04.334686] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:07:04.883624] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:07:04.891314] [INFO ] [REMOTE ] CRI: Full fetch complete (70916 records). [2025-10-21T18:07:04.891456] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-21T18:07:04.960283] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-21T18:07:05.327584] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-21T18:07:05.327705] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-21T18:07:05.328695] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-21T18:07:05.328758] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-21T18:07:05.330314] [DEBUG] [LOCAL ] CRI: Trimmed 70916 records to 49512 (keeping 200 days of data) [2025-10-21T18:07:05.674066] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:07:05.697728] [DEBUG] [LOCAL ] CRI: Primary data saved (49512 records). [2025-10-21T18:07:05.697847] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-21T18:07:05.698792] [INFO ] [MAIN ] Update Progress: 531/2366 symbols completed. CRI took 26.1s. Estimated remaining: 3h 51m 38s. Rate: 7.9 symbols/min [2025-10-21T18:07:05.759984] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-21T18:07:05.887373] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:05.932514] [DEBUG] [LOCAL ] CRS: Loaded 43124 existing records from primary storage. [2025-10-21T18:07:05.932870] [INFO ] [MAIN ] CRS: Loaded 43124 existing records. [2025-10-21T18:07:06.138107] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:06.138345] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-21T18:07:06.138395] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-21T18:07:06.138906] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-21T18:07:06.138965] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-21T18:07:06.534476] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:06.550990] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-21T18:07:07.350995] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-21T18:07:07.599890] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-21T18:07:07.710159] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T18:07:07.718446] [INFO ] [REMOTE ] CRK: Full fetch complete (75824 records). [2025-10-21T18:07:07.718573] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-21T18:07:08.105681] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-21T18:07:08.105828] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-21T18:07:08.107039] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-21T18:07:08.107145] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-21T18:07:08.108874] [DEBUG] [LOCAL ] CRK: Trimmed 75824 records to 52233 (keeping 200 days of data) [2025-10-21T18:07:08.155730] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-21T18:07:08.352205] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:07:08.453587] [DEBUG] [LOCAL ] CRK: Primary data saved (52233 records). [2025-10-21T18:07:08.453752] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-21T18:07:08.453840] [INFO ] [MAIN ] Update Progress: 532/2366 symbols completed. CRK took 26.9s. Estimated remaining: 3h 51m 14s. Rate: 7.9 symbols/min [2025-10-21T18:07:08.620390] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:08.626460] [DEBUG] [LOCAL ] CRT: Loaded 4802 existing records from primary storage. [2025-10-21T18:07:08.626677] [INFO ] [MAIN ] CRT: Loaded 4802 existing records. [2025-10-21T18:07:08.810683] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:08.811165] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-21T18:07:08.811245] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-21T18:07:08.811487] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-21T18:07:08.811553] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-21T18:07:08.954328] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-21T18:07:09.206418] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:09.208339] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T18:07:09.751051] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-21T18:07:10.551409] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-21T18:07:10.577184] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:07:10.642594] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-21T18:07:11.017171] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T18:07:11.166315] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-21T18:07:11.351039] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-21T18:07:12.151038] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-21T18:07:12.951036] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-21T18:07:13.013465] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:07:13.241211] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T18:07:13.751035] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-21T18:07:14.551021] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-21T18:07:15.126398] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:07:15.351000] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-21T18:07:15.420779] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-21T18:07:15.876351] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T18:07:16.150992] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-21T18:07:16.452999] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T18:07:16.951032] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-21T18:07:17.653061] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:07:17.750994] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-21T18:07:18.551076] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-21T18:07:18.979944] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T18:07:19.351057] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-21T18:07:19.579912] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T18:07:20.151032] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-21T18:07:20.762623] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T18:07:20.901012] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T18:07:20.950989] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-21T18:07:21.142992] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-21T18:07:21.495906] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T18:07:21.751072] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-21T18:07:22.278775] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T18:07:22.551064] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-21T18:07:23.351074] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-21T18:07:24.151028] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-21T18:07:24.922280] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T18:07:24.949751] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T18:07:24.957887] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-21T18:07:25.038015] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-21T18:07:25.751002] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-21T18:07:26.184262] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T18:07:26.548790] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T18:07:26.557265] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-21T18:07:27.351052] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-21T18:07:28.151028] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-21T18:07:28.813586] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T18:07:28.853981] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T18:07:28.951058] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-21T18:07:29.013676] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-21T18:07:29.686900] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T18:07:29.688255] [INFO ] [REMOTE ] CRT: Full fetch complete (7334 records). [2025-10-21T18:07:29.688338] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-21T18:07:29.756159] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-21T18:07:30.058509] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-21T18:07:30.058608] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-21T18:07:30.058873] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-21T18:07:30.058930] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-21T18:07:30.059315] [DEBUG] [LOCAL ] CRT: Trimmed 7334 records to 4791 (keeping 200 days of data) [2025-10-21T18:07:30.087626] [DEBUG] [LOCAL ] CRT: Primary data saved (4791 records). [2025-10-21T18:07:30.087787] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-21T18:07:30.087869] [INFO ] [MAIN ] Update Progress: 533/2366 symbols completed. CRT took 21.6s. Estimated remaining: 3h 51m 54s. Rate: 7.9 symbols/min [2025-10-21T18:07:30.268537] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:30.311689] [DEBUG] [LOCAL ] CSAN: Loaded 42287 existing records from primary storage. [2025-10-21T18:07:30.311986] [INFO ] [MAIN ] CSAN: Loaded 42287 existing records. [2025-10-21T18:07:30.521496] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:30.521802] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-21T18:07:30.521857] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-21T18:07:30.522244] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-21T18:07:30.522302] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-21T18:07:30.563253] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-21T18:07:31.036700] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:31.351077] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-21T18:07:31.866824] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T18:07:32.151019] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-21T18:07:32.424710] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T18:07:32.513194] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T18:07:32.520084] [INFO ] [REMOTE ] CRL: Full fetch complete (63564 records). [2025-10-21T18:07:32.520220] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-21T18:07:32.901564] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-21T18:07:32.901635] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-21T18:07:32.902399] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-21T18:07:32.902444] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-21T18:07:32.903591] [DEBUG] [LOCAL ] CRL: Trimmed 63564 records to 42659 (keeping 200 days of data) [2025-10-21T18:07:32.953759] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-21T18:07:33.159374] [DEBUG] [LOCAL ] CRL: Primary data saved (42659 records). [2025-10-21T18:07:33.159508] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-21T18:07:33.160041] [INFO ] [MAIN ] Update Progress: 534/2366 symbols completed. CRL took 40.8s. Estimated remaining: 3h 51m 31s. Rate: 7.9 symbols/min [2025-10-21T18:07:33.330061] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:33.363135] [DEBUG] [LOCAL ] CSL: Loaded 31310 existing records from primary storage. [2025-10-21T18:07:33.363392] [INFO ] [MAIN ] CSL: Loaded 31310 existing records. [2025-10-21T18:07:33.537786] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:33.537977] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-21T18:07:33.538053] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-21T18:07:33.538375] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-21T18:07:33.538442] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-21T18:07:33.756569] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-21T18:07:33.892577] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:34.444675] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T18:07:34.497829] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:07:34.550982] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-21T18:07:35.351068] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-21T18:07:35.590719] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T18:07:35.796391] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T18:07:36.151028] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-21T18:07:36.667572] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T18:07:36.951022] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-21T18:07:37.681206] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T18:07:37.751006] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-21T18:07:38.551079] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-21T18:07:39.351060] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-21T18:07:39.529358] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:07:39.535767] [INFO ] [REMOTE ] CRS: Full fetch complete (62543 records). [2025-10-21T18:07:39.535891] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-21T18:07:39.968249] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-21T18:07:39.968443] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-21T18:07:39.964750] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-10-21T18:07:39.969800] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-21T18:07:39.980357] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-21T18:07:39.982913] [DEBUG] [LOCAL ] CRS: Trimmed 62543 records to 43115 (keeping 200 days of data) [2025-10-21T18:07:40.100195] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:07:40.197015] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-21T18:07:40.291057] [DEBUG] [LOCAL ] CRS: Primary data saved (43115 records). [2025-10-21T18:07:40.291185] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-21T18:07:40.291281] [INFO ] [MAIN ] Update Progress: 535/2366 symbols completed. CRS took 34.6s. Estimated remaining: 3h 51m 22s. Rate: 7.9 symbols/min [2025-10-21T18:07:40.461731] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:40.486409] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T18:07:40.497589] [DEBUG] [LOCAL ] CSR: Loaded 13476 existing records from primary storage. [2025-10-21T18:07:40.498452] [INFO ] [MAIN ] CSR: Loaded 13476 existing records. [2025-10-21T18:07:40.672085] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:40.672294] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-21T18:07:40.672340] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-21T18:07:40.672503] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-21T18:07:40.672558] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-21T18:07:40.961261] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-21T18:07:41.050857] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:41.189340] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T18:07:41.197849] [INFO ] [REMOTE ] CRM: Full fetch complete (77946 records). [2025-10-21T18:07:41.198050] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-21T18:07:41.626330] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-21T18:07:41.626408] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-21T18:07:41.627273] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-21T18:07:41.627335] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-21T18:07:41.628707] [DEBUG] [LOCAL ] CRM: Trimmed 77946 records to 53770 (keeping 200 days of data) [2025-10-21T18:07:41.751673] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-21T18:07:41.967785] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-21T18:07:41.967903] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-21T18:07:41.968848] [INFO ] [MAIN ] Update Progress: 536/2366 symbols completed. CRM took 41.4s. Estimated remaining: 3h 50m 54s. Rate: 7.9 symbols/min [2025-10-21T18:07:42.144454] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:42.190170] [DEBUG] [LOCAL ] CSTM: Loaded 47473 existing records from primary storage. [2025-10-21T18:07:42.190448] [INFO ] [MAIN ] CSTM: Loaded 47473 existing records. [2025-10-21T18:07:42.374819] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:42.375159] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-21T18:07:42.375263] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-21T18:07:42.375879] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-21T18:07:42.375941] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-21T18:07:42.555953] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:07:42.556020] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-21T18:07:42.753570] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:07:42.795459] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:43.351025] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-21T18:07:44.151021] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-21T18:07:44.402111] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:07:44.845143] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:07:44.950989] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-21T18:07:45.751080] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-21T18:07:45.942599] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:07:46.444344] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T18:07:46.551066] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-21T18:07:47.353230] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-21T18:07:47.358225] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T18:07:47.781291] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T18:07:48.151052] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-21T18:07:48.888108] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T18:07:48.950988] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-21T18:07:49.469870] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T18:07:49.751033] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-21T18:07:50.164422] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T18:07:50.550998] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-21T18:07:50.869814] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T18:07:51.351017] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-21T18:07:52.137549] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:07:52.150985] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-21T18:07:52.879708] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:07:52.885777] [INFO ] [REMOTE ] CSAN: Full fetch complete (60273 records). [2025-10-21T18:07:52.885891] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-21T18:07:52.956112] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-21T18:07:53.282326] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-21T18:07:53.282457] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-21T18:07:53.283249] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-21T18:07:53.283344] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-21T18:07:53.284554] [DEBUG] [LOCAL ] CSAN: Trimmed 60273 records to 42270 (keeping 200 days of data) [2025-10-21T18:07:53.539868] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T18:07:53.567447] [DEBUG] [LOCAL ] CSAN: Primary data saved (42270 records). [2025-10-21T18:07:53.567596] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-21T18:07:53.568069] [INFO ] [MAIN ] Update Progress: 537/2366 symbols completed. CSAN took 23.5s. Estimated remaining: 3h 51m 1s. Rate: 7.9 symbols/min [2025-10-21T18:07:53.738456] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:07:53.751510] [DEBUG] [LOCAL ] CSV: Loaded 12576 existing records from primary storage. [2025-10-21T18:07:53.751782] [INFO ] [MAIN ] CSV: Loaded 12576 existing records. [2025-10-21T18:07:53.751189] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-21T18:07:53.929060] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:07:53.929265] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-21T18:07:53.929312] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-21T18:07:53.929460] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-21T18:07:53.929498] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-21T18:07:54.289202] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:07:54.501440] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:07:54.550988] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-21T18:07:55.305069] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T18:07:55.351000] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-21T18:07:55.928785] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T18:07:56.151014] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-21T18:07:56.769556] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T18:07:56.951025] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-21T18:07:57.139472] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T18:07:57.751024] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-21T18:07:57.943442] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T18:07:58.551025] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-21T18:07:58.854756] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T18:07:59.351054] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-21T18:07:59.489225] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T18:08:00.151059] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-21T18:08:00.777268] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:08:00.782410] [INFO ] [REMOTE ] CSL: Full fetch complete (45652 records). [2025-10-21T18:08:00.782506] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-21T18:08:00.966057] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-21T18:08:01.023548] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T18:08:01.186028] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-21T18:08:01.186118] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-21T18:08:01.186789] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-21T18:08:01.186855] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-21T18:08:01.187997] [DEBUG] [LOCAL ] CSL: Trimmed 45652 records to 31256 (keeping 200 days of data) [2025-10-21T18:08:01.384420] [DEBUG] [LOCAL ] CSL: Primary data saved (31256 records). [2025-10-21T18:08:01.384567] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-21T18:08:01.385372] [INFO ] [MAIN ] Update Progress: 538/2366 symbols completed. CSL took 28.2s. Estimated remaining: 3h 50m 54s. Rate: 7.9 symbols/min [2025-10-21T18:08:01.562986] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:01.563150] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-21T18:08:01.563188] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-21T18:08:01.563300] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-21T18:08:01.563342] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-21T18:08:01.563382] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-21T18:08:01.563414] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-21T18:08:01.756389] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-21T18:08:01.957552] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:02.550984] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-21T18:08:02.714731] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:08:02.913011] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T18:08:03.269002] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T18:08:03.351034] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-21T18:08:04.151055] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-21T18:08:04.339312] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:08:04.339598] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-21T18:08:04.339715] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:08:04.339813] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-21T18:08:04.339880] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:08:04.339950] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-21T18:08:04.340013] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-21T18:08:04.340049] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-21T18:08:04.340086] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-21T18:08:04.340132] [INFO ] [MAIN ] Update Progress: 539/2366 symbols completed. CSW took 3.0s. Estimated remaining: 3h 50m 31s. Rate: 7.9 symbols/min [2025-10-21T18:08:04.517536] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:04.526669] [DEBUG] [LOCAL ] CTBB: Loaded 6573 existing records from primary storage. [2025-10-21T18:08:04.526887] [INFO ] [MAIN ] CTBB: Loaded 6573 existing records. [2025-10-21T18:08:04.709115] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:04.709551] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-21T18:08:04.709628] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-21T18:08:04.709980] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-21T18:08:04.710044] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-21T18:08:04.956111] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-21T18:08:04.984401] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T18:08:05.125603] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:05.750998] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-21T18:08:05.900241] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T18:08:06.476847] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T18:08:06.551020] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-21T18:08:07.149081] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T18:08:07.351084] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-21T18:08:08.150994] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-21T18:08:08.529741] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:08:08.951043] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-21T18:08:09.162282] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T18:08:09.547848] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T18:08:09.751075] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-21T18:08:10.539041] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T18:08:10.550980] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-21T18:08:11.351009] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-21T18:08:11.484944] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T18:08:11.919892] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:08:12.151043] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-21T18:08:12.803230] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T18:08:12.951026] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-21T18:08:13.440332] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T18:08:13.751023] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-21T18:08:14.551075] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-21T18:08:14.670250] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T18:08:15.351008] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-21T18:08:15.476809] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T18:08:15.981766] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T18:08:16.151075] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-21T18:08:16.950983] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-21T18:08:17.182110] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T18:08:17.524029] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T18:08:17.751041] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-21T18:08:18.551062] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-21T18:08:18.812320] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T18:08:18.815228] [INFO ] [REMOTE ] CSR: Full fetch complete (17945 records). [2025-10-21T18:08:18.815310] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-21T18:08:19.203453] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-21T18:08:19.203533] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-21T18:08:19.203972] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-21T18:08:19.204042] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-21T18:08:19.204617] [DEBUG] [LOCAL ] CSR: Trimmed 17945 records to 13477 (keeping 200 days of data) [2025-10-21T18:08:19.303305] [DEBUG] [LOCAL ] CSR: Primary data saved (13477 records). [2025-10-21T18:08:19.303476] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-21T18:08:19.303573] [INFO ] [MAIN ] Update Progress: 540/2366 symbols completed. CSR took 39.0s. Estimated remaining: 3h 50m 48s. Rate: 7.9 symbols/min [2025-10-21T18:08:19.357271] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-21T18:08:19.474930] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:19.483823] [DEBUG] [LOCAL ] CTDD: Loaded 5284 existing records from primary storage. [2025-10-21T18:08:19.484044] [INFO ] [MAIN ] CTDD: Loaded 5284 existing records. [2025-10-21T18:08:19.658236] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:19.658476] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-21T18:08:19.658525] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-21T18:08:19.658744] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-21T18:08:19.658803] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-21T18:08:20.017104] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:20.119079] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T18:08:20.121236] [INFO ] [REMOTE ] CSV: Full fetch complete (19065 records). [2025-10-21T18:08:20.121319] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-21T18:08:20.156120] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-21T18:08:20.427306] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T18:08:20.473523] [INFO ] [REMOTE ] CSTM: Full fetch complete (69534 records). [2025-10-21T18:08:20.484518] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-21T18:08:20.651565] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-21T18:08:20.657141] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-21T18:08:20.669086] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-21T18:08:20.669216] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-21T18:08:20.686024] [DEBUG] [LOCAL ] CSV: Trimmed 19065 records to 12501 (keeping 200 days of data) [2025-10-21T18:08:20.954342] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-21T18:08:20.978545] [DEBUG] [LOCAL ] CSV: Primary data saved (12501 records). [2025-10-21T18:08:20.979815] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-21T18:08:20.980048] [INFO ] [MAIN ] Update Progress: 541/2366 symbols completed. CSV took 27.4s. Estimated remaining: 3h 50m 21s. Rate: 7.9 symbols/min [2025-10-21T18:08:21.034534] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T18:08:21.174608] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-21T18:08:21.174764] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-21T18:08:21.176040] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-21T18:08:21.176127] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-21T18:08:21.247190] [DEBUG] [LOCAL ] CSTM: Trimmed 69534 records to 47446 (keeping 200 days of data) [2025-10-21T18:08:21.250232] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:21.250547] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-21T18:08:21.250918] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-21T18:08:21.251317] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-21T18:08:21.251369] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-21T18:08:21.251412] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-21T18:08:21.251443] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-21T18:08:21.756114] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-21T18:08:21.786555] [DEBUG] [LOCAL ] CSTM: Primary data saved (47446 records). [2025-10-21T18:08:21.792584] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-21T18:08:21.808560] [INFO ] [MAIN ] Update Progress: 542/2366 symbols completed. CSTM took 39.8s. Estimated remaining: 3h 49m 50s. Rate: 7.9 symbols/min [2025-10-21T18:08:21.980980] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T18:08:22.029338] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:22.096095] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:22.096305] [DEBUG] [LOCAL ] CTO: No existing data file found in primary storage. [2025-10-21T18:08:22.096343] [WARN ] [MAIN ] CTO: No existing data found, performing full refresh instead. [2025-10-21T18:08:22.096457] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-21T18:08:22.096499] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-21T18:08:22.096538] [DEBUG] [LOCAL ] CTO: No primary data file found to delete. [2025-10-21T18:08:22.096569] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-21T18:08:22.452119] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T18:08:22.480613] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:22.551063] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-21T18:08:23.351080] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-21T18:08:23.615579] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:08:24.124546] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T18:08:24.151079] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-21T18:08:24.925818] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T18:08:24.950982] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-21T18:08:25.404639] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T18:08:25.751032] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-21T18:08:26.551038] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-21T18:08:27.023506] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T18:08:27.024276] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T18:08:27.351120] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-21T18:08:28.151064] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-21T18:08:28.522556] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-21T18:08:28.951050] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-21T18:08:29.018234] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:08:29.658602] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:08:29.751001] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-21T18:08:30.398663] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T18:08:30.551014] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-21T18:08:31.179183] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T18:08:31.350990] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-21T18:08:32.151045] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-21T18:08:32.549856] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T18:08:32.871488] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T18:08:32.951081] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-21T18:08:33.751034] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-21T18:08:33.950323] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:08:33.950623] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-21T18:08:33.950754] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:08:33.950803] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-21T18:08:33.950834] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:08:33.950898] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-21T18:08:33.950959] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-21T18:08:33.950993] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-21T18:08:33.951031] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-21T18:08:33.951076] [INFO ] [MAIN ] Update Progress: 543/2366 symbols completed. CTEV took 13.0s. Estimated remaining: 3h 49m 58s. Rate: 7.9 symbols/min [2025-10-21T18:08:34.119137] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:34.138374] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T18:08:34.169584] [DEBUG] [LOCAL ] CTOS: Loaded 37326 existing records from primary storage. [2025-10-21T18:08:34.169881] [INFO ] [MAIN ] CTOS: Loaded 37326 existing records. [2025-10-21T18:08:34.346945] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:34.347181] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-21T18:08:34.347234] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-21T18:08:34.347861] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-21T18:08:34.347917] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-21T18:08:34.556183] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-21T18:08:34.700416] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:35.087119] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-21T18:08:35.351035] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-21T18:08:35.943874] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:08:35.945595] [INFO ] [REMOTE ] CTDD: Full fetch complete (7924 records). [2025-10-21T18:08:35.945763] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-21T18:08:36.156881] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-21T18:08:36.305455] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-21T18:08:36.305529] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-21T18:08:36.305801] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-21T18:08:36.305861] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-21T18:08:36.306233] [DEBUG] [LOCAL ] CTDD: Trimmed 7924 records to 5258 (keeping 200 days of data) [2025-10-21T18:08:36.336570] [DEBUG] [LOCAL ] CTDD: Primary data saved (5258 records). [2025-10-21T18:08:36.336637] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-21T18:08:36.336745] [INFO ] [MAIN ] Update Progress: 544/2366 symbols completed. CTDD took 17.0s. Estimated remaining: 3h 49m 33s. Rate: 7.9 symbols/min [2025-10-21T18:08:36.504245] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:36.504419] [DEBUG] [LOCAL ] CTRA: No existing data file found in primary storage. [2025-10-21T18:08:36.504456] [WARN ] [MAIN ] CTRA: No existing data found, performing full refresh instead. [2025-10-21T18:08:36.504557] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-21T18:08:36.504597] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-21T18:08:36.504636] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-10-21T18:08:36.504708] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-21T18:08:36.848982] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:36.950983] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-21T18:08:37.092509] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T18:08:37.094707] [INFO ] [REMOTE ] CTBB: Full fetch complete (10066 records). [2025-10-21T18:08:37.094882] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-21T18:08:37.479028] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-21T18:08:37.479108] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-21T18:08:37.479340] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-21T18:08:37.479379] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-21T18:08:37.479820] [DEBUG] [LOCAL ] CTBB: Trimmed 10066 records to 6539 (keeping 200 days of data) [2025-10-21T18:08:37.518370] [DEBUG] [LOCAL ] CTBB: Primary data saved (6539 records). [2025-10-21T18:08:37.518489] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-21T18:08:37.518573] [INFO ] [MAIN ] Update Progress: 545/2366 symbols completed. CTBB took 33.2s. Estimated remaining: 3h 49m 4s. Rate: 7.9 symbols/min [2025-10-21T18:08:37.682603] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:37.727183] [DEBUG] [LOCAL ] CTRE: Loaded 49507 existing records from primary storage. [2025-10-21T18:08:37.727480] [INFO ] [MAIN ] CTRE: Loaded 49507 existing records. [2025-10-21T18:08:37.757463] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-21T18:08:37.925121] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:37.925318] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-21T18:08:37.925364] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-21T18:08:37.926123] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-21T18:08:37.926181] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-21T18:08:38.277948] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:38.551033] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-21T18:08:38.993181] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-21T18:08:39.057441] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:08:39.351037] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-21T18:08:39.929062] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:08:40.151032] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-21T18:08:40.433407] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:08:40.951073] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-21T18:08:41.751011] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-21T18:08:41.888687] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:08:42.126844] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T18:08:42.551012] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-21T18:08:43.351072] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-21T18:08:43.445489] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:08:44.151004] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-21T18:08:44.721210] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-21T18:08:44.885849] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:08:44.951070] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-21T18:08:45.054324] [DEBUG] [REMOTE ] CTOS: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T18:08:45.054797] [WARN ] [REMOTE ] CTOS: No data returned for month 2025-04 [2025-10-21T18:08:45.054929] [FATAL] [REMOTE ] CTOS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:08:45.055025] [FATAL] [MAIN ] CTOS: Failed to fetch primary data. [2025-10-21T18:08:45.055089] [WARN ] [MAIN ] CTOS: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:08:45.055169] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-21T18:08:45.055244] [DEBUG] [LOCAL ] CTOS: No primary data file found to delete. [2025-10-21T18:08:45.055283] [INFO ] [LOCAL ] CTOS: Starting deletion of derivative data. [2025-10-21T18:08:45.055543] [DEBUG] [LOCAL ] CTOS: Deleted derivative data file. [2025-10-21T18:08:45.055663] [INFO ] [MAIN ] Update Progress: 546/2366 symbols completed. CTOS took 11.1s. Estimated remaining: 3h 48m 57s. Rate: 7.9 symbols/min [2025-10-21T18:08:45.226796] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:45.263846] [DEBUG] [LOCAL ] CTRI: Loaded 40518 existing records from primary storage. [2025-10-21T18:08:45.264118] [INFO ] [MAIN ] CTRI: Loaded 40518 existing records. [2025-10-21T18:08:45.464345] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T18:08:45.496340] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:08:45.497478] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-21T18:08:45.498098] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-21T18:08:45.498599] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-21T18:08:45.498701] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-21T18:08:45.756259] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-21T18:08:45.854294] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:46.551070] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-21T18:08:47.062340] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T18:08:47.351000] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-21T18:08:47.549405] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:08:48.151062] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-21T18:08:48.951096] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-21T18:08:49.318805] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T18:08:49.492744] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T18:08:49.758353] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-21T18:08:49.762505] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T18:08:50.551022] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-21T18:08:51.133331] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:08:51.138405] [INFO ] [REMOTE ] CTO: Full fetch complete (41356 records). [2025-10-21T18:08:51.138512] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-21T18:08:51.356266] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-21T18:08:51.512670] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-21T18:08:51.512756] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-21T18:08:51.513330] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-21T18:08:51.513371] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-21T18:08:51.514202] [DEBUG] [LOCAL ] CTO: Trimmed 41356 records to 27425 (keeping 200 days of data) [2025-10-21T18:08:51.673870] [DEBUG] [LOCAL ] CTO: Primary data saved (27425 records). [2025-10-21T18:08:51.673988] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-21T18:08:51.674057] [INFO ] [MAIN ] Update Progress: 547/2366 symbols completed. CTO took 29.9s. Estimated remaining: 3h 48m 46s. Rate: 8.0 symbols/min [2025-10-21T18:08:51.845597] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:08:51.845877] [DEBUG] [LOCAL ] CTS: No existing data file found in primary storage. [2025-10-21T18:08:51.845950] [WARN ] [MAIN ] CTS: No existing data found, performing full refresh instead. [2025-10-21T18:08:51.846185] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-21T18:08:51.846252] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-21T18:08:51.846393] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-21T18:08:51.846443] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-21T18:08:51.964098] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T18:08:52.153056] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-21T18:08:52.232592] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:08:52.950995] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-21T18:08:53.107592] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T18:08:53.175884] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T18:08:53.751060] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-21T18:08:54.551043] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-21T18:08:54.895466] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T18:08:55.351089] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-21T18:08:55.600484] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T18:08:55.641772] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:08:56.151076] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-21T18:08:56.888520] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T18:08:56.950980] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-21T18:08:57.751066] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-21T18:08:57.910721] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:08:58.403811] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:08:58.551037] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-21T18:08:59.351070] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-21T18:08:59.489687] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T18:08:59.600400] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:09:00.151041] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-21T18:09:00.951033] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-21T18:09:01.759156] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-21T18:09:01.765985] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-21T18:09:01.855904] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T18:09:02.468008] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T18:09:02.550997] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-21T18:09:02.740204] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:09:03.351026] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-21T18:09:04.151049] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-21T18:09:04.665890] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-21T18:09:04.951065] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-21T18:09:05.177327] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T18:09:05.313360] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T18:09:05.751040] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-21T18:09:06.544756] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T18:09:06.555901] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-21T18:09:07.069452] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T18:09:07.351014] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-21T18:09:08.151031] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-21T18:09:08.420431] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T18:09:08.951033] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-21T18:09:09.399500] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T18:09:09.408241] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-21T18:09:09.408379] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-21T18:09:09.758712] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-21T18:09:09.820897] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-21T18:09:09.821053] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-21T18:09:09.822070] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-21T18:09:09.822144] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-21T18:09:09.823761] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-21T18:09:10.156203] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T18:09:10.186965] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-21T18:09:10.187099] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-21T18:09:10.187175] [INFO ] [MAIN ] Update Progress: 548/2366 symbols completed. CTRA took 33.9s. Estimated remaining: 3h 49m 15s. Rate: 7.9 symbols/min [2025-10-21T18:09:10.386701] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:10.400170] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:09:10.458592] [DEBUG] [LOCAL ] CTVA: Loaded 53302 existing records from primary storage. [2025-10-21T18:09:10.458930] [INFO ] [MAIN ] CTVA: Loaded 53302 existing records. [2025-10-21T18:09:10.556300] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-21T18:09:10.642516] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:10.642738] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-21T18:09:10.642790] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-21T18:09:10.643707] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-21T18:09:10.643765] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-21T18:09:10.997630] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:11.009505] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T18:09:11.351029] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-21T18:09:12.151054] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-21T18:09:12.216598] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T18:09:12.498947] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:09:12.507076] [INFO ] [REMOTE ] CTRE: Full fetch complete (71341 records). [2025-10-21T18:09:12.507222] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-21T18:09:12.897131] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-21T18:09:12.897231] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-21T18:09:12.898159] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-21T18:09:12.898243] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-21T18:09:12.899601] [DEBUG] [LOCAL ] CTRE: Trimmed 71341 records to 49466 (keeping 200 days of data) [2025-10-21T18:09:12.953498] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-21T18:09:13.200414] [DEBUG] [LOCAL ] CTRE: Primary data saved (49466 records). [2025-10-21T18:09:13.200543] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-21T18:09:13.201353] [INFO ] [MAIN ] Update Progress: 549/2366 symbols completed. CTRE took 35.7s. Estimated remaining: 3h 48m 52s. Rate: 7.9 symbols/min [2025-10-21T18:09:13.387432] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:13.387614] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-21T18:09:13.387689] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-21T18:09:13.387813] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-21T18:09:13.387866] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-21T18:09:13.387908] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-21T18:09:13.387939] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-21T18:09:13.747613] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:13.750977] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-21T18:09:13.961365] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T18:09:13.969123] [INFO ] [REMOTE ] CTRI: Full fetch complete (54096 records). [2025-10-21T18:09:13.969234] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-21T18:09:14.245357] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-21T18:09:14.376614] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T18:09:14.376793] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-21T18:09:14.376952] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-21T18:09:14.382633] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-21T18:09:14.383018] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-21T18:09:14.384110] [DEBUG] [LOCAL ] CTRI: Trimmed 54096 records to 40676 (keeping 200 days of data) [2025-10-21T18:09:14.551059] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-21T18:09:14.626611] [DEBUG] [LOCAL ] CTRI: Primary data saved (40676 records). [2025-10-21T18:09:14.626787] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-21T18:09:14.626877] [INFO ] [MAIN ] Update Progress: 550/2366 symbols completed. CTRI took 29.6s. Estimated remaining: 3h 48m 24s. Rate: 8.0 symbols/min [2025-10-21T18:09:14.798272] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:14.845105] [DEBUG] [LOCAL ] CUBE: Loaded 50888 existing records from primary storage. [2025-10-21T18:09:14.845422] [INFO ] [MAIN ] CUBE: Loaded 50888 existing records. [2025-10-21T18:09:15.020204] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:15.020401] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-21T18:09:15.020471] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-21T18:09:15.021414] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-21T18:09:15.021471] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-21T18:09:15.371295] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-21T18:09:15.376355] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:15.633540] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-21T18:09:15.650063] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T18:09:16.151017] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-21T18:09:16.951022] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-21T18:09:17.751080] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-21T18:09:18.141787] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:09:18.183907] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-21T18:09:18.551039] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-21T18:09:19.325459] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T18:09:19.351054] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-21T18:09:19.718741] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T18:09:20.151058] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-21T18:09:20.556548] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T18:09:20.561824] [INFO ] [REMOTE ] CTS: Full fetch complete (27244 records). [2025-10-21T18:09:20.561934] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-21T18:09:20.954357] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-21T18:09:20.954721] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-21T18:09:20.954845] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-21T18:09:20.956152] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-21T18:09:20.956221] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-21T18:09:20.958304] [DEBUG] [LOCAL ] CTS: Trimmed 27244 records to 19552 (keeping 200 days of data) [2025-10-21T18:09:21.077769] [DEBUG] [LOCAL ] CTS: Primary data saved (19552 records). [2025-10-21T18:09:21.077910] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-21T18:09:21.077981] [INFO ] [MAIN ] Update Progress: 551/2366 symbols completed. CTS took 29.4s. Estimated remaining: 3h 48m 13s. Rate: 8.0 symbols/min [2025-10-21T18:09:21.251159] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:21.277267] [DEBUG] [LOCAL ] CUBI: Loaded 27276 existing records from primary storage. [2025-10-21T18:09:21.277517] [INFO ] [MAIN ] CUBI: Loaded 27276 existing records. [2025-10-21T18:09:21.349762] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-21T18:09:21.470267] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:21.470541] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-21T18:09:21.470630] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-21T18:09:21.470856] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-21T18:09:21.470915] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-21T18:09:21.753804] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-21T18:09:21.863757] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:21.866587] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T18:09:22.120329] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-21T18:09:22.551024] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-21T18:09:22.935392] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T18:09:23.351022] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-21T18:09:24.151017] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-21T18:09:24.951005] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-21T18:09:25.090128] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:09:25.556186] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T18:09:25.751031] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-21T18:09:26.334721] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T18:09:26.551010] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-21T18:09:26.599166] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T18:09:27.351039] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-21T18:09:27.670579] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-21T18:09:28.151020] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-21T18:09:28.506925] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T18:09:28.951025] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-21T18:09:29.751012] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-21T18:09:30.084167] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T18:09:30.553389] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-21T18:09:30.556145] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T18:09:30.642629] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T18:09:31.351057] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-21T18:09:32.151027] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-21T18:09:32.440943] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T18:09:32.807620] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T18:09:32.950998] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-21T18:09:33.715498] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:09:33.750985] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-21T18:09:33.996776] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T18:09:34.551020] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-21T18:09:34.805751] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-21T18:09:35.239697] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:09:35.351011] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-21T18:09:36.151027] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-21T18:09:36.446725] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-21T18:09:36.580464] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T18:09:36.951033] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-21T18:09:37.309488] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-21T18:09:37.751019] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-21T18:09:38.233717] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-21T18:09:38.234410] [INFO ] [REMOTE ] CUBB: Full fetch complete (952 records). [2025-10-21T18:09:38.234481] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-21T18:09:38.408501] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-21T18:09:38.408751] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:09:38.408822] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:09:38.408891] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-21T18:09:38.408952] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-21T18:09:38.408997] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-21T18:09:38.409080] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-21T18:09:38.409144] [INFO ] [MAIN ] Update Progress: 552/2366 symbols completed. CUBB took 25.2s. Estimated remaining: 3h 48m 38s. Rate: 7.9 symbols/min [2025-10-21T18:09:38.555270] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-21T18:09:38.577260] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:38.625978] [DEBUG] [LOCAL ] CUK: Loaded 51072 existing records from primary storage. [2025-10-21T18:09:38.626304] [INFO ] [MAIN ] CUK: Loaded 51072 existing records. [2025-10-21T18:09:38.798865] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:38.799064] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-21T18:09:38.799165] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-21T18:09:38.800048] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-21T18:09:38.800105] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-21T18:09:39.143025] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:39.350996] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-21T18:09:39.970055] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T18:09:40.151077] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-21T18:09:40.836189] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T18:09:40.951030] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-21T18:09:40.971417] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T18:09:41.751000] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-21T18:09:42.550995] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-21T18:09:42.739117] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T18:09:43.350997] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-21T18:09:43.459129] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:09:44.151000] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-21T18:09:44.483617] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T18:09:44.590909] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T18:09:44.951036] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-21T18:09:45.751012] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-21T18:09:45.972588] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T18:09:46.551000] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-21T18:09:46.969886] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T18:09:46.996818] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T18:09:47.001119] [INFO ] [REMOTE ] CUBI: Full fetch complete (39130 records). [2025-10-21T18:09:47.001196] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-21T18:09:47.353906] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-21T18:09:47.388732] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-21T18:09:47.388818] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-21T18:09:47.389465] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-21T18:09:47.389615] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-21T18:09:47.390505] [DEBUG] [LOCAL ] CUBI: Trimmed 39130 records to 27119 (keeping 200 days of data) [2025-10-21T18:09:47.548941] [DEBUG] [LOCAL ] CUBI: Primary data saved (27119 records). [2025-10-21T18:09:47.549070] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-21T18:09:47.549147] [INFO ] [MAIN ] Update Progress: 553/2366 symbols completed. CUBI took 26.5s. Estimated remaining: 3h 48m 36s. Rate: 7.9 symbols/min [2025-10-21T18:09:47.743285] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:47.747616] [DEBUG] [LOCAL ] CULP: Loaded 2882 existing records from primary storage. [2025-10-21T18:09:47.747808] [INFO ] [MAIN ] CULP: Loaded 2882 existing records. [2025-10-21T18:09:47.921683] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:09:47.921884] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-21T18:09:47.921932] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-21T18:09:47.922056] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-21T18:09:47.922092] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-21T18:09:48.169623] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-21T18:09:48.287098] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:48.437250] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T18:09:48.951028] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-21T18:09:49.110340] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T18:09:49.749422] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T18:09:49.750969] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-21T18:09:50.173108] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T18:09:50.317936] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T18:09:50.551016] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-21T18:09:51.351074] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-21T18:09:51.862116] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T18:09:52.034808] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T18:09:52.151007] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-21T18:09:52.756439] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T18:09:52.951014] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-21T18:09:53.243120] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-21T18:09:53.751051] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-21T18:09:54.551031] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-21T18:09:55.319864] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T18:09:55.350985] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-21T18:09:55.844037] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T18:09:56.151008] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-21T18:09:56.348116] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T18:09:56.355479] [INFO ] [REMOTE ] CUBE: Full fetch complete (72955 records). [2025-10-21T18:09:56.355590] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-21T18:09:56.356384] [FATAL] [VALIDATOR ] CUBE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:09:56.356478] [FATAL] [MAIN ] CUBE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:09:56.356523] [WARN ] [MAIN ] CUBE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:09:56.356601] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-21T18:09:56.356714] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-21T18:09:56.356776] [INFO ] [LOCAL ] CUBE: Starting deletion of derivative data. [2025-10-21T18:09:56.356983] [DEBUG] [LOCAL ] CUBE: Deleted derivative data file. [2025-10-21T18:09:56.357089] [INFO ] [MAIN ] Update Progress: 554/2366 symbols completed. CUBE took 41.7s. Estimated remaining: 3h 48m 32s. Rate: 7.9 symbols/min [2025-10-21T18:09:56.561726] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:09:56.561947] [DEBUG] [LOCAL ] CURB: No existing data file found in primary storage. [2025-10-21T18:09:56.562043] [WARN ] [MAIN ] CURB: No existing data found, performing full refresh instead. [2025-10-21T18:09:56.562145] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-21T18:09:56.562192] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-21T18:09:56.562245] [DEBUG] [LOCAL ] CURB: No primary data file found to delete. [2025-10-21T18:09:56.562287] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-21T18:09:56.924526] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:09:56.950984] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-21T18:09:57.751052] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-21T18:09:58.165255] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-21T18:09:58.373909] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T18:09:58.428739] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-21T18:09:58.551016] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-21T18:09:59.351023] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-21T18:09:59.809213] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T18:10:00.151027] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-21T18:10:00.797749] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T18:10:00.951033] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-21T18:10:01.604687] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-21T18:10:01.615108] [INFO ] [REMOTE ] CTVA: Full fetch complete (77223 records). [2025-10-21T18:10:01.615354] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-21T18:10:01.756227] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-21T18:10:02.057114] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-21T18:10:02.057210] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-21T18:10:02.058180] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-21T18:10:02.058248] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-21T18:10:02.059796] [DEBUG] [LOCAL ] CTVA: Trimmed 77223 records to 53305 (keeping 200 days of data) [2025-10-21T18:10:02.363091] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T18:10:02.478565] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:10:02.503154] [DEBUG] [LOCAL ] CTVA: Primary data saved (53305 records). [2025-10-21T18:10:02.503618] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-21T18:10:02.504497] [INFO ] [MAIN ] Update Progress: 555/2366 symbols completed. CTVA took 52.3s. Estimated remaining: 3h 48m 20s. Rate: 7.9 symbols/min [2025-10-21T18:10:02.556287] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-21T18:10:02.702965] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:02.734388] [DEBUG] [LOCAL ] CURV: Loaded 27263 existing records from primary storage. [2025-10-21T18:10:02.734714] [INFO ] [MAIN ] CURV: Loaded 27263 existing records. [2025-10-21T18:10:02.915791] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:02.916020] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-21T18:10:02.916078] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-21T18:10:02.916518] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-21T18:10:02.916574] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-21T18:10:03.262965] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:03.350980] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-21T18:10:04.151044] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-21T18:10:04.698082] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T18:10:04.801261] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T18:10:04.889543] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T18:10:04.890509] [INFO ] [REMOTE ] CULP: Full fetch complete (4520 records). [2025-10-21T18:10:04.890575] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-21T18:10:04.890949] [FATAL] [VALIDATOR ] CULP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:10:04.891032] [FATAL] [MAIN ] CULP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:10:04.891074] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:10:04.891138] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-21T18:10:04.891197] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-21T18:10:04.891231] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-10-21T18:10:04.891373] [DEBUG] [LOCAL ] CULP: Deleted derivative data file. [2025-10-21T18:10:04.891453] [INFO ] [MAIN ] Update Progress: 556/2366 symbols completed. CULP took 17.3s. Estimated remaining: 3h 47m 55s. Rate: 7.9 symbols/min [2025-10-21T18:10:04.956680] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-21T18:10:05.069108] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:05.113070] [DEBUG] [LOCAL ] CUZ: Loaded 49575 existing records from primary storage. [2025-10-21T18:10:05.113400] [INFO ] [MAIN ] CUZ: Loaded 49575 existing records. [2025-10-21T18:10:05.290543] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:05.290767] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-21T18:10:05.290835] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-21T18:10:05.291488] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-21T18:10:05.291544] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-21T18:10:05.647184] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:05.751041] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-21T18:10:06.550999] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-21T18:10:06.745242] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:10:06.991716] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T18:10:07.270562] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T18:10:07.351028] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-21T18:10:08.151024] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-21T18:10:08.534435] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:10:08.951006] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-21T18:10:09.751089] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-21T18:10:09.891805] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:10:10.551047] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-21T18:10:10.975793] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T18:10:11.093076] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T18:10:11.351067] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-21T18:10:11.792022] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:10:12.151023] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-21T18:10:12.663694] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T18:10:12.951094] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-21T18:10:13.615598] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T18:10:13.751027] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-21T18:10:14.022280] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T18:10:14.551069] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-21T18:10:15.081031] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:10:15.351080] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-21T18:10:16.151004] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-21T18:10:16.536381] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:10:16.544316] [INFO ] [REMOTE ] CUK: Full fetch complete (74356 records). [2025-10-21T18:10:16.544426] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-21T18:10:16.956241] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-21T18:10:16.960162] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-21T18:10:16.961081] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-21T18:10:16.962146] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-21T18:10:16.962443] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-21T18:10:16.996270] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:10:16.994533] [DEBUG] [LOCAL ] CUK: Trimmed 74356 records to 51065 (keeping 200 days of data) [2025-10-21T18:10:17.298084] [DEBUG] [LOCAL ] CUK: Primary data saved (51065 records). [2025-10-21T18:10:17.298213] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-21T18:10:17.299218] [INFO ] [MAIN ] Update Progress: 557/2366 symbols completed. CUK took 38.9s. Estimated remaining: 3h 48m 4s. Rate: 7.9 symbols/min [2025-10-21T18:10:17.751007] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-21T18:10:18.557958] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:10:18.567256] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-21T18:10:19.140593] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (2.99 seconds). [2025-10-21T18:10:19.351035] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-21T18:10:20.030967] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:10:20.151086] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-21T18:10:20.492095] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T18:10:20.951000] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-21T18:10:21.518324] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:10:21.524142] [INFO ] [REMOTE ] CURB: Full fetch complete (47444 records). [2025-10-21T18:10:21.524231] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-21T18:10:21.906752] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-21T18:10:21.906827] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-21T18:10:21.907433] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-21T18:10:21.907472] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-21T18:10:21.908398] [DEBUG] [LOCAL ] CURB: Trimmed 47444 records to 32813 (keeping 200 days of data) [2025-10-21T18:10:22.105600] [DEBUG] [LOCAL ] CURB: Primary data saved (32813 records). [2025-10-21T18:10:22.105778] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-21T18:10:22.105856] [INFO ] [MAIN ] Update Progress: 558/2366 symbols completed. CURB took 25.7s. Estimated remaining: 3h 47m 47s. Rate: 7.9 symbols/min [2025-10-21T18:10:22.209157] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (4.46 seconds). [2025-10-21T18:10:22.219610] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-21T18:10:22.270150] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T18:10:22.551005] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-21T18:10:23.766128] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:10:23.772581] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-21T18:10:23.906259] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:10:24.151055] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-21T18:10:25.249861] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T18:10:25.257456] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-21T18:10:25.659910] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:10:25.751007] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-21T18:10:26.599763] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T18:10:26.604951] [INFO ] [REMOTE ] CURV: Full fetch complete (38899 records). [2025-10-21T18:10:26.605032] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-21T18:10:26.973567] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-21T18:10:26.973707] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-21T18:10:26.974447] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-21T18:10:26.974508] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-21T18:10:26.975408] [DEBUG] [LOCAL ] CURV: Trimmed 38899 records to 27190 (keeping 200 days of data) [2025-10-21T18:10:27.122727] [DEBUG] [LOCAL ] CURV: Primary data saved (27190 records). [2025-10-21T18:10:27.122905] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-21T18:10:27.123036] [INFO ] [MAIN ] Update Progress: 559/2366 symbols completed. CURV took 24.6s. Estimated remaining: 3h 47m 31s. Rate: 7.9 symbols/min [2025-10-21T18:10:27.204447] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T18:10:27.214731] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-21T18:10:28.887006] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T18:10:28.897792] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-21T18:10:30.584701] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T18:10:30.591762] [INFO ] [REMOTE ] CUZ: Full fetch complete (70528 records). [2025-10-21T18:10:30.591865] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-21T18:10:30.592572] [FATAL] [VALIDATOR ] CUZ: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:10:30.592699] [FATAL] [MAIN ] CUZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:10:30.592750] [WARN ] [MAIN ] CUZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:10:30.592811] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-21T18:10:30.592873] [DEBUG] [LOCAL ] CUZ: No primary data file found to delete. [2025-10-21T18:10:30.592947] [INFO ] [LOCAL ] CUZ: Starting deletion of derivative data. [2025-10-21T18:10:30.593105] [DEBUG] [LOCAL ] CUZ: Deleted derivative data file. [2025-10-21T18:10:30.593479] [INFO ] [MAIN ] Update Progress: 560/2366 symbols completed. CUZ took 25.7s. Estimated remaining: 3h 47m 11s. Rate: 7.9 symbols/min [2025-10-21T18:10:31.223320] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:31.304597] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:31.309625] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:31.313032] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:31.335044] [DEBUG] [LOCAL ] CVEO: Loaded 15328 existing records from primary storage. [2025-10-21T18:10:31.335327] [INFO ] [MAIN ] CVEO: Loaded 15328 existing records. [2025-10-21T18:10:31.399619] [DEBUG] [LOCAL ] CVLG: Loaded 15478 existing records from primary storage. [2025-10-21T18:10:31.431500] [INFO ] [MAIN ] CVLG: Loaded 15478 existing records. [2025-10-21T18:10:31.700635] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:31.693234] [DEBUG] [LOCAL ] CVI: Loaded 46745 existing records from primary storage. [2025-10-21T18:10:31.701285] [INFO ] [MAIN ] CVI: Loaded 46745 existing records. [2025-10-21T18:10:31.717463] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-21T18:10:31.730302] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-21T18:10:31.759822] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-21T18:10:31.797588] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-21T18:10:31.818632] [INFO ] [MAIN ] CVE: Loaded 53567 existing records. [2025-10-21T18:10:31.818884] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-21T18:10:32.037259] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:32.137972] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-21T18:10:32.176172] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-21T18:10:32.199713] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-21T18:10:32.204321] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:32.235417] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-21T18:10:32.240663] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-21T18:10:32.296403] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-21T18:10:32.371767] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:32.437622] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-21T18:10:32.448032] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-21T18:10:32.425543] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-21T18:10:32.475526] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-21T18:10:32.500853] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-21T18:10:32.572479] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-21T18:10:33.280607] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:33.404497] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-21T18:10:33.567530] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:33.623297] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-21T18:10:33.725018] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:33.727602] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-21T18:10:33.747764] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:33.748072] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-21T18:10:34.465185] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:10:34.467356] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-21T18:10:34.857010] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T18:10:34.862487] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-21T18:10:35.216594] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T18:10:35.227564] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-21T18:10:35.255375] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:10:35.265152] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-21T18:10:35.294973] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T18:10:35.299617] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-21T18:10:35.321510] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-21T18:10:35.351029] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-21T18:10:35.960961] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:10:36.151002] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-21T18:10:36.317161] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T18:10:36.516150] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T18:10:36.880786] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:10:36.957367] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-21T18:10:36.961069] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T18:10:37.751024] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-21T18:10:38.550996] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-21T18:10:38.938500] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T18:10:39.203228] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T18:10:39.350999] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-21T18:10:39.420206] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:10:40.151010] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-21T18:10:40.301695] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T18:10:40.951059] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-21T18:10:41.751033] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-21T18:10:41.983760] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T18:10:42.025132] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T18:10:42.551057] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-21T18:10:42.793990] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:10:43.351059] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-21T18:10:44.125316] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:10:44.150983] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-21T18:10:44.293334] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T18:10:44.951021] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-21T18:10:45.750993] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-21T18:10:45.999841] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:10:46.045809] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T18:10:46.551031] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-21T18:10:46.829328] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:10:47.351042] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-21T18:10:47.896693] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T18:10:47.914435] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T18:10:48.151023] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-21T18:10:48.951112] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-21T18:10:49.751115] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-21T18:10:49.807995] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T18:10:49.948131] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:10:50.551037] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-21T18:10:51.351030] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-21T18:10:51.716975] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T18:10:51.738747] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:10:51.741887] [INFO ] [REMOTE ] CVEO: Full fetch complete (20882 records). [2025-10-21T18:10:51.741978] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-21T18:10:52.112531] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-21T18:10:52.112617] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-21T18:10:52.113068] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-21T18:10:52.113121] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-21T18:10:52.113697] [DEBUG] [LOCAL ] CVEO: Trimmed 20882 records to 15250 (keeping 200 days of data) [2025-10-21T18:10:52.155110] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-21T18:10:52.200632] [DEBUG] [LOCAL ] CVEO: Primary data saved (15250 records). [2025-10-21T18:10:52.200753] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-21T18:10:52.200826] [INFO ] [MAIN ] Update Progress: 561/2366 symbols completed. CVEO took 21.6s. Estimated remaining: 3h 47m 48s. Rate: 7.9 symbols/min [2025-10-21T18:10:52.371527] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:52.421289] [DEBUG] [LOCAL ] CVNA: Loaded 52842 existing records from primary storage. [2025-10-21T18:10:52.421583] [INFO ] [MAIN ] CVNA: Loaded 52842 existing records. [2025-10-21T18:10:52.596252] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:52.596499] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-21T18:10:52.596545] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-21T18:10:52.597176] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-21T18:10:52.597234] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-21T18:10:52.958683] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-21T18:10:52.979112] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:52.981581] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T18:10:53.016762] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:10:53.751041] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-21T18:10:54.523000] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:10:54.550990] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-21T18:10:55.351018] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-21T18:10:56.017135] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-21T18:10:56.047733] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-21T18:10:56.151003] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-21T18:10:56.235549] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T18:10:56.951022] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-21T18:10:57.751020] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-21T18:10:57.915214] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T18:10:58.044636] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T18:10:58.046976] [INFO ] [REMOTE ] CVLG: Full fetch complete (21317 records). [2025-10-21T18:10:58.047045] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-21T18:10:58.404853] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-21T18:10:58.404942] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-21T18:10:58.405378] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-21T18:10:58.405427] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-21T18:10:58.406007] [DEBUG] [LOCAL ] CVLG: Trimmed 21317 records to 15331 (keeping 200 days of data) [2025-10-21T18:10:58.495396] [DEBUG] [LOCAL ] CVLG: Primary data saved (15331 records). [2025-10-21T18:10:58.495525] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-21T18:10:58.495605] [INFO ] [MAIN ] Update Progress: 562/2366 symbols completed. CVLG took 27.9s. Estimated remaining: 3h 47m 37s. Rate: 7.9 symbols/min [2025-10-21T18:10:58.557410] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-21T18:10:58.663164] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:10:58.712704] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-21T18:10:58.713059] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-21T18:10:58.890660] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:10:58.890895] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-21T18:10:58.890949] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-21T18:10:58.891737] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-21T18:10:58.891797] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-21T18:10:59.248535] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:10:59.350976] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-21T18:10:59.544506] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:11:00.151003] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-21T18:11:00.401751] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T18:11:00.409526] [INFO ] [REMOTE ] CVI: Full fetch complete (67204 records). [2025-10-21T18:11:00.409722] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-21T18:11:00.809976] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-21T18:11:00.810057] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-21T18:11:00.810889] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-21T18:11:00.810954] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-21T18:11:00.812381] [DEBUG] [LOCAL ] CVI: Trimmed 67204 records to 46730 (keeping 200 days of data) [2025-10-21T18:11:00.978079] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-21T18:11:01.087840] [DEBUG] [LOCAL ] CVI: Primary data saved (46730 records). [2025-10-21T18:11:01.087965] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-21T18:11:01.088065] [INFO ] [MAIN ] Update Progress: 563/2366 symbols completed. CVI took 30.5s. Estimated remaining: 3h 47m 13s. Rate: 7.9 symbols/min [2025-10-21T18:11:01.258358] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:01.314906] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-21T18:11:01.315273] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-21T18:11:01.498570] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:01.498788] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-21T18:11:01.498834] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-21T18:11:01.499740] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-21T18:11:01.499798] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-21T18:11:01.916277] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:01.916846] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-21T18:11:01.953332] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-21T18:11:02.343850] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-21T18:11:02.551008] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-21T18:11:02.988090] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T18:11:03.351005] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-21T18:11:04.151052] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-21T18:11:04.289190] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-21T18:11:04.361425] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T18:11:04.951002] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-21T18:11:05.429835] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-21T18:11:05.438203] [INFO ] [REMOTE ] CVE: Full fetch complete (77718 records). [2025-10-21T18:11:05.438344] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-21T18:11:05.756119] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-21T18:11:05.832839] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-21T18:11:05.832915] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-21T18:11:05.833801] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-21T18:11:05.833864] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-21T18:11:05.835292] [DEBUG] [LOCAL ] CVE: Trimmed 77718 records to 53567 (keeping 200 days of data) [2025-10-21T18:11:06.177621] [DEBUG] [LOCAL ] CVE: Primary data saved (53567 records). [2025-10-21T18:11:06.192694] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-21T18:11:06.196724] [INFO ] [MAIN ] Update Progress: 564/2366 symbols completed. CVE took 35.6s. Estimated remaining: 3h 46m 58s. Rate: 7.9 symbols/min [2025-10-21T18:11:06.242534] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T18:11:06.382402] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:06.404520] [DEBUG] [LOCAL ] CW: Loaded 22034 existing records from primary storage. [2025-10-21T18:11:06.404792] [INFO ] [MAIN ] CW: Loaded 22034 existing records. [2025-10-21T18:11:06.559918] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-21T18:11:06.581017] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:06.581300] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-21T18:11:06.581346] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-21T18:11:06.581850] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-21T18:11:06.581906] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-21T18:11:06.927340] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:07.220569] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-21T18:11:07.351025] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-21T18:11:07.968209] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T18:11:08.151053] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-21T18:11:08.623905] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T18:11:08.806194] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T18:11:08.951042] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-21T18:11:09.751023] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-21T18:11:10.270002] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T18:11:10.451741] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-21T18:11:10.550985] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-21T18:11:11.351052] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-21T18:11:12.155459] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-21T18:11:12.158711] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-21T18:11:12.951046] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-21T18:11:13.161531] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-21T18:11:13.265059] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:11:13.290283] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T18:11:13.751087] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-21T18:11:14.551090] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-21T18:11:15.164570] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T18:11:15.351007] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-21T18:11:15.754318] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T18:11:15.978863] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-21T18:11:16.151001] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-21T18:11:16.951041] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-21T18:11:17.469373] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T18:11:17.751064] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-21T18:11:17.874096] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-21T18:11:18.551048] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-21T18:11:19.351007] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-21T18:11:19.609750] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-21T18:11:19.650082] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T18:11:19.873048] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T18:11:20.151061] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-21T18:11:20.951054] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-21T18:11:21.277625] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T18:11:21.751028] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-21T18:11:22.013834] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:11:22.039086] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T18:11:22.551034] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-21T18:11:23.351040] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-21T18:11:24.150998] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-21T18:11:24.209186] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-21T18:11:24.935317] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-21T18:11:24.950979] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-21T18:11:25.086566] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T18:11:25.467739] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T18:11:25.751027] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-21T18:11:26.551077] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-21T18:11:26.593892] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T18:11:26.772566] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T18:11:27.351124] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-21T18:11:28.151059] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-21T18:11:28.450959] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:11:28.454480] [INFO ] [REMOTE ] CW: Full fetch complete (33056 records). [2025-10-21T18:11:28.454677] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-21T18:11:28.836130] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-21T18:11:28.836228] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-21T18:11:28.836622] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-21T18:11:28.836904] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-21T18:11:28.859508] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-21T18:11:28.859628] [DEBUG] [LOCAL ] CW: Trimmed 33056 records to 21993 (keeping 200 days of data) [2025-10-21T18:11:28.868315] [INFO ] [REMOTE ] CVNA: Full fetch complete (76744 records). [2025-10-21T18:11:28.868421] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-21T18:11:28.955986] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-21T18:11:29.412876] [DEBUG] [LOCAL ] CW: Primary data saved (21993 records). [2025-10-21T18:11:29.432693] [INFO ] [MAIN ] CW: Full history saved. [2025-10-21T18:11:29.432905] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-21T18:11:29.433054] [INFO ] [MAIN ] Update Progress: 565/2366 symbols completed. CW took 23.2s. Estimated remaining: 3h 47m 40s. Rate: 7.9 symbols/min [2025-10-21T18:11:29.433287] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-21T18:11:29.445942] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-21T18:11:29.466985] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-21T18:11:29.555728] [DEBUG] [LOCAL ] CVNA: Trimmed 76744 records to 52839 (keeping 200 days of data) [2025-10-21T18:11:29.619156] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:29.908726] [DEBUG] [LOCAL ] CWAN: Loaded 52668 existing records from primary storage. [2025-10-21T18:11:29.982471] [INFO ] [MAIN ] CWAN: Loaded 52668 existing records. [2025-10-21T18:11:30.127928] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:11:30.231195] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:30.231880] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-21T18:11:30.231973] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-21T18:11:30.235315] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-21T18:11:30.242423] [DEBUG] [LOCAL ] CVNA: Primary data saved (52839 records). [2025-10-21T18:11:30.242484] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-21T18:11:30.242709] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-21T18:11:30.242616] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-21T18:11:30.248004] [INFO ] [MAIN ] Update Progress: 566/2366 symbols completed. CVNA took 38.0s. Estimated remaining: 3h 47m 11s. Rate: 7.9 symbols/min [2025-10-21T18:11:30.655249] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:30.835960] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:30.846519] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-21T18:11:30.868140] [DEBUG] [LOCAL ] CWEN: Loaded 45314 existing records from primary storage. [2025-10-21T18:11:30.868481] [INFO ] [MAIN ] CWEN: Loaded 45314 existing records. [2025-10-21T18:11:31.046847] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:31.047098] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-21T18:11:31.047174] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-21T18:11:31.048146] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-21T18:11:31.048205] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-21T18:11:31.410912] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:31.411550] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-21T18:11:31.445286] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T18:11:31.472707] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-21T18:11:31.473607] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-21T18:11:31.473914] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-21T18:11:31.910633] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-21T18:11:31.910753] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-21T18:11:31.911700] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-21T18:11:31.911762] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-21T18:11:31.913118] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-21T18:11:32.157084] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-21T18:11:32.239969] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-21T18:11:32.240121] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-21T18:11:32.240482] [INFO ] [MAIN ] Update Progress: 567/2366 symbols completed. CVS took 33.7s. Estimated remaining: 3h 46m 46s. Rate: 7.9 symbols/min [2025-10-21T18:11:32.449137] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:32.451888] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T18:11:32.511805] [DEBUG] [LOCAL ] CWH: Loaded 51314 existing records from primary storage. [2025-10-21T18:11:32.512130] [INFO ] [MAIN ] CWH: Loaded 51314 existing records. [2025-10-21T18:11:32.702297] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:32.702545] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-21T18:11:32.702594] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-21T18:11:32.702907] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-21T18:11:32.702963] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-21T18:11:32.958449] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-21T18:11:33.083549] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:33.108040] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:11:33.751032] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-21T18:11:34.399977] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T18:11:34.466360] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:11:34.550993] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-21T18:11:35.327138] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:11:35.351023] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-21T18:11:35.526027] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T18:11:35.534361] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-21T18:11:35.534491] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-21T18:11:35.918803] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-21T18:11:35.918881] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-21T18:11:35.919766] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-21T18:11:35.919829] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-21T18:11:35.921233] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-21T18:11:36.151100] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-21T18:11:36.261591] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-21T18:11:36.261767] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-21T18:11:36.262768] [INFO ] [MAIN ] Update Progress: 568/2366 symbols completed. CVX took 35.2s. Estimated remaining: 3h 46m 27s. Rate: 7.9 symbols/min [2025-10-21T18:11:36.439348] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:36.491869] [DEBUG] [LOCAL ] CWK: Loaded 49668 existing records from primary storage. [2025-10-21T18:11:36.492188] [INFO ] [MAIN ] CWK: Loaded 49668 existing records. [2025-10-21T18:11:36.670069] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:36.670264] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-21T18:11:36.670312] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-21T18:11:36.671118] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-21T18:11:36.671176] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-21T18:11:36.958429] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-21T18:11:37.045141] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:37.074207] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:11:37.751038] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-21T18:11:37.840596] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:11:38.551050] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-21T18:11:38.666822] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T18:11:39.245840] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T18:11:39.351019] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-21T18:11:40.063757] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:11:40.151043] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-21T18:11:40.689482] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:11:40.951035] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-21T18:11:41.715276] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:11:41.750987] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-21T18:11:42.551016] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-21T18:11:42.667712] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:11:43.351145] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-21T18:11:43.424957] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T18:11:43.857365] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T18:11:44.151037] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-21T18:11:44.679869] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T18:11:44.951110] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-21T18:11:45.751011] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-21T18:11:45.882941] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T18:11:46.400986] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:11:46.551016] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-21T18:11:46.658223] [DEBUG] [REMOTE ] CWH: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T18:11:46.658525] [WARN ] [REMOTE ] CWH: No data returned for month 2025-04 [2025-10-21T18:11:46.658614] [FATAL] [REMOTE ] CWH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:11:46.658731] [FATAL] [MAIN ] CWH: Failed to fetch primary data. [2025-10-21T18:11:46.658812] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:11:46.658891] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-21T18:11:46.658951] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-10-21T18:11:46.658986] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-10-21T18:11:46.659133] [DEBUG] [LOCAL ] CWH: Deleted derivative data file. [2025-10-21T18:11:46.659540] [INFO ] [MAIN ] Update Progress: 569/2366 symbols completed. CWH took 14.4s. Estimated remaining: 3h 46m 28s. Rate: 7.9 symbols/min [2025-10-21T18:11:46.829910] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:46.830106] [DEBUG] [LOCAL ] CWT: No existing data file found in primary storage. [2025-10-21T18:11:46.830146] [WARN ] [MAIN ] CWT: No existing data found, performing full refresh instead. [2025-10-21T18:11:46.830255] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-21T18:11:46.830296] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-21T18:11:46.830335] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-21T18:11:46.830366] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-21T18:11:47.193788] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:11:47.351005] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-21T18:11:47.706102] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T18:11:48.151039] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-21T18:11:48.328693] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T18:11:48.951037] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-21T18:11:49.677489] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:11:49.751012] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-21T18:11:50.237626] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T18:11:50.551022] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-21T18:11:51.351023] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-21T18:11:51.466251] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T18:11:52.129103] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T18:11:52.151000] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-21T18:11:52.314731] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:11:52.951083] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-21T18:11:53.751037] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-21T18:11:53.890224] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T18:11:54.551008] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-21T18:11:54.797751] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T18:11:55.360193] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-21T18:11:55.365470] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:11:55.842830] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T18:11:56.151018] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-21T18:11:56.951008] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-21T18:11:57.059777] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T18:11:57.751013] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-21T18:11:57.879526] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:11:58.551027] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-21T18:11:58.660984] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T18:11:58.668343] [INFO ] [REMOTE ] CWEN: Full fetch complete (65560 records). [2025-10-21T18:11:58.668462] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-21T18:11:59.069449] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-21T18:11:59.069629] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-21T18:11:59.070499] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-21T18:11:59.070611] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-21T18:11:59.089814] [DEBUG] [LOCAL ] CWEN: Trimmed 65560 records to 45297 (keeping 200 days of data) [2025-10-21T18:11:59.091445] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T18:11:59.351487] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-21T18:11:59.371205] [DEBUG] [LOCAL ] CWEN: Primary data saved (45297 records). [2025-10-21T18:11:59.371294] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-21T18:11:59.371371] [INFO ] [MAIN ] Update Progress: 570/2366 symbols completed. CWEN took 29.1s. Estimated remaining: 3h 46m 37s. Rate: 7.9 symbols/min [2025-10-21T18:11:59.546184] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:11:59.596076] [DEBUG] [LOCAL ] CX: Loaded 52835 existing records from primary storage. [2025-10-21T18:11:59.596398] [INFO ] [MAIN ] CX: Loaded 52835 existing records. [2025-10-21T18:11:59.773502] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:11:59.773785] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-21T18:11:59.773838] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-21T18:11:59.774889] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-21T18:11:59.774946] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-21T18:12:00.123539] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:00.153383] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-21T18:12:00.156365] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T18:12:00.404002] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T18:12:00.951018] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-21T18:12:01.751038] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-21T18:12:02.102193] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T18:12:02.551022] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-21T18:12:03.093898] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T18:12:03.356166] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-21T18:12:03.368928] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T18:12:04.151075] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-21T18:12:04.274992] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T18:12:04.283340] [INFO ] [REMOTE ] CWAN: Full fetch complete (75569 records). [2025-10-21T18:12:04.283456] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-21T18:12:04.671248] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-21T18:12:04.671336] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-21T18:12:04.672215] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-21T18:12:04.672280] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-21T18:12:04.673775] [DEBUG] [LOCAL ] CWAN: Trimmed 75569 records to 52682 (keeping 200 days of data) [2025-10-21T18:12:04.953742] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-21T18:12:04.976877] [DEBUG] [LOCAL ] CWAN: Primary data saved (52682 records). [2025-10-21T18:12:04.977027] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-21T18:12:04.977131] [INFO ] [MAIN ] Update Progress: 571/2366 symbols completed. CWAN took 35.5s. Estimated remaining: 3h 46m 23s. Rate: 7.9 symbols/min [2025-10-21T18:12:05.159592] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:05.177184] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T18:12:05.193064] [DEBUG] [LOCAL ] CXE: Loaded 6342 existing records from primary storage. [2025-10-21T18:12:05.193250] [INFO ] [MAIN ] CXE: Loaded 6342 existing records. [2025-10-21T18:12:05.382079] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:05.382494] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-21T18:12:05.382719] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-21T18:12:05.383117] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-21T18:12:05.383173] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-21T18:12:05.645229] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:12:05.756811] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-21T18:12:05.756751] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:06.551022] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-21T18:12:06.606630] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T18:12:06.614530] [INFO ] [REMOTE ] CWK: Full fetch complete (71320 records). [2025-10-21T18:12:06.614721] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-21T18:12:07.009256] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-21T18:12:07.009376] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-21T18:12:07.010262] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-21T18:12:07.010461] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-21T18:12:07.033168] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T18:12:07.039922] [DEBUG] [LOCAL ] CWK: Trimmed 71320 records to 49650 (keeping 200 days of data) [2025-10-21T18:12:07.338608] [DEBUG] [LOCAL ] CWK: Primary data saved (49650 records). [2025-10-21T18:12:07.338775] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-21T18:12:07.339845] [INFO ] [MAIN ] Update Progress: 572/2366 symbols completed. CWK took 31.1s. Estimated remaining: 3h 45m 59s. Rate: 7.9 symbols/min [2025-10-21T18:12:07.360414] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-21T18:12:07.513438] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:07.521564] [DEBUG] [LOCAL ] CXH: Loaded 4421 existing records from primary storage. [2025-10-21T18:12:07.521802] [INFO ] [MAIN ] CXH: Loaded 4421 existing records. [2025-10-21T18:12:07.699265] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:07.699481] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-21T18:12:07.699530] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-21T18:12:07.699739] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-21T18:12:07.699796] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-21T18:12:08.054124] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:08.150981] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-21T18:12:08.529570] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T18:12:08.653969] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:12:08.748310] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-21T18:12:08.951016] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-21T18:12:09.751042] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-21T18:12:10.550985] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-21T18:12:10.687165] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T18:12:10.716732] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T18:12:11.310040] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T18:12:11.350997] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-21T18:12:12.151060] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-21T18:12:12.946782] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T18:12:12.950982] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-21T18:12:13.058212] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T18:12:13.751081] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-21T18:12:13.781251] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T18:12:14.551023] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-21T18:12:14.871209] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T18:12:14.876230] [INFO ] [REMOTE ] CWT: Full fetch complete (41062 records). [2025-10-21T18:12:14.876350] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-21T18:12:14.876953] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:12:14.877035] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:12:14.877077] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:12:14.877116] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-21T18:12:14.877186] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-21T18:12:14.877223] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-10-21T18:12:14.877261] [DEBUG] [LOCAL ] CWT: No derivative data file found to delete. [2025-10-21T18:12:14.877317] [INFO ] [MAIN ] Update Progress: 573/2366 symbols completed. CWT took 28.2s. Estimated remaining: 3h 45m 52s. Rate: 7.9 symbols/min [2025-10-21T18:12:15.038558] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-21T18:12:15.078815] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:15.122955] [DEBUG] [LOCAL ] CXM: Loaded 47532 existing records from primary storage. [2025-10-21T18:12:15.123284] [INFO ] [MAIN ] CXM: Loaded 47532 existing records. [2025-10-21T18:12:15.315491] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:15.315774] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-21T18:12:15.315863] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-21T18:12:15.316540] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-21T18:12:15.316597] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-21T18:12:15.356191] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-21T18:12:15.667172] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:16.151044] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-21T18:12:16.643931] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T18:12:16.951030] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-21T18:12:17.166514] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T18:12:17.308210] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:12:17.751037] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-21T18:12:18.551067] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-21T18:12:19.314445] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:12:19.351108] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-21T18:12:19.367445] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T18:12:19.933085] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T18:12:20.151036] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-21T18:12:20.762149] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:12:20.951097] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-21T18:12:21.537891] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T18:12:21.751093] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-21T18:12:22.386479] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T18:12:22.550993] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-21T18:12:23.112338] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T18:12:23.351024] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-21T18:12:23.937166] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T18:12:24.151062] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-21T18:12:24.951010] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-21T18:12:24.961860] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T18:12:25.751029] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-21T18:12:25.809476] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T18:12:26.551082] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-21T18:12:27.350995] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-21T18:12:27.824735] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-21T18:12:27.897034] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:12:28.151002] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-21T18:12:28.228317] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:12:28.229863] [INFO ] [REMOTE ] CXE: Full fetch complete (11494 records). [2025-10-21T18:12:28.229930] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-21T18:12:28.583886] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-21T18:12:28.583961] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-21T18:12:28.584215] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-21T18:12:28.584253] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-21T18:12:28.584681] [DEBUG] [LOCAL ] CXE: Trimmed 11494 records to 6372 (keeping 200 days of data) [2025-10-21T18:12:28.620701] [DEBUG] [LOCAL ] CXE: Primary data saved (6372 records). [2025-10-21T18:12:28.620822] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-21T18:12:28.620899] [INFO ] [MAIN ] Update Progress: 574/2366 symbols completed. CXE took 23.6s. Estimated remaining: 3h 46m 4s. Rate: 7.9 symbols/min [2025-10-21T18:12:28.785126] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:28.814430] [DEBUG] [LOCAL ] CXT: Loaded 30937 existing records from primary storage. [2025-10-21T18:12:28.814737] [INFO ] [MAIN ] CXT: Loaded 30937 existing records. [2025-10-21T18:12:28.958288] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-21T18:12:29.001114] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:29.001308] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-21T18:12:29.001354] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-21T18:12:29.002046] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-21T18:12:29.002104] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-21T18:12:29.382248] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:29.586998] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T18:12:29.751183] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-21T18:12:29.897027] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:12:30.206246] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T18:12:30.551057] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-21T18:12:31.351074] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-21T18:12:32.151061] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-21T18:12:32.329553] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:12:32.614348] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T18:12:32.615235] [INFO ] [REMOTE ] CXH: Full fetch complete (5301 records). [2025-10-21T18:12:32.615301] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-21T18:12:32.922287] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T18:12:32.962078] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-21T18:12:33.002558] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-21T18:12:33.002638] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-21T18:12:33.002840] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-21T18:12:33.002881] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-21T18:12:33.003234] [DEBUG] [LOCAL ] CXH: Trimmed 5301 records to 4418 (keeping 200 days of data) [2025-10-21T18:12:33.028693] [DEBUG] [LOCAL ] CXH: Primary data saved (4418 records). [2025-10-21T18:12:33.028774] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-21T18:12:33.028848] [INFO ] [MAIN ] Update Progress: 575/2366 symbols completed. CXH took 25.7s. Estimated remaining: 3h 45m 46s. Rate: 7.9 symbols/min [2025-10-21T18:12:33.192116] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:33.233668] [DEBUG] [LOCAL ] CXW: Loaded 43775 existing records from primary storage. [2025-10-21T18:12:33.234045] [INFO ] [MAIN ] CXW: Loaded 43775 existing records. [2025-10-21T18:12:33.406124] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:33.406283] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-21T18:12:33.406328] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-21T18:12:33.407045] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-21T18:12:33.407101] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-21T18:12:33.751717] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-21T18:12:33.771740] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:34.315142] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:12:34.551020] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-21T18:12:35.351073] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-21T18:12:35.470243] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:12:35.887894] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T18:12:36.151046] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-21T18:12:36.951028] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-21T18:12:37.014035] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T18:12:37.751043] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-21T18:12:37.967590] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T18:12:38.305533] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T18:12:38.550998] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-21T18:12:39.351010] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-21T18:12:39.382298] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T18:12:40.150999] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-21T18:12:40.250608] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T18:12:40.493381] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:12:40.501914] [INFO ] [REMOTE ] CX: Full fetch complete (76585 records). [2025-10-21T18:12:40.502062] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-21T18:12:40.885206] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-21T18:12:40.885285] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-21T18:12:40.886152] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-21T18:12:40.886281] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-21T18:12:40.887743] [DEBUG] [LOCAL ] CX: Trimmed 76585 records to 52833 (keeping 200 days of data) [2025-10-21T18:12:40.969498] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-21T18:12:41.192202] [DEBUG] [LOCAL ] CX: Primary data saved (52833 records). [2025-10-21T18:12:41.192335] [INFO ] [MAIN ] CX: Full history saved. [2025-10-21T18:12:41.192411] [INFO ] [MAIN ] Update Progress: 576/2366 symbols completed. CX took 41.8s. Estimated remaining: 3h 45m 40s. Rate: 7.9 symbols/min [2025-10-21T18:12:41.364248] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:41.390804] [DEBUG] [LOCAL ] CYD: Loaded 27167 existing records from primary storage. [2025-10-21T18:12:41.391056] [INFO ] [MAIN ] CYD: Loaded 27167 existing records. [2025-10-21T18:12:41.566403] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:41.566618] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-21T18:12:41.566693] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-21T18:12:41.567180] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-21T18:12:41.567236] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-21T18:12:41.756779] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-21T18:12:41.964699] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:41.960460] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T18:12:42.525384] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T18:12:42.550988] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-21T18:12:43.236746] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:12:43.351094] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-21T18:12:44.143110] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:12:44.156331] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T18:12:44.156406] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-21T18:12:44.951039] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-21T18:12:45.512525] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T18:12:45.751006] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-21T18:12:46.068071] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T18:12:46.551031] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-21T18:12:47.351005] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-21T18:12:47.395908] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:12:47.972984] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T18:12:48.151051] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-21T18:12:48.916465] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:12:48.950987] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-21T18:12:49.527883] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T18:12:49.751029] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-21T18:12:50.143690] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T18:12:50.551055] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-21T18:12:51.135049] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T18:12:51.350999] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-21T18:12:52.150994] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-21T18:12:52.189077] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T18:12:52.567377] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T18:12:52.951037] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-21T18:12:53.751009] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-21T18:12:53.818433] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T18:12:54.397790] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:12:54.551027] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-21T18:12:54.972958] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T18:12:55.351007] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-21T18:12:56.164625] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-21T18:12:56.167917] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T18:12:56.734093] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T18:12:56.739101] [INFO ] [REMOTE ] CXT: Full fetch complete (45676 records). [2025-10-21T18:12:56.739190] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-21T18:12:56.963275] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-21T18:12:57.146411] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-21T18:12:57.146493] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-21T18:12:57.147182] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-21T18:12:57.147245] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-21T18:12:57.148209] [DEBUG] [LOCAL ] CXT: Trimmed 45676 records to 30841 (keeping 200 days of data) [2025-10-21T18:12:57.331818] [DEBUG] [LOCAL ] CXT: Primary data saved (30841 records). [2025-10-21T18:12:57.331944] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-21T18:12:57.332698] [INFO ] [MAIN ] Update Progress: 577/2366 symbols completed. CXT took 28.7s. Estimated remaining: 3h 45m 59s. Rate: 7.9 symbols/min [2025-10-21T18:12:57.505676] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:57.549963] [DEBUG] [LOCAL ] CYH: Loaded 47742 existing records from primary storage. [2025-10-21T18:12:57.550278] [INFO ] [MAIN ] CYH: Loaded 47742 existing records. [2025-10-21T18:12:57.727505] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:57.727786] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-21T18:12:57.727857] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-21T18:12:57.728713] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-21T18:12:57.728773] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-21T18:12:57.759774] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-21T18:12:58.100456] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T18:12:58.121380] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:12:58.551048] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-21T18:12:58.676486] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T18:12:58.684318] [INFO ] [REMOTE ] CXM: Full fetch complete (68693 records). [2025-10-21T18:12:58.684493] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-21T18:12:58.868359] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T18:12:59.117355] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-21T18:12:59.117461] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-21T18:12:59.118573] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-21T18:12:59.118638] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-21T18:12:59.120182] [DEBUG] [LOCAL ] CXM: Trimmed 68693 records to 47468 (keeping 200 days of data) [2025-10-21T18:12:59.352215] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-21T18:12:59.378345] [DEBUG] [LOCAL ] CXM: Primary data saved (47468 records). [2025-10-21T18:12:59.378436] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-21T18:12:59.378899] [INFO ] [MAIN ] Update Progress: 578/2366 symbols completed. CXM took 44.5s. Estimated remaining: 3h 45m 35s. Rate: 7.9 symbols/min [2025-10-21T18:12:59.544487] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:12:59.594702] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-21T18:12:59.594998] [INFO ] [MAIN ] D: Loaded 53649 existing records. [2025-10-21T18:12:59.770019] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:12:59.770235] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-21T18:12:59.770281] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-21T18:12:59.770456] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-10-21T18:12:59.770493] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-21T18:13:00.126911] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:00.151373] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-21T18:13:00.153749] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T18:13:00.951062] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-21T18:13:00.953774] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:13:01.751061] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-21T18:13:01.797232] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:13:02.551020] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-21T18:13:02.587289] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:13:02.910977] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T18:13:03.351085] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-21T18:13:04.150993] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-21T18:13:04.271899] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T18:13:04.951101] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-21T18:13:05.078567] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T18:13:05.484704] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T18:13:05.751270] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-21T18:13:06.510561] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:13:06.551121] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-21T18:13:07.350995] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-21T18:13:07.498170] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:13:08.151010] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-21T18:13:08.195671] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T18:13:08.202270] [INFO ] [REMOTE ] CXW: Full fetch complete (64788 records). [2025-10-21T18:13:08.202393] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-21T18:13:08.582632] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-21T18:13:08.582749] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-21T18:13:08.583513] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-21T18:13:08.583555] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-21T18:13:08.584972] [DEBUG] [LOCAL ] CXW: Trimmed 64788 records to 43650 (keeping 200 days of data) [2025-10-21T18:13:08.839587] [DEBUG] [LOCAL ] CXW: Primary data saved (43650 records). [2025-10-21T18:13:08.839756] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-21T18:13:08.839848] [INFO ] [MAIN ] Update Progress: 579/2366 symbols completed. CXW took 35.8s. Estimated remaining: 3h 45m 33s. Rate: 7.9 symbols/min [2025-10-21T18:13:08.956236] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-21T18:13:09.015543] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:09.029688] [DEBUG] [LOCAL ] DAC: Loaded 12590 existing records from primary storage. [2025-10-21T18:13:09.029922] [INFO ] [MAIN ] DAC: Loaded 12590 existing records. [2025-10-21T18:13:09.227523] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:09.227885] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-21T18:13:09.228707] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-21T18:13:09.229031] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-21T18:13:09.229089] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-21T18:13:09.563114] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T18:13:09.696964] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:09.751009] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-21T18:13:09.943428] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T18:13:10.328797] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:13:10.333746] [INFO ] [REMOTE ] CYD: Full fetch complete (35579 records). [2025-10-21T18:13:10.333830] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-21T18:13:10.334392] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:13:10.334488] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:13:10.334549] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:13:10.334618] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-21T18:13:10.334717] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-21T18:13:10.334764] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-21T18:13:10.334940] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-21T18:13:10.335027] [INFO ] [MAIN ] Update Progress: 580/2366 symbols completed. CYD took 29.1s. Estimated remaining: 3h 45m 7s. Rate: 7.9 symbols/min [2025-10-21T18:13:10.521666] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:10.551079] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-21T18:13:10.572947] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-21T18:13:10.573269] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-21T18:13:10.774042] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:10.774456] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-21T18:13:10.774637] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-21T18:13:10.784157] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T18:13:10.788764] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-21T18:13:10.788836] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-21T18:13:11.180014] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:11.351008] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-21T18:13:12.151023] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-21T18:13:12.264004] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:13:12.951051] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-21T18:13:13.060181] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:13:13.140273] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T18:13:13.751048] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-21T18:13:14.551017] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-21T18:13:14.712897] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T18:13:15.351035] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-21T18:13:15.693000] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T18:13:16.150998] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-21T18:13:16.456545] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:13:16.951060] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-21T18:13:17.011881] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:13:17.751027] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-21T18:13:18.153908] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T18:13:18.551030] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-21T18:13:18.969447] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T18:13:19.103635] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T18:13:19.126148] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T18:13:19.351007] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-21T18:13:20.151018] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-21T18:13:20.392883] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T18:13:20.951114] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-21T18:13:21.751067] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-21T18:13:21.822086] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T18:13:21.829789] [INFO ] [REMOTE ] CYH: Full fetch complete (69831 records). [2025-10-21T18:13:21.829938] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-21T18:13:22.218191] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-21T18:13:22.218267] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-21T18:13:22.219092] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-21T18:13:22.219156] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-21T18:13:22.220409] [DEBUG] [LOCAL ] CYH: Trimmed 69831 records to 47712 (keeping 200 days of data) [2025-10-21T18:13:22.475534] [DEBUG] [LOCAL ] CYH: Primary data saved (47712 records). [2025-10-21T18:13:22.475678] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-21T18:13:22.476437] [INFO ] [MAIN ] Update Progress: 581/2366 symbols completed. CYH took 25.1s. Estimated remaining: 3h 45m 13s. Rate: 7.9 symbols/min [2025-10-21T18:13:22.556097] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-21T18:13:22.649369] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:22.693948] [DEBUG] [LOCAL ] DAN: Loaded 49407 existing records from primary storage. [2025-10-21T18:13:22.694246] [INFO ] [MAIN ] DAN: Loaded 49407 existing records. [2025-10-21T18:13:22.868108] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:22.868330] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-21T18:13:22.868390] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-21T18:13:22.868855] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-21T18:13:22.868911] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-21T18:13:23.224639] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:23.350988] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-21T18:13:23.365757] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T18:13:23.465115] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-21T18:13:23.659138] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T18:13:24.151065] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-21T18:13:24.951084] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-21T18:13:25.041977] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T18:13:25.227968] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T18:13:25.751094] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-21T18:13:26.551054] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-21T18:13:26.899627] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:13:27.119998] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T18:13:27.351015] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-21T18:13:27.435557] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T18:13:28.151062] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-21T18:13:28.951033] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-21T18:13:29.643327] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T18:13:29.753213] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-21T18:13:29.758582] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T18:13:30.539864] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T18:13:30.550971] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-21T18:13:30.785329] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T18:13:31.315798] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T18:13:31.350987] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-21T18:13:32.151053] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-21T18:13:32.522960] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T18:13:32.525369] [INFO ] [REMOTE ] DAC: Full fetch complete (19192 records). [2025-10-21T18:13:32.525439] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-21T18:13:32.894735] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-21T18:13:32.894821] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-21T18:13:32.895201] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-21T18:13:32.895239] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-21T18:13:32.895841] [DEBUG] [LOCAL ] DAC: Trimmed 19192 records to 12508 (keeping 200 days of data) [2025-10-21T18:13:32.952685] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-21T18:13:32.975033] [DEBUG] [LOCAL ] DAC: Primary data saved (12508 records). [2025-10-21T18:13:32.975154] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-21T18:13:32.975234] [INFO ] [MAIN ] Update Progress: 582/2366 symbols completed. DAC took 24.1s. Estimated remaining: 3h 45m 15s. Rate: 7.9 symbols/min [2025-10-21T18:13:33.162536] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:33.181506] [DEBUG] [LOCAL ] DAO: Loaded 19694 existing records from primary storage. [2025-10-21T18:13:33.181771] [INFO ] [MAIN ] DAO: Loaded 19694 existing records. [2025-10-21T18:13:33.362907] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:33.363099] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-21T18:13:33.363147] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-21T18:13:33.363577] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-21T18:13:33.363635] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-21T18:13:33.730282] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:33.750974] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-21T18:13:33.912452] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:13:34.551014] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-21T18:13:35.178322] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-21T18:13:35.351008] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-21T18:13:35.487322] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T18:13:35.521573] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T18:13:36.151023] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-21T18:13:36.951059] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-21T18:13:37.252016] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:13:37.260621] [INFO ] [REMOTE ] D: Full fetch complete (77812 records). [2025-10-21T18:13:37.260788] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-21T18:13:37.659330] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-21T18:13:37.659442] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-21T18:13:37.660359] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-21T18:13:37.660453] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-21T18:13:37.661923] [DEBUG] [LOCAL ] D: Trimmed 77812 records to 53649 (keeping 200 days of data) [2025-10-21T18:13:37.777110] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-21T18:13:37.783765] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-21T18:13:38.022923] [DEBUG] [LOCAL ] D: Primary data saved (53649 records). [2025-10-21T18:13:38.023229] [INFO ] [MAIN ] D: Full history saved. [2025-10-21T18:13:38.023739] [INFO ] [MAIN ] Update Progress: 583/2366 symbols completed. D took 38.6s. Estimated remaining: 3h 44m 59s. Rate: 7.9 symbols/min [2025-10-21T18:13:38.192152] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:38.243636] [DEBUG] [LOCAL ] DAR: Loaded 51998 existing records from primary storage. [2025-10-21T18:13:38.244002] [INFO ] [MAIN ] DAR: Loaded 51998 existing records. [2025-10-21T18:13:38.364414] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:13:38.447272] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:38.447490] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-21T18:13:38.447539] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-21T18:13:38.447926] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-21T18:13:38.447983] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-21T18:13:38.556199] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-21T18:13:38.803214] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:39.325595] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:13:39.350998] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-21T18:13:40.151035] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-21T18:13:40.737270] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T18:13:40.950998] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-21T18:13:41.045779] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:13:41.139206] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T18:13:41.751074] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-21T18:13:42.551030] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-21T18:13:43.069078] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T18:13:43.095993] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T18:13:43.351031] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-21T18:13:44.151038] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-21T18:13:44.280794] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:13:44.377859] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T18:13:44.951038] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-21T18:13:45.751082] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-21T18:13:46.018943] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T18:13:46.170671] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T18:13:46.551020] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-21T18:13:47.351031] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-21T18:13:47.464437] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:13:47.542789] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T18:13:48.151079] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-21T18:13:48.813209] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T18:13:48.951015] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-21T18:13:49.011755] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T18:13:49.751066] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-21T18:13:50.551046] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-21T18:13:50.647995] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:13:50.800479] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T18:13:51.351077] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-21T18:13:52.150988] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-21T18:13:52.414469] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:13:52.951069] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-21T18:13:52.980510] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T18:13:52.989280] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-21T18:13:52.989421] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-21T18:13:53.415110] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-21T18:13:53.415232] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-21T18:13:53.416126] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-21T18:13:53.416217] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-21T18:13:53.418819] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T18:13:53.430245] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 53753 (keeping 200 days of data) [2025-10-21T18:13:53.749553] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-21T18:13:53.749693] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-21T18:13:53.749778] [INFO ] [MAIN ] Update Progress: 584/2366 symbols completed. DAL took 43.4s. Estimated remaining: 3h 45m 17s. Rate: 7.9 symbols/min [2025-10-21T18:13:53.760715] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-21T18:13:53.922520] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:53.960598] [DEBUG] [LOCAL ] DAVA: Loaded 41996 existing records from primary storage. [2025-10-21T18:13:53.960940] [INFO ] [MAIN ] DAVA: Loaded 41996 existing records. [2025-10-21T18:13:54.142835] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:13:54.147945] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:54.148212] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-21T18:13:54.151190] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-21T18:13:54.151838] [INFO ] [REMOTE ] DAO: Full fetch complete (32550 records). [2025-10-21T18:13:54.151908] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-21T18:13:54.183562] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-21T18:13:54.215257] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-21T18:13:54.559273] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-21T18:13:54.859798] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-21T18:13:54.874156] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-21T18:13:54.878926] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-21T18:13:54.879007] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-21T18:13:54.878348] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:54.879879] [DEBUG] [LOCAL ] DAO: Trimmed 32550 records to 19753 (keeping 200 days of data) [2025-10-21T18:13:54.985605] [DEBUG] [LOCAL ] DAO: Primary data saved (19753 records). [2025-10-21T18:13:54.985816] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-21T18:13:54.985946] [INFO ] [MAIN ] Update Progress: 585/2366 symbols completed. DAO took 22.0s. Estimated remaining: 3h 44m 50s. Rate: 7.9 symbols/min [2025-10-21T18:13:55.152098] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:55.195619] [DEBUG] [LOCAL ] DAY: Loaded 49167 existing records from primary storage. [2025-10-21T18:13:55.195933] [INFO ] [MAIN ] DAY: Loaded 49167 existing records. [2025-10-21T18:13:55.356483] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-21T18:13:55.378878] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:55.379077] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-21T18:13:55.379131] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-21T18:13:55.379968] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-21T18:13:55.380026] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-21T18:13:55.690079] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T18:13:55.748176] [INFO ] [REMOTE ] DAN: Full fetch complete (71355 records). [2025-10-21T18:13:55.774096] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-21T18:13:55.777209] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:56.154897] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-21T18:13:56.155442] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-10-21T18:13:56.156263] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-10-21T18:13:56.157144] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-10-21T18:13:56.157207] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-10-21T18:13:56.158768] [DEBUG] [LOCAL ] DAN: Trimmed 71355 records to 49394 (keeping 200 days of data) [2025-10-21T18:13:56.451919] [DEBUG] [LOCAL ] DAN: Primary data saved (49394 records). [2025-10-21T18:13:56.452049] [INFO ] [MAIN ] DAN: Full history saved. [2025-10-21T18:13:56.452787] [INFO ] [MAIN ] Update Progress: 586/2366 symbols completed. DAN took 34.0s. Estimated remaining: 3h 44m 24s. Rate: 7.9 symbols/min [2025-10-21T18:13:56.624733] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:13:56.675610] [DEBUG] [LOCAL ] DB: Loaded 52484 existing records from primary storage. [2025-10-21T18:13:56.676020] [INFO ] [MAIN ] DB: Loaded 52484 existing records. [2025-10-21T18:13:56.902854] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:13:56.906623] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-21T18:13:56.904570] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T18:13:56.907249] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-21T18:13:56.924850] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-21T18:13:56.926867] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-21T18:13:56.926950] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-21T18:13:56.958769] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-21T18:13:57.292924] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:13:57.690074] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:13:57.750988] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-21T18:13:58.556150] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-21T18:13:58.576783] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T18:13:58.731210] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:13:59.351043] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-21T18:14:00.151052] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-21T18:14:00.362387] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:14:00.951065] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-21T18:14:01.440375] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:14:01.473150] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T18:14:01.751062] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-21T18:14:02.541999] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:14:02.552591] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-21T18:14:03.351063] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-21T18:14:03.461152] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:14:04.097328] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:14:04.150988] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-21T18:14:04.951042] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-21T18:14:05.025757] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:14:05.557574] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:14:05.750999] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-21T18:14:06.551012] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-21T18:14:06.604419] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:14:07.351014] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-21T18:14:07.579901] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:14:08.151002] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-21T18:14:08.407911] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:14:08.951017] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-21T18:14:09.264750] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T18:14:09.589131] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:14:09.751021] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-21T18:14:10.551065] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-21T18:14:11.245443] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:14:11.293081] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-21T18:14:11.351017] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-21T18:14:11.636287] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T18:14:12.151060] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-21T18:14:12.951072] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-21T18:14:13.417234] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T18:14:13.750999] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-21T18:14:14.121005] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T18:14:14.129059] [INFO ] [REMOTE ] DAR: Full fetch complete (75059 records). [2025-10-21T18:14:14.129188] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-21T18:14:14.528215] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T18:14:14.555569] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-21T18:14:14.551705] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-21T18:14:14.562041] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-21T18:14:14.564010] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-21T18:14:14.564763] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-21T18:14:14.567098] [DEBUG] [LOCAL ] DAR: Trimmed 75059 records to 52006 (keeping 200 days of data) [2025-10-21T18:14:14.864865] [DEBUG] [LOCAL ] DAR: Primary data saved (52006 records). [2025-10-21T18:14:14.865000] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-21T18:14:14.865359] [INFO ] [MAIN ] Update Progress: 587/2366 symbols completed. DAR took 36.8s. Estimated remaining: 3h 44m 49s. Rate: 7.9 symbols/min [2025-10-21T18:14:15.032763] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:15.032945] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-21T18:14:15.032981] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-21T18:14:15.033083] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-21T18:14:15.033123] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-21T18:14:15.033165] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-21T18:14:15.033198] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-21T18:14:15.358897] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-21T18:14:15.398725] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:15.678120] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T18:14:16.151000] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-21T18:14:16.563512] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T18:14:16.950983] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-21T18:14:17.227514] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T18:14:17.750997] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-21T18:14:17.955970] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T18:14:18.551021] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-21T18:14:18.782172] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T18:14:19.350987] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-21T18:14:19.367426] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T18:14:19.689468] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:14:19.700259] [INFO ] [REMOTE ] DAVA: Full fetch complete (57217 records). [2025-10-21T18:14:19.700626] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-21T18:14:20.106554] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-21T18:14:20.106627] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-21T18:14:20.107406] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-21T18:14:20.107459] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-21T18:14:20.108598] [DEBUG] [LOCAL ] DAVA: Trimmed 57217 records to 41991 (keeping 200 days of data) [2025-10-21T18:14:20.155943] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-21T18:14:20.347058] [DEBUG] [LOCAL ] DAVA: Primary data saved (41991 records). [2025-10-21T18:14:20.347174] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-21T18:14:20.347246] [INFO ] [MAIN ] Update Progress: 588/2366 symbols completed. DAVA took 26.6s. Estimated remaining: 3h 44m 35s. Rate: 7.9 symbols/min [2025-10-21T18:14:20.516780] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:20.554768] [DEBUG] [LOCAL ] DBI: Loaded 43623 existing records from primary storage. [2025-10-21T18:14:20.555043] [INFO ] [MAIN ] DBI: Loaded 43623 existing records. [2025-10-21T18:14:20.733744] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:14:20.733963] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-21T18:14:20.734009] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-21T18:14:20.734465] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-21T18:14:20.734521] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-21T18:14:20.964798] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-21T18:14:21.110282] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:21.243174] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T18:14:21.750992] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-21T18:14:22.046764] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T18:14:22.269673] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T18:14:22.551079] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-21T18:14:23.351057] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-21T18:14:23.558365] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T18:14:23.566791] [INFO ] [REMOTE ] DAY: Full fetch complete (71797 records). [2025-10-21T18:14:23.566972] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-21T18:14:24.005991] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-21T18:14:24.006067] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-21T18:14:24.006895] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-21T18:14:24.006958] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-21T18:14:24.008245] [DEBUG] [LOCAL ] DAY: Trimmed 71797 records to 49140 (keeping 200 days of data) [2025-10-21T18:14:24.169695] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-21T18:14:24.236331] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T18:14:24.296323] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:14:24.369396] [DEBUG] [LOCAL ] DAY: Primary data saved (49140 records). [2025-10-21T18:14:24.369635] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-21T18:14:24.370560] [INFO ] [MAIN ] Update Progress: 589/2366 symbols completed. DAY took 29.4s. Estimated remaining: 3h 44m 17s. Rate: 7.9 symbols/min [2025-10-21T18:14:24.553522] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:24.553802] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-21T18:14:24.553916] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-21T18:14:24.554014] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-21T18:14:24.554055] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-21T18:14:24.554096] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-21T18:14:24.554131] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-21T18:14:24.919680] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:24.951073] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-21T18:14:25.751020] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-21T18:14:25.818471] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:14:25.889045] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T18:14:26.551084] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-21T18:14:27.351023] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-21T18:14:27.700127] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T18:14:27.737964] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T18:14:28.151006] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-21T18:14:28.364869] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:14:28.951028] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-21T18:14:29.750999] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-21T18:14:29.912633] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T18:14:29.920913] [INFO ] [REMOTE ] DB: Full fetch complete (75576 records). [2025-10-21T18:14:29.921051] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-21T18:14:30.323354] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-21T18:14:30.323504] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-21T18:14:30.324408] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-21T18:14:30.324490] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-21T18:14:30.326005] [DEBUG] [LOCAL ] DB: Trimmed 75576 records to 52474 (keeping 200 days of data) [2025-10-21T18:14:30.558243] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-21T18:14:30.574800] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:14:30.672519] [DEBUG] [LOCAL ] DB: Primary data saved (52474 records). [2025-10-21T18:14:30.672664] [INFO ] [MAIN ] DB: Full history saved. [2025-10-21T18:14:30.673592] [INFO ] [MAIN ] Update Progress: 590/2366 symbols completed. DB took 34.2s. Estimated remaining: 3h 44m 5s. Rate: 7.9 symbols/min [2025-10-21T18:14:30.851870] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:30.867981] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T18:14:30.914906] [DEBUG] [LOCAL ] DBRG: Loaded 49985 existing records from primary storage. [2025-10-21T18:14:30.915198] [INFO ] [MAIN ] DBRG: Loaded 49985 existing records. [2025-10-21T18:14:31.096037] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:14:31.096750] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-21T18:14:31.096801] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-21T18:14:31.097582] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-21T18:14:31.097639] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-21T18:14:31.356014] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-21T18:14:31.456378] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T18:14:31.489261] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:32.151076] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-21T18:14:32.687032] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:14:32.951033] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-21T18:14:33.578832] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:14:33.751011] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-21T18:14:33.918487] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T18:14:34.551085] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-21T18:14:35.215152] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T18:14:35.351003] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-21T18:14:35.617408] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T18:14:36.151092] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-21T18:14:36.951008] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-21T18:14:37.027198] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T18:14:37.428725] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T18:14:37.756523] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-21T18:14:37.762254] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T18:14:38.550996] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-21T18:14:38.916006] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T18:14:39.351055] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-21T18:14:40.119121] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:14:40.150978] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-21T18:14:40.494561] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T18:14:40.951013] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-21T18:14:41.751058] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-21T18:14:41.924847] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T18:14:41.963147] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:14:42.551028] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-21T18:14:43.104231] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T18:14:43.351074] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-21T18:14:43.448674] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:14:43.452786] [INFO ] [REMOTE ] DBD: Full fetch complete (31771 records). [2025-10-21T18:14:43.452936] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-21T18:14:43.453489] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:14:43.453620] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:14:43.453707] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:14:43.453782] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-21T18:14:43.453847] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-21T18:14:43.453882] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-21T18:14:43.453977] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-21T18:14:43.454041] [INFO ] [MAIN ] Update Progress: 591/2366 symbols completed. DBD took 28.6s. Estimated remaining: 3h 44m 13s. Rate: 7.9 symbols/min [2025-10-21T18:14:43.633418] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:43.633605] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-21T18:14:43.633689] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-21T18:14:43.633822] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-21T18:14:43.633865] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-21T18:14:43.633907] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-21T18:14:43.633940] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-21T18:14:44.004237] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:44.151008] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-21T18:14:44.951043] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-21T18:14:45.751068] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-21T18:14:45.785619] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-21T18:14:46.393436] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T18:14:46.551022] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-21T18:14:46.654209] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T18:14:47.237449] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (3.09 seconds). [2025-10-21T18:14:47.351005] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-21T18:14:48.029336] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T18:14:48.151011] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-21T18:14:48.691716] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:14:48.951052] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-21T18:14:49.595514] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T18:14:49.751006] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-21T18:14:49.776275] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T18:14:50.551018] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-21T18:14:51.151043] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T18:14:51.282957] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:14:51.288885] [INFO ] [REMOTE ] DBI: Full fetch complete (64850 records). [2025-10-21T18:14:51.288989] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-21T18:14:51.356209] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-21T18:14:51.677398] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-21T18:14:51.677476] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-21T18:14:51.678354] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-21T18:14:51.678417] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-21T18:14:51.679591] [DEBUG] [LOCAL ] DBI: Trimmed 64850 records to 43510 (keeping 200 days of data) [2025-10-21T18:14:51.925835] [DEBUG] [LOCAL ] DBI: Primary data saved (43510 records). [2025-10-21T18:14:51.925963] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-21T18:14:51.926040] [INFO ] [MAIN ] Update Progress: 592/2366 symbols completed. DBI took 31.6s. Estimated remaining: 3h 44m 8s. Rate: 7.9 symbols/min [2025-10-21T18:14:52.092400] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:52.108230] [DEBUG] [LOCAL ] DCO: Loaded 14765 existing records from primary storage. [2025-10-21T18:14:52.108454] [INFO ] [MAIN ] DCO: Loaded 14765 existing records. [2025-10-21T18:14:52.163005] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-21T18:14:52.285991] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:14:52.286230] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-21T18:14:52.286277] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-21T18:14:52.286505] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-21T18:14:52.286562] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-21T18:14:52.672027] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:52.910999] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T18:14:52.951008] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-21T18:14:53.033267] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T18:14:53.751082] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-21T18:14:54.515981] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T18:14:54.550984] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-21T18:14:54.706676] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:14:55.351024] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-21T18:14:55.446375] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T18:14:56.151029] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-21T18:14:56.185046] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T18:14:56.186736] [INFO ] [REMOTE ] DBL: Full fetch complete (12672 records). [2025-10-21T18:14:56.186805] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-21T18:14:56.553491] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-21T18:14:56.553568] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-21T18:14:56.553894] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-21T18:14:56.553959] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-21T18:14:56.554439] [DEBUG] [LOCAL ] DBL: Trimmed 12672 records to 9364 (keeping 200 days of data) [2025-10-21T18:14:56.612518] [DEBUG] [LOCAL ] DBL: Primary data saved (9364 records). [2025-10-21T18:14:56.612666] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-21T18:14:56.612755] [INFO ] [MAIN ] Update Progress: 593/2366 symbols completed. DBL took 32.2s. Estimated remaining: 3h 43m 52s. Rate: 7.9 symbols/min [2025-10-21T18:14:56.785764] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:14:56.836426] [DEBUG] [LOCAL ] DD: Loaded 52934 existing records from primary storage. [2025-10-21T18:14:56.836759] [INFO ] [MAIN ] DD: Loaded 52934 existing records. [2025-10-21T18:14:56.956121] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-21T18:14:57.021230] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:14:57.021492] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-21T18:14:57.021540] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-21T18:14:57.022422] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-21T18:14:57.022481] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-21T18:14:57.378506] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:14:57.756088] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-21T18:14:57.772095] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T18:14:57.805051] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T18:14:58.551030] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-21T18:14:59.350992] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-21T18:14:59.601434] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T18:15:00.151067] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-21T18:15:00.336588] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T18:15:00.842224] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T18:15:00.951026] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-21T18:15:01.201145] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T18:15:01.751029] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-21T18:15:02.551049] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-21T18:15:02.794664] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T18:15:03.351165] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-21T18:15:03.368924] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T18:15:03.821974] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-21T18:15:04.151084] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-21T18:15:04.958434] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-21T18:15:04.980227] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:15:05.751019] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-21T18:15:06.034060] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T18:15:06.550994] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-21T18:15:06.738830] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:15:06.966809] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T18:15:07.351018] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-21T18:15:08.151009] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-21T18:15:08.545350] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T18:15:08.820568] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T18:15:08.829249] [INFO ] [REMOTE ] DBRG: Full fetch complete (72531 records). [2025-10-21T18:15:08.829386] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-21T18:15:08.956131] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-21T18:15:09.280874] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T18:15:09.280044] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-21T18:15:09.285296] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-21T18:15:09.286915] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-21T18:15:09.287012] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-21T18:15:09.288832] [DEBUG] [LOCAL ] DBRG: Trimmed 72531 records to 49982 (keeping 200 days of data) [2025-10-21T18:15:09.723428] [DEBUG] [LOCAL ] DBRG: Primary data saved (49982 records). [2025-10-21T18:15:09.723599] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-21T18:15:09.724420] [INFO ] [MAIN ] Update Progress: 594/2366 symbols completed. DBRG took 39.1s. Estimated remaining: 3h 44m 1s. Rate: 7.9 symbols/min [2025-10-21T18:15:09.762234] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-21T18:15:09.984267] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:10.055769] [DEBUG] [LOCAL ] DDD: Loaded 50939 existing records from primary storage. [2025-10-21T18:15:10.056251] [INFO ] [MAIN ] DDD: Loaded 50939 existing records. [2025-10-21T18:15:10.259779] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:15:10.260061] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-21T18:15:10.260125] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-21T18:15:10.260985] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-21T18:15:10.261063] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-21T18:15:10.551007] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-21T18:15:10.662725] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:10.852837] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T18:15:10.890878] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T18:15:11.351061] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-21T18:15:12.151065] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-21T18:15:12.194053] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:15:12.951023] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-21T18:15:13.036029] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:15:13.162285] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:15:13.751052] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-21T18:15:14.550988] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-21T18:15:14.741945] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:15:15.351000] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-21T18:15:15.815042] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T18:15:16.124689] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T18:15:16.150991] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-21T18:15:16.419106] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T18:15:16.422348] [INFO ] [REMOTE ] DCO: Full fetch complete (19637 records). [2025-10-21T18:15:16.422419] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-21T18:15:16.774261] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-21T18:15:16.774336] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-21T18:15:16.774749] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-21T18:15:16.774808] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-21T18:15:16.775415] [DEBUG] [LOCAL ] DCO: Trimmed 19637 records to 14899 (keeping 200 days of data) [2025-10-21T18:15:16.859139] [DEBUG] [LOCAL ] DCO: Primary data saved (14899 records). [2025-10-21T18:15:16.859267] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-21T18:15:16.859340] [INFO ] [MAIN ] Update Progress: 595/2366 symbols completed. DCO took 24.9s. Estimated remaining: 3h 43m 52s. Rate: 7.9 symbols/min [2025-10-21T18:15:16.956471] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-21T18:15:17.028371] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:17.061073] [DEBUG] [LOCAL ] DDL: Loaded 37211 existing records from primary storage. [2025-10-21T18:15:17.061335] [INFO ] [MAIN ] DDL: Loaded 37211 existing records. [2025-10-21T18:15:17.237895] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:15:17.238135] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-21T18:15:17.238201] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-21T18:15:17.238709] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-21T18:15:17.238766] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-21T18:15:17.588816] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:17.753013] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-21T18:15:17.756133] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T18:15:18.551058] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-21T18:15:18.899272] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T18:15:19.321773] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T18:15:19.350990] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-21T18:15:19.707349] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T18:15:19.712840] [INFO ] [REMOTE ] DCI: Full fetch complete (53640 records). [2025-10-21T18:15:19.712954] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-21T18:15:20.106745] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-21T18:15:20.106842] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-21T18:15:20.107685] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-21T18:15:20.107765] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-21T18:15:20.109230] [DEBUG] [LOCAL ] DCI: Trimmed 53640 records to 36912 (keeping 200 days of data) [2025-10-21T18:15:20.166959] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-21T18:15:20.332250] [DEBUG] [LOCAL ] DCI: Primary data saved (36912 records). [2025-10-21T18:15:20.332376] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-21T18:15:20.332444] [INFO ] [MAIN ] Update Progress: 596/2366 symbols completed. DCI took 36.9s. Estimated remaining: 3h 43m 32s. Rate: 7.9 symbols/min [2025-10-21T18:15:20.503257] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:20.503437] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-21T18:15:20.503492] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-21T18:15:20.503602] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-21T18:15:20.503678] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-21T18:15:20.503761] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-21T18:15:20.503801] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-21T18:15:20.858865] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:20.951015] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-21T18:15:21.169785] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:15:21.751036] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-21T18:15:22.097104] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T18:15:22.379838] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T18:15:22.551046] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-21T18:15:23.295379] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:15:23.351001] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-21T18:15:23.463862] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T18:15:24.151060] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-21T18:15:24.858813] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:15:24.951083] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-21T18:15:25.560164] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:15:25.751072] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-21T18:15:25.876777] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T18:15:25.885151] [INFO ] [REMOTE ] DD: Full fetch complete (76621 records). [2025-10-21T18:15:25.885293] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-21T18:15:26.284944] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-21T18:15:26.285036] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-21T18:15:26.286036] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-21T18:15:26.286106] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-21T18:15:26.287589] [DEBUG] [LOCAL ] DD: Trimmed 76621 records to 52933 (keeping 200 days of data) [2025-10-21T18:15:26.551113] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-21T18:15:26.632795] [DEBUG] [LOCAL ] DD: Primary data saved (52933 records). [2025-10-21T18:15:26.632985] [INFO ] [MAIN ] DD: Full history saved. [2025-10-21T18:15:26.633838] [INFO ] [MAIN ] Update Progress: 597/2366 symbols completed. DD took 30.0s. Estimated remaining: 3h 43m 21s. Rate: 7.9 symbols/min [2025-10-21T18:15:26.811304] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T18:15:27.351101] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-21T18:15:28.158693] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-21T18:15:28.174119] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:15:28.193051] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T18:15:28.951027] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-21T18:15:29.733508] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T18:15:29.750990] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-21T18:15:29.829061] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T18:15:30.551023] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-21T18:15:31.351003] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-21T18:15:31.384956] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T18:15:31.559877] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T18:15:32.151042] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-21T18:15:32.951032] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-21T18:15:33.037442] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T18:15:33.751063] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-21T18:15:33.807982] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T18:15:34.104142] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:15:34.551118] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-21T18:15:35.351011] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-21T18:15:35.411922] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T18:15:36.053529] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T18:15:36.151038] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-21T18:15:36.385792] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T18:15:36.802313] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T18:15:36.951109] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-21T18:15:37.751027] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-21T18:15:37.849608] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:15:37.851390] [INFO ] [REMOTE ] DDS: Full fetch complete (18508 records). [2025-10-21T18:15:37.851463] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-21T18:15:38.236788] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-21T18:15:38.236887] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-21T18:15:38.237288] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-21T18:15:38.237327] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-21T18:15:38.237877] [DEBUG] [LOCAL ] DDS: Trimmed 18508 records to 12448 (keeping 200 days of data) [2025-10-21T18:15:38.312984] [DEBUG] [LOCAL ] DDS: Primary data saved (12448 records). [2025-10-21T18:15:38.313110] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-21T18:15:38.313178] [INFO ] [MAIN ] Update Progress: 598/2366 symbols completed. DDS took 18.0s. Estimated remaining: 3h 43m 26s. Rate: 7.9 symbols/min [2025-10-21T18:15:38.551045] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-21T18:15:39.660665] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T18:15:39.687443] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-21T18:15:39.689473] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T18:15:40.151024] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-21T18:15:41.399444] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T18:15:41.407311] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-21T18:15:41.862571] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T18:15:41.870619] [INFO ] [REMOTE ] DDD: Full fetch complete (73946 records). [2025-10-21T18:15:41.870776] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-21T18:15:42.259408] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-21T18:15:42.259489] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-21T18:15:42.260351] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-21T18:15:42.260412] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-21T18:15:42.261803] [DEBUG] [LOCAL ] DDD: Trimmed 73946 records to 50947 (keeping 200 days of data) [2025-10-21T18:15:42.551261] [DEBUG] [LOCAL ] DDD: Primary data saved (50947 records). [2025-10-21T18:15:42.551424] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-21T18:15:42.552173] [INFO ] [MAIN ] Update Progress: 599/2366 symbols completed. DDD took 32.8s. Estimated remaining: 3h 43m 8s. Rate: 7.9 symbols/min [2025-10-21T18:15:42.652698] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T18:15:42.659477] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-21T18:15:44.215227] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:15:44.224377] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-21T18:15:45.908405] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T18:15:45.915604] [INFO ] [REMOTE ] DDL: Full fetch complete (53636 records). [2025-10-21T18:15:45.915747] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-21T18:15:46.342717] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-21T18:15:46.342837] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-21T18:15:46.343813] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-21T18:15:46.343881] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-21T18:15:46.345547] [DEBUG] [LOCAL ] DDL: Trimmed 53636 records to 37279 (keeping 200 days of data) [2025-10-21T18:15:46.584359] [DEBUG] [LOCAL ] DDL: Primary data saved (37279 records). [2025-10-21T18:15:46.584635] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-21T18:15:46.584816] [INFO ] [MAIN ] Update Progress: 600/2366 symbols completed. DDL took 29.7s. Estimated remaining: 3h 42m 50s. Rate: 7.9 symbols/min [2025-10-21T18:15:47.220024] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:47.250620] [DEBUG] [LOCAL ] DE: No existing data file found in primary storage. [2025-10-21T18:15:47.276107] [WARN ] [MAIN ] DE: No existing data found, performing full refresh instead. [2025-10-21T18:15:47.276287] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-21T18:15:47.276338] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-21T18:15:47.276384] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-10-21T18:15:47.276425] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-21T18:15:47.337136] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:47.372281] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:47.391199] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:15:47.391541] [DEBUG] [LOCAL ] DEC: No existing data file found in primary storage. [2025-10-21T18:15:47.391449] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-21T18:15:47.401340] [WARN ] [MAIN ] DEC: No existing data found, performing full refresh instead. [2025-10-21T18:15:47.411365] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-21T18:15:47.411244] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-21T18:15:47.438276] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-21T18:15:47.438669] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-21T18:15:47.455217] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-21T18:15:47.453935] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-21T18:15:47.485213] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-21T18:15:47.485360] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-21T18:15:47.474559] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-21T18:15:47.479953] [DEBUG] [LOCAL ] DDT: Loaded 1978 existing records from primary storage. [2025-10-21T18:15:47.590400] [INFO ] [MAIN ] DDT: Loaded 1978 existing records. [2025-10-21T18:15:48.524388] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:48.527212] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:15:48.582416] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-21T18:15:48.666105] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-21T18:15:48.646749] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:48.706289] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:48.706569] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-21T18:15:48.707637] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-21T18:15:48.707577] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-21T18:15:48.708405] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-21T18:15:48.708475] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-21T18:15:49.082233] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:15:49.082634] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-21T18:15:49.557616] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-21T18:15:49.558913] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-21T18:15:49.925409] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T18:15:49.930754] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-21T18:15:50.010496] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T18:15:50.011692] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-21T18:15:50.500187] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T18:15:50.501385] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-21T18:15:50.532328] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T18:15:50.541500] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-21T18:15:50.573867] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T18:15:50.583433] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-21T18:15:50.937126] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T18:15:51.128562] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-21T18:15:51.351026] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-21T18:15:51.845872] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T18:15:52.151017] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-21T18:15:52.183631] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:15:52.492599] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T18:15:52.951050] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-21T18:15:53.471561] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T18:15:53.632762] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T18:15:53.751042] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-21T18:15:54.551074] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-21T18:15:55.070273] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-21T18:15:55.351051] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-21T18:15:55.490887] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:15:56.151044] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-21T18:15:56.762407] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T18:15:56.951024] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-21T18:15:57.322147] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T18:15:57.751018] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-21T18:15:58.551005] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-21T18:15:58.687883] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T18:15:59.098195] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T18:15:59.350993] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-21T18:16:00.151020] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-21T18:16:00.258684] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T18:16:00.367600] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T18:16:00.562542] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-21T18:16:00.951046] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-21T18:16:01.463365] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T18:16:01.464530] [INFO ] [REMOTE ] DDT: Full fetch complete (2812 records). [2025-10-21T18:16:01.464620] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-21T18:16:01.465135] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:01.465232] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:01.465288] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:01.465368] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-21T18:16:01.465447] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-21T18:16:01.465496] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-21T18:16:01.465704] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-10-21T18:16:01.465818] [INFO ] [MAIN ] Update Progress: 601/2366 symbols completed. DDT took 14.9s. Estimated remaining: 3h 43m 4s. Rate: 7.9 symbols/min [2025-10-21T18:16:01.697330] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:01.697494] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-21T18:16:01.697530] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-21T18:16:01.697636] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-21T18:16:01.697713] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-21T18:16:01.697760] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-21T18:16:01.697792] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-21T18:16:01.757611] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-21T18:16:02.158410] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:02.551115] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-21T18:16:03.351074] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-21T18:16:03.547320] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T18:16:04.151100] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-21T18:16:04.677015] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T18:16:04.951017] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-21T18:16:05.357402] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-21T18:16:05.550301] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T18:16:05.751039] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-21T18:16:06.551020] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-21T18:16:06.813384] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:16:07.351021] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-21T18:16:07.836968] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-21T18:16:07.992362] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:16:08.151056] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-21T18:16:08.914528] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T18:16:08.950995] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-21T18:16:09.719318] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:16:09.750991] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-21T18:16:10.551050] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-21T18:16:10.846490] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T18:16:10.900536] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T18:16:11.351054] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-21T18:16:11.876684] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:16:12.151049] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-21T18:16:12.951079] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-21T18:16:13.219551] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T18:16:13.751033] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-21T18:16:13.843177] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T18:16:14.315297] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-21T18:16:14.551006] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-21T18:16:14.630631] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:16:14.639723] [INFO ] [REMOTE ] DE: Full fetch complete (69854 records). [2025-10-21T18:16:14.640010] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-21T18:16:15.081806] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-21T18:16:15.081934] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-21T18:16:15.083266] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-21T18:16:15.083339] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-21T18:16:15.085307] [DEBUG] [LOCAL ] DE: Trimmed 69854 records to 47547 (keeping 200 days of data) [2025-10-21T18:16:15.351481] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-21T18:16:15.412257] [DEBUG] [LOCAL ] DE: Primary data saved (47547 records). [2025-10-21T18:16:15.412448] [INFO ] [MAIN ] DE: Full history saved. [2025-10-21T18:16:15.412538] [INFO ] [MAIN ] Update Progress: 602/2366 symbols completed. DE took 28.8s. Estimated remaining: 3h 43m 15s. Rate: 7.9 symbols/min [2025-10-21T18:16:15.590320] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:15.641609] [DEBUG] [LOCAL ] DEI: Loaded 48313 existing records from primary storage. [2025-10-21T18:16:15.642040] [INFO ] [MAIN ] DEI: Loaded 48313 existing records. [2025-10-21T18:16:15.833586] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:15.833907] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-21T18:16:15.834077] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-21T18:16:15.834538] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-21T18:16:15.834604] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-21T18:16:16.120174] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:16:16.160364] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-21T18:16:16.247982] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:16.951055] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-21T18:16:16.984620] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T18:16:17.751025] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-21T18:16:18.299566] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T18:16:18.376502] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:16:18.381633] [INFO ] [REMOTE ] DEC: Full fetch complete (44273 records). [2025-10-21T18:16:18.381771] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-21T18:16:18.382392] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:18.382473] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:18.382516] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:18.382580] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-21T18:16:18.382665] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-21T18:16:18.382723] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-10-21T18:16:18.382768] [DEBUG] [LOCAL ] DEC: No derivative data file found to delete. [2025-10-21T18:16:18.382825] [INFO ] [MAIN ] Update Progress: 603/2366 symbols completed. DEC took 31.8s. Estimated remaining: 3h 42m 54s. Rate: 7.9 symbols/min [2025-10-21T18:16:18.556437] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-21T18:16:18.559842] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:18.612984] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-21T18:16:18.613310] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-21T18:16:18.799297] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:18.799488] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-21T18:16:18.799534] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-21T18:16:18.799771] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-21T18:16:18.799826] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-21T18:16:19.159895] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:19.350998] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-21T18:16:19.452141] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:16:20.151023] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-21T18:16:20.730462] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-21T18:16:20.951098] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-21T18:16:21.254696] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:16:21.260635] [INFO ] [REMOTE ] DEA: Full fetch complete (61504 records). [2025-10-21T18:16:21.260765] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-21T18:16:21.261421] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:21.261506] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:21.261547] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:21.261612] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-21T18:16:21.261710] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-21T18:16:21.261763] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-21T18:16:21.261856] [DEBUG] [LOCAL ] DEA: No derivative data file found to delete. [2025-10-21T18:16:21.261926] [INFO ] [MAIN ] Update Progress: 604/2366 symbols completed. DEA took 34.7s. Estimated remaining: 3h 42m 33s. Rate: 7.9 symbols/min [2025-10-21T18:16:21.436682] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:21.486187] [DEBUG] [LOCAL ] DEO: Loaded 49256 existing records from primary storage. [2025-10-21T18:16:21.486553] [INFO ] [MAIN ] DEO: Loaded 49256 existing records. [2025-10-21T18:16:21.683909] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:21.684209] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-21T18:16:21.684300] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-21T18:16:21.684714] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-21T18:16:21.684773] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-21T18:16:21.756133] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-21T18:16:22.097612] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-10-21T18:16:22.103042] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:22.551053] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-21T18:16:22.952486] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T18:16:23.351712] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-21T18:16:23.351606] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:16:24.151084] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-21T18:16:24.910157] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:16:24.951614] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-21T18:16:24.951537] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-21T18:16:25.751060] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-21T18:16:25.866633] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:16:26.551009] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-21T18:16:26.786306] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T18:16:27.351076] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-21T18:16:27.988519] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T18:16:28.035101] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T18:16:28.151035] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-21T18:16:28.936321] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:16:28.951002] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-21T18:16:29.476399] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T18:16:29.751026] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-21T18:16:30.551043] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-21T18:16:31.345333] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-21T18:16:31.356486] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-21T18:16:31.601008] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T18:16:32.151020] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-21T18:16:32.205367] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:16:32.951035] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-21T18:16:33.277105] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T18:16:33.751023] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-21T18:16:34.551010] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-21T18:16:34.717635] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-21T18:16:34.777407] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T18:16:35.351028] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-21T18:16:35.934413] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T18:16:36.151114] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-21T18:16:36.505766] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T18:16:36.951058] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-21T18:16:37.762572] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-21T18:16:37.802036] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-10-21T18:16:37.826973] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:16:38.551068] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-21T18:16:39.219238] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-21T18:16:39.227404] [INFO ] [REMOTE ] DECK: Full fetch complete (76759 records). [2025-10-21T18:16:39.227576] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-21T18:16:39.228520] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:39.228711] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:39.228765] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:39.228833] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-21T18:16:39.228911] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-21T18:16:39.228949] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-10-21T18:16:39.228990] [DEBUG] [LOCAL ] DECK: No derivative data file found to delete. [2025-10-21T18:16:39.229050] [INFO ] [MAIN ] Update Progress: 605/2366 symbols completed. DECK took 37.8s. Estimated remaining: 3h 42m 55s. Rate: 7.9 symbols/min [2025-10-21T18:16:39.364473] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-21T18:16:39.429915] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:39.430285] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-10-21T18:16:39.430465] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-10-21T18:16:39.430597] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-21T18:16:39.430821] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-21T18:16:39.430951] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-10-21T18:16:39.431056] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-21T18:16:39.563173] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T18:16:39.831415] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:40.151028] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-21T18:16:40.349893] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T18:16:40.951040] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-21T18:16:41.461097] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T18:16:41.524963] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:16:41.751046] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-21T18:16:42.551027] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-21T18:16:43.104420] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:16:43.226314] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-21T18:16:43.351029] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-21T18:16:44.151026] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-21T18:16:44.187245] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:16:44.951088] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-21T18:16:45.751014] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-21T18:16:45.822123] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-21T18:16:46.220783] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T18:16:46.292972] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T18:16:46.300682] [INFO ] [REMOTE ] DEI: Full fetch complete (69925 records). [2025-10-21T18:16:46.300795] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-21T18:16:46.559740] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-21T18:16:46.727927] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-21T18:16:46.728084] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-21T18:16:46.729166] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-21T18:16:46.729237] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-21T18:16:46.731239] [DEBUG] [LOCAL ] DEI: Trimmed 69925 records to 48305 (keeping 200 days of data) [2025-10-21T18:16:47.073375] [DEBUG] [LOCAL ] DEI: Primary data saved (48305 records). [2025-10-21T18:16:47.073590] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-21T18:16:47.074145] [INFO ] [MAIN ] Update Progress: 606/2366 symbols completed. DEI took 31.7s. Estimated remaining: 3h 42m 49s. Rate: 7.9 symbols/min [2025-10-21T18:16:47.273330] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:47.273844] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-10-21T18:16:47.282119] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-10-21T18:16:47.294415] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-21T18:16:47.294782] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-21T18:16:47.295297] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-21T18:16:47.296269] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T18:16:47.296543] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-21T18:16:47.356152] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-21T18:16:47.686147] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:48.151066] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-21T18:16:48.939742] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T18:16:48.950988] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-21T18:16:49.013794] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-21T18:16:49.141738] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T18:16:49.751001] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-21T18:16:50.227386] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T18:16:50.551028] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-21T18:16:51.351076] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-21T18:16:52.151060] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-21T18:16:52.181422] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T18:16:52.219886] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.47 seconds). [2025-10-21T18:16:52.227630] [INFO ] [REMOTE ] DELL: Full fetch complete (77525 records). [2025-10-21T18:16:52.227803] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-21T18:16:52.228625] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:52.228725] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:52.228767] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:52.228834] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-21T18:16:52.228899] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-21T18:16:52.228932] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-10-21T18:16:52.229124] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-10-21T18:16:52.229213] [INFO ] [MAIN ] Update Progress: 607/2366 symbols completed. DELL took 33.8s. Estimated remaining: 3h 42m 34s. Rate: 7.9 symbols/min [2025-10-21T18:16:52.397092] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:52.408991] [DEBUG] [LOCAL ] DFP: Loaded 11121 existing records from primary storage. [2025-10-21T18:16:52.409181] [INFO ] [MAIN ] DFP: Loaded 11121 existing records. [2025-10-21T18:16:52.585921] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:52.586177] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-21T18:16:52.586230] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-21T18:16:52.586580] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-21T18:16:52.586637] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-21T18:16:52.910071] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:16:52.965255] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-21T18:16:52.988437] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:53.230274] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T18:16:53.751044] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-21T18:16:54.551023] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-21T18:16:54.955095] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:16:54.962866] [INFO ] [REMOTE ] DEO: Full fetch complete (71387 records). [2025-10-21T18:16:54.963015] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-21T18:16:54.963891] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:16:54.963984] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:16:54.964027] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:16:54.964089] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-21T18:16:54.964145] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-21T18:16:54.964180] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-21T18:16:54.964313] [DEBUG] [LOCAL ] DEO: Deleted derivative data file. [2025-10-21T18:16:54.964970] [INFO ] [MAIN ] Update Progress: 608/2366 symbols completed. DEO took 33.7s. Estimated remaining: 3h 42m 12s. Rate: 7.9 symbols/min [2025-10-21T18:16:55.159842] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:16:55.169629] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T18:16:55.205766] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T18:16:55.263354] [DEBUG] [LOCAL ] DG: Loaded 53269 existing records from primary storage. [2025-10-21T18:16:55.263719] [INFO ] [MAIN ] DG: Loaded 53269 existing records. [2025-10-21T18:16:55.356139] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-21T18:16:55.471275] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:16:55.471499] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-21T18:16:55.471551] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-21T18:16:55.472047] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-21T18:16:55.472105] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-21T18:16:55.929751] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:16:56.151090] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-21T18:16:56.728280] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T18:16:56.951034] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-21T18:16:57.043062] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T18:16:57.714471] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T18:16:57.751008] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-21T18:16:58.551007] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-21T18:16:58.611638] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T18:16:59.351014] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-21T18:17:00.150997] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-21T18:17:00.433390] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T18:17:00.491727] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T18:17:00.951055] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-21T18:17:01.208836] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T18:17:01.751035] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-21T18:17:02.004193] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T18:17:02.010097] [INFO ] [REMOTE ] DFH: Full fetch complete (47556 records). [2025-10-21T18:17:02.010222] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-21T18:17:02.407420] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-21T18:17:02.407498] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-21T18:17:02.408179] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-21T18:17:02.408243] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-21T18:17:02.409196] [DEBUG] [LOCAL ] DFH: Trimmed 47556 records to 31847 (keeping 200 days of data) [2025-10-21T18:17:02.555218] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-21T18:17:02.592918] [DEBUG] [LOCAL ] DFH: Primary data saved (31847 records). [2025-10-21T18:17:02.593094] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-21T18:17:02.593171] [INFO ] [MAIN ] Update Progress: 609/2366 symbols completed. DFH took 23.4s. Estimated remaining: 3h 42m 5s. Rate: 7.9 symbols/min [2025-10-21T18:17:02.771695] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:02.771818] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-10-21T18:17:02.771855] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-10-21T18:17:02.771964] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-21T18:17:02.772005] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-21T18:17:02.772046] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-21T18:17:02.772078] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-21T18:17:03.124543] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T18:17:03.165169] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:03.249043] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T18:17:03.351055] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-21T18:17:04.151006] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-21T18:17:04.186609] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T18:17:04.951040] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-21T18:17:05.751033] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-21T18:17:05.960894] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T18:17:06.007681] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T18:17:06.551043] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-21T18:17:07.351058] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-21T18:17:07.389713] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T18:17:07.583898] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T18:17:08.151098] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-21T18:17:08.510113] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T18:17:08.951066] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-21T18:17:09.003441] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T18:17:09.751019] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-21T18:17:10.003096] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T18:17:10.551036] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-21T18:17:11.351071] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-21T18:17:11.610574] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:17:12.151084] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-21T18:17:12.179455] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T18:17:12.295032] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:17:12.951062] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-21T18:17:13.751075] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-21T18:17:14.067430] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T18:17:14.551046] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-21T18:17:14.609189] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:17:14.891132] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T18:17:14.894603] [INFO ] [REMOTE ] DFIN: Full fetch complete (33323 records). [2025-10-21T18:17:14.894701] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-21T18:17:15.268408] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-21T18:17:15.268506] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-21T18:17:15.269067] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-21T18:17:15.269127] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-21T18:17:15.269957] [DEBUG] [LOCAL ] DFIN: Trimmed 33323 records to 22406 (keeping 200 days of data) [2025-10-21T18:17:15.356688] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-21T18:17:15.399616] [DEBUG] [LOCAL ] DFIN: Primary data saved (22406 records). [2025-10-21T18:17:15.399766] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-21T18:17:15.399838] [INFO ] [MAIN ] Update Progress: 610/2366 symbols completed. DFIN took 28.3s. Estimated remaining: 3h 42m 12s. Rate: 7.9 symbols/min [2025-10-21T18:17:15.564751] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:15.564876] [DEBUG] [LOCAL ] DHF: No existing data file found in primary storage. [2025-10-21T18:17:15.564912] [WARN ] [MAIN ] DHF: No existing data found, performing full refresh instead. [2025-10-21T18:17:15.565039] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-21T18:17:15.565099] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-21T18:17:15.565143] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-21T18:17:15.565176] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-21T18:17:15.914985] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:16.151009] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-21T18:17:16.181781] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T18:17:16.485863] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T18:17:16.950996] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-21T18:17:17.750992] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-21T18:17:18.029382] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T18:17:18.551066] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-21T18:17:18.664877] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T18:17:18.836529] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T18:17:19.351066] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-21T18:17:19.606173] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:17:20.151048] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-21T18:17:20.347019] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T18:17:20.348700] [INFO ] [REMOTE ] DFP: Full fetch complete (15739 records). [2025-10-21T18:17:20.348768] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-21T18:17:20.704597] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-21T18:17:20.704711] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-21T18:17:20.705013] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-21T18:17:20.705073] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-21T18:17:20.705561] [DEBUG] [LOCAL ] DFP: Trimmed 15739 records to 11074 (keeping 200 days of data) [2025-10-21T18:17:20.769879] [DEBUG] [LOCAL ] DFP: Primary data saved (11074 records). [2025-10-21T18:17:20.769987] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-21T18:17:20.770060] [INFO ] [MAIN ] Update Progress: 611/2366 symbols completed. DFP took 28.5s. Estimated remaining: 3h 41m 58s. Rate: 7.9 symbols/min [2025-10-21T18:17:20.946519] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:20.951023] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-21T18:17:21.000359] [DEBUG] [LOCAL ] DHI: Loaded 53365 existing records from primary storage. [2025-10-21T18:17:21.000699] [INFO ] [MAIN ] DHI: Loaded 53365 existing records. [2025-10-21T18:17:21.171868] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:21.172072] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-21T18:17:21.172151] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-21T18:17:21.172876] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-21T18:17:21.172932] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-21T18:17:21.519108] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:21.750991] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-21T18:17:22.054533] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T18:17:22.240460] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:17:22.551092] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-21T18:17:23.351020] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-21T18:17:23.746847] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T18:17:24.151019] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-21T18:17:24.324306] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T18:17:24.951058] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-21T18:17:25.018290] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:17:25.227858] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T18:17:25.751027] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-21T18:17:26.550996] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-21T18:17:26.749190] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T18:17:27.214190] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:17:27.350982] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-21T18:17:27.621847] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T18:17:28.150986] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-21T18:17:28.398901] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T18:17:28.407058] [INFO ] [REMOTE ] DG: Full fetch complete (77334 records). [2025-10-21T18:17:28.407180] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-21T18:17:28.802292] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-21T18:17:28.802385] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-21T18:17:28.803319] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-21T18:17:28.803380] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-21T18:17:28.804765] [DEBUG] [LOCAL ] DG: Trimmed 77334 records to 53258 (keeping 200 days of data) [2025-10-21T18:17:28.980048] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-21T18:17:29.131000] [DEBUG] [LOCAL ] DG: Primary data saved (53258 records). [2025-10-21T18:17:29.131122] [INFO ] [MAIN ] DG: Full history saved. [2025-10-21T18:17:29.131748] [INFO ] [MAIN ] Update Progress: 612/2366 symbols completed. DG took 34.2s. Estimated remaining: 3h 41m 53s. Rate: 7.9 symbols/min [2025-10-21T18:17:29.297623] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:29.349132] [DEBUG] [LOCAL ] DHR: Loaded 53381 existing records from primary storage. [2025-10-21T18:17:29.349447] [INFO ] [MAIN ] DHR: Loaded 53381 existing records. [2025-10-21T18:17:29.526924] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:29.527139] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-21T18:17:29.527188] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-21T18:17:29.528126] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-21T18:17:29.528186] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-21T18:17:29.765493] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-21T18:17:29.896092] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:30.123868] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T18:17:30.551048] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-21T18:17:30.825152] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T18:17:30.918196] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T18:17:31.351077] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-21T18:17:32.151001] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-21T18:17:32.578748] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T18:17:32.951007] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-21T18:17:33.104103] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T18:17:33.751076] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-21T18:17:34.174430] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T18:17:34.551063] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-21T18:17:34.824871] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T18:17:34.965376] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T18:17:35.351022] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-21T18:17:36.094633] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:17:36.151039] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-21T18:17:36.951001] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-21T18:17:37.140628] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:17:37.572212] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T18:17:37.751029] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-21T18:17:38.366311] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T18:17:38.551039] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-21T18:17:39.351122] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-21T18:17:39.823976] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T18:17:40.151036] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-21T18:17:40.236680] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:17:40.951029] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-21T18:17:41.097937] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:17:41.751091] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-21T18:17:42.070358] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:17:42.550991] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-21T18:17:42.888867] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T18:17:42.943350] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:17:43.351097] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-21T18:17:43.774733] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:17:44.151037] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-21T18:17:44.951125] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-21T18:17:45.548022] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T18:17:45.579101] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:17:45.585622] [INFO ] [REMOTE ] DGX: Full fetch complete (65202 records). [2025-10-21T18:17:45.585808] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-21T18:17:45.586530] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:17:45.586617] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:17:45.586706] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:17:45.586780] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-21T18:17:45.586842] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-21T18:17:45.586877] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-21T18:17:45.586914] [DEBUG] [LOCAL ] DGX: No derivative data file found to delete. [2025-10-21T18:17:45.586967] [INFO ] [MAIN ] Update Progress: 613/2366 symbols completed. DGX took 43.0s. Estimated remaining: 3h 42m 11s. Rate: 7.9 symbols/min [2025-10-21T18:17:45.763385] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-21T18:17:45.766967] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:45.819941] [DEBUG] [LOCAL ] DHT: Loaded 47915 existing records from primary storage. [2025-10-21T18:17:45.820282] [INFO ] [MAIN ] DHT: Loaded 47915 existing records. [2025-10-21T18:17:46.002274] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:46.017861] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-21T18:17:46.018706] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-21T18:17:46.019346] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T18:17:46.025226] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-21T18:17:46.025740] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-21T18:17:46.379182] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:46.550984] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-21T18:17:47.136682] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:17:47.145168] [INFO ] [REMOTE ] DHI: Full fetch complete (77397 records). [2025-10-21T18:17:47.145316] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-21T18:17:47.357871] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-21T18:17:47.591561] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-21T18:17:47.591677] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-21T18:17:47.592672] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-21T18:17:47.592738] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-21T18:17:47.594511] [DEBUG] [LOCAL ] DHI: Trimmed 77397 records to 53364 (keeping 200 days of data) [2025-10-21T18:17:47.925486] [DEBUG] [LOCAL ] DHI: Primary data saved (53364 records). [2025-10-21T18:17:47.925635] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-21T18:17:47.925755] [INFO ] [MAIN ] Update Progress: 614/2366 symbols completed. DHI took 27.2s. Estimated remaining: 3h 41m 48s. Rate: 7.9 symbols/min [2025-10-21T18:17:48.109325] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:48.123494] [DEBUG] [LOCAL ] DHX: Loaded 13199 existing records from primary storage. [2025-10-21T18:17:48.123787] [INFO ] [MAIN ] DHX: Loaded 13199 existing records. [2025-10-21T18:17:48.158852] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-21T18:17:48.342561] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:48.342932] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-21T18:17:48.343004] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-21T18:17:48.343491] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-21T18:17:48.343552] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-21T18:17:48.578530] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-21T18:17:48.930031] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:48.951097] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-21T18:17:49.378140] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T18:17:49.382520] [INFO ] [REMOTE ] DHF: Full fetch complete (29772 records). [2025-10-21T18:17:49.382759] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-21T18:17:49.394507] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:17:49.415510] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:17:49.415761] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:17:49.415844] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-21T18:17:49.416527] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-21T18:17:49.416589] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-10-21T18:17:49.418464] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-21T18:17:49.428986] [DEBUG] [LOCAL ] DHF: No derivative data file found to delete. [2025-10-21T18:17:49.429518] [INFO ] [MAIN ] Update Progress: 615/2366 symbols completed. DHF took 34.0s. Estimated remaining: 3h 41m 23s. Rate: 7.9 symbols/min [2025-10-21T18:17:49.613092] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:17:49.628583] [DEBUG] [LOCAL ] DIAX: Loaded 12903 existing records from primary storage. [2025-10-21T18:17:49.628848] [INFO ] [MAIN ] DIAX: Loaded 12903 existing records. [2025-10-21T18:17:49.757595] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-21T18:17:49.849356] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:17:49.849596] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-21T18:17:49.849675] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-21T18:17:49.849853] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-21T18:17:49.849908] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-21T18:17:50.205723] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:17:50.551010] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-21T18:17:50.593946] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:17:51.351012] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-21T18:17:51.428739] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T18:17:51.847587] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:17:52.151017] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-21T18:17:52.951047] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-21T18:17:53.202671] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:17:53.612573] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T18:17:53.751043] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-21T18:17:54.168488] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T18:17:54.551039] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-21T18:17:55.199254] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T18:17:55.351002] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-21T18:17:55.419633] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T18:17:56.151088] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-21T18:17:56.720500] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T18:17:56.951033] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-21T18:17:57.292571] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T18:17:57.751020] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-21T18:17:58.551018] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-21T18:17:58.840921] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T18:17:58.921521] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T18:17:59.351062] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-21T18:18:00.152886] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-21T18:18:00.156862] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:18:00.229460] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:18:00.237837] [INFO ] [REMOTE ] DHR: Full fetch complete (77442 records). [2025-10-21T18:18:00.238048] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-21T18:18:00.644410] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-21T18:18:00.644489] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-21T18:18:00.645413] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-21T18:18:00.645482] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-21T18:18:00.646929] [DEBUG] [LOCAL ] DHR: Trimmed 77442 records to 53381 (keeping 200 days of data) [2025-10-21T18:18:00.956218] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-21T18:18:00.983458] [DEBUG] [LOCAL ] DHR: Primary data saved (53381 records). [2025-10-21T18:18:00.983603] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-21T18:18:00.984275] [INFO ] [MAIN ] Update Progress: 616/2366 symbols completed. DHR took 31.9s. Estimated remaining: 3h 41m 27s. Rate: 7.9 symbols/min [2025-10-21T18:18:01.160185] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:01.198060] [DEBUG] [LOCAL ] DIN: Loaded 37006 existing records from primary storage. [2025-10-21T18:18:01.198367] [INFO ] [MAIN ] DIN: Loaded 37006 existing records. [2025-10-21T18:18:01.396471] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:01.407377] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-21T18:18:01.408942] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T18:18:01.408311] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-21T18:18:01.412991] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-21T18:18:01.413603] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-21T18:18:01.758262] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-21T18:18:01.833993] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:02.551042] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-21T18:18:02.755634] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T18:18:02.963842] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T18:18:03.351048] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-21T18:18:03.610484] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T18:18:04.151045] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-21T18:18:04.950999] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-21T18:18:05.111167] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T18:18:05.158909] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:18:05.751082] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-21T18:18:06.541839] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:18:06.551029] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-21T18:18:06.570141] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T18:18:07.351038] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-21T18:18:08.151024] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-21T18:18:08.276715] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T18:18:08.392753] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:18:08.951010] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-21T18:18:09.427558] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:18:09.707326] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T18:18:09.751052] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-21T18:18:10.551074] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-21T18:18:10.615922] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T18:18:11.332208] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T18:18:11.350995] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-21T18:18:12.151045] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-21T18:18:12.278230] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T18:18:12.951059] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-21T18:18:13.626385] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T18:18:13.751003] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-21T18:18:13.991795] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T18:18:14.551083] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-21T18:18:15.350992] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-21T18:18:15.412938] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:18:16.031240] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T18:18:16.038661] [INFO ] [REMOTE ] DHT: Full fetch complete (69877 records). [2025-10-21T18:18:16.038770] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-21T18:18:16.039472] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:18:16.039573] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:18:16.039672] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:18:16.039765] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-21T18:18:16.039830] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-10-21T18:18:16.039864] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-10-21T18:18:16.040005] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-10-21T18:18:16.040869] [INFO ] [MAIN ] Update Progress: 617/2366 symbols completed. DHT took 30.5s. Estimated remaining: 3h 41m 40s. Rate: 7.9 symbols/min [2025-10-21T18:18:16.155013] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-21T18:18:16.155864] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:18:16.227486] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:16.277748] [DEBUG] [LOCAL ] DINO: Loaded 52842 existing records from primary storage. [2025-10-21T18:18:16.278073] [INFO ] [MAIN ] DINO: Loaded 52842 existing records. [2025-10-21T18:18:16.452638] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:16.452849] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-21T18:18:16.452895] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-21T18:18:16.453442] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-21T18:18:16.453498] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-21T18:18:16.802614] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:16.951085] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-21T18:18:17.219585] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T18:18:17.222692] [INFO ] [REMOTE ] DHX: Full fetch complete (21375 records). [2025-10-21T18:18:17.222830] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-21T18:18:17.223309] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:18:17.223388] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:18:17.223456] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:18:17.223537] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-21T18:18:17.223600] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-21T18:18:17.223636] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-21T18:18:17.223823] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-10-21T18:18:17.223910] [INFO ] [MAIN ] Update Progress: 618/2366 symbols completed. DHX took 29.3s. Estimated remaining: 3h 41m 15s. Rate: 7.9 symbols/min [2025-10-21T18:18:17.411810] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:17.461321] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-21T18:18:17.461635] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-21T18:18:17.652237] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:17.652434] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-21T18:18:17.652480] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-21T18:18:17.653306] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-21T18:18:17.653364] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-21T18:18:17.753134] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-21T18:18:17.774698] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T18:18:18.029565] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:18.551069] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-21T18:18:19.062355] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T18:18:19.351121] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-21T18:18:20.151076] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-21T18:18:20.388249] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T18:18:20.736584] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:18:20.951078] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-21T18:18:21.726356] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T18:18:21.728964] [INFO ] [REMOTE ] DIAX: Full fetch complete (17571 records). [2025-10-21T18:18:21.729057] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-21T18:18:21.729478] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:18:21.729563] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:18:21.729626] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:18:21.729749] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-21T18:18:21.729825] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-21T18:18:21.729873] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-10-21T18:18:21.730015] [DEBUG] [LOCAL ] DIAX: Deleted derivative data file. [2025-10-21T18:18:21.730107] [INFO ] [MAIN ] Update Progress: 619/2366 symbols completed. DIAX took 32.3s. Estimated remaining: 3h 40m 58s. Rate: 7.9 symbols/min [2025-10-21T18:18:21.762571] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-21T18:18:21.908920] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:21.909105] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-21T18:18:21.909160] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-21T18:18:21.909270] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-21T18:18:21.909312] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-21T18:18:21.909352] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-21T18:18:21.909383] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-21T18:18:22.273077] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:22.551090] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-21T18:18:22.767680] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-21T18:18:23.350999] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-21T18:18:23.872878] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T18:18:24.151009] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-21T18:18:24.242353] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:18:24.951041] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-21T18:18:25.612532] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-21T18:18:25.716699] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:18:25.750981] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-21T18:18:26.245774] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:18:26.551019] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-21T18:18:27.086853] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-21T18:18:27.351026] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-21T18:18:27.484730] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T18:18:27.683935] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-21T18:18:28.151056] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-21T18:18:28.951024] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-21T18:18:29.429561] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T18:18:29.658011] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T18:18:29.750981] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-21T18:18:30.551027] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-21T18:18:31.212138] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T18:18:31.218479] [INFO ] [REMOTE ] DIN: Full fetch complete (54781 records). [2025-10-21T18:18:31.218658] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-21T18:18:31.362940] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-21T18:18:31.607572] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-21T18:18:31.607703] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-21T18:18:31.608486] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-21T18:18:31.608550] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-21T18:18:31.610200] [DEBUG] [LOCAL ] DIN: Trimmed 54781 records to 36831 (keeping 200 days of data) [2025-10-21T18:18:31.834904] [DEBUG] [LOCAL ] DIN: Primary data saved (36831 records). [2025-10-21T18:18:31.835043] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-21T18:18:31.835874] [INFO ] [MAIN ] Update Progress: 620/2366 symbols completed. DIN took 30.9s. Estimated remaining: 3h 40m 58s. Rate: 7.9 symbols/min [2025-10-21T18:18:32.011858] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:32.060320] [DEBUG] [LOCAL ] DK: Loaded 49346 existing records from primary storage. [2025-10-21T18:18:32.060698] [INFO ] [MAIN ] DK: Loaded 49346 existing records. [2025-10-21T18:18:32.156278] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-21T18:18:32.247671] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:32.247884] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-21T18:18:32.247932] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-21T18:18:32.248356] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-21T18:18:32.248414] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-21T18:18:32.619250] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:32.643399] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-21T18:18:32.950997] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-21T18:18:33.027794] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-10-21T18:18:33.235931] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T18:18:33.751019] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-21T18:18:34.550997] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-21T18:18:34.588539] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T18:18:34.849090] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-21T18:18:35.351037] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-21T18:18:35.950198] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-21T18:18:36.150991] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-21T18:18:36.951098] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-21T18:18:36.981180] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T18:18:37.751094] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-21T18:18:38.164622] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-21T18:18:38.551810] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-21T18:18:38.554948] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-10-21T18:18:39.028754] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-21T18:18:39.351063] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-21T18:18:40.151005] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-21T18:18:40.454627] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T18:18:40.614937] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-21T18:18:40.868473] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:18:40.950991] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-21T18:18:41.751025] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-21T18:18:42.551002] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-21T18:18:42.669753] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T18:18:42.807155] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-21T18:18:42.899130] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T18:18:43.351030] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-21T18:18:44.151035] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-21T18:18:44.501118] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-21T18:18:44.951081] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-21T18:18:45.417675] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T18:18:45.418467] [INFO ] [REMOTE ] DIVY: Full fetch complete (1700 records). [2025-10-21T18:18:45.418535] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-21T18:18:45.622913] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T18:18:45.623126] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:18:45.623172] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:18:45.623214] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-21T18:18:45.623268] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-21T18:18:45.623301] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-21T18:18:45.623342] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-21T18:18:45.623435] [INFO ] [MAIN ] Update Progress: 621/2366 symbols completed. DIVY took 23.9s. Estimated remaining: 3h 41m 8s. Rate: 7.9 symbols/min [2025-10-21T18:18:45.761107] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-21T18:18:45.792508] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:45.812119] [DEBUG] [LOCAL ] DKL: Loaded 17203 existing records from primary storage. [2025-10-21T18:18:45.812563] [INFO ] [MAIN ] DKL: Loaded 17203 existing records. [2025-10-21T18:18:45.988303] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:45.988521] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-21T18:18:45.988678] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-21T18:18:45.989143] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-21T18:18:45.989202] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-21T18:18:46.376895] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-10-21T18:18:46.382290] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:46.551029] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-21T18:18:47.351058] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-21T18:18:47.691813] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T18:18:47.731171] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T18:18:48.151027] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-21T18:18:48.951088] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-21T18:18:49.196109] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:18:49.751098] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-21T18:18:49.956929] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T18:18:49.964870] [INFO ] [REMOTE ] DINO: Full fetch complete (76720 records). [2025-10-21T18:18:49.964999] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-21T18:18:50.349223] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-21T18:18:50.349308] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-21T18:18:50.350664] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-21T18:18:50.350726] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-21T18:18:50.352328] [DEBUG] [LOCAL ] DINO: Trimmed 76720 records to 52837 (keeping 200 days of data) [2025-10-21T18:18:50.565739] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-21T18:18:50.685985] [DEBUG] [LOCAL ] DINO: Primary data saved (52837 records). [2025-10-21T18:18:50.686182] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-21T18:18:50.687306] [INFO ] [MAIN ] Update Progress: 622/2366 symbols completed. DINO took 34.6s. Estimated remaining: 3h 40m 53s. Rate: 7.9 symbols/min [2025-10-21T18:18:50.865196] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:50.913905] [DEBUG] [LOCAL ] DKS: Loaded 49551 existing records from primary storage. [2025-10-21T18:18:50.914202] [INFO ] [MAIN ] DKS: Loaded 49551 existing records. [2025-10-21T18:18:51.096804] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:51.097065] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-21T18:18:51.097125] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-21T18:18:51.098202] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-21T18:18:51.098267] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-21T18:18:51.376412] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-21T18:18:51.444059] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-21T18:18:51.528593] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:18:51.581401] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T18:18:51.584753] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T18:18:52.151040] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-21T18:18:52.951031] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-21T18:18:53.751120] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-21T18:18:53.786442] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:18:53.833469] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T18:18:54.478180] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:18:54.550981] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-21T18:18:54.935769] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T18:18:55.351066] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-21T18:18:55.877305] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T18:18:56.151024] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-21T18:18:56.951029] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-21T18:18:57.680946] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-21T18:18:57.753997] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-21T18:18:57.757481] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T18:18:58.286566] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-21T18:18:58.296164] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-21T18:18:58.296421] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-21T18:18:58.556951] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-21T18:18:58.714149] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T18:18:58.766700] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-21T18:18:58.766790] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-21T18:18:58.768160] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-21T18:18:58.768225] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-21T18:18:58.769687] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-21T18:18:59.097210] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-21T18:18:59.097355] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-21T18:18:59.097445] [INFO ] [MAIN ] Update Progress: 623/2366 symbols completed. DIS took 41.9s. Estimated remaining: 3h 40m 47s. Rate: 7.9 symbols/min [2025-10-21T18:18:59.266448] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:18:59.296394] [DEBUG] [LOCAL ] DLB: Loaded 32311 existing records from primary storage. [2025-10-21T18:18:59.296673] [INFO ] [MAIN ] DLB: Loaded 32311 existing records. [2025-10-21T18:18:59.358559] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-21T18:18:59.477374] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:18:59.477593] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-21T18:18:59.477639] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-21T18:18:59.478268] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-21T18:18:59.478324] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-21T18:18:59.853252] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:00.151051] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-21T18:19:00.514121] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T18:19:00.951070] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-21T18:19:01.152150] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:19:01.707889] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:19:01.750989] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-21T18:19:02.551023] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-21T18:19:02.587377] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:19:03.104182] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:19:03.351093] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-21T18:19:04.151004] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-21T18:19:04.320512] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T18:19:04.327518] [INFO ] [REMOTE ] DK: Full fetch complete (70484 records). [2025-10-21T18:19:04.327691] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-21T18:19:04.328525] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:19:04.328626] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:19:04.328706] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:19:04.328777] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-21T18:19:04.328844] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-10-21T18:19:04.328880] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-10-21T18:19:04.329005] [DEBUG] [LOCAL ] DK: Deleted derivative data file. [2025-10-21T18:19:04.329477] [INFO ] [MAIN ] Update Progress: 624/2366 symbols completed. DK took 32.5s. Estimated remaining: 3h 40m 33s. Rate: 7.9 symbols/min [2025-10-21T18:19:04.500720] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:04.510196] [DEBUG] [LOCAL ] DLNG: Loaded 6143 existing records from primary storage. [2025-10-21T18:19:04.510416] [INFO ] [MAIN ] DLNG: Loaded 6143 existing records. [2025-10-21T18:19:04.694766] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:04.695118] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-21T18:19:04.695289] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-21T18:19:04.695542] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-21T18:19:04.695599] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-21T18:19:04.915611] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:19:04.956117] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-21T18:19:05.143823] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:05.751033] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-21T18:19:06.047320] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T18:19:06.285337] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T18:19:06.551051] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-21T18:19:06.907895] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T18:19:07.351033] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-21T18:19:08.151008] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-21T18:19:08.226856] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:19:08.340881] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T18:19:08.951007] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-21T18:19:09.233320] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T18:19:09.751161] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-21T18:19:10.462065] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:19:10.550980] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-21T18:19:10.831782] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:19:11.351095] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-21T18:19:12.003115] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:19:12.151045] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-21T18:19:12.175904] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T18:19:12.951072] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-21T18:19:13.750785] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T18:19:13.752593] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-21T18:19:13.836305] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:19:14.551050] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-21T18:19:14.836395] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T18:19:15.351062] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-21T18:19:16.151020] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-21T18:19:16.442153] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:19:16.679853] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:19:16.951003] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-21T18:19:17.170858] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T18:19:17.751027] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-21T18:19:18.551010] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-21T18:19:18.753043] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T18:19:19.101371] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T18:19:19.351052] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-21T18:19:19.455680] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:19:19.457850] [INFO ] [REMOTE ] DKL: Full fetch complete (27586 records). [2025-10-21T18:19:19.457930] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-21T18:19:19.821108] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-21T18:19:19.821190] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-21T18:19:19.821717] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-21T18:19:19.821777] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-21T18:19:19.822475] [DEBUG] [LOCAL ] DKL: Trimmed 27586 records to 17059 (keeping 200 days of data) [2025-10-21T18:19:19.926073] [DEBUG] [LOCAL ] DKL: Primary data saved (17059 records). [2025-10-21T18:19:19.926225] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-21T18:19:19.926309] [INFO ] [MAIN ] Update Progress: 625/2366 symbols completed. DKL took 34.3s. Estimated remaining: 3h 40m 48s. Rate: 7.9 symbols/min [2025-10-21T18:19:20.099635] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:20.154007] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-21T18:19:20.156032] [DEBUG] [LOCAL ] DLR: Loaded 50645 existing records from primary storage. [2025-10-21T18:19:20.156458] [INFO ] [MAIN ] DLR: Loaded 50645 existing records. [2025-10-21T18:19:20.355021] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:20.355254] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-21T18:19:20.355301] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-21T18:19:20.356248] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-21T18:19:20.356309] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-21T18:19:20.700374] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:20.951032] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-21T18:19:21.085628] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T18:19:21.412133] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-21T18:19:21.419902] [INFO ] [REMOTE ] DKS: Full fetch complete (71676 records). [2025-10-21T18:19:21.420096] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-21T18:19:21.760271] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-21T18:19:21.808381] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-21T18:19:21.808462] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-21T18:19:21.809337] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-21T18:19:21.809402] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-21T18:19:21.810799] [DEBUG] [LOCAL ] DKS: Trimmed 71676 records to 49449 (keeping 200 days of data) [2025-10-21T18:19:22.113067] [DEBUG] [LOCAL ] DKS: Primary data saved (49449 records). [2025-10-21T18:19:22.113191] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-21T18:19:22.114187] [INFO ] [MAIN ] Update Progress: 626/2366 symbols completed. DKS took 31.4s. Estimated remaining: 3h 40m 25s. Rate: 7.9 symbols/min [2025-10-21T18:19:22.281430] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:22.311969] [DEBUG] [LOCAL ] DLX: Loaded 28318 existing records from primary storage. [2025-10-21T18:19:22.312224] [INFO ] [MAIN ] DLX: Loaded 28318 existing records. [2025-10-21T18:19:22.448040] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T18:19:22.532263] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:22.532459] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-21T18:19:22.532531] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-21T18:19:22.533101] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-21T18:19:22.533160] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-21T18:19:22.562926] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-21T18:19:22.789946] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T18:19:22.906301] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:23.351057] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-21T18:19:24.151075] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-21T18:19:24.460387] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T18:19:24.743375] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T18:19:24.748755] [INFO ] [REMOTE ] DLB: Full fetch complete (47386 records). [2025-10-21T18:19:24.748851] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-21T18:19:24.847366] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T18:19:24.956730] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-21T18:19:25.146227] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-21T18:19:25.146305] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-21T18:19:25.146995] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-21T18:19:25.147057] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-21T18:19:25.148020] [DEBUG] [LOCAL ] DLB: Trimmed 47386 records to 32289 (keeping 200 days of data) [2025-10-21T18:19:25.337314] [DEBUG] [LOCAL ] DLB: Primary data saved (32289 records). [2025-10-21T18:19:25.337444] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-21T18:19:25.337521] [INFO ] [MAIN ] Update Progress: 627/2366 symbols completed. DLB took 26.2s. Estimated remaining: 3h 40m 6s. Rate: 7.9 symbols/min [2025-10-21T18:19:25.507436] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:25.526677] [DEBUG] [LOCAL ] DLY: Loaded 20770 existing records from primary storage. [2025-10-21T18:19:25.526912] [INFO ] [MAIN ] DLY: Loaded 20770 existing records. [2025-10-21T18:19:25.703348] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:25.703541] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-21T18:19:25.703597] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-21T18:19:25.704092] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-21T18:19:25.704149] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-21T18:19:25.757895] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-21T18:19:26.050880] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:26.551059] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-21T18:19:27.006748] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T18:19:27.030622] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T18:19:27.351018] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-21T18:19:27.648306] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:19:27.937776] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T18:19:28.151060] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-21T18:19:28.951057] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-21T18:19:29.557045] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:19:29.751039] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-21T18:19:30.551038] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-21T18:19:30.683143] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T18:19:30.987046] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T18:19:31.258438] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:19:31.351091] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-21T18:19:32.151023] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-21T18:19:32.750979] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T18:19:32.781568] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T18:19:32.951010] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-21T18:19:33.751017] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-21T18:19:34.551074] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-21T18:19:34.746425] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T18:19:35.301207] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-21T18:19:35.315984] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T18:19:35.317571] [INFO ] [REMOTE ] DLNG: Full fetch complete (11469 records). [2025-10-21T18:19:35.317662] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-21T18:19:35.357106] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-21T18:19:35.686973] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-21T18:19:35.687056] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-21T18:19:35.687310] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-21T18:19:35.687348] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-21T18:19:35.687805] [DEBUG] [LOCAL ] DLNG: Trimmed 11469 records to 6106 (keeping 200 days of data) [2025-10-21T18:19:35.722377] [DEBUG] [LOCAL ] DLNG: Primary data saved (6106 records). [2025-10-21T18:19:35.722480] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-21T18:19:35.722553] [INFO ] [MAIN ] Update Progress: 628/2366 symbols completed. DLNG took 31.4s. Estimated remaining: 3h 40m 6s. Rate: 7.9 symbols/min [2025-10-21T18:19:35.905632] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:35.905806] [DEBUG] [LOCAL ] DMA: No existing data file found in primary storage. [2025-10-21T18:19:35.905847] [WARN ] [MAIN ] DMA: No existing data found, performing full refresh instead. [2025-10-21T18:19:35.905954] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-21T18:19:35.905995] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-21T18:19:35.906057] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-10-21T18:19:35.906127] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-21T18:19:36.156194] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-21T18:19:36.255200] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:36.950990] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-21T18:19:37.210789] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:19:37.297175] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T18:19:37.628303] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T18:19:37.751097] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-21T18:19:38.361812] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T18:19:38.551000] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-21T18:19:38.899915] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-21T18:19:39.351005] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-21T18:19:40.151078] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-21T18:19:40.951000] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-21T18:19:41.137422] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:19:41.509576] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T18:19:41.753834] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-21T18:19:41.757071] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T18:19:42.551030] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-21T18:19:43.173776] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T18:19:43.192801] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T18:19:43.351045] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-21T18:19:44.151068] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-21T18:19:44.560819] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T18:19:44.951113] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-21T18:19:45.153909] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T18:19:45.751015] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-21T18:19:46.551005] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-21T18:19:46.967938] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T18:19:46.993028] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T18:19:47.351033] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-21T18:19:47.790921] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T18:19:48.097372] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T18:19:48.151042] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-21T18:19:48.602606] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T18:19:48.951025] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-21T18:19:49.751069] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-21T18:19:50.241409] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:19:50.551020] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-21T18:19:51.119839] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T18:19:51.351031] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-21T18:19:51.425855] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:19:52.150995] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-21T18:19:52.442952] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T18:19:52.951066] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-21T18:19:53.751047] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-21T18:19:54.082944] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T18:19:54.257162] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T18:19:54.551072] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-21T18:19:54.673960] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T18:19:55.351030] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-21T18:19:55.385372] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T18:19:55.393022] [INFO ] [REMOTE ] DLR: Full fetch complete (74173 records). [2025-10-21T18:19:55.393159] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-21T18:19:55.780040] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-21T18:19:55.780181] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-21T18:19:55.781076] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-21T18:19:55.781145] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-21T18:19:55.782528] [DEBUG] [LOCAL ] DLR: Trimmed 74173 records to 50634 (keeping 200 days of data) [2025-10-21T18:19:56.003498] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T18:19:56.105215] [DEBUG] [LOCAL ] DLR: Primary data saved (50634 records). [2025-10-21T18:19:56.105357] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-21T18:19:56.106108] [INFO ] [MAIN ] Update Progress: 629/2366 symbols completed. DLR took 36.2s. Estimated remaining: 3h 40m 33s. Rate: 7.9 symbols/min [2025-10-21T18:19:56.159831] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-21T18:19:56.277675] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:56.292711] [DEBUG] [LOCAL ] DMB: Loaded 10378 existing records from primary storage. [2025-10-21T18:19:56.292934] [INFO ] [MAIN ] DMB: Loaded 10378 existing records. [2025-10-21T18:19:56.470998] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:56.471221] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-21T18:19:56.471277] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-21T18:19:56.471526] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-21T18:19:56.471567] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-21T18:19:56.834577] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:56.951024] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-21T18:19:57.557483] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:19:57.561376] [INFO ] [REMOTE ] DLX: Full fetch complete (41249 records). [2025-10-21T18:19:57.561488] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-21T18:19:57.756194] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-21T18:19:57.949490] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-21T18:19:57.949594] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-21T18:19:57.950292] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-21T18:19:57.950498] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-21T18:19:57.963255] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T18:19:57.967710] [DEBUG] [LOCAL ] DLX: Trimmed 41249 records to 28165 (keeping 200 days of data) [2025-10-21T18:19:57.968532] [INFO ] [REMOTE ] DLY: Full fetch complete (28534 records). [2025-10-21T18:19:57.968631] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-21T18:19:58.322056] [DEBUG] [LOCAL ] DLX: Primary data saved (28165 records). [2025-10-21T18:19:58.340811] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-21T18:19:58.405869] [INFO ] [MAIN ] Update Progress: 630/2366 symbols completed. DLX took 36.3s. Estimated remaining: 3h 40m 11s. Rate: 7.9 symbols/min [2025-10-21T18:19:58.564883] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-21T18:19:58.668191] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T18:19:58.668546] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-21T18:19:58.697995] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-21T18:19:58.704379] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-21T18:19:58.722638] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-21T18:19:58.751682] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:58.752073] [DEBUG] [LOCAL ] DLY: Trimmed 28534 records to 20743 (keeping 200 days of data) [2025-10-21T18:19:58.869145] [DEBUG] [LOCAL ] DMO: Loaded 9868 existing records from primary storage. [2025-10-21T18:19:58.881840] [INFO ] [MAIN ] DMO: Loaded 9868 existing records. [2025-10-21T18:19:58.983395] [DEBUG] [LOCAL ] DLY: Primary data saved (20743 records). [2025-10-21T18:19:58.993786] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-21T18:19:58.993879] [INFO ] [MAIN ] Update Progress: 631/2366 symbols completed. DLY took 33.7s. Estimated remaining: 3h 39m 44s. Rate: 7.9 symbols/min [2025-10-21T18:19:59.205563] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:59.232995] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-21T18:19:59.234588] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-21T18:19:59.252421] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:19:59.252797] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-21T18:19:59.252939] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-21T18:19:59.357965] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-21T18:19:59.673941] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:19:59.684085] [DEBUG] [LOCAL ] DNA: Loaded 48575 existing records from primary storage. [2025-10-21T18:19:59.685037] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T18:19:59.685169] [INFO ] [MAIN ] DNA: Loaded 48575 existing records. [2025-10-21T18:19:59.871697] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:19:59.872580] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-21T18:19:59.872724] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-21T18:19:59.873476] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-21T18:19:59.873826] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-21T18:20:00.156440] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-21T18:20:00.156372] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:20:00.216191] [INFO ] [REMOTE ] DMA: Full fetch complete (6621 records). [2025-10-21T18:20:00.217257] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-21T18:20:00.439499] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:00.732146] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-21T18:20:00.732230] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-21T18:20:00.732671] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-21T18:20:00.732753] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-21T18:20:00.733224] [DEBUG] [LOCAL ] DMA: Trimmed 6621 records to 4729 (keeping 200 days of data) [2025-10-21T18:20:00.766322] [DEBUG] [LOCAL ] DMA: Primary data saved (4729 records). [2025-10-21T18:20:00.766459] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-21T18:20:00.766533] [INFO ] [MAIN ] Update Progress: 632/2366 symbols completed. DMA took 25.0s. Estimated remaining: 3h 39m 21s. Rate: 7.9 symbols/min [2025-10-21T18:20:00.973206] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:00.968361] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-21T18:20:01.018139] [DEBUG] [LOCAL ] DNOW: Loaded 43858 existing records from primary storage. [2025-10-21T18:20:01.018822] [INFO ] [MAIN ] DNOW: Loaded 43858 existing records. [2025-10-21T18:20:01.231735] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:20:01.231935] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-21T18:20:01.231982] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-21T18:20:01.232712] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-21T18:20:01.232770] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-21T18:20:01.355894] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T18:20:01.636514] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:01.751035] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-21T18:20:02.532584] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T18:20:02.550981] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-21T18:20:03.068977] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T18:20:03.118012] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:20:03.351029] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-21T18:20:04.048183] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T18:20:04.151050] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-21T18:20:04.951026] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-21T18:20:05.751068] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-21T18:20:05.810708] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T18:20:06.040905] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T18:20:06.551121] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-21T18:20:07.350988] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-21T18:20:07.858714] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T18:20:07.893348] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-21T18:20:08.150996] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-21T18:20:08.320439] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T18:20:08.763947] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T18:20:08.951102] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-21T18:20:09.751006] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-21T18:20:09.758332] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T18:20:10.551099] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-21T18:20:11.338436] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T18:20:11.350978] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-21T18:20:11.701313] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:20:12.151034] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-21T18:20:12.324218] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T18:20:12.951024] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-21T18:20:12.962716] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T18:20:13.751041] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-21T18:20:14.123849] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T18:20:14.551080] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-21T18:20:15.349185] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T18:20:15.351369] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-21T18:20:16.135505] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T18:20:16.150979] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-21T18:20:16.486559] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-21T18:20:16.951041] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-21T18:20:17.479875] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T18:20:17.751021] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-21T18:20:18.447335] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T18:20:18.449323] [INFO ] [REMOTE ] DMO: Full fetch complete (14537 records). [2025-10-21T18:20:18.449404] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-21T18:20:18.552318] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-21T18:20:18.835147] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-21T18:20:18.835222] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-21T18:20:18.835530] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-21T18:20:18.835566] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-21T18:20:18.836050] [DEBUG] [LOCAL ] DMO: Trimmed 14537 records to 9862 (keeping 200 days of data) [2025-10-21T18:20:18.895858] [DEBUG] [LOCAL ] DMO: Primary data saved (9862 records). [2025-10-21T18:20:18.895995] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-21T18:20:18.896080] [INFO ] [MAIN ] Update Progress: 633/2366 symbols completed. DMO took 20.5s. Estimated remaining: 3h 39m 42s. Rate: 7.9 symbols/min [2025-10-21T18:20:19.066519] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:19.100225] [DEBUG] [LOCAL ] DNP: Loaded 33154 existing records from primary storage. [2025-10-21T18:20:19.100522] [INFO ] [MAIN ] DNP: Loaded 33154 existing records. [2025-10-21T18:20:19.218490] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T18:20:19.295319] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:20:19.295484] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-21T18:20:19.295530] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-21T18:20:19.296152] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-21T18:20:19.296208] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-21T18:20:19.357089] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-21T18:20:19.650516] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:19.675845] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:20:20.151041] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-21T18:20:20.951034] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-21T18:20:21.483298] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T18:20:21.751012] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-21T18:20:21.801546] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T18:20:22.118228] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-21T18:20:22.551087] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-21T18:20:23.339825] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:20:23.350978] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-21T18:20:24.017095] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T18:20:24.151085] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-21T18:20:24.951140] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-21T18:20:25.155059] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:20:25.584128] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T18:20:25.751057] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-21T18:20:26.345794] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T18:20:26.551075] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-21T18:20:26.946710] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T18:20:27.083188] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-21T18:20:27.085328] [INFO ] [REMOTE ] DMB: Full fetch complete (14739 records). [2025-10-21T18:20:27.085407] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-21T18:20:27.356224] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-21T18:20:27.452084] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-21T18:20:27.452157] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-21T18:20:27.452572] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-21T18:20:27.452634] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-21T18:20:27.453189] [DEBUG] [LOCAL ] DMB: Trimmed 14739 records to 10482 (keeping 200 days of data) [2025-10-21T18:20:27.516218] [DEBUG] [LOCAL ] DMB: Primary data saved (10482 records). [2025-10-21T18:20:27.516349] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-21T18:20:27.516429] [INFO ] [MAIN ] Update Progress: 634/2366 symbols completed. DMB took 31.4s. Estimated remaining: 3h 39m 37s. Rate: 7.9 symbols/min [2025-10-21T18:20:27.687046] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:27.740904] [DEBUG] [LOCAL ] DOC: Loaded 53556 existing records from primary storage. [2025-10-21T18:20:27.741232] [INFO ] [MAIN ] DOC: Loaded 53556 existing records. [2025-10-21T18:20:27.931735] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:20:27.931945] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-21T18:20:27.931992] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-21T18:20:27.932892] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-21T18:20:27.932954] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-21T18:20:28.158395] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-21T18:20:28.309260] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:28.951095] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-21T18:20:29.587231] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-21T18:20:29.720991] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:20:29.751024] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-21T18:20:30.535892] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T18:20:30.550979] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-21T18:20:31.119291] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T18:20:31.351029] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-21T18:20:32.059797] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:20:32.151040] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-21T18:20:32.648761] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:20:32.951070] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-21T18:20:33.637876] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T18:20:33.751038] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-21T18:20:34.551036] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-21T18:20:34.595602] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T18:20:35.351058] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-21T18:20:35.632233] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T18:20:35.804576] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-21T18:20:36.151085] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-21T18:20:36.747629] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T18:20:36.951034] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-21T18:20:37.753950] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-21T18:20:37.758290] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T18:20:37.765754] [INFO ] [REMOTE ] DNOW: Full fetch complete (63520 records). [2025-10-21T18:20:37.765883] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-21T18:20:38.149708] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-21T18:20:38.149805] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-21T18:20:38.150588] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-21T18:20:38.150631] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-21T18:20:38.152001] [DEBUG] [LOCAL ] DNOW: Trimmed 63520 records to 43799 (keeping 200 days of data) [2025-10-21T18:20:38.403894] [DEBUG] [LOCAL ] DNOW: Primary data saved (43799 records). [2025-10-21T18:20:38.404030] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-21T18:20:38.404678] [INFO ] [MAIN ] Update Progress: 635/2366 symbols completed. DNOW took 37.6s. Estimated remaining: 3h 39m 38s. Rate: 7.9 symbols/min [2025-10-21T18:20:38.557797] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-21T18:20:38.576883] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:38.577032] [DEBUG] [LOCAL ] DOCN: No existing data file found in primary storage. [2025-10-21T18:20:38.577067] [WARN ] [MAIN ] DOCN: No existing data found, performing full refresh instead. [2025-10-21T18:20:38.577174] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-21T18:20:38.577214] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-21T18:20:38.577255] [DEBUG] [LOCAL ] DOCN: No primary data file found to delete. [2025-10-21T18:20:38.577286] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-21T18:20:38.936333] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:39.141032] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-21T18:20:39.149201] [INFO ] [REMOTE ] DNA: Full fetch complete (71253 records). [2025-10-21T18:20:39.149398] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-21T18:20:39.357926] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-21T18:20:39.565271] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-21T18:20:39.565385] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-21T18:20:39.566396] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-21T18:20:39.566510] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-21T18:20:39.577710] [DEBUG] [LOCAL ] DNA: Trimmed 71253 records to 48547 (keeping 200 days of data) [2025-10-21T18:20:39.595747] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T18:20:39.879439] [DEBUG] [LOCAL ] DNA: Primary data saved (48547 records). [2025-10-21T18:20:39.879734] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-21T18:20:39.879903] [INFO ] [MAIN ] Update Progress: 636/2366 symbols completed. DNA took 40.9s. Estimated remaining: 3h 39m 14s. Rate: 7.9 symbols/min [2025-10-21T18:20:40.049820] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:20:40.050091] [DEBUG] [LOCAL ] DOCS: No existing data file found in primary storage. [2025-10-21T18:20:40.050163] [WARN ] [MAIN ] DOCS: No existing data found, performing full refresh instead. [2025-10-21T18:20:40.050278] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-21T18:20:40.050343] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-21T18:20:40.050590] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-21T18:20:40.050833] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-21T18:20:40.151811] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-21T18:20:40.284632] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T18:20:40.438137] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:20:40.791505] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T18:20:40.951092] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-21T18:20:41.751011] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-21T18:20:42.156090] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T18:20:42.551099] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-21T18:20:42.774050] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T18:20:43.290790] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T18:20:43.351062] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-21T18:20:44.020231] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T18:20:44.151036] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-21T18:20:44.726577] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T18:20:44.732249] [INFO ] [REMOTE ] DNP: Full fetch complete (48643 records). [2025-10-21T18:20:44.732413] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-21T18:20:44.957158] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-21T18:20:45.129501] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-21T18:20:45.129601] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-21T18:20:45.130366] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-21T18:20:45.130433] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-21T18:20:45.131611] [DEBUG] [LOCAL ] DNP: Trimmed 48643 records to 33093 (keeping 200 days of data) [2025-10-21T18:20:45.328694] [DEBUG] [LOCAL ] DNP: Primary data saved (33093 records). [2025-10-21T18:20:45.328843] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-21T18:20:45.328927] [INFO ] [MAIN ] Update Progress: 637/2366 symbols completed. DNP took 26.4s. Estimated remaining: 3h 39m 1s. Rate: 7.9 symbols/min [2025-10-21T18:20:45.751100] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-21T18:20:46.118752] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T18:20:46.551034] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-21T18:20:46.800311] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T18:20:47.351103] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-21T18:20:47.524532] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T18:20:48.151075] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-21T18:20:48.298239] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T18:20:48.951050] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-21T18:20:49.304268] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:20:49.681605] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:20:49.751070] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-21T18:20:50.551020] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-21T18:20:51.015963] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T18:20:51.351020] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-21T18:20:51.731806] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T18:20:52.121962] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:20:52.151033] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-21T18:20:52.951027] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-21T18:20:53.368533] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T18:20:53.751075] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-21T18:20:53.894575] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T18:20:54.551031] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-21T18:20:55.033728] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-21T18:20:55.351109] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-21T18:20:55.577713] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T18:20:56.151037] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-21T18:20:56.243871] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:20:56.828948] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:20:56.951025] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-21T18:20:57.676825] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:20:57.685183] [INFO ] [REMOTE ] DOC: Full fetch complete (77576 records). [2025-10-21T18:20:57.685330] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-21T18:20:57.758233] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-21T18:20:58.079035] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-21T18:20:58.079111] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-21T18:20:58.080011] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-21T18:20:58.080071] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-21T18:20:58.081422] [DEBUG] [LOCAL ] DOC: Trimmed 77576 records to 53555 (keeping 200 days of data) [2025-10-21T18:20:58.406384] [DEBUG] [LOCAL ] DOC: Primary data saved (53555 records). [2025-10-21T18:20:58.406604] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-21T18:20:58.407093] [INFO ] [MAIN ] Update Progress: 638/2366 symbols completed. DOC took 30.9s. Estimated remaining: 3h 39m 8s. Rate: 7.9 symbols/min [2025-10-21T18:20:58.608056] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T18:20:58.618949] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-21T18:20:59.499126] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T18:20:59.510428] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-21T18:21:00.364917] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T18:21:00.375337] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-21T18:21:02.044248] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-21T18:21:02.055375] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-21T18:21:02.350891] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:21:02.361133] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-21T18:21:04.143322] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:21:04.150282] [INFO ] [REMOTE ] DOCS: Full fetch complete (73501 records). [2025-10-21T18:21:04.150440] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-21T18:21:04.151314] [FATAL] [VALIDATOR ] DOCS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:21:04.151407] [FATAL] [MAIN ] DOCS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:21:04.151450] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:21:04.151514] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-21T18:21:04.151578] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-21T18:21:04.151613] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-10-21T18:21:04.151686] [DEBUG] [LOCAL ] DOCS: No derivative data file found to delete. [2025-10-21T18:21:04.151763] [INFO ] [MAIN ] Update Progress: 639/2366 symbols completed. DOCS took 24.3s. Estimated remaining: 3h 38m 55s. Rate: 7.9 symbols/min [2025-10-21T18:21:04.201083] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T18:21:04.212910] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-21T18:21:06.230373] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-21T18:21:06.241878] [INFO ] [REMOTE ] DOCN: Full fetch complete (72888 records). [2025-10-21T18:21:06.242070] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-21T18:21:06.650447] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-21T18:21:06.650556] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-21T18:21:06.651525] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-21T18:21:06.651616] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-21T18:21:06.653290] [DEBUG] [LOCAL ] DOCN: Trimmed 72888 records to 51135 (keeping 200 days of data) [2025-10-21T18:21:06.946966] [DEBUG] [LOCAL ] DOCN: Primary data saved (51135 records). [2025-10-21T18:21:06.947109] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-21T18:21:06.947182] [INFO ] [MAIN ] Update Progress: 640/2366 symbols completed. DOCN took 28.5s. Estimated remaining: 3h 38m 35s. Rate: 7.9 symbols/min [2025-10-21T18:21:07.566910] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:07.630957] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:07.680803] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:07.664121] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:07.734575] [DEBUG] [LOCAL ] DOUG: Loaded 33965 existing records from primary storage. [2025-10-21T18:21:07.735222] [INFO ] [MAIN ] DOUG: Loaded 33965 existing records. [2025-10-21T18:21:07.832286] [DEBUG] [LOCAL ] DOLE: Loaded 39134 existing records from primary storage. [2025-10-21T18:21:07.878052] [DEBUG] [LOCAL ] DOV: Loaded 45575 existing records from primary storage. [2025-10-21T18:21:07.861574] [INFO ] [MAIN ] DOLE: Loaded 39134 existing records. [2025-10-21T18:21:07.919013] [INFO ] [MAIN ] DOV: Loaded 45575 existing records. [2025-10-21T18:21:07.991487] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-21T18:21:08.109045] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-21T18:21:08.136174] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:08.287554] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-21T18:21:08.312489] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-21T18:21:08.412071] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-21T18:21:08.458858] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:08.436722] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-21T18:21:08.472340] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-21T18:21:08.525147] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-21T18:21:08.586043] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:08.614437] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-21T18:21:08.650420] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-21T18:21:08.642591] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-21T18:21:08.676862] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:08.673813] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-21T18:21:08.691980] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-21T18:21:08.707673] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-21T18:21:08.698044] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-21T18:21:08.707843] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-21T18:21:08.732865] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-21T18:21:08.738146] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-21T18:21:09.582140] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:09.775991] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-21T18:21:09.987290] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:10.039785] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-21T18:21:10.095853] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:10.106772] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-21T18:21:10.169827] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:10.170219] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-21T18:21:11.223532] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:21:11.231477] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-21T18:21:11.503856] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T18:21:11.511196] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-21T18:21:11.897247] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T18:21:11.907089] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-21T18:21:12.020471] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T18:21:12.031291] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-21T18:21:12.455907] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T18:21:12.463183] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-21T18:21:12.574034] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:21:12.580515] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-21T18:21:13.401159] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T18:21:13.409563] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-21T18:21:13.632405] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:21:13.646928] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-21T18:21:13.672401] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T18:21:13.680531] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-21T18:21:13.773306] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T18:21:13.781183] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-21T18:21:15.533712] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:21:15.541441] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-21T18:21:15.627991] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T18:21:15.637925] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-21T18:21:15.933900] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T18:21:16.008192] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-21T18:21:16.151009] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-21T18:21:16.956123] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-21T18:21:16.973871] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T18:21:17.751056] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-21T18:21:17.843379] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-21T18:21:18.476562] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-21T18:21:18.551055] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-21T18:21:18.722714] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T18:21:19.314456] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-21T18:21:19.350986] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-21T18:21:20.150986] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-21T18:21:20.708096] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T18:21:20.861588] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T18:21:20.951010] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-21T18:21:21.751041] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-21T18:21:21.901412] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T18:21:22.556106] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-21T18:21:22.573763] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T18:21:23.351120] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-21T18:21:24.019469] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T18:21:24.067413] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-21T18:21:24.151046] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-21T18:21:24.951064] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-21T18:21:25.182552] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:21:25.751005] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-21T18:21:26.348773] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-21T18:21:26.467508] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T18:21:26.550986] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-21T18:21:27.351000] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-21T18:21:27.437008] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:21:28.151030] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-21T18:21:28.246799] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T18:21:28.662687] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T18:21:28.951095] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-21T18:21:29.751008] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-21T18:21:29.831115] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T18:21:30.430491] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T18:21:30.436754] [INFO ] [REMOTE ] DOLE: Full fetch complete (54374 records). [2025-10-21T18:21:30.436881] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-21T18:21:30.437492] [FATAL] [VALIDATOR ] DOLE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:21:30.437594] [FATAL] [MAIN ] DOLE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:21:30.437680] [WARN ] [MAIN ] DOLE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:21:30.437752] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-21T18:21:30.437814] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-21T18:21:30.437849] [INFO ] [LOCAL ] DOLE: Starting deletion of derivative data. [2025-10-21T18:21:30.438109] [DEBUG] [LOCAL ] DOLE: Deleted derivative data file. [2025-10-21T18:21:30.438212] [INFO ] [MAIN ] Update Progress: 641/2366 symbols completed. DOLE took 23.5s. Estimated remaining: 3h 39m 10s. Rate: 7.9 symbols/min [2025-10-21T18:21:30.556081] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-21T18:21:30.607538] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:30.623225] [DEBUG] [LOCAL ] DPG: Loaded 13502 existing records from primary storage. [2025-10-21T18:21:30.623442] [INFO ] [MAIN ] DPG: Loaded 13502 existing records. [2025-10-21T18:21:30.795879] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:30.796092] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-21T18:21:30.796137] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-21T18:21:30.796279] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-21T18:21:30.796316] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-21T18:21:31.144290] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:31.351009] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-21T18:21:31.523308] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T18:21:31.528092] [INFO ] [REMOTE ] DOUG: Full fetch complete (50023 records). [2025-10-21T18:21:31.528199] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-21T18:21:31.935635] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-21T18:21:31.935744] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-21T18:21:31.936450] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-21T18:21:31.936489] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-21T18:21:31.937482] [DEBUG] [LOCAL ] DOUG: Trimmed 50023 records to 33846 (keeping 200 days of data) [2025-10-21T18:21:32.128555] [DEBUG] [LOCAL ] DOUG: Primary data saved (33846 records). [2025-10-21T18:21:32.128775] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-21T18:21:32.129473] [INFO ] [MAIN ] Update Progress: 642/2366 symbols completed. DOUG took 25.2s. Estimated remaining: 3h 38m 46s. Rate: 7.9 symbols/min [2025-10-21T18:21:32.160164] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-21T18:21:32.304933] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:32.346533] [DEBUG] [LOCAL ] DQ: Loaded 43901 existing records from primary storage. [2025-10-21T18:21:32.346840] [INFO ] [MAIN ] DQ: Loaded 43901 existing records. [2025-10-21T18:21:32.541080] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:32.550812] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-21T18:21:32.552053] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T18:21:32.551216] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-21T18:21:32.561378] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-21T18:21:32.561773] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-21T18:21:32.912193] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:32.950977] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-21T18:21:33.149410] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:21:33.751089] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-21T18:21:34.530949] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T18:21:34.550981] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-21T18:21:34.594992] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-21T18:21:34.724339] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:21:35.351043] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-21T18:21:35.436459] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T18:21:36.151043] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-21T18:21:36.951035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-21T18:21:37.180092] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T18:21:37.667883] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-21T18:21:37.751009] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-21T18:21:38.551133] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-21T18:21:38.597836] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:21:38.656953] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T18:21:39.351072] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-21T18:21:40.151090] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-21T18:21:40.777933] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-21T18:21:40.951095] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-21T18:21:41.373667] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T18:21:41.414265] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T18:21:41.751081] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-21T18:21:42.551030] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-21T18:21:42.802198] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:21:43.351060] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-21T18:21:43.475739] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (2.52 seconds). [2025-10-21T18:21:43.483566] [INFO ] [REMOTE ] DOW: Full fetch complete (77520 records). [2025-10-21T18:21:43.483790] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-21T18:21:43.484623] [FATAL] [VALIDATOR ] DOW: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:21:43.484750] [FATAL] [MAIN ] DOW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:21:43.484794] [WARN ] [MAIN ] DOW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:21:43.484834] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-21T18:21:43.484891] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-21T18:21:43.484928] [INFO ] [LOCAL ] DOW: Starting deletion of derivative data. [2025-10-21T18:21:43.485055] [DEBUG] [LOCAL ] DOW: Deleted derivative data file. [2025-10-21T18:21:43.485813] [INFO ] [MAIN ] Update Progress: 643/2366 symbols completed. DOW took 36.5s. Estimated remaining: 3h 38m 49s. Rate: 7.9 symbols/min [2025-10-21T18:21:43.659159] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:43.697595] [DEBUG] [LOCAL ] DRD: Loaded 37805 existing records from primary storage. [2025-10-21T18:21:43.697920] [INFO ] [MAIN ] DRD: Loaded 37805 existing records. [2025-10-21T18:21:43.894468] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:43.894700] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-21T18:21:43.894758] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-21T18:21:43.894973] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-21T18:21:43.895046] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-21T18:21:44.156137] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-21T18:21:44.291447] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:44.361503] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T18:21:44.411289] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T18:21:44.418804] [INFO ] [REMOTE ] DOV: Full fetch complete (66000 records). [2025-10-21T18:21:44.418973] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-21T18:21:44.799699] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-21T18:21:44.799811] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-21T18:21:44.800820] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-21T18:21:44.800886] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-21T18:21:44.802247] [DEBUG] [LOCAL ] DOV: Trimmed 66000 records to 45577 (keeping 200 days of data) [2025-10-21T18:21:44.978872] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-21T18:21:45.084480] [DEBUG] [LOCAL ] DOV: Primary data saved (45577 records). [2025-10-21T18:21:45.084612] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-21T18:21:45.084718] [INFO ] [MAIN ] Update Progress: 644/2366 symbols completed. DOV took 38.1s. Estimated remaining: 3h 38m 25s. Rate: 7.9 symbols/min [2025-10-21T18:21:45.253511] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:45.295759] [DEBUG] [LOCAL ] DRH: Loaded 50315 existing records from primary storage. [2025-10-21T18:21:45.296068] [INFO ] [MAIN ] DRH: Loaded 50315 existing records. [2025-10-21T18:21:45.469034] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:45.469240] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-21T18:21:45.469301] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-21T18:21:45.470032] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-21T18:21:45.470116] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-21T18:21:45.756238] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-21T18:21:45.822981] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:46.010849] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T18:21:46.547135] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-21T18:21:46.556255] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-21T18:21:46.989887] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T18:21:47.351078] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-21T18:21:48.061485] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T18:21:48.151030] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-21T18:21:48.634899] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:21:48.951035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-21T18:21:49.395588] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T18:21:49.398271] [INFO ] [REMOTE ] DPG: Full fetch complete (19026 records). [2025-10-21T18:21:49.398346] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-21T18:21:49.756362] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-21T18:21:49.766944] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-21T18:21:49.767154] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-21T18:21:49.767681] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-21T18:21:49.767745] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-21T18:21:49.768377] [DEBUG] [LOCAL ] DPG: Trimmed 19026 records to 13478 (keeping 200 days of data) [2025-10-21T18:21:49.856138] [DEBUG] [LOCAL ] DPG: Primary data saved (13478 records). [2025-10-21T18:21:49.856252] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-21T18:21:49.856331] [INFO ] [MAIN ] Update Progress: 645/2366 symbols completed. DPG took 19.4s. Estimated remaining: 3h 38m 10s. Rate: 7.9 symbols/min [2025-10-21T18:21:50.029622] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:21:50.076954] [DEBUG] [LOCAL ] DRI: Loaded 47643 existing records from primary storage. [2025-10-21T18:21:50.077274] [INFO ] [MAIN ] DRI: Loaded 47643 existing records. [2025-10-21T18:21:50.251171] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:21:50.251406] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-21T18:21:50.251473] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-21T18:21:50.252356] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-21T18:21:50.252414] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-21T18:21:50.556175] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-21T18:21:50.616719] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:21:50.832732] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T18:21:51.111290] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:21:51.351036] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-21T18:21:52.151063] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-21T18:21:52.209179] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T18:21:52.951045] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-21T18:21:53.152475] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:21:53.546166] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T18:21:53.751054] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-21T18:21:54.551062] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-21T18:21:54.609067] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:21:55.351021] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-21T18:21:55.353423] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:21:56.151023] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-21T18:21:56.268049] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:21:56.752535] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T18:21:56.951055] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-21T18:21:57.756243] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-21T18:21:57.773545] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:21:58.460911] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:21:58.551016] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-21T18:21:59.351049] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-21T18:21:59.688056] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T18:22:00.151064] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-21T18:22:00.296524] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:22:00.951073] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-21T18:22:01.196410] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T18:22:01.751051] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-21T18:22:01.899243] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T18:22:02.236529] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:22:02.551031] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-21T18:22:03.351020] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-21T18:22:03.588292] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T18:22:04.151093] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-21T18:22:04.358726] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T18:22:04.672259] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T18:22:04.950992] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-21T18:22:05.557529] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T18:22:05.751003] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-21T18:22:06.551031] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-21T18:22:06.591893] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T18:22:06.599474] [INFO ] [REMOTE ] DQ: Full fetch complete (63629 records). [2025-10-21T18:22:06.599696] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-21T18:22:06.990140] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-21T18:22:06.990226] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-21T18:22:06.991004] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-21T18:22:06.991067] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-21T18:22:06.992275] [DEBUG] [LOCAL ] DQ: Trimmed 63629 records to 43827 (keeping 200 days of data) [2025-10-21T18:22:07.244383] [DEBUG] [LOCAL ] DQ: Primary data saved (43827 records). [2025-10-21T18:22:07.244560] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-21T18:22:07.244934] [INFO ] [MAIN ] Update Progress: 646/2366 symbols completed. DQ took 35.1s. Estimated remaining: 3h 38m 28s. Rate: 7.9 symbols/min [2025-10-21T18:22:07.351929] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-21T18:22:07.427503] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:07.438869] [DEBUG] [LOCAL ] DRLL: Loaded 8856 existing records from primary storage. [2025-10-21T18:22:07.439087] [INFO ] [MAIN ] DRLL: Loaded 8856 existing records. [2025-10-21T18:22:07.652994] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:07.647226] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T18:22:07.653222] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-21T18:22:07.663155] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-21T18:22:07.663566] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-21T18:22:07.663621] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-21T18:22:08.048119] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:08.069018] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T18:22:08.151005] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-21T18:22:08.951053] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-21T18:22:08.979263] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T18:22:09.327384] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T18:22:09.751029] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-21T18:22:10.551027] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-21T18:22:10.744147] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:22:11.351059] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-21T18:22:11.443608] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:22:12.150999] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-21T18:22:12.233448] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T18:22:12.515434] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T18:22:12.951093] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-21T18:22:13.751089] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-21T18:22:13.903061] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T18:22:14.181560] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T18:22:14.190115] [INFO ] [REMOTE ] DRD: Full fetch complete (51996 records). [2025-10-21T18:22:14.190301] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-21T18:22:14.556199] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-21T18:22:14.652379] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-21T18:22:14.652684] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-21T18:22:14.653384] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-21T18:22:14.653426] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-21T18:22:14.654790] [DEBUG] [LOCAL ] DRD: Trimmed 51996 records to 37887 (keeping 200 days of data) [2025-10-21T18:22:14.879434] [DEBUG] [LOCAL ] DRD: Primary data saved (37887 records). [2025-10-21T18:22:14.879578] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-21T18:22:14.880394] [INFO ] [MAIN ] Update Progress: 647/2366 symbols completed. DRD took 31.4s. Estimated remaining: 3h 38m 21s. Rate: 7.9 symbols/min [2025-10-21T18:22:15.046301] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:15.080967] [DEBUG] [LOCAL ] DSL: Loaded 29017 existing records from primary storage. [2025-10-21T18:22:15.081250] [INFO ] [MAIN ] DSL: Loaded 29017 existing records. [2025-10-21T18:22:15.256607] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:15.256818] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-21T18:22:15.256907] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-21T18:22:15.257213] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-21T18:22:15.257268] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-21T18:22:15.354483] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-21T18:22:15.623163] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:15.650684] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:22:16.151093] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-21T18:22:16.275055] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T18:22:16.447922] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T18:22:16.455612] [INFO ] [REMOTE ] DRH: Full fetch complete (71970 records). [2025-10-21T18:22:16.455781] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-21T18:22:16.878544] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-21T18:22:16.878732] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-21T18:22:16.879889] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-21T18:22:16.879966] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-21T18:22:16.881417] [DEBUG] [LOCAL ] DRH: Trimmed 71970 records to 50269 (keeping 200 days of data) [2025-10-21T18:22:16.955197] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-21T18:22:17.224978] [DEBUG] [LOCAL ] DRH: Primary data saved (50269 records). [2025-10-21T18:22:17.225110] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-21T18:22:17.225186] [INFO ] [MAIN ] Update Progress: 648/2366 symbols completed. DRH took 32.1s. Estimated remaining: 3h 37m 59s. Rate: 7.9 symbols/min [2025-10-21T18:22:17.396553] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:17.411820] [DEBUG] [LOCAL ] DSM: Loaded 14073 existing records from primary storage. [2025-10-21T18:22:17.412058] [INFO ] [MAIN ] DSM: Loaded 14073 existing records. [2025-10-21T18:22:17.602268] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:17.602631] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-21T18:22:17.602785] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-21T18:22:17.603049] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-21T18:22:17.603220] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-21T18:22:17.755975] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-21T18:22:17.828971] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T18:22:18.022188] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:18.025266] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:22:18.551048] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-21T18:22:19.124291] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:22:19.223428] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-21T18:22:19.351021] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-21T18:22:20.150995] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-21T18:22:20.951046] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-21T18:22:21.328867] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:22:21.487245] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:22:21.751074] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-21T18:22:21.791269] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T18:22:22.551038] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-21T18:22:22.799342] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T18:22:23.313209] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T18:22:23.350981] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-21T18:22:24.060265] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T18:22:24.151094] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-21T18:22:24.951046] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-21T18:22:25.447690] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T18:22:25.751049] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-21T18:22:26.049727] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T18:22:26.470277] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T18:22:26.472837] [INFO ] [REMOTE ] DRLL: Full fetch complete (14563 records). [2025-10-21T18:22:26.472930] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-21T18:22:26.556108] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-21T18:22:26.878517] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-21T18:22:26.878618] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-21T18:22:26.879105] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-21T18:22:26.879155] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-21T18:22:26.879701] [DEBUG] [LOCAL ] DRLL: Trimmed 14563 records to 8769 (keeping 200 days of data) [2025-10-21T18:22:26.937038] [DEBUG] [LOCAL ] DRLL: Primary data saved (8769 records). [2025-10-21T18:22:26.937215] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-21T18:22:26.937312] [INFO ] [MAIN ] Update Progress: 649/2366 symbols completed. DRLL took 19.7s. Estimated remaining: 3h 37m 57s. Rate: 7.9 symbols/min [2025-10-21T18:22:27.129491] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:27.133683] [DEBUG] [LOCAL ] DSMC: Loaded 1838 existing records from primary storage. [2025-10-21T18:22:27.133835] [INFO ] [MAIN ] DSMC: Loaded 1838 existing records. [2025-10-21T18:22:27.313385] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:27.313579] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-21T18:22:27.313668] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-21T18:22:27.313892] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-21T18:22:27.313957] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-21T18:22:27.356768] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-21T18:22:27.671119] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:28.151003] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-21T18:22:28.232013] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T18:22:28.634913] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-21T18:22:28.951031] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-21T18:22:29.113574] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:22:29.367893] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-21T18:22:29.375237] [INFO ] [REMOTE ] DRI: Full fetch complete (69567 records). [2025-10-21T18:22:29.375338] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-21T18:22:29.757340] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-21T18:22:29.759317] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-21T18:22:29.759372] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-21T18:22:29.760157] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-21T18:22:29.760305] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-21T18:22:29.761607] [DEBUG] [LOCAL ] DRI: Trimmed 69567 records to 47615 (keeping 200 days of data) [2025-10-21T18:22:30.089954] [DEBUG] [LOCAL ] DRI: Primary data saved (47615 records). [2025-10-21T18:22:30.090075] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-21T18:22:30.091029] [INFO ] [MAIN ] Update Progress: 650/2366 symbols completed. DRI took 40.2s. Estimated remaining: 3h 37m 38s. Rate: 7.9 symbols/min [2025-10-21T18:22:30.258151] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:30.258312] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-10-21T18:22:30.258347] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-10-21T18:22:30.258453] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-21T18:22:30.258492] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-21T18:22:30.258532] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-21T18:22:30.258562] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-21T18:22:30.350579] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T18:22:30.556119] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-21T18:22:30.614061] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:31.351076] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-21T18:22:31.821709] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T18:22:32.151042] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-21T18:22:32.641905] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:22:32.681616] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-21T18:22:32.951026] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-21T18:22:33.505837] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-21T18:22:33.751013] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-21T18:22:34.223185] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T18:22:34.551038] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-21T18:22:35.351034] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-21T18:22:35.504365] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T18:22:36.150997] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-21T18:22:36.547761] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T18:22:36.951040] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-21T18:22:37.235496] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T18:22:37.751045] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-21T18:22:38.219063] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-21T18:22:38.551029] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-21T18:22:38.960226] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T18:22:39.237061] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T18:22:39.351016] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-21T18:22:40.151030] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-21T18:22:40.498773] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T18:22:40.951039] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-21T18:22:41.163113] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:22:41.442793] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T18:22:41.751027] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-21T18:22:42.551034] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-21T18:22:42.689802] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T18:22:43.351043] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-21T18:22:43.828182] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T18:22:44.151073] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-21T18:22:44.383584] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T18:22:44.951027] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-21T18:22:45.300786] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T18:22:45.426205] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T18:22:45.751017] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-21T18:22:46.551023] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-21T18:22:46.728880] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T18:22:46.987041] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T18:22:47.350993] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-21T18:22:48.151005] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-21T18:22:48.334541] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T18:22:48.481220] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-21T18:22:48.951021] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-21T18:22:49.403465] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T18:22:49.404304] [INFO ] [REMOTE ] DSMC: Full fetch complete (2853 records). [2025-10-21T18:22:49.404372] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-21T18:22:49.404732] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:22:49.404814] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:22:49.404857] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:22:49.404894] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-21T18:22:49.404948] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-21T18:22:49.404983] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-21T18:22:49.405133] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-21T18:22:49.405216] [INFO ] [MAIN ] Update Progress: 651/2366 symbols completed. DSMC took 22.5s. Estimated remaining: 3h 38m 1s. Rate: 7.9 symbols/min [2025-10-21T18:22:49.574153] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:22:49.595849] [DEBUG] [LOCAL ] DSX: Loaded 23744 existing records from primary storage. [2025-10-21T18:22:49.596113] [INFO ] [MAIN ] DSX: Loaded 23744 existing records. [2025-10-21T18:22:49.752760] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-21T18:22:49.774739] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:22:49.775777] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-21T18:22:49.775882] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-21T18:22:49.776442] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-21T18:22:49.776506] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-21T18:22:50.138911] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:22:50.551031] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-21T18:22:50.836866] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:22:51.351022] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-21T18:22:51.654684] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:22:52.151021] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-21T18:22:52.951035] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-21T18:22:53.751073] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-21T18:23:05.688715] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (14.34 seconds). [2025-10-21T18:23:05.692002] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-21T18:23:06.013702] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (12.26 seconds). [2025-10-21T18:23:06.019006] [INFO ] [REMOTE ] DSL: Full fetch complete (41503 records). [2025-10-21T18:23:06.019143] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-21T18:23:06.019828] [FATAL] [VALIDATOR ] DSL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:23:06.019922] [FATAL] [MAIN ] DSL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:23:06.019963] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:23:06.020001] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-21T18:23:06.020059] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-21T18:23:06.020092] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-10-21T18:23:06.020276] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-10-21T18:23:06.020723] [INFO ] [MAIN ] Update Progress: 652/2366 symbols completed. DSL took 51.1s. Estimated remaining: 3h 38m 17s. Rate: 7.9 symbols/min [2025-10-21T18:23:06.196522] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:06.214020] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (14.06 seconds). [2025-10-21T18:23:06.220804] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-21T18:23:06.268084] [DEBUG] [LOCAL ] DT: Loaded 52952 existing records from primary storage. [2025-10-21T18:23:06.268458] [INFO ] [MAIN ] DT: Loaded 52952 existing records. [2025-10-21T18:23:06.459839] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (13.51 seconds). [2025-10-21T18:23:06.464370] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:06.470761] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-21T18:23:06.470856] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-21T18:23:06.470687] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-21T18:23:06.472487] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-21T18:23:06.472553] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-21T18:23:06.830042] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:06.830491] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-21T18:23:06.870508] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T18:23:06.874120] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-21T18:23:07.632212] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T18:23:07.638261] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-21T18:23:07.750411] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:23:07.752500] [INFO ] [REMOTE ] DSM: Full fetch complete (23865 records). [2025-10-21T18:23:07.752576] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-21T18:23:08.135023] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-21T18:23:08.135144] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-21T18:23:08.141638] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-21T18:23:08.144776] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-21T18:23:08.147996] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T18:23:08.152918] [DEBUG] [LOCAL ] DSM: Trimmed 23865 records to 14103 (keeping 200 days of data) [2025-10-21T18:23:08.152812] [INFO ] [REMOTE ] DSU: Full fetch complete (33156 records). [2025-10-21T18:23:08.153374] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-21T18:23:08.373461] [DEBUG] [LOCAL ] DSM: Primary data saved (14103 records). [2025-10-21T18:23:08.398242] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-21T18:23:08.435220] [INFO ] [MAIN ] Update Progress: 653/2366 symbols completed. DSM took 51.2s. Estimated remaining: 3h 37m 55s. Rate: 7.9 symbols/min [2025-10-21T18:23:08.819211] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-21T18:23:08.818913] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:08.819762] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-21T18:23:08.820965] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-21T18:23:08.822283] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-21T18:23:08.845801] [DEBUG] [LOCAL ] DSU: Trimmed 33156 records to 23023 (keeping 200 days of data) [2025-10-21T18:23:08.850499] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T18:23:08.848827] [DEBUG] [LOCAL ] DTB: Loaded 4937 existing records from primary storage. [2025-10-21T18:23:08.856634] [INFO ] [MAIN ] DTB: Loaded 4937 existing records. [2025-10-21T18:23:08.868959] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-21T18:23:09.199573] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:09.201846] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-21T18:23:09.201959] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-21T18:23:09.209621] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-21T18:23:09.209757] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-21T18:23:09.323630] [DEBUG] [LOCAL ] DSU: Primary data saved (23023 records). [2025-10-21T18:23:09.331459] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-21T18:23:09.331699] [INFO ] [MAIN ] Update Progress: 654/2366 symbols completed. DSU took 39.2s. Estimated remaining: 3h 37m 30s. Rate: 7.9 symbols/min [2025-10-21T18:23:09.502825] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-21T18:23:09.571197] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-21T18:23:09.725559] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:09.817845] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:09.818237] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-21T18:23:09.861768] [DEBUG] [LOCAL ] DTE: Loaded 47244 existing records from primary storage. [2025-10-21T18:23:09.862097] [INFO ] [MAIN ] DTE: Loaded 47244 existing records. [2025-10-21T18:23:10.060661] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:10.060916] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-21T18:23:10.060974] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-21T18:23:10.061174] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-21T18:23:10.061217] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-21T18:23:10.357447] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-21T18:23:10.399151] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-21T18:23:10.442395] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:10.454906] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-21T18:23:10.456039] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T18:23:10.461950] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-21T18:23:10.979184] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:23:10.980590] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-21T18:23:11.376902] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T18:23:11.387803] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-21T18:23:11.535749] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T18:23:11.537120] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-21T18:23:11.656584] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T18:23:11.662461] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-21T18:23:11.831289] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:23:11.841417] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-21T18:23:11.994458] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:23:11.996124] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-21T18:23:12.539145] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T18:23:12.540631] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-21T18:23:12.734916] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T18:23:12.740542] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-21T18:23:13.016980] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T18:23:13.018965] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-21T18:23:13.054491] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:23:13.090905] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-21T18:23:13.093216] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T18:23:13.102481] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-21T18:23:13.580180] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T18:23:13.585401] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-21T18:23:13.672478] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T18:23:13.751074] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-21T18:23:14.140319] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-21T18:23:14.551008] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-21T18:23:14.615560] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T18:23:14.641207] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T18:23:14.859395] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T18:23:15.291376] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T18:23:15.351030] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-21T18:23:16.151058] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-21T18:23:16.951079] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-21T18:23:17.491432] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-21T18:23:17.750994] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-21T18:23:17.824529] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T18:23:17.825769] [INFO ] [REMOTE ] DTB: Full fetch complete (6539 records). [2025-10-21T18:23:17.825851] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-21T18:23:18.185516] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T18:23:18.283206] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-21T18:23:18.283283] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-21T18:23:18.283467] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-21T18:23:18.283508] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-21T18:23:18.283930] [DEBUG] [LOCAL ] DTB: Trimmed 6539 records to 4919 (keeping 200 days of data) [2025-10-21T18:23:18.315681] [DEBUG] [LOCAL ] DTB: Primary data saved (4919 records). [2025-10-21T18:23:18.315809] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-21T18:23:18.315890] [INFO ] [MAIN ] Update Progress: 655/2366 symbols completed. DTB took 9.8s. Estimated remaining: 3h 37m 26s. Rate: 7.9 symbols/min [2025-10-21T18:23:18.501997] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:18.502155] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-21T18:23:18.502190] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-21T18:23:18.502328] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-21T18:23:18.502368] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-21T18:23:18.502407] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-21T18:23:18.502438] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-21T18:23:18.556310] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-21T18:23:18.862611] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:19.351049] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-21T18:23:19.595169] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T18:23:19.801274] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-21T18:23:19.931974] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T18:23:19.936070] [INFO ] [REMOTE ] DSX: Full fetch complete (35626 records). [2025-10-21T18:23:19.936140] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-21T18:23:20.156276] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-21T18:23:20.321013] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-21T18:23:20.321094] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-21T18:23:20.321668] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-21T18:23:20.321728] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-21T18:23:20.322518] [DEBUG] [LOCAL ] DSX: Trimmed 35626 records to 23594 (keeping 200 days of data) [2025-10-21T18:23:20.454159] [DEBUG] [LOCAL ] DSX: Primary data saved (23594 records). [2025-10-21T18:23:20.454281] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-21T18:23:20.454371] [INFO ] [MAIN ] Update Progress: 656/2366 symbols completed. DSX took 31.0s. Estimated remaining: 3h 37m 4s. Rate: 7.9 symbols/min [2025-10-21T18:23:20.627770] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:20.635191] [DEBUG] [LOCAL ] DTG: Loaded 5735 existing records from primary storage. [2025-10-21T18:23:20.635348] [INFO ] [MAIN ] DTG: Loaded 5735 existing records. [2025-10-21T18:23:20.818488] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:20.818733] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-21T18:23:20.818786] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-21T18:23:20.818963] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-21T18:23:20.819020] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-21T18:23:20.960730] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-21T18:23:21.192695] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:21.434062] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T18:23:21.751035] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-21T18:23:22.035823] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T18:23:22.263695] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T18:23:22.551049] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-21T18:23:23.351082] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-21T18:23:23.852721] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T18:23:24.151005] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-21T18:23:24.413977] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T18:23:24.951038] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-21T18:23:25.699407] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:23:25.751037] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-21T18:23:26.551046] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-21T18:23:26.702014] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T18:23:27.305118] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T18:23:27.350991] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-21T18:23:27.454091] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T18:23:27.689979] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T18:23:28.151042] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-21T18:23:28.951025] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-21T18:23:29.750992] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-21T18:23:30.165072] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T18:23:30.174880] [INFO ] [REMOTE ] DT: Full fetch complete (76898 records). [2025-10-21T18:23:30.175056] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-21T18:23:30.401291] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T18:23:30.556147] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-21T18:23:30.635383] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-21T18:23:30.635504] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-21T18:23:30.636561] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-21T18:23:30.636625] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-21T18:23:30.638189] [DEBUG] [LOCAL ] DT: Trimmed 76898 records to 52954 (keeping 200 days of data) [2025-10-21T18:23:30.773283] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T18:23:30.985289] [DEBUG] [LOCAL ] DT: Primary data saved (52954 records). [2025-10-21T18:23:30.985419] [INFO ] [MAIN ] DT: Full history saved. [2025-10-21T18:23:30.986216] [INFO ] [MAIN ] Update Progress: 657/2366 symbols completed. DT took 25.0s. Estimated remaining: 3h 37m 4s. Rate: 7.9 symbols/min [2025-10-21T18:23:31.156407] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:31.156552] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-21T18:23:31.156590] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-21T18:23:31.156722] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-21T18:23:31.156768] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-21T18:23:31.156810] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-21T18:23:31.156843] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-21T18:23:31.360958] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-21T18:23:31.389330] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T18:23:31.540615] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:32.151037] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-21T18:23:32.756572] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T18:23:32.787053] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T18:23:32.951035] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-21T18:23:33.456855] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-21T18:23:33.751043] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-21T18:23:34.350634] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T18:23:34.551041] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-21T18:23:35.351041] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-21T18:23:35.579540] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:23:35.579841] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-21T18:23:35.579942] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:23:35.580029] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-21T18:23:35.580131] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:23:35.580223] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-21T18:23:35.580307] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-21T18:23:35.580345] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-21T18:23:35.580385] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-21T18:23:35.580430] [INFO ] [MAIN ] Update Progress: 658/2366 symbols completed. DTK took 4.6s. Estimated remaining: 3h 36m 49s. Rate: 7.9 symbols/min [2025-10-21T18:23:35.762368] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:35.806365] [DEBUG] [LOCAL ] DTM: Loaded 43821 existing records from primary storage. [2025-10-21T18:23:35.806688] [INFO ] [MAIN ] DTM: Loaded 43821 existing records. [2025-10-21T18:23:35.984853] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:35.985065] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-21T18:23:35.985119] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-21T18:23:35.985344] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-21T18:23:35.985400] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-21T18:23:36.167787] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-21T18:23:36.373193] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:36.446523] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:23:36.591684] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T18:23:36.951040] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-21T18:23:37.751023] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-21T18:23:38.527054] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T18:23:38.550978] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-21T18:23:38.592313] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T18:23:38.599589] [INFO ] [REMOTE ] DTE: Full fetch complete (68916 records). [2025-10-21T18:23:38.599776] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-21T18:23:38.992824] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-21T18:23:38.992908] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-21T18:23:38.993940] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-21T18:23:38.994002] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-21T18:23:38.995364] [DEBUG] [LOCAL ] DTE: Trimmed 68916 records to 47181 (keeping 200 days of data) [2025-10-21T18:23:39.287612] [DEBUG] [LOCAL ] DTE: Primary data saved (47181 records). [2025-10-21T18:23:39.287758] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-21T18:23:39.287838] [INFO ] [MAIN ] Update Progress: 659/2366 symbols completed. DTE took 30.0s. Estimated remaining: 3h 36m 31s. Rate: 7.9 symbols/min [2025-10-21T18:23:39.356213] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-21T18:23:39.465021] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:39.465167] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-21T18:23:39.465202] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-21T18:23:39.465308] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-21T18:23:39.465348] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-21T18:23:39.465407] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-21T18:23:39.465439] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-21T18:23:39.715312] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-21T18:23:39.826222] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:40.150988] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-21T18:23:40.242301] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T18:23:40.832003] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T18:23:40.951064] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-21T18:23:41.395991] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-21T18:23:41.751002] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-21T18:23:42.551020] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-21T18:23:42.986356] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T18:23:42.987310] [INFO ] [REMOTE ] DTF: Full fetch complete (1758 records). [2025-10-21T18:23:42.987377] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-21T18:23:43.174800] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-21T18:23:43.174966] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:23:43.175032] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:23:43.175102] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-21T18:23:43.175162] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-21T18:23:43.175197] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-21T18:23:43.175234] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-21T18:23:43.175288] [INFO ] [MAIN ] Update Progress: 660/2366 symbols completed. DTF took 24.9s. Estimated remaining: 3h 36m 14s. Rate: 7.9 symbols/min [2025-10-21T18:23:43.346107] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:43.351005] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-21T18:23:43.399337] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-21T18:23:43.399678] [INFO ] [MAIN ] DUK: Loaded 53437 existing records. [2025-10-21T18:23:43.589341] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:43.589580] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-21T18:23:43.589796] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-21T18:23:43.600239] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-21T18:23:43.613823] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-21T18:23:43.696616] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:23:43.755435] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-21T18:23:43.999799] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:44.151021] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-21T18:23:44.833206] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T18:23:44.951088] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-21T18:23:45.751049] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-21T18:23:46.551044] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-21T18:23:46.567496] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T18:23:46.675516] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:23:47.182051] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T18:23:47.351041] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-21T18:23:48.067551] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T18:23:48.069243] [INFO ] [REMOTE ] DTG: Full fetch complete (8563 records). [2025-10-21T18:23:48.069353] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-21T18:23:48.069829] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:23:48.069922] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:23:48.069965] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:23:48.070004] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-21T18:23:48.070061] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-21T18:23:48.070096] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-21T18:23:48.070271] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-10-21T18:23:48.070359] [INFO ] [MAIN ] Update Progress: 661/2366 symbols completed. DTG took 27.6s. Estimated remaining: 3h 35m 59s. Rate: 7.9 symbols/min [2025-10-21T18:23:48.156223] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-21T18:23:48.266077] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:23:48.273235] [DEBUG] [LOCAL ] DUKB: Loaded 6196 existing records from primary storage. [2025-10-21T18:23:48.273403] [INFO ] [MAIN ] DUKB: Loaded 6196 existing records. [2025-10-21T18:23:48.452781] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:23:48.452987] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-21T18:23:48.453034] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-21T18:23:48.453204] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-21T18:23:48.453260] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-21T18:23:48.864063] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:23:48.951018] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-21T18:23:49.751014] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-21T18:23:49.877828] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T18:23:49.912996] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T18:23:50.308197] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T18:23:50.551015] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-21T18:23:50.977512] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T18:23:51.351057] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-21T18:23:52.151068] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-21T18:23:52.834314] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T18:23:52.951040] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-21T18:23:53.251241] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T18:23:53.751020] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-21T18:23:54.546139] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T18:23:54.554173] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-21T18:23:55.153329] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T18:23:55.351052] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-21T18:23:55.558833] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T18:23:55.910046] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T18:23:56.151082] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-21T18:23:56.730005] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T18:23:56.951078] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-21T18:23:57.751028] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-21T18:23:58.551076] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-21T18:23:58.630277] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T18:23:58.985428] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-21T18:23:59.351057] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-21T18:23:59.408269] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:23:59.947565] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T18:24:00.151061] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-21T18:24:00.951028] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-21T18:24:01.751056] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-21T18:24:01.927894] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T18:24:01.941691] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T18:24:02.551035] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-21T18:24:03.351102] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-21T18:24:03.720978] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T18:24:04.080078] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T18:24:04.160491] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-21T18:24:04.165481] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T18:24:04.748818] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T18:24:04.951018] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-21T18:24:05.751037] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-21T18:24:06.301277] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T18:24:06.555409] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-21T18:24:06.560052] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T18:24:06.568229] [INFO ] [REMOTE ] DTM: Full fetch complete (65133 records). [2025-10-21T18:24:06.568376] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-21T18:24:06.989198] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-21T18:24:06.989296] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-21T18:24:06.990311] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-21T18:24:06.990380] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-21T18:24:06.991873] [DEBUG] [LOCAL ] DTM: Trimmed 65133 records to 43736 (keeping 200 days of data) [2025-10-21T18:24:07.286956] [DEBUG] [LOCAL ] DTM: Primary data saved (43736 records). [2025-10-21T18:24:07.287095] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-21T18:24:07.287853] [INFO ] [MAIN ] Update Progress: 662/2366 symbols completed. DTM took 31.7s. Estimated remaining: 3h 36m 21s. Rate: 7.9 symbols/min [2025-10-21T18:24:07.357432] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-21T18:24:07.389785] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T18:24:07.485309] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:07.539595] [DEBUG] [LOCAL ] DV: Loaded 51250 existing records from primary storage. [2025-10-21T18:24:07.539965] [INFO ] [MAIN ] DV: Loaded 51250 existing records. [2025-10-21T18:24:07.717940] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:07.718199] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-21T18:24:07.718269] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-21T18:24:07.719160] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-21T18:24:07.719217] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-21T18:24:08.090459] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:08.151011] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-21T18:24:08.294766] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T18:24:08.765746] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T18:24:08.951029] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-21T18:24:09.751053] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-21T18:24:10.353895] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T18:24:10.551072] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-21T18:24:10.687638] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T18:24:11.351044] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-21T18:24:11.797317] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T18:24:11.798852] [INFO ] [REMOTE ] DUKB: Full fetch complete (9022 records). [2025-10-21T18:24:11.798925] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-21T18:24:12.155724] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-21T18:24:12.183043] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-21T18:24:12.183233] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-21T18:24:12.183595] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-21T18:24:12.183696] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-21T18:24:12.184584] [DEBUG] [LOCAL ] DUKB: Trimmed 9022 records to 6174 (keeping 200 days of data) [2025-10-21T18:24:12.222787] [DEBUG] [LOCAL ] DUKB: Primary data saved (6174 records). [2025-10-21T18:24:12.222992] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-21T18:24:12.223078] [INFO ] [MAIN ] Update Progress: 663/2366 symbols completed. DUKB took 24.2s. Estimated remaining: 3h 36m 7s. Rate: 7.9 symbols/min [2025-10-21T18:24:12.422182] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:12.424542] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T18:24:12.474850] [DEBUG] [LOCAL ] DVA: Loaded 40887 existing records from primary storage. [2025-10-21T18:24:12.475143] [INFO ] [MAIN ] DVA: Loaded 40887 existing records. [2025-10-21T18:24:12.649994] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:12.654162] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-21T18:24:12.654081] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-21T18:24:12.655517] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-21T18:24:12.655609] [INFO ] [REMOTE ] DTW: Full fetch complete (6952 records). [2025-10-21T18:24:12.655838] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-21T18:24:12.656462] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-21T18:24:12.656424] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:24:12.656724] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-21T18:24:12.688851] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:24:12.732867] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:24:12.759118] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-21T18:24:12.759213] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-21T18:24:12.759535] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-21T18:24:12.764982] [DEBUG] [LOCAL ] DTW: No derivative data file found to delete. [2025-10-21T18:24:12.765063] [INFO ] [MAIN ] Update Progress: 664/2366 symbols completed. DTW took 33.5s. Estimated remaining: 3h 35m 41s. Rate: 7.9 symbols/min [2025-10-21T18:24:12.954868] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-21T18:24:13.107885] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:13.211845] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:13.252406] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-21T18:24:13.252781] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-21T18:24:13.429130] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:13.429363] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-21T18:24:13.429420] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-21T18:24:13.430393] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-21T18:24:13.430451] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-21T18:24:13.764668] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-21T18:24:13.785625] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:14.551053] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-21T18:24:14.650201] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T18:24:15.313265] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T18:24:15.351012] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-21T18:24:16.151040] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-21T18:24:16.632289] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-21T18:24:16.951074] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-21T18:24:17.052242] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T18:24:17.751026] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-21T18:24:18.064590] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T18:24:18.214837] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T18:24:18.551065] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-21T18:24:19.351073] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-21T18:24:19.416745] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:24:20.151219] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-21T18:24:20.585583] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T18:24:20.950997] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-21T18:24:21.283587] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T18:24:21.751030] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-21T18:24:21.800830] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:24:22.551005] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-21T18:24:22.746289] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T18:24:23.324115] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:24:23.350997] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-21T18:24:24.135104] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T18:24:24.150985] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-21T18:24:24.951055] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-21T18:24:25.259567] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:24:25.751079] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-21T18:24:26.151575] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T18:24:26.483912] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T18:24:26.551014] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-21T18:24:27.351159] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-21T18:24:27.706279] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T18:24:28.019555] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T18:24:28.151016] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-21T18:24:28.275158] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T18:24:28.283638] [INFO ] [REMOTE ] DUK: Full fetch complete (77568 records). [2025-10-21T18:24:28.283839] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-21T18:24:28.675818] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-21T18:24:28.675895] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-21T18:24:28.676888] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-21T18:24:28.676955] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-21T18:24:28.678424] [DEBUG] [LOCAL ] DUK: Trimmed 77568 records to 53437 (keeping 200 days of data) [2025-10-21T18:24:28.962468] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-21T18:24:29.013914] [DEBUG] [LOCAL ] DUK: Primary data saved (53437 records). [2025-10-21T18:24:29.014037] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-21T18:24:29.014114] [INFO ] [MAIN ] Update Progress: 665/2366 symbols completed. DUK took 45.8s. Estimated remaining: 3h 35m 56s. Rate: 7.9 symbols/min [2025-10-21T18:24:29.190165] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:29.239577] [DEBUG] [LOCAL ] DX: Loaded 52526 existing records from primary storage. [2025-10-21T18:24:29.239901] [INFO ] [MAIN ] DX: Loaded 52526 existing records. [2025-10-21T18:24:29.422602] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:29.422847] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-21T18:24:29.422905] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-21T18:24:29.423834] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-21T18:24:29.423896] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-21T18:24:29.752420] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-21T18:24:29.793412] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:29.820737] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T18:24:30.551005] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-21T18:24:30.663633] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T18:24:31.351019] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-21T18:24:31.917776] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T18:24:32.151003] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-21T18:24:32.206129] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T18:24:32.951043] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-21T18:24:33.067099] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T18:24:33.633396] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:24:33.751028] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-21T18:24:34.551079] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-21T18:24:35.113802] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T18:24:35.298963] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:24:35.351053] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-21T18:24:36.024632] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T18:24:36.151040] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-21T18:24:36.920181] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T18:24:36.951022] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-21T18:24:37.751150] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-21T18:24:37.886359] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:24:38.551130] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-21T18:24:38.625720] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T18:24:38.636457] [INFO ] [REMOTE ] DV: Full fetch complete (73868 records). [2025-10-21T18:24:38.636700] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-21T18:24:39.093088] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-21T18:24:39.093203] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-21T18:24:39.094115] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-21T18:24:39.094241] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-21T18:24:39.095817] [DEBUG] [LOCAL ] DV: Trimmed 73868 records to 51247 (keeping 200 days of data) [2025-10-21T18:24:39.361730] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-21T18:24:39.405217] [DEBUG] [LOCAL ] DV: Primary data saved (51247 records). [2025-10-21T18:24:39.405385] [INFO ] [MAIN ] DV: Full history saved. [2025-10-21T18:24:39.406074] [INFO ] [MAIN ] Update Progress: 666/2366 symbols completed. DV took 32.1s. Estimated remaining: 3h 35m 55s. Rate: 7.9 symbols/min [2025-10-21T18:24:39.577538] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:39.627864] [DEBUG] [LOCAL ] DXC: Loaded 49946 existing records from primary storage. [2025-10-21T18:24:39.628378] [INFO ] [MAIN ] DXC: Loaded 49946 existing records. [2025-10-21T18:24:39.813379] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:39.813939] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-21T18:24:39.814326] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-21T18:24:39.825151] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-21T18:24:39.839154] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-21T18:24:39.929432] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T18:24:40.171842] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-21T18:24:40.239542] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:24:40.261182] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:40.951011] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-21T18:24:41.220680] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:24:41.751007] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-21T18:24:42.068918] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:24:42.385942] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T18:24:42.551033] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-21T18:24:43.351711] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-21T18:24:43.354932] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:24:43.364516] [INFO ] [REMOTE ] DVN: Full fetch complete (77489 records). [2025-10-21T18:24:43.364776] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-21T18:24:43.365824] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:24:43.365921] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:24:43.365964] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:24:43.366040] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-21T18:24:43.366112] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-10-21T18:24:43.366152] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-10-21T18:24:43.366532] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-10-21T18:24:43.366664] [INFO ] [MAIN ] Update Progress: 667/2366 symbols completed. DVN took 30.6s. Estimated remaining: 3h 35m 38s. Rate: 7.9 symbols/min [2025-10-21T18:24:43.547921] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:43.589440] [DEBUG] [LOCAL ] DXYZ: Loaded 37229 existing records from primary storage. [2025-10-21T18:24:43.589845] [INFO ] [MAIN ] DXYZ: Loaded 37229 existing records. [2025-10-21T18:24:43.785415] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:43.785934] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-21T18:24:43.786111] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-21T18:24:43.786979] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-21T18:24:43.787049] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-21T18:24:44.149884] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-21T18:24:44.169758] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-21T18:24:44.231749] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:44.827948] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T18:24:44.951022] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-21T18:24:45.619620] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:24:45.625851] [INFO ] [REMOTE ] DVA: Full fetch complete (59554 records). [2025-10-21T18:24:45.626001] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-21T18:24:45.756195] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-21T18:24:46.056479] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-21T18:24:46.056566] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-21T18:24:46.057445] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-21T18:24:46.057512] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-21T18:24:46.058767] [DEBUG] [LOCAL ] DVA: Trimmed 59554 records to 40739 (keeping 200 days of data) [2025-10-21T18:24:46.306414] [DEBUG] [LOCAL ] DVA: Primary data saved (40739 records). [2025-10-21T18:24:46.306540] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-21T18:24:46.306953] [INFO ] [MAIN ] Update Progress: 668/2366 symbols completed. DVA took 34.1s. Estimated remaining: 3h 35m 19s. Rate: 7.9 symbols/min [2025-10-21T18:24:46.490815] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:24:46.523110] [DEBUG] [LOCAL ] DY: Loaded 28264 existing records from primary storage. [2025-10-21T18:24:46.523448] [INFO ] [MAIN ] DY: Loaded 28264 existing records. [2025-10-21T18:24:46.556401] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-21T18:24:46.724614] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:24:46.724919] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-21T18:24:46.725082] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-21T18:24:46.734376] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-21T18:24:46.746926] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-21T18:24:46.821716] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T18:24:47.149442] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:24:47.245670] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T18:24:47.351016] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-21T18:24:48.151058] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-21T18:24:48.425156] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T18:24:48.745948] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-21T18:24:48.951015] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-21T18:24:49.751073] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-21T18:24:49.951406] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T18:24:50.469962] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T18:24:50.551055] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-21T18:24:51.351012] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-21T18:24:51.680770] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T18:24:51.711718] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T18:24:52.151056] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-21T18:24:52.959672] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-21T18:24:52.964839] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T18:24:53.278050] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T18:24:53.751048] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-21T18:24:54.551024] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-21T18:24:54.968204] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T18:24:55.351012] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-21T18:24:55.805389] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T18:24:55.956373] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T18:24:56.150999] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-21T18:24:56.602357] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T18:24:56.951027] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-21T18:24:57.571265] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T18:24:57.751014] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-21T18:24:58.551014] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-21T18:24:58.816446] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:24:59.351018] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-21T18:24:59.747243] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T18:24:59.908915] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T18:25:00.151014] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-21T18:25:00.951051] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-21T18:25:01.652975] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-21T18:25:01.698249] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:25:01.751048] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-21T18:25:02.551008] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-21T18:25:02.644869] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:25:03.143906] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T18:25:03.350993] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-21T18:25:04.151112] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-21T18:25:04.178784] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:25:04.951053] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-21T18:25:05.457470] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T18:25:05.465791] [INFO ] [REMOTE ] DX: Full fetch complete (75485 records). [2025-10-21T18:25:05.465938] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-21T18:25:05.466847] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:05.466949] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:05.467016] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:05.467106] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-21T18:25:05.467185] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-21T18:25:05.467272] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-10-21T18:25:05.467450] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-10-21T18:25:05.467535] [INFO ] [MAIN ] Update Progress: 669/2366 symbols completed. DX took 36.5s. Estimated remaining: 3h 35m 40s. Rate: 7.9 symbols/min [2025-10-21T18:25:05.604001] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:25:05.684777] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:05.720727] [DEBUG] [LOCAL ] E: Loaded 33355 existing records from primary storage. [2025-10-21T18:25:05.720997] [INFO ] [MAIN ] E: Loaded 33355 existing records. [2025-10-21T18:25:05.756213] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-21T18:25:05.900485] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:05.900717] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-21T18:25:05.900772] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-21T18:25:05.901435] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-21T18:25:05.901494] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-21T18:25:06.249242] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:06.551059] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-21T18:25:06.686275] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T18:25:07.226580] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T18:25:07.230288] [INFO ] [REMOTE ] DY: Full fetch complete (43213 records). [2025-10-21T18:25:07.230368] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-21T18:25:07.356153] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-21T18:25:07.620066] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-21T18:25:07.620146] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-21T18:25:07.620820] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-21T18:25:07.620880] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-21T18:25:07.621796] [DEBUG] [LOCAL ] DY: Trimmed 43213 records to 28120 (keeping 200 days of data) [2025-10-21T18:25:07.789817] [DEBUG] [LOCAL ] DY: Primary data saved (28120 records). [2025-10-21T18:25:07.789951] [INFO ] [MAIN ] DY: Full history saved. [2025-10-21T18:25:07.790028] [INFO ] [MAIN ] Update Progress: 670/2366 symbols completed. DY took 21.5s. Estimated remaining: 3h 35m 19s. Rate: 7.9 symbols/min [2025-10-21T18:25:07.964315] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:08.003478] [DEBUG] [LOCAL ] EAF: Loaded 41341 existing records from primary storage. [2025-10-21T18:25:08.003997] [INFO ] [MAIN ] EAF: Loaded 41341 existing records. [2025-10-21T18:25:08.134936] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T18:25:08.169710] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-21T18:25:08.216019] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:08.216222] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-21T18:25:08.216270] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-21T18:25:08.217115] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-21T18:25:08.217173] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-21T18:25:08.616999] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:08.951030] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-21T18:25:09.501398] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T18:25:09.751064] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-21T18:25:09.956849] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:25:10.280057] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T18:25:10.551025] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-21T18:25:11.351022] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-21T18:25:11.781986] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T18:25:11.869423] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-21T18:25:12.151040] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-21T18:25:12.951025] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-21T18:25:13.020011] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T18:25:13.738609] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:25:13.750971] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-21T18:25:14.551073] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-21T18:25:14.727293] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:25:14.836294] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T18:25:15.351085] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-21T18:25:16.151080] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-21T18:25:16.412611] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:25:16.676974] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:25:16.951101] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-21T18:25:17.751056] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-21T18:25:18.062484] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T18:25:18.070281] [INFO ] [REMOTE ] DXC: Full fetch complete (70237 records). [2025-10-21T18:25:18.070426] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-21T18:25:18.471687] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-21T18:25:18.471818] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-21T18:25:18.472736] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-21T18:25:18.472905] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-21T18:25:18.500424] [DEBUG] [LOCAL ] DXC: Trimmed 70237 records to 49925 (keeping 200 days of data) [2025-10-21T18:25:18.500264] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:25:18.561889] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-21T18:25:18.810168] [DEBUG] [LOCAL ] DXC: Primary data saved (49925 records). [2025-10-21T18:25:18.810308] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-21T18:25:18.811182] [INFO ] [MAIN ] Update Progress: 671/2366 symbols completed. DXC took 39.4s. Estimated remaining: 3h 35m 20s. Rate: 7.9 symbols/min [2025-10-21T18:25:18.981727] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:19.007854] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T18:25:19.020344] [DEBUG] [LOCAL ] EAI: Loaded 3940 existing records from primary storage. [2025-10-21T18:25:19.020839] [INFO ] [MAIN ] EAI: Loaded 3940 existing records. [2025-10-21T18:25:19.195426] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:19.195710] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-21T18:25:19.195766] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-21T18:25:19.195939] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-21T18:25:19.195976] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-21T18:25:19.375249] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-21T18:25:19.600303] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:20.129991] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:25:20.151015] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-21T18:25:20.781289] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T18:25:20.782259] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T18:25:20.951023] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-21T18:25:21.751059] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-21T18:25:22.163952] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T18:25:22.408396] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T18:25:22.551069] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-21T18:25:23.351069] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-21T18:25:23.720859] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-21T18:25:24.151055] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-21T18:25:24.344791] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:25:24.749958] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T18:25:24.951129] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-21T18:25:25.751023] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-21T18:25:26.229350] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:25:26.234413] [INFO ] [REMOTE ] E: Full fetch complete (47662 records). [2025-10-21T18:25:26.234509] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-21T18:25:26.556153] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-21T18:25:26.633854] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-21T18:25:26.633929] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-21T18:25:26.634673] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-21T18:25:26.634737] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-21T18:25:26.635771] [DEBUG] [LOCAL ] E: Trimmed 47662 records to 33282 (keeping 200 days of data) [2025-10-21T18:25:26.832432] [DEBUG] [LOCAL ] E: Primary data saved (33282 records). [2025-10-21T18:25:26.832559] [INFO ] [MAIN ] E: Full history saved. [2025-10-21T18:25:26.832634] [INFO ] [MAIN ] Update Progress: 672/2366 symbols completed. E took 21.4s. Estimated remaining: 3h 35m 14s. Rate: 7.9 symbols/min [2025-10-21T18:25:26.997711] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:27.022578] [DEBUG] [LOCAL ] EARN: Loaded 28002 existing records from primary storage. [2025-10-21T18:25:27.022849] [INFO ] [MAIN ] EARN: Loaded 28002 existing records. [2025-10-21T18:25:27.195274] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:27.195503] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-21T18:25:27.195567] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-21T18:25:27.196196] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-21T18:25:27.196253] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-21T18:25:27.354912] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-21T18:25:27.553966] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:28.151074] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-21T18:25:28.171750] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T18:25:28.378413] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-21T18:25:28.385606] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56669 records). [2025-10-21T18:25:28.385877] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-21T18:25:28.386563] [FATAL] [VALIDATOR ] DXYZ: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:28.386688] [FATAL] [MAIN ] DXYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:28.386765] [WARN ] [MAIN ] DXYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:28.386854] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-21T18:25:28.386955] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-10-21T18:25:28.387009] [INFO ] [LOCAL ] DXYZ: Starting deletion of derivative data. [2025-10-21T18:25:28.387428] [DEBUG] [LOCAL ] DXYZ: Deleted derivative data file. [2025-10-21T18:25:28.387520] [INFO ] [MAIN ] Update Progress: 673/2366 symbols completed. DXYZ took 45.0s. Estimated remaining: 3h 34m 51s. Rate: 7.9 symbols/min [2025-10-21T18:25:28.565269] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:28.596029] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-21T18:25:28.650854] [DEBUG] [LOCAL ] EAT: Loaded 49806 existing records from primary storage. [2025-10-21T18:25:28.651143] [INFO ] [MAIN ] EAT: Loaded 49806 existing records. [2025-10-21T18:25:28.837805] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:28.838058] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-21T18:25:28.838111] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-21T18:25:28.838770] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-21T18:25:28.838829] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-21T18:25:28.956110] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-21T18:25:29.217057] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:29.577144] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T18:25:29.713506] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:25:29.750986] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-21T18:25:30.551103] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-21T18:25:31.351055] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-21T18:25:31.649513] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T18:25:31.840884] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T18:25:32.151029] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-21T18:25:32.556839] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T18:25:32.951060] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-21T18:25:33.750992] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-21T18:25:33.788035] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:25:34.341089] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T18:25:34.551078] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-21T18:25:34.616084] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T18:25:35.351067] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-21T18:25:35.904107] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T18:25:36.151012] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-21T18:25:36.237988] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T18:25:36.951018] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-21T18:25:37.521044] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T18:25:37.751046] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-21T18:25:37.796324] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:25:38.455956] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T18:25:38.457006] [INFO ] [REMOTE ] EAI: Full fetch complete (5809 records). [2025-10-21T18:25:38.457073] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-21T18:25:38.457401] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:38.457480] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:38.457521] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:38.457558] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-21T18:25:38.457611] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-21T18:25:38.457679] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-21T18:25:38.457860] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-10-21T18:25:38.457940] [INFO ] [MAIN ] Update Progress: 674/2366 symbols completed. EAI took 19.6s. Estimated remaining: 3h 34m 49s. Rate: 7.9 symbols/min [2025-10-21T18:25:38.556931] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-21T18:25:38.630370] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:38.664066] [DEBUG] [LOCAL ] EB: Loaded 36273 existing records from primary storage. [2025-10-21T18:25:38.664365] [INFO ] [MAIN ] EB: Loaded 36273 existing records. [2025-10-21T18:25:38.892678] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:38.892903] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-21T18:25:38.892950] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-21T18:25:38.893482] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-21T18:25:38.893539] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-21T18:25:39.251624] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:39.351023] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-21T18:25:39.857852] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T18:25:40.151096] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-21T18:25:40.947252] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T18:25:40.953957] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-21T18:25:41.751027] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-21T18:25:41.968688] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T18:25:42.484910] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:25:42.550987] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-21T18:25:43.041313] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T18:25:43.046435] [INFO ] [REMOTE ] EAF: Full fetch complete (62008 records). [2025-10-21T18:25:43.046544] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-21T18:25:43.047278] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:43.047363] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:43.047405] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:43.047441] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-21T18:25:43.047494] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-21T18:25:43.047528] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-10-21T18:25:43.047680] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-10-21T18:25:43.048157] [INFO ] [MAIN ] Update Progress: 675/2366 symbols completed. EAF took 35.3s. Estimated remaining: 3h 34m 34s. Rate: 7.9 symbols/min [2025-10-21T18:25:43.224496] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:43.245373] [DEBUG] [LOCAL ] EBF: Loaded 19140 existing records from primary storage. [2025-10-21T18:25:43.245611] [INFO ] [MAIN ] EBF: Loaded 19140 existing records. [2025-10-21T18:25:43.352932] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-21T18:25:43.444545] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:43.444803] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-21T18:25:43.444859] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-21T18:25:43.445251] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-21T18:25:43.445309] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-21T18:25:43.805294] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:43.829227] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:25:44.151038] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-21T18:25:44.519483] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T18:25:44.951083] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-21T18:25:45.751005] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-21T18:25:45.895976] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:25:46.204749] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T18:25:46.453436] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T18:25:46.551041] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-21T18:25:47.351044] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-21T18:25:47.819723] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T18:25:48.151047] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-21T18:25:48.629411] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T18:25:48.951150] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-21T18:25:49.613289] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T18:25:49.750990] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-21T18:25:50.128004] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T18:25:50.551041] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-21T18:25:51.351052] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-21T18:25:51.539508] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T18:25:51.585551] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T18:25:52.151031] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-21T18:25:52.935259] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T18:25:52.950972] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-21T18:25:53.751071] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-21T18:25:54.137870] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T18:25:54.347228] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T18:25:54.551025] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-21T18:25:54.932455] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T18:25:54.937160] [INFO ] [REMOTE ] EARN: Full fetch complete (45108 records). [2025-10-21T18:25:54.937338] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-21T18:25:54.938123] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:25:54.938265] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:25:54.938339] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:25:54.938416] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-21T18:25:54.938476] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-21T18:25:54.938515] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-21T18:25:54.938700] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-10-21T18:25:54.938788] [INFO ] [MAIN ] Update Progress: 676/2366 symbols completed. EARN took 28.1s. Estimated remaining: 3h 34m 37s. Rate: 7.9 symbols/min [2025-10-21T18:25:55.117628] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:25:55.156260] [DEBUG] [LOCAL ] EBR: Loaded 43386 existing records from primary storage. [2025-10-21T18:25:55.156533] [INFO ] [MAIN ] EBR: Loaded 43386 existing records. [2025-10-21T18:25:55.337135] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:25:55.337354] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-21T18:25:55.337401] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-21T18:25:55.337981] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-21T18:25:55.338047] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-21T18:25:55.366841] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-21T18:25:55.705705] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:25:55.720107] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T18:25:56.151034] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-21T18:25:56.859716] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:25:56.950983] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-21T18:25:57.340691] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T18:25:57.751065] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-21T18:25:58.424366] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T18:25:58.551014] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-21T18:25:59.084594] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:25:59.351085] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-21T18:25:59.871905] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T18:26:00.151014] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-21T18:26:00.375480] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T18:26:00.951097] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-21T18:26:01.751102] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-21T18:26:01.855181] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:26:01.977145] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T18:26:02.551038] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-21T18:26:03.351007] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-21T18:26:03.553665] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T18:26:03.739021] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T18:26:04.151090] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-21T18:26:04.762554] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T18:26:04.767848] [INFO ] [REMOTE ] EB: Full fetch complete (55038 records). [2025-10-21T18:26:04.767939] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-21T18:26:04.956966] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-21T18:26:05.147887] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-21T18:26:05.147983] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-21T18:26:05.148732] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-21T18:26:05.148812] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-21T18:26:05.149849] [DEBUG] [LOCAL ] EB: Trimmed 55038 records to 36257 (keeping 200 days of data) [2025-10-21T18:26:05.348588] [DEBUG] [LOCAL ] EB: Primary data saved (36257 records). [2025-10-21T18:26:05.348768] [INFO ] [MAIN ] EB: Full history saved. [2025-10-21T18:26:05.349630] [INFO ] [MAIN ] Update Progress: 677/2366 symbols completed. EB took 26.9s. Estimated remaining: 3h 34m 37s. Rate: 7.9 symbols/min [2025-10-21T18:26:05.610938] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T18:26:05.751069] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-21T18:26:06.551058] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-21T18:26:06.950910] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T18:26:06.989268] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T18:26:07.350986] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-21T18:26:07.671406] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T18:26:08.151101] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-21T18:26:08.951044] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-21T18:26:09.019931] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T18:26:09.147251] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:26:09.750991] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-21T18:26:10.551043] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-21T18:26:10.723289] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T18:26:11.228387] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:26:11.351066] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-21T18:26:11.804083] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T18:26:11.810018] [INFO ] [REMOTE ] EBF: Full fetch complete (28154 records). [2025-10-21T18:26:11.810332] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-21T18:26:12.158991] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-21T18:26:12.186960] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-21T18:26:12.187151] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-21T18:26:12.187713] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-21T18:26:12.187835] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-21T18:26:12.188575] [DEBUG] [LOCAL ] EBF: Trimmed 28154 records to 19191 (keeping 200 days of data) [2025-10-21T18:26:12.302932] [DEBUG] [LOCAL ] EBF: Primary data saved (19191 records). [2025-10-21T18:26:12.303060] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-21T18:26:12.303139] [INFO ] [MAIN ] Update Progress: 678/2366 symbols completed. EBF took 29.3s. Estimated remaining: 3h 34m 27s. Rate: 7.9 symbols/min [2025-10-21T18:26:13.150379] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T18:26:13.158149] [INFO ] [REMOTE ] EAT: Full fetch complete (72344 records). [2025-10-21T18:26:13.158301] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-21T18:26:13.556967] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-21T18:26:13.557050] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-21T18:26:13.557901] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-21T18:26:13.557985] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-21T18:26:13.559358] [DEBUG] [LOCAL ] EAT: Trimmed 72344 records to 49741 (keeping 200 days of data) [2025-10-21T18:26:13.882564] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:26:13.887516] [DEBUG] [LOCAL ] EAT: Primary data saved (49741 records). [2025-10-21T18:26:13.896021] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-21T18:26:13.896140] [INFO ] [MAIN ] Update Progress: 679/2366 symbols completed. EAT took 45.5s. Estimated remaining: 3h 34m 5s. Rate: 7.9 symbols/min [2025-10-21T18:26:13.897196] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-21T18:26:15.427391] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:26:15.436624] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-21T18:26:16.935057] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T18:26:16.944172] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-21T18:26:18.466791] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:26:18.476387] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-21T18:26:20.215687] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:26:20.223584] [INFO ] [REMOTE ] EBR: Full fetch complete (62519 records). [2025-10-21T18:26:20.223768] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-21T18:26:20.606964] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-21T18:26:20.607059] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-21T18:26:20.607841] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-21T18:26:20.607902] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-21T18:26:20.609078] [DEBUG] [LOCAL ] EBR: Trimmed 62519 records to 43373 (keeping 200 days of data) [2025-10-21T18:26:20.849431] [DEBUG] [LOCAL ] EBR: Primary data saved (43373 records). [2025-10-21T18:26:20.849548] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-21T18:26:20.849622] [INFO ] [MAIN ] Update Progress: 680/2366 symbols completed. EBR took 25.9s. Estimated remaining: 3h 33m 55s. Rate: 7.9 symbols/min [2025-10-21T18:26:21.420027] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:21.533277] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:21.570747] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:21.573477] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:21.642416] [DEBUG] [LOCAL ] ECC: Loaded 43475 existing records from primary storage. [2025-10-21T18:26:21.652612] [DEBUG] [LOCAL ] EBS: Loaded 46671 existing records from primary storage. [2025-10-21T18:26:21.653873] [DEBUG] [LOCAL ] ECAT: Loaded 29346 existing records from primary storage. [2025-10-21T18:26:21.654040] [INFO ] [MAIN ] EBS: Loaded 46671 existing records. [2025-10-21T18:26:21.659425] [INFO ] [MAIN ] ECC: Loaded 43475 existing records. [2025-10-21T18:26:21.674953] [INFO ] [MAIN ] ECAT: Loaded 29346 existing records. [2025-10-21T18:26:22.073917] [DEBUG] [LOCAL ] EC: Loaded 48929 existing records from primary storage. [2025-10-21T18:26:22.198924] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:22.193870] [INFO ] [MAIN ] EC: Loaded 48929 existing records. [2025-10-21T18:26:22.243499] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:22.285132] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-21T18:26:22.293811] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-21T18:26:22.294025] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-21T18:26:22.288206] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:22.322575] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-21T18:26:22.322688] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-21T18:26:22.333274] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-21T18:26:22.354143] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-21T18:26:22.361051] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-21T18:26:22.343600] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-21T18:26:22.354391] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-21T18:26:22.370420] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-21T18:26:22.369938] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-21T18:26:22.697713] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:22.732912] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-21T18:26:22.756560] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-21T18:26:22.777058] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-21T18:26:22.792795] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-21T18:26:23.622679] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:23.704048] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-21T18:26:23.745275] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:23.783368] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-21T18:26:23.885330] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:23.895924] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-21T18:26:23.957026] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:23.957441] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-21T18:26:25.377661] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T18:26:25.385715] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-21T18:26:25.463846] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T18:26:25.472638] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-21T18:26:25.516807] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T18:26:25.522627] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-21T18:26:25.800065] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T18:26:25.809958] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-21T18:26:26.707973] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T18:26:26.713933] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-21T18:26:26.844226] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T18:26:26.852780] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-21T18:26:26.876998] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:26:26.886317] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-21T18:26:27.016879] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T18:26:27.027051] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-21T18:26:27.916356] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T18:26:27.923633] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-21T18:26:28.243591] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T18:26:28.254964] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-21T18:26:28.391268] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T18:26:28.401187] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-21T18:26:28.768771] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T18:26:28.771338] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T18:26:28.788810] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-21T18:26:28.951053] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-21T18:26:29.605067] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T18:26:29.635356] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T18:26:29.751032] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-21T18:26:29.939831] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:26:30.550997] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-21T18:26:30.912886] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T18:26:30.980201] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T18:26:31.351024] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-21T18:26:32.151013] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-21T18:26:32.191444] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T18:26:32.951055] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-21T18:26:32.982317] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:26:33.401463] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:26:33.751051] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-21T18:26:34.551080] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-21T18:26:34.775432] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:26:35.351065] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-21T18:26:35.634988] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T18:26:36.049186] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T18:26:36.151033] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-21T18:26:36.951013] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-21T18:26:37.129486] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T18:26:37.191856] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T18:26:37.751026] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-21T18:26:38.551075] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-21T18:26:38.668915] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:26:39.351044] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-21T18:26:39.456748] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:26:40.113226] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T18:26:40.151084] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-21T18:26:40.958429] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-21T18:26:40.964756] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T18:26:41.506593] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T18:26:41.751036] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-21T18:26:42.551055] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-21T18:26:42.671846] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:26:43.015462] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T18:26:43.019985] [INFO ] [REMOTE ] ECAT: Full fetch complete (42915 records). [2025-10-21T18:26:43.020096] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-21T18:26:43.375935] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-21T18:26:43.391803] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-21T18:26:43.392105] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-21T18:26:43.392762] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-21T18:26:43.392823] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-21T18:26:43.393814] [DEBUG] [LOCAL ] ECAT: Trimmed 42915 records to 29262 (keeping 200 days of data) [2025-10-21T18:26:43.578302] [DEBUG] [LOCAL ] ECAT: Primary data saved (29262 records). [2025-10-21T18:26:43.578451] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-21T18:26:43.578546] [INFO ] [MAIN ] Update Progress: 681/2366 symbols completed. ECAT took 22.7s. Estimated remaining: 3h 34m 25s. Rate: 7.9 symbols/min [2025-10-21T18:26:43.755282] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:43.755451] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-21T18:26:43.755501] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-21T18:26:43.755607] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-21T18:26:43.755670] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-21T18:26:43.755733] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-21T18:26:43.755768] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-21T18:26:44.117039] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:44.151018] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-21T18:26:44.230048] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T18:26:44.595993] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-21T18:26:44.951021] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-21T18:26:45.130776] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T18:26:45.751003] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-21T18:26:46.551015] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-21T18:26:46.800706] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T18:26:46.807756] [INFO ] [REMOTE ] ECC: Full fetch complete (61579 records). [2025-10-21T18:26:46.807867] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-21T18:26:47.197358] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-21T18:26:47.197498] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-21T18:26:47.198401] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-21T18:26:47.198464] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-21T18:26:47.199709] [DEBUG] [LOCAL ] ECC: Trimmed 61579 records to 43432 (keeping 200 days of data) [2025-10-21T18:26:47.362869] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-21T18:26:47.452871] [DEBUG] [LOCAL ] ECC: Primary data saved (43432 records). [2025-10-21T18:26:47.453011] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-21T18:26:47.453117] [INFO ] [MAIN ] Update Progress: 682/2366 symbols completed. ECC took 26.6s. Estimated remaining: 3h 34m 8s. Rate: 7.9 symbols/min [2025-10-21T18:26:47.662466] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T18:26:47.664490] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:47.682481] [DEBUG] [LOCAL ] ECCU: Loaded 2179 existing records from primary storage. [2025-10-21T18:26:47.682801] [INFO ] [MAIN ] ECCU: Loaded 2179 existing records. [2025-10-21T18:26:47.846122] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T18:26:47.874468] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:26:47.875116] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-21T18:26:47.875170] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-21T18:26:47.875363] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-21T18:26:47.875419] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-21T18:26:48.152742] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-21T18:26:48.230441] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:48.344235] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T18:26:48.352006] [INFO ] [REMOTE ] EC: Full fetch complete (71874 records). [2025-10-21T18:26:48.352182] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-21T18:26:48.743937] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-21T18:26:48.744028] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-21T18:26:48.744899] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-21T18:26:48.744961] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-21T18:26:48.746324] [DEBUG] [LOCAL ] EC: Trimmed 71874 records to 48909 (keeping 200 days of data) [2025-10-21T18:26:48.951050] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-21T18:26:49.037922] [DEBUG] [LOCAL ] EC: Primary data saved (48909 records). [2025-10-21T18:26:49.038062] [INFO ] [MAIN ] EC: Full history saved. [2025-10-21T18:26:49.038155] [INFO ] [MAIN ] Update Progress: 683/2366 symbols completed. EC took 28.2s. Estimated remaining: 3h 33m 46s. Rate: 7.9 symbols/min [2025-10-21T18:26:49.207433] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:49.207591] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-21T18:26:49.207627] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-21T18:26:49.207761] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-21T18:26:49.207822] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-21T18:26:49.207889] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-21T18:26:49.207935] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-21T18:26:49.569341] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:49.680443] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T18:26:49.750992] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-21T18:26:49.855796] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T18:26:50.088831] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-21T18:26:50.551024] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-21T18:26:50.982404] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-21T18:26:51.351095] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-21T18:26:51.826100] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T18:26:52.151053] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-21T18:26:52.731285] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T18:26:52.951026] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-21T18:26:53.751061] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-21T18:26:54.119342] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-21T18:26:54.529928] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T18:26:54.536607] [INFO ] [REMOTE ] EBS: Full fetch complete (67050 records). [2025-10-21T18:26:54.536753] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-21T18:26:54.537486] [FATAL] [VALIDATOR ] EBS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:26:54.537612] [FATAL] [MAIN ] EBS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:26:54.537713] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:26:54.537814] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-21T18:26:54.537892] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-21T18:26:54.537930] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-10-21T18:26:54.538115] [DEBUG] [LOCAL ] EBS: Deleted derivative data file. [2025-10-21T18:26:54.538827] [INFO ] [MAIN ] Update Progress: 684/2366 symbols completed. EBS took 33.7s. Estimated remaining: 3h 33m 33s. Rate: 7.9 symbols/min [2025-10-21T18:26:54.559189] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-21T18:26:54.718854] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:26:54.719039] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-21T18:26:54.719076] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-21T18:26:54.719211] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-21T18:26:54.719289] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-21T18:26:54.719351] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-21T18:26:54.719384] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-21T18:26:55.082792] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:26:55.247255] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T18:26:55.351048] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-21T18:26:55.629388] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-21T18:26:56.151126] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-21T18:26:56.516468] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-21T18:26:56.951042] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-21T18:26:57.383223] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T18:26:57.751019] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-21T18:26:58.092856] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T18:26:58.551029] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-21T18:26:58.893117] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-21T18:26:59.351046] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-21T18:26:59.707207] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T18:27:00.151023] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-21T18:27:00.713372] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T18:27:00.951049] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-21T18:27:01.341102] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-21T18:27:01.751038] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-21T18:27:02.099549] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-21T18:27:02.551029] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-21T18:27:02.959258] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-21T18:27:03.351043] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-21T18:27:03.680021] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-21T18:27:04.151014] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-21T18:27:04.608976] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:27:04.951056] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-21T18:27:05.501617] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T18:27:05.502636] [INFO ] [REMOTE ] ECCC: Full fetch complete (1302 records). [2025-10-21T18:27:05.502762] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-21T18:27:05.503196] [FATAL] [VALIDATOR ] ECCC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:27:05.503298] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:27:05.503354] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:27:05.503403] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-21T18:27:05.503588] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-21T18:27:05.503683] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-21T18:27:05.503758] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-21T18:27:05.503836] [INFO ] [MAIN ] Update Progress: 685/2366 symbols completed. ECCC took 21.9s. Estimated remaining: 3h 33m 34s. Rate: 7.9 symbols/min [2025-10-21T18:27:05.699559] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:05.733006] [DEBUG] [LOCAL ] ECG: Loaded 32902 existing records from primary storage. [2025-10-21T18:27:05.733309] [INFO ] [MAIN ] ECG: Loaded 32902 existing records. [2025-10-21T18:27:05.756157] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-21T18:27:05.932482] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:27:05.932737] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-21T18:27:05.932791] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-21T18:27:05.933362] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-21T18:27:05.933420] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-21T18:27:06.273550] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-21T18:27:06.329190] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:06.551039] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-21T18:27:07.015764] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:27:07.351085] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-21T18:27:07.684963] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-21T18:27:08.151079] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-21T18:27:08.612281] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:27:08.951025] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-21T18:27:09.264536] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-21T18:27:09.751055] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-21T18:27:10.551032] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-21T18:27:10.955613] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-21T18:27:11.287437] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:27:11.351032] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-21T18:27:11.922467] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T18:27:12.151082] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-21T18:27:12.567216] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T18:27:12.951076] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-21T18:27:13.751022] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-21T18:27:14.087189] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T18:27:14.363330] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:27:14.551023] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-21T18:27:15.066246] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T18:27:15.351012] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-21T18:27:15.834389] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T18:27:16.151076] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-21T18:27:16.951024] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-21T18:27:17.515521] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T18:27:17.516284] [INFO ] [REMOTE ] ECCW: Full fetch complete (1423 records). [2025-10-21T18:27:17.516349] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-21T18:27:17.712960] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:27:17.717555] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-21T18:27:17.717767] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:27:17.725621] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:27:17.726086] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-21T18:27:17.726418] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-21T18:27:17.726475] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-21T18:27:17.726518] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-21T18:27:17.726571] [INFO ] [MAIN ] Update Progress: 686/2366 symbols completed. ECCW took 28.7s. Estimated remaining: 3h 33m 37s. Rate: 7.9 symbols/min [2025-10-21T18:27:17.756200] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-21T18:27:17.893820] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:17.936747] [DEBUG] [LOCAL ] ECL: Loaded 46730 existing records from primary storage. [2025-10-21T18:27:17.937035] [INFO ] [MAIN ] ECL: Loaded 46730 existing records. [2025-10-21T18:27:18.109637] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:27:18.109850] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-21T18:27:18.109895] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-21T18:27:18.110067] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-21T18:27:18.110104] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-21T18:27:18.298587] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-21T18:27:18.470678] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:18.550978] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-21T18:27:19.351022] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-21T18:27:19.777269] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T18:27:20.151101] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-21T18:27:20.322397] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:27:20.951020] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-21T18:27:21.750997] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-21T18:27:21.835513] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T18:27:22.023519] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-21T18:27:22.551044] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-21T18:27:22.732151] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T18:27:22.859069] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-21T18:27:23.351096] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-21T18:27:24.151037] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-21T18:27:24.951033] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-21T18:27:25.223445] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T18:27:25.440250] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T18:27:25.441216] [INFO ] [REMOTE ] ECCX: Full fetch complete (1456 records). [2025-10-21T18:27:25.441320] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-21T18:27:25.635089] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-21T18:27:25.635546] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:27:25.635635] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:27:25.635899] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-21T18:27:25.636123] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-21T18:27:25.636205] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-21T18:27:25.636328] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-21T18:27:25.636521] [INFO ] [MAIN ] Update Progress: 687/2366 symbols completed. ECCX took 31.1s. Estimated remaining: 3h 33m 30s. Rate: 7.9 symbols/min [2025-10-21T18:27:25.756727] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-21T18:27:25.763896] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T18:27:25.846955] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:25.866670] [DEBUG] [LOCAL ] ECO: Loaded 18204 existing records from primary storage. [2025-10-21T18:27:25.866917] [INFO ] [MAIN ] ECO: Loaded 18204 existing records. [2025-10-21T18:27:26.040944] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:27:26.041135] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-21T18:27:26.041183] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-21T18:27:26.041352] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-21T18:27:26.041391] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-21T18:27:26.382553] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:26.550978] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-21T18:27:27.351062] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-21T18:27:27.753102] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T18:27:27.842083] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:27:27.884233] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-21T18:27:27.884986] [INFO ] [REMOTE ] ECCU: Full fetch complete (4251 records). [2025-10-21T18:27:27.885053] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-21T18:27:27.885380] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:27:27.885454] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:27:27.885519] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:27:27.885589] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-21T18:27:27.885671] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-21T18:27:27.885726] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-21T18:27:27.885837] [DEBUG] [LOCAL ] ECCU: Deleted derivative data file. [2025-10-21T18:27:27.885901] [INFO ] [MAIN ] Update Progress: 688/2366 symbols completed. ECCU took 40.4s. Estimated remaining: 3h 33m 9s. Rate: 7.9 symbols/min [2025-10-21T18:27:28.059701] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:28.059871] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-21T18:27:28.059908] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-21T18:27:28.060021] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-21T18:27:28.060061] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-21T18:27:28.060100] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-21T18:27:28.060131] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-21T18:27:28.156109] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-21T18:27:28.410742] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:28.951024] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-21T18:27:29.427757] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T18:27:29.751016] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-21T18:27:30.551024] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-21T18:27:30.724265] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T18:27:31.108163] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T18:27:31.350995] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-21T18:27:31.734926] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T18:27:32.151064] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-21T18:27:32.488905] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T18:27:32.951263] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-21T18:27:33.751087] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-21T18:27:33.916285] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:27:34.336321] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T18:27:34.551147] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-21T18:27:34.988295] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:27:35.351010] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-21T18:27:35.400524] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T18:27:36.151040] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-21T18:27:36.445596] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T18:27:36.951030] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-21T18:27:37.505509] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T18:27:37.510405] [INFO ] [REMOTE ] ECG: Full fetch complete (50797 records). [2025-10-21T18:27:37.510489] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-21T18:27:37.756122] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-21T18:27:37.895338] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T18:27:37.894882] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-21T18:27:37.895456] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-21T18:27:37.899942] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-21T18:27:37.900105] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-21T18:27:37.901286] [DEBUG] [LOCAL ] ECG: Trimmed 50797 records to 32804 (keeping 200 days of data) [2025-10-21T18:27:38.086531] [DEBUG] [LOCAL ] ECG: Primary data saved (32804 records). [2025-10-21T18:27:38.086676] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-21T18:27:38.086768] [INFO ] [MAIN ] Update Progress: 689/2366 symbols completed. ECG took 32.6s. Estimated remaining: 3h 33m 8s. Rate: 7.9 symbols/min [2025-10-21T18:27:38.257879] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:38.308918] [DEBUG] [LOCAL ] ED: Loaded 52649 existing records from primary storage. [2025-10-21T18:27:38.309208] [INFO ] [MAIN ] ED: Loaded 52649 existing records. [2025-10-21T18:27:38.481419] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:27:38.481594] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-21T18:27:38.481639] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-21T18:27:38.482157] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-21T18:27:38.482213] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-21T18:27:38.556192] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-21T18:27:38.828607] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:39.350991] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-21T18:27:39.703959] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:27:39.976740] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:27:40.150990] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-21T18:27:40.464523] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T18:27:40.951044] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-21T18:27:41.751029] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-21T18:27:41.919895] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:27:42.528719] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T18:27:42.550993] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-21T18:27:43.351026] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-21T18:27:43.463756] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:27:44.044033] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-21T18:27:44.092953] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:27:44.151014] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-21T18:27:44.951035] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-21T18:27:45.751032] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-21T18:27:46.039972] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T18:27:46.551068] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-21T18:27:46.645912] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:27:47.351072] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-21T18:27:47.430537] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T18:27:47.680929] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:27:48.151069] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-21T18:27:48.951027] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-21T18:27:49.073506] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:27:49.296007] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T18:27:49.751087] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-21T18:27:50.551049] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-21T18:27:50.817352] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T18:27:50.825364] [INFO ] [REMOTE ] ECL: Full fetch complete (68390 records). [2025-10-21T18:27:50.825521] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-21T18:27:50.996309] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T18:27:51.024688] [INFO ] [REMOTE ] ECO: Full fetch complete (28312 records). [2025-10-21T18:27:51.030386] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-21T18:27:51.375048] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-21T18:27:51.411157] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-21T18:27:51.436638] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-21T18:27:51.442763] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-21T18:27:51.506101] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-21T18:27:51.556571] [DEBUG] [LOCAL ] ECL: Trimmed 68390 records to 46734 (keeping 200 days of data) [2025-10-21T18:27:51.698885] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-21T18:27:51.725819] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-21T18:27:51.736767] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-21T18:27:51.736856] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-21T18:27:51.742893] [DEBUG] [LOCAL ] ECO: Trimmed 28312 records to 18099 (keeping 200 days of data) [2025-10-21T18:27:51.980896] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T18:27:52.009859] [DEBUG] [LOCAL ] ECO: Primary data saved (18099 records). [2025-10-21T18:27:52.011167] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-21T18:27:52.011609] [INFO ] [MAIN ] Update Progress: 690/2366 symbols completed. ECO took 26.4s. Estimated remaining: 3h 33m 16s. Rate: 7.9 symbols/min [2025-10-21T18:27:52.173508] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-21T18:27:52.207693] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:52.227406] [DEBUG] [LOCAL ] EDD: No existing data file found in primary storage. [2025-10-21T18:27:52.239712] [WARN ] [MAIN ] EDD: No existing data found, performing full refresh instead. [2025-10-21T18:27:52.243263] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-21T18:27:52.248446] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-21T18:27:52.251997] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-21T18:27:52.252093] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-21T18:27:52.251923] [DEBUG] [LOCAL ] ECL: Primary data saved (46734 records). [2025-10-21T18:27:52.252254] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-21T18:27:52.258280] [INFO ] [MAIN ] Update Progress: 691/2366 symbols completed. ECL took 34.5s. Estimated remaining: 3h 32m 50s. Rate: 7.9 symbols/min [2025-10-21T18:27:52.636944] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:27:52.660061] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-10-21T18:27:52.666000] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-10-21T18:27:52.666149] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-21T18:27:52.690039] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-21T18:27:52.737419] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-21T18:27:52.745397] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-21T18:27:52.980082] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:53.006113] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-21T18:27:53.188911] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:27:53.707211] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-21T18:27:53.744127] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T18:27:53.752020] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-21T18:27:54.309465] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T18:27:54.551069] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-21T18:27:54.818456] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T18:27:55.351045] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-21T18:27:56.151048] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-21T18:27:56.190289] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:27:56.685699] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:27:56.779297] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:27:56.951031] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-21T18:27:57.751040] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-21T18:27:58.551064] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-21T18:27:58.656949] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:27:58.856050] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T18:27:59.351027] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-21T18:27:59.555428] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T18:28:00.151065] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-21T18:28:00.650219] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T18:28:00.951126] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-21T18:28:01.751031] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-21T18:28:02.062106] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T18:28:02.221932] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-21T18:28:02.551109] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-21T18:28:03.334499] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T18:28:03.350983] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-21T18:28:04.151015] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-21T18:28:04.193557] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:28:04.950998] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-21T18:28:05.357499] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T18:28:05.472395] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T18:28:05.751102] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-21T18:28:06.491432] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T18:28:06.497727] [INFO ] [REMOTE ] ECVT: Full fetch complete (60038 records). [2025-10-21T18:28:06.497872] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-21T18:28:06.498511] [FATAL] [VALIDATOR ] ECVT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:28:06.498616] [FATAL] [MAIN ] ECVT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:28:06.498713] [WARN ] [MAIN ] ECVT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:28:06.498811] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-21T18:28:06.498892] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-21T18:28:06.498930] [INFO ] [LOCAL ] ECVT: Starting deletion of derivative data. [2025-10-21T18:28:06.498970] [DEBUG] [LOCAL ] ECVT: No derivative data file found to delete. [2025-10-21T18:28:06.499026] [INFO ] [MAIN ] Update Progress: 692/2366 symbols completed. ECVT took 38.6s. Estimated remaining: 3h 32m 59s. Rate: 7.9 symbols/min [2025-10-21T18:28:06.556221] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-21T18:28:06.678991] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:06.697919] [DEBUG] [LOCAL ] EDN: Loaded 19210 existing records from primary storage. [2025-10-21T18:28:06.698223] [INFO ] [MAIN ] EDN: Loaded 19210 existing records. [2025-10-21T18:28:06.912067] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:06.913565] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T18:28:06.913693] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-21T18:28:06.919010] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-21T18:28:06.920085] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-21T18:28:06.920146] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-21T18:28:07.273442] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:07.351019] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-21T18:28:08.155159] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-21T18:28:08.159927] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T18:28:08.168423] [INFO ] [REMOTE ] ED: Full fetch complete (76376 records). [2025-10-21T18:28:08.168537] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-21T18:28:08.533484] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T18:28:08.595636] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-21T18:28:08.595743] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-21T18:28:08.596634] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-21T18:28:08.596715] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-21T18:28:08.598127] [DEBUG] [LOCAL ] ED: Trimmed 76376 records to 52606 (keeping 200 days of data) [2025-10-21T18:28:08.924196] [DEBUG] [LOCAL ] ED: Primary data saved (52606 records). [2025-10-21T18:28:08.924429] [INFO ] [MAIN ] ED: Full history saved. [2025-10-21T18:28:08.925379] [INFO ] [MAIN ] Update Progress: 693/2366 symbols completed. ED took 30.8s. Estimated remaining: 3h 32m 38s. Rate: 7.9 symbols/min [2025-10-21T18:28:08.956103] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-21T18:28:09.037165] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T18:28:09.107993] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:09.148307] [DEBUG] [LOCAL ] EDU: Loaded 44811 existing records from primary storage. [2025-10-21T18:28:09.148598] [INFO ] [MAIN ] EDU: Loaded 44811 existing records. [2025-10-21T18:28:09.326519] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:09.326779] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-21T18:28:09.326840] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-21T18:28:09.327126] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-21T18:28:09.327190] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-21T18:28:09.682204] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:09.751045] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-21T18:28:10.116576] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T18:28:10.551797] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-21T18:28:11.136583] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T18:28:11.351073] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-21T18:28:12.151034] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-21T18:28:12.384171] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T18:28:12.422801] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T18:28:12.951024] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-21T18:28:13.547223] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T18:28:13.751015] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-21T18:28:14.551013] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-21T18:28:14.687252] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:28:14.870499] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T18:28:15.332099] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T18:28:15.350988] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-21T18:28:16.151051] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-21T18:28:16.505543] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T18:28:16.951079] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-21T18:28:17.728203] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T18:28:17.750979] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-21T18:28:17.885629] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T18:28:18.551070] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-21T18:28:19.351080] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-21T18:28:19.392878] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:28:19.539823] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T18:28:20.151012] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-21T18:28:20.847430] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T18:28:20.951023] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-21T18:28:21.618812] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T18:28:21.750988] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-21T18:28:21.820326] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T18:28:22.551033] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-21T18:28:23.337315] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:28:23.350996] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-21T18:28:23.528273] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T18:28:24.151026] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-21T18:28:24.951009] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-21T18:28:24.969145] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T18:28:25.042397] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:28:25.594830] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T18:28:25.751079] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-21T18:28:26.551001] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-21T18:28:26.701199] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T18:28:26.705810] [INFO ] [REMOTE ] EDD: Full fetch complete (38915 records). [2025-10-21T18:28:26.705922] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-21T18:28:27.219926] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-21T18:28:27.220074] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-21T18:28:27.220806] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-21T18:28:27.220871] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-21T18:28:27.222009] [DEBUG] [LOCAL ] EDD: Trimmed 38915 records to 27227 (keeping 200 days of data) [2025-10-21T18:28:27.353869] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-21T18:28:27.464975] [DEBUG] [LOCAL ] EDD: Primary data saved (27227 records). [2025-10-21T18:28:27.465143] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-21T18:28:27.465224] [INFO ] [MAIN ] Update Progress: 694/2366 symbols completed. EDD took 35.5s. Estimated remaining: 3h 32m 57s. Rate: 7.9 symbols/min [2025-10-21T18:28:27.680688] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:27.682071] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:28:27.723324] [DEBUG] [LOCAL ] EE: Loaded 32694 existing records from primary storage. [2025-10-21T18:28:27.723637] [INFO ] [MAIN ] EE: Loaded 32694 existing records. [2025-10-21T18:28:27.921922] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:27.922187] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-21T18:28:27.922279] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-21T18:28:27.922926] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-21T18:28:27.923010] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-21T18:28:28.156127] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-21T18:28:28.312590] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:28.327792] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T18:28:28.333179] [INFO ] [REMOTE ] EDF: Full fetch complete (20294 records). [2025-10-21T18:28:28.333291] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-21T18:28:28.722810] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-21T18:28:28.722880] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-21T18:28:28.723358] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-21T18:28:28.723398] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-21T18:28:28.723998] [DEBUG] [LOCAL ] EDF: Trimmed 20294 records to 12901 (keeping 200 days of data) [2025-10-21T18:28:28.797546] [DEBUG] [LOCAL ] EDF: Primary data saved (12901 records). [2025-10-21T18:28:28.797698] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-21T18:28:28.797778] [INFO ] [MAIN ] Update Progress: 695/2366 symbols completed. EDF took 36.5s. Estimated remaining: 3h 32m 34s. Rate: 7.9 symbols/min [2025-10-21T18:28:28.961419] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-21T18:28:28.964901] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:28.965840] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-21T18:28:28.965899] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-21T18:28:28.966037] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-21T18:28:28.966101] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-21T18:28:28.966159] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-21T18:28:28.966390] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-21T18:28:29.320996] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:29.630299] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T18:28:29.751000] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-21T18:28:30.239135] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T18:28:30.303098] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T18:28:30.551055] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-21T18:28:31.351029] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-21T18:28:31.648255] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:28:31.652401] [INFO ] [REMOTE ] EDN: Full fetch complete (29885 records). [2025-10-21T18:28:31.652506] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-21T18:28:32.033860] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-21T18:28:32.033936] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-21T18:28:32.034476] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-21T18:28:32.034529] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-21T18:28:32.035291] [DEBUG] [LOCAL ] EDN: Trimmed 29885 records to 19252 (keeping 200 days of data) [2025-10-21T18:28:32.146902] [DEBUG] [LOCAL ] EDN: Primary data saved (19252 records). [2025-10-21T18:28:32.147073] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-21T18:28:32.147159] [INFO ] [MAIN ] Update Progress: 696/2366 symbols completed. EDN took 25.6s. Estimated remaining: 3h 32m 16s. Rate: 7.9 symbols/min [2025-10-21T18:28:32.158406] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-21T18:28:32.318690] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:32.328686] [DEBUG] [LOCAL ] EEX: Loaded 10029 existing records from primary storage. [2025-10-21T18:28:32.328900] [INFO ] [MAIN ] EEX: Loaded 10029 existing records. [2025-10-21T18:28:32.508677] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:32.508866] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-21T18:28:32.508911] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-21T18:28:32.509166] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-21T18:28:32.509221] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-21T18:28:32.593717] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T18:28:32.876933] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:32.957377] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-21T18:28:32.963407] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T18:28:33.571272] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:28:33.750993] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-21T18:28:34.551028] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-21T18:28:35.314118] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T18:28:35.321486] [INFO ] [REMOTE ] EDU: Full fetch complete (67176 records). [2025-10-21T18:28:35.321685] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-21T18:28:35.353728] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-21T18:28:35.667997] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T18:28:35.728629] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-21T18:28:35.728732] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-21T18:28:35.729599] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-21T18:28:35.729686] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-21T18:28:35.731092] [DEBUG] [LOCAL ] EDU: Trimmed 67176 records to 44834 (keeping 200 days of data) [2025-10-21T18:28:35.985760] [DEBUG] [LOCAL ] EDU: Primary data saved (44834 records). [2025-10-21T18:28:35.985888] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-21T18:28:35.985965] [INFO ] [MAIN ] Update Progress: 697/2366 symbols completed. EDU took 27.1s. Estimated remaining: 3h 31m 60s. Rate: 7.9 symbols/min [2025-10-21T18:28:36.150227] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:36.151003] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-21T18:28:36.193230] [DEBUG] [LOCAL ] EFC: Loaded 46426 existing records from primary storage. [2025-10-21T18:28:36.193537] [INFO ] [MAIN ] EFC: Loaded 46426 existing records. [2025-10-21T18:28:36.366024] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:36.366235] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-21T18:28:36.366286] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-21T18:28:36.366792] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-21T18:28:36.366849] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-21T18:28:36.720445] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:36.733775] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:28:36.861917] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T18:28:36.950984] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-21T18:28:37.750983] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-21T18:28:38.164682] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-21T18:28:38.551031] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-21T18:28:38.661408] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:28:39.351003] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-21T18:28:39.588279] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T18:28:40.150992] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-21T18:28:40.386026] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:28:40.951016] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-21T18:28:41.460505] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T18:28:41.751060] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-21T18:28:41.900903] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T18:28:42.120853] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-21T18:28:42.551022] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-21T18:28:43.351049] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-21T18:28:43.387838] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T18:28:44.151036] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-21T18:28:44.904967] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:28:44.950996] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-21T18:28:45.001940] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T18:28:45.751056] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-21T18:28:46.551055] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-21T18:28:46.631735] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T18:28:46.633183] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T18:28:47.042564] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T18:28:47.351032] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-21T18:28:48.151025] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-21T18:28:48.872600] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T18:28:48.951023] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-21T18:28:49.258926] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:28:49.431939] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T18:28:49.751028] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-21T18:28:50.258259] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-21T18:28:50.551029] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-21T18:28:51.351039] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-21T18:28:52.071497] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T18:28:52.151555] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-21T18:28:52.154350] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T18:28:52.632067] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T18:28:52.951088] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-21T18:28:53.539742] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:28:53.541422] [INFO ] [REMOTE ] EEX: Full fetch complete (18426 records). [2025-10-21T18:28:53.541491] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-21T18:28:53.756198] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-21T18:28:53.907199] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-21T18:28:53.907276] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-21T18:28:53.907718] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-21T18:28:53.907781] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-21T18:28:53.908351] [DEBUG] [LOCAL ] EEX: Trimmed 18426 records to 9972 (keeping 200 days of data) [2025-10-21T18:28:53.965679] [DEBUG] [LOCAL ] EEX: Primary data saved (9972 records). [2025-10-21T18:28:53.965821] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-21T18:28:53.965900] [INFO ] [MAIN ] Update Progress: 698/2366 symbols completed. EEX took 21.8s. Estimated remaining: 3h 32m 17s. Rate: 7.9 symbols/min [2025-10-21T18:28:54.137273] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:54.137479] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-10-21T18:28:54.137542] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-10-21T18:28:54.137684] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-21T18:28:54.137738] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-21T18:28:54.137780] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-10-21T18:28:54.137812] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-21T18:28:54.407675] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T18:28:54.419349] [INFO ] [REMOTE ] EEA: Full fetch complete (3747 records). [2025-10-21T18:28:54.424969] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-21T18:28:54.558276] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-21T18:28:54.606836] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:54.689599] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T18:28:54.689855] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:28:54.689926] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:28:54.689977] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-21T18:28:54.690050] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-21T18:28:54.690130] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-21T18:28:54.690192] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-21T18:28:54.690254] [INFO ] [MAIN ] Update Progress: 699/2366 symbols completed. EEA took 25.9s. Estimated remaining: 3h 31m 53s. Rate: 7.9 symbols/min [2025-10-21T18:28:54.859979] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:28:54.873554] [DEBUG] [LOCAL ] EFT: Loaded 12980 existing records from primary storage. [2025-10-21T18:28:54.873799] [INFO ] [MAIN ] EFT: Loaded 12980 existing records. [2025-10-21T18:28:55.060481] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:28:55.060726] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-21T18:28:55.060801] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-21T18:28:55.061133] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-21T18:28:55.061190] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-21T18:28:55.353728] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-21T18:28:55.435074] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:28:56.129742] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:28:56.150988] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-21T18:28:56.951057] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-21T18:28:57.062950] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T18:28:57.503449] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:28:57.751047] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-21T18:28:57.849868] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T18:28:58.551029] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-21T18:28:58.598969] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T18:28:59.351037] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-21T18:29:00.066541] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T18:29:00.151064] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-21T18:29:00.324734] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T18:29:00.951049] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-21T18:29:01.716104] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:29:01.750984] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-21T18:29:01.998941] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T18:29:02.551059] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-21T18:29:03.085033] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T18:29:03.351052] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-21T18:29:03.365798] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:29:04.151063] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-21T18:29:04.950998] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-21T18:29:05.162342] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:29:05.183243] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T18:29:05.751018] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-21T18:29:06.377552] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T18:29:06.551082] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-21T18:29:07.352905] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-21T18:29:07.354113] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T18:29:07.588622] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T18:29:08.151041] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-21T18:29:08.270147] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T18:29:08.951009] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-21T18:29:09.184817] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T18:29:09.751010] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-21T18:29:10.551056] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-21T18:29:10.618346] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T18:29:11.098508] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T18:29:11.103552] [INFO ] [REMOTE ] EE: Full fetch complete (44050 records). [2025-10-21T18:29:11.103634] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-21T18:29:11.104217] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:29:11.104297] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:29:11.104339] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:29:11.104406] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-21T18:29:11.104466] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-21T18:29:11.104501] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-10-21T18:29:11.104697] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-10-21T18:29:11.105059] [INFO ] [MAIN ] Update Progress: 700/2366 symbols completed. EE took 43.6s. Estimated remaining: 3h 32m 6s. Rate: 7.9 symbols/min [2025-10-21T18:29:11.271581] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:11.312420] [DEBUG] [LOCAL ] EFX: Loaded 44781 existing records from primary storage. [2025-10-21T18:29:11.312768] [INFO ] [MAIN ] EFX: Loaded 44781 existing records. [2025-10-21T18:29:11.374975] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-21T18:29:11.502053] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:11.502908] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T18:29:11.506544] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-21T18:29:11.506605] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-21T18:29:11.507375] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-21T18:29:11.507432] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-21T18:29:11.884221] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:12.151069] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-21T18:29:12.951123] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-21T18:29:13.055275] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T18:29:13.364716] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:29:13.372872] [INFO ] [REMOTE ] EFC: Full fetch complete (66643 records). [2025-10-21T18:29:13.372987] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-21T18:29:13.685191] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T18:29:13.760822] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-21T18:29:13.781848] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-21T18:29:13.782713] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-21T18:29:13.783542] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-21T18:29:13.783694] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-21T18:29:13.784968] [DEBUG] [LOCAL ] EFC: Trimmed 66643 records to 46334 (keeping 200 days of data) [2025-10-21T18:29:14.072596] [DEBUG] [LOCAL ] EFC: Primary data saved (46334 records). [2025-10-21T18:29:14.072746] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-21T18:29:14.072829] [INFO ] [MAIN ] Update Progress: 701/2366 symbols completed. EFC took 38.1s. Estimated remaining: 3h 31m 47s. Rate: 7.9 symbols/min [2025-10-21T18:29:14.242135] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:14.270229] [DEBUG] [LOCAL ] EFXT: Loaded 29637 existing records from primary storage. [2025-10-21T18:29:14.270488] [INFO ] [MAIN ] EFXT: Loaded 29637 existing records. [2025-10-21T18:29:14.447189] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:14.447378] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-21T18:29:14.447422] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-21T18:29:14.447971] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-21T18:29:14.448029] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-21T18:29:14.556228] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-21T18:29:14.821002] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:15.351092] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-21T18:29:15.391379] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T18:29:15.470628] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:29:16.151053] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-21T18:29:16.406285] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T18:29:16.951003] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-21T18:29:16.991603] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T18:29:17.690546] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T18:29:17.751020] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-21T18:29:18.508758] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T18:29:18.550983] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-21T18:29:19.350998] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-21T18:29:19.634680] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T18:29:20.151055] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-21T18:29:20.888508] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:29:20.951033] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-21T18:29:21.751053] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-21T18:29:21.877739] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T18:29:22.179861] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T18:29:22.182936] [INFO ] [REMOTE ] EFR: Full fetch complete (19590 records). [2025-10-21T18:29:22.183007] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-21T18:29:22.554086] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-21T18:29:22.554278] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-21T18:29:22.554352] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-21T18:29:22.555939] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-21T18:29:22.556013] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-21T18:29:22.556999] [DEBUG] [LOCAL ] EFR: Trimmed 19590 records to 15065 (keeping 200 days of data) [2025-10-21T18:29:22.651934] [DEBUG] [LOCAL ] EFR: Primary data saved (15065 records). [2025-10-21T18:29:22.652052] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-21T18:29:22.652119] [INFO ] [MAIN ] Update Progress: 702/2366 symbols completed. EFR took 28.7s. Estimated remaining: 3h 31m 42s. Rate: 7.9 symbols/min [2025-10-21T18:29:22.760205] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T18:29:22.776307] [INFO ] [REMOTE ] EFT: Full fetch complete (17720 records). [2025-10-21T18:29:22.786629] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-21T18:29:22.925210] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:23.157329] [DEBUG] [LOCAL ] EG: Loaded 27781 existing records from primary storage. [2025-10-21T18:29:23.186935] [INFO ] [MAIN ] EG: Loaded 27781 existing records. [2025-10-21T18:29:23.286376] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-21T18:29:23.292134] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-21T18:29:23.297692] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-21T18:29:23.308880] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-21T18:29:23.320102] [DEBUG] [LOCAL ] EFT: Trimmed 17720 records to 13016 (keeping 200 days of data) [2025-10-21T18:29:23.358990] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-21T18:29:23.440264] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:23.440781] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-21T18:29:23.472951] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-21T18:29:23.477517] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-21T18:29:23.478525] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-21T18:29:23.544510] [DEBUG] [LOCAL ] EFT: Primary data saved (13016 records). [2025-10-21T18:29:23.556171] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-21T18:29:23.561390] [INFO ] [MAIN ] Update Progress: 703/2366 symbols completed. EFT took 28.9s. Estimated remaining: 3h 31m 18s. Rate: 7.9 symbols/min [2025-10-21T18:29:23.942382] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:23.974122] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:29:24.056241] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:24.097178] [DEBUG] [LOCAL ] EGO: Loaded 51745 existing records from primary storage. [2025-10-21T18:29:24.097506] [INFO ] [MAIN ] EGO: Loaded 51745 existing records. [2025-10-21T18:29:24.158853] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-21T18:29:24.290999] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:24.291207] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-21T18:29:24.291255] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-21T18:29:24.292119] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-21T18:29:24.292176] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-21T18:29:24.663935] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:24.951019] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-21T18:29:25.074545] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:29:25.751024] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-21T18:29:25.785832] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:29:26.551076] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-21T18:29:26.793575] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T18:29:27.037774] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T18:29:27.351037] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-21T18:29:27.786590] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T18:29:28.151037] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-21T18:29:28.951093] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-21T18:29:29.015333] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:29:29.131214] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T18:29:29.751059] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-21T18:29:30.038193] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T18:29:30.551027] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-21T18:29:31.135022] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T18:29:31.351019] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-21T18:29:32.150986] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-21T18:29:32.246392] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:29:32.788389] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T18:29:32.951044] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-21T18:29:33.750999] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-21T18:29:33.975862] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T18:29:34.371846] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T18:29:34.551021] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-21T18:29:35.351000] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-21T18:29:35.520815] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T18:29:36.102168] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:29:36.158636] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-21T18:29:36.162552] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T18:29:36.951101] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-21T18:29:37.203366] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:29:37.751075] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-21T18:29:38.550996] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-21T18:29:38.785738] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:29:38.812491] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T18:29:39.351067] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-21T18:29:40.151010] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-21T18:29:40.367514] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T18:29:40.478253] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:29:40.951028] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-21T18:29:41.441074] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T18:29:41.751024] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-21T18:29:42.126102] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T18:29:42.551073] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-21T18:29:43.351074] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-21T18:29:43.428567] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T18:29:44.151020] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-21T18:29:44.401760] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T18:29:44.542410] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T18:29:44.951031] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-21T18:29:45.481690] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T18:29:45.485548] [INFO ] [REMOTE ] EG: Full fetch complete (42990 records). [2025-10-21T18:29:45.485626] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-21T18:29:45.756213] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-21T18:29:45.870109] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-21T18:29:45.870237] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-21T18:29:45.870967] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-21T18:29:45.871029] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-21T18:29:45.872006] [DEBUG] [LOCAL ] EG: Trimmed 42990 records to 27710 (keeping 200 days of data) [2025-10-21T18:29:46.062987] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T18:29:46.076925] [DEBUG] [LOCAL ] EG: Primary data saved (27710 records). [2025-10-21T18:29:46.077028] [INFO ] [MAIN ] EG: Full history saved. [2025-10-21T18:29:46.077096] [INFO ] [MAIN ] Update Progress: 704/2366 symbols completed. EG took 23.4s. Estimated remaining: 3h 31m 46s. Rate: 7.8 symbols/min [2025-10-21T18:29:46.243358] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:46.243518] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-10-21T18:29:46.243554] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-10-21T18:29:46.243685] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-21T18:29:46.243738] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-21T18:29:46.243780] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-21T18:29:46.243811] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-21T18:29:46.556209] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-21T18:29:46.632387] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:47.351007] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-21T18:29:47.650560] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T18:29:47.912101] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T18:29:47.918013] [INFO ] [REMOTE ] EFXT: Full fetch complete (44028 records). [2025-10-21T18:29:47.918251] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-21T18:29:47.919103] [FATAL] [VALIDATOR ] EFXT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:29:47.919200] [FATAL] [MAIN ] EFXT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:29:47.919243] [WARN ] [MAIN ] EFXT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:29:47.919286] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-21T18:29:47.919355] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-21T18:29:47.919392] [INFO ] [LOCAL ] EFXT: Starting deletion of derivative data. [2025-10-21T18:29:47.919560] [DEBUG] [LOCAL ] EFXT: Deleted derivative data file. [2025-10-21T18:29:47.919668] [INFO ] [MAIN ] Update Progress: 705/2366 symbols completed. EFXT took 33.8s. Estimated remaining: 3h 31m 25s. Rate: 7.9 symbols/min [2025-10-21T18:29:48.114974] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:48.158972] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-21T18:29:48.162745] [DEBUG] [LOCAL ] EGY: Loaded 41464 existing records from primary storage. [2025-10-21T18:29:48.163274] [INFO ] [MAIN ] EGY: Loaded 41464 existing records. [2025-10-21T18:29:48.354557] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:29:48.354851] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-21T18:29:48.354902] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-21T18:29:48.355463] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-21T18:29:48.355520] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-21T18:29:48.762505] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:48.826690] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T18:29:48.951062] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-21T18:29:49.751003] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-21T18:29:49.901858] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T18:29:50.551047] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-21T18:29:50.591871] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T18:29:51.164507] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:29:51.351089] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-21T18:29:52.151024] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-21T18:29:52.245598] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:29:52.951051] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-21T18:29:53.027911] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T18:29:53.289569] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T18:29:53.751040] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-21T18:29:54.464241] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:29:54.550991] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-21T18:29:55.351053] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-21T18:29:55.611307] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:29:55.801942] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T18:29:56.151101] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-21T18:29:56.951071] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-21T18:29:57.101610] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T18:29:57.108968] [INFO ] [REMOTE ] EFX: Full fetch complete (65040 records). [2025-10-21T18:29:57.109089] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-21T18:29:57.497128] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-21T18:29:57.497268] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-21T18:29:57.498121] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-21T18:29:57.498189] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-21T18:29:57.499479] [DEBUG] [LOCAL ] EFX: Trimmed 65040 records to 44767 (keeping 200 days of data) [2025-10-21T18:29:57.764377] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-21T18:29:57.768364] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T18:29:57.811683] [DEBUG] [LOCAL ] EFX: Primary data saved (44767 records). [2025-10-21T18:29:57.812179] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-21T18:29:57.812900] [INFO ] [MAIN ] Update Progress: 706/2366 symbols completed. EFX took 46.7s. Estimated remaining: 3h 31m 22s. Rate: 7.9 symbols/min [2025-10-21T18:29:57.984302] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:29:57.984532] [DEBUG] [LOCAL ] EHAB: No existing data file found in primary storage. [2025-10-21T18:29:57.984625] [WARN ] [MAIN ] EHAB: No existing data found, performing full refresh instead. [2025-10-21T18:29:57.985010] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-21T18:29:57.985072] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-21T18:29:57.985203] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-21T18:29:57.985308] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-21T18:29:58.344499] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T18:29:58.375183] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:29:58.551008] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-21T18:29:59.351033] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-21T18:29:59.517594] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T18:29:59.598186] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:29:59.607277] [INFO ] [REMOTE ] EGO: Full fetch complete (74505 records). [2025-10-21T18:29:59.607429] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-21T18:30:00.013660] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-21T18:30:00.013775] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-21T18:30:00.014742] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-21T18:30:00.014807] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-21T18:30:00.016271] [DEBUG] [LOCAL ] EGO: Trimmed 74505 records to 51738 (keeping 200 days of data) [2025-10-21T18:30:00.180959] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-21T18:30:00.320263] [DEBUG] [LOCAL ] EGO: Primary data saved (51738 records). [2025-10-21T18:30:00.320408] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-21T18:30:00.320487] [INFO ] [MAIN ] Update Progress: 707/2366 symbols completed. EGO took 36.8s. Estimated remaining: 3h 31m 3s. Rate: 7.9 symbols/min [2025-10-21T18:30:00.491791] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:00.535171] [DEBUG] [LOCAL ] EHC: Loaded 41026 existing records from primary storage. [2025-10-21T18:30:00.535471] [INFO ] [MAIN ] EHC: Loaded 41026 existing records. [2025-10-21T18:30:00.719824] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:30:00.720044] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-21T18:30:00.720092] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-21T18:30:00.720915] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-21T18:30:00.720973] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-21T18:30:00.971476] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-21T18:30:01.096122] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:01.309520] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T18:30:01.698378] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T18:30:01.751023] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-21T18:30:02.551078] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-21T18:30:03.050895] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-21T18:30:03.351014] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-21T18:30:03.519253] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:30:04.150996] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-21T18:30:04.324829] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:30:04.635061] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T18:30:04.951071] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-21T18:30:05.751048] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-21T18:30:05.989901] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T18:30:06.066505] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T18:30:06.551058] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-21T18:30:07.333557] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T18:30:07.351012] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-21T18:30:08.156124] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-21T18:30:08.174101] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:30:08.756890] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T18:30:08.951139] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-21T18:30:09.436274] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T18:30:09.751025] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-21T18:30:10.184901] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T18:30:10.551036] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-21T18:30:11.351033] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-21T18:30:11.536427] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:30:12.139227] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T18:30:12.150987] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-21T18:30:12.854560] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:30:12.951039] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-21T18:30:13.385928] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T18:30:13.751027] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-21T18:30:14.347764] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:30:14.352700] [INFO ] [REMOTE ] EGP: Full fetch complete (45501 records). [2025-10-21T18:30:14.352846] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-21T18:30:14.556613] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-21T18:30:14.735369] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-21T18:30:14.735451] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-21T18:30:14.736106] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-21T18:30:14.736170] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-21T18:30:14.737167] [DEBUG] [LOCAL ] EGP: Trimmed 45501 records to 30323 (keeping 200 days of data) [2025-10-21T18:30:14.937175] [DEBUG] [LOCAL ] EGP: Primary data saved (30323 records). [2025-10-21T18:30:14.937371] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-21T18:30:14.937597] [INFO ] [MAIN ] Update Progress: 708/2366 symbols completed. EGP took 28.9s. Estimated remaining: 3h 31m 11s. Rate: 7.9 symbols/min [2025-10-21T18:30:15.112902] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:15.148951] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:30:15.166603] [DEBUG] [LOCAL ] EHI: Loaded 10543 existing records from primary storage. [2025-10-21T18:30:15.166889] [INFO ] [MAIN ] EHI: Loaded 10543 existing records. [2025-10-21T18:30:15.341056] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:30:15.341273] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-21T18:30:15.341321] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-21T18:30:15.341531] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-21T18:30:15.341588] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-21T18:30:15.356172] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-21T18:30:15.695664] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:15.938970] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T18:30:16.151078] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-21T18:30:16.913743] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T18:30:16.951064] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-21T18:30:17.751021] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-21T18:30:17.829983] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T18:30:17.920794] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-21T18:30:17.927194] [INFO ] [REMOTE ] EGY: Full fetch complete (60834 records). [2025-10-21T18:30:17.927343] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-21T18:30:18.305692] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-21T18:30:18.305786] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-21T18:30:18.306539] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-21T18:30:18.306578] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-21T18:30:18.309040] [DEBUG] [LOCAL ] EGY: Trimmed 60834 records to 41354 (keeping 200 days of data) [2025-10-21T18:30:18.543159] [DEBUG] [LOCAL ] EGY: Primary data saved (41354 records). [2025-10-21T18:30:18.543280] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-21T18:30:18.543354] [INFO ] [MAIN ] Update Progress: 709/2366 symbols completed. EGY took 30.6s. Estimated remaining: 3h 30m 54s. Rate: 7.9 symbols/min [2025-10-21T18:30:18.556258] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-21T18:30:18.717308] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:18.739339] [DEBUG] [LOCAL ] EIC: Loaded 22699 existing records from primary storage. [2025-10-21T18:30:18.739584] [INFO ] [MAIN ] EIC: Loaded 22699 existing records. [2025-10-21T18:30:18.916046] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:30:18.916282] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-21T18:30:18.916329] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-21T18:30:18.916542] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-21T18:30:18.916608] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-21T18:30:19.267873] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:19.351000] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-21T18:30:19.410048] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T18:30:19.747425] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T18:30:20.150995] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-21T18:30:20.525316] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:30:20.951059] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-21T18:30:21.458088] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T18:30:21.650139] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T18:30:21.751013] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-21T18:30:22.551039] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-21T18:30:23.266283] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:30:23.352071] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-21T18:30:23.353568] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T18:30:24.151102] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-21T18:30:24.497477] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T18:30:24.924015] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T18:30:24.951018] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-21T18:30:25.756451] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-21T18:30:25.757721] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T18:30:26.551049] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-21T18:30:26.849713] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T18:30:27.351081] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-21T18:30:27.860294] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T18:30:28.151063] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-21T18:30:28.273144] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-21T18:30:28.951025] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-21T18:30:29.745845] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T18:30:29.755186] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-21T18:30:30.114079] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T18:30:30.551054] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-21T18:30:30.636897] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T18:30:31.351105] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-21T18:30:31.871286] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T18:30:32.151098] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-21T18:30:32.736822] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T18:30:32.951123] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-21T18:30:33.080558] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T18:30:33.083783] [INFO ] [REMOTE ] EHI: Full fetch complete (15812 records). [2025-10-21T18:30:33.083905] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-21T18:30:33.443752] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-21T18:30:33.443825] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-21T18:30:33.444140] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-21T18:30:33.444177] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-21T18:30:33.444637] [DEBUG] [LOCAL ] EHI: Trimmed 15812 records to 10531 (keeping 200 days of data) [2025-10-21T18:30:33.501972] [DEBUG] [LOCAL ] EHI: Primary data saved (10531 records). [2025-10-21T18:30:33.502081] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-21T18:30:33.502156] [INFO ] [MAIN ] Update Progress: 710/2366 symbols completed. EHI took 18.6s. Estimated remaining: 3h 31m 4s. Rate: 7.8 symbols/min [2025-10-21T18:30:33.672823] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:33.673042] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-21T18:30:33.673091] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-21T18:30:33.673197] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-21T18:30:33.673260] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-21T18:30:33.673335] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-21T18:30:33.673390] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-21T18:30:33.756205] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-21T18:30:34.029774] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:34.346333] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:30:34.551081] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-21T18:30:35.058411] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T18:30:35.099337] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T18:30:35.351018] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-21T18:30:36.151059] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-21T18:30:36.475053] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-21T18:30:36.656737] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T18:30:36.665693] [INFO ] [REMOTE ] EHC: Full fetch complete (58766 records). [2025-10-21T18:30:36.665882] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-21T18:30:36.957749] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-21T18:30:37.055769] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-21T18:30:37.055861] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-21T18:30:37.056834] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-21T18:30:37.056901] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-21T18:30:37.058242] [DEBUG] [LOCAL ] EHC: Trimmed 58766 records to 40976 (keeping 200 days of data) [2025-10-21T18:30:37.250565] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-21T18:30:37.321377] [DEBUG] [LOCAL ] EHC: Primary data saved (40976 records). [2025-10-21T18:30:37.321510] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-21T18:30:37.322160] [INFO ] [MAIN ] Update Progress: 711/2366 symbols completed. EHC took 37.0s. Estimated remaining: 3h 30m 47s. Rate: 7.9 symbols/min [2025-10-21T18:30:37.528571] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:37.528907] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-21T18:30:37.528953] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-21T18:30:37.529086] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-21T18:30:37.529130] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-21T18:30:37.529169] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-21T18:30:37.529200] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-21T18:30:37.756217] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-21T18:30:37.903754] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:38.551044] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-21T18:30:39.031633] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:30:39.035851] [INFO ] [REMOTE ] EHAB: Full fetch complete (41047 records). [2025-10-21T18:30:39.035949] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-21T18:30:39.129147] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T18:30:39.356169] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-21T18:30:39.418529] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-21T18:30:39.418613] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-21T18:30:39.419248] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-21T18:30:39.419303] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-21T18:30:39.420264] [DEBUG] [LOCAL ] EHAB: Trimmed 41047 records to 29287 (keeping 200 days of data) [2025-10-21T18:30:39.581579] [DEBUG] [LOCAL ] EHAB: Primary data saved (29287 records). [2025-10-21T18:30:39.581758] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-21T18:30:39.581839] [INFO ] [MAIN ] Update Progress: 712/2366 symbols completed. EHAB took 41.8s. Estimated remaining: 3h 30m 27s. Rate: 7.9 symbols/min [2025-10-21T18:30:39.750061] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:39.750241] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-21T18:30:39.750277] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-21T18:30:39.750384] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-21T18:30:39.750425] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-21T18:30:39.750465] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-21T18:30:39.750513] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-21T18:30:40.105594] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:40.150991] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-21T18:30:40.606427] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:30:40.737036] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-21T18:30:40.951014] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-21T18:30:41.522331] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T18:30:41.751011] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-21T18:30:42.380947] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T18:30:42.551058] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-21T18:30:42.977785] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T18:30:43.351035] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-21T18:30:44.151093] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-21T18:30:44.489519] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-21T18:30:44.706037] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T18:30:44.951052] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-21T18:30:45.382578] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-21T18:30:45.751057] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-21T18:30:46.450271] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T18:30:46.551056] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-21T18:30:47.351006] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-21T18:30:47.687375] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T18:30:47.806881] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:30:48.151017] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-21T18:30:48.591878] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-21T18:30:48.951074] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-21T18:30:49.300153] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T18:30:49.751023] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-21T18:30:50.285863] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T18:30:50.551035] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-21T18:30:51.281524] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T18:30:51.350988] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-21T18:30:52.151010] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-21T18:30:52.539576] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-21T18:30:52.677952] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T18:30:52.951048] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-21T18:30:53.288539] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-21T18:30:53.751009] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-21T18:30:54.101612] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-21T18:30:54.551097] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-21T18:30:55.351047] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-21T18:30:55.773913] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T18:30:55.777291] [INFO ] [REMOTE ] EIC: Full fetch complete (34278 records). [2025-10-21T18:30:55.777367] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-21T18:30:56.039819] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-21T18:30:56.154590] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-21T18:30:56.154854] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-21T18:30:56.154940] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-21T18:30:56.156277] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-21T18:30:56.156359] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-21T18:30:56.157250] [DEBUG] [LOCAL ] EIC: Trimmed 34278 records to 22643 (keeping 200 days of data) [2025-10-21T18:30:56.290377] [DEBUG] [LOCAL ] EIC: Primary data saved (22643 records). [2025-10-21T18:30:56.290491] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-21T18:30:56.290583] [INFO ] [MAIN ] Update Progress: 713/2366 symbols completed. EIC took 37.7s. Estimated remaining: 3h 30m 40s. Rate: 7.8 symbols/min [2025-10-21T18:30:56.455310] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:30:56.455469] [DEBUG] [LOCAL ] EIG: No existing data file found in primary storage. [2025-10-21T18:30:56.455504] [WARN ] [MAIN ] EIG: No existing data found, performing full refresh instead. [2025-10-21T18:30:56.455607] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-21T18:30:56.455671] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-21T18:30:56.455735] [DEBUG] [LOCAL ] EIG: No primary data file found to delete. [2025-10-21T18:30:56.455768] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-21T18:30:56.788980] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T18:30:56.820145] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:30:56.951014] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-21T18:30:57.751065] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-21T18:30:58.092372] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T18:30:58.414580] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:30:58.551023] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-21T18:30:59.270126] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T18:30:59.351042] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-21T18:30:59.974964] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T18:30:59.976479] [INFO ] [REMOTE ] EICC: Full fetch complete (8452 records). [2025-10-21T18:30:59.976546] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-21T18:30:59.976932] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:30:59.977015] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:30:59.977056] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:30:59.977095] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-21T18:30:59.977148] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-21T18:30:59.977183] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-21T18:30:59.977267] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-21T18:30:59.977326] [INFO ] [MAIN ] Update Progress: 714/2366 symbols completed. EICC took 20.4s. Estimated remaining: 3h 30m 24s. Rate: 7.9 symbols/min [2025-10-21T18:31:00.152875] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:00.151131] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-21T18:31:00.153788] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-10-21T18:31:00.153838] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-10-21T18:31:00.153942] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-21T18:31:00.153983] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-21T18:31:00.154022] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-21T18:31:00.154054] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-21T18:31:00.511430] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:00.951041] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-21T18:31:01.055613] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T18:31:01.751071] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-21T18:31:02.551083] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-21T18:31:02.828113] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T18:31:03.195664] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T18:31:03.196376] [INFO ] [REMOTE ] EICA: Full fetch complete (1251 records). [2025-10-21T18:31:03.196441] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-21T18:31:03.196796] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:31:03.196877] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:03.196919] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:03.196955] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-21T18:31:03.197005] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-21T18:31:03.197039] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-21T18:31:03.197077] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-21T18:31:03.197125] [INFO ] [MAIN ] Update Progress: 715/2366 symbols completed. EICA took 29.7s. Estimated remaining: 3h 30m 6s. Rate: 7.9 symbols/min [2025-10-21T18:31:03.377145] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:03.358259] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-21T18:31:03.427815] [DEBUG] [LOCAL ] EL: Loaded 53387 existing records from primary storage. [2025-10-21T18:31:03.428177] [INFO ] [MAIN ] EL: Loaded 53387 existing records. [2025-10-21T18:31:03.612493] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:31:03.612735] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-21T18:31:03.612796] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-21T18:31:03.623320] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-21T18:31:03.638133] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-21T18:31:03.719658] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-10-21T18:31:03.910334] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-21T18:31:04.018188] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:04.151040] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-21T18:31:04.727945] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T18:31:04.951114] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-21T18:31:05.751055] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-21T18:31:06.211722] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T18:31:06.551054] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-21T18:31:06.966567] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T18:31:07.139162] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:31:07.140107] [INFO ] [REMOTE ] EICB: Full fetch complete (2697 records). [2025-10-21T18:31:07.140174] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-21T18:31:07.319953] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T18:31:07.320137] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:07.320225] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:07.320297] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-21T18:31:07.320359] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-21T18:31:07.320395] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-21T18:31:07.320434] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-21T18:31:07.320487] [INFO ] [MAIN ] Update Progress: 716/2366 symbols completed. EICB took 30.0s. Estimated remaining: 3h 29m 50s. Rate: 7.9 symbols/min [2025-10-21T18:31:07.356176] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-21T18:31:07.496303] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:07.547156] [DEBUG] [LOCAL ] ELAN: Loaded 53315 existing records from primary storage. [2025-10-21T18:31:07.547477] [INFO ] [MAIN ] ELAN: Loaded 53315 existing records. [2025-10-21T18:31:07.728990] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:31:07.729199] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-21T18:31:07.729281] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-21T18:31:07.730323] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-21T18:31:07.730388] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-21T18:31:08.088809] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:08.151006] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-21T18:31:08.951042] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-21T18:31:09.534271] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-21T18:31:09.751029] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-21T18:31:09.853784] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:31:10.173063] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:31:10.551094] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-21T18:31:11.351051] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-21T18:31:11.455368] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:31:11.860302] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T18:31:12.151060] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-21T18:31:12.753749] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:31:12.951054] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-21T18:31:13.750997] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-21T18:31:14.159032] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T18:31:14.189085] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T18:31:14.551060] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-21T18:31:15.351071] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-21T18:31:15.616067] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T18:31:15.869968] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-21T18:31:16.151036] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-21T18:31:16.951070] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-21T18:31:17.300930] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:31:17.751013] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-21T18:31:18.059167] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T18:31:18.092747] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T18:31:18.551075] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-21T18:31:19.282253] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T18:31:19.351101] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-21T18:31:20.151082] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-21T18:31:20.695614] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:31:20.849173] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-21T18:31:20.951001] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-21T18:31:21.714037] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T18:31:21.750985] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-21T18:31:22.551084] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-21T18:31:23.136940] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T18:31:23.277133] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T18:31:23.350993] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-21T18:31:23.438258] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:31:24.151024] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-21T18:31:24.951003] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-21T18:31:25.228797] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T18:31:25.751167] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-21T18:31:25.953987] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T18:31:25.973608] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:31:25.976874] [INFO ] [REMOTE ] EIG: Full fetch complete (27275 records). [2025-10-21T18:31:25.976967] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-21T18:31:26.369366] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-21T18:31:26.369448] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-21T18:31:26.370035] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-21T18:31:26.370098] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-21T18:31:26.370876] [DEBUG] [LOCAL ] EIG: Trimmed 27275 records to 20185 (keeping 200 days of data) [2025-10-21T18:31:26.491662] [DEBUG] [LOCAL ] EIG: Primary data saved (20185 records). [2025-10-21T18:31:26.491785] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-21T18:31:26.491850] [INFO ] [MAIN ] Update Progress: 717/2366 symbols completed. EIG took 30.2s. Estimated remaining: 3h 30m 9s. Rate: 7.8 symbols/min [2025-10-21T18:31:26.550982] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-21T18:31:27.351079] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-21T18:31:27.929329] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-21T18:31:28.150992] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-21T18:31:28.186905] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T18:31:28.951056] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-21T18:31:29.371990] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T18:31:29.751072] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-21T18:31:30.829416] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T18:31:30.840686] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-21T18:31:31.143627] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-10-21T18:31:31.351072] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-21T18:31:31.604129] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T18:31:32.151023] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-21T18:31:33.173030] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T18:31:33.184839] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-21T18:31:33.875773] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-21T18:31:33.888586] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-21T18:31:34.236888] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T18:31:34.247208] [INFO ] [REMOTE ] ELAN: Full fetch complete (77096 records). [2025-10-21T18:31:34.247484] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-21T18:31:34.699105] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-21T18:31:34.699321] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-21T18:31:34.700896] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-21T18:31:34.701096] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-21T18:31:34.703366] [DEBUG] [LOCAL ] ELAN: Trimmed 77096 records to 53313 (keeping 200 days of data) [2025-10-21T18:31:34.866132] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T18:31:34.939133] [INFO ] [REMOTE ] EL: Full fetch complete (77051 records). [2025-10-21T18:31:34.967288] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-21T18:31:35.017607] [FATAL] [VALIDATOR ] EL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:31:35.058604] [FATAL] [MAIN ] EL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:35.077530] [WARN ] [MAIN ] EL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:35.079949] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-21T18:31:35.091756] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-21T18:31:35.094537] [INFO ] [LOCAL ] EL: Starting deletion of derivative data. [2025-10-21T18:31:35.096252] [DEBUG] [LOCAL ] EL: Deleted derivative data file. [2025-10-21T18:31:35.096889] [INFO ] [MAIN ] Update Progress: 718/2366 symbols completed. EL took 31.9s. Estimated remaining: 3h 30m 3s. Rate: 7.8 symbols/min [2025-10-21T18:31:35.112892] [DEBUG] [LOCAL ] ELAN: Primary data saved (53313 records). [2025-10-21T18:31:35.113082] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-21T18:31:35.113623] [INFO ] [MAIN ] Update Progress: 719/2366 symbols completed. ELAN took 27.8s. Estimated remaining: 3h 29m 38s. Rate: 7.9 symbols/min [2025-10-21T18:31:35.149107] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T18:31:35.160746] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-21T18:31:36.613425] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T18:31:36.625108] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-21T18:31:37.412085] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T18:31:37.420074] [INFO ] [REMOTE ] EIX: Full fetch complete (77068 records). [2025-10-21T18:31:37.420205] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-21T18:31:37.421022] [FATAL] [VALIDATOR ] EIX: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:31:37.421131] [FATAL] [MAIN ] EIX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:37.421175] [WARN ] [MAIN ] EIX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:37.421240] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-21T18:31:37.421306] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-10-21T18:31:37.421342] [INFO ] [LOCAL ] EIX: Starting deletion of derivative data. [2025-10-21T18:31:37.421382] [DEBUG] [LOCAL ] EIX: No derivative data file found to delete. [2025-10-21T18:31:37.421437] [INFO ] [MAIN ] Update Progress: 720/2366 symbols completed. EIX took 37.4s. Estimated remaining: 3h 29m 18s. Rate: 7.9 symbols/min [2025-10-21T18:31:37.998303] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:38.008901] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:38.075052] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:38.131979] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:38.132176] [DEBUG] [LOCAL ] ELF: No existing data file found in primary storage. [2025-10-21T18:31:38.132354] [WARN ] [MAIN ] ELF: No existing data found, performing full refresh instead. [2025-10-21T18:31:38.132795] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-21T18:31:38.132955] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-21T18:31:38.132905] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-21T18:31:38.133101] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-21T18:31:38.136769] [DEBUG] [LOCAL ] ELC: Loaded 3476 existing records from primary storage. [2025-10-21T18:31:38.134225] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-21T18:31:38.137329] [INFO ] [MAIN ] ELC: Loaded 3476 existing records. [2025-10-21T18:31:38.137454] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-21T18:31:38.137104] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-21T18:31:38.158368] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-21T18:31:38.189553] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-21T18:31:38.200695] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-21T18:31:38.536098] [DEBUG] [LOCAL ] ELME: Loaded 39361 existing records from primary storage. [2025-10-21T18:31:38.590814] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:31:38.615451] [INFO ] [MAIN ] ELME: Loaded 39361 existing records. [2025-10-21T18:31:38.705679] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-21T18:31:38.706043] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-21T18:31:38.874556] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-21T18:31:38.887240] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-21T18:31:39.287797] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:31:39.334234] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:39.339742] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-21T18:31:39.363250] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-21T18:31:39.372829] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-21T18:31:39.408621] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:39.449984] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-21T18:31:39.459154] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-21T18:31:39.458848] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-21T18:31:39.880013] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:39.905480] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-21T18:31:40.033961] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:40.034279] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-21T18:31:40.587849] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T18:31:40.589728] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-21T18:31:40.827175] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:31:40.833293] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-21T18:31:41.216416] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:31:41.217780] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-21T18:31:41.460537] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-21T18:31:41.501611] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T18:31:41.756211] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-21T18:31:41.774745] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T18:31:41.795685] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T18:31:42.551083] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-21T18:31:43.351053] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-21T18:31:43.687566] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T18:31:43.867593] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T18:31:44.151070] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-21T18:31:44.323623] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T18:31:44.951126] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-21T18:31:45.331696] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:31:45.751064] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-21T18:31:46.551066] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-21T18:31:47.021229] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T18:31:47.126502] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T18:31:47.172620] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T18:31:47.351059] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-21T18:31:48.151033] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-21T18:31:48.717373] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T18:31:48.838795] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T18:31:48.951038] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-21T18:31:49.751045] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-21T18:31:50.313221] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T18:31:50.440541] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:31:50.551004] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-21T18:31:51.351078] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-21T18:31:52.037428] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-21T18:31:52.070175] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T18:31:52.151028] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-21T18:31:52.951021] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-21T18:31:53.751052] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-21T18:31:54.242780] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T18:31:54.354960] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T18:31:54.551054] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-21T18:31:55.066195] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T18:31:55.109005] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T18:31:55.351067] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-21T18:31:56.151059] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-21T18:31:56.720402] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T18:31:56.854786] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T18:31:56.951053] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-21T18:31:57.751010] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-21T18:31:58.360978] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T18:31:58.362460] [INFO ] [REMOTE ] ELC: Full fetch complete (4894 records). [2025-10-21T18:31:58.362546] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-21T18:31:58.363009] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:31:58.363095] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:31:58.363143] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:31:58.363205] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-21T18:31:58.363279] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-21T18:31:58.363346] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-10-21T18:31:58.363548] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-10-21T18:31:58.363637] [INFO ] [MAIN ] Update Progress: 721/2366 symbols completed. ELC took 20.9s. Estimated remaining: 3h 29m 41s. Rate: 7.8 symbols/min [2025-10-21T18:31:58.546490] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:31:58.546724] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-21T18:31:58.546794] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-21T18:31:58.546938] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-21T18:31:58.547091] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-21T18:31:58.547178] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-21T18:31:58.547231] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-21T18:31:58.558167] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-21T18:31:58.665265] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:31:59.008436] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:31:59.351025] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-21T18:32:00.151024] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-21T18:32:00.898800] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T18:32:00.951011] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-21T18:32:01.089215] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-21T18:32:01.336023] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:32:01.751030] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-21T18:32:02.139440] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T18:32:02.551059] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-21T18:32:03.331922] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T18:32:03.340439] [INFO ] [REMOTE ] ELME: Full fetch complete (55681 records). [2025-10-21T18:32:03.340556] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-21T18:32:03.341389] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:03.341492] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:03.341546] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:03.341588] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-21T18:32:03.341752] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-21T18:32:03.341822] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-21T18:32:03.341986] [DEBUG] [LOCAL ] ELME: Deleted derivative data file. [2025-10-21T18:32:03.342082] [INFO ] [MAIN ] Update Progress: 722/2366 symbols completed. ELME took 25.9s. Estimated remaining: 3h 29m 27s. Rate: 7.8 symbols/min [2025-10-21T18:32:03.356105] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-21T18:32:03.519735] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:03.563779] [DEBUG] [LOCAL ] ELS: Loaded 49903 existing records from primary storage. [2025-10-21T18:32:03.564112] [INFO ] [MAIN ] ELS: Loaded 49903 existing records. [2025-10-21T18:32:03.747178] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T18:32:03.784091] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:03.785039] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-21T18:32:03.785102] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-21T18:32:03.785991] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-21T18:32:03.786048] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-21T18:32:04.130401] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:04.150988] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-21T18:32:04.951122] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-21T18:32:05.297112] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-21T18:32:05.746518] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T18:32:05.755551] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-21T18:32:06.035630] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-21T18:32:06.551011] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-21T18:32:06.865622] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T18:32:07.351084] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-21T18:32:08.150997] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-21T18:32:08.459338] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T18:32:08.463001] [INFO ] [REMOTE ] ELP: Full fetch complete (36700 records). [2025-10-21T18:32:08.463088] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-21T18:32:08.463615] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:08.463719] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:08.463783] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:08.463854] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-21T18:32:08.463916] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-21T18:32:08.463951] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-10-21T18:32:08.463988] [DEBUG] [LOCAL ] ELP: No derivative data file found to delete. [2025-10-21T18:32:08.464041] [INFO ] [MAIN ] Update Progress: 723/2366 symbols completed. ELP took 31.0s. Estimated remaining: 3h 29m 14s. Rate: 7.9 symbols/min [2025-10-21T18:32:08.638686] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:08.671828] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T18:32:08.724218] [DEBUG] [LOCAL ] ELV: Loaded 50756 existing records from primary storage. [2025-10-21T18:32:08.724524] [INFO ] [MAIN ] ELV: Loaded 50756 existing records. [2025-10-21T18:32:08.897087] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:08.897300] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-21T18:32:08.897345] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-21T18:32:08.898293] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-21T18:32:08.898350] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-21T18:32:08.960718] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-21T18:32:09.252162] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:09.751060] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-21T18:32:09.832215] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T18:32:10.109016] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:32:10.551094] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-21T18:32:11.008819] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:32:11.017275] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-21T18:32:11.351063] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-21T18:32:12.151060] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-21T18:32:12.951030] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-21T18:32:13.055326] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:32:13.751048] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-21T18:32:14.028414] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T18:32:14.157902] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-21T18:32:14.551033] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-21T18:32:14.690364] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T18:32:15.351132] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-21T18:32:15.726993] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-21T18:32:16.151100] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-21T18:32:16.855314] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T18:32:16.868123] [INFO ] [REMOTE ] ELF: Full fetch complete (75497 records). [2025-10-21T18:32:16.868328] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-21T18:32:16.956164] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-21T18:32:17.279055] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-21T18:32:17.279136] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-21T18:32:17.280027] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-21T18:32:17.280091] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-21T18:32:17.281459] [DEBUG] [LOCAL ] ELF: Trimmed 75497 records to 51917 (keeping 200 days of data) [2025-10-21T18:32:17.380049] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T18:32:17.599667] [DEBUG] [LOCAL ] ELF: Primary data saved (51917 records). [2025-10-21T18:32:17.599845] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-21T18:32:17.599949] [INFO ] [MAIN ] Update Progress: 724/2366 symbols completed. ELF took 40.2s. Estimated remaining: 3h 29m 10s. Rate: 7.9 symbols/min [2025-10-21T18:32:17.751854] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-21T18:32:17.774095] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:17.775389] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-21T18:32:17.775464] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-21T18:32:17.799595] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-21T18:32:17.800970] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:32:17.801075] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-21T18:32:17.810804] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-21T18:32:17.811266] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-21T18:32:18.179755] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:18.551023] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-21T18:32:18.888097] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-21T18:32:19.351089] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-21T18:32:19.642946] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T18:32:20.151157] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-21T18:32:20.874306] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T18:32:20.951044] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-21T18:32:21.751045] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-21T18:32:22.202693] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T18:32:22.251793] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-21T18:32:22.550999] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-21T18:32:22.755251] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T18:32:23.016436] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T18:32:23.017192] [INFO ] [REMOTE ] ELPC: Full fetch complete (1375 records). [2025-10-21T18:32:23.017263] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-21T18:32:23.017589] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:23.017691] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:23.017759] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:23.017830] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-21T18:32:23.017891] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-21T18:32:23.017951] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-21T18:32:23.018014] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-21T18:32:23.018068] [INFO ] [MAIN ] Update Progress: 725/2366 symbols completed. ELPC took 24.7s. Estimated remaining: 3h 28m 57s. Rate: 7.9 symbols/min [2025-10-21T18:32:23.200085] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:23.219541] [DEBUG] [LOCAL ] EMD: Loaded 20926 existing records from primary storage. [2025-10-21T18:32:23.219828] [INFO ] [MAIN ] EMD: Loaded 20926 existing records. [2025-10-21T18:32:23.356164] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-21T18:32:23.414516] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:23.414934] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-21T18:32:23.414990] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-21T18:32:23.415433] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-21T18:32:23.415489] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-21T18:32:23.792941] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:24.151029] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-21T18:32:24.951064] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-21T18:32:25.276622] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:32:25.277155] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-21T18:32:25.277249] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:32:25.277304] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-21T18:32:25.277375] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:32:25.277460] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-21T18:32:25.277539] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-21T18:32:25.277594] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-21T18:32:25.277702] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-21T18:32:25.277787] [INFO ] [MAIN ] Update Progress: 726/2366 symbols completed. EMA took 7.7s. Estimated remaining: 3h 28m 37s. Rate: 7.9 symbols/min [2025-10-21T18:32:25.404415] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T18:32:25.481819] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:25.517528] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T18:32:25.553220] [DEBUG] [LOCAL ] EME: Loaded 30809 existing records from primary storage. [2025-10-21T18:32:25.553583] [INFO ] [MAIN ] EME: Loaded 30809 existing records. [2025-10-21T18:32:25.731945] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:25.732156] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-21T18:32:25.732203] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-21T18:32:25.732800] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-21T18:32:25.732857] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-21T18:32:25.761488] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-21T18:32:26.089125] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:26.551066] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-21T18:32:26.936732] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T18:32:27.351037] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-21T18:32:28.151114] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-21T18:32:28.352680] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:32:28.951032] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-21T18:32:29.253282] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:32:29.750996] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-21T18:32:29.847296] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T18:32:30.465858] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:32:30.551001] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-21T18:32:31.274692] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:32:31.325146] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T18:32:31.350986] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-21T18:32:32.151000] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-21T18:32:32.452421] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T18:32:32.951053] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-21T18:32:33.688876] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:32:33.751030] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-21T18:32:34.551022] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-21T18:32:35.162457] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T18:32:35.209097] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T18:32:35.350994] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-21T18:32:35.649956] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T18:32:36.151026] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-21T18:32:36.951005] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-21T18:32:37.077513] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T18:32:37.751023] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-21T18:32:38.197215] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-21T18:32:38.551011] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-21T18:32:38.738362] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:32:38.855386] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T18:32:39.351040] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-21T18:32:39.928453] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T18:32:40.151038] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-21T18:32:40.951062] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-21T18:32:41.018203] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T18:32:41.750994] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-21T18:32:42.001287] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:32:42.068185] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T18:32:42.551034] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-21T18:32:43.351041] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-21T18:32:43.584986] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:32:43.592496] [INFO ] [REMOTE ] ELS: Full fetch complete (70892 records). [2025-10-21T18:32:43.592623] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-21T18:32:43.593418] [FATAL] [VALIDATOR ] ELS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:43.593506] [FATAL] [MAIN ] ELS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:43.593565] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:43.593683] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-21T18:32:43.593774] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-10-21T18:32:43.593827] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-10-21T18:32:43.594007] [DEBUG] [LOCAL ] ELS: Deleted derivative data file. [2025-10-21T18:32:43.594483] [INFO ] [MAIN ] Update Progress: 727/2366 symbols completed. ELS took 40.3s. Estimated remaining: 3h 28m 54s. Rate: 7.8 symbols/min [2025-10-21T18:32:43.770734] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:43.776751] [DEBUG] [LOCAL ] EMF: Loaded 3172 existing records from primary storage. [2025-10-21T18:32:43.776978] [INFO ] [MAIN ] EMF: Loaded 3172 existing records. [2025-10-21T18:32:43.991935] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:43.992160] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-21T18:32:43.992220] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-21T18:32:43.992426] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-21T18:32:43.992484] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-21T18:32:44.156918] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-21T18:32:44.384732] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:44.508176] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T18:32:44.540092] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:32:44.548628] [INFO ] [REMOTE ] ELV: Full fetch complete (72929 records). [2025-10-21T18:32:44.548846] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-21T18:32:44.549810] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:32:44.549921] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:32:44.550001] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:32:44.550114] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-21T18:32:44.550212] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-21T18:32:44.550282] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-21T18:32:44.550475] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-10-21T18:32:44.551111] [INFO ] [MAIN ] Update Progress: 728/2366 symbols completed. ELV took 36.1s. Estimated remaining: 3h 28m 31s. Rate: 7.9 symbols/min [2025-10-21T18:32:44.729385] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:44.776462] [DEBUG] [LOCAL ] EMN: Loaded 50838 existing records from primary storage. [2025-10-21T18:32:44.776785] [INFO ] [MAIN ] EMN: Loaded 50838 existing records. [2025-10-21T18:32:44.950408] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:44.950634] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-21T18:32:44.950714] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-21T18:32:44.951034] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-21T18:32:44.952108] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-21T18:32:44.952166] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-21T18:32:45.307850] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:45.321638] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T18:32:45.751041] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-21T18:32:46.170007] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:32:46.551047] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-21T18:32:47.353630] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-21T18:32:47.356821] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T18:32:48.016078] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-21T18:32:48.039833] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T18:32:48.151030] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-21T18:32:48.566709] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-21T18:32:48.951121] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-21T18:32:49.751102] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-21T18:32:50.521610] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T18:32:50.526461] [INFO ] [REMOTE ] EME: Full fetch complete (47018 records). [2025-10-21T18:32:50.526598] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-21T18:32:50.557756] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-21T18:32:50.917800] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-21T18:32:50.917887] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-21T18:32:50.918639] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-21T18:32:50.918728] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-21T18:32:50.919771] [DEBUG] [LOCAL ] EME: Trimmed 47018 records to 30734 (keeping 200 days of data) [2025-10-21T18:32:51.135469] [DEBUG] [LOCAL ] EME: Primary data saved (30734 records). [2025-10-21T18:32:51.135788] [INFO ] [MAIN ] EME: Full history saved. [2025-10-21T18:32:51.135908] [INFO ] [MAIN ] Update Progress: 729/2366 symbols completed. EME took 25.9s. Estimated remaining: 3h 28m 21s. Rate: 7.9 symbols/min [2025-10-21T18:32:51.326914] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:51.340460] [DEBUG] [LOCAL ] EMO: Loaded 13342 existing records from primary storage. [2025-10-21T18:32:51.346680] [INFO ] [MAIN ] EMO: Loaded 13342 existing records. [2025-10-21T18:32:51.377992] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T18:32:51.378197] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-21T18:32:51.550017] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T18:32:51.570974] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:51.580423] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-21T18:32:51.580894] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-21T18:32:51.581345] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-21T18:32:51.581405] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-21T18:32:52.020495] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:52.151037] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-21T18:32:52.722264] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T18:32:52.951048] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-21T18:32:53.000596] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T18:32:53.751045] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-21T18:32:54.459981] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-21T18:32:54.551071] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-21T18:32:54.961549] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T18:32:55.351086] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-21T18:32:55.937836] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T18:32:56.067286] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T18:32:56.070880] [INFO ] [REMOTE ] EMD: Full fetch complete (32037 records). [2025-10-21T18:32:56.070955] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-21T18:32:56.156252] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-21T18:32:56.435709] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-21T18:32:56.435792] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-21T18:32:56.436327] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-21T18:32:56.436369] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-21T18:32:56.437124] [DEBUG] [LOCAL ] EMD: Trimmed 32037 records to 20913 (keeping 200 days of data) [2025-10-21T18:32:56.559359] [DEBUG] [LOCAL ] EMD: Primary data saved (20913 records). [2025-10-21T18:32:56.559484] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-21T18:32:56.559559] [INFO ] [MAIN ] Update Progress: 730/2366 symbols completed. EMD took 33.5s. Estimated remaining: 3h 28m 9s. Rate: 7.9 symbols/min [2025-10-21T18:32:56.728823] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:32:56.732955] [DEBUG] [LOCAL ] EMP: Loaded 2945 existing records from primary storage. [2025-10-21T18:32:56.733101] [INFO ] [MAIN ] EMP: Loaded 2945 existing records. [2025-10-21T18:32:56.915107] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:32:56.915343] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-21T18:32:56.915449] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-21T18:32:56.915681] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-21T18:32:56.915738] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-21T18:32:56.956318] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-21T18:32:57.280192] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:32:57.678776] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:32:57.704352] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:32:57.750999] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-21T18:32:58.551088] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-21T18:32:59.224035] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T18:32:59.340879] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:32:59.351003] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-21T18:33:00.151081] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-21T18:33:00.951068] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-21T18:33:01.282255] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T18:33:01.751095] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-21T18:33:02.095759] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-10-21T18:33:02.551066] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-21T18:33:03.209026] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:33:03.350997] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-21T18:33:03.384526] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-21T18:33:03.411878] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:33:04.151064] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-21T18:33:04.724312] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:33:04.950998] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-21T18:33:05.073024] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T18:33:05.607300] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T18:33:05.751057] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-21T18:33:06.551089] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-21T18:33:06.665903] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T18:33:07.195620] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-21T18:33:07.351018] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-21T18:33:07.965177] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:33:08.151071] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-21T18:33:08.801567] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T18:33:08.802750] [INFO ] [REMOTE ] EMF: Full fetch complete (6115 records). [2025-10-21T18:33:08.802821] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-21T18:33:08.956142] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-21T18:33:09.315987] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-21T18:33:09.316096] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-21T18:33:09.316322] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-21T18:33:09.316362] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-21T18:33:09.316987] [DEBUG] [LOCAL ] EMF: Trimmed 6115 records to 3131 (keeping 200 days of data) [2025-10-21T18:33:09.339218] [DEBUG] [LOCAL ] EMF: Primary data saved (3131 records). [2025-10-21T18:33:09.339360] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-21T18:33:09.339443] [INFO ] [MAIN ] Update Progress: 731/2366 symbols completed. EMF took 25.7s. Estimated remaining: 3h 28m 12s. Rate: 7.9 symbols/min [2025-10-21T18:33:09.572251] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:09.637729] [DEBUG] [LOCAL ] EMR: Loaded 53176 existing records from primary storage. [2025-10-21T18:33:09.638149] [INFO ] [MAIN ] EMR: Loaded 53176 existing records. [2025-10-21T18:33:09.754266] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-21T18:33:09.857737] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:09.858082] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-21T18:33:09.858146] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-21T18:33:09.859583] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-21T18:33:09.859693] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-21T18:33:10.134515] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:33:10.275680] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:10.450039] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T18:33:10.551034] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-21T18:33:11.351039] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-21T18:33:11.866169] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T18:33:12.151043] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-21T18:33:12.366344] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T18:33:12.674497] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-21T18:33:12.951025] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-21T18:33:13.518260] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T18:33:13.751045] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-21T18:33:14.267845] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T18:33:14.551056] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-21T18:33:15.350998] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-21T18:33:15.433476] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T18:33:16.151078] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-21T18:33:16.951009] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-21T18:33:17.354250] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T18:33:17.515624] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T18:33:17.517127] [INFO ] [REMOTE ] EMP: Full fetch complete (4055 records). [2025-10-21T18:33:17.517260] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-21T18:33:17.518503] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:33:17.518813] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:33:17.518881] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:33:17.518978] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-21T18:33:17.519048] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-21T18:33:17.519087] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-10-21T18:33:17.519201] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-10-21T18:33:17.519293] [INFO ] [MAIN ] Update Progress: 732/2366 symbols completed. EMP took 21.0s. Estimated remaining: 3h 28m 6s. Rate: 7.9 symbols/min [2025-10-21T18:33:17.697312] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:17.746061] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-21T18:33:17.746372] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-21T18:33:17.757898] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-21T18:33:17.941882] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:17.942182] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-21T18:33:17.942247] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-21T18:33:17.943252] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-21T18:33:17.943313] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-21T18:33:18.154620] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T18:33:18.353203] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:18.551028] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-21T18:33:18.886117] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T18:33:19.351021] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-21T18:33:20.151082] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-21T18:33:20.914211] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-21T18:33:20.950996] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-21T18:33:21.166504] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T18:33:21.166992] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:33:21.182163] [INFO ] [REMOTE ] EMO: Full fetch complete (17696 records). [2025-10-21T18:33:21.182327] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-21T18:33:21.556090] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-21T18:33:21.556171] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-21T18:33:21.556604] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-21T18:33:21.556663] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-21T18:33:21.557168] [DEBUG] [LOCAL ] EMO: Trimmed 17696 records to 13345 (keeping 200 days of data) [2025-10-21T18:33:21.634292] [DEBUG] [LOCAL ] EMO: Primary data saved (13345 records). [2025-10-21T18:33:21.634420] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-21T18:33:21.634510] [INFO ] [MAIN ] Update Progress: 733/2366 symbols completed. EMO took 30.5s. Estimated remaining: 3h 27m 50s. Rate: 7.9 symbols/min [2025-10-21T18:33:21.756210] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-21T18:33:21.802709] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:21.840823] [DEBUG] [LOCAL ] ENIC: Loaded 36571 existing records from primary storage. [2025-10-21T18:33:21.841147] [INFO ] [MAIN ] ENIC: Loaded 36571 existing records. [2025-10-21T18:33:22.015338] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:22.015592] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-21T18:33:22.015639] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-21T18:33:22.016291] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-21T18:33:22.016348] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-21T18:33:22.443707] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:22.473139] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T18:33:22.550987] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-21T18:33:23.351043] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-21T18:33:23.700628] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T18:33:24.151032] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-21T18:33:24.410995] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:33:24.442283] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T18:33:24.951020] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-21T18:33:25.751076] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-21T18:33:25.912302] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T18:33:26.551040] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-21T18:33:26.615091] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:33:27.200172] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:33:27.208243] [INFO ] [REMOTE ] EMN: Full fetch complete (72411 records). [2025-10-21T18:33:27.208374] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-21T18:33:27.360685] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-21T18:33:27.604235] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-21T18:33:27.604313] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-21T18:33:27.605168] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-21T18:33:27.605230] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-21T18:33:27.606557] [DEBUG] [LOCAL ] EMN: Trimmed 72411 records to 50825 (keeping 200 days of data) [2025-10-21T18:33:27.917191] [DEBUG] [LOCAL ] EMN: Primary data saved (50825 records). [2025-10-21T18:33:27.917317] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-21T18:33:27.917973] [INFO ] [MAIN ] Update Progress: 734/2366 symbols completed. EMN took 43.4s. Estimated remaining: 3h 27m 40s. Rate: 7.9 symbols/min [2025-10-21T18:33:28.092315] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:28.092513] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-21T18:33:28.092609] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-21T18:33:28.092751] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-21T18:33:28.092823] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-21T18:33:28.093032] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-21T18:33:28.093140] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-21T18:33:28.156404] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-21T18:33:28.482037] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:28.524797] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T18:33:28.763019] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:33:28.951070] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-21T18:33:29.751012] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-21T18:33:30.013935] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T18:33:30.406155] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T18:33:30.551067] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-21T18:33:30.609299] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T18:33:31.351041] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-21T18:33:31.936779] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T18:33:32.151049] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-21T18:33:32.619155] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T18:33:32.951047] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-21T18:33:33.148050] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T18:33:33.751055] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-21T18:33:34.454137] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:33:34.551016] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-21T18:33:35.351013] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-21T18:33:35.665210] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T18:33:35.801946] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T18:33:36.045597] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:33:36.151032] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-21T18:33:36.951065] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-21T18:33:37.595526] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T18:33:37.751017] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-21T18:33:38.551027] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-21T18:33:39.055701] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T18:33:39.090117] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:33:39.351038] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-21T18:33:40.151026] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-21T18:33:40.468965] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:33:40.579114] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-21T18:33:40.711052] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T18:33:40.951067] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-21T18:33:41.751077] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-21T18:33:42.551090] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-21T18:33:42.737491] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:33:43.227226] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T18:33:43.232313] [INFO ] [REMOTE ] ENIC: Full fetch complete (51154 records). [2025-10-21T18:33:43.232406] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-21T18:33:43.232994] [FATAL] [VALIDATOR ] ENIC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:33:43.233076] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:33:43.233161] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:33:43.233232] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-21T18:33:43.233294] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-21T18:33:43.233329] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-10-21T18:33:43.233464] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-10-21T18:33:43.233556] [INFO ] [MAIN ] Update Progress: 735/2366 symbols completed. ENIC took 21.6s. Estimated remaining: 3h 27m 49s. Rate: 7.8 symbols/min [2025-10-21T18:33:43.356121] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-21T18:33:43.406267] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:43.444464] [DEBUG] [LOCAL ] ENOV: Loaded 44779 existing records from primary storage. [2025-10-21T18:33:43.444762] [INFO ] [MAIN ] ENOV: Loaded 44779 existing records. [2025-10-21T18:33:43.618974] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:43.619148] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-21T18:33:43.619193] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-21T18:33:43.619881] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-21T18:33:43.619965] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-21T18:33:43.971258] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:44.151063] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-21T18:33:44.673601] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-21T18:33:44.950998] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-21T18:33:45.305989] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T18:33:45.751001] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-21T18:33:45.971267] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T18:33:46.357060] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T18:33:46.550993] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-21T18:33:47.080221] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T18:33:47.218824] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-21T18:33:47.351068] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-21T18:33:48.151069] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-21T18:33:48.590628] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T18:33:48.950999] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-21T18:33:49.438929] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T18:33:49.447408] [INFO ] [REMOTE ] ENB: Full fetch complete (77658 records). [2025-10-21T18:33:49.447573] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-21T18:33:49.756285] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-21T18:33:49.884432] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-21T18:33:49.884538] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-21T18:33:49.885624] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-21T18:33:49.885738] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-21T18:33:49.887331] [DEBUG] [LOCAL ] ENB: Trimmed 77658 records to 53511 (keeping 200 days of data) [2025-10-21T18:33:50.219065] [DEBUG] [LOCAL ] ENB: Primary data saved (53511 records). [2025-10-21T18:33:50.219207] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-21T18:33:50.220049] [INFO ] [MAIN ] Update Progress: 736/2366 symbols completed. ENB took 32.7s. Estimated remaining: 3h 27m 40s. Rate: 7.8 symbols/min [2025-10-21T18:33:50.395405] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:50.436384] [DEBUG] [LOCAL ] ENR: Loaded 43825 existing records from primary storage. [2025-10-21T18:33:50.436725] [INFO ] [MAIN ] ENR: Loaded 43825 existing records. [2025-10-21T18:33:50.554924] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-21T18:33:50.628821] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:50.629137] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-21T18:33:50.629331] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-21T18:33:50.630195] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-21T18:33:50.630257] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-21T18:33:50.938910] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T18:33:51.061123] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:51.170054] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T18:33:51.231625] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T18:33:51.350990] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-21T18:33:51.791664] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-21T18:33:52.151082] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-21T18:33:52.951102] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-21T18:33:53.423309] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T18:33:53.424118] [INFO ] [REMOTE ] ENO: Full fetch complete (2985 records). [2025-10-21T18:33:53.424184] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-21T18:33:53.424507] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:33:53.424591] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:33:53.424632] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:33:53.424720] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-21T18:33:53.424780] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-21T18:33:53.424814] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-10-21T18:33:53.424858] [DEBUG] [LOCAL ] ENO: No derivative data file found to delete. [2025-10-21T18:33:53.424911] [INFO ] [MAIN ] Update Progress: 737/2366 symbols completed. ENO took 25.5s. Estimated remaining: 3h 27m 23s. Rate: 7.9 symbols/min [2025-10-21T18:33:53.601753] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:53.601997] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-10-21T18:33:53.602049] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-10-21T18:33:53.602157] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-21T18:33:53.602199] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-21T18:33:53.602241] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-21T18:33:53.602271] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-21T18:33:53.754538] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-21T18:33:53.974281] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:54.005482] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T18:33:54.551125] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-21T18:33:55.359336] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-21T18:33:55.382065] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T18:33:55.420226] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T18:33:55.430020] [INFO ] [REMOTE ] EMR: Full fetch complete (77215 records). [2025-10-21T18:33:55.430195] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-21T18:33:55.838002] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-21T18:33:55.838092] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-21T18:33:55.839005] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-21T18:33:55.839068] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-21T18:33:55.840696] [DEBUG] [LOCAL ] EMR: Trimmed 77215 records to 53171 (keeping 200 days of data) [2025-10-21T18:33:56.158731] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-21T18:33:56.168679] [DEBUG] [LOCAL ] EMR: Primary data saved (53171 records). [2025-10-21T18:33:56.168814] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-21T18:33:56.169612] [INFO ] [MAIN ] Update Progress: 738/2366 symbols completed. EMR took 46.8s. Estimated remaining: 3h 27m 4s. Rate: 7.9 symbols/min [2025-10-21T18:33:56.372065] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:33:56.397217] [DEBUG] [LOCAL ] ENVA: Loaded 25413 existing records from primary storage. [2025-10-21T18:33:56.397461] [INFO ] [MAIN ] ENVA: Loaded 25413 existing records. [2025-10-21T18:33:56.571629] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:33:56.571889] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-21T18:33:56.571944] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-21T18:33:56.572371] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-21T18:33:56.572425] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-21T18:33:56.931395] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:33:56.950986] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-21T18:33:57.109545] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T18:33:57.680291] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T18:33:57.751000] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-21T18:33:58.225091] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T18:33:58.551015] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-21T18:33:59.350987] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-21T18:33:59.459210] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T18:33:59.888315] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T18:34:00.151022] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-21T18:34:00.272630] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T18:34:00.951017] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-21T18:34:01.751074] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-21T18:34:02.149284] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T18:34:02.551006] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-21T18:34:02.727851] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:34:03.289578] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:34:03.350986] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-21T18:34:03.978760] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T18:34:04.151032] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-21T18:34:04.951077] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-21T18:34:05.135799] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T18:34:05.751041] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-21T18:34:05.941369] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T18:34:06.497339] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T18:34:06.551022] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-21T18:34:07.320170] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T18:34:07.351000] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-21T18:34:08.151083] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-21T18:34:08.258865] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T18:34:08.747247] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T18:34:08.951029] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-21T18:34:09.751013] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-21T18:34:09.857532] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:34:10.551051] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-21T18:34:10.638680] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:34:11.222175] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T18:34:11.351041] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-21T18:34:12.021744] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T18:34:12.151048] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-21T18:34:12.937668] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T18:34:12.951328] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-21T18:34:13.530795] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T18:34:13.702572] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T18:34:13.750988] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-21T18:34:14.551102] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-21T18:34:14.893451] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T18:34:15.351094] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-21T18:34:16.122143] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T18:34:16.127987] [INFO ] [REMOTE ] ENOV: Full fetch complete (63174 records). [2025-10-21T18:34:16.128097] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-21T18:34:16.128705] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:34:16.128803] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:34:16.128864] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:34:16.128930] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-21T18:34:16.128993] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-21T18:34:16.129028] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-21T18:34:16.129181] [DEBUG] [LOCAL ] ENOV: Deleted derivative data file. [2025-10-21T18:34:16.129268] [INFO ] [MAIN ] Update Progress: 739/2366 symbols completed. ENOV took 32.9s. Estimated remaining: 3h 27m 24s. Rate: 7.8 symbols/min [2025-10-21T18:34:16.159870] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-21T18:34:16.298941] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:16.314180] [DEBUG] [LOCAL ] EOD: Loaded 15056 existing records from primary storage. [2025-10-21T18:34:16.314392] [INFO ] [MAIN ] EOD: Loaded 15056 existing records. [2025-10-21T18:34:16.493570] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:16.493747] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-21T18:34:16.493796] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-21T18:34:16.493933] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-21T18:34:16.493969] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-21T18:34:16.859124] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:16.950991] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-21T18:34:16.953102] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T18:34:17.654243] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T18:34:17.751061] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-21T18:34:18.468583] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T18:34:18.551074] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-21T18:34:19.351134] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-21T18:34:19.616192] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T18:34:19.770544] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:34:20.151036] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-21T18:34:20.714463] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:34:20.951017] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-21T18:34:21.075465] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T18:34:21.751023] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-21T18:34:22.324299] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T18:34:22.551002] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-21T18:34:22.966168] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T18:34:23.333982] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T18:34:23.351025] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-21T18:34:24.151025] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-21T18:34:24.897026] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T18:34:24.902389] [INFO ] [REMOTE ] ENS: Full fetch complete (42720 records). [2025-10-21T18:34:24.902475] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-21T18:34:24.956719] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-21T18:34:25.281731] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-21T18:34:25.281807] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-21T18:34:25.282383] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-21T18:34:25.282422] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-21T18:34:25.283706] [DEBUG] [LOCAL ] ENS: Trimmed 42720 records to 29741 (keeping 200 days of data) [2025-10-21T18:34:25.463363] [DEBUG] [LOCAL ] ENS: Primary data saved (29741 records). [2025-10-21T18:34:25.463477] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-21T18:34:25.463543] [INFO ] [MAIN ] Update Progress: 740/2366 symbols completed. ENS took 32.0s. Estimated remaining: 3h 27m 20s. Rate: 7.8 symbols/min [2025-10-21T18:34:25.632197] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:25.686338] [DEBUG] [LOCAL ] EOG: Loaded 53391 existing records from primary storage. [2025-10-21T18:34:25.686671] [INFO ] [MAIN ] EOG: Loaded 53391 existing records. [2025-10-21T18:34:25.753935] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-21T18:34:25.872857] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:25.873289] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-21T18:34:25.873570] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-21T18:34:25.880161] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-21T18:34:25.881511] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-21T18:34:25.903945] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T18:34:26.015896] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T18:34:26.271733] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:26.551023] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-21T18:34:27.056320] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T18:34:27.060044] [INFO ] [REMOTE ] ENVA: Full fetch complete (36497 records). [2025-10-21T18:34:27.060120] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-21T18:34:27.356185] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-21T18:34:27.431764] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-21T18:34:27.431863] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-21T18:34:27.432450] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-21T18:34:27.432510] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-21T18:34:27.433296] [DEBUG] [LOCAL ] ENVA: Trimmed 36497 records to 25267 (keeping 200 days of data) [2025-10-21T18:34:27.578427] [DEBUG] [LOCAL ] ENVA: Primary data saved (25267 records). [2025-10-21T18:34:27.578557] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-21T18:34:27.578636] [INFO ] [MAIN ] Update Progress: 741/2366 symbols completed. ENVA took 31.4s. Estimated remaining: 3h 27m 0s. Rate: 7.9 symbols/min [2025-10-21T18:34:27.749906] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:27.760158] [DEBUG] [LOCAL ] EOI: Loaded 10601 existing records from primary storage. [2025-10-21T18:34:27.760315] [INFO ] [MAIN ] EOI: Loaded 10601 existing records. [2025-10-21T18:34:27.940468] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:27.940696] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-21T18:34:27.940788] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-21T18:34:27.941114] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-21T18:34:27.941171] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-21T18:34:28.161357] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-21T18:34:28.306946] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:28.916913] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-10-21T18:34:28.951003] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-21T18:34:28.950946] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T18:34:29.160741] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T18:34:29.751018] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-21T18:34:30.551022] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-21T18:34:30.785014] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T18:34:31.248381] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T18:34:31.261100] [INFO ] [REMOTE ] ENR: Full fetch complete (59632 records). [2025-10-21T18:34:31.265492] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-21T18:34:31.265837] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T18:34:31.356103] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-21T18:34:31.681089] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-21T18:34:31.681184] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-21T18:34:31.681966] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-21T18:34:31.682031] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-21T18:34:31.683347] [DEBUG] [LOCAL ] ENR: Trimmed 59632 records to 43882 (keeping 200 days of data) [2025-10-21T18:34:31.957151] [DEBUG] [LOCAL ] ENR: Primary data saved (43882 records). [2025-10-21T18:34:31.957460] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-21T18:34:31.957558] [INFO ] [MAIN ] Update Progress: 742/2366 symbols completed. ENR took 41.7s. Estimated remaining: 3h 26m 45s. Rate: 7.9 symbols/min [2025-10-21T18:34:32.126963] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:32.141912] [DEBUG] [LOCAL ] EOS: Loaded 14852 existing records from primary storage. [2025-10-21T18:34:32.142140] [INFO ] [MAIN ] EOS: Loaded 14852 existing records. [2025-10-21T18:34:32.156330] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-21T18:34:32.335548] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:32.335881] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-21T18:34:32.335936] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-21T18:34:32.336640] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-21T18:34:32.336728] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-21T18:34:32.636886] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T18:34:32.741729] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:32.951032] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-21T18:34:33.245874] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T18:34:33.751013] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-21T18:34:34.305069] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-21T18:34:34.551051] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-21T18:34:34.765393] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T18:34:35.351036] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-21T18:34:35.361980] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:34:36.150986] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-21T18:34:36.322938] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T18:34:36.951013] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-21T18:34:37.751024] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-21T18:34:37.864247] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T18:34:38.097270] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T18:34:38.551111] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-21T18:34:39.185510] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T18:34:39.351012] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-21T18:34:39.597208] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T18:34:40.151001] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-21T18:34:40.288632] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T18:34:40.951029] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-21T18:34:41.750994] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-21T18:34:42.026543] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T18:34:42.029545] [INFO ] [REMOTE ] EOD: Full fetch complete (20821 records). [2025-10-21T18:34:42.029614] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-21T18:34:42.428790] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-21T18:34:42.438211] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-21T18:34:42.449067] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-21T18:34:42.450754] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-21T18:34:42.450948] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-21T18:34:42.452711] [DEBUG] [LOCAL ] EOD: Trimmed 20821 records to 15024 (keeping 200 days of data) [2025-10-21T18:34:42.537964] [DEBUG] [LOCAL ] EOD: Primary data saved (15024 records). [2025-10-21T18:34:42.544559] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-21T18:34:42.544830] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T18:34:42.547425] [INFO ] [MAIN ] Update Progress: 743/2366 symbols completed. EOD took 26.4s. Estimated remaining: 3h 26m 44s. Rate: 7.9 symbols/min [2025-10-21T18:34:42.558183] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-21T18:34:42.723318] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:42.723498] [DEBUG] [LOCAL ] EOT: No existing data file found in primary storage. [2025-10-21T18:34:42.723536] [WARN ] [MAIN ] EOT: No existing data found, performing full refresh instead. [2025-10-21T18:34:42.723673] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-21T18:34:42.723744] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-21T18:34:42.723809] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-21T18:34:42.723853] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-21T18:34:43.081780] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:43.351014] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-21T18:34:44.097802] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T18:34:44.151011] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-21T18:34:44.453822] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:34:44.951020] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-21T18:34:45.330095] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:34:45.751086] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-21T18:34:45.813860] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T18:34:46.521806] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:34:46.551003] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-21T18:34:47.270310] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T18:34:47.351001] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-21T18:34:48.069976] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T18:34:48.151056] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-21T18:34:48.800259] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T18:34:48.951061] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-21T18:34:49.563749] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:34:49.751039] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-21T18:34:50.469927] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T18:34:50.551033] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-21T18:34:51.245169] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-21T18:34:51.351037] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-21T18:34:52.125846] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T18:34:52.150990] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-21T18:34:52.938456] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T18:34:52.950984] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-21T18:34:53.751056] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-21T18:34:53.889259] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T18:34:53.891623] [INFO ] [REMOTE ] EOI: Full fetch complete (16108 records). [2025-10-21T18:34:53.891753] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-21T18:34:54.272155] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-21T18:34:54.272229] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-21T18:34:54.272573] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-21T18:34:54.272612] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-21T18:34:54.273099] [DEBUG] [LOCAL ] EOI: Trimmed 16108 records to 10545 (keeping 200 days of data) [2025-10-21T18:34:54.335460] [DEBUG] [LOCAL ] EOI: Primary data saved (10545 records). [2025-10-21T18:34:54.335575] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-21T18:34:54.335669] [INFO ] [MAIN ] Update Progress: 744/2366 symbols completed. EOI took 26.8s. Estimated remaining: 3h 26m 45s. Rate: 7.8 symbols/min [2025-10-21T18:34:54.530135] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:54.553971] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-21T18:34:54.554451] [DEBUG] [LOCAL ] EPAC: Loaded 26516 existing records from primary storage. [2025-10-21T18:34:54.555401] [INFO ] [MAIN ] EPAC: Loaded 26516 existing records. [2025-10-21T18:34:54.659824] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T18:34:54.740696] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:54.740925] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-21T18:34:54.740970] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-21T18:34:54.741398] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-21T18:34:54.741453] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-21T18:34:55.086824] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:34:55.351042] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-21T18:34:56.151057] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-21T18:34:56.573228] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T18:34:56.704181] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T18:34:56.951074] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-21T18:34:57.170634] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T18:34:57.746009] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T18:34:57.750970] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-21T18:34:58.551521] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-21T18:34:58.553953] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:34:58.556372] [INFO ] [REMOTE ] EOT: Full fetch complete (10663 records). [2025-10-21T18:34:58.556450] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-21T18:34:58.980500] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-21T18:34:58.980582] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-21T18:34:58.980858] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-21T18:34:58.980918] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-21T18:34:58.981339] [DEBUG] [LOCAL ] EOT: Trimmed 10663 records to 7050 (keeping 200 days of data) [2025-10-21T18:34:59.023365] [DEBUG] [LOCAL ] EOT: Primary data saved (7050 records). [2025-10-21T18:34:59.023498] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-21T18:34:59.023576] [INFO ] [MAIN ] Update Progress: 745/2366 symbols completed. EOT took 16.5s. Estimated remaining: 3h 26m 31s. Rate: 7.8 symbols/min [2025-10-21T18:34:59.187770] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:34:59.226182] [DEBUG] [LOCAL ] EPAM: Loaded 39399 existing records from primary storage. [2025-10-21T18:34:59.226456] [INFO ] [MAIN ] EPAM: Loaded 39399 existing records. [2025-10-21T18:34:59.352532] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-21T18:34:59.403022] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:34:59.403517] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-21T18:34:59.403621] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-21T18:34:59.403908] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-21T18:34:59.403968] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-21T18:34:59.500547] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T18:34:59.771895] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:00.151065] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-21T18:35:00.405073] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T18:35:00.951091] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-21T18:35:01.751032] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-21T18:35:01.944575] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:35:02.551083] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-21T18:35:03.138626] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T18:35:03.290552] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:35:03.350997] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-21T18:35:03.516578] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T18:35:04.151083] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-21T18:35:04.762597] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:35:04.951049] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-21T18:35:05.512821] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T18:35:05.751016] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-21T18:35:05.986522] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T18:35:06.551059] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-21T18:35:07.351053] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-21T18:35:07.462670] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T18:35:07.629266] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T18:35:08.151025] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-21T18:35:08.670924] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T18:35:08.951051] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-21T18:35:09.016885] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T18:35:09.751053] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-21T18:35:10.488971] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:35:10.551016] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-21T18:35:10.656026] [DEBUG] [REMOTE ] EPAM: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-21T18:35:10.656320] [WARN ] [REMOTE ] EPAM: No data returned for month 2025-05 [2025-10-21T18:35:10.656418] [FATAL] [REMOTE ] EPAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:35:10.656493] [FATAL] [MAIN ] EPAM: Failed to fetch primary data. [2025-10-21T18:35:10.656555] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:35:10.656637] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-21T18:35:10.656751] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-21T18:35:10.656808] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-10-21T18:35:10.656937] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-10-21T18:35:10.657001] [INFO ] [MAIN ] Update Progress: 746/2366 symbols completed. EPAM took 11.6s. Estimated remaining: 3h 26m 32s. Rate: 7.8 symbols/min [2025-10-21T18:35:10.858686] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:10.855931] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T18:35:10.871881] [INFO ] [REMOTE ] EOG: Full fetch complete (77466 records). [2025-10-21T18:35:10.872159] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-21T18:35:11.189239] [DEBUG] [LOCAL ] EPC: Loaded 39805 existing records from primary storage. [2025-10-21T18:35:11.211073] [INFO ] [MAIN ] EPC: Loaded 39805 existing records. [2025-10-21T18:35:11.356089] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-21T18:35:11.433274] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-21T18:35:11.433435] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-21T18:35:11.434539] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-21T18:35:11.434628] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-21T18:35:11.507746] [DEBUG] [LOCAL ] EOG: Trimmed 77466 records to 53390 (keeping 200 days of data) [2025-10-21T18:35:11.534856] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:11.535417] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-21T18:35:11.535475] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-21T18:35:11.535742] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-21T18:35:11.535844] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-21T18:35:12.160000] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:12.160126] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-21T18:35:12.494090] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T18:35:12.519074] [DEBUG] [LOCAL ] EOG: Primary data saved (53390 records). [2025-10-21T18:35:12.519243] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-21T18:35:12.520158] [INFO ] [MAIN ] Update Progress: 747/2366 symbols completed. EOG took 47.1s. Estimated remaining: 3h 26m 12s. Rate: 7.9 symbols/min [2025-10-21T18:35:12.715197] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:12.769201] [DEBUG] [LOCAL ] EPD: Loaded 53612 existing records from primary storage. [2025-10-21T18:35:12.769523] [INFO ] [MAIN ] EPD: Loaded 53612 existing records. [2025-10-21T18:35:12.956212] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-21T18:35:12.993994] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:12.994776] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-21T18:35:12.994886] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-21T18:35:12.995278] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-21T18:35:12.995352] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-21T18:35:13.349014] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:35:13.381797] [INFO ] [REMOTE ] EOS: Full fetch complete (22888 records). [2025-10-21T18:35:13.396141] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:13.396347] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-21T18:35:13.756142] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-21T18:35:13.766364] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-21T18:35:13.766415] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-21T18:35:13.766926] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-21T18:35:13.766987] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-21T18:35:13.767589] [DEBUG] [LOCAL ] EOS: Trimmed 22888 records to 14817 (keeping 200 days of data) [2025-10-21T18:35:13.858015] [DEBUG] [LOCAL ] EOS: Primary data saved (14817 records). [2025-10-21T18:35:13.858122] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-21T18:35:13.858199] [INFO ] [MAIN ] Update Progress: 748/2366 symbols completed. EOS took 41.9s. Estimated remaining: 3h 25m 51s. Rate: 7.9 symbols/min [2025-10-21T18:35:14.025964] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:14.064377] [DEBUG] [LOCAL ] EPR: Loaded 43859 existing records from primary storage. [2025-10-21T18:35:14.064834] [INFO ] [MAIN ] EPR: Loaded 43859 existing records. [2025-10-21T18:35:14.261570] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:14.256427] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:35:14.266912] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-21T18:35:14.266980] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-21T18:35:14.267538] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-21T18:35:14.267591] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-21T18:35:14.556150] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-21T18:35:14.624713] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:15.351045] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-21T18:35:16.151089] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-21T18:35:16.189803] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-21T18:35:16.517717] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T18:35:16.789942] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T18:35:16.951002] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-21T18:35:17.751020] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-21T18:35:18.156372] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-21T18:35:18.551070] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-21T18:35:18.784138] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T18:35:18.865568] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T18:35:19.351077] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-21T18:35:19.902211] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T18:35:20.151061] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-21T18:35:20.951024] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-21T18:35:21.359554] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T18:35:21.751058] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-21T18:35:21.787694] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:35:22.070234] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T18:35:22.551022] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-21T18:35:23.350996] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-21T18:35:23.755707] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T18:35:24.151010] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-21T18:35:24.179349] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T18:35:24.648411] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T18:35:24.951021] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-21T18:35:25.590103] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T18:35:25.751013] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-21T18:35:26.551046] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-21T18:35:26.705827] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:35:27.351004] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-21T18:35:27.444963] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T18:35:28.150988] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-21T18:35:28.491748] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T18:35:28.605401] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T18:35:28.609750] [INFO ] [REMOTE ] EPAC: Full fetch complete (38884 records). [2025-10-21T18:35:28.609841] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-21T18:35:28.957152] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-21T18:35:29.006606] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-21T18:35:29.006698] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-21T18:35:29.007288] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-21T18:35:29.007327] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-21T18:35:29.008142] [DEBUG] [LOCAL ] EPAC: Trimmed 38884 records to 26483 (keeping 200 days of data) [2025-10-21T18:35:29.161406] [DEBUG] [LOCAL ] EPAC: Primary data saved (26483 records). [2025-10-21T18:35:29.161535] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-21T18:35:29.161614] [INFO ] [MAIN ] Update Progress: 749/2366 symbols completed. EPAC took 34.8s. Estimated remaining: 3h 25m 60s. Rate: 7.8 symbols/min [2025-10-21T18:35:29.362256] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:29.407243] [DEBUG] [LOCAL ] EPRT: Loaded 48488 existing records from primary storage. [2025-10-21T18:35:29.407541] [INFO ] [MAIN ] EPRT: Loaded 48488 existing records. [2025-10-21T18:35:29.599058] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:29.599254] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-21T18:35:29.599300] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-21T18:35:29.599478] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-21T18:35:29.599515] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-21T18:35:29.752146] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-21T18:35:29.947373] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:30.128886] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T18:35:30.415183] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T18:35:30.550991] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-21T18:35:31.351003] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-21T18:35:31.751681] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T18:35:32.070636] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:35:32.151000] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-21T18:35:32.951026] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-21T18:35:33.274604] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T18:35:33.752181] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-21T18:35:33.754352] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:35:34.512130] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:35:34.550975] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-21T18:35:35.264180] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:35:35.350989] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-21T18:35:35.777262] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T18:35:36.151018] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-21T18:35:36.951031] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-21T18:35:37.004478] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T18:35:37.751020] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-21T18:35:38.243296] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T18:35:38.551083] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-21T18:35:38.611598] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:35:39.351006] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-21T18:35:39.562696] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T18:35:39.568860] [INFO ] [REMOTE ] EPC: Full fetch complete (57313 records). [2025-10-21T18:35:39.569008] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-21T18:35:39.982495] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-21T18:35:39.982575] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-21T18:35:39.983335] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-21T18:35:39.983396] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-21T18:35:39.984563] [DEBUG] [LOCAL ] EPC: Trimmed 57313 records to 39777 (keeping 200 days of data) [2025-10-21T18:35:40.157311] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-21T18:35:40.230012] [DEBUG] [LOCAL ] EPC: Primary data saved (39777 records). [2025-10-21T18:35:40.230157] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-21T18:35:40.230233] [INFO ] [MAIN ] Update Progress: 750/2366 symbols completed. EPC took 29.6s. Estimated remaining: 3h 25m 60s. Rate: 7.8 symbols/min [2025-10-21T18:35:40.401316] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:40.412358] [DEBUG] [LOCAL ] EQBK: Loaded 11425 existing records from primary storage. [2025-10-21T18:35:40.412574] [INFO ] [MAIN ] EQBK: Loaded 11425 existing records. [2025-10-21T18:35:40.596118] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:40.596450] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-21T18:35:40.596508] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-21T18:35:40.622378] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-10-21T18:35:40.625493] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-21T18:35:40.672057] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-21T18:35:40.955093] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-21T18:35:41.025213] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:41.070516] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T18:35:41.751056] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-21T18:35:41.822984] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T18:35:42.551069] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-21T18:35:43.130512] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T18:35:43.239572] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T18:35:43.285958] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T18:35:43.350984] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-21T18:35:44.123353] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:35:44.150991] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-21T18:35:44.951036] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-21T18:35:45.730428] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T18:35:45.737049] [INFO ] [REMOTE ] EPR: Full fetch complete (63280 records). [2025-10-21T18:35:45.737146] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-21T18:35:45.758476] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-21T18:35:46.126035] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-21T18:35:46.126111] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-21T18:35:46.126867] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-21T18:35:46.126927] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-21T18:35:46.129102] [DEBUG] [LOCAL ] EPR: Trimmed 63280 records to 43777 (keeping 200 days of data) [2025-10-21T18:35:46.386782] [DEBUG] [LOCAL ] EPR: Primary data saved (43777 records). [2025-10-21T18:35:46.386933] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-21T18:35:46.387010] [INFO ] [MAIN ] Update Progress: 751/2366 symbols completed. EPR took 32.5s. Estimated remaining: 3h 25m 49s. Rate: 7.8 symbols/min [2025-10-21T18:35:46.554093] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-21T18:35:46.555697] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:46.556752] [DEBUG] [LOCAL ] EQH: No existing data file found in primary storage. [2025-10-21T18:35:46.556803] [WARN ] [MAIN ] EQH: No existing data found, performing full refresh instead. [2025-10-21T18:35:46.556950] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-21T18:35:46.557023] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-21T18:35:46.557079] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-21T18:35:46.557112] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-21T18:35:46.914913] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:46.941078] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T18:35:47.350999] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-21T18:35:47.387243] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T18:35:47.575959] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T18:35:47.584271] [INFO ] [REMOTE ] EPD: Full fetch complete (77777 records). [2025-10-21T18:35:47.584399] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-21T18:35:47.990115] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-21T18:35:47.990202] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-21T18:35:47.991151] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-21T18:35:47.991218] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-21T18:35:47.992677] [DEBUG] [LOCAL ] EPD: Trimmed 77777 records to 53609 (keeping 200 days of data) [2025-10-21T18:35:48.164316] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-21T18:35:48.313821] [DEBUG] [LOCAL ] EPD: Primary data saved (53609 records). [2025-10-21T18:35:48.313952] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-21T18:35:48.314688] [INFO ] [MAIN ] Update Progress: 752/2366 symbols completed. EPD took 35.8s. Estimated remaining: 3h 25m 29s. Rate: 7.9 symbols/min [2025-10-21T18:35:48.478098] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:35:48.529252] [DEBUG] [LOCAL ] EQNR: Loaded 53058 existing records from primary storage. [2025-10-21T18:35:48.529599] [INFO ] [MAIN ] EQNR: Loaded 53058 existing records. [2025-10-21T18:35:48.701175] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:35:48.701379] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-21T18:35:48.701426] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-21T18:35:48.701637] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-21T18:35:48.701729] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-21T18:35:48.964530] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-21T18:35:49.075911] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:35:49.178344] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T18:35:49.305427] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T18:35:49.751023] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-21T18:35:50.449068] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:35:50.551043] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-21T18:35:51.293672] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T18:35:51.350991] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-21T18:35:51.549928] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:35:52.151027] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-21T18:35:52.951590] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-21T18:35:52.961831] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T18:35:52.960107] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T18:35:53.751055] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-21T18:35:54.551009] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-21T18:35:54.909096] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T18:35:54.952720] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T18:35:55.351023] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-21T18:35:56.143061] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T18:35:56.152551] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-21T18:35:56.858128] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:35:56.950986] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-21T18:35:57.112526] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T18:35:57.751023] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-21T18:35:58.551092] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-21T18:35:58.637607] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T18:35:59.304028] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T18:35:59.350984] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-21T18:35:59.595875] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:36:00.150994] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-21T18:36:00.296492] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T18:36:00.299416] [INFO ] [REMOTE ] EQBK: Full fetch complete (15738 records). [2025-10-21T18:36:00.299489] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-21T18:36:00.687243] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-10-21T18:36:00.687319] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-10-21T18:36:00.687673] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-10-21T18:36:00.687738] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-10-21T18:36:00.688264] [DEBUG] [LOCAL ] EQBK: Trimmed 15738 records to 11388 (keeping 200 days of data) [2025-10-21T18:36:00.756735] [DEBUG] [LOCAL ] EQBK: Primary data saved (11388 records). [2025-10-21T18:36:00.756869] [INFO ] [MAIN ] EQBK: Full history saved. [2025-10-21T18:36:00.756947] [INFO ] [MAIN ] Update Progress: 753/2366 symbols completed. EQBK took 20.5s. Estimated remaining: 3h 25m 31s. Rate: 7.8 symbols/min [2025-10-21T18:36:00.922819] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:00.951037] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-21T18:36:00.969830] [DEBUG] [LOCAL ] EQR: Loaded 51795 existing records from primary storage. [2025-10-21T18:36:00.970140] [INFO ] [MAIN ] EQR: Loaded 51795 existing records. [2025-10-21T18:36:01.149011] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:01.149219] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-21T18:36:01.149272] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-21T18:36:01.149704] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-21T18:36:01.149760] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-21T18:36:01.533608] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:01.751057] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-21T18:36:02.200621] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T18:36:02.551011] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-21T18:36:03.010054] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T18:36:03.351057] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-21T18:36:03.651448] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T18:36:04.151079] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-21T18:36:04.193002] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:36:04.958441] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-21T18:36:04.967541] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T18:36:05.751058] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-21T18:36:05.825715] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:36:06.551109] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-21T18:36:06.905508] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T18:36:07.351005] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-21T18:36:07.391160] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T18:36:08.150995] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-21T18:36:08.550139] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T18:36:08.558103] [INFO ] [REMOTE ] EPRT: Full fetch complete (69483 records). [2025-10-21T18:36:08.558316] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-21T18:36:08.956565] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-21T18:36:08.956848] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-21T18:36:08.956944] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-21T18:36:08.958813] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-21T18:36:08.959000] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-21T18:36:08.960437] [DEBUG] [LOCAL ] EPRT: Trimmed 69483 records to 48476 (keeping 200 days of data) [2025-10-21T18:36:09.282957] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T18:36:09.300520] [DEBUG] [LOCAL ] EPRT: Primary data saved (48476 records). [2025-10-21T18:36:09.301047] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-21T18:36:09.301534] [INFO ] [MAIN ] Update Progress: 754/2366 symbols completed. EPRT took 40.1s. Estimated remaining: 3h 25m 26s. Rate: 7.8 symbols/min [2025-10-21T18:36:09.490473] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:09.490723] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-21T18:36:09.490779] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-21T18:36:09.490887] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-21T18:36:09.490930] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-21T18:36:09.490972] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-21T18:36:09.491004] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-21T18:36:09.754524] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-21T18:36:09.859732] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:09.888749] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T18:36:10.558091] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-21T18:36:10.576806] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:36:11.275059] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T18:36:11.278991] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T18:36:11.351026] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-21T18:36:12.151086] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-21T18:36:12.951027] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-21T18:36:13.530329] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T18:36:13.629198] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T18:36:13.751030] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-21T18:36:14.095511] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-21T18:36:14.478248] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T18:36:14.551063] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-21T18:36:15.351025] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-21T18:36:16.151027] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-21T18:36:16.244693] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T18:36:16.514070] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:36:16.747745] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:36:16.951069] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-21T18:36:17.313603] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T18:36:17.751017] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-21T18:36:18.551061] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-21T18:36:18.934249] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T18:36:19.351023] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-21T18:36:19.450570] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T18:36:19.459038] [INFO ] [REMOTE ] EQH: Full fetch complete (76646 records). [2025-10-21T18:36:19.459197] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-21T18:36:19.786670] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T18:36:19.878704] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-21T18:36:19.878807] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-21T18:36:19.879815] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-21T18:36:19.879883] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-21T18:36:19.881733] [DEBUG] [LOCAL ] EQH: Trimmed 76646 records to 52705 (keeping 200 days of data) [2025-10-21T18:36:20.151796] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-21T18:36:20.197849] [DEBUG] [LOCAL ] EQH: Primary data saved (52705 records). [2025-10-21T18:36:20.198048] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-21T18:36:20.198154] [INFO ] [MAIN ] Update Progress: 755/2366 symbols completed. EQH took 33.8s. Estimated remaining: 3h 25m 25s. Rate: 7.8 symbols/min [2025-10-21T18:36:20.379791] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:20.434835] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-21T18:36:20.435324] [INFO ] [MAIN ] EQT: Loaded 53685 existing records. [2025-10-21T18:36:20.620247] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:20.620549] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-21T18:36:20.620595] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-21T18:36:20.621393] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-21T18:36:20.621454] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-21T18:36:20.953671] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-21T18:36:20.973726] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:21.751014] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-21T18:36:21.925930] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:36:22.551052] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-21T18:36:22.800588] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T18:36:23.351048] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-21T18:36:23.677126] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T18:36:24.061456] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:36:24.150986] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-21T18:36:24.951063] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-21T18:36:25.391718] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T18:36:25.399794] [INFO ] [REMOTE ] EQNR: Full fetch complete (77011 records). [2025-10-21T18:36:25.399917] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-21T18:36:25.502925] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-21T18:36:25.758234] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-21T18:36:25.797509] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-21T18:36:25.797603] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-21T18:36:25.798547] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-21T18:36:25.798712] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-21T18:36:25.800564] [DEBUG] [LOCAL ] EQNR: Trimmed 77011 records to 53055 (keeping 200 days of data) [2025-10-21T18:36:26.038951] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:36:26.161964] [DEBUG] [LOCAL ] EQNR: Primary data saved (53055 records). [2025-10-21T18:36:26.162099] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-21T18:36:26.162701] [INFO ] [MAIN ] Update Progress: 756/2366 symbols completed. EQNR took 37.8s. Estimated remaining: 3h 25m 14s. Rate: 7.8 symbols/min [2025-10-21T18:36:26.333962] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:26.340425] [DEBUG] [LOCAL ] EQV: Loaded 2745 existing records from primary storage. [2025-10-21T18:36:26.340636] [INFO ] [MAIN ] EQV: Loaded 2745 existing records. [2025-10-21T18:36:26.498744] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T18:36:26.537757] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:26.538045] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-21T18:36:26.538095] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-21T18:36:26.538264] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-21T18:36:26.538320] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-21T18:36:26.558588] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-21T18:36:26.889246] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:27.351026] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-21T18:36:28.151014] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-21T18:36:28.502146] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T18:36:28.951027] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-21T18:36:29.224691] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T18:36:29.254974] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:36:29.565532] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T18:36:29.751026] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-21T18:36:30.551054] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-21T18:36:31.351087] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-21T18:36:31.597841] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:36:31.919456] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T18:36:31.920328] [INFO ] [REMOTE ] EQS: Full fetch complete (2373 records). [2025-10-21T18:36:31.920402] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-21T18:36:31.920784] [FATAL] [VALIDATOR ] EQS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:36:31.920923] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:36:31.920992] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:36:31.921062] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-21T18:36:31.921140] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-21T18:36:31.921194] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-21T18:36:31.921238] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-21T18:36:31.921289] [INFO ] [MAIN ] Update Progress: 757/2366 symbols completed. EQS took 22.6s. Estimated remaining: 3h 25m 2s. Rate: 7.8 symbols/min [2025-10-21T18:36:32.151018] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-21T18:36:32.449971] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T18:36:32.458580] [INFO ] [REMOTE ] EQR: Full fetch complete (74575 records). [2025-10-21T18:36:32.458806] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-21T18:36:32.767075] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T18:36:32.865131] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-21T18:36:32.865236] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-21T18:36:32.866160] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-21T18:36:32.866221] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-21T18:36:32.867588] [DEBUG] [LOCAL ] EQR: Trimmed 74575 records to 51808 (keeping 200 days of data) [2025-10-21T18:36:32.955895] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-21T18:36:33.185218] [DEBUG] [LOCAL ] EQR: Primary data saved (51808 records). [2025-10-21T18:36:33.185351] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-21T18:36:33.185429] [INFO ] [MAIN ] Update Progress: 758/2366 symbols completed. EQR took 32.4s. Estimated remaining: 3h 24m 41s. Rate: 7.9 symbols/min [2025-10-21T18:36:33.525579] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:36:33.751019] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-21T18:36:34.551038] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-21T18:36:34.661865] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T18:36:35.351022] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-21T18:36:36.134495] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:36:36.151018] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-21T18:36:36.362344] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T18:36:36.779783] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T18:36:36.951013] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-21T18:36:37.751016] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-21T18:36:38.201841] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T18:36:38.551001] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-21T18:36:38.771800] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:36:39.260592] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:36:39.351051] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-21T18:36:40.151132] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-21T18:36:40.581803] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T18:36:40.951053] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-21T18:36:41.323638] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-21T18:36:41.530071] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T18:36:41.531065] [INFO ] [REMOTE ] EQV: Full fetch complete (4965 records). [2025-10-21T18:36:41.531134] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-21T18:36:41.764437] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-21T18:36:41.890561] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-21T18:36:41.890633] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-21T18:36:41.890822] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-21T18:36:41.890867] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-21T18:36:41.891218] [DEBUG] [LOCAL ] EQV: Trimmed 4965 records to 2740 (keeping 200 days of data) [2025-10-21T18:36:41.907466] [DEBUG] [LOCAL ] EQV: Primary data saved (2740 records). [2025-10-21T18:36:41.907527] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-21T18:36:41.907591] [INFO ] [MAIN ] Update Progress: 759/2366 symbols completed. EQV took 15.7s. Estimated remaining: 3h 24m 36s. Rate: 7.9 symbols/min [2025-10-21T18:36:44.301005] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-21T18:36:44.312487] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-21T18:36:46.291123] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T18:36:46.302441] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-21T18:36:48.349935] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T18:36:48.361441] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-21T18:36:49.046970] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T18:36:49.055418] [INFO ] [REMOTE ] EQT: Full fetch complete (77860 records). [2025-10-21T18:36:49.055580] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-21T18:36:49.453191] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-21T18:36:49.453287] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-21T18:36:49.454224] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-21T18:36:49.454301] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-21T18:36:49.455776] [DEBUG] [LOCAL ] EQT: Trimmed 77860 records to 53685 (keeping 200 days of data) [2025-10-21T18:36:49.777548] [DEBUG] [LOCAL ] EQT: Primary data saved (53685 records). [2025-10-21T18:36:49.777707] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-21T18:36:49.778569] [INFO ] [MAIN ] Update Progress: 760/2366 symbols completed. EQT took 29.6s. Estimated remaining: 3h 24m 28s. Rate: 7.9 symbols/min [2025-10-21T18:36:50.403294] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:50.455494] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:50.525969] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:50.524250] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:36:50.597319] [DEBUG] [LOCAL ] ESAB: Loaded 26063 existing records from primary storage. [2025-10-21T18:36:50.597752] [INFO ] [MAIN ] ESAB: Loaded 26063 existing records. [2025-10-21T18:36:50.750347] [DEBUG] [LOCAL ] ERO: Loaded 42144 existing records from primary storage. [2025-10-21T18:36:50.753431] [INFO ] [MAIN ] ERO: Loaded 42144 existing records. [2025-10-21T18:36:50.751362] [DEBUG] [LOCAL ] ES: Loaded 52707 existing records from primary storage. [2025-10-21T18:36:50.753243] [DEBUG] [LOCAL ] ERJ: Loaded 50301 existing records from primary storage. [2025-10-21T18:36:50.800761] [INFO ] [MAIN ] ES: Loaded 52707 existing records. [2025-10-21T18:36:50.883581] [INFO ] [MAIN ] ERJ: Loaded 50301 existing records. [2025-10-21T18:36:50.996252] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:51.036081] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-21T18:36:51.066766] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-21T18:36:51.133161] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-21T18:36:51.158618] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-21T18:36:51.386948] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:51.427802] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-21T18:36:51.459881] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-21T18:36:51.492569] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-21T18:36:51.496890] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:51.544474] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-21T18:36:51.532602] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:36:51.544744] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-21T18:36:51.562243] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-21T18:36:51.608149] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-21T18:36:51.582196] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-21T18:36:51.618592] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-21T18:36:51.726324] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-21T18:36:51.910721] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-21T18:36:51.941895] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-21T18:36:52.591120] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:52.657734] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-21T18:36:52.907346] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:52.925161] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-21T18:36:52.982347] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:52.982771] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-21T18:36:53.070745] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:36:53.071072] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-21T18:36:53.998268] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T18:36:54.002481] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-21T18:36:54.579339] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:36:54.590572] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-21T18:36:54.671618] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:36:54.679363] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-21T18:36:55.032781] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T18:36:55.037286] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-21T18:36:55.069681] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T18:36:55.079262] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-21T18:36:56.090984] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T18:36:56.099398] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-21T18:36:56.133673] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:36:56.143576] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-21T18:36:56.209397] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T18:36:56.215449] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-21T18:36:56.758151] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T18:36:56.767460] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-21T18:36:57.529467] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T18:36:57.536387] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-21T18:36:57.625384] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:36:57.635173] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-21T18:36:58.072288] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T18:36:58.089920] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-21T18:36:58.646223] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T18:36:58.658216] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-21T18:36:58.684113] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T18:36:58.690338] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-21T18:36:58.764680] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T18:36:59.351033] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-21T18:36:59.560508] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T18:37:00.004595] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T18:37:00.151028] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-21T18:37:00.484687] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T18:37:00.728930] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T18:37:00.951070] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-21T18:37:01.412521] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T18:37:01.751087] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-21T18:37:02.551001] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-21T18:37:02.981438] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-21T18:37:03.228439] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:37:03.351061] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-21T18:37:04.151076] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-21T18:37:04.391310] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T18:37:04.951010] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-21T18:37:05.173325] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T18:37:05.658575] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:37:05.751079] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-21T18:37:06.551034] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-21T18:37:06.769294] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T18:37:07.004857] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T18:37:07.351022] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-21T18:37:07.975478] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T18:37:08.151016] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-21T18:37:08.951020] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-21T18:37:09.114173] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T18:37:09.382329] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T18:37:09.751030] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-21T18:37:10.432085] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T18:37:10.551027] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-21T18:37:10.685360] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T18:37:10.689914] [INFO ] [REMOTE ] ESAB: Full fetch complete (36407 records). [2025-10-21T18:37:10.690021] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-21T18:37:11.062574] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-21T18:37:11.062669] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-21T18:37:11.063256] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-21T18:37:11.063296] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-21T18:37:11.064105] [DEBUG] [LOCAL ] ESAB: Trimmed 36407 records to 25989 (keeping 200 days of data) [2025-10-21T18:37:11.225460] [DEBUG] [LOCAL ] ESAB: Primary data saved (25989 records). [2025-10-21T18:37:11.225593] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-21T18:37:11.225701] [INFO ] [MAIN ] Update Progress: 761/2366 symbols completed. ESAB took 21.4s. Estimated remaining: 3h 24m 50s. Rate: 7.8 symbols/min [2025-10-21T18:37:11.362735] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-21T18:37:11.394887] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:11.411827] [DEBUG] [LOCAL ] ESE: Loaded 16467 existing records from primary storage. [2025-10-21T18:37:11.412056] [INFO ] [MAIN ] ESE: Loaded 16467 existing records. [2025-10-21T18:37:11.585096] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:11.585322] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-21T18:37:11.585381] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-21T18:37:11.585582] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-21T18:37:11.585621] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-21T18:37:11.953755] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:12.150996] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-21T18:37:12.951050] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-21T18:37:14.680983] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T18:37:14.690632] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-21T18:37:15.229549] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (4.68 seconds). [2025-10-21T18:37:15.240592] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-21T18:37:16.862011] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-21T18:37:16.869575] [INFO ] [REMOTE ] ERO: Full fetch complete (60581 records). [2025-10-21T18:37:16.869734] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-21T18:37:17.278250] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (5.92 seconds). [2025-10-21T18:37:17.306831] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-21T18:37:17.307420] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-21T18:37:17.308523] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-21T18:37:17.308958] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-21T18:37:17.308634] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-21T18:37:17.310872] [DEBUG] [LOCAL ] ERO: Trimmed 60581 records to 42158 (keeping 200 days of data) [2025-10-21T18:37:17.433013] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (5.28 seconds). [2025-10-21T18:37:17.498552] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-21T18:37:17.562775] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-21T18:37:17.578971] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-21T18:37:17.616310] [DEBUG] [LOCAL ] ERO: Primary data saved (42158 records). [2025-10-21T18:37:17.616436] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-21T18:37:17.616515] [INFO ] [MAIN ] Update Progress: 762/2366 symbols completed. ERO took 27.8s. Estimated remaining: 3h 24m 40s. Rate: 7.8 symbols/min [2025-10-21T18:37:17.797172] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:17.846076] [DEBUG] [LOCAL ] ESI: Loaded 50643 existing records from primary storage. [2025-10-21T18:37:17.846438] [INFO ] [MAIN ] ESI: Loaded 50643 existing records. [2025-10-21T18:37:18.030187] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:18.030419] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-21T18:37:18.030469] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-21T18:37:18.030708] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-21T18:37:18.030764] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-21T18:37:18.403851] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:18.404201] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-21T18:37:18.425440] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T18:37:18.433720] [INFO ] [REMOTE ] ES: Full fetch complete (76091 records). [2025-10-21T18:37:18.433841] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-21T18:37:18.434614] [FATAL] [VALIDATOR ] ES: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:37:18.434787] [FATAL] [MAIN ] ES: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:37:18.434862] [WARN ] [MAIN ] ES: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:37:18.434978] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-21T18:37:18.435040] [DEBUG] [LOCAL ] ES: No primary data file found to delete. [2025-10-21T18:37:18.435074] [INFO ] [LOCAL ] ES: Starting deletion of derivative data. [2025-10-21T18:37:18.435221] [DEBUG] [LOCAL ] ES: Deleted derivative data file. [2025-10-21T18:37:18.435310] [INFO ] [MAIN ] Update Progress: 763/2366 symbols completed. ES took 28.6s. Estimated remaining: 3h 24m 18s. Rate: 7.8 symbols/min [2025-10-21T18:37:18.629909] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:18.627671] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T18:37:18.633679] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-21T18:37:18.667835] [DEBUG] [LOCAL ] ESNT: Loaded 38177 existing records from primary storage. [2025-10-21T18:37:18.668127] [INFO ] [MAIN ] ESNT: Loaded 38177 existing records. [2025-10-21T18:37:18.847261] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:18.847467] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-21T18:37:18.847525] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-21T18:37:18.847724] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-21T18:37:18.847781] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-21T18:37:19.206840] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:19.236144] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T18:37:19.350997] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-21T18:37:19.878744] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T18:37:20.151044] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-21T18:37:20.355308] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T18:37:20.951036] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-21T18:37:21.024468] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T18:37:21.032195] [INFO ] [REMOTE ] ERJ: Full fetch complete (72998 records). [2025-10-21T18:37:21.032329] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-21T18:37:21.315745] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T18:37:21.455169] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-21T18:37:21.455259] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-21T18:37:21.456131] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-21T18:37:21.456195] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-21T18:37:21.457613] [DEBUG] [LOCAL ] ERJ: Trimmed 72998 records to 50293 (keeping 200 days of data) [2025-10-21T18:37:21.749776] [DEBUG] [LOCAL ] ERJ: Primary data saved (50293 records). [2025-10-21T18:37:21.749946] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-21T18:37:21.750415] [INFO ] [MAIN ] Update Progress: 764/2366 symbols completed. ERJ took 32.0s. Estimated remaining: 3h 24m 1s. Rate: 7.9 symbols/min [2025-10-21T18:37:21.761875] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-21T18:37:21.927550] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:21.969914] [DEBUG] [LOCAL ] ESRT: Loaded 46564 existing records from primary storage. [2025-10-21T18:37:21.970221] [INFO ] [MAIN ] ESRT: Loaded 46564 existing records. [2025-10-21T18:37:22.176018] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:22.176231] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-21T18:37:22.176277] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-21T18:37:22.176453] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-21T18:37:22.176503] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-21T18:37:22.562225] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:22.556364] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-21T18:37:22.589169] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:37:22.818550] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T18:37:23.351024] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-21T18:37:24.148676] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:37:24.156623] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-21T18:37:24.709825] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T18:37:24.951025] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-21T18:37:25.751023] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-21T18:37:26.399305] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-21T18:37:26.551073] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-21T18:37:26.634535] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T18:37:26.867483] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T18:37:27.351080] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-21T18:37:27.969820] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:37:28.151038] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-21T18:37:28.951071] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-21T18:37:28.994712] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:37:29.689573] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T18:37:29.751032] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-21T18:37:30.005162] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:37:30.551077] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-21T18:37:31.315482] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:37:31.351018] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-21T18:37:32.151001] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-21T18:37:32.248213] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:37:32.803973] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T18:37:32.950999] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-21T18:37:33.756269] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-21T18:37:33.762003] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T18:37:33.784370] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T18:37:34.551021] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-21T18:37:35.351052] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-21T18:37:35.655333] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:37:36.106591] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:37:36.150980] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-21T18:37:36.232025] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T18:37:36.951017] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-21T18:37:37.700168] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:37:37.751000] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-21T18:37:38.550995] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-21T18:37:38.757445] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:37:39.107712] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:37:39.350998] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-21T18:37:39.765237] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T18:37:39.768015] [INFO ] [REMOTE ] ESE: Full fetch complete (22897 records). [2025-10-21T18:37:39.768090] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-21T18:37:40.121751] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-21T18:37:40.121820] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-21T18:37:40.122292] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-21T18:37:40.122329] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-21T18:37:40.122943] [DEBUG] [LOCAL ] ESE: Trimmed 22897 records to 16514 (keeping 200 days of data) [2025-10-21T18:37:40.166532] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-21T18:37:40.226631] [DEBUG] [LOCAL ] ESE: Primary data saved (16514 records). [2025-10-21T18:37:40.226775] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-21T18:37:40.226852] [INFO ] [MAIN ] Update Progress: 765/2366 symbols completed. ESE took 29.0s. Estimated remaining: 3h 24m 16s. Rate: 7.8 symbols/min [2025-10-21T18:37:40.389984] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:40.390202] [DEBUG] [LOCAL ] ESS: No existing data file found in primary storage. [2025-10-21T18:37:40.390243] [WARN ] [MAIN ] ESS: No existing data found, performing full refresh instead. [2025-10-21T18:37:40.390350] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-21T18:37:40.390391] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-21T18:37:40.390430] [DEBUG] [LOCAL ] ESS: No primary data file found to delete. [2025-10-21T18:37:40.390461] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-21T18:37:40.737411] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:40.951074] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-21T18:37:41.139740] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:37:41.627631] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:37:41.751015] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-21T18:37:42.551001] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-21T18:37:42.667256] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:37:43.351038] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-21T18:37:43.619006] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T18:37:44.044166] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T18:37:44.050219] [INFO ] [REMOTE ] ESNT: Full fetch complete (57179 records). [2025-10-21T18:37:44.050320] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-21T18:37:44.152258] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-21T18:37:44.437484] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-21T18:37:44.437563] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-21T18:37:44.438405] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-21T18:37:44.438470] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-21T18:37:44.439699] [DEBUG] [LOCAL ] ESNT: Trimmed 57179 records to 38064 (keeping 200 days of data) [2025-10-21T18:37:44.664730] [DEBUG] [LOCAL ] ESNT: Primary data saved (38064 records). [2025-10-21T18:37:44.664869] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-21T18:37:44.665437] [INFO ] [MAIN ] Update Progress: 766/2366 symbols completed. ESNT took 26.2s. Estimated remaining: 3h 24m 1s. Rate: 7.8 symbols/min [2025-10-21T18:37:44.837497] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:44.883992] [DEBUG] [LOCAL ] ESTC: Loaded 50306 existing records from primary storage. [2025-10-21T18:37:44.884322] [INFO ] [MAIN ] ESTC: Loaded 50306 existing records. [2025-10-21T18:37:44.956092] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-21T18:37:45.072507] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:45.072822] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-21T18:37:45.072967] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-21T18:37:45.073336] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-21T18:37:45.073453] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-21T18:37:45.263756] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T18:37:45.468699] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:45.751007] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-21T18:37:45.991009] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T18:37:46.003373] [INFO ] [REMOTE ] ESI: Full fetch complete (73220 records). [2025-10-21T18:37:46.003612] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-21T18:37:46.442992] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-21T18:37:46.443131] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-21T18:37:46.444347] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-21T18:37:46.444424] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-21T18:37:46.446043] [DEBUG] [LOCAL ] ESI: Trimmed 73220 records to 50624 (keeping 200 days of data) [2025-10-21T18:37:46.558341] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-21T18:37:46.754595] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:37:46.803404] [DEBUG] [LOCAL ] ESI: Primary data saved (50624 records). [2025-10-21T18:37:46.803593] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-21T18:37:46.803730] [INFO ] [MAIN ] Update Progress: 767/2366 symbols completed. ESI took 29.2s. Estimated remaining: 3h 23m 42s. Rate: 7.8 symbols/min [2025-10-21T18:37:46.996497] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:37:47.048489] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-21T18:37:47.048979] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-21T18:37:47.228904] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:37:47.229111] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-21T18:37:47.229157] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-21T18:37:47.229345] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-21T18:37:47.229383] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-21T18:37:47.356164] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-21T18:37:47.593108] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:37:47.758028] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-21T18:37:48.151012] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-21T18:37:48.449949] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T18:37:48.608340] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T18:37:48.951021] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-21T18:37:49.751052] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-21T18:37:50.395639] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T18:37:50.556209] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-21T18:37:50.578230] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-21T18:37:51.219136] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T18:37:51.351058] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-21T18:37:51.966205] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:37:52.151048] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-21T18:37:52.507935] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T18:37:52.951045] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-21T18:37:53.751135] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-21T18:37:54.068573] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T18:37:54.350038] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T18:37:54.551036] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-21T18:37:55.351039] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-21T18:37:55.609408] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T18:37:56.065093] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T18:37:56.150983] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-21T18:37:56.951019] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-21T18:37:57.533390] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-21T18:37:57.758106] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-21T18:37:57.763138] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T18:37:58.551013] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-21T18:37:58.788951] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:37:59.351021] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-21T18:38:00.049862] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T18:38:00.141145] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T18:38:00.148409] [INFO ] [REMOTE ] ESRT: Full fetch complete (66646 records). [2025-10-21T18:38:00.148569] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-21T18:38:00.160270] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-21T18:38:00.531218] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-21T18:38:00.531298] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-21T18:38:00.532126] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-21T18:38:00.532221] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-21T18:38:00.533482] [DEBUG] [LOCAL ] ESRT: Trimmed 66646 records to 46538 (keeping 200 days of data) [2025-10-21T18:38:00.792909] [DEBUG] [LOCAL ] ESRT: Primary data saved (46538 records). [2025-10-21T18:38:00.793031] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-21T18:38:00.793407] [INFO ] [MAIN ] Update Progress: 768/2366 symbols completed. ESRT took 39.0s. Estimated remaining: 3h 23m 48s. Rate: 7.8 symbols/min [2025-10-21T18:38:00.958253] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-21T18:38:00.960823] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:00.976618] [DEBUG] [LOCAL ] ETB: Loaded 11975 existing records from primary storage. [2025-10-21T18:38:00.976881] [INFO ] [MAIN ] ETB: Loaded 11975 existing records. [2025-10-21T18:38:01.157011] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:01.157395] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-21T18:38:01.157469] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-21T18:38:01.157746] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-21T18:38:01.157819] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-21T18:38:01.414982] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T18:38:01.564824] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:01.584127] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T18:38:01.751066] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-21T18:38:02.551076] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-21T18:38:02.921899] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:38:03.351062] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-21T18:38:03.486122] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-21T18:38:04.057301] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:38:04.151083] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-21T18:38:04.789759] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T18:38:04.953974] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-21T18:38:04.959533] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:38:05.751075] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-21T18:38:06.398695] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T18:38:06.551089] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-21T18:38:07.351068] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-21T18:38:07.561072] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:38:08.151070] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-21T18:38:08.429962] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T18:38:08.508633] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T18:38:08.951183] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-21T18:38:09.751111] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-21T18:38:09.943007] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T18:38:10.043030] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:38:10.551034] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-21T18:38:11.351064] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-21T18:38:11.591093] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T18:38:12.096778] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-21T18:38:12.151057] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-21T18:38:12.951010] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-21T18:38:13.063550] [DEBUG] [REMOTE ] ETB: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-21T18:38:13.063957] [WARN ] [REMOTE ] ETB: No data returned for month 2025-05 [2025-10-21T18:38:13.064195] [FATAL] [REMOTE ] ETB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:38:13.065821] [FATAL] [MAIN ] ETB: Failed to fetch primary data. [2025-10-21T18:38:13.065737] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T18:38:13.065973] [WARN ] [MAIN ] ETB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:38:13.076198] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-21T18:38:13.076390] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-10-21T18:38:13.076447] [INFO ] [LOCAL ] ETB: Starting deletion of derivative data. [2025-10-21T18:38:13.076613] [DEBUG] [LOCAL ] ETB: Deleted derivative data file. [2025-10-21T18:38:13.077024] [INFO ] [MAIN ] Update Progress: 769/2366 symbols completed. ETB took 12.3s. Estimated remaining: 3h 23m 50s. Rate: 7.8 symbols/min [2025-10-21T18:38:13.255636] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:13.282837] [DEBUG] [LOCAL ] ETD: Loaded 27370 existing records from primary storage. [2025-10-21T18:38:13.283103] [INFO ] [MAIN ] ETD: Loaded 27370 existing records. [2025-10-21T18:38:13.458439] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:13.458696] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-21T18:38:13.458763] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-21T18:38:13.458963] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-21T18:38:13.459017] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-21T18:38:13.756127] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-21T18:38:13.810733] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:14.551040] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-21T18:38:14.666697] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-21T18:38:15.128306] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T18:38:15.136438] [INFO ] [REMOTE ] ESTC: Full fetch complete (72130 records). [2025-10-21T18:38:15.136573] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-21T18:38:15.137412] [FATAL] [VALIDATOR ] ESTC: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:38:15.137497] [FATAL] [MAIN ] ESTC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:38:15.137538] [WARN ] [MAIN ] ESTC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:38:15.137577] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-21T18:38:15.137633] [DEBUG] [LOCAL ] ESTC: No primary data file found to delete. [2025-10-21T18:38:15.137709] [INFO ] [LOCAL ] ESTC: Starting deletion of derivative data. [2025-10-21T18:38:15.137860] [DEBUG] [LOCAL ] ESTC: Deleted derivative data file. [2025-10-21T18:38:15.138223] [INFO ] [MAIN ] Update Progress: 770/2366 symbols completed. ESTC took 30.5s. Estimated remaining: 3h 23m 31s. Rate: 7.8 symbols/min [2025-10-21T18:38:15.318115] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:15.337325] [DEBUG] [LOCAL ] ETG: Loaded 16667 existing records from primary storage. [2025-10-21T18:38:15.337562] [INFO ] [MAIN ] ETG: Loaded 16667 existing records. [2025-10-21T18:38:15.359557] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-21T18:38:15.519526] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:15.519793] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-21T18:38:15.519846] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-21T18:38:15.520018] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-21T18:38:15.520073] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-21T18:38:15.874749] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:16.115599] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:38:16.151077] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-21T18:38:16.951012] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-21T18:38:17.500800] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-21T18:38:17.678480] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:38:17.751034] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-21T18:38:17.995180] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T18:38:18.000522] [INFO ] [REMOTE ] ESS: Full fetch complete (43792 records). [2025-10-21T18:38:18.000690] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-21T18:38:18.383765] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-21T18:38:18.383838] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-21T18:38:18.384468] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-21T18:38:18.384506] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-21T18:38:18.385373] [DEBUG] [LOCAL ] ESS: Trimmed 43792 records to 30188 (keeping 200 days of data) [2025-10-21T18:38:18.552628] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-21T18:38:18.571720] [DEBUG] [LOCAL ] ESS: Primary data saved (30188 records). [2025-10-21T18:38:18.571844] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-21T18:38:18.571911] [INFO ] [MAIN ] Update Progress: 771/2366 symbols completed. ESS took 38.3s. Estimated remaining: 3h 23m 14s. Rate: 7.8 symbols/min [2025-10-21T18:38:18.712390] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:38:18.760997] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:18.778223] [DEBUG] [LOCAL ] ETJ: Loaded 16676 existing records from primary storage. [2025-10-21T18:38:18.778451] [INFO ] [MAIN ] ETJ: Loaded 16676 existing records. [2025-10-21T18:38:18.953607] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:18.953829] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-21T18:38:18.953877] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-21T18:38:18.954030] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-21T18:38:18.954069] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-21T18:38:19.307132] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:19.351017] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-21T18:38:19.442540] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T18:38:20.151034] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-21T18:38:20.277565] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T18:38:20.951025] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-21T18:38:21.277080] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T18:38:21.751027] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-21T18:38:21.777176] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T18:38:22.551086] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-21T18:38:23.084211] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T18:38:23.351047] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-21T18:38:24.151008] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-21T18:38:24.358099] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:38:24.601520] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T18:38:24.609423] [INFO ] [REMOTE ] ET: Full fetch complete (77579 records). [2025-10-21T18:38:24.609571] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-21T18:38:24.610396] [FATAL] [VALIDATOR ] ET: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:38:24.610517] [FATAL] [MAIN ] ET: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:38:24.610558] [WARN ] [MAIN ] ET: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:38:24.610595] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-21T18:38:24.610684] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-10-21T18:38:24.610738] [INFO ] [LOCAL ] ET: Starting deletion of derivative data. [2025-10-21T18:38:24.610904] [DEBUG] [LOCAL ] ET: Deleted derivative data file. [2025-10-21T18:38:24.610992] [INFO ] [MAIN ] Update Progress: 772/2366 symbols completed. ET took 37.8s. Estimated remaining: 3h 23m 3s. Rate: 7.9 symbols/min [2025-10-21T18:38:24.780267] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:24.829491] [DEBUG] [LOCAL ] ETN: Loaded 52584 existing records from primary storage. [2025-10-21T18:38:24.829843] [INFO ] [MAIN ] ETN: Loaded 52584 existing records. [2025-10-21T18:38:24.956144] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-21T18:38:25.015210] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:25.015389] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-21T18:38:25.015436] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-21T18:38:25.015635] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-21T18:38:25.015715] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-21T18:38:25.376574] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:25.447296] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T18:38:25.751034] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-21T18:38:26.050558] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T18:38:26.551043] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-21T18:38:27.190164] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T18:38:27.244493] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T18:38:27.351034] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-21T18:38:28.151005] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-21T18:38:28.521180] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T18:38:28.951082] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-21T18:38:29.751096] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-21T18:38:30.042704] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T18:38:30.111184] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T18:38:30.551030] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-21T18:38:30.759482] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T18:38:31.351027] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-21T18:38:31.876067] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T18:38:32.151056] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-21T18:38:32.348689] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T18:38:32.951018] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-21T18:38:33.751021] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-21T18:38:34.108380] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T18:38:34.133755] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:38:34.551040] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-21T18:38:34.650723] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T18:38:35.351005] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-21T18:38:35.409166] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T18:38:36.151015] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-21T18:38:36.951033] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-21T18:38:37.670910] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-21T18:38:37.708381] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:38:37.750988] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-21T18:38:38.263807] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:38:38.386575] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-21T18:38:38.551007] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-21T18:38:39.351004] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-21T18:38:39.711288] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T18:38:39.715471] [INFO ] [REMOTE ] ETD: Full fetch complete (38608 records). [2025-10-21T18:38:39.715565] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-21T18:38:40.125079] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-21T18:38:40.125557] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-21T18:38:40.126261] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-21T18:38:40.126324] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-21T18:38:40.127187] [DEBUG] [LOCAL ] ETD: Trimmed 38608 records to 27258 (keeping 200 days of data) [2025-10-21T18:38:40.179356] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-21T18:38:40.289272] [DEBUG] [LOCAL ] ETD: Primary data saved (27258 records). [2025-10-21T18:38:40.289395] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-21T18:38:40.289471] [INFO ] [MAIN ] Update Progress: 773/2366 symbols completed. ETD took 27.2s. Estimated remaining: 3h 23m 12s. Rate: 7.8 symbols/min [2025-10-21T18:38:40.421522] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T18:38:40.477808] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:40.475000] [INFO ] [REMOTE ] ETG: Full fetch complete (24722 records). [2025-10-21T18:38:40.478065] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-21T18:38:40.617397] [DEBUG] [LOCAL ] ETO: Loaded 7007 existing records from primary storage. [2025-10-21T18:38:40.639706] [INFO ] [MAIN ] ETO: Loaded 7007 existing records. [2025-10-21T18:38:40.978849] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-21T18:38:40.978756] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:41.003981] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-21T18:38:41.051048] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-21T18:38:41.052722] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-21T18:38:41.052842] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-21T18:38:41.053441] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-21T18:38:41.053549] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-21T18:38:41.053928] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-21T18:38:41.054123] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-21T18:38:41.059832] [DEBUG] [LOCAL ] ETG: Trimmed 24722 records to 16586 (keeping 200 days of data) [2025-10-21T18:38:41.452154] [DEBUG] [LOCAL ] ETG: Primary data saved (16586 records). [2025-10-21T18:38:41.462511] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-21T18:38:41.467733] [INFO ] [MAIN ] Update Progress: 774/2366 symbols completed. ETG took 26.3s. Estimated remaining: 3h 22m 51s. Rate: 7.8 symbols/min [2025-10-21T18:38:41.626717] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:41.695441] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:41.741292] [DEBUG] [LOCAL ] ETR: Loaded 53196 existing records from primary storage. [2025-10-21T18:38:41.741581] [INFO ] [MAIN ] ETR: Loaded 53196 existing records. [2025-10-21T18:38:41.774213] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-21T18:38:41.932689] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:41.932895] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-21T18:38:41.932947] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-21T18:38:41.933277] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-21T18:38:41.933313] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-21T18:38:42.160519] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:38:42.330763] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:42.368389] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-21T18:38:42.368570] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-21T18:38:42.550986] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-21T18:38:43.351019] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-21T18:38:44.151032] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-21T18:38:44.584698] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-21T18:38:44.584925] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T18:38:44.951005] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-21T18:38:45.200730] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T18:38:45.558863] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:38:45.751051] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-21T18:38:46.551032] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-21T18:38:47.351015] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-21T18:38:47.539067] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:38:47.619405] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T18:38:48.151035] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-21T18:38:48.905938] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:38:48.950993] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-21T18:38:49.751032] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-21T18:38:49.872413] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T18:38:50.484193] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T18:38:50.550995] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-21T18:38:50.783840] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:38:51.350992] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-21T18:38:51.546440] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:38:52.151016] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-21T18:38:52.951016] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-21T18:38:53.013360] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:38:53.750985] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-21T18:38:53.914056] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T18:38:53.916972] [INFO ] [REMOTE ] ETJ: Full fetch complete (25582 records). [2025-10-21T18:38:53.917045] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-21T18:38:54.290367] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-21T18:38:54.290496] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-21T18:38:54.291143] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-21T18:38:54.291207] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-21T18:38:54.291930] [DEBUG] [LOCAL ] ETJ: Trimmed 25582 records to 16565 (keeping 200 days of data) [2025-10-21T18:38:54.392505] [DEBUG] [LOCAL ] ETJ: Primary data saved (16565 records). [2025-10-21T18:38:54.392621] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-21T18:38:54.392739] [INFO ] [MAIN ] Update Progress: 775/2366 symbols completed. ETJ took 35.8s. Estimated remaining: 3h 22m 54s. Rate: 7.8 symbols/min [2025-10-21T18:38:54.564919] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-21T18:38:54.564787] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:38:54.598552] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-21T18:38:54.656004] [DEBUG] [LOCAL ] ETSY: Loaded 53569 existing records from primary storage. [2025-10-21T18:38:54.656320] [INFO ] [MAIN ] ETSY: Loaded 53569 existing records. [2025-10-21T18:38:54.829487] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:38:54.829744] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-21T18:38:54.829799] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-21T18:38:54.830009] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-21T18:38:54.830066] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-21T18:38:55.182974] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:38:55.188547] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-21T18:38:55.351002] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-21T18:38:55.674399] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:38:56.151026] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-21T18:38:56.874890] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:38:56.951043] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-21T18:38:57.483415] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T18:38:57.751014] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-21T18:38:58.420390] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T18:38:58.551043] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-21T18:38:58.912104] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T18:38:59.222605] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T18:38:59.234440] [INFO ] [REMOTE ] ETN: Full fetch complete (76638 records). [2025-10-21T18:38:59.234666] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-21T18:38:59.356134] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-21T18:38:59.631465] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-21T18:38:59.631545] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-21T18:38:59.632533] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-21T18:38:59.632599] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-21T18:38:59.634079] [DEBUG] [LOCAL ] ETN: Trimmed 76638 records to 52573 (keeping 200 days of data) [2025-10-21T18:38:59.957869] [DEBUG] [LOCAL ] ETN: Primary data saved (52573 records). [2025-10-21T18:38:59.958025] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-21T18:38:59.958107] [INFO ] [MAIN ] Update Progress: 776/2366 symbols completed. ETN took 35.3s. Estimated remaining: 3h 22m 42s. Rate: 7.8 symbols/min [2025-10-21T18:39:00.064021] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T18:39:00.136104] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:00.156890] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-21T18:39:00.159129] [DEBUG] [LOCAL ] ETV: Loaded 22127 existing records from primary storage. [2025-10-21T18:39:00.159324] [INFO ] [MAIN ] ETV: Loaded 22127 existing records. [2025-10-21T18:39:00.379283] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:00.379522] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-21T18:39:00.379574] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-21T18:39:00.379754] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-21T18:39:00.379810] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-21T18:39:00.742717] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:00.950995] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-21T18:39:01.751104] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-21T18:39:02.207617] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T18:39:02.363306] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T18:39:02.551060] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-21T18:39:02.615789] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T18:39:03.351057] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-21T18:39:04.151014] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-21T18:39:04.172899] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T18:39:04.174876] [INFO ] [REMOTE ] ETO: Full fetch complete (9741 records). [2025-10-21T18:39:04.174968] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-21T18:39:04.538529] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-21T18:39:04.538609] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-21T18:39:04.538962] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-21T18:39:04.539062] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-21T18:39:04.539769] [DEBUG] [LOCAL ] ETO: Trimmed 9741 records to 6981 (keeping 200 days of data) [2025-10-21T18:39:04.608623] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T18:39:04.628824] [DEBUG] [LOCAL ] ETO: Primary data saved (6981 records). [2025-10-21T18:39:04.628932] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-21T18:39:04.629006] [INFO ] [MAIN ] Update Progress: 777/2366 symbols completed. ETO took 24.3s. Estimated remaining: 3h 22m 29s. Rate: 7.8 symbols/min [2025-10-21T18:39:04.796454] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:04.820287] [DEBUG] [LOCAL ] ETW: Loaded 25419 existing records from primary storage. [2025-10-21T18:39:04.820527] [INFO ] [MAIN ] ETW: Loaded 25419 existing records. [2025-10-21T18:39:04.960528] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-21T18:39:05.003323] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:05.003633] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-21T18:39:05.003715] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-21T18:39:05.003877] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-21T18:39:05.003915] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-21T18:39:05.226502] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T18:39:05.375713] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:05.751043] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-21T18:39:06.551044] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-21T18:39:07.004255] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T18:39:07.350996] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-21T18:39:07.487412] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T18:39:07.653266] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T18:39:08.151059] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-21T18:39:08.886809] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:39:08.951050] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-21T18:39:09.751009] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-21T18:39:09.941218] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:39:10.551023] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-21T18:39:10.886942] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T18:39:10.983459] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-21T18:39:11.351025] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-21T18:39:11.371628] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T18:39:12.151035] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-21T18:39:12.951024] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-21T18:39:13.458111] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T18:39:13.467769] [INFO ] [REMOTE ] ETR: Full fetch complete (77277 records). [2025-10-21T18:39:13.468044] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-21T18:39:13.753976] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-21T18:39:13.885300] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-21T18:39:13.885404] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-21T18:39:13.886378] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-21T18:39:13.886537] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-21T18:39:13.888189] [DEBUG] [LOCAL ] ETR: Trimmed 77277 records to 53193 (keeping 200 days of data) [2025-10-21T18:39:14.014379] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T18:39:14.049311] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T18:39:14.273221] [DEBUG] [LOCAL ] ETR: Primary data saved (53193 records). [2025-10-21T18:39:14.273356] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-21T18:39:14.274028] [INFO ] [MAIN ] Update Progress: 778/2366 symbols completed. ETR took 32.8s. Estimated remaining: 3h 22m 25s. Rate: 7.8 symbols/min [2025-10-21T18:39:14.441418] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:14.449200] [DEBUG] [LOCAL ] ETX: Loaded 5277 existing records from primary storage. [2025-10-21T18:39:14.449414] [INFO ] [MAIN ] ETX: Loaded 5277 existing records. [2025-10-21T18:39:14.552444] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-21T18:39:14.635951] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:14.636166] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-21T18:39:14.636225] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-21T18:39:14.636405] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-21T18:39:14.636460] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-21T18:39:14.989900] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:39:15.017537] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:15.351006] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-21T18:39:15.580235] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T18:39:16.151024] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-21T18:39:16.951002] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-21T18:39:17.106452] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T18:39:17.217822] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T18:39:17.751006] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-21T18:39:18.057754] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T18:39:18.550990] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-21T18:39:19.189318] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T18:39:19.351015] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-21T18:39:19.566211] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:39:20.151053] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-21T18:39:20.453967] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T18:39:20.511475] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-21T18:39:20.951069] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-21T18:39:21.751055] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-21T18:39:22.067088] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:39:22.244594] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T18:39:22.551039] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-21T18:39:23.350995] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-21T18:39:23.737060] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:39:23.741160] [INFO ] [REMOTE ] ETV: Full fetch complete (32233 records). [2025-10-21T18:39:23.741240] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-21T18:39:23.741774] [FATAL] [VALIDATOR ] ETV: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:39:23.741856] [FATAL] [MAIN ] ETV: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:39:23.741899] [WARN ] [MAIN ] ETV: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:39:23.741964] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-21T18:39:23.742027] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-21T18:39:23.742063] [INFO ] [LOCAL ] ETV: Starting deletion of derivative data. [2025-10-21T18:39:23.742216] [DEBUG] [LOCAL ] ETV: Deleted derivative data file. [2025-10-21T18:39:23.742302] [INFO ] [MAIN ] Update Progress: 779/2366 symbols completed. ETV took 23.8s. Estimated remaining: 3h 22m 21s. Rate: 7.8 symbols/min [2025-10-21T18:39:23.918434] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:23.942050] [DEBUG] [LOCAL ] ETY: Loaded 22685 existing records from primary storage. [2025-10-21T18:39:23.942358] [INFO ] [MAIN ] ETY: Loaded 22685 existing records. [2025-10-21T18:39:24.125640] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:24.125866] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-21T18:39:24.125927] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-21T18:39:24.126124] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-21T18:39:24.126180] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-21T18:39:24.156754] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-21T18:39:24.487103] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:24.951052] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-21T18:39:25.120370] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T18:39:25.306464] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T18:39:25.751083] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-21T18:39:25.859157] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T18:39:26.551063] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-21T18:39:27.105226] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T18:39:27.350995] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-21T18:39:27.417542] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T18:39:28.150989] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-21T18:39:28.393303] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T18:39:28.951018] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-21T18:39:29.750996] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-21T18:39:30.112617] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T18:39:30.148749] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T18:39:30.302705] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T18:39:30.551021] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-21T18:39:31.351029] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-21T18:39:32.048911] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T18:39:32.150982] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-21T18:39:32.454321] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T18:39:32.710085] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T18:39:32.951012] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-21T18:39:33.750988] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-21T18:39:34.120152] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T18:39:34.554158] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-21T18:39:34.555045] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:39:35.351070] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-21T18:39:36.151012] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-21T18:39:36.349891] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T18:39:36.544227] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-21T18:39:36.575480] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:39:36.951020] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-21T18:39:37.751012] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-21T18:39:38.093608] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T18:39:38.551023] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-21T18:39:39.030399] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:39:39.036751] [INFO ] [REMOTE ] ETW: Full fetch complete (36545 records). [2025-10-21T18:39:39.036940] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-21T18:39:39.354496] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-21T18:39:39.438501] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-21T18:39:39.438672] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-21T18:39:39.439853] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-21T18:39:39.439920] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-21T18:39:39.441225] [DEBUG] [LOCAL ] ETW: Trimmed 36545 records to 25249 (keeping 200 days of data) [2025-10-21T18:39:39.608187] [DEBUG] [LOCAL ] ETW: Primary data saved (25249 records). [2025-10-21T18:39:39.608463] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-21T18:39:39.608594] [INFO ] [MAIN ] Update Progress: 780/2366 symbols completed. ETW took 35.0s. Estimated remaining: 3h 22m 30s. Rate: 7.8 symbols/min [2025-10-21T18:39:39.771174] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T18:39:39.854816] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:39.873530] [DEBUG] [LOCAL ] EVC: Loaded 18043 existing records from primary storage. [2025-10-21T18:39:39.873814] [INFO ] [MAIN ] EVC: Loaded 18043 existing records. [2025-10-21T18:39:40.048324] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:40.048533] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-21T18:39:40.048579] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-21T18:39:40.048828] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-21T18:39:40.048888] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-21T18:39:40.156144] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-21T18:39:40.397916] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:40.951956] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-21T18:39:40.952240] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:39:40.954887] [INFO ] [REMOTE ] ETX: Full fetch complete (6797 records). [2025-10-21T18:39:40.955100] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-21T18:39:41.321476] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-21T18:39:41.321575] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-21T18:39:41.321807] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-21T18:39:41.321919] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-21T18:39:41.330345] [DEBUG] [LOCAL ] ETX: Trimmed 6797 records to 5311 (keeping 200 days of data) [2025-10-21T18:39:41.345563] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T18:39:41.380915] [INFO ] [REMOTE ] ETSY: Full fetch complete (77662 records). [2025-10-21T18:39:41.383728] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-21T18:39:41.433154] [DEBUG] [LOCAL ] ETX: Primary data saved (5311 records). [2025-10-21T18:39:41.462793] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-21T18:39:41.473936] [INFO ] [MAIN ] Update Progress: 781/2366 symbols completed. ETX took 27.2s. Estimated remaining: 3h 22m 11s. Rate: 7.8 symbols/min [2025-10-21T18:39:41.755351] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-21T18:39:41.839713] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:42.036322] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-10-21T18:39:42.037367] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-10-21T18:39:42.038398] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-10-21T18:39:42.038511] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-10-21T18:39:42.039087] [DEBUG] [LOCAL ] EVEX: Loaded 32891 existing records from primary storage. [2025-10-21T18:39:42.039542] [INFO ] [MAIN ] EVEX: Loaded 32891 existing records. [2025-10-21T18:39:42.145211] [DEBUG] [LOCAL ] ETSY: Trimmed 77662 records to 53569 (keeping 200 days of data) [2025-10-21T18:39:42.179133] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T18:39:42.298802] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:42.334812] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-21T18:39:42.337679] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-21T18:39:42.346922] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-21T18:39:42.347009] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-21T18:39:42.551698] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-21T18:39:42.920404] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:42.956267] [DEBUG] [LOCAL ] ETSY: Primary data saved (53569 records). [2025-10-21T18:39:42.956413] [INFO ] [MAIN ] ETSY: Full history saved. [2025-10-21T18:39:42.957115] [INFO ] [MAIN ] Update Progress: 782/2366 symbols completed. ETSY took 48.6s. Estimated remaining: 3h 21m 51s. Rate: 7.8 symbols/min [2025-10-21T18:39:43.127670] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:43.139669] [DEBUG] [LOCAL ] EVF: Loaded 9820 existing records from primary storage. [2025-10-21T18:39:43.139893] [INFO ] [MAIN ] EVF: Loaded 9820 existing records. [2025-10-21T18:39:43.328291] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T18:39:43.333596] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:43.339074] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-21T18:39:43.339131] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-21T18:39:43.339276] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-21T18:39:43.339315] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-21T18:39:43.360020] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-21T18:39:43.713517] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:43.727624] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:39:44.151006] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-21T18:39:44.483530] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T18:39:44.951034] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-21T18:39:45.400759] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T18:39:45.751021] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-21T18:39:46.128880] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T18:39:46.551034] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-21T18:39:46.602802] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T18:39:47.351062] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-21T18:39:47.662709] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T18:39:48.151138] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-21T18:39:48.566893] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:39:48.951076] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-21T18:39:49.297788] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T18:39:49.751032] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-21T18:39:50.214233] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T18:39:50.550994] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-21T18:39:50.836143] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T18:39:51.351008] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-21T18:39:51.699524] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T18:39:52.151031] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-21T18:39:52.419793] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T18:39:52.423638] [INFO ] [REMOTE ] ETY: Full fetch complete (34041 records). [2025-10-21T18:39:52.423748] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-21T18:39:52.788587] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-21T18:39:52.788687] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-21T18:39:52.789248] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-21T18:39:52.789288] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-21T18:39:52.790020] [DEBUG] [LOCAL ] ETY: Trimmed 34041 records to 22546 (keeping 200 days of data) [2025-10-21T18:39:52.924909] [DEBUG] [LOCAL ] ETY: Primary data saved (22546 records). [2025-10-21T18:39:52.925034] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-21T18:39:52.925113] [INFO ] [MAIN ] Update Progress: 783/2366 symbols completed. ETY took 29.2s. Estimated remaining: 3h 21m 48s. Rate: 7.8 symbols/min [2025-10-21T18:39:52.956065] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-21T18:39:53.105619] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:39:53.113561] [DEBUG] [LOCAL ] EVG: Loaded 5867 existing records from primary storage. [2025-10-21T18:39:53.113756] [INFO ] [MAIN ] EVG: Loaded 5867 existing records. [2025-10-21T18:39:53.298522] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:39:53.298802] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-21T18:39:53.298855] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-21T18:39:53.299028] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-21T18:39:53.299093] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-21T18:39:53.418998] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-21T18:39:53.664636] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:39:53.750985] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-21T18:39:54.136977] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:39:54.551081] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-21T18:39:54.748709] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:39:55.351082] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-21T18:39:55.795460] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T18:39:55.884624] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T18:39:56.151096] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-21T18:39:56.951030] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-21T18:39:57.143697] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T18:39:57.559314] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:39:57.751015] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-21T18:39:58.451549] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T18:39:58.551075] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-21T18:39:59.351016] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-21T18:39:59.548818] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T18:40:00.151072] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-21T18:40:00.359836] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:40:00.866992] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T18:40:00.951007] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-21T18:40:01.751065] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-21T18:40:01.926925] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T18:40:02.532200] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T18:40:02.551089] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-21T18:40:03.351117] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-21T18:40:03.940087] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:40:03.961088] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:40:04.151023] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-21T18:40:04.951048] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-21T18:40:05.326518] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T18:40:05.329254] [INFO ] [REMOTE ] EVC: Full fetch complete (28804 records). [2025-10-21T18:40:05.329334] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-21T18:40:05.698707] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-21T18:40:05.698786] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-21T18:40:05.699303] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-21T18:40:05.699374] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-21T18:40:05.700031] [DEBUG] [LOCAL ] EVC: Trimmed 28804 records to 17976 (keeping 200 days of data) [2025-10-21T18:40:05.771956] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-21T18:40:05.804758] [DEBUG] [LOCAL ] EVC: Primary data saved (17976 records). [2025-10-21T18:40:05.804906] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-21T18:40:05.804985] [INFO ] [MAIN ] Update Progress: 784/2366 symbols completed. EVC took 26.2s. Estimated remaining: 3h 21m 51s. Rate: 7.8 symbols/min [2025-10-21T18:40:05.926606] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T18:40:05.986255] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:06.029372] [DEBUG] [LOCAL ] EVH: Loaded 49646 existing records from primary storage. [2025-10-21T18:40:06.029673] [INFO ] [MAIN ] EVH: Loaded 49646 existing records. [2025-10-21T18:40:06.205942] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:06.206102] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-21T18:40:06.206148] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-21T18:40:06.206313] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-21T18:40:06.206354] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-21T18:40:06.556690] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-21T18:40:06.562372] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:07.278829] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T18:40:07.351028] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-21T18:40:07.484911] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:40:08.122424] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T18:40:08.150978] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-21T18:40:08.905110] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T18:40:08.951045] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-21T18:40:09.699750] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T18:40:09.750994] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-21T18:40:10.551043] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-21T18:40:11.333671] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T18:40:11.350988] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-21T18:40:12.151028] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-21T18:40:12.360848] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:40:12.900413] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T18:40:12.931501] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T18:40:12.951004] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-21T18:40:13.662277] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T18:40:13.663764] [INFO ] [REMOTE ] EVG: Full fetch complete (8136 records). [2025-10-21T18:40:13.663832] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-21T18:40:13.760331] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-21T18:40:14.019847] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-21T18:40:14.019924] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-21T18:40:14.020126] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-21T18:40:14.020163] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-21T18:40:14.020553] [DEBUG] [LOCAL ] EVG: Trimmed 8136 records to 5831 (keeping 200 days of data) [2025-10-21T18:40:14.054481] [DEBUG] [LOCAL ] EVG: Primary data saved (5831 records). [2025-10-21T18:40:14.054554] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-21T18:40:14.054622] [INFO ] [MAIN ] Update Progress: 785/2366 symbols completed. EVG took 21.1s. Estimated remaining: 3h 21m 44s. Rate: 7.8 symbols/min [2025-10-21T18:40:14.221931] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:14.234031] [DEBUG] [LOCAL ] EVN: Loaded 10724 existing records from primary storage. [2025-10-21T18:40:14.234228] [INFO ] [MAIN ] EVN: Loaded 10724 existing records. [2025-10-21T18:40:14.409487] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:14.409769] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-21T18:40:14.409822] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-21T18:40:14.409970] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-21T18:40:14.410005] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-21T18:40:14.556162] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-21T18:40:14.760726] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:15.351025] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-21T18:40:15.396424] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T18:40:15.501343] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T18:40:16.151018] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-21T18:40:16.951033] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-21T18:40:17.134897] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:40:17.143479] [INFO ] [REMOTE ] EVEX: Full fetch complete (44005 records). [2025-10-21T18:40:17.143676] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-21T18:40:17.551481] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-21T18:40:17.551602] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-21T18:40:17.552545] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-21T18:40:17.552628] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-21T18:40:17.554193] [DEBUG] [LOCAL ] EVEX: Trimmed 44005 records to 33007 (keeping 200 days of data) [2025-10-21T18:40:17.756091] [DEBUG] [LOCAL ] EVEX: Primary data saved (33007 records). [2025-10-21T18:40:17.756176] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-21T18:40:17.756353] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-21T18:40:17.757284] [INFO ] [MAIN ] Update Progress: 786/2366 symbols completed. EVEX took 36.3s. Estimated remaining: 3h 21m 29s. Rate: 7.8 symbols/min [2025-10-21T18:40:17.931218] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:17.967193] [DEBUG] [LOCAL ] EVR: Loaded 34068 existing records from primary storage. [2025-10-21T18:40:17.967475] [INFO ] [MAIN ] EVR: Loaded 34068 existing records. [2025-10-21T18:40:18.145960] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:18.146153] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-21T18:40:18.146199] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-21T18:40:18.146456] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-21T18:40:18.146494] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-21T18:40:18.506671] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:18.551028] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-21T18:40:18.632163] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-21T18:40:18.711757] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T18:40:19.350994] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-21T18:40:19.844593] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T18:40:20.081704] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:40:20.147548] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T18:40:20.150971] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-21T18:40:20.951020] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-21T18:40:21.356674] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T18:40:21.359072] [INFO ] [REMOTE ] EVF: Full fetch complete (12852 records). [2025-10-21T18:40:21.359217] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-21T18:40:21.661428] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T18:40:21.748181] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-21T18:40:21.748260] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-21T18:40:21.748627] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-21T18:40:21.748713] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-21T18:40:21.749185] [DEBUG] [LOCAL ] EVF: Trimmed 12852 records to 9793 (keeping 200 days of data) [2025-10-21T18:40:21.771472] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-21T18:40:21.807847] [DEBUG] [LOCAL ] EVF: Primary data saved (9793 records). [2025-10-21T18:40:21.807983] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-21T18:40:21.808068] [INFO ] [MAIN ] Update Progress: 787/2366 symbols completed. EVF took 38.9s. Estimated remaining: 3h 21m 14s. Rate: 7.8 symbols/min [2025-10-21T18:40:21.990120] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:22.006381] [DEBUG] [LOCAL ] EVT: Loaded 16762 existing records from primary storage. [2025-10-21T18:40:22.006639] [INFO ] [MAIN ] EVT: Loaded 16762 existing records. [2025-10-21T18:40:22.178052] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:22.178254] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-21T18:40:22.178299] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-21T18:40:22.178464] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-21T18:40:22.178501] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-21T18:40:22.536854] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:22.550991] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-21T18:40:22.681304] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T18:40:23.351023] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-21T18:40:24.151002] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-21T18:40:24.177634] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T18:40:24.248271] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:40:24.951022] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-21T18:40:25.745867] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:40:25.750970] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-21T18:40:26.551012] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-21T18:40:26.646960] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:40:26.715603] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:40:27.351024] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-21T18:40:28.057487] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:40:28.150999] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-21T18:40:28.158809] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T18:40:28.951022] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-21T18:40:29.186097] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:40:29.751002] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-21T18:40:29.786944] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T18:40:30.551016] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-21T18:40:30.670024] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T18:40:31.351019] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-21T18:40:32.151046] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-21T18:40:32.324631] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T18:40:32.357748] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:40:32.951035] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-21T18:40:33.034673] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T18:40:33.724536] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T18:40:33.751046] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-21T18:40:34.551066] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-21T18:40:35.351014] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-21T18:40:35.513089] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T18:40:35.565341] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T18:40:36.151028] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-21T18:40:36.342231] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T18:40:36.951002] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-21T18:40:36.967185] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T18:40:37.751000] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-21T18:40:37.982713] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T18:40:38.551021] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-21T18:40:39.197320] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T18:40:39.351026] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-21T18:40:39.440261] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T18:40:39.442834] [INFO ] [REMOTE ] EVN: Full fetch complete (17091 records). [2025-10-21T18:40:39.442916] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-21T18:40:39.858332] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-21T18:40:39.858414] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-21T18:40:39.858873] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-21T18:40:39.858935] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-21T18:40:39.859439] [DEBUG] [LOCAL ] EVN: Trimmed 17091 records to 10747 (keeping 200 days of data) [2025-10-21T18:40:39.924743] [DEBUG] [LOCAL ] EVN: Primary data saved (10747 records). [2025-10-21T18:40:39.924880] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-21T18:40:39.924962] [INFO ] [MAIN ] Update Progress: 788/2366 symbols completed. EVN took 25.9s. Estimated remaining: 3h 21m 27s. Rate: 7.8 symbols/min [2025-10-21T18:40:40.097319] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:40.123215] [DEBUG] [LOCAL ] EVTC: Loaded 26895 existing records from primary storage. [2025-10-21T18:40:40.123461] [INFO ] [MAIN ] EVTC: Loaded 26895 existing records. [2025-10-21T18:40:40.156153] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-21T18:40:40.299566] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:40.299784] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-21T18:40:40.299835] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-21T18:40:40.300003] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-21T18:40:40.300040] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-21T18:40:40.653209] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:40.827385] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:40:40.951045] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-21T18:40:41.751047] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-21T18:40:41.984470] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T18:40:42.022620] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T18:40:42.551030] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-21T18:40:42.923387] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:40:43.351124] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-21T18:40:43.670567] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T18:40:43.673124] [INFO ] [REMOTE ] EVT: Full fetch complete (25039 records). [2025-10-21T18:40:43.673222] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-21T18:40:43.673815] [FATAL] [VALIDATOR ] EVT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:40:43.673945] [FATAL] [MAIN ] EVT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:40:43.674017] [WARN ] [MAIN ] EVT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:40:43.674104] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-21T18:40:43.674177] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-10-21T18:40:43.674216] [INFO ] [LOCAL ] EVT: Starting deletion of derivative data. [2025-10-21T18:40:43.674406] [DEBUG] [LOCAL ] EVT: Deleted derivative data file. [2025-10-21T18:40:43.674494] [INFO ] [MAIN ] Update Progress: 789/2366 symbols completed. EVT took 21.9s. Estimated remaining: 3h 21m 12s. Rate: 7.8 symbols/min [2025-10-21T18:40:43.845399] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:43.882558] [DEBUG] [LOCAL ] EVTL: Loaded 41005 existing records from primary storage. [2025-10-21T18:40:43.882868] [INFO ] [MAIN ] EVTL: Loaded 41005 existing records. [2025-10-21T18:40:44.061478] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:44.061691] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-21T18:40:44.061748] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-21T18:40:44.062229] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-21T18:40:44.062268] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-21T18:40:44.158813] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-21T18:40:44.423208] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:44.942942] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:40:44.950968] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-21T18:40:45.562069] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T18:40:45.751049] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-21T18:40:46.489612] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T18:40:46.551027] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-21T18:40:47.230119] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T18:40:47.351054] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-21T18:40:47.452964] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T18:40:48.151034] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-21T18:40:48.490018] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T18:40:48.951098] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-21T18:40:49.480454] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T18:40:49.751065] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-21T18:40:50.025984] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T18:40:50.551052] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-21T18:40:51.350996] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-21T18:40:51.594515] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T18:40:51.927723] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T18:40:51.935499] [INFO ] [REMOTE ] EVH: Full fetch complete (71830 records). [2025-10-21T18:40:51.935635] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-21T18:40:52.159799] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-21T18:40:52.323492] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-21T18:40:52.323564] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-21T18:40:52.324423] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-21T18:40:52.324484] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-21T18:40:52.325802] [DEBUG] [LOCAL ] EVH: Trimmed 71830 records to 49597 (keeping 200 days of data) [2025-10-21T18:40:52.599144] [DEBUG] [LOCAL ] EVH: Primary data saved (49597 records). [2025-10-21T18:40:52.599270] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-21T18:40:52.599344] [INFO ] [MAIN ] Update Progress: 790/2366 symbols completed. EVH took 46.8s. Estimated remaining: 3h 21m 6s. Rate: 7.8 symbols/min [2025-10-21T18:40:52.779810] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:52.781108] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T18:40:52.786041] [INFO ] [REMOTE ] EVR: Full fetch complete (50729 records). [2025-10-21T18:40:52.786169] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-21T18:40:52.974378] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-21T18:40:52.981321] [DEBUG] [LOCAL ] EVTR: Loaded 25188 existing records from primary storage. [2025-10-21T18:40:52.997088] [INFO ] [MAIN ] EVTR: Loaded 25188 existing records. [2025-10-21T18:40:53.347879] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-21T18:40:53.348281] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-21T18:40:53.349972] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-21T18:40:53.370429] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-21T18:40:53.370343] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:53.370725] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-21T18:40:53.370780] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-21T18:40:53.370997] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-21T18:40:53.371098] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-21T18:40:53.453139] [DEBUG] [LOCAL ] EVR: Trimmed 50729 records to 33850 (keeping 200 days of data) [2025-10-21T18:40:53.915216] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T18:40:53.943983] [DEBUG] [LOCAL ] EVR: Primary data saved (33850 records). [2025-10-21T18:40:53.957459] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-21T18:40:53.967680] [INFO ] [MAIN ] Update Progress: 791/2366 symbols completed. EVR took 36.2s. Estimated remaining: 3h 20m 46s. Rate: 7.8 symbols/min [2025-10-21T18:40:53.975831] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-21T18:40:54.047868] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:54.179188] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:40:54.227635] [DEBUG] [LOCAL ] EW: Loaded 53400 existing records from primary storage. [2025-10-21T18:40:54.227993] [INFO ] [MAIN ] EW: Loaded 53400 existing records. [2025-10-21T18:40:54.408603] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:40:54.408933] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-21T18:40:54.409123] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-21T18:40:54.409528] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-21T18:40:54.409589] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-21T18:40:54.542765] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:40:54.553381] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-21T18:40:54.803794] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:40:55.199144] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:40:55.351038] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-21T18:40:55.823366] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T18:40:56.101456] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T18:40:56.150989] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-21T18:40:56.951056] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-21T18:40:57.637550] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T18:40:57.751011] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-21T18:40:58.148726] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T18:40:58.551046] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-21T18:40:59.351005] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-21T18:40:59.550178] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T18:41:00.083008] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T18:41:00.151054] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-21T18:41:00.246215] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T18:41:00.951028] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-21T18:41:01.751081] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-21T18:41:02.152186] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-21T18:41:02.201019] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T18:41:02.551062] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-21T18:41:03.064627] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T18:41:03.351140] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-21T18:41:04.151050] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-21T18:41:04.330283] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T18:41:04.919166] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-21T18:41:04.951048] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-21T18:41:05.751083] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-21T18:41:05.970718] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:41:06.185630] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T18:41:06.551036] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-21T18:41:07.350984] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-21T18:41:07.702011] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T18:41:07.753758] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T18:41:08.151043] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-21T18:41:08.951014] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-21T18:41:09.364151] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T18:41:09.518835] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-21T18:41:09.751018] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-21T18:41:10.551009] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-21T18:41:10.793725] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:41:11.351101] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-21T18:41:11.652085] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T18:41:11.849152] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T18:41:11.854250] [INFO ] [REMOTE ] EVTC: Full fetch complete (38427 records). [2025-10-21T18:41:11.854358] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-21T18:41:12.156125] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-21T18:41:12.253829] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-21T18:41:12.253915] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-21T18:41:12.254520] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-21T18:41:12.254560] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-21T18:41:12.255494] [DEBUG] [LOCAL ] EVTC: Trimmed 38427 records to 26869 (keeping 200 days of data) [2025-10-21T18:41:12.420796] [DEBUG] [LOCAL ] EVTC: Primary data saved (26869 records). [2025-10-21T18:41:12.420930] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-21T18:41:12.421007] [INFO ] [MAIN ] Update Progress: 792/2366 symbols completed. EVTC took 32.5s. Estimated remaining: 3h 21m 0s. Rate: 7.8 symbols/min [2025-10-21T18:41:12.606430] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T18:41:12.632004] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:12.664970] [DEBUG] [LOCAL ] EXG: Loaded 33887 existing records from primary storage. [2025-10-21T18:41:12.665309] [INFO ] [MAIN ] EXG: Loaded 33887 existing records. [2025-10-21T18:41:12.868144] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:41:12.868443] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-21T18:41:12.868513] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-21T18:41:12.868823] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-21T18:41:12.868892] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-21T18:41:12.956159] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-21T18:41:13.243270] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:13.751063] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-21T18:41:14.334996] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T18:41:14.345680] [INFO ] [REMOTE ] EVTL: Full fetch complete (54773 records). [2025-10-21T18:41:14.345789] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-21T18:41:14.552534] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-21T18:41:14.767771] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-21T18:41:14.767969] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-21T18:41:14.768933] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-21T18:41:14.769037] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-21T18:41:14.798025] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T18:41:14.815565] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:41:14.813827] [DEBUG] [LOCAL ] EVTL: Trimmed 54773 records to 41214 (keeping 200 days of data) [2025-10-21T18:41:15.050477] [DEBUG] [LOCAL ] EVTL: Primary data saved (41214 records). [2025-10-21T18:41:15.050584] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-21T18:41:15.050682] [INFO ] [MAIN ] Update Progress: 793/2366 symbols completed. EVTL took 31.4s. Estimated remaining: 3h 20m 42s. Rate: 7.8 symbols/min [2025-10-21T18:41:15.216196] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:15.265012] [DEBUG] [LOCAL ] EXK: Loaded 53185 existing records from primary storage. [2025-10-21T18:41:15.265327] [INFO ] [MAIN ] EXK: Loaded 53185 existing records. [2025-10-21T18:41:15.360933] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-21T18:41:15.440084] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:41:15.440240] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-21T18:41:15.440285] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-21T18:41:15.440472] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-21T18:41:15.440527] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-21T18:41:15.789368] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:16.151052] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-21T18:41:16.360673] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:41:16.951054] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-21T18:41:17.199155] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:41:17.282336] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T18:41:17.751021] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-21T18:41:18.489353] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:41:18.551019] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-21T18:41:19.351004] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-21T18:41:19.623742] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:41:20.151032] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-21T18:41:20.223541] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:41:20.753299] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:41:20.951122] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-21T18:41:21.748581] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T18:41:21.759425] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-21T18:41:22.227200] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T18:41:22.551051] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-21T18:41:23.351005] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-21T18:41:23.382974] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:41:23.520262] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T18:41:23.529202] [INFO ] [REMOTE ] EW: Full fetch complete (77514 records). [2025-10-21T18:41:23.529358] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-21T18:41:23.934979] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-21T18:41:23.935073] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-21T18:41:23.935998] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-21T18:41:23.936061] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-21T18:41:23.937574] [DEBUG] [LOCAL ] EW: Trimmed 77514 records to 53399 (keeping 200 days of data) [2025-10-21T18:41:24.151120] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-21T18:41:24.259817] [DEBUG] [LOCAL ] EW: Primary data saved (53399 records). [2025-10-21T18:41:24.259958] [INFO ] [MAIN ] EW: Full history saved. [2025-10-21T18:41:24.260885] [INFO ] [MAIN ] Update Progress: 794/2366 symbols completed. EW took 30.3s. Estimated remaining: 3h 20m 38s. Rate: 7.8 symbols/min [2025-10-21T18:41:24.431399] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:24.462021] [DEBUG] [LOCAL ] EXP: Loaded 29414 existing records from primary storage. [2025-10-21T18:41:24.462289] [INFO ] [MAIN ] EXP: Loaded 29414 existing records. [2025-10-21T18:41:24.669781] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:41:24.670006] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-21T18:41:24.670053] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-21T18:41:24.670273] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-21T18:41:24.670331] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-21T18:41:24.956694] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-21T18:41:24.993388] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:41:25.086215] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:25.751116] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-21T18:41:25.917863] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T18:41:25.974712] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T18:41:26.551027] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-21T18:41:27.039039] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:41:27.351088] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-21T18:41:27.892863] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T18:41:27.898395] [INFO ] [REMOTE ] EVTR: Full fetch complete (33792 records). [2025-10-21T18:41:27.898486] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-21T18:41:28.162090] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-21T18:41:28.292958] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-21T18:41:28.293053] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-21T18:41:28.293698] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-21T18:41:28.293761] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-21T18:41:28.294560] [DEBUG] [LOCAL ] EVTR: Trimmed 33792 records to 25297 (keeping 200 days of data) [2025-10-21T18:41:28.451694] [DEBUG] [LOCAL ] EVTR: Primary data saved (25297 records). [2025-10-21T18:41:28.451821] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-21T18:41:28.451900] [INFO ] [MAIN ] Update Progress: 795/2366 symbols completed. EVTR took 35.9s. Estimated remaining: 3h 20m 23s. Rate: 7.8 symbols/min [2025-10-21T18:41:28.628798] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:28.629005] [DEBUG] [LOCAL ] EXPD: No existing data file found in primary storage. [2025-10-21T18:41:28.629061] [WARN ] [MAIN ] EXPD: No existing data found, performing full refresh instead. [2025-10-21T18:41:28.629167] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-21T18:41:28.629221] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-21T18:41:28.629294] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-10-21T18:41:28.629329] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-21T18:41:28.937226] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T18:41:28.953202] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-21T18:41:29.008503] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:29.750985] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-21T18:41:30.083605] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T18:41:30.551035] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-21T18:41:30.713290] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T18:41:30.792791] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:41:31.351004] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-21T18:41:32.151040] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-21T18:41:32.222054] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T18:41:32.770352] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T18:41:32.951026] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-21T18:41:33.441076] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T18:41:33.751046] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-21T18:41:33.937176] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T18:41:34.551005] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-21T18:41:35.351025] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-21T18:41:35.508580] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T18:41:36.040438] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:41:36.150996] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-21T18:41:36.663034] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:41:36.950992] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-21T18:41:37.751005] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-21T18:41:37.869162] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:41:38.276918] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T18:41:38.550995] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-21T18:41:39.356965] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-21T18:41:39.375371] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T18:41:39.734586] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:41:40.150994] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-21T18:41:40.618336] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-21T18:41:40.951025] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-21T18:41:41.176021] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T18:41:41.751091] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-21T18:41:42.227699] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T18:41:42.551093] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-21T18:41:43.351027] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-21T18:41:43.748049] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T18:41:43.802021] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T18:41:44.151052] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-21T18:41:44.950997] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-21T18:41:45.137251] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:41:45.453444] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T18:41:45.458043] [INFO ] [REMOTE ] EXP: Full fetch complete (43039 records). [2025-10-21T18:41:45.458144] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-21T18:41:45.756100] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-21T18:41:45.837250] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-21T18:41:45.837332] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-21T18:41:45.838012] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-21T18:41:45.838077] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-21T18:41:45.839094] [DEBUG] [LOCAL ] EXP: Trimmed 43039 records to 29339 (keeping 200 days of data) [2025-10-21T18:41:46.020973] [DEBUG] [LOCAL ] EXP: Primary data saved (29339 records). [2025-10-21T18:41:46.021106] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-21T18:41:46.021227] [INFO ] [MAIN ] Update Progress: 796/2366 symbols completed. EXP took 21.8s. Estimated remaining: 3h 20m 35s. Rate: 7.8 symbols/min [2025-10-21T18:41:46.188026] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:41:46.231577] [DEBUG] [LOCAL ] EXR: Loaded 45611 existing records from primary storage. [2025-10-21T18:41:46.231887] [INFO ] [MAIN ] EXR: Loaded 45611 existing records. [2025-10-21T18:41:46.415064] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:41:46.415273] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-21T18:41:46.415331] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-21T18:41:46.415540] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-21T18:41:46.415594] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-21T18:41:46.565080] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-21T18:41:46.775495] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:41:46.826319] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T18:41:47.148677] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T18:41:47.153891] [INFO ] [REMOTE ] EXG: Full fetch complete (49616 records). [2025-10-21T18:41:47.154000] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-21T18:41:47.356226] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-21T18:41:47.541858] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-21T18:41:47.541941] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-21T18:41:47.542611] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-21T18:41:47.542687] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-21T18:41:47.543731] [DEBUG] [LOCAL ] EXG: Trimmed 49616 records to 33695 (keeping 200 days of data) [2025-10-21T18:41:47.740842] [DEBUG] [LOCAL ] EXG: Primary data saved (33695 records). [2025-10-21T18:41:47.740985] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-21T18:41:47.741063] [INFO ] [MAIN ] Update Progress: 797/2366 symbols completed. EXG took 35.3s. Estimated remaining: 3h 20m 16s. Rate: 7.8 symbols/min [2025-10-21T18:41:48.151058] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-21T18:41:48.194369] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T18:41:48.608370] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T18:41:48.951105] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-21T18:41:49.751052] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-21T18:41:50.030924] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T18:41:50.508727] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:41:50.550993] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-21T18:41:50.910147] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T18:41:51.350999] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-21T18:41:52.023351] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T18:41:52.151019] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-21T18:41:52.951137] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-21T18:41:53.013444] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:41:53.751086] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-21T18:41:54.040055] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:41:54.551069] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-21T18:41:55.274956] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-21T18:41:55.283439] [INFO ] [REMOTE ] EXK: Full fetch complete (76819 records). [2025-10-21T18:41:55.283562] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-21T18:41:55.715836] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-21T18:41:55.716048] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-21T18:41:55.717060] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-21T18:41:55.717143] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-21T18:41:55.743293] [DEBUG] [LOCAL ] EXK: Trimmed 76819 records to 53186 (keeping 200 days of data) [2025-10-21T18:41:55.745250] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T18:41:55.756252] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-21T18:41:56.059856] [DEBUG] [LOCAL ] EXK: Primary data saved (53186 records). [2025-10-21T18:41:56.060015] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-21T18:41:56.060851] [INFO ] [MAIN ] Update Progress: 798/2366 symbols completed. EXK took 41.0s. Estimated remaining: 3h 20m 10s. Rate: 7.8 symbols/min [2025-10-21T18:41:56.203625] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T18:41:56.215260] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-21T18:41:56.682171] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T18:41:56.690131] [INFO ] [REMOTE ] EXPD: Full fetch complete (69454 records). [2025-10-21T18:41:56.690322] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-21T18:41:57.103325] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-21T18:41:57.103414] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-21T18:41:57.104325] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-21T18:41:57.104417] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-21T18:41:57.105804] [DEBUG] [LOCAL ] EXPD: Trimmed 69454 records to 47765 (keeping 200 days of data) [2025-10-21T18:41:57.407180] [DEBUG] [LOCAL ] EXPD: Primary data saved (47765 records). [2025-10-21T18:41:57.407423] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-21T18:41:57.407533] [INFO ] [MAIN ] Update Progress: 799/2366 symbols completed. EXPD took 29.0s. Estimated remaining: 3h 19m 50s. Rate: 7.8 symbols/min [2025-10-21T18:41:57.474711] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T18:41:57.484958] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-21T18:41:59.260887] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T18:41:59.272278] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-21T18:42:01.034481] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T18:42:01.044463] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-21T18:42:06.189172] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (5.14 seconds). [2025-10-21T18:42:06.199205] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-21T18:42:07.917534] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T18:42:07.927209] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-21T18:42:08.747487] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T18:42:08.754636] [INFO ] [REMOTE ] EXR: Full fetch complete (66206 records). [2025-10-21T18:42:08.754773] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-21T18:42:09.135427] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-21T18:42:09.135522] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-21T18:42:09.136365] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-21T18:42:09.136429] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-21T18:42:09.137808] [DEBUG] [LOCAL ] EXR: Trimmed 66206 records to 45544 (keeping 200 days of data) [2025-10-21T18:42:09.421311] [DEBUG] [LOCAL ] EXR: Primary data saved (45544 records). [2025-10-21T18:42:09.421464] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-21T18:42:09.422272] [INFO ] [MAIN ] Update Progress: 800/2366 symbols completed. EXR took 23.4s. Estimated remaining: 3h 19m 50s. Rate: 7.8 symbols/min [2025-10-21T18:42:10.095891] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:10.097091] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:10.135708] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:10.134428] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:10.175196] [DEBUG] [LOCAL ] FBK: Loaded 27519 existing records from primary storage. [2025-10-21T18:42:10.185287] [INFO ] [MAIN ] FBK: Loaded 27519 existing records. [2025-10-21T18:42:10.314037] [DEBUG] [LOCAL ] FAF: Loaded 41567 existing records from primary storage. [2025-10-21T18:42:10.349522] [DEBUG] [LOCAL ] FBIN: Loaded 50414 existing records from primary storage. [2025-10-21T18:42:10.360198] [INFO ] [MAIN ] FAF: Loaded 41567 existing records. [2025-10-21T18:42:10.415508] [INFO ] [MAIN ] FBIN: Loaded 50414 existing records. [2025-10-21T18:42:10.449826] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-21T18:42:10.449039] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:10.458833] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-21T18:42:10.529448] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-21T18:42:10.609867] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-21T18:42:10.662417] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-21T18:42:10.711486] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-21T18:42:11.030902] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:11.072733] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-21T18:42:11.065924] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:11.079357] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-21T18:42:11.072973] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-21T18:42:11.082760] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-21T18:42:11.086021] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:11.111925] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-21T18:42:11.106769] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-21T18:42:11.125035] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-21T18:42:11.140313] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-21T18:42:11.155844] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-21T18:42:11.161094] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-21T18:42:11.201229] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-21T18:42:11.254976] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-21T18:42:11.857167] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:11.964412] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-21T18:42:12.349958] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:12.345895] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:12.355969] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-21T18:42:12.355756] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-21T18:42:12.429565] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:12.430058] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-21T18:42:13.153254] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T18:42:13.157189] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-21T18:42:13.519824] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T18:42:13.526925] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-21T18:42:14.111563] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T18:42:14.121713] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-21T18:42:14.136332] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:42:14.139792] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-21T18:42:14.828792] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T18:42:14.836230] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-21T18:42:15.014206] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-10-21T18:42:15.025206] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-21T18:42:15.195329] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T18:42:15.199633] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-21T18:42:15.704918] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:42:15.714760] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-21T18:42:16.223842] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T18:42:16.232539] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-21T18:42:16.259509] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T18:42:16.266218] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-21T18:42:17.242356] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:42:17.252674] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-21T18:42:17.398623] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-21T18:42:17.409023] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-21T18:42:17.456730] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T18:42:17.461455] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-21T18:42:17.813876] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T18:42:17.823028] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-21T18:42:18.185192] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:42:18.190185] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-21T18:42:19.066825] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T18:42:19.077793] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-21T18:42:19.383637] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T18:42:19.392928] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-21T18:42:19.466031] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T18:42:19.474136] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-21T18:42:19.904221] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-21T18:42:19.916219] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-21T18:42:20.783341] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T18:42:20.799271] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T18:42:20.807253] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-21T18:42:20.809274] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-21T18:42:20.952099] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T18:42:20.961909] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-21T18:42:21.929782] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:42:21.935469] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-21T18:42:22.195249] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:42:22.281312] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T18:42:22.522931] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-21T18:42:22.550982] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-21T18:42:23.352931] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-21T18:42:23.355098] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T18:42:23.360966] [INFO ] [REMOTE ] FBK: Full fetch complete (35446 records). [2025-10-21T18:42:23.361052] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-21T18:42:23.733403] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-21T18:42:23.733476] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-21T18:42:23.734063] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-21T18:42:23.734123] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-21T18:42:23.734940] [DEBUG] [LOCAL ] FBK: Trimmed 35446 records to 27486 (keeping 200 days of data) [2025-10-21T18:42:23.899716] [DEBUG] [LOCAL ] FBK: Primary data saved (27486 records). [2025-10-21T18:42:23.899834] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-21T18:42:23.899908] [INFO ] [MAIN ] Update Progress: 801/2366 symbols completed. FBK took 14.5s. Estimated remaining: 3h 19m 56s. Rate: 7.8 symbols/min [2025-10-21T18:42:24.073838] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:24.123074] [DEBUG] [LOCAL ] FBP: Loaded 45752 existing records from primary storage. [2025-10-21T18:42:24.123458] [INFO ] [MAIN ] FBP: Loaded 45752 existing records. [2025-10-21T18:42:24.153609] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-21T18:42:24.329163] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:24.329371] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-21T18:42:24.329448] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-21T18:42:24.329979] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-21T18:42:24.330038] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-21T18:42:24.697535] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:24.741222] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-21T18:42:24.869535] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T18:42:24.951021] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-21T18:42:25.751026] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-21T18:42:26.543125] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T18:42:26.550995] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-21T18:42:26.804579] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-21T18:42:27.127166] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T18:42:27.351071] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-21T18:42:28.151018] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-21T18:42:28.421314] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T18:42:28.796868] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:42:28.802977] [INFO ] [REMOTE ] FAF: Full fetch complete (58233 records). [2025-10-21T18:42:28.803091] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-21T18:42:28.958959] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-21T18:42:29.216869] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-21T18:42:29.216945] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-21T18:42:29.217698] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-21T18:42:29.217760] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-21T18:42:29.218893] [DEBUG] [LOCAL ] FAF: Trimmed 58233 records to 41479 (keeping 200 days of data) [2025-10-21T18:42:29.490424] [DEBUG] [LOCAL ] FAF: Primary data saved (41479 records). [2025-10-21T18:42:29.490559] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-21T18:42:29.490661] [INFO ] [MAIN ] Update Progress: 802/2366 symbols completed. FAF took 20.1s. Estimated remaining: 3h 19m 44s. Rate: 7.8 symbols/min [2025-10-21T18:42:29.670879] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:29.671069] [DEBUG] [LOCAL ] FBRT: No existing data file found in primary storage. [2025-10-21T18:42:29.671118] [WARN ] [MAIN ] FBRT: No existing data found, performing full refresh instead. [2025-10-21T18:42:29.671246] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-21T18:42:29.671288] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-21T18:42:29.671330] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-21T18:42:29.671366] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-21T18:42:29.756186] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-21T18:42:30.030717] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:30.552168] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-21T18:42:30.557750] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-21T18:42:30.598990] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:42:31.327619] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T18:42:31.350997] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-21T18:42:32.025484] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T18:42:32.151035] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-21T18:42:32.951033] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-21T18:42:33.554776] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T18:42:33.750994] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-21T18:42:33.958994] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-21T18:42:34.212515] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T18:42:34.551034] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-21T18:42:35.351088] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-21T18:42:35.533707] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:42:35.541326] [INFO ] [REMOTE ] FBIN: Full fetch complete (73015 records). [2025-10-21T18:42:35.541449] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-21T18:42:35.924684] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-21T18:42:35.924768] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-21T18:42:35.925605] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-21T18:42:35.925664] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-21T18:42:35.926986] [DEBUG] [LOCAL ] FBIN: Trimmed 73015 records to 50399 (keeping 200 days of data) [2025-10-21T18:42:36.154373] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-21T18:42:36.220968] [DEBUG] [LOCAL ] FBIN: Primary data saved (50399 records). [2025-10-21T18:42:36.221076] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-21T18:42:36.221906] [INFO ] [MAIN ] Update Progress: 803/2366 symbols completed. FBIN took 26.8s. Estimated remaining: 3h 19m 35s. Rate: 7.8 symbols/min [2025-10-21T18:42:36.392827] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:36.409992] [DEBUG] [LOCAL ] FC: Loaded 14647 existing records from primary storage. [2025-10-21T18:42:36.410251] [INFO ] [MAIN ] FC: Loaded 14647 existing records. [2025-10-21T18:42:36.588002] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:36.588257] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-21T18:42:36.588334] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-21T18:42:36.588683] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-21T18:42:36.588743] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-21T18:42:36.862295] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T18:42:36.973318] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:36.954022] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-21T18:42:37.183412] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-21T18:42:37.751039] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-21T18:42:37.935111] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T18:42:38.464250] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:42:38.551017] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-21T18:42:38.658783] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T18:42:39.351016] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-21T18:42:40.151033] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-21T18:42:40.955500] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-21T18:42:40.961416] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T18:42:41.010963] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-21T18:42:41.023888] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T18:42:41.751087] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-21T18:42:42.424095] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T18:42:42.551013] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-21T18:42:42.793623] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:42:43.351026] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-21T18:42:43.432018] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:42:43.440333] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-21T18:42:43.440480] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-21T18:42:43.844020] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-21T18:42:43.844096] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-21T18:42:43.845000] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-21T18:42:43.845063] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-21T18:42:43.846410] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-21T18:42:44.155267] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-21T18:42:44.175569] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-21T18:42:44.175761] [INFO ] [MAIN ] F: Full history saved. [2025-10-21T18:42:44.175954] [INFO ] [MAIN ] Update Progress: 804/2366 symbols completed. F took 34.8s. Estimated remaining: 3h 19m 28s. Rate: 7.8 symbols/min [2025-10-21T18:42:44.359877] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:44.360183] [DEBUG] [LOCAL ] FCF: No existing data file found in primary storage. [2025-10-21T18:42:44.360245] [WARN ] [MAIN ] FCF: No existing data found, performing full refresh instead. [2025-10-21T18:42:44.360393] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-21T18:42:44.360437] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-21T18:42:44.360483] [DEBUG] [LOCAL ] FCF: No primary data file found to delete. [2025-10-21T18:42:44.360518] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-21T18:42:44.517925] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T18:42:44.731440] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:44.951003] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-21T18:42:45.639573] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T18:42:45.751024] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-21T18:42:46.551092] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-21T18:42:46.613182] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T18:42:47.347750] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T18:42:47.357386] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-21T18:42:47.385982] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T18:42:48.151047] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-21T18:42:48.614396] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T18:42:48.951067] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-21T18:42:49.484083] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:42:49.751002] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-21T18:42:50.551018] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-21T18:42:50.659237] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:42:50.830868] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T18:42:51.351141] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-21T18:42:52.065265] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:42:52.151064] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-21T18:42:52.908896] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:42:52.950997] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-21T18:42:53.751024] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-21T18:42:53.800088] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:42:54.551110] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-21T18:42:54.683919] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T18:42:54.691305] [INFO ] [REMOTE ] FBP: Full fetch complete (66723 records). [2025-10-21T18:42:54.691420] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-21T18:42:54.827174] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T18:42:55.105464] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-21T18:42:55.105538] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-21T18:42:55.106395] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-21T18:42:55.106465] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-21T18:42:55.107802] [DEBUG] [LOCAL ] FBP: Trimmed 66723 records to 45626 (keeping 200 days of data) [2025-10-21T18:42:55.358285] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-21T18:42:55.377887] [DEBUG] [LOCAL ] FBP: Primary data saved (45626 records). [2025-10-21T18:42:55.377974] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-21T18:42:55.378615] [INFO ] [MAIN ] Update Progress: 805/2366 symbols completed. FBP took 31.5s. Estimated remaining: 3h 19m 27s. Rate: 7.8 symbols/min [2025-10-21T18:42:55.551202] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:42:55.584403] [DEBUG] [LOCAL ] FCN: Loaded 25974 existing records from primary storage. [2025-10-21T18:42:55.585279] [INFO ] [MAIN ] FCN: Loaded 25974 existing records. [2025-10-21T18:42:55.767300] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:42:55.767575] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-21T18:42:55.767634] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-21T18:42:55.768367] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-21T18:42:55.768425] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-21T18:42:56.096474] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T18:42:56.164142] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:42:56.158663] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-21T18:42:56.950992] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-21T18:42:57.064140] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T18:42:57.411268] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:42:57.751002] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-21T18:42:58.079996] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T18:42:58.551089] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-21T18:42:59.092872] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T18:42:59.351161] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-21T18:43:00.122749] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:43:00.150999] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-21T18:43:00.423591] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T18:43:00.951019] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-21T18:43:01.701193] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T18:43:01.722805] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T18:43:01.751006] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-21T18:43:02.551046] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-21T18:43:02.760144] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:43:03.351038] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-21T18:43:03.657326] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T18:43:04.151031] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-21T18:43:04.393637] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T18:43:04.951048] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-21T18:43:05.751038] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-21T18:43:05.807550] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T18:43:05.813688] [INFO ] [REMOTE ] FBRT: Full fetch complete (49231 records). [2025-10-21T18:43:05.813827] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-21T18:43:05.814485] [FATAL] [VALIDATOR ] FBRT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:43:05.814611] [FATAL] [MAIN ] FBRT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:43:05.814722] [WARN ] [MAIN ] FBRT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:43:05.814810] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-21T18:43:05.814994] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-10-21T18:43:05.815412] [INFO ] [LOCAL ] FBRT: Starting deletion of derivative data. [2025-10-21T18:43:05.815471] [DEBUG] [LOCAL ] FBRT: No derivative data file found to delete. [2025-10-21T18:43:05.815533] [INFO ] [MAIN ] Update Progress: 806/2366 symbols completed. FBRT took 36.3s. Estimated remaining: 3h 19m 25s. Rate: 7.8 symbols/min [2025-10-21T18:43:05.993813] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:06.011010] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T18:43:06.049855] [DEBUG] [LOCAL ] FCPT: Loaded 37210 existing records from primary storage. [2025-10-21T18:43:06.050126] [INFO ] [MAIN ] FCPT: Loaded 37210 existing records. [2025-10-21T18:43:06.232265] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:06.232471] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-21T18:43:06.232518] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-21T18:43:06.233024] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-21T18:43:06.233082] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-21T18:43:06.556116] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-21T18:43:06.594752] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:07.237893] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T18:43:07.244402] [INFO ] [REMOTE ] FCF: Full fetch complete (58208 records). [2025-10-21T18:43:07.244547] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-21T18:43:07.356145] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-21T18:43:07.629634] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-21T18:43:07.629743] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-21T18:43:07.630536] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-21T18:43:07.630577] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-21T18:43:07.631681] [DEBUG] [LOCAL ] FCF: Trimmed 58208 records to 39218 (keeping 200 days of data) [2025-10-21T18:43:07.863044] [DEBUG] [LOCAL ] FCF: Primary data saved (39218 records). [2025-10-21T18:43:07.863183] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-21T18:43:07.863254] [INFO ] [MAIN ] Update Progress: 807/2366 symbols completed. FCF took 23.7s. Estimated remaining: 3h 19m 6s. Rate: 7.8 symbols/min [2025-10-21T18:43:08.042469] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:08.042766] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-21T18:43:08.042822] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-21T18:43:08.043046] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-21T18:43:08.049950] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-21T18:43:08.061142] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-21T18:43:08.061247] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-21T18:43:08.122812] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T18:43:08.156129] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-21T18:43:08.454884] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:08.837508] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T18:43:08.950995] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-21T18:43:09.315096] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T18:43:09.317689] [INFO ] [REMOTE ] FC: Full fetch complete (21884 records). [2025-10-21T18:43:09.317767] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-21T18:43:09.675915] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-21T18:43:09.675999] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-21T18:43:09.676451] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-21T18:43:09.676490] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-21T18:43:09.677191] [DEBUG] [LOCAL ] FC: Trimmed 21884 records to 14475 (keeping 200 days of data) [2025-10-21T18:43:09.751053] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-21T18:43:09.759069] [DEBUG] [LOCAL ] FC: Primary data saved (14475 records). [2025-10-21T18:43:09.759227] [INFO ] [MAIN ] FC: Full history saved. [2025-10-21T18:43:09.759495] [INFO ] [MAIN ] Update Progress: 808/2366 symbols completed. FC took 33.5s. Estimated remaining: 3h 18m 47s. Rate: 7.8 symbols/min [2025-10-21T18:43:09.926671] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:09.941284] [DEBUG] [LOCAL ] FCT: Loaded 14667 existing records from primary storage. [2025-10-21T18:43:09.941463] [INFO ] [MAIN ] FCT: Loaded 14667 existing records. [2025-10-21T18:43:10.120214] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:10.120392] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-21T18:43:10.120436] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-21T18:43:10.120692] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-21T18:43:10.120748] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-21T18:43:10.497466] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:10.492577] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T18:43:10.551009] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-21T18:43:11.219157] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T18:43:11.351065] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-21T18:43:11.947765] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T18:43:12.151009] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-21T18:43:12.630045] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T18:43:12.951051] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-21T18:43:13.168419] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:43:13.751063] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-21T18:43:13.849980] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T18:43:14.551039] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-21T18:43:15.057931] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-21T18:43:15.279570] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T18:43:15.351050] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-21T18:43:16.151028] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-21T18:43:16.492395] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-21T18:43:16.529927] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T18:43:16.951066] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-21T18:43:17.751078] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-21T18:43:18.419181] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T18:43:18.551000] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-21T18:43:18.854390] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T18:43:19.351082] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-21T18:43:20.102983] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T18:43:20.138369] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T18:43:20.150978] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-21T18:43:20.951000] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-21T18:43:21.173372] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T18:43:21.270479] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-21T18:43:21.751020] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-21T18:43:22.039842] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-21T18:43:22.551029] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-21T18:43:23.351041] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-21T18:43:23.940046] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T18:43:24.151002] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-21T18:43:24.462319] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T18:43:24.951013] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-21T18:43:25.486861] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:43:25.751013] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-21T18:43:25.771877] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T18:43:26.551030] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-21T18:43:26.971834] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-21T18:43:27.269209] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:43:27.350994] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-21T18:43:27.775945] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-21T18:43:28.151018] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-21T18:43:28.950995] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-21T18:43:29.176439] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T18:43:29.751076] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-21T18:43:30.421372] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T18:43:30.427493] [INFO ] [REMOTE ] FCPT: Full fetch complete (53805 records). [2025-10-21T18:43:30.427602] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-21T18:43:30.556083] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-21T18:43:30.749309] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T18:43:30.799474] [INFO ] [REMOTE ] FCT: Full fetch complete (21160 records). [2025-10-21T18:43:30.800869] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-21T18:43:30.897576] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-21T18:43:30.903347] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-21T18:43:30.909909] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-21T18:43:30.915100] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-21T18:43:30.963881] [DEBUG] [LOCAL ] FCPT: Trimmed 53805 records to 37077 (keeping 200 days of data) [2025-10-21T18:43:31.120830] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T18:43:31.348015] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-21T18:43:31.350309] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-21T18:43:31.357103] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-21T18:43:31.356356] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-21T18:43:31.357336] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-21T18:43:31.431841] [DEBUG] [LOCAL ] FCT: Trimmed 21160 records to 14677 (keeping 200 days of data) [2025-10-21T18:43:31.540966] [DEBUG] [LOCAL ] FCPT: Primary data saved (37077 records). [2025-10-21T18:43:31.549351] [DEBUG] [LOCAL ] FCT: Primary data saved (14677 records). [2025-10-21T18:43:31.549432] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-21T18:43:31.549595] [INFO ] [MAIN ] Update Progress: 809/2366 symbols completed. FCPT took 25.7s. Estimated remaining: 3h 19m 7s. Rate: 7.8 symbols/min [2025-10-21T18:43:31.549713] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-21T18:43:31.581520] [INFO ] [MAIN ] Update Progress: 810/2366 symbols completed. FCT took 21.8s. Estimated remaining: 3h 18m 45s. Rate: 7.8 symbols/min [2025-10-21T18:43:31.793569] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T18:43:31.881661] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:31.898528] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:31.929491] [DEBUG] [LOCAL ] FDP: Loaded 29728 existing records from primary storage. [2025-10-21T18:43:31.929787] [INFO ] [MAIN ] FDP: Loaded 29728 existing records. [2025-10-21T18:43:32.119733] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-21T18:43:32.140579] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:32.140824] [INFO ] [MAIN ] FCX: Loaded 53701 existing records. [2025-10-21T18:43:32.161034] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-21T18:43:32.161168] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-21T18:43:32.170116] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-21T18:43:32.183709] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-21T18:43:32.205595] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-21T18:43:32.486259] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:32.502819] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-21T18:43:32.513125] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-21T18:43:32.530913] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-21T18:43:32.541289] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-21T18:43:32.745485] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:43:32.905753] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:32.960928] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-21T18:43:33.085897] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:33.751020] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-21T18:43:34.292934] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T18:43:34.551029] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-21T18:43:35.142204] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T18:43:35.212718] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T18:43:35.213358] [INFO ] [REMOTE ] FCRX: Full fetch complete (1643 records). [2025-10-21T18:43:35.213423] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-21T18:43:35.356853] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-21T18:43:35.398281] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-21T18:43:35.398440] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:43:35.398506] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:43:35.398587] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-21T18:43:35.398688] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-21T18:43:35.398742] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-21T18:43:35.398785] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-21T18:43:35.398839] [INFO ] [MAIN ] Update Progress: 811/2366 symbols completed. FCRX took 27.5s. Estimated remaining: 3h 18m 30s. Rate: 7.8 symbols/min [2025-10-21T18:43:35.566306] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:35.593898] [DEBUG] [LOCAL ] FDS: Loaded 27869 existing records from primary storage. [2025-10-21T18:43:35.594147] [INFO ] [MAIN ] FDS: Loaded 27869 existing records. [2025-10-21T18:43:35.774690] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:35.774904] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-21T18:43:35.774950] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-21T18:43:35.775224] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-21T18:43:35.775287] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-21T18:43:36.135575] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:36.150975] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-21T18:43:36.951068] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-21T18:43:37.706878] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:43:37.750983] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-21T18:43:37.873374] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-21T18:43:38.056549] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T18:43:38.551020] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-21T18:43:38.904028] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T18:43:39.350988] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-21T18:43:39.635778] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T18:43:40.150990] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-21T18:43:40.443037] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T18:43:40.951012] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-21T18:43:41.035958] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:43:41.040128] [INFO ] [REMOTE ] FCN: Full fetch complete (36109 records). [2025-10-21T18:43:41.040205] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-21T18:43:41.417090] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-21T18:43:41.417168] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-21T18:43:41.417785] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-21T18:43:41.417847] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-21T18:43:41.418676] [DEBUG] [LOCAL ] FCN: Trimmed 36109 records to 25874 (keeping 200 days of data) [2025-10-21T18:43:41.566144] [DEBUG] [LOCAL ] FCN: Primary data saved (25874 records). [2025-10-21T18:43:41.566259] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-21T18:43:41.566333] [INFO ] [MAIN ] Update Progress: 812/2366 symbols completed. FCN took 46.2s. Estimated remaining: 3h 18m 19s. Rate: 7.8 symbols/min [2025-10-21T18:43:41.733274] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:43:41.761318] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-21T18:43:41.783149] [DEBUG] [LOCAL ] FDX: Loaded 51326 existing records from primary storage. [2025-10-21T18:43:41.783442] [INFO ] [MAIN ] FDX: Loaded 51326 existing records. [2025-10-21T18:43:41.961813] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:43:41.962001] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-21T18:43:41.962048] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-21T18:43:41.962546] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-21T18:43:41.962587] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-21T18:43:42.350509] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:43:42.349675] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:43:42.551035] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-21T18:43:43.351046] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-21T18:43:44.151002] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-21T18:43:44.302056] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-21T18:43:44.679347] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T18:43:44.879692] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-21T18:43:44.951126] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-21T18:43:45.391438] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:43:45.751083] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-21T18:43:46.551090] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-21T18:43:46.617214] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:43:47.070431] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T18:43:47.351050] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-21T18:43:47.584547] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T18:43:48.151023] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-21T18:43:48.951037] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-21T18:43:49.362790] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T18:43:49.367951] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T18:43:49.751069] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-21T18:43:49.804384] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T18:43:50.551005] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-21T18:43:51.351000] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-21T18:43:51.649504] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T18:43:52.151031] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-21T18:43:52.780633] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T18:43:52.950983] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-21T18:43:53.015434] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-21T18:43:53.250686] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T18:43:53.751048] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-21T18:43:54.421232] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T18:43:54.551038] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-21T18:43:55.350995] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-21T18:43:55.700019] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T18:43:55.744783] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T18:43:56.151070] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-21T18:43:56.951019] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-21T18:43:57.130513] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T18:43:57.570552] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T18:43:57.751039] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-21T18:43:58.550995] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-21T18:43:58.853292] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:43:59.351077] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-21T18:43:59.852360] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-21T18:43:59.919249] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T18:44:00.151067] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-21T18:44:00.951022] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-21T18:44:01.764670] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-21T18:44:01.790237] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-21T18:44:02.320915] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T18:44:02.550999] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-21T18:44:02.869579] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T18:44:03.119400] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T18:44:03.123901] [INFO ] [REMOTE ] FDP: Full fetch complete (42841 records). [2025-10-21T18:44:03.123980] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-21T18:44:03.356260] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-21T18:44:03.498228] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-21T18:44:03.498302] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-21T18:44:03.499005] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-21T18:44:03.499068] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-21T18:44:03.499972] [DEBUG] [LOCAL ] FDP: Trimmed 42841 records to 29749 (keeping 200 days of data) [2025-10-21T18:44:03.674619] [DEBUG] [LOCAL ] FDP: Primary data saved (29749 records). [2025-10-21T18:44:03.674787] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-21T18:44:03.675248] [INFO ] [MAIN ] Update Progress: 813/2366 symbols completed. FDP took 32.1s. Estimated remaining: 3h 18m 39s. Rate: 7.8 symbols/min [2025-10-21T18:44:03.840712] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:03.894536] [DEBUG] [LOCAL ] FE: Loaded 53436 existing records from primary storage. [2025-10-21T18:44:03.894943] [INFO ] [MAIN ] FE: Loaded 53436 existing records. [2025-10-21T18:44:04.079092] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:04.079383] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-21T18:44:04.079547] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-21T18:44:04.080146] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-21T18:44:04.080215] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-21T18:44:04.156211] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-21T18:44:04.457621] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T18:44:04.488560] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:04.951054] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-21T18:44:05.114143] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T18:44:05.120443] [INFO ] [REMOTE ] FDS: Full fetch complete (39230 records). [2025-10-21T18:44:05.120567] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-21T18:44:05.492998] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-21T18:44:05.493076] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-21T18:44:05.493705] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-21T18:44:05.493764] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-21T18:44:05.494597] [DEBUG] [LOCAL ] FDS: Trimmed 39230 records to 28015 (keeping 200 days of data) [2025-10-21T18:44:05.668193] [DEBUG] [LOCAL ] FDS: Primary data saved (28015 records). [2025-10-21T18:44:05.668321] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-21T18:44:05.668398] [INFO ] [MAIN ] Update Progress: 814/2366 symbols completed. FDS took 30.3s. Estimated remaining: 3h 18m 20s. Rate: 7.8 symbols/min [2025-10-21T18:44:05.763638] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-21T18:44:05.844862] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:05.845030] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-21T18:44:05.845073] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-21T18:44:05.845175] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-21T18:44:05.845216] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-21T18:44:05.845256] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-21T18:44:05.845286] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-21T18:44:06.197289] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:06.550998] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-21T18:44:06.659469] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:44:06.706231] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-21T18:44:07.012695] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-21T18:44:07.350990] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-21T18:44:07.908756] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T18:44:07.911559] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T18:44:08.151016] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-21T18:44:08.951047] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-21T18:44:09.751062] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-21T18:44:10.239511] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T18:44:10.551060] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-21T18:44:10.892434] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:44:10.900159] [INFO ] [REMOTE ] FDX: Full fetch complete (74287 records). [2025-10-21T18:44:10.900287] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-21T18:44:11.287372] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-21T18:44:11.287530] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-21T18:44:11.288461] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-21T18:44:11.288538] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-21T18:44:11.289967] [DEBUG] [LOCAL ] FDX: Trimmed 74287 records to 51271 (keeping 200 days of data) [2025-10-21T18:44:11.355430] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-21T18:44:11.573336] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T18:44:11.650194] [DEBUG] [LOCAL ] FDX: Primary data saved (51271 records). [2025-10-21T18:44:11.650289] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-21T18:44:11.650821] [INFO ] [MAIN ] Update Progress: 815/2366 symbols completed. FDX took 30.1s. Estimated remaining: 3h 18m 10s. Rate: 7.8 symbols/min [2025-10-21T18:44:11.740754] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-21T18:44:11.825705] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:11.872755] [DEBUG] [LOCAL ] FERG: Loaded 48769 existing records from primary storage. [2025-10-21T18:44:11.873025] [INFO ] [MAIN ] FERG: Loaded 48769 existing records. [2025-10-21T18:44:12.052622] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:12.052873] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-21T18:44:12.052929] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-21T18:44:12.053124] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-21T18:44:12.053181] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-21T18:44:12.156319] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-21T18:44:12.422981] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:12.556847] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T18:44:12.639488] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T18:44:12.950995] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-21T18:44:13.751022] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-21T18:44:14.551064] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-21T18:44:14.617059] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T18:44:14.626570] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-21T18:44:14.626755] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-21T18:44:15.058687] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-21T18:44:15.060541] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-21T18:44:15.058906] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-21T18:44:15.071471] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-21T18:44:15.073101] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-21T18:44:15.073223] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-21T18:44:15.074755] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53701 (keeping 200 days of data) [2025-10-21T18:44:15.354667] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-21T18:44:15.405498] [DEBUG] [LOCAL ] FCX: Primary data saved (53701 records). [2025-10-21T18:44:15.405667] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-21T18:44:15.405768] [INFO ] [MAIN ] Update Progress: 816/2366 symbols completed. FCX took 43.9s. Estimated remaining: 3h 17m 55s. Rate: 7.8 symbols/min [2025-10-21T18:44:15.572274] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:15.586974] [DEBUG] [LOCAL ] FET: Loaded 12965 existing records from primary storage. [2025-10-21T18:44:15.587198] [INFO ] [MAIN ] FET: Loaded 12965 existing records. [2025-10-21T18:44:15.688749] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-21T18:44:15.765098] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:15.765328] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-21T18:44:15.765374] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-21T18:44:15.765521] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-21T18:44:15.765558] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-21T18:44:16.111847] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:16.150980] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-21T18:44:16.951018] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-21T18:44:17.123470] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T18:44:17.751021] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-21T18:44:18.520670] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:44:18.550986] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-21T18:44:18.897744] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T18:44:19.351004] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-21T18:44:19.464501] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T18:44:20.151054] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-21T18:44:20.951004] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-21T18:44:21.150300] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T18:44:21.171610] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T18:44:21.417512] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T18:44:21.751026] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-21T18:44:22.551021] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-21T18:44:22.910227] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-21T18:44:23.299626] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T18:44:23.350973] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-21T18:44:24.151021] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-21T18:44:24.535369] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-21T18:44:24.951077] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-21T18:44:25.162085] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T18:44:25.751047] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-21T18:44:26.455997] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T18:44:26.487990] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T18:44:26.550991] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-21T18:44:27.351023] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-21T18:44:28.156207] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-21T18:44:28.176770] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:44:28.270571] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T18:44:28.951069] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-21T18:44:29.407731] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T18:44:29.408618] [INFO ] [REMOTE ] FENG: Full fetch complete (2282 records). [2025-10-21T18:44:29.408716] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-21T18:44:29.596134] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T18:44:29.596317] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:44:29.596384] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:44:29.596432] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-21T18:44:29.596486] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-21T18:44:29.596521] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-21T18:44:29.596559] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-21T18:44:29.596613] [INFO ] [MAIN ] Update Progress: 817/2366 symbols completed. FENG took 23.9s. Estimated remaining: 3h 17m 59s. Rate: 7.8 symbols/min [2025-10-21T18:44:29.750991] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-21T18:44:29.770891] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:29.793160] [DEBUG] [LOCAL ] FF: Loaded 24052 existing records from primary storage. [2025-10-21T18:44:29.793399] [INFO ] [MAIN ] FF: Loaded 24052 existing records. [2025-10-21T18:44:29.991325] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:29.991617] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-21T18:44:29.991780] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-21T18:44:29.992003] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-21T18:44:29.992060] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-21T18:44:30.373598] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:30.375684] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T18:44:30.551007] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-21T18:44:30.716274] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T18:44:31.351034] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-21T18:44:31.754560] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T18:44:32.151044] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-21T18:44:32.951034] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-21T18:44:32.991777] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T18:44:33.333048] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T18:44:33.751085] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-21T18:44:33.897095] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T18:44:34.551074] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-21T18:44:35.108022] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T18:44:35.351028] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-21T18:44:36.151022] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-21T18:44:36.593380] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-21T18:44:36.669557] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T18:44:36.951029] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-21T18:44:37.751203] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-21T18:44:37.812208] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T18:44:37.958062] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:44:38.551077] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-21T18:44:39.351037] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-21T18:44:39.567997] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T18:44:40.150992] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-21T18:44:40.334731] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T18:44:40.368709] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:44:40.371260] [INFO ] [REMOTE ] FET: Full fetch complete (18419 records). [2025-10-21T18:44:40.371328] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-21T18:44:40.726282] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-21T18:44:40.726356] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-21T18:44:40.726718] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-21T18:44:40.726780] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-21T18:44:40.727284] [DEBUG] [LOCAL ] FET: Trimmed 18419 records to 12922 (keeping 200 days of data) [2025-10-21T18:44:40.800296] [DEBUG] [LOCAL ] FET: Primary data saved (12922 records). [2025-10-21T18:44:40.800416] [INFO ] [MAIN ] FET: Full history saved. [2025-10-21T18:44:40.800490] [INFO ] [MAIN ] Update Progress: 818/2366 symbols completed. FET took 25.4s. Estimated remaining: 3h 17m 58s. Rate: 7.8 symbols/min [2025-10-21T18:44:40.957098] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-21T18:44:40.967948] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:40.968109] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-10-21T18:44:40.968153] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-10-21T18:44:40.968255] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-21T18:44:40.968297] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-21T18:44:40.968394] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-10-21T18:44:40.968433] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-21T18:44:41.316524] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:41.751006] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-21T18:44:42.134012] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T18:44:42.223621] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T18:44:42.551095] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-21T18:44:43.029089] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T18:44:43.351121] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-21T18:44:43.434557] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:44:43.443188] [INFO ] [REMOTE ] FE: Full fetch complete (77477 records). [2025-10-21T18:44:43.443342] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-21T18:44:43.861850] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-21T18:44:43.861941] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-21T18:44:43.862898] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-21T18:44:43.862974] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-21T18:44:43.864454] [DEBUG] [LOCAL ] FE: Trimmed 77477 records to 53434 (keeping 200 days of data) [2025-10-21T18:44:44.162169] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-21T18:44:44.187086] [DEBUG] [LOCAL ] FE: Primary data saved (53434 records). [2025-10-21T18:44:44.187192] [INFO ] [MAIN ] FE: Full history saved. [2025-10-21T18:44:44.187728] [INFO ] [MAIN ] Update Progress: 819/2366 symbols completed. FE took 40.5s. Estimated remaining: 3h 17m 42s. Rate: 7.8 symbols/min [2025-10-21T18:44:44.368531] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:44.386855] [DEBUG] [LOCAL ] FFC: Loaded 16622 existing records from primary storage. [2025-10-21T18:44:44.387084] [INFO ] [MAIN ] FFC: Loaded 16622 existing records. [2025-10-21T18:44:44.569921] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:44.570135] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-21T18:44:44.570183] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-21T18:44:44.570332] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-21T18:44:44.570370] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-21T18:44:44.949436] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:44.950978] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-21T18:44:45.189058] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:44:45.321741] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T18:44:45.751060] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-21T18:44:46.390223] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T18:44:46.551026] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-21T18:44:46.857702] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T18:44:47.351092] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-21T18:44:47.931984] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:44:48.151007] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-21T18:44:48.535186] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T18:44:48.542770] [INFO ] [REMOTE ] FERG: Full fetch complete (71205 records). [2025-10-21T18:44:48.542876] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-21T18:44:48.943790] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-21T18:44:48.950940] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-21T18:44:48.952149] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T18:44:48.953188] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-21T18:44:48.951041] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-21T18:44:48.955079] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-21T18:44:48.960907] [DEBUG] [LOCAL ] FERG: Trimmed 71205 records to 48749 (keeping 200 days of data) [2025-10-21T18:44:49.259937] [DEBUG] [LOCAL ] FERG: Primary data saved (48749 records). [2025-10-21T18:44:49.260072] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-21T18:44:49.260841] [INFO ] [MAIN ] Update Progress: 820/2366 symbols completed. FERG took 37.6s. Estimated remaining: 3h 17m 30s. Rate: 7.8 symbols/min [2025-10-21T18:44:49.430252] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:49.464892] [DEBUG] [LOCAL ] FFWM: Loaded 35833 existing records from primary storage. [2025-10-21T18:44:49.465148] [INFO ] [MAIN ] FFWM: Loaded 35833 existing records. [2025-10-21T18:44:49.692246] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:49.692990] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-21T18:44:49.693310] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T18:44:49.695684] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-21T18:44:49.695968] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-21T18:44:49.696040] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-21T18:44:49.760865] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-21T18:44:50.049967] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:44:50.551009] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-21T18:44:50.977587] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T18:44:51.351053] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-21T18:44:51.563514] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T18:44:52.151034] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-21T18:44:52.735446] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:44:52.800243] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T18:44:52.951046] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-21T18:44:53.751004] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-21T18:44:54.140995] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:44:54.514255] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T18:44:54.551038] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-21T18:44:55.060623] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-21T18:44:55.351059] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-21T18:44:55.925776] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T18:44:56.151094] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-21T18:44:56.763738] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T18:44:56.950997] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-21T18:44:57.751026] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-21T18:44:58.306555] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T18:44:58.551000] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-21T18:44:58.933514] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T18:44:58.938879] [INFO ] [REMOTE ] FF: Full fetch complete (36594 records). [2025-10-21T18:44:58.938988] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-21T18:44:59.321083] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-21T18:44:59.321159] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-21T18:44:59.321754] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-21T18:44:59.321814] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-21T18:44:59.322676] [DEBUG] [LOCAL ] FF: Trimmed 36594 records to 23879 (keeping 200 days of data) [2025-10-21T18:44:59.369590] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-21T18:44:59.458480] [DEBUG] [LOCAL ] FF: Primary data saved (23879 records). [2025-10-21T18:44:59.458596] [INFO ] [MAIN ] FF: Full history saved. [2025-10-21T18:44:59.458691] [INFO ] [MAIN ] Update Progress: 821/2366 symbols completed. FF took 29.9s. Estimated remaining: 3h 17m 27s. Rate: 7.8 symbols/min [2025-10-21T18:44:59.625233] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:44:59.646001] [DEBUG] [LOCAL ] FG: Loaded 21737 existing records from primary storage. [2025-10-21T18:44:59.646239] [INFO ] [MAIN ] FG: Loaded 21737 existing records. [2025-10-21T18:44:59.773187] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T18:44:59.837758] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:44:59.837968] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-21T18:44:59.838019] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-21T18:44:59.838199] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-21T18:44:59.838238] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-21T18:45:00.156127] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-21T18:45:00.197371] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:00.921357] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T18:45:00.951050] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-21T18:45:01.179808] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:45:01.751104] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-21T18:45:02.241878] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T18:45:02.551034] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-21T18:45:03.351032] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-21T18:45:03.747806] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T18:45:03.841953] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T18:45:04.151039] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-21T18:45:04.951102] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-21T18:45:05.102077] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:45:05.551541] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T18:45:05.750983] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-21T18:45:06.033739] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:45:06.556008] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-21T18:45:06.558693] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T18:45:07.354467] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-21T18:45:07.355226] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:45:07.357989] [INFO ] [REMOTE ] FFA: Full fetch complete (8625 records). [2025-10-21T18:45:07.358066] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-21T18:45:07.358430] [FATAL] [VALIDATOR ] FFA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:45:07.358533] [FATAL] [MAIN ] FFA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:45:07.358576] [WARN ] [MAIN ] FFA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:45:07.358621] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-21T18:45:07.358709] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-10-21T18:45:07.358757] [INFO ] [LOCAL ] FFA: Starting deletion of derivative data. [2025-10-21T18:45:07.358799] [DEBUG] [LOCAL ] FFA: No derivative data file found to delete. [2025-10-21T18:45:07.358850] [INFO ] [MAIN ] Update Progress: 822/2366 symbols completed. FFA took 26.6s. Estimated remaining: 3h 17m 20s. Rate: 7.8 symbols/min [2025-10-21T18:45:07.529264] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:07.535082] [DEBUG] [LOCAL ] FGN: Loaded 3636 existing records from primary storage. [2025-10-21T18:45:07.535260] [INFO ] [MAIN ] FGN: Loaded 3636 existing records. [2025-10-21T18:45:07.716552] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:07.716895] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-21T18:45:07.716952] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-21T18:45:07.717204] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-21T18:45:07.717261] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-21T18:45:08.061997] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:08.150986] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-21T18:45:08.443694] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T18:45:08.937851] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T18:45:08.950981] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-21T18:45:09.438925] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T18:45:09.751056] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-21T18:45:10.551024] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-21T18:45:11.238485] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T18:45:11.351075] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-21T18:45:11.786966] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:45:12.150989] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-21T18:45:12.628696] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T18:45:12.806458] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T18:45:12.951029] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-21T18:45:13.390105] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T18:45:13.751074] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-21T18:45:14.551028] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-21T18:45:15.289807] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:45:15.350988] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-21T18:45:16.151003] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-21T18:45:16.277458] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:45:16.462966] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-21T18:45:16.692881] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T18:45:16.951063] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-21T18:45:17.751051] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-21T18:45:17.970041] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T18:45:18.551036] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-21T18:45:18.787140] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T18:45:19.293219] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T18:45:19.351039] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-21T18:45:20.151004] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-21T18:45:20.464935] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T18:45:20.951059] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-21T18:45:21.478992] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T18:45:21.751030] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-21T18:45:22.008992] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T18:45:22.011934] [INFO ] [REMOTE ] FFC: Full fetch complete (24454 records). [2025-10-21T18:45:22.012099] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-21T18:45:22.398760] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-21T18:45:22.399069] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-21T18:45:22.399021] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T18:45:22.399836] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-21T18:45:22.401850] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-21T18:45:22.402963] [DEBUG] [LOCAL ] FFC: Trimmed 24454 records to 16617 (keeping 200 days of data) [2025-10-21T18:45:22.500783] [DEBUG] [LOCAL ] FFC: Primary data saved (16617 records). [2025-10-21T18:45:22.500912] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-21T18:45:22.500987] [INFO ] [MAIN ] Update Progress: 823/2366 symbols completed. FFC took 38.3s. Estimated remaining: 3h 17m 26s. Rate: 7.8 symbols/min [2025-10-21T18:45:22.556370] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-21T18:45:22.670555] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:22.670736] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-21T18:45:22.670780] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-21T18:45:22.670919] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-21T18:45:22.670959] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-21T18:45:22.671015] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-21T18:45:22.671047] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-21T18:45:23.018712] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:23.351058] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-21T18:45:23.651994] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T18:45:24.150999] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-21T18:45:24.648604] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T18:45:24.951018] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-21T18:45:24.975028] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T18:45:24.978568] [INFO ] [REMOTE ] FG: Full fetch complete (28917 records). [2025-10-21T18:45:24.978678] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-21T18:45:25.349237] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-21T18:45:25.349310] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-21T18:45:25.349860] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-21T18:45:25.349921] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-21T18:45:25.350561] [DEBUG] [LOCAL ] FG: Trimmed 28917 records to 21549 (keeping 200 days of data) [2025-10-21T18:45:25.481681] [DEBUG] [LOCAL ] FG: Primary data saved (21549 records). [2025-10-21T18:45:25.481803] [INFO ] [MAIN ] FG: Full history saved. [2025-10-21T18:45:25.481875] [INFO ] [MAIN ] Update Progress: 824/2366 symbols completed. FG took 26.0s. Estimated remaining: 3h 17m 10s. Rate: 7.8 symbols/min [2025-10-21T18:45:25.567488] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T18:45:25.659524] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:25.697196] [DEBUG] [LOCAL ] FHI: Loaded 39793 existing records from primary storage. [2025-10-21T18:45:25.697476] [INFO ] [MAIN ] FHI: Loaded 39793 existing records. [2025-10-21T18:45:25.758785] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-21T18:45:25.880052] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:25.880276] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-21T18:45:25.880323] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-21T18:45:25.880602] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-21T18:45:25.880701] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-21T18:45:26.240521] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:26.551062] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-21T18:45:27.244072] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T18:45:27.249505] [INFO ] [REMOTE ] FFWM: Full fetch complete (51684 records). [2025-10-21T18:45:27.249634] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-21T18:45:27.250258] [FATAL] [VALIDATOR ] FFWM: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T18:45:27.250347] [FATAL] [MAIN ] FFWM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:45:27.250391] [WARN ] [MAIN ] FFWM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:45:27.250453] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-21T18:45:27.250514] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-10-21T18:45:27.250610] [INFO ] [LOCAL ] FFWM: Starting deletion of derivative data. [2025-10-21T18:45:27.250830] [DEBUG] [LOCAL ] FFWM: Deleted derivative data file. [2025-10-21T18:45:27.251279] [INFO ] [MAIN ] Update Progress: 825/2366 symbols completed. FFWM took 38.0s. Estimated remaining: 3h 16m 51s. Rate: 7.8 symbols/min [2025-10-21T18:45:27.353148] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-21T18:45:27.405448] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T18:45:27.462418] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:27.513158] [DEBUG] [LOCAL ] FHN: Loaded 53394 existing records from primary storage. [2025-10-21T18:45:27.513453] [INFO ] [MAIN ] FHN: Loaded 53394 existing records. [2025-10-21T18:45:27.688796] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:27.688973] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-21T18:45:27.689019] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-21T18:45:27.689489] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-21T18:45:27.689544] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-21T18:45:28.028984] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T18:45:28.051304] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:28.151006] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-21T18:45:28.951021] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-21T18:45:29.598120] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T18:45:29.751029] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-21T18:45:30.037472] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T18:45:30.298448] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T18:45:30.551034] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-21T18:45:31.054023] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-21T18:45:31.054983] [INFO ] [REMOTE ] FGN: Full fetch complete (5539 records). [2025-10-21T18:45:31.055053] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-21T18:45:31.356305] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-21T18:45:31.451690] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-21T18:45:31.451775] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-21T18:45:31.451925] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-21T18:45:31.451962] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-21T18:45:31.452311] [DEBUG] [LOCAL ] FGN: Trimmed 5539 records to 3610 (keeping 200 days of data) [2025-10-21T18:45:31.473583] [DEBUG] [LOCAL ] FGN: Primary data saved (3610 records). [2025-10-21T18:45:31.473663] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-21T18:45:31.473749] [INFO ] [MAIN ] Update Progress: 826/2366 symbols completed. FGN took 24.1s. Estimated remaining: 3h 16m 37s. Rate: 7.8 symbols/min [2025-10-21T18:45:31.640115] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:31.695168] [DEBUG] [LOCAL ] FI: Loaded 53585 existing records from primary storage. [2025-10-21T18:45:31.695702] [INFO ] [MAIN ] FI: Loaded 53585 existing records. [2025-10-21T18:45:31.880256] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:31.880453] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-21T18:45:31.880520] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-21T18:45:31.881162] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-21T18:45:31.881218] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-21T18:45:31.991237] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T18:45:32.157972] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-21T18:45:32.248669] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:32.895900] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T18:45:32.951022] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-21T18:45:33.751028] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-21T18:45:34.551105] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-21T18:45:34.828989] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T18:45:35.184778] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T18:45:35.351067] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-21T18:45:36.151043] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-21T18:45:36.365408] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:45:36.912195] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:45:36.950990] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-21T18:45:37.755287] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-21T18:45:37.761001] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T18:45:38.384993] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T18:45:38.422139] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T18:45:38.551007] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-21T18:45:39.351001] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-21T18:45:39.980360] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T18:45:40.151029] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-21T18:45:40.355343] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T18:45:40.951050] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-21T18:45:41.313297] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-21T18:45:41.559070] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T18:45:41.751038] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-21T18:45:42.097985] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-21T18:45:42.551022] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-21T18:45:43.351025] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-21T18:45:43.931097] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:45:43.956069] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T18:45:44.151074] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-21T18:45:44.944336] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T18:45:44.945551] [INFO ] [REMOTE ] FGSN: Full fetch complete (8057 records). [2025-10-21T18:45:44.945688] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-21T18:45:44.957012] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-21T18:45:45.128147] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-21T18:45:45.128402] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:45:45.128469] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:45:45.128540] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-21T18:45:45.128601] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-21T18:45:45.128636] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-21T18:45:45.128734] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-21T18:45:45.128796] [INFO ] [MAIN ] Update Progress: 827/2366 symbols completed. FGSN took 22.6s. Estimated remaining: 3h 16m 40s. Rate: 7.8 symbols/min [2025-10-21T18:45:45.297167] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:45.325371] [DEBUG] [LOCAL ] FICO: Loaded 21862 existing records from primary storage. [2025-10-21T18:45:45.325632] [INFO ] [MAIN ] FICO: Loaded 21862 existing records. [2025-10-21T18:45:45.506997] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:45:45.507212] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-21T18:45:45.507259] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-21T18:45:45.507417] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-21T18:45:45.507454] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-21T18:45:45.759023] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-21T18:45:45.887913] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:46.551051] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-21T18:45:47.001312] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-21T18:45:47.306361] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:45:47.350988] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-21T18:45:48.151125] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-21T18:45:48.204214] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:45:48.590603] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T18:45:48.951114] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-21T18:45:49.751020] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-21T18:45:50.074131] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T18:45:50.551046] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-21T18:45:50.761550] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T18:45:50.989305] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T18:45:51.350995] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-21T18:45:52.068265] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:45:52.151066] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-21T18:45:52.951032] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-21T18:45:53.029257] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:45:53.587120] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T18:45:53.592829] [INFO ] [REMOTE ] FHI: Full fetch complete (57551 records). [2025-10-21T18:45:53.592929] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-21T18:45:53.764384] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-21T18:45:53.972519] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-21T18:45:53.972609] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-21T18:45:53.973412] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-21T18:45:53.973476] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-21T18:45:53.974737] [DEBUG] [LOCAL ] FHI: Trimmed 57551 records to 39612 (keeping 200 days of data) [2025-10-21T18:45:54.208893] [DEBUG] [LOCAL ] FHI: Primary data saved (39612 records). [2025-10-21T18:45:54.209033] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-21T18:45:54.209112] [INFO ] [MAIN ] Update Progress: 828/2366 symbols completed. FHI took 28.7s. Estimated remaining: 3h 16m 35s. Rate: 7.8 symbols/min [2025-10-21T18:45:54.381437] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:45:54.381616] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-21T18:45:54.381694] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-21T18:45:54.381820] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-21T18:45:54.381883] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-21T18:45:54.381951] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-21T18:45:54.381985] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-21T18:45:54.553956] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-21T18:45:54.749239] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:45:55.150924] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-21T18:45:55.351077] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-21T18:45:55.665825] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:45:55.866474] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T18:45:56.151054] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-21T18:45:56.951018] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-21T18:45:57.375716] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T18:45:57.751002] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-21T18:45:57.888163] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T18:45:57.980275] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T18:45:58.110720] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-21T18:45:58.551023] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-21T18:45:59.351047] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-21T18:45:59.591826] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-21T18:45:59.803838] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T18:46:00.151021] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-21T18:46:00.412483] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-21T18:46:00.951068] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-21T18:46:01.434093] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T18:46:01.751080] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-21T18:46:02.551052] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-21T18:46:02.819559] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-21T18:46:03.030038] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T18:46:03.351028] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-21T18:46:04.151053] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-21T18:46:04.460382] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T18:46:04.951077] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-21T18:46:05.751065] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-21T18:46:05.966888] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:46:05.967345] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-21T18:46:05.967445] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:46:05.967539] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-21T18:46:05.967608] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:46:05.967708] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-21T18:46:05.967783] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-21T18:46:05.967820] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-21T18:46:05.967883] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-21T18:46:05.967959] [INFO ] [MAIN ] Update Progress: 829/2366 symbols completed. FIG took 11.8s. Estimated remaining: 3h 16m 35s. Rate: 7.8 symbols/min [2025-10-21T18:46:06.197005] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:06.201003] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T18:46:06.267561] [DEBUG] [LOCAL ] FIGS: Loaded 48620 existing records from primary storage. [2025-10-21T18:46:06.268211] [INFO ] [MAIN ] FIGS: Loaded 48620 existing records. [2025-10-21T18:46:06.400588] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T18:46:06.493010] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:06.493174] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-21T18:46:06.493223] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-21T18:46:06.493891] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-21T18:46:06.493950] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-21T18:46:06.556188] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-21T18:46:06.840044] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:07.351092] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-21T18:46:08.151102] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-21T18:46:08.695228] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:46:08.770610] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T18:46:08.951031] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-21T18:46:09.744212] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:46:09.753436] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-21T18:46:10.550992] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-21T18:46:10.807571] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:46:11.350994] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-21T18:46:11.667041] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:46:11.758097] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T18:46:12.151082] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-21T18:46:12.951070] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-21T18:46:13.167771] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T18:46:13.176715] [INFO ] [REMOTE ] FHN: Full fetch complete (77476 records). [2025-10-21T18:46:13.176873] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-21T18:46:13.606276] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-21T18:46:13.606397] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-21T18:46:13.607767] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-21T18:46:13.607877] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-21T18:46:13.609767] [DEBUG] [LOCAL ] FHN: Trimmed 77476 records to 53399 (keeping 200 days of data) [2025-10-21T18:46:13.802527] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-21T18:46:13.963517] [DEBUG] [LOCAL ] FHN: Primary data saved (53399 records). [2025-10-21T18:46:13.963801] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-21T18:46:13.963976] [INFO ] [MAIN ] Update Progress: 830/2366 symbols completed. FHN took 46.7s. Estimated remaining: 3h 16m 28s. Rate: 7.8 symbols/min [2025-10-21T18:46:14.138393] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:14.177597] [DEBUG] [LOCAL ] FIHL: Loaded 39199 existing records from primary storage. [2025-10-21T18:46:14.177944] [INFO ] [MAIN ] FIHL: Loaded 39199 existing records. [2025-10-21T18:46:14.349796] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T18:46:14.422116] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:14.422804] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-21T18:46:14.423068] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-21T18:46:14.423923] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-21T18:46:14.424080] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-21T18:46:14.552968] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-21T18:46:14.688342] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:46:14.740140] [INFO ] [REMOTE ] FICO: Full fetch complete (29954 records). [2025-10-21T18:46:14.746250] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-21T18:46:14.955200] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:15.257210] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-21T18:46:15.257306] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-21T18:46:15.257936] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-21T18:46:15.258001] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-21T18:46:15.258919] [DEBUG] [LOCAL ] FICO: Trimmed 29954 records to 21911 (keeping 200 days of data) [2025-10-21T18:46:15.351784] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-21T18:46:15.401334] [DEBUG] [LOCAL ] FICO: Primary data saved (21911 records). [2025-10-21T18:46:15.401505] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-21T18:46:15.401951] [INFO ] [MAIN ] Update Progress: 831/2366 symbols completed. FICO took 30.3s. Estimated remaining: 3h 16m 9s. Rate: 7.8 symbols/min [2025-10-21T18:46:15.597539] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T18:46:15.623806] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:15.666728] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T18:46:15.680376] [INFO ] [REMOTE ] FI: Full fetch complete (77482 records). [2025-10-21T18:46:15.680715] [DEBUG] [LOCAL ] FINS: Loaded 8283 existing records from primary storage. [2025-10-21T18:46:15.681045] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-21T18:46:15.681333] [INFO ] [MAIN ] FINS: Loaded 8283 existing records. [2025-10-21T18:46:16.053229] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:16.075105] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-21T18:46:16.096054] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-21T18:46:16.138218] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-21T18:46:16.151207] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-21T18:46:16.164950] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-21T18:46:16.438866] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-21T18:46:16.444135] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-21T18:46:16.445276] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-21T18:46:16.450504] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-21T18:46:16.531082] [DEBUG] [LOCAL ] FI: Trimmed 77482 records to 53588 (keeping 200 days of data) [2025-10-21T18:46:16.902438] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:16.957367] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-21T18:46:16.964735] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T18:46:17.101066] [DEBUG] [LOCAL ] FI: Primary data saved (53588 records). [2025-10-21T18:46:17.101266] [INFO ] [MAIN ] FI: Full history saved. [2025-10-21T18:46:17.102202] [INFO ] [MAIN ] Update Progress: 832/2366 symbols completed. FI took 45.6s. Estimated remaining: 3h 15m 50s. Rate: 7.8 symbols/min [2025-10-21T18:46:17.287088] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:17.339587] [DEBUG] [LOCAL ] FINV: Loaded 45271 existing records from primary storage. [2025-10-21T18:46:17.340039] [INFO ] [MAIN ] FINV: Loaded 45271 existing records. [2025-10-21T18:46:17.547275] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:17.547584] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-21T18:46:17.547636] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-21T18:46:17.548352] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-21T18:46:17.548412] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-21T18:46:17.762880] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-21T18:46:17.834993] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T18:46:17.994828] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:18.001051] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:46:18.551004] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-21T18:46:18.892183] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T18:46:19.351039] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-21T18:46:19.889424] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T18:46:20.151027] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-21T18:46:20.907443] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:46:20.951006] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-21T18:46:21.665117] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T18:46:21.750987] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-21T18:46:22.515734] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:46:22.551002] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-21T18:46:23.263431] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T18:46:23.287262] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:46:23.351000] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-21T18:46:24.151072] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-21T18:46:24.715500] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T18:46:24.951008] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-21T18:46:25.347355] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T18:46:25.751024] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-21T18:46:26.340315] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:46:26.551035] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-21T18:46:27.307248] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T18:46:27.350977] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-21T18:46:27.897579] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:46:28.151000] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-21T18:46:28.851450] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:46:28.951026] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-21T18:46:29.740677] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T18:46:29.750978] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-21T18:46:30.458897] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T18:46:30.550989] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-21T18:46:31.040999] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T18:46:31.351041] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-21T18:46:31.654705] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T18:46:32.151032] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-21T18:46:32.486194] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T18:46:32.951066] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-21T18:46:33.556801] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T18:46:33.558511] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T18:46:33.751015] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-21T18:46:34.338011] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T18:46:34.551076] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-21T18:46:35.334897] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:46:35.350977] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-21T18:46:36.151013] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-21T18:46:36.203151] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T18:46:36.951024] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-21T18:46:37.681588] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T18:46:37.750989] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-21T18:46:38.551108] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-21T18:46:38.636810] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T18:46:38.972620] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T18:46:39.203469] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:46:39.212097] [INFO ] [REMOTE ] FIHL: Full fetch complete (56319 records). [2025-10-21T18:46:39.212244] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-21T18:46:39.356147] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-21T18:46:39.596947] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-21T18:46:39.597031] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-21T18:46:39.597787] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-21T18:46:39.597850] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-21T18:46:39.599088] [DEBUG] [LOCAL ] FIHL: Trimmed 56319 records to 39140 (keeping 200 days of data) [2025-10-21T18:46:39.836608] [DEBUG] [LOCAL ] FIHL: Primary data saved (39140 records). [2025-10-21T18:46:39.836762] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-21T18:46:39.837328] [INFO ] [MAIN ] Update Progress: 833/2366 symbols completed. FIHL took 25.9s. Estimated remaining: 3h 16m 10s. Rate: 7.8 symbols/min [2025-10-21T18:46:40.009181] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:40.015022] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:46:40.064543] [DEBUG] [LOCAL ] FIS: Loaded 53327 existing records from primary storage. [2025-10-21T18:46:40.064916] [INFO ] [MAIN ] FIS: Loaded 53327 existing records. [2025-10-21T18:46:40.156183] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-21T18:46:40.241141] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:40.241329] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-21T18:46:40.241377] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-21T18:46:40.241926] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-21T18:46:40.241982] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-21T18:46:40.590133] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:40.951103] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-21T18:46:41.751049] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-21T18:46:41.923459] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T18:46:42.551002] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-21T18:46:42.594353] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:46:42.969522] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-21T18:46:43.351024] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-21T18:46:43.541753] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T18:46:44.151049] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-21T18:46:44.849069] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T18:46:44.850560] [INFO ] [REMOTE ] FINS: Full fetch complete (11625 records). [2025-10-21T18:46:44.850627] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-21T18:46:44.953596] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-21T18:46:45.232972] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-21T18:46:45.251240] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-21T18:46:45.252043] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-21T18:46:45.252674] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T18:46:45.252826] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-21T18:46:45.260390] [DEBUG] [LOCAL ] FINS: Trimmed 11625 records to 8297 (keeping 200 days of data) [2025-10-21T18:46:45.260309] [INFO ] [REMOTE ] FIGS: Full fetch complete (70822 records). [2025-10-21T18:46:45.260818] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-21T18:46:45.436727] [DEBUG] [LOCAL ] FINS: Primary data saved (8297 records). [2025-10-21T18:46:45.454611] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-21T18:46:45.467262] [INFO ] [MAIN ] Update Progress: 834/2366 symbols completed. FINS took 30.1s. Estimated remaining: 3h 15m 59s. Rate: 7.8 symbols/min [2025-10-21T18:46:45.754730] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-21T18:46:45.857625] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:45.896877] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-21T18:46:45.897064] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-21T18:46:45.897969] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-21T18:46:45.898050] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-21T18:46:45.899921] [DEBUG] [LOCAL ] FIGS: Trimmed 70822 records to 48559 (keeping 200 days of data) [2025-10-21T18:46:46.128430] [DEBUG] [LOCAL ] FIX: Loaded 28617 existing records from primary storage. [2025-10-21T18:46:46.133079] [INFO ] [MAIN ] FIX: Loaded 28617 existing records. [2025-10-21T18:46:46.375155] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:46.376063] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-21T18:46:46.376376] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-21T18:46:46.377296] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-21T18:46:46.378246] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-21T18:46:46.448151] [DEBUG] [LOCAL ] FIGS: Primary data saved (48559 records). [2025-10-21T18:46:46.471096] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-21T18:46:46.471301] [INFO ] [MAIN ] Update Progress: 835/2366 symbols completed. FIGS took 40.5s. Estimated remaining: 3h 15m 39s. Rate: 7.8 symbols/min [2025-10-21T18:46:46.842131] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:46.848046] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-21T18:46:46.858491] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-21T18:46:46.891969] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-21T18:46:46.898886] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-21T18:46:46.923914] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-21T18:46:46.923999] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-21T18:46:46.923786] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:46.935263] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-21T18:46:47.141493] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-21T18:46:47.334802] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:47.350975] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-21T18:46:47.480323] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T18:46:47.556321] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T18:46:47.556587] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-21T18:46:47.556713] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:46:47.556790] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-21T18:46:47.556871] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:46:47.556963] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-21T18:46:47.557042] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-21T18:46:47.557079] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-21T18:46:47.557118] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-21T18:46:47.557161] [INFO ] [MAIN ] Update Progress: 836/2366 symbols completed. FIXT took 1.1s. Estimated remaining: 3h 15m 19s. Rate: 7.8 symbols/min [2025-10-21T18:46:47.723956] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:46:47.731495] [DEBUG] [LOCAL ] FLC: Loaded 5417 existing records from primary storage. [2025-10-21T18:46:47.731670] [INFO ] [MAIN ] FLC: Loaded 5417 existing records. [2025-10-21T18:46:47.904947] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:46:47.905134] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-21T18:46:47.905189] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-21T18:46:47.905365] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-21T18:46:47.905420] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-21T18:46:48.156140] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-21T18:46:48.262294] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:46:48.569468] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:46:48.951062] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-21T18:46:49.751063] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-21T18:46:49.972881] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T18:46:50.429977] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T18:46:50.550984] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-21T18:46:50.625088] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T18:46:51.351032] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-21T18:46:51.930063] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:46:52.151052] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-21T18:46:52.196986] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T18:46:52.951069] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-21T18:46:53.751012] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-21T18:46:54.092929] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T18:46:54.441173] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-21T18:46:54.551057] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-21T18:46:54.683873] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T18:46:54.691222] [INFO ] [REMOTE ] FINV: Full fetch complete (64870 records). [2025-10-21T18:46:54.691341] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-21T18:46:55.091406] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-21T18:46:55.091484] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-21T18:46:55.092300] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-21T18:46:55.092361] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-21T18:46:55.093574] [DEBUG] [LOCAL ] FINV: Trimmed 64870 records to 45256 (keeping 200 days of data) [2025-10-21T18:46:55.347564] [DEBUG] [LOCAL ] FINV: Primary data saved (45256 records). [2025-10-21T18:46:55.347707] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-21T18:46:55.347793] [INFO ] [MAIN ] Update Progress: 837/2366 symbols completed. FINV took 38.2s. Estimated remaining: 3h 15m 12s. Rate: 7.8 symbols/min [2025-10-21T18:46:55.351041] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-21T18:46:56.150989] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-21T18:46:56.285099] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T18:46:56.925744] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T18:46:56.950993] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-21T18:46:57.001115] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:46:57.551843] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T18:46:57.751002] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-21T18:46:58.551020] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-21T18:46:59.358037] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-21T18:46:59.377619] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:46:59.402555] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T18:47:00.151066] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-21T18:47:00.782898] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T18:47:00.951003] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-21T18:47:01.751106] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-21T18:47:02.091199] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T18:47:02.204821] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:47:02.245091] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T18:47:02.551096] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-21T18:47:03.351089] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-21T18:47:04.078260] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T18:47:04.150983] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-21T18:47:04.429568] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T18:47:04.951066] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-21T18:47:05.176599] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T18:47:05.609906] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-21T18:47:05.751007] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-21T18:47:06.551038] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-21T18:47:07.351061] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-21T18:47:07.555540] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T18:47:07.832218] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T18:47:08.021424] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T18:47:08.022709] [INFO ] [REMOTE ] FLC: Full fetch complete (7779 records). [2025-10-21T18:47:08.022777] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-21T18:47:08.156237] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-21T18:47:08.403342] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-21T18:47:08.403413] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-21T18:47:08.403603] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-21T18:47:08.403659] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-21T18:47:08.404065] [DEBUG] [LOCAL ] FLC: Trimmed 7779 records to 5426 (keeping 200 days of data) [2025-10-21T18:47:08.435564] [DEBUG] [LOCAL ] FLC: Primary data saved (5426 records). [2025-10-21T18:47:08.435633] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-21T18:47:08.435750] [INFO ] [MAIN ] Update Progress: 838/2366 symbols completed. FLC took 20.9s. Estimated remaining: 3h 15m 14s. Rate: 7.8 symbols/min [2025-10-21T18:47:08.951075] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-21T18:47:09.512457] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T18:47:09.665447] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T18:47:09.673726] [INFO ] [REMOTE ] FIS: Full fetch complete (77391 records). [2025-10-21T18:47:09.673849] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-21T18:47:09.764897] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-21T18:47:10.080026] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-21T18:47:10.080102] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-21T18:47:10.081012] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-21T18:47:10.081073] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-21T18:47:10.082492] [DEBUG] [LOCAL ] FIS: Trimmed 77391 records to 53326 (keeping 200 days of data) [2025-10-21T18:47:10.400519] [DEBUG] [LOCAL ] FIS: Primary data saved (53326 records). [2025-10-21T18:47:10.400662] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-21T18:47:10.401356] [INFO ] [MAIN ] Update Progress: 839/2366 symbols completed. FIS took 30.6s. Estimated remaining: 3h 14m 56s. Rate: 7.8 symbols/min [2025-10-21T18:47:11.169430] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:47:11.173850] [INFO ] [REMOTE ] FIX: Full fetch complete (45554 records). [2025-10-21T18:47:11.173956] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-21T18:47:11.550080] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-21T18:47:11.550204] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-21T18:47:11.550911] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-21T18:47:11.550974] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-21T18:47:11.552030] [DEBUG] [LOCAL ] FIX: Trimmed 45554 records to 28480 (keeping 200 days of data) [2025-10-21T18:47:11.725614] [DEBUG] [LOCAL ] FIX: Primary data saved (28480 records). [2025-10-21T18:47:11.725764] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-21T18:47:11.725844] [INFO ] [MAIN ] Update Progress: 840/2366 symbols completed. FIX took 26.3s. Estimated remaining: 3h 14m 37s. Rate: 7.8 symbols/min [2025-10-21T18:47:12.410438] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:12.431943] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:12.428513] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:12.427590] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:12.432683] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-21T18:47:12.433400] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-21T18:47:12.433532] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-21T18:47:12.433586] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-21T18:47:12.433640] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-21T18:47:12.433733] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-21T18:47:12.756966] [DEBUG] [LOCAL ] FLNG: Loaded 33591 existing records from primary storage. [2025-10-21T18:47:12.835482] [DEBUG] [LOCAL ] FLO: Loaded 52083 existing records from primary storage. [2025-10-21T18:47:12.835883] [INFO ] [MAIN ] FLO: Loaded 52083 existing records. [2025-10-21T18:47:12.841962] [DEBUG] [LOCAL ] FLG: Loaded 53322 existing records from primary storage. [2025-10-21T18:47:12.847280] [INFO ] [MAIN ] FLNG: Loaded 33591 existing records. [2025-10-21T18:47:12.919150] [INFO ] [MAIN ] FLG: Loaded 53322 existing records. [2025-10-21T18:47:13.083813] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:13.118714] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-21T18:47:13.376751] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:13.440169] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:13.417509] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-21T18:47:13.454522] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-21T18:47:13.475967] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-21T18:47:13.475870] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:13.476243] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-21T18:47:13.476369] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-21T18:47:13.476477] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-21T18:47:13.476533] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-21T18:47:13.476586] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-21T18:47:13.476916] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-21T18:47:13.477009] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-21T18:47:13.501422] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-21T18:47:13.564287] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-21T18:47:14.424259] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:14.449857] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-21T18:47:14.566237] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:14.600776] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-21T18:47:14.606717] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:14.609177] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-21T18:47:14.611071] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T18:47:14.616046] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-21T18:47:15.898613] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:47:15.906581] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-21T18:47:15.977300] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:47:15.985180] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-21T18:47:16.367253] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T18:47:16.378732] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-21T18:47:16.418003] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:47:16.951005] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-21T18:47:17.052493] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T18:47:17.111296] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T18:47:17.751021] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-21T18:47:18.152288] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T18:47:18.556157] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-21T18:47:18.576255] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T18:47:19.258754] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T18:47:19.351032] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-21T18:47:19.498449] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T18:47:20.151037] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-21T18:47:20.951024] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-21T18:47:21.081517] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T18:47:21.751031] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-21T18:47:21.927487] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:47:22.364505] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T18:47:22.551010] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-21T18:47:23.350998] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-21T18:47:23.676935] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T18:47:23.901630] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:47:24.151019] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-21T18:47:24.957954] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-21T18:47:24.963539] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T18:47:25.499112] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:47:25.751037] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-21T18:47:26.550998] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-21T18:47:26.703561] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T18:47:26.993461] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T18:47:27.351074] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-21T18:47:28.151020] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-21T18:47:28.304026] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T18:47:28.951068] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-21T18:47:29.208467] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:47:29.508282] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T18:47:29.751062] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-21T18:47:30.386821] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:47:30.551051] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-21T18:47:31.351032] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-21T18:47:31.796747] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T18:47:32.151040] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-21T18:47:32.450840] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:47:32.525554] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T18:47:32.951068] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-21T18:47:33.682338] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:47:33.751040] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-21T18:47:34.551056] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-21T18:47:34.720682] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T18:47:34.955339] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T18:47:35.351050] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-21T18:47:36.151089] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-21T18:47:36.350322] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T18:47:36.951012] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-21T18:47:37.161106] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T18:47:37.718883] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T18:47:37.750977] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-21T18:47:38.551086] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-21T18:47:38.779821] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T18:47:39.148414] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:47:39.153249] [INFO ] [REMOTE ] FLNG: Full fetch complete (49938 records). [2025-10-21T18:47:39.153361] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-21T18:47:39.352957] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-21T18:47:39.553007] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-21T18:47:39.553122] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-21T18:47:39.553861] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-21T18:47:39.553925] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-21T18:47:39.555300] [DEBUG] [LOCAL ] FLNG: Trimmed 49938 records to 33491 (keeping 200 days of data) [2025-10-21T18:47:39.684478] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:47:39.788119] [DEBUG] [LOCAL ] FLNG: Primary data saved (33491 records). [2025-10-21T18:47:39.788246] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-21T18:47:39.788325] [INFO ] [MAIN ] Update Progress: 841/2366 symbols completed. FLNG took 28.1s. Estimated remaining: 3h 15m 6s. Rate: 7.8 symbols/min [2025-10-21T18:47:39.955241] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:40.004694] [DEBUG] [LOCAL ] FLR: Loaded 53258 existing records from primary storage. [2025-10-21T18:47:40.004984] [INFO ] [MAIN ] FLR: Loaded 53258 existing records. [2025-10-21T18:47:40.161562] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-21T18:47:40.183027] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:40.183869] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-21T18:47:40.183919] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-21T18:47:40.184473] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-21T18:47:40.184531] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-21T18:47:40.561168] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:40.951015] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-21T18:47:41.335885] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T18:47:41.401484] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T18:47:41.410087] [INFO ] [REMOTE ] FLG: Full fetch complete (77424 records). [2025-10-21T18:47:41.410272] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-21T18:47:41.758639] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-21T18:47:41.807591] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-21T18:47:41.807699] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-21T18:47:41.808716] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-21T18:47:41.808779] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-21T18:47:41.810628] [DEBUG] [LOCAL ] FLG: Trimmed 77424 records to 53319 (keeping 200 days of data) [2025-10-21T18:47:42.134338] [DEBUG] [LOCAL ] FLG: Primary data saved (53319 records). [2025-10-21T18:47:42.134704] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-21T18:47:42.134801] [INFO ] [MAIN ] Update Progress: 842/2366 symbols completed. FLG took 30.4s. Estimated remaining: 3h 14m 49s. Rate: 7.8 symbols/min [2025-10-21T18:47:42.306121] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:42.353431] [DEBUG] [LOCAL ] FLS: Loaded 50452 existing records from primary storage. [2025-10-21T18:47:42.353777] [INFO ] [MAIN ] FLS: Loaded 50452 existing records. [2025-10-21T18:47:42.553609] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-21T18:47:42.578548] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:42.578871] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-21T18:47:42.578943] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-21T18:47:42.581453] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-21T18:47:42.581393] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:47:42.581758] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-21T18:47:42.946574] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:43.350983] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-21T18:47:43.586187] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:47:43.594879] [INFO ] [REMOTE ] FLO: Full fetch complete (75383 records). [2025-10-21T18:47:43.595024] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-21T18:47:44.001681] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-21T18:47:44.002292] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-21T18:47:44.002932] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T18:47:44.007635] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-21T18:47:44.008144] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-21T18:47:44.008353] [INFO ] [REMOTE ] FLOC: Full fetch complete (40673 records). [2025-10-21T18:47:44.008432] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-21T18:47:44.089411] [DEBUG] [LOCAL ] FLO: Trimmed 75383 records to 52075 (keeping 200 days of data) [2025-10-21T18:47:44.179039] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-21T18:47:44.294962] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-21T18:47:44.296309] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:47:44.301689] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:47:44.312952] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-21T18:47:44.320912] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-21T18:47:44.321254] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-21T18:47:44.323708] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-21T18:47:44.331020] [INFO ] [MAIN ] Update Progress: 843/2366 symbols completed. FLOC took 32.6s. Estimated remaining: 3h 14m 31s. Rate: 7.8 symbols/min [2025-10-21T18:47:44.609601] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:44.704303] [DEBUG] [LOCAL ] FLO: Primary data saved (52075 records). [2025-10-21T18:47:44.704524] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-21T18:47:44.705183] [INFO ] [MAIN ] Update Progress: 844/2366 symbols completed. FLO took 33.0s. Estimated remaining: 3h 14m 11s. Rate: 7.8 symbols/min [2025-10-21T18:47:44.890218] [DEBUG] [LOCAL ] FLUT: Loaded 50697 existing records from primary storage. [2025-10-21T18:47:44.908510] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:47:44.908750] [INFO ] [MAIN ] FLUT: Loaded 50697 existing records. [2025-10-21T18:47:45.105289] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:45.105685] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-21T18:47:45.105982] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-21T18:47:45.107446] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-21T18:47:45.107329] [DEBUG] [LOCAL ] FLXR: Loaded 21242 existing records from primary storage. [2025-10-21T18:47:45.107534] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-21T18:47:45.107805] [INFO ] [MAIN ] FLXR: Loaded 21242 existing records. [2025-10-21T18:47:45.327069] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T18:47:45.350930] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-21T18:47:45.554816] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:47:45.607706] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-21T18:47:45.612988] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-21T18:47:45.644357] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-21T18:47:45.686759] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-21T18:47:45.718107] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:45.759210] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-21T18:47:46.054634] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T18:47:46.129223] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:47:46.550987] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-21T18:47:46.800129] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T18:47:47.351013] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-21T18:47:47.462821] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T18:47:48.151000] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-21T18:47:48.418443] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T18:47:48.454710] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:47:48.951006] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-21T18:47:49.392951] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T18:47:49.751063] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-21T18:47:50.551005] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-21T18:47:50.817900] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T18:47:51.350998] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-21T18:47:51.549396] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T18:47:51.918901] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T18:47:52.151018] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-21T18:47:52.865630] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:47:52.950986] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-21T18:47:53.662293] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:47:53.750985] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-21T18:47:54.403898] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:47:54.550992] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-21T18:47:55.350991] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-21T18:47:55.454344] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:47:56.151062] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-21T18:47:56.455287] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:47:56.951042] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-21T18:47:57.134943] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T18:47:57.746587] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T18:47:57.750971] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-21T18:47:57.879836] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T18:47:58.390784] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T18:47:58.551066] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-21T18:47:59.351029] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-21T18:48:00.151054] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-21T18:48:00.231097] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T18:48:00.951017] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-21T18:48:01.267797] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T18:48:01.311125] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T18:48:01.751037] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-21T18:48:02.551091] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-21T18:48:02.939344] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T18:48:03.205534] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T18:48:03.350996] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-21T18:48:03.535510] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T18:48:04.151064] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-21T18:48:04.950986] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-21T18:48:05.290777] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T18:48:05.750998] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-21T18:48:05.833308] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:48:05.877258] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T18:48:06.551016] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-21T18:48:07.350999] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-21T18:48:08.157354] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-21T18:48:08.160197] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (2.41 seconds). [2025-10-21T18:48:08.168919] [INFO ] [REMOTE ] FLR: Full fetch complete (76873 records). [2025-10-21T18:48:08.169041] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-21T18:48:08.536692] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T18:48:08.629858] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-21T18:48:08.644479] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-21T18:48:08.644956] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-21T18:48:08.646517] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-21T18:48:08.646799] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-21T18:48:08.648396] [DEBUG] [LOCAL ] FLR: Trimmed 76873 records to 53260 (keeping 200 days of data) [2025-10-21T18:48:08.945886] [DEBUG] [LOCAL ] FLR: Primary data saved (53260 records). [2025-10-21T18:48:08.946009] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-21T18:48:08.946085] [INFO ] [MAIN ] Update Progress: 845/2366 symbols completed. FLR took 29.2s. Estimated remaining: 3h 14m 33s. Rate: 7.8 symbols/min [2025-10-21T18:48:08.951500] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-21T18:48:09.114976] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:09.161618] [DEBUG] [LOCAL ] FMC: Loaded 51892 existing records from primary storage. [2025-10-21T18:48:09.161949] [INFO ] [MAIN ] FMC: Loaded 51892 existing records. [2025-10-21T18:48:09.333901] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:09.334084] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-21T18:48:09.334133] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-21T18:48:09.335118] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-21T18:48:09.335175] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-21T18:48:09.686039] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:09.751005] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-21T18:48:09.996979] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:48:10.197667] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T18:48:10.551048] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-21T18:48:11.351069] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-21T18:48:11.470067] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T18:48:12.075224] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T18:48:12.151074] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-21T18:48:12.951068] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-21T18:48:13.435351] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-21T18:48:13.443257] [INFO ] [REMOTE ] FLUT: Full fetch complete (73387 records). [2025-10-21T18:48:13.443393] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-21T18:48:13.756190] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-21T18:48:13.835001] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-21T18:48:13.835087] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-21T18:48:13.836018] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-21T18:48:13.836082] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-21T18:48:13.837460] [DEBUG] [LOCAL ] FLUT: Trimmed 73387 records to 50684 (keeping 200 days of data) [2025-10-21T18:48:14.094067] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:48:14.106683] [INFO ] [REMOTE ] FLS: Full fetch complete (72491 records). [2025-10-21T18:48:14.132745] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-21T18:48:14.467060] [DEBUG] [LOCAL ] FLUT: Primary data saved (50684 records). [2025-10-21T18:48:14.481816] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-21T18:48:14.502316] [INFO ] [MAIN ] Update Progress: 846/2366 symbols completed. FLUT took 30.2s. Estimated remaining: 3h 14m 21s. Rate: 7.8 symbols/min [2025-10-21T18:48:14.710877] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-21T18:48:14.711265] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-21T18:48:14.712319] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-21T18:48:14.726234] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-21T18:48:14.788959] [DEBUG] [LOCAL ] FLS: Trimmed 72491 records to 50413 (keeping 200 days of data) [2025-10-21T18:48:14.788537] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:14.899883] [DEBUG] [LOCAL ] FMN: Loaded 5517 existing records from primary storage. [2025-10-21T18:48:14.904930] [INFO ] [MAIN ] FMN: Loaded 5517 existing records. [2025-10-21T18:48:15.120766] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:48:15.192631] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-21T18:48:15.287447] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:15.292637] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-21T18:48:15.292811] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-21T18:48:15.300328] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-21T18:48:15.304939] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-21T18:48:15.313954] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-21T18:48:15.409229] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-21T18:48:15.642846] [DEBUG] [LOCAL ] FLS: Primary data saved (50413 records). [2025-10-21T18:48:15.681248] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-21T18:48:15.701032] [INFO ] [MAIN ] Update Progress: 847/2366 symbols completed. FLS took 33.6s. Estimated remaining: 3h 14m 2s. Rate: 7.8 symbols/min [2025-10-21T18:48:15.901162] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:15.953200] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:15.983070] [DEBUG] [LOCAL ] FMS: Loaded 30419 existing records from primary storage. [2025-10-21T18:48:15.983327] [INFO ] [MAIN ] FMS: Loaded 30419 existing records. [2025-10-21T18:48:16.157113] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-21T18:48:16.161615] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:16.161847] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-21T18:48:16.162683] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-21T18:48:16.163301] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-21T18:48:16.163358] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-21T18:48:16.530806] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T18:48:16.563551] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:16.951069] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-21T18:48:17.066564] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T18:48:17.379113] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T18:48:17.751049] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-21T18:48:17.852555] [DEBUG] [REMOTE ] FLXR: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-21T18:48:17.852917] [WARN ] [REMOTE ] FLXR: No data returned for month 2025-10 [2025-10-21T18:48:17.853025] [FATAL] [REMOTE ] FLXR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T18:48:17.853147] [FATAL] [MAIN ] FLXR: Failed to fetch primary data. [2025-10-21T18:48:17.853229] [WARN ] [MAIN ] FLXR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T18:48:17.853313] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-21T18:48:17.853391] [DEBUG] [LOCAL ] FLXR: No primary data file found to delete. [2025-10-21T18:48:17.853441] [INFO ] [LOCAL ] FLXR: Starting deletion of derivative data. [2025-10-21T18:48:17.853683] [DEBUG] [LOCAL ] FLXR: Deleted derivative data file. [2025-10-21T18:48:17.853795] [INFO ] [MAIN ] Update Progress: 848/2366 symbols completed. FLXR took 33.1s. Estimated remaining: 3h 13m 45s. Rate: 7.8 symbols/min [2025-10-21T18:48:18.025823] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:18.063859] [DEBUG] [LOCAL ] FMX: Loaded 40649 existing records from primary storage. [2025-10-21T18:48:18.064149] [INFO ] [MAIN ] FMX: Loaded 40649 existing records. [2025-10-21T18:48:18.254624] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T18:48:18.272423] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:18.273105] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-21T18:48:18.273162] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-21T18:48:18.273374] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-21T18:48:18.273428] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-21T18:48:18.556195] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-21T18:48:18.626241] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:19.351001] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-21T18:48:19.814352] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T18:48:20.151024] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-21T18:48:20.755383] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T18:48:20.951019] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-21T18:48:21.751039] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-21T18:48:21.802780] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T18:48:21.855226] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:48:22.551023] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-21T18:48:23.195273] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T18:48:23.351005] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-21T18:48:23.360364] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:48:24.151032] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-21T18:48:24.693522] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T18:48:24.951021] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-21T18:48:25.751029] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-21T18:48:26.398297] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T18:48:26.533189] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-21T18:48:26.550973] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-21T18:48:27.024387] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-21T18:48:27.351020] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-21T18:48:28.151057] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-21T18:48:28.244263] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:48:28.951026] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-21T18:48:29.036814] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T18:48:29.630094] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:48:29.750981] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-21T18:48:30.551059] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-21T18:48:30.730265] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T18:48:30.748222] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T18:48:31.351040] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-21T18:48:31.861596] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T18:48:32.151055] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-21T18:48:32.718268] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T18:48:32.951029] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-21T18:48:33.015576] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:48:33.453086] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T18:48:33.751049] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-21T18:48:34.376449] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T18:48:34.551017] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-21T18:48:35.241665] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T18:48:35.351018] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-21T18:48:35.941876] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T18:48:36.151030] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-21T18:48:36.951011] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-21T18:48:37.632607] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:48:37.751061] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-21T18:48:38.198078] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T18:48:38.551030] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-21T18:48:39.105924] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T18:48:39.351035] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-21T18:48:39.825405] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T18:48:40.150932] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T18:48:40.150981] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-21T18:48:40.153670] [INFO ] [REMOTE ] FMN: Full fetch complete (10022 records). [2025-10-21T18:48:40.153744] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-21T18:48:40.510747] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-21T18:48:40.510811] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-21T18:48:40.511046] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-21T18:48:40.511085] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-21T18:48:40.511519] [DEBUG] [LOCAL ] FMN: Trimmed 10022 records to 5499 (keeping 200 days of data) [2025-10-21T18:48:40.543820] [DEBUG] [LOCAL ] FMN: Primary data saved (5499 records). [2025-10-21T18:48:40.543923] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-21T18:48:40.543998] [INFO ] [MAIN ] Update Progress: 849/2366 symbols completed. FMN took 26.0s. Estimated remaining: 3h 14m 4s. Rate: 7.8 symbols/min [2025-10-21T18:48:40.712838] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:40.716346] [DEBUG] [LOCAL ] FMY: Loaded 1381 existing records from primary storage. [2025-10-21T18:48:40.716484] [INFO ] [MAIN ] FMY: Loaded 1381 existing records. [2025-10-21T18:48:40.891876] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:40.892077] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-21T18:48:40.892125] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-21T18:48:40.892268] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-21T18:48:40.892310] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-21T18:48:40.956145] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-21T18:48:41.251700] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:41.555034] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:48:41.751031] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-21T18:48:42.551091] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-21T18:48:42.580285] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T18:48:42.894888] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-21T18:48:43.076165] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T18:48:43.081356] [INFO ] [REMOTE ] FMS: Full fetch complete (43116 records). [2025-10-21T18:48:43.081444] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-21T18:48:43.356119] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-21T18:48:43.475449] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-21T18:48:43.475540] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-21T18:48:43.476206] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-21T18:48:43.476267] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-21T18:48:43.477327] [DEBUG] [LOCAL ] FMS: Trimmed 43116 records to 30427 (keeping 200 days of data) [2025-10-21T18:48:43.654747] [DEBUG] [LOCAL ] FMS: Primary data saved (30427 records). [2025-10-21T18:48:43.654873] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-21T18:48:43.654948] [INFO ] [MAIN ] Update Progress: 850/2366 symbols completed. FMS took 28.0s. Estimated remaining: 3h 13m 48s. Rate: 7.8 symbols/min [2025-10-21T18:48:43.825986] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:43.862819] [DEBUG] [LOCAL ] FN: Loaded 37620 existing records from primary storage. [2025-10-21T18:48:43.863099] [INFO ] [MAIN ] FN: Loaded 37620 existing records. [2025-10-21T18:48:44.038459] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:44.038718] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-21T18:48:44.038773] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-21T18:48:44.039027] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-21T18:48:44.039082] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-21T18:48:44.156136] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-21T18:48:44.414444] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:44.737774] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T18:48:44.951041] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-21T18:48:45.173965] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T18:48:45.304128] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-21T18:48:45.751080] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-21T18:48:46.551005] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-21T18:48:47.351011] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-21T18:48:47.665207] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T18:48:47.673748] [INFO ] [REMOTE ] FMC: Full fetch complete (75398 records). [2025-10-21T18:48:47.673887] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-21T18:48:47.806690] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T18:48:48.090950] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-21T18:48:48.091062] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-21T18:48:48.092132] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-21T18:48:48.092320] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-21T18:48:48.113271] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T18:48:48.121363] [DEBUG] [LOCAL ] FMC: Trimmed 75398 records to 51887 (keeping 200 days of data) [2025-10-21T18:48:48.172904] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-21T18:48:48.431964] [DEBUG] [LOCAL ] FMC: Primary data saved (51887 records). [2025-10-21T18:48:48.432126] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-21T18:48:48.432218] [INFO ] [MAIN ] Update Progress: 851/2366 symbols completed. FMC took 39.5s. Estimated remaining: 3h 13m 35s. Rate: 7.8 symbols/min [2025-10-21T18:48:48.598161] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:48.648097] [DEBUG] [LOCAL ] FNB: Loaded 52605 existing records from primary storage. [2025-10-21T18:48:48.648397] [INFO ] [MAIN ] FNB: Loaded 52605 existing records. [2025-10-21T18:48:48.820590] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:48.820867] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-21T18:48:48.820915] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-21T18:48:48.821137] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-21T18:48:48.821193] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-21T18:48:48.957263] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-21T18:48:49.173424] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:49.751048] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-21T18:48:49.796412] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T18:48:50.043076] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-21T18:48:50.235478] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:48:50.551026] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-21T18:48:51.351063] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-21T18:48:52.150999] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-21T18:48:52.252377] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:48:52.503944] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T18:48:52.950936] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-21T18:48:52.989752] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T18:48:53.393745] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T18:48:53.751080] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-21T18:48:54.551078] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-21T18:48:55.351022] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-21T18:48:55.395499] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:48:56.151086] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-21T18:48:56.203120] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T18:48:56.603978] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T18:48:56.951037] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-21T18:48:57.085533] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T18:48:57.091599] [INFO ] [REMOTE ] FMX: Full fetch complete (58007 records). [2025-10-21T18:48:57.091792] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-21T18:48:57.495848] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-21T18:48:57.495930] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-21T18:48:57.496782] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-21T18:48:57.496865] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-21T18:48:57.498109] [DEBUG] [LOCAL ] FMX: Trimmed 58007 records to 40553 (keeping 200 days of data) [2025-10-21T18:48:57.749049] [DEBUG] [LOCAL ] FMX: Primary data saved (40553 records). [2025-10-21T18:48:57.749171] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-21T18:48:57.749749] [INFO ] [MAIN ] Update Progress: 852/2366 symbols completed. FMX took 39.9s. Estimated remaining: 3h 13m 30s. Rate: 7.8 symbols/min [2025-10-21T18:48:57.761433] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-21T18:48:57.931277] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:57.982340] [DEBUG] [LOCAL ] FND: Loaded 52091 existing records from primary storage. [2025-10-21T18:48:57.982693] [INFO ] [MAIN ] FND: Loaded 52091 existing records. [2025-10-21T18:48:58.170863] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:58.171120] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-21T18:48:58.171191] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-21T18:48:58.171523] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-21T18:48:58.171589] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-21T18:48:58.280315] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T18:48:58.551457] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-21T18:48:58.551337] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:48:58.629524] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T18:48:58.995574] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T18:48:58.996301] [INFO ] [REMOTE ] FMY: Full fetch complete (1945 records). [2025-10-21T18:48:58.996368] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-21T18:48:59.356181] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-21T18:48:59.362076] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-21T18:48:59.362137] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-21T18:48:59.362229] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-21T18:48:59.362270] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-21T18:48:59.362591] [DEBUG] [LOCAL ] FMY: Trimmed 1945 records to 1377 (keeping 200 days of data) [2025-10-21T18:48:59.371401] [DEBUG] [LOCAL ] FMY: Primary data saved (1377 records). [2025-10-21T18:48:59.371468] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-21T18:48:59.371539] [INFO ] [MAIN ] Update Progress: 853/2366 symbols completed. FMY took 18.8s. Estimated remaining: 3h 13m 12s. Rate: 7.8 symbols/min [2025-10-21T18:48:59.552531] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:48:59.598284] [DEBUG] [LOCAL ] FNF: Loaded 48842 existing records from primary storage. [2025-10-21T18:48:59.598594] [INFO ] [MAIN ] FNF: Loaded 48842 existing records. [2025-10-21T18:48:59.785221] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:48:59.785421] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-21T18:48:59.785470] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-21T18:48:59.785739] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-21T18:48:59.785796] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-21T18:49:00.153940] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-21T18:49:00.157791] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:00.951027] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-21T18:49:01.038744] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T18:49:01.751313] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-21T18:49:01.855786] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:49:02.550997] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-21T18:49:02.649470] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T18:49:03.350995] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-21T18:49:03.439777] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:49:03.992041] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:49:04.151039] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-21T18:49:04.951004] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-21T18:49:05.190502] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:49:05.225929] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T18:49:05.751038] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-21T18:49:06.551039] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-21T18:49:06.609692] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:49:07.351005] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-21T18:49:07.451402] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T18:49:08.064713] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T18:49:08.151015] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-21T18:49:08.951001] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-21T18:49:09.163950] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T18:49:09.502862] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T18:49:09.750997] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-21T18:49:10.551036] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-21T18:49:10.598326] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T18:49:11.350998] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-21T18:49:11.446674] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:49:12.137146] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T18:49:12.150983] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-21T18:49:12.891558] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:49:12.951040] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-21T18:49:13.536944] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T18:49:13.542131] [INFO ] [REMOTE ] FN: Full fetch complete (56379 records). [2025-10-21T18:49:13.542249] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-21T18:49:13.756232] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-21T18:49:13.951910] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-21T18:49:13.951992] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-21T18:49:13.952808] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-21T18:49:13.952871] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-21T18:49:13.954421] [DEBUG] [LOCAL ] FN: Trimmed 56379 records to 37491 (keeping 200 days of data) [2025-10-21T18:49:14.174713] [DEBUG] [LOCAL ] FN: Primary data saved (37491 records). [2025-10-21T18:49:14.174842] [INFO ] [MAIN ] FN: Full history saved. [2025-10-21T18:49:14.174916] [INFO ] [MAIN ] Update Progress: 854/2366 symbols completed. FN took 30.5s. Estimated remaining: 3h 13m 17s. Rate: 7.8 symbols/min [2025-10-21T18:49:14.341941] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:14.387299] [DEBUG] [LOCAL ] FNV: Loaded 46152 existing records from primary storage. [2025-10-21T18:49:14.387617] [INFO ] [MAIN ] FNV: Loaded 46152 existing records. [2025-10-21T18:49:14.557977] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-21T18:49:14.570771] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:14.572266] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-21T18:49:14.572344] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-21T18:49:14.572789] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-21T18:49:14.572848] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-21T18:49:14.777009] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T18:49:14.967092] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:15.236044] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:49:15.350994] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-21T18:49:16.151012] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-21T18:49:16.446182] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T18:49:16.951010] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-21T18:49:17.178350] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T18:49:17.413639] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T18:49:17.751053] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-21T18:49:18.556287] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-21T18:49:18.571948] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T18:49:19.351065] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-21T18:49:19.537210] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T18:49:20.151013] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-21T18:49:20.272567] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T18:49:20.951033] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-21T18:49:21.166896] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T18:49:21.426917] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:49:21.751031] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-21T18:49:22.551093] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-21T18:49:22.666278] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T18:49:23.317028] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:49:23.351031] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-21T18:49:24.151050] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-21T18:49:24.322394] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T18:49:24.951061] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-21T18:49:25.071735] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T18:49:25.750992] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-21T18:49:26.004627] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T18:49:26.551087] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-21T18:49:26.785315] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:49:26.796331] [INFO ] [REMOTE ] FNB: Full fetch complete (76217 records). [2025-10-21T18:49:26.796505] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-21T18:49:27.277871] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-21T18:49:27.278018] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-21T18:49:27.279080] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-21T18:49:27.279165] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-21T18:49:27.280911] [DEBUG] [LOCAL ] FNB: Trimmed 76217 records to 52603 (keeping 200 days of data) [2025-10-21T18:49:27.361134] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-21T18:49:27.405597] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T18:49:27.654921] [DEBUG] [LOCAL ] FNB: Primary data saved (52603 records). [2025-10-21T18:49:27.655065] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-21T18:49:27.655150] [INFO ] [MAIN ] Update Progress: 855/2366 symbols completed. FNB took 39.2s. Estimated remaining: 3h 13m 20s. Rate: 7.8 symbols/min [2025-10-21T18:49:27.834157] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:27.848283] [DEBUG] [LOCAL ] FOA: Loaded 13064 existing records from primary storage. [2025-10-21T18:49:27.848460] [INFO ] [MAIN ] FOA: Loaded 13064 existing records. [2025-10-21T18:49:28.024566] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:28.024763] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-21T18:49:28.024810] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-21T18:49:28.025029] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-21T18:49:28.025084] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-21T18:49:28.165369] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-21T18:49:28.408228] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:28.410083] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T18:49:28.951022] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-21T18:49:29.098161] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T18:49:29.705514] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T18:49:29.713797] [INFO ] [REMOTE ] FND: Full fetch complete (75046 records). [2025-10-21T18:49:29.713923] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-21T18:49:29.756557] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-21T18:49:30.105143] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-21T18:49:30.105271] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-21T18:49:30.106178] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-21T18:49:30.106239] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-21T18:49:30.107726] [DEBUG] [LOCAL ] FND: Trimmed 75046 records to 52080 (keeping 200 days of data) [2025-10-21T18:49:30.421818] [DEBUG] [LOCAL ] FND: Primary data saved (52080 records). [2025-10-21T18:49:30.421950] [INFO ] [MAIN ] FND: Full history saved. [2025-10-21T18:49:30.422542] [INFO ] [MAIN ] Update Progress: 856/2366 symbols completed. FND took 32.7s. Estimated remaining: 3h 13m 3s. Rate: 7.8 symbols/min [2025-10-21T18:49:30.551116] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-21T18:49:30.624869] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:30.658003] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T18:49:30.672459] [DEBUG] [LOCAL ] FOF: Loaded 8615 existing records from primary storage. [2025-10-21T18:49:30.673180] [INFO ] [MAIN ] FOF: Loaded 8615 existing records. [2025-10-21T18:49:30.770543] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-21T18:49:30.875430] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:30.875742] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-21T18:49:30.875795] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-21T18:49:30.875986] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-21T18:49:30.876041] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-21T18:49:31.225974] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:31.351008] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-21T18:49:32.151000] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-21T18:49:32.308621] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T18:49:32.803683] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-21T18:49:32.951023] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-21T18:49:33.721621] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:49:33.751014] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-21T18:49:33.925206] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T18:49:33.932629] [INFO ] [REMOTE ] FNF: Full fetch complete (69982 records). [2025-10-21T18:49:33.932816] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-21T18:49:34.315805] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-21T18:49:34.315884] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-21T18:49:34.316745] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-21T18:49:34.316808] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-21T18:49:34.318118] [DEBUG] [LOCAL ] FNF: Trimmed 69982 records to 48759 (keeping 200 days of data) [2025-10-21T18:49:34.553806] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-21T18:49:34.622355] [DEBUG] [LOCAL ] FNF: Primary data saved (48759 records). [2025-10-21T18:49:34.622492] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-21T18:49:34.622845] [INFO ] [MAIN ] Update Progress: 857/2366 symbols completed. FNF took 35.3s. Estimated remaining: 3h 12m 49s. Rate: 7.8 symbols/min [2025-10-21T18:49:34.798338] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:34.818730] [DEBUG] [LOCAL ] FOR: Loaded 19738 existing records from primary storage. [2025-10-21T18:49:34.818974] [INFO ] [MAIN ] FOR: Loaded 19738 existing records. [2025-10-21T18:49:35.001851] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:35.002152] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-21T18:49:35.002209] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-21T18:49:35.002907] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-21T18:49:35.002970] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-21T18:49:35.342860] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T18:49:35.355848] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-21T18:49:35.456343] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:35.458681] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:49:36.150991] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-21T18:49:36.401796] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T18:49:36.951000] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-21T18:49:37.324453] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T18:49:37.677700] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T18:49:37.750964] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-21T18:49:38.551087] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-21T18:49:38.897482] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T18:49:39.351004] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-21T18:49:39.474813] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T18:49:40.151053] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-21T18:49:40.951000] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-21T18:49:40.993818] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T18:49:41.193025] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:49:41.745020] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T18:49:41.750973] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-21T18:49:42.317726] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T18:49:42.551063] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-21T18:49:43.351030] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-21T18:49:43.835362] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T18:49:44.044946] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-21T18:49:44.151031] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-21T18:49:44.951034] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-21T18:49:45.222832] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T18:49:45.751007] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-21T18:49:45.776816] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T18:49:46.555311] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-21T18:49:46.559285] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T18:49:47.297239] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T18:49:47.351049] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-21T18:49:48.078723] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T18:49:48.151011] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-21T18:49:48.949712] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T18:49:48.952023] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-21T18:49:49.705479] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T18:49:49.751020] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-21T18:49:50.494938] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T18:49:50.550981] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-21T18:49:51.351019] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-21T18:49:51.634221] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:49:52.151035] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-21T18:49:52.392574] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T18:49:52.394376] [INFO ] [REMOTE ] FOF: Full fetch complete (11919 records). [2025-10-21T18:49:52.394447] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-21T18:49:52.752851] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-21T18:49:52.753138] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-21T18:49:52.753429] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-21T18:49:52.753487] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-21T18:49:52.753946] [DEBUG] [LOCAL ] FOF: Trimmed 11919 records to 8614 (keeping 200 days of data) [2025-10-21T18:49:52.805852] [DEBUG] [LOCAL ] FOF: Primary data saved (8614 records). [2025-10-21T18:49:52.805964] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-21T18:49:52.806039] [INFO ] [MAIN ] Update Progress: 858/2366 symbols completed. FOF took 22.4s. Estimated remaining: 3h 13m 0s. Rate: 7.8 symbols/min [2025-10-21T18:49:52.957674] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-21T18:49:52.975856] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:53.021515] [DEBUG] [LOCAL ] FOUR: Loaded 49761 existing records from primary storage. [2025-10-21T18:49:53.021826] [INFO ] [MAIN ] FOUR: Loaded 49761 existing records. [2025-10-21T18:49:53.204413] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T18:49:53.209963] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:53.213444] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-21T18:49:53.213531] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-21T18:49:53.214249] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-21T18:49:53.214309] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-21T18:49:53.593173] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:53.751015] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-21T18:49:54.551028] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-21T18:49:54.739596] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T18:49:55.253093] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T18:49:55.351002] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-21T18:49:55.437203] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:49:56.151025] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-21T18:49:56.951048] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-21T18:49:57.215211] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T18:49:57.217784] [INFO ] [REMOTE ] FOA: Full fetch complete (21269 records). [2025-10-21T18:49:57.217894] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-21T18:49:57.487047] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T18:49:57.535575] [INFO ] [REMOTE ] FNV: Full fetch complete (66918 records). [2025-10-21T18:49:57.541319] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-21T18:49:57.733866] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-21T18:49:57.744195] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-21T18:49:57.766515] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-21T18:49:57.767234] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-21T18:49:57.774357] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-21T18:49:57.812203] [DEBUG] [LOCAL ] FOA: Trimmed 21269 records to 13051 (keeping 200 days of data) [2025-10-21T18:49:58.086361] [DEBUG] [LOCAL ] FOA: Primary data saved (13051 records). [2025-10-21T18:49:58.086485] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-21T18:49:58.086603] [INFO ] [MAIN ] Update Progress: 859/2366 symbols completed. FOA took 30.4s. Estimated remaining: 3h 12m 48s. Rate: 7.8 symbols/min [2025-10-21T18:49:58.086763] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-21T18:49:58.098145] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-21T18:49:58.119209] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-21T18:49:58.130484] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-21T18:49:58.212295] [DEBUG] [LOCAL ] FNV: Trimmed 66918 records to 46145 (keeping 200 days of data) [2025-10-21T18:49:58.312603] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:58.487878] [DEBUG] [LOCAL ] FPF: Loaded 18844 existing records from primary storage. [2025-10-21T18:49:58.495747] [INFO ] [MAIN ] FPF: Loaded 18844 existing records. [2025-10-21T18:49:58.721877] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:58.747168] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-21T18:49:58.755835] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-21T18:49:58.766175] [DEBUG] [LOCAL ] FNV: Primary data saved (46145 records). [2025-10-21T18:49:58.766539] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-21T18:49:58.766710] [INFO ] [MAIN ] Update Progress: 860/2366 symbols completed. FNV took 44.6s. Estimated remaining: 3h 12m 28s. Rate: 7.8 symbols/min [2025-10-21T18:49:58.766801] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-21T18:49:58.766987] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-21T18:49:59.053905] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T18:49:59.106485] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-21T18:49:59.162231] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-21T18:49:59.187507] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:49:59.373767] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-21T18:49:59.373681] [DEBUG] [LOCAL ] FPH: Loaded 19328 existing records from primary storage. [2025-10-21T18:49:59.396684] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:49:59.397997] [INFO ] [MAIN ] FPH: Loaded 19328 existing records. [2025-10-21T18:49:59.584775] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:49:59.585007] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-21T18:49:59.585054] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-21T18:49:59.585222] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-21T18:49:59.585280] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-21T18:49:59.930329] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:00.151005] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-21T18:50:00.276892] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T18:50:00.951105] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-21T18:50:01.282869] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T18:50:01.332797] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T18:50:01.751064] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-21T18:50:02.249816] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T18:50:02.551041] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-21T18:50:02.858290] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T18:50:03.351063] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-21T18:50:03.578049] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T18:50:03.580989] [INFO ] [REMOTE ] FOR: Full fetch complete (29702 records). [2025-10-21T18:50:03.581074] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-21T18:50:03.955820] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-21T18:50:03.955900] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-21T18:50:03.956434] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-21T18:50:03.956472] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-21T18:50:03.957254] [DEBUG] [LOCAL ] FOR: Trimmed 29702 records to 19646 (keeping 200 days of data) [2025-10-21T18:50:04.069096] [DEBUG] [LOCAL ] FOR: Primary data saved (19646 records). [2025-10-21T18:50:04.069236] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-21T18:50:04.069310] [INFO ] [MAIN ] Update Progress: 861/2366 symbols completed. FOR took 29.4s. Estimated remaining: 3h 12m 17s. Rate: 7.8 symbols/min [2025-10-21T18:50:04.156170] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-21T18:50:04.256064] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:04.290289] [DEBUG] [LOCAL ] FPI: Loaded 31464 existing records from primary storage. [2025-10-21T18:50:04.290598] [INFO ] [MAIN ] FPI: Loaded 31464 existing records. [2025-10-21T18:50:04.479778] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:04.480136] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-21T18:50:04.480258] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-21T18:50:04.480471] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-21T18:50:04.480529] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-21T18:50:04.637445] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T18:50:04.869186] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:04.879955] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T18:50:04.951027] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-21T18:50:05.751064] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-21T18:50:05.962866] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T18:50:06.551001] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-21T18:50:06.847378] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T18:50:07.351050] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-21T18:50:08.151011] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-21T18:50:08.304622] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T18:50:08.433768] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T18:50:08.951017] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-21T18:50:09.222215] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T18:50:09.751024] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-21T18:50:10.336780] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T18:50:10.526179] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:50:10.551003] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-21T18:50:11.351005] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-21T18:50:11.597957] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T18:50:11.899075] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T18:50:12.151042] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-21T18:50:12.951046] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-21T18:50:13.202873] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:50:13.751036] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-21T18:50:14.105221] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T18:50:14.551001] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-21T18:50:14.710685] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T18:50:15.351018] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-21T18:50:15.600271] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:50:16.151070] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-21T18:50:16.951052] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-21T18:50:17.001081] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T18:50:17.190328] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T18:50:17.750998] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-21T18:50:18.079271] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T18:50:18.405628] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T18:50:18.551070] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-21T18:50:19.351014] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-21T18:50:19.791684] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T18:50:20.151024] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-21T18:50:20.951018] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-21T18:50:21.085772] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T18:50:21.123904] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T18:50:21.126967] [INFO ] [REMOTE ] FPH: Full fetch complete (30839 records). [2025-10-21T18:50:21.127046] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-21T18:50:21.485125] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-21T18:50:21.485200] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-21T18:50:21.485760] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-21T18:50:21.485860] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-21T18:50:21.486555] [DEBUG] [LOCAL ] FPH: Trimmed 30839 records to 19222 (keeping 200 days of data) [2025-10-21T18:50:21.588836] [DEBUG] [LOCAL ] FPH: Primary data saved (19222 records). [2025-10-21T18:50:21.588965] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-21T18:50:21.589054] [INFO ] [MAIN ] Update Progress: 862/2366 symbols completed. FPH took 22.8s. Estimated remaining: 3h 12m 26s. Rate: 7.8 symbols/min [2025-10-21T18:50:21.756218] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:21.755218] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-21T18:50:21.802699] [DEBUG] [LOCAL ] FR: Loaded 46684 existing records from primary storage. [2025-10-21T18:50:21.803224] [INFO ] [MAIN ] FR: Loaded 46684 existing records. [2025-10-21T18:50:22.005106] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:22.005324] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-21T18:50:22.005377] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-21T18:50:22.005895] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-21T18:50:22.005954] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-21T18:50:22.147309] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T18:50:22.431835] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:22.551025] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-21T18:50:23.351000] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-21T18:50:23.699082] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T18:50:24.085414] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T18:50:24.151053] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-21T18:50:24.722618] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T18:50:24.951025] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-21T18:50:25.751016] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-21T18:50:25.936398] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:50:26.177912] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T18:50:26.181882] [INFO ] [REMOTE ] FPF: Full fetch complete (26512 records). [2025-10-21T18:50:26.182013] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-21T18:50:26.540599] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-21T18:50:26.540709] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-21T18:50:26.541227] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-21T18:50:26.541269] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-21T18:50:26.542013] [DEBUG] [LOCAL ] FPF: Trimmed 26512 records to 18753 (keeping 200 days of data) [2025-10-21T18:50:26.588562] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-21T18:50:26.662209] [DEBUG] [LOCAL ] FPF: Primary data saved (18753 records). [2025-10-21T18:50:26.662362] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-21T18:50:26.662455] [INFO ] [MAIN ] Update Progress: 863/2366 symbols completed. FPF took 28.6s. Estimated remaining: 3h 12m 14s. Rate: 7.8 symbols/min [2025-10-21T18:50:26.829536] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:26.845524] [DEBUG] [LOCAL ] FRA: Loaded 14261 existing records from primary storage. [2025-10-21T18:50:26.845790] [INFO ] [MAIN ] FRA: Loaded 14261 existing records. [2025-10-21T18:50:27.021389] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:27.021604] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-21T18:50:27.021820] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-21T18:50:27.022150] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-21T18:50:27.022206] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-21T18:50:27.354361] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-21T18:50:27.377111] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:27.400602] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:50:28.151287] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-21T18:50:28.487457] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T18:50:28.495393] [INFO ] [REMOTE ] FOUR: Full fetch complete (72237 records). [2025-10-21T18:50:28.495505] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-21T18:50:28.883929] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T18:50:28.901312] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-21T18:50:28.908794] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-21T18:50:28.909716] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-21T18:50:28.910177] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-21T18:50:28.911437] [DEBUG] [LOCAL ] FOUR: Trimmed 72237 records to 49722 (keeping 200 days of data) [2025-10-21T18:50:28.961470] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-21T18:50:29.201475] [DEBUG] [LOCAL ] FOUR: Primary data saved (49722 records). [2025-10-21T18:50:29.201605] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-21T18:50:29.202476] [INFO ] [MAIN ] Update Progress: 864/2366 symbols completed. FOUR took 36.4s. Estimated remaining: 3h 11m 57s. Rate: 7.8 symbols/min [2025-10-21T18:50:29.368484] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:29.388553] [DEBUG] [LOCAL ] FRGE: Loaded 15767 existing records from primary storage. [2025-10-21T18:50:29.388805] [INFO ] [MAIN ] FRGE: Loaded 15767 existing records. [2025-10-21T18:50:29.568957] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:29.569222] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-21T18:50:29.569271] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-21T18:50:29.569417] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-21T18:50:29.569454] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-21T18:50:29.759848] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-21T18:50:29.950516] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:29.977294] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:50:30.409209] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T18:50:30.551060] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-21T18:50:31.174150] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T18:50:31.351096] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-21T18:50:31.911161] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T18:50:32.151034] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-21T18:50:32.354023] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:50:32.951019] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-21T18:50:33.751049] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-21T18:50:33.945198] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:50:34.076547] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T18:50:34.551053] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-21T18:50:34.758913] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T18:50:35.351045] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-21T18:50:35.738257] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:50:36.151060] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-21T18:50:36.604539] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T18:50:36.951040] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-21T18:50:37.112730] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T18:50:37.751073] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-21T18:50:38.551011] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-21T18:50:38.736567] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T18:50:39.052138] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T18:50:39.351035] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-21T18:50:39.556507] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T18:50:40.151069] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-21T18:50:40.894104] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T18:50:40.951003] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-21T18:50:41.399279] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T18:50:41.751085] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-21T18:50:42.482398] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T18:50:42.551024] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-21T18:50:43.039578] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T18:50:43.351051] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-21T18:50:44.111110] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:50:44.150978] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-21T18:50:44.358778] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:50:44.951025] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-21T18:50:45.433016] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T18:50:45.440541] [INFO ] [REMOTE ] FR: Full fetch complete (67157 records). [2025-10-21T18:50:45.440702] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-21T18:50:45.756192] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-21T18:50:45.830721] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-21T18:50:45.830805] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-21T18:50:45.831611] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-21T18:50:45.831678] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-21T18:50:45.833883] [DEBUG] [LOCAL ] FR: Trimmed 67157 records to 46672 (keeping 200 days of data) [2025-10-21T18:50:46.116228] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T18:50:46.132496] [DEBUG] [LOCAL ] FR: Primary data saved (46672 records). [2025-10-21T18:50:46.132810] [INFO ] [MAIN ] FR: Full history saved. [2025-10-21T18:50:46.132931] [INFO ] [MAIN ] Update Progress: 865/2366 symbols completed. FR took 24.5s. Estimated remaining: 3h 12m 6s. Rate: 7.8 symbols/min [2025-10-21T18:50:46.132621] [INFO ] [REMOTE ] FPI: Full fetch complete (43845 records). [2025-10-21T18:50:46.144486] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-21T18:50:46.469377] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:46.569365] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-21T18:50:46.617553] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T18:50:46.725538] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-21T18:50:46.725617] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-21T18:50:46.726401] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-21T18:50:46.726463] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-21T18:50:46.727401] [DEBUG] [LOCAL ] FPI: Trimmed 43845 records to 31413 (keeping 200 days of data) [2025-10-21T18:50:46.840420] [DEBUG] [LOCAL ] FRO: Loaded 51691 existing records from primary storage. [2025-10-21T18:50:46.843499] [INFO ] [MAIN ] FRO: Loaded 51691 existing records. [2025-10-21T18:50:47.083912] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:47.104004] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-21T18:50:47.111364] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-21T18:50:47.116559] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-21T18:50:47.118001] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-21T18:50:47.226967] [DEBUG] [LOCAL ] FPI: Primary data saved (31413 records). [2025-10-21T18:50:47.227206] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-21T18:50:47.230978] [INFO ] [MAIN ] Update Progress: 866/2366 symbols completed. FPI took 43.2s. Estimated remaining: 3h 11m 47s. Rate: 7.8 symbols/min [2025-10-21T18:50:47.359791] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-21T18:50:47.619553] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T18:50:47.618743] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:47.702894] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:47.735761] [DEBUG] [LOCAL ] FRT: Loaded 41648 existing records from primary storage. [2025-10-21T18:50:47.736030] [INFO ] [MAIN ] FRT: Loaded 41648 existing records. [2025-10-21T18:50:47.911587] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:47.911813] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-21T18:50:47.911862] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-21T18:50:47.912053] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-21T18:50:47.912093] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-21T18:50:48.156107] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-21T18:50:48.267060] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:48.387055] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T18:50:48.951036] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-21T18:50:49.750999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-21T18:50:49.932163] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T18:50:50.127906] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T18:50:50.550992] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-21T18:50:50.752359] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T18:50:51.351032] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-21T18:50:52.089442] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T18:50:52.151018] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-21T18:50:52.216372] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T18:50:52.951063] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-21T18:50:53.751006] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-21T18:50:53.816751] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T18:50:53.974320] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:50:53.976597] [INFO ] [REMOTE ] FRGE: Full fetch complete (30314 records). [2025-10-21T18:50:53.976701] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-21T18:50:54.341376] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-21T18:50:54.341455] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-21T18:50:54.342010] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-21T18:50:54.342071] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-21T18:50:54.342813] [DEBUG] [LOCAL ] FRGE: Trimmed 30314 records to 15653 (keeping 200 days of data) [2025-10-21T18:50:54.432416] [DEBUG] [LOCAL ] FRGE: Primary data saved (15653 records). [2025-10-21T18:50:54.432552] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-21T18:50:54.432627] [INFO ] [MAIN ] Update Progress: 867/2366 symbols completed. FRGE took 25.2s. Estimated remaining: 3h 11m 38s. Rate: 7.8 symbols/min [2025-10-21T18:50:54.556091] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-21T18:50:54.603563] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:50:54.638195] [DEBUG] [LOCAL ] FSCO: Loaded 38696 existing records from primary storage. [2025-10-21T18:50:54.638464] [INFO ] [MAIN ] FSCO: Loaded 38696 existing records. [2025-10-21T18:50:54.816153] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:50:54.816453] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-21T18:50:54.816511] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-21T18:50:54.816901] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-21T18:50:54.816959] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-21T18:50:55.165895] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:50:55.350995] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-21T18:50:55.489410] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T18:50:55.632062] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T18:50:56.151076] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-21T18:50:56.853844] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T18:50:56.951007] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-21T18:50:57.035225] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T18:50:57.751081] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-21T18:50:58.551089] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-21T18:50:58.583074] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T18:50:58.601549] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T18:50:59.351024] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-21T18:51:00.151081] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-21T18:51:00.459475] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T18:51:00.951111] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-21T18:51:01.638518] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T18:51:01.751052] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-21T18:51:01.783797] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T18:51:02.147945] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T18:51:02.150795] [INFO ] [REMOTE ] FRA: Full fetch complete (23487 records). [2025-10-21T18:51:02.150937] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-21T18:51:02.545679] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-21T18:51:02.545804] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-21T18:51:02.546353] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-21T18:51:02.546397] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-21T18:51:02.547188] [DEBUG] [LOCAL ] FRA: Trimmed 23487 records to 14225 (keeping 200 days of data) [2025-10-21T18:51:02.583277] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-21T18:51:02.640345] [DEBUG] [LOCAL ] FRA: Primary data saved (14225 records). [2025-10-21T18:51:02.640485] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-21T18:51:02.640567] [INFO ] [MAIN ] Update Progress: 868/2366 symbols completed. FRA took 36.0s. Estimated remaining: 3h 11m 31s. Rate: 7.8 symbols/min [2025-10-21T18:51:02.841999] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:02.889619] [DEBUG] [LOCAL ] FSK: Loaded 49506 existing records from primary storage. [2025-10-21T18:51:02.889966] [INFO ] [MAIN ] FSK: Loaded 49506 existing records. [2025-10-21T18:51:03.072722] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:03.073020] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-21T18:51:03.073162] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-21T18:51:03.073372] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-21T18:51:03.073414] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-21T18:51:03.356421] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-21T18:51:03.456818] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:03.460671] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T18:51:04.150996] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-21T18:51:04.615111] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T18:51:04.924706] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T18:51:04.951067] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-21T18:51:05.751001] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-21T18:51:05.791189] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T18:51:06.444112] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:51:06.551018] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-21T18:51:07.297577] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T18:51:07.350987] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-21T18:51:08.075700] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T18:51:08.151010] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-21T18:51:08.951005] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-21T18:51:08.953885] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T18:51:09.329044] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:51:09.751071] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-21T18:51:10.271752] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T18:51:10.551068] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-21T18:51:11.351088] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-21T18:51:11.515361] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T18:51:12.103229] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T18:51:12.151028] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-21T18:51:12.950991] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-21T18:51:13.122522] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T18:51:13.652313] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T18:51:13.751001] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-21T18:51:14.333438] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T18:51:14.551052] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-21T18:51:15.213621] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T18:51:15.219806] [INFO ] [REMOTE ] FRT: Full fetch complete (60476 records). [2025-10-21T18:51:15.219927] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-21T18:51:15.356575] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-21T18:51:15.604733] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-21T18:51:15.604812] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-21T18:51:15.605564] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-21T18:51:15.605603] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-21T18:51:15.606730] [DEBUG] [LOCAL ] FRT: Trimmed 60476 records to 41559 (keeping 200 days of data) [2025-10-21T18:51:15.859132] [DEBUG] [LOCAL ] FRT: Primary data saved (41559 records). [2025-10-21T18:51:15.859272] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-21T18:51:15.859363] [INFO ] [MAIN ] Update Progress: 869/2366 symbols completed. FRT took 28.6s. Estimated remaining: 3h 11m 33s. Rate: 7.8 symbols/min [2025-10-21T18:51:16.034106] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:16.081140] [DEBUG] [LOCAL ] FSLY: Loaded 51345 existing records from primary storage. [2025-10-21T18:51:16.081458] [INFO ] [MAIN ] FSLY: Loaded 51345 existing records. [2025-10-21T18:51:16.158685] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-21T18:51:16.273004] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:16.273410] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-21T18:51:16.273515] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-21T18:51:16.283219] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-21T18:51:16.299600] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-21T18:51:16.367794] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:51:16.673192] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:16.938508] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T18:51:16.950968] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-21T18:51:17.750990] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-21T18:51:18.060962] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T18:51:18.134980] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T18:51:18.551023] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-21T18:51:19.353312] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-21T18:51:19.356082] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:51:19.916998] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:51:20.151030] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-21T18:51:20.951028] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-21T18:51:21.282228] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T18:51:21.498080] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:51:21.751019] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-21T18:51:22.410118] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:51:22.551033] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-21T18:51:23.351035] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-21T18:51:23.559707] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T18:51:23.732257] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T18:51:24.151092] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-21T18:51:24.951011] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-21T18:51:25.069120] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T18:51:25.751053] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-21T18:51:25.952052] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T18:51:25.959841] [INFO ] [REMOTE ] FSCO: Full fetch complete (55374 records). [2025-10-21T18:51:25.959996] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-21T18:51:26.363690] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-21T18:51:26.363808] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-21T18:51:26.365083] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-21T18:51:26.365153] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-21T18:51:26.366760] [DEBUG] [LOCAL ] FSCO: Trimmed 55374 records to 38651 (keeping 200 days of data) [2025-10-21T18:51:26.554629] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-21T18:51:26.617903] [DEBUG] [LOCAL ] FSCO: Primary data saved (38651 records). [2025-10-21T18:51:26.618137] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-21T18:51:26.619220] [INFO ] [MAIN ] Update Progress: 870/2366 symbols completed. FSCO took 32.2s. Estimated remaining: 3h 11m 31s. Rate: 7.8 symbols/min [2025-10-21T18:51:26.822526] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:26.853733] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:51:26.917062] [DEBUG] [LOCAL ] FSM: Loaded 53303 existing records from primary storage. [2025-10-21T18:51:26.917553] [INFO ] [MAIN ] FSM: Loaded 53303 existing records. [2025-10-21T18:51:27.110013] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:27.110551] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-21T18:51:27.110677] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-21T18:51:27.111065] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-21T18:51:27.111173] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-21T18:51:27.368574] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-21T18:51:27.494506] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T18:51:27.538336] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:28.040921] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:51:28.151033] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-21T18:51:28.961126] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-21T18:51:28.962807] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T18:51:28.972140] [INFO ] [REMOTE ] FRO: Full fetch complete (75373 records). [2025-10-21T18:51:28.972277] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-21T18:51:29.361050] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-21T18:51:29.361127] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-21T18:51:29.362045] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-21T18:51:29.362108] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-21T18:51:29.363485] [DEBUG] [LOCAL ] FRO: Trimmed 75373 records to 51688 (keeping 200 days of data) [2025-10-21T18:51:29.670080] [DEBUG] [LOCAL ] FRO: Primary data saved (51688 records). [2025-10-21T18:51:29.670211] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-21T18:51:29.670287] [INFO ] [MAIN ] Update Progress: 871/2366 symbols completed. FRO took 43.5s. Estimated remaining: 3h 11m 15s. Rate: 7.8 symbols/min [2025-10-21T18:51:29.752204] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-21T18:51:29.849584] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:29.884114] [DEBUG] [LOCAL ] FSS: Loaded 33463 existing records from primary storage. [2025-10-21T18:51:29.884567] [INFO ] [MAIN ] FSS: Loaded 33463 existing records. [2025-10-21T18:51:30.072148] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:30.072390] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-21T18:51:30.072524] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-21T18:51:30.072829] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-21T18:51:30.072916] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-21T18:51:30.221546] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T18:51:30.517998] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:30.552570] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:51:30.552727] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-21T18:51:31.351075] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-21T18:51:31.706355] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T18:51:31.913602] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T18:51:32.151033] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-21T18:51:32.951022] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-21T18:51:33.039948] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T18:51:33.751025] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-21T18:51:34.026940] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T18:51:34.035309] [INFO ] [REMOTE ] FSK: Full fetch complete (72136 records). [2025-10-21T18:51:34.035443] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-21T18:51:34.440795] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-21T18:51:34.440882] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-21T18:51:34.441771] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-21T18:51:34.441835] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-21T18:51:34.443306] [DEBUG] [LOCAL ] FSK: Trimmed 72136 records to 49498 (keeping 200 days of data) [2025-10-21T18:51:34.553806] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-21T18:51:34.698203] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T18:51:34.794345] [DEBUG] [LOCAL ] FSK: Primary data saved (49498 records). [2025-10-21T18:51:34.794483] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-21T18:51:34.794638] [INFO ] [MAIN ] Update Progress: 872/2366 symbols completed. FSK took 32.2s. Estimated remaining: 3h 11m 3s. Rate: 7.8 symbols/min [2025-10-21T18:51:34.916072] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T18:51:34.990376] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:34.998554] [DEBUG] [LOCAL ] FT: Loaded 6734 existing records from primary storage. [2025-10-21T18:51:34.998986] [INFO ] [MAIN ] FT: Loaded 6734 existing records. [2025-10-21T18:51:35.173085] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:35.173295] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-21T18:51:35.173352] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-21T18:51:35.173518] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-21T18:51:35.173573] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-21T18:51:35.357383] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-21T18:51:35.534594] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:36.151026] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-21T18:51:36.354873] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T18:51:36.951015] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-21T18:51:37.209100] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T18:51:37.396991] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-21T18:51:37.618525] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T18:51:37.751002] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-21T18:51:38.551031] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-21T18:51:39.364070] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-21T18:51:39.366476] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T18:51:39.957514] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T18:51:40.151030] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-21T18:51:40.423755] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T18:51:40.951042] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-21T18:51:41.751025] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-21T18:51:41.986729] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:51:42.228866] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T18:51:42.297386] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:51:42.551041] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-21T18:51:43.351042] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-21T18:51:44.151051] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-21T18:51:44.367354] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T18:51:44.650343] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T18:51:44.664981] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T18:51:44.951035] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-21T18:51:45.751039] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-21T18:51:46.411157] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T18:51:46.551036] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-21T18:51:47.267070] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T18:51:47.275252] [INFO ] [REMOTE ] FSLY: Full fetch complete (74929 records). [2025-10-21T18:51:47.275375] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-21T18:51:47.356155] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-21T18:51:47.671056] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-21T18:51:47.671181] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-21T18:51:47.672249] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-21T18:51:47.672315] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-21T18:51:47.673731] [DEBUG] [LOCAL ] FSLY: Trimmed 74929 records to 51318 (keeping 200 days of data) [2025-10-21T18:51:47.949496] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T18:51:47.998614] [DEBUG] [LOCAL ] FSLY: Primary data saved (51318 records). [2025-10-21T18:51:47.998779] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-21T18:51:47.999369] [INFO ] [MAIN ] Update Progress: 873/2366 symbols completed. FSLY took 32.1s. Estimated remaining: 3h 11m 5s. Rate: 7.8 symbols/min [2025-10-21T18:51:48.155227] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-21T18:51:48.175797] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:48.192409] [DEBUG] [LOCAL ] FTHY: Loaded 12520 existing records from primary storage. [2025-10-21T18:51:48.192720] [INFO ] [MAIN ] FTHY: Loaded 12520 existing records. [2025-10-21T18:51:48.388465] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:48.388807] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-21T18:51:48.388870] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-21T18:51:48.389258] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-21T18:51:48.389318] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-21T18:51:48.805184] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:48.951016] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-21T18:51:49.138985] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T18:51:49.501420] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T18:51:49.751047] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-21T18:51:49.786215] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T18:51:50.551061] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-21T18:51:51.319133] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T18:51:51.324121] [INFO ] [REMOTE ] FSS: Full fetch complete (48573 records). [2025-10-21T18:51:51.324214] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-21T18:51:51.356146] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-21T18:51:51.702673] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-21T18:51:51.702773] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-21T18:51:51.703473] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-21T18:51:51.703513] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-21T18:51:51.704578] [DEBUG] [LOCAL ] FSS: Trimmed 48573 records to 33326 (keeping 200 days of data) [2025-10-21T18:51:51.919274] [DEBUG] [LOCAL ] FSS: Primary data saved (33326 records). [2025-10-21T18:51:51.919422] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-21T18:51:51.919501] [INFO ] [MAIN ] Update Progress: 874/2366 symbols completed. FSS took 22.2s. Estimated remaining: 3h 10m 51s. Rate: 7.8 symbols/min [2025-10-21T18:51:52.094241] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:51:52.145130] [DEBUG] [LOCAL ] FTI: Loaded 53290 existing records from primary storage. [2025-10-21T18:51:52.145452] [INFO ] [MAIN ] FTI: Loaded 53290 existing records. [2025-10-21T18:51:52.156819] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-21T18:51:52.190148] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T18:51:52.345234] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:51:52.345506] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-21T18:51:52.345769] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-21T18:51:52.346027] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-21T18:51:52.346272] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-21T18:51:52.530394] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T18:51:52.772475] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:51:52.782390] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:51:52.951090] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-21T18:51:53.664712] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-21T18:51:53.751064] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-21T18:51:54.533507] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T18:51:54.550986] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-21T18:51:55.127304] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T18:51:55.351021] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-21T18:51:56.151031] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-21T18:51:56.886917] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T18:51:56.951034] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-21T18:51:57.077227] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T18:51:57.537812] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T18:51:57.751092] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-21T18:51:58.405589] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T18:51:58.551035] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-21T18:51:59.269026] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T18:51:59.351022] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-21T18:52:00.151018] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-21T18:52:00.951012] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-21T18:52:01.000343] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T18:52:01.434077] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-21T18:52:01.751035] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-21T18:52:01.790087] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T18:52:02.519678] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T18:52:02.521441] [INFO ] [REMOTE ] FT: Full fetch complete (9252 records). [2025-10-21T18:52:02.521508] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-21T18:52:02.556175] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-21T18:52:02.892777] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-21T18:52:02.892865] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-21T18:52:02.893119] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-21T18:52:02.893166] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-21T18:52:02.893612] [DEBUG] [LOCAL ] FT: Trimmed 9252 records to 6765 (keeping 200 days of data) [2025-10-21T18:52:02.933197] [DEBUG] [LOCAL ] FT: Primary data saved (6765 records). [2025-10-21T18:52:02.933331] [INFO ] [MAIN ] FT: Full history saved. [2025-10-21T18:52:02.933412] [INFO ] [MAIN ] Update Progress: 875/2366 symbols completed. FT took 28.1s. Estimated remaining: 3h 10m 49s. Rate: 7.8 symbols/min [2025-10-21T18:52:03.120868] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:03.155071] [DEBUG] [LOCAL ] FTK: Loaded 32881 existing records from primary storage. [2025-10-21T18:52:03.155361] [INFO ] [MAIN ] FTK: Loaded 32881 existing records. [2025-10-21T18:52:03.333754] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:03.333986] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-21T18:52:03.334042] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-21T18:52:03.334239] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-21T18:52:03.334295] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-21T18:52:03.356091] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-21T18:52:03.626317] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T18:52:03.705733] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:04.151054] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-21T18:52:04.951004] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-21T18:52:04.995037] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T18:52:05.116213] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T18:52:05.751062] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-21T18:52:06.152131] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T18:52:06.551065] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-21T18:52:07.350995] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-21T18:52:07.390348] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T18:52:07.539085] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:52:08.151007] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-21T18:52:08.254389] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:52:08.257304] [INFO ] [REMOTE ] FTHY: Full fetch complete (17309 records). [2025-10-21T18:52:08.257391] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-21T18:52:08.660736] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-21T18:52:08.660822] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-21T18:52:08.661203] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-21T18:52:08.661244] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-21T18:52:08.661803] [DEBUG] [LOCAL ] FTHY: Trimmed 17309 records to 12518 (keeping 200 days of data) [2025-10-21T18:52:08.736615] [DEBUG] [LOCAL ] FTHY: Primary data saved (12518 records). [2025-10-21T18:52:08.736779] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-21T18:52:08.736865] [INFO ] [MAIN ] Update Progress: 876/2366 symbols completed. FTHY took 20.7s. Estimated remaining: 3h 10m 38s. Rate: 7.8 symbols/min [2025-10-21T18:52:08.909726] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:08.950626] [DEBUG] [LOCAL ] FTS: Loaded 42558 existing records from primary storage. [2025-10-21T18:52:08.950964] [INFO ] [MAIN ] FTS: Loaded 42558 existing records. [2025-10-21T18:52:08.962256] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-21T18:52:09.130340] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:09.130535] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-21T18:52:09.130582] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-21T18:52:09.130840] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-21T18:52:09.130903] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-21T18:52:09.491930] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:09.751057] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-21T18:52:09.798360] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T18:52:10.310565] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T18:52:10.551083] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-21T18:52:11.351009] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-21T18:52:11.382176] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:52:11.496446] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T18:52:12.151010] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-21T18:52:12.917353] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T18:52:12.951026] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-21T18:52:13.597681] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T18:52:13.751062] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-21T18:52:14.551040] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-21T18:52:14.816932] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T18:52:15.240463] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:52:15.351031] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-21T18:52:16.048922] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T18:52:16.151045] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-21T18:52:16.951055] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-21T18:52:17.059331] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:52:17.751080] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-21T18:52:18.000173] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T18:52:18.433251] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T18:52:18.551077] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-21T18:52:19.351048] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-21T18:52:19.517382] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T18:52:20.040240] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T18:52:20.151032] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-21T18:52:20.840786] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T18:52:20.951024] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-21T18:52:21.665864] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T18:52:21.750994] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-21T18:52:21.891555] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T18:52:22.551025] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-21T18:52:23.282144] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T18:52:23.351001] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-21T18:52:23.945912] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T18:52:24.151049] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-21T18:52:24.951086] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-21T18:52:25.160292] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T18:52:25.751043] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-21T18:52:26.115454] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T18:52:26.125125] [INFO ] [REMOTE ] FSM: Full fetch complete (77127 records). [2025-10-21T18:52:26.125283] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-21T18:52:26.560802] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-21T18:52:26.558606] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-21T18:52:26.562108] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-21T18:52:26.564775] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T18:52:26.563619] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-21T18:52:26.570693] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-21T18:52:26.571090] [INFO ] [REMOTE ] FTK: Full fetch complete (43945 records). [2025-10-21T18:52:26.571179] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-21T18:52:26.647307] [DEBUG] [LOCAL ] FSM: Trimmed 77127 records to 53303 (keeping 200 days of data) [2025-10-21T18:52:27.215757] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-21T18:52:27.223324] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-21T18:52:27.224678] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-21T18:52:27.232512] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-21T18:52:27.272284] [DEBUG] [LOCAL ] FTK: Trimmed 43945 records to 32948 (keeping 200 days of data) [2025-10-21T18:52:27.381045] [DEBUG] [LOCAL ] FSM: Primary data saved (53303 records). [2025-10-21T18:52:27.420226] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-21T18:52:27.433793] [INFO ] [MAIN ] Update Progress: 877/2366 symbols completed. FSM took 1m 1s. Estimated remaining: 3h 10m 49s. Rate: 7.8 symbols/min [2025-10-21T18:52:27.452774] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T18:52:27.477924] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-21T18:52:27.564751] [DEBUG] [LOCAL ] FTK: Primary data saved (32948 records). [2025-10-21T18:52:27.564883] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-21T18:52:27.564975] [INFO ] [MAIN ] Update Progress: 878/2366 symbols completed. FTK took 24.6s. Estimated remaining: 3h 10m 29s. Rate: 7.8 symbols/min [2025-10-21T18:52:28.473105] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T18:52:28.481931] [INFO ] [REMOTE ] FTI: Full fetch complete (77331 records). [2025-10-21T18:52:28.482086] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-21T18:52:28.880003] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-21T18:52:28.880099] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-21T18:52:28.881056] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-21T18:52:28.881120] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-21T18:52:28.882564] [DEBUG] [LOCAL ] FTI: Trimmed 77331 records to 53293 (keeping 200 days of data) [2025-10-21T18:52:29.229339] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T18:52:29.253459] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-21T18:52:29.265398] [DEBUG] [LOCAL ] FTI: Primary data saved (53293 records). [2025-10-21T18:52:29.266558] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-21T18:52:29.267469] [INFO ] [MAIN ] Update Progress: 879/2366 symbols completed. FTI took 37.3s. Estimated remaining: 3h 10m 11s. Rate: 7.8 symbols/min [2025-10-21T18:52:30.689067] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T18:52:30.701162] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-21T18:52:32.156971] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T18:52:32.166052] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-21T18:52:33.775804] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T18:52:33.783098] [INFO ] [REMOTE ] FTS: Full fetch complete (60729 records). [2025-10-21T18:52:33.783241] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-21T18:52:34.191609] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-21T18:52:34.191733] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-21T18:52:34.192627] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-21T18:52:34.192724] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-21T18:52:34.194012] [DEBUG] [LOCAL ] FTS: Trimmed 60729 records to 42523 (keeping 200 days of data) [2025-10-21T18:52:34.446905] [DEBUG] [LOCAL ] FTS: Primary data saved (42523 records). [2025-10-21T18:52:34.447032] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-21T18:52:34.447385] [INFO ] [MAIN ] Update Progress: 880/2366 symbols completed. FTS took 25.7s. Estimated remaining: 3h 9m 59s. Rate: 7.8 symbols/min [2025-10-21T18:52:35.209073] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:35.215105] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:35.213308] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:35.212299] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:35.225345] [DEBUG] [LOCAL ] FTWO: Loaded 1955 existing records from primary storage. [2025-10-21T18:52:35.225805] [INFO ] [MAIN ] FTWO: Loaded 1955 existing records. [2025-10-21T18:52:35.446177] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:35.415587] [DEBUG] [LOCAL ] FUL: Loaded 32097 existing records from primary storage. [2025-10-21T18:52:35.461244] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-21T18:52:35.460943] [INFO ] [MAIN ] FUL: Loaded 32097 existing records. [2025-10-21T18:52:35.472965] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-21T18:52:35.532389] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-21T18:52:35.541297] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-21T18:52:35.552942] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-21T18:52:35.644592] [INFO ] [MAIN ] FUBO: Loaded 53718 existing records. [2025-10-21T18:52:35.724260] [DEBUG] [LOCAL ] FTV: Loaded 53059 existing records from primary storage. [2025-10-21T18:52:35.824904] [INFO ] [MAIN ] FTV: Loaded 53059 existing records. [2025-10-21T18:52:36.004150] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:36.085021] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-21T18:52:36.138980] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-21T18:52:36.243719] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:36.207000] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-21T18:52:36.307130] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-21T18:52:36.314293] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-21T18:52:36.320349] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-21T18:52:36.454246] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-21T18:52:36.522201] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:36.591244] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-21T18:52:36.596621] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-21T18:52:36.569260] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-21T18:52:36.591142] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:36.655343] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-21T18:52:36.677548] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-21T18:52:36.677140] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-21T18:52:37.179122] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:37.211446] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-21T18:52:37.483032] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T18:52:37.558273] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-21T18:52:37.640493] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:37.644515] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-21T18:52:37.673790] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:37.674089] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-21T18:52:38.085038] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T18:52:38.086341] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-21T18:52:38.564846] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T18:52:38.566066] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-21T18:52:38.587570] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T18:52:38.594982] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-21T18:52:39.015886] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T18:52:39.017380] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-21T18:52:39.289469] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-21T18:52:39.290876] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-21T18:52:39.363915] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T18:52:39.374545] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-21T18:52:39.877408] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T18:52:39.884063] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-21T18:52:40.055749] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T18:52:40.094520] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-21T18:52:40.151014] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-21T18:52:40.960076] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-21T18:52:40.979864] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T18:52:41.025044] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:52:41.440593] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T18:52:41.751053] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-21T18:52:42.373994] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-21T18:52:42.551006] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-21T18:52:43.208555] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T18:52:43.351041] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-21T18:52:43.775589] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T18:52:44.151043] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-21T18:52:44.237674] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T18:52:44.951036] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-21T18:52:45.751076] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-21T18:52:46.285589] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-21T18:52:46.529697] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:52:46.550989] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-21T18:52:46.695670] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T18:52:47.351061] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-21T18:52:47.487766] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T18:52:47.636369] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-21T18:52:48.151108] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-21T18:52:48.951048] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-21T18:52:49.751093] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-21T18:52:50.341343] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T18:52:50.343630] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-21T18:52:50.345227] [INFO ] [REMOTE ] FTWO: Full fetch complete (3336 records). [2025-10-21T18:52:50.355857] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-21T18:52:50.528554] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T18:52:50.566428] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-21T18:52:50.782444] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-21T18:52:50.782521] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-21T18:52:50.782636] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-21T18:52:50.782717] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-21T18:52:50.783069] [DEBUG] [LOCAL ] FTWO: Trimmed 3336 records to 1964 (keeping 200 days of data) [2025-10-21T18:52:50.795168] [DEBUG] [LOCAL ] FTWO: Primary data saved (1964 records). [2025-10-21T18:52:50.795265] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-21T18:52:50.795342] [INFO ] [MAIN ] Update Progress: 881/2366 symbols completed. FTWO took 16.3s. Estimated remaining: 3h 10m 6s. Rate: 7.8 symbols/min [2025-10-21T18:52:50.982936] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:52:51.030114] [DEBUG] [LOCAL ] FUN: Loaded 52012 existing records from primary storage. [2025-10-21T18:52:51.030410] [INFO ] [MAIN ] FUN: Loaded 52012 existing records. [2025-10-21T18:52:51.203054] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:52:51.203243] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-21T18:52:51.203289] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-21T18:52:51.203595] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-21T18:52:51.203680] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-21T18:52:51.374252] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-21T18:52:51.561038] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:52:52.151065] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-21T18:52:52.914256] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-21T18:52:52.950997] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-21T18:52:53.202469] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:52:53.751056] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-21T18:52:53.779989] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:52:54.551109] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-21T18:52:55.228817] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T18:52:55.350883] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-10-21T18:52:55.351008] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-21T18:52:55.752794] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T18:52:56.151024] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-21T18:52:56.640025] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T18:52:56.951025] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-21T18:52:57.751079] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-21T18:52:58.498808] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-21T18:52:58.550990] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-21T18:52:58.592347] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:52:59.350997] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-21T18:52:59.487347] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T18:53:00.151071] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-21T18:53:00.951041] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-21T18:53:01.103842] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-10-21T18:53:01.231246] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T18:53:01.377937] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T18:53:01.382787] [INFO ] [REMOTE ] FUL: Full fetch complete (47699 records). [2025-10-21T18:53:01.382877] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-21T18:53:01.757719] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-21T18:53:01.758491] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-21T18:53:01.758790] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-21T18:53:01.759512] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-21T18:53:01.759587] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-21T18:53:01.761626] [DEBUG] [LOCAL ] FUL: Trimmed 47699 records to 31998 (keeping 200 days of data) [2025-10-21T18:53:01.972978] [DEBUG] [LOCAL ] FUL: Primary data saved (31998 records). [2025-10-21T18:53:01.973138] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-21T18:53:01.973816] [INFO ] [MAIN ] Update Progress: 882/2366 symbols completed. FUL took 27.5s. Estimated remaining: 3h 10m 4s. Rate: 7.8 symbols/min [2025-10-21T18:53:02.149221] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:02.173398] [DEBUG] [LOCAL ] FVR: Loaded 20901 existing records from primary storage. [2025-10-21T18:53:02.173615] [INFO ] [MAIN ] FVR: Loaded 20901 existing records. [2025-10-21T18:53:02.364960] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:02.365225] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-21T18:53:02.365273] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-21T18:53:02.365455] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-21T18:53:02.365513] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-21T18:53:02.575368] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-21T18:53:02.733535] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:03.196919] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T18:53:03.351028] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-21T18:53:03.980917] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T18:53:04.151074] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-21T18:53:04.400057] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T18:53:04.951044] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-21T18:53:05.143892] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T18:53:05.751042] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-21T18:53:05.911558] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T18:53:06.081321] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T18:53:06.089780] [INFO ] [REMOTE ] FUBO: Full fetch complete (77868 records). [2025-10-21T18:53:06.089930] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-21T18:53:06.505177] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-21T18:53:06.505262] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-21T18:53:06.506193] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-21T18:53:06.506263] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-21T18:53:06.507794] [DEBUG] [LOCAL ] FUBO: Trimmed 77868 records to 53718 (keeping 200 days of data) [2025-10-21T18:53:06.552824] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-21T18:53:06.816195] [DEBUG] [LOCAL ] FUBO: Primary data saved (53718 records). [2025-10-21T18:53:06.816338] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-21T18:53:06.816415] [INFO ] [MAIN ] Update Progress: 883/2366 symbols completed. FUBO took 32.4s. Estimated remaining: 3h 9m 52s. Rate: 7.8 symbols/min [2025-10-21T18:53:06.984116] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:07.026473] [DEBUG] [LOCAL ] FVRR: Loaded 40712 existing records from primary storage. [2025-10-21T18:53:07.026800] [INFO ] [MAIN ] FVRR: Loaded 40712 existing records. [2025-10-21T18:53:07.230877] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:07.231073] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-21T18:53:07.231118] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-21T18:53:07.231365] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-21T18:53:07.231404] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-21T18:53:07.351292] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-21T18:53:07.540621] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T18:53:07.643098] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:07.646578] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T18:53:08.151046] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-21T18:53:08.951005] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-21T18:53:08.984983] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T18:53:09.751009] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-21T18:53:09.940334] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T18:53:09.948533] [INFO ] [REMOTE ] FTV: Full fetch complete (76625 records). [2025-10-21T18:53:09.948699] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-21T18:53:10.350960] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-21T18:53:10.351195] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-21T18:53:10.352185] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-21T18:53:10.352271] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-21T18:53:10.353695] [DEBUG] [LOCAL ] FTV: Trimmed 76625 records to 53034 (keeping 200 days of data) [2025-10-21T18:53:10.568403] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-21T18:53:10.678113] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T18:53:10.726399] [DEBUG] [LOCAL ] FTV: Primary data saved (53034 records). [2025-10-21T18:53:10.726537] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-21T18:53:10.726613] [INFO ] [MAIN ] Update Progress: 884/2366 symbols completed. FTV took 36.3s. Estimated remaining: 3h 9m 38s. Rate: 7.8 symbols/min [2025-10-21T18:53:10.900516] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:10.904383] [DEBUG] [LOCAL ] FXED: Loaded 1237 existing records from primary storage. [2025-10-21T18:53:10.904714] [INFO ] [MAIN ] FXED: Loaded 1237 existing records. [2025-10-21T18:53:11.093065] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:11.093359] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-21T18:53:11.093478] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-21T18:53:11.093631] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-21T18:53:11.093767] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-21T18:53:11.364063] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-21T18:53:11.374156] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T18:53:11.509748] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:11.790083] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T18:53:12.151087] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-21T18:53:12.424223] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-21T18:53:12.941724] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:53:12.950980] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-21T18:53:13.297308] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-21T18:53:13.751080] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-21T18:53:14.551034] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-21T18:53:15.351066] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-21T18:53:15.417991] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:53:15.657808] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T18:53:16.151074] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-21T18:53:16.563154] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-21T18:53:16.950996] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-21T18:53:16.992322] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:53:17.751023] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-21T18:53:18.078988] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T18:53:18.094798] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-21T18:53:18.551079] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-21T18:53:19.351039] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-21T18:53:19.695594] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T18:53:20.150997] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-21T18:53:20.318429] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T18:53:20.951088] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-21T18:53:21.674380] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T18:53:21.751128] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-21T18:53:22.016371] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T18:53:22.551042] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-21T18:53:23.007727] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T18:53:23.351034] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-21T18:53:24.150997] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-21T18:53:24.380354] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T18:53:24.388559] [INFO ] [REMOTE ] FUN: Full fetch complete (73456 records). [2025-10-21T18:53:24.388722] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-21T18:53:24.543319] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-21T18:53:24.826085] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-21T18:53:24.826382] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-21T18:53:24.827575] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-21T18:53:24.827752] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-21T18:53:24.829496] [DEBUG] [LOCAL ] FUN: Trimmed 73456 records to 52023 (keeping 200 days of data) [2025-10-21T18:53:24.947397] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T18:53:24.955743] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-21T18:53:25.160612] [DEBUG] [LOCAL ] FUN: Primary data saved (52023 records). [2025-10-21T18:53:25.160768] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-21T18:53:25.160850] [INFO ] [MAIN ] Update Progress: 885/2366 symbols completed. FUN took 34.4s. Estimated remaining: 3h 9m 41s. Rate: 7.8 symbols/min [2025-10-21T18:53:25.334039] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:25.383354] [DEBUG] [LOCAL ] G: Loaded 50114 existing records from primary storage. [2025-10-21T18:53:25.383739] [INFO ] [MAIN ] G: Loaded 50114 existing records. [2025-10-21T18:53:25.485101] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T18:53:25.573770] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:25.573947] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-21T18:53:25.573993] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-21T18:53:25.574247] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-21T18:53:25.574285] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-21T18:53:25.763355] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-21T18:53:25.955214] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:26.550998] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-21T18:53:26.916444] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T18:53:27.351068] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-21T18:53:27.777322] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T18:53:28.140946] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T18:53:28.152801] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-21T18:53:28.951021] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-21T18:53:29.176434] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:53:29.751046] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-21T18:53:30.551017] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-21T18:53:30.596869] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T18:53:30.674851] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T18:53:31.351027] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-21T18:53:32.163122] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-21T18:53:32.192441] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:53:32.494579] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T18:53:32.498338] [INFO ] [REMOTE ] FVR: Full fetch complete (29308 records). [2025-10-21T18:53:32.498448] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-21T18:53:32.692671] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-21T18:53:32.917968] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-21T18:53:32.918089] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-21T18:53:32.918973] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-21T18:53:32.919044] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-21T18:53:32.920296] [DEBUG] [LOCAL ] FVR: Trimmed 29308 records to 20869 (keeping 200 days of data) [2025-10-21T18:53:32.974736] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-21T18:53:33.064272] [DEBUG] [LOCAL ] FVR: Primary data saved (20869 records). [2025-10-21T18:53:33.064461] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-21T18:53:33.064565] [INFO ] [MAIN ] Update Progress: 886/2366 symbols completed. FVR took 31.1s. Estimated remaining: 3h 9m 34s. Rate: 7.8 symbols/min [2025-10-21T18:53:33.236428] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:33.265147] [DEBUG] [LOCAL ] GAB: Loaded 27744 existing records from primary storage. [2025-10-21T18:53:33.265526] [INFO ] [MAIN ] GAB: Loaded 27744 existing records. [2025-10-21T18:53:33.375046] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-21T18:53:33.386800] [INFO ] [REMOTE ] FXED: Full fetch complete (1792 records). [2025-10-21T18:53:33.392040] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-21T18:53:33.574302] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:33.590188] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-21T18:53:33.620280] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-21T18:53:33.630829] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-21T18:53:33.641024] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-21T18:53:33.760487] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-21T18:53:34.084306] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-21T18:53:34.125680] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-21T18:53:34.139151] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-21T18:53:34.157757] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-21T18:53:34.170109] [DEBUG] [LOCAL ] FXED: Trimmed 1792 records to 1238 (keeping 200 days of data) [2025-10-21T18:53:34.215168] [DEBUG] [LOCAL ] FXED: Primary data saved (1238 records). [2025-10-21T18:53:34.225595] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-21T18:53:34.252608] [INFO ] [MAIN ] Update Progress: 887/2366 symbols completed. FXED took 23.5s. Estimated remaining: 3h 9m 15s. Rate: 7.8 symbols/min [2025-10-21T18:53:34.367061] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:34.475160] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:34.482315] [DEBUG] [LOCAL ] GAM: Loaded 3901 existing records from primary storage. [2025-10-21T18:53:34.482602] [INFO ] [MAIN ] GAM: Loaded 3901 existing records. [2025-10-21T18:53:34.556260] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-21T18:53:34.677403] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:34.677632] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-21T18:53:34.677719] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-21T18:53:34.677913] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-21T18:53:34.677970] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-21T18:53:35.038377] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:35.351009] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-21T18:53:35.643884] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T18:53:36.151078] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-21T18:53:36.211966] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T18:53:36.348193] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:53:36.950993] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-21T18:53:37.565917] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T18:53:37.752402] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-21T18:53:37.754761] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T18:53:38.551031] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-21T18:53:38.860814] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T18:53:39.278237] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T18:53:39.350997] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-21T18:53:39.952883] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T18:53:40.151033] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-21T18:53:40.728346] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T18:53:40.951012] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-21T18:53:41.751054] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-21T18:53:41.932013] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T18:53:42.551037] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-21T18:53:43.351090] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-21T18:53:43.416786] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T18:53:43.423428] [INFO ] [REMOTE ] FVRR: Full fetch complete (59292 records). [2025-10-21T18:53:43.423581] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-21T18:53:43.817260] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-21T18:53:43.817364] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-21T18:53:43.818290] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-21T18:53:43.818387] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-21T18:53:43.836443] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T18:53:43.842973] [DEBUG] [LOCAL ] FVRR: Trimmed 59292 records to 40625 (keeping 200 days of data) [2025-10-21T18:53:44.076857] [DEBUG] [LOCAL ] FVRR: Primary data saved (40625 records). [2025-10-21T18:53:44.076989] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-21T18:53:44.077067] [INFO ] [MAIN ] Update Progress: 888/2366 symbols completed. FVRR took 37.3s. Estimated remaining: 3h 9m 11s. Rate: 7.8 symbols/min [2025-10-21T18:53:44.156228] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-21T18:53:44.246527] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:44.296235] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-21T18:53:44.296519] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-21T18:53:44.470239] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:44.470513] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-21T18:53:44.470577] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-21T18:53:44.470851] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-21T18:53:44.470909] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-21T18:53:44.873425] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:44.873722] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T18:53:44.950985] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-21T18:53:44.998044] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T18:53:45.619762] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T18:53:45.751059] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-21T18:53:46.551074] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-21T18:53:47.351069] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-21T18:53:47.455963] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T18:53:47.916074] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T18:53:48.151099] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-21T18:53:48.264580] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T18:53:48.951048] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-21T18:53:49.751067] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-21T18:53:49.838140] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T18:53:50.230752] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T18:53:50.545769] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:53:50.552745] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-21T18:53:51.351049] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-21T18:53:52.150989] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-21T18:53:52.373815] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T18:53:52.562677] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T18:53:52.865094] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T18:53:52.866302] [INFO ] [REMOTE ] GAM: Full fetch complete (6519 records). [2025-10-21T18:53:52.866391] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-21T18:53:52.956254] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-21T18:53:53.223125] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-21T18:53:53.223225] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-21T18:53:53.223424] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-21T18:53:53.223484] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-21T18:53:53.224049] [DEBUG] [LOCAL ] GAM: Trimmed 6519 records to 3873 (keeping 200 days of data) [2025-10-21T18:53:53.245892] [DEBUG] [LOCAL ] GAM: Primary data saved (3873 records). [2025-10-21T18:53:53.245962] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-21T18:53:53.246029] [INFO ] [MAIN ] Update Progress: 889/2366 symbols completed. GAM took 19.0s. Estimated remaining: 3h 9m 6s. Rate: 7.8 symbols/min [2025-10-21T18:53:53.425547] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:53:53.444615] [DEBUG] [LOCAL ] GATX: Loaded 18106 existing records from primary storage. [2025-10-21T18:53:53.444877] [INFO ] [MAIN ] GATX: Loaded 18106 existing records. [2025-10-21T18:53:53.622258] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:53:53.622443] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-21T18:53:53.622488] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-21T18:53:53.622771] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-21T18:53:53.622833] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-21T18:53:53.760162] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-21T18:53:53.976463] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:53:54.209293] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T18:53:54.551065] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-21T18:53:55.351084] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-21T18:53:55.746603] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T18:53:56.151060] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-21T18:53:56.262573] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T18:53:56.581321] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T18:53:56.951058] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-21T18:53:57.247922] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T18:53:57.751058] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-21T18:53:58.469738] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T18:53:58.550444] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:53:58.557038] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-21T18:53:59.351031] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-21T18:54:00.151006] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-21T18:54:00.578224] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T18:54:00.643481] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T18:54:00.951038] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-21T18:54:01.275534] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T18:54:01.751266] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-21T18:54:02.520131] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T18:54:02.524630] [INFO ] [REMOTE ] GAB: Full fetch complete (39401 records). [2025-10-21T18:54:02.524782] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-21T18:54:02.557342] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-21T18:54:02.900753] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-21T18:54:02.900822] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-21T18:54:02.901381] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-21T18:54:02.901418] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-21T18:54:02.902278] [DEBUG] [LOCAL ] GAB: Trimmed 39401 records to 27631 (keeping 200 days of data) [2025-10-21T18:54:03.056003] [DEBUG] [LOCAL ] GAB: Primary data saved (27631 records). [2025-10-21T18:54:03.056132] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-21T18:54:03.056230] [INFO ] [MAIN ] Update Progress: 890/2366 symbols completed. GAB took 30.0s. Estimated remaining: 3h 9m 2s. Rate: 7.8 symbols/min [2025-10-21T18:54:03.227617] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:03.243748] [DEBUG] [LOCAL ] GBAB: Loaded 12847 existing records from primary storage. [2025-10-21T18:54:03.243946] [INFO ] [MAIN ] GBAB: Loaded 12847 existing records. [2025-10-21T18:54:03.357307] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-21T18:54:03.429350] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:03.430018] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-21T18:54:03.430285] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-21T18:54:03.436026] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-21T18:54:03.440268] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-21T18:54:03.485734] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T18:54:03.843316] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:03.847784] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-21T18:54:04.150998] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-21T18:54:04.951034] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-21T18:54:05.141253] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T18:54:05.184669] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T18:54:05.751087] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-21T18:54:06.540579] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T18:54:06.550982] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-21T18:54:07.350990] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-21T18:54:07.491987] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:54:07.499861] [INFO ] [REMOTE ] G: Full fetch complete (72268 records). [2025-10-21T18:54:07.499976] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-21T18:54:07.799445] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T18:54:07.905438] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-21T18:54:07.905521] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-21T18:54:07.906466] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-21T18:54:07.906531] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-21T18:54:07.907941] [DEBUG] [LOCAL ] G: Trimmed 72268 records to 50109 (keeping 200 days of data) [2025-10-21T18:54:08.151083] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-21T18:54:08.231702] [DEBUG] [LOCAL ] G: Primary data saved (50109 records). [2025-10-21T18:54:08.231853] [INFO ] [MAIN ] G: Full history saved. [2025-10-21T18:54:08.231944] [INFO ] [MAIN ] Update Progress: 891/2366 symbols completed. G took 43.1s. Estimated remaining: 3h 8m 50s. Rate: 7.8 symbols/min [2025-10-21T18:54:08.398502] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:08.437802] [DEBUG] [LOCAL ] GBCI: Loaded 41215 existing records from primary storage. [2025-10-21T18:54:08.438139] [INFO ] [MAIN ] GBCI: Loaded 41215 existing records. [2025-10-21T18:54:08.611760] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:08.611946] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-21T18:54:08.611992] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-21T18:54:08.612188] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-21T18:54:08.612226] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-21T18:54:08.953964] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-21T18:54:08.981767] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:09.098784] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T18:54:09.206374] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T18:54:09.519779] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T18:54:09.751055] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-21T18:54:10.551014] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-21T18:54:10.565009] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T18:54:11.351023] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-21T18:54:11.603495] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T18:54:12.151033] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-21T18:54:12.951133] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-21T18:54:13.161021] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T18:54:13.378434] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T18:54:13.751049] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-21T18:54:13.824209] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T18:54:14.551070] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-21T18:54:14.848032] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T18:54:15.351094] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-21T18:54:16.135557] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T18:54:16.150987] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-21T18:54:16.654343] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T18:54:16.951043] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-21T18:54:17.055812] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T18:54:17.751044] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-21T18:54:18.551039] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-21T18:54:19.008525] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T18:54:19.011250] [INFO ] [REMOTE ] GATX: Full fetch complete (24973 records). [2025-10-21T18:54:19.011339] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-21T18:54:19.374701] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-21T18:54:19.440687] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-21T18:54:19.440932] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-21T18:54:19.452066] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-21T18:54:19.453085] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-21T18:54:19.453164] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-21T18:54:19.454308] [DEBUG] [LOCAL ] GATX: Trimmed 24973 records to 18144 (keeping 200 days of data) [2025-10-21T18:54:19.548388] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T18:54:19.580880] [DEBUG] [LOCAL ] GATX: Primary data saved (18144 records). [2025-10-21T18:54:19.581008] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-21T18:54:19.581084] [INFO ] [MAIN ] Update Progress: 892/2366 symbols completed. GATX took 26.3s. Estimated remaining: 3h 8m 49s. Rate: 7.8 symbols/min [2025-10-21T18:54:19.767797] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:19.768022] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-21T18:54:19.768064] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-21T18:54:19.768180] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-21T18:54:19.768221] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-21T18:54:19.768262] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-21T18:54:19.768297] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-21T18:54:20.149535] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:20.150995] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-21T18:54:20.533608] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-21T18:54:20.829202] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T18:54:20.951095] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-21T18:54:21.274340] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-21T18:54:21.751043] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-21T18:54:22.112150] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T18:54:22.551022] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-21T18:54:22.908446] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T18:54:23.351044] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-21T18:54:24.151049] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-21T18:54:24.951011] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-21T18:54:25.290258] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T18:54:25.299010] [INFO ] [REMOTE ] GAP: Full fetch complete (77812 records). [2025-10-21T18:54:25.299179] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-21T18:54:25.378198] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T18:54:25.742027] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-21T18:54:25.742182] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-21T18:54:25.743827] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-21T18:54:25.745073] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-21T18:54:25.744982] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T18:54:25.752671] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-21T18:54:25.756144] [DEBUG] [LOCAL ] GAP: Trimmed 77812 records to 53653 (keeping 200 days of data) [2025-10-21T18:54:26.078923] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-21T18:54:26.079053] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-21T18:54:26.079745] [INFO ] [MAIN ] Update Progress: 893/2366 symbols completed. GAP took 42.0s. Estimated remaining: 3h 8m 39s. Rate: 7.8 symbols/min [2025-10-21T18:54:26.249494] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:26.289188] [DEBUG] [LOCAL ] GBTG: Loaded 40310 existing records from primary storage. [2025-10-21T18:54:26.289506] [INFO ] [MAIN ] GBTG: Loaded 40310 existing records. [2025-10-21T18:54:26.464691] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:26.464892] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-21T18:54:26.464952] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-21T18:54:26.465300] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-21T18:54:26.465357] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-21T18:54:26.556165] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-21T18:54:26.808170] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T18:54:26.901826] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T18:54:26.901480] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:27.351091] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-21T18:54:28.126619] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T18:54:28.150989] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-21T18:54:28.951047] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-21T18:54:29.271027] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-21T18:54:29.345949] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:54:29.348213] [INFO ] [REMOTE ] GBAB: Full fetch complete (18804 records). [2025-10-21T18:54:29.348292] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-21T18:54:29.717045] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-21T18:54:29.717136] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-21T18:54:29.717564] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-21T18:54:29.717622] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-21T18:54:29.718219] [DEBUG] [LOCAL ] GBAB: Trimmed 18804 records to 12766 (keeping 200 days of data) [2025-10-21T18:54:29.756100] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-21T18:54:29.796488] [DEBUG] [LOCAL ] GBAB: Primary data saved (12766 records). [2025-10-21T18:54:29.796592] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-21T18:54:29.796697] [INFO ] [MAIN ] Update Progress: 894/2366 symbols completed. GBAB took 26.7s. Estimated remaining: 3h 8m 25s. Rate: 7.8 symbols/min [2025-10-21T18:54:29.978494] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:30.007518] [DEBUG] [LOCAL ] GBX: Loaded 28567 existing records from primary storage. [2025-10-21T18:54:30.007920] [INFO ] [MAIN ] GBX: Loaded 28567 existing records. [2025-10-21T18:54:30.200981] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:30.201215] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-21T18:54:30.201263] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-21T18:54:30.201470] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-21T18:54:30.201542] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-21T18:54:30.556717] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-21T18:54:30.590235] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:31.208698] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T18:54:31.351003] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-21T18:54:31.811489] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-21T18:54:32.145866] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:54:32.154166] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-21T18:54:32.951021] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-21T18:54:33.295573] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T18:54:33.652717] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T18:54:33.750987] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-21T18:54:34.550984] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-21T18:54:35.022093] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T18:54:35.351044] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-21T18:54:35.805260] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T18:54:35.805969] [INFO ] [REMOTE ] GBLI: Full fetch complete (1273 records). [2025-10-21T18:54:35.806034] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-21T18:54:35.987952] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-10-21T18:54:35.988190] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T18:54:35.988290] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T18:54:35.988370] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-21T18:54:35.988542] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-21T18:54:35.988627] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-21T18:54:35.988822] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-21T18:54:35.988962] [INFO ] [MAIN ] Update Progress: 895/2366 symbols completed. GBLI took 16.4s. Estimated remaining: 3h 8m 15s. Rate: 7.8 symbols/min [2025-10-21T18:54:36.166021] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:36.162691] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-21T18:54:36.192979] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T18:54:36.234163] [DEBUG] [LOCAL ] GCI: Loaded 43764 existing records from primary storage. [2025-10-21T18:54:36.234435] [INFO ] [MAIN ] GCI: Loaded 43764 existing records. [2025-10-21T18:54:36.407713] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:36.407947] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-21T18:54:36.407998] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-21T18:54:36.408269] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-21T18:54:36.408324] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-21T18:54:36.756897] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:36.950982] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-21T18:54:37.426093] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T18:54:37.751105] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-21T18:54:38.264322] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T18:54:38.551095] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-21T18:54:38.837113] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T18:54:39.351085] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-21T18:54:40.099259] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T18:54:40.151043] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-21T18:54:40.408570] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T18:54:40.951024] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-21T18:54:41.352891] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T18:54:41.751065] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-21T18:54:42.367152] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T18:54:42.551032] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-21T18:54:43.078980] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T18:54:43.350996] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-21T18:54:44.031736] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T18:54:44.150999] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-21T18:54:44.951012] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-21T18:54:45.012318] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T18:54:45.676163] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T18:54:45.751020] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-21T18:54:46.262938] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T18:54:46.500017] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T18:54:46.550986] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-21T18:54:47.351064] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-21T18:54:47.945883] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T18:54:48.151033] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-21T18:54:48.833494] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:54:48.951026] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-21T18:54:49.259994] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T18:54:49.751096] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-21T18:54:50.551090] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-21T18:54:50.632254] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T18:54:50.831299] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T18:54:51.351095] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-21T18:54:52.152071] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-21T18:54:52.155549] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:54:52.950991] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-21T18:54:53.040785] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T18:54:53.291450] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T18:54:53.295607] [INFO ] [REMOTE ] GBX: Full fetch complete (42797 records). [2025-10-21T18:54:53.295721] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-21T18:54:53.663092] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-21T18:54:53.663170] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-21T18:54:53.663829] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-21T18:54:53.663889] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-21T18:54:53.664911] [DEBUG] [LOCAL ] GBX: Trimmed 42797 records to 28402 (keeping 200 days of data) [2025-10-21T18:54:53.752893] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-21T18:54:53.833039] [DEBUG] [LOCAL ] GBX: Primary data saved (28402 records). [2025-10-21T18:54:53.833164] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-21T18:54:53.833235] [INFO ] [MAIN ] Update Progress: 896/2366 symbols completed. GBX took 24.0s. Estimated remaining: 3h 8m 24s. Rate: 7.8 symbols/min [2025-10-21T18:54:54.004047] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:54.004241] [DEBUG] [LOCAL ] GCO: No existing data file found in primary storage. [2025-10-21T18:54:54.004290] [WARN ] [MAIN ] GCO: No existing data found, performing full refresh instead. [2025-10-21T18:54:54.004400] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-21T18:54:54.004441] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-21T18:54:54.004480] [DEBUG] [LOCAL ] GCO: No primary data file found to delete. [2025-10-21T18:54:54.004511] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-21T18:54:54.365727] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:54.388698] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T18:54:54.551040] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-21T18:54:55.315123] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T18:54:55.350986] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-21T18:54:55.915557] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T18:54:56.151008] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-21T18:54:56.951055] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-21T18:54:57.089467] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T18:54:57.097088] [INFO ] [REMOTE ] GBCI: Full fetch complete (59434 records). [2025-10-21T18:54:57.097226] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-21T18:54:57.505040] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-21T18:54:57.505219] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-21T18:54:57.506054] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-21T18:54:57.506138] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-21T18:54:57.522230] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T18:54:57.527334] [DEBUG] [LOCAL ] GBCI: Trimmed 59434 records to 41232 (keeping 200 days of data) [2025-10-21T18:54:57.751093] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-21T18:54:57.776015] [DEBUG] [LOCAL ] GBCI: Primary data saved (41232 records). [2025-10-21T18:54:57.776114] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-21T18:54:57.776193] [INFO ] [MAIN ] Update Progress: 897/2366 symbols completed. GBCI took 49.5s. Estimated remaining: 3h 8m 10s. Rate: 7.8 symbols/min [2025-10-21T18:54:57.943718] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:54:57.963830] [DEBUG] [LOCAL ] GCTS: Loaded 20245 existing records from primary storage. [2025-10-21T18:54:57.964057] [INFO ] [MAIN ] GCTS: Loaded 20245 existing records. [2025-10-21T18:54:58.139112] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:54:58.139305] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-21T18:54:58.139351] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-21T18:54:58.139500] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-21T18:54:58.139537] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-21T18:54:58.501613] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:54:58.550978] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-21T18:54:58.812022] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:54:59.261437] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-21T18:54:59.307564] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T18:54:59.351004] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-21T18:55:00.151026] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-21T18:55:00.312325] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T18:55:00.951027] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-21T18:55:01.750998] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-21T18:55:01.953798] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T18:55:02.149559] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T18:55:02.156734] [INFO ] [REMOTE ] GBTG: Full fetch complete (56802 records). [2025-10-21T18:55:02.156909] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-21T18:55:02.553160] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-21T18:55:02.596725] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-21T18:55:02.596854] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-21T18:55:02.597924] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-21T18:55:02.598138] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-21T18:55:02.612284] [DEBUG] [LOCAL ] GBTG: Trimmed 56802 records to 40249 (keeping 200 days of data) [2025-10-21T18:55:02.612920] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T18:55:02.858564] [DEBUG] [LOCAL ] GBTG: Primary data saved (40249 records). [2025-10-21T18:55:02.858724] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-21T18:55:02.858813] [INFO ] [MAIN ] Update Progress: 898/2366 symbols completed. GBTG took 36.8s. Estimated remaining: 3h 7m 58s. Rate: 7.8 symbols/min [2025-10-21T18:55:03.046480] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:03.057743] [DEBUG] [LOCAL ] GCV: Loaded 7831 existing records from primary storage. [2025-10-21T18:55:03.058012] [INFO ] [MAIN ] GCV: Loaded 7831 existing records. [2025-10-21T18:55:03.260842] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:03.261108] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-21T18:55:03.261179] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-21T18:55:03.261355] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-21T18:55:03.261418] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-21T18:55:03.356189] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-21T18:55:03.669458] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:04.150998] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-21T18:55:04.310087] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:55:04.432606] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T18:55:04.951008] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-21T18:55:05.179195] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T18:55:05.750994] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-21T18:55:05.917352] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T18:55:06.551045] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-21T18:55:07.351034] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-21T18:55:07.394431] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T18:55:07.977452] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:55:08.038822] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T18:55:08.151048] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-21T18:55:08.951047] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-21T18:55:09.324803] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T18:55:09.751030] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-21T18:55:10.551021] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-21T18:55:10.616354] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:55:10.992169] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T18:55:11.344152] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T18:55:11.350974] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-21T18:55:12.151077] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-21T18:55:12.951035] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-21T18:55:13.009418] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T18:55:13.037206] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:55:13.751106] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-21T18:55:14.344248] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T18:55:14.551027] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-21T18:55:15.351040] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-21T18:55:15.442574] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T18:55:15.449900] [INFO ] [REMOTE ] GCI: Full fetch complete (63284 records). [2025-10-21T18:55:15.450059] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-21T18:55:15.709209] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T18:55:15.862908] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-21T18:55:15.862996] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-21T18:55:15.863824] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-21T18:55:15.863886] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-21T18:55:15.865209] [DEBUG] [LOCAL ] GCI: Trimmed 63284 records to 43632 (keeping 200 days of data) [2025-10-21T18:55:16.105217] [DEBUG] [LOCAL ] GCI: Primary data saved (43632 records). [2025-10-21T18:55:16.105348] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-21T18:55:16.105988] [INFO ] [MAIN ] Update Progress: 899/2366 symbols completed. GCI took 40.1s. Estimated remaining: 3h 7m 59s. Rate: 7.8 symbols/min [2025-10-21T18:55:16.161363] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-21T18:55:16.281573] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:16.325233] [DEBUG] [LOCAL ] GD: Loaded 46577 existing records from primary storage. [2025-10-21T18:55:16.325509] [INFO ] [MAIN ] GD: Loaded 46577 existing records. [2025-10-21T18:55:16.501439] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:16.501632] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-21T18:55:16.501730] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-21T18:55:16.501976] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-21T18:55:16.502032] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-21T18:55:16.846011] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T18:55:16.881046] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:16.950974] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-21T18:55:17.107393] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T18:55:17.751028] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-21T18:55:18.551056] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-21T18:55:18.756917] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T18:55:18.832157] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T18:55:19.015047] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:55:19.351025] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-21T18:55:20.151033] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-21T18:55:20.951097] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-21T18:55:21.098634] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T18:55:21.164287] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T18:55:21.751034] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-21T18:55:22.124674] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T18:55:22.128019] [INFO ] [REMOTE ] GCTS: Full fetch complete (26748 records). [2025-10-21T18:55:22.128104] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-21T18:55:22.496623] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-21T18:55:22.496755] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-21T18:55:22.497272] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-21T18:55:22.497311] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-21T18:55:22.498075] [DEBUG] [LOCAL ] GCTS: Trimmed 26748 records to 20218 (keeping 200 days of data) [2025-10-21T18:55:22.575741] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-21T18:55:22.614034] [DEBUG] [LOCAL ] GCTS: Primary data saved (20218 records). [2025-10-21T18:55:22.614140] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-21T18:55:22.614213] [INFO ] [MAIN ] Update Progress: 900/2366 symbols completed. GCTS took 24.8s. Estimated remaining: 3h 7m 50s. Rate: 7.8 symbols/min [2025-10-21T18:55:22.808321] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:22.854140] [DEBUG] [LOCAL ] GDDY: Loaded 49758 existing records from primary storage. [2025-10-21T18:55:22.854433] [INFO ] [MAIN ] GDDY: Loaded 49758 existing records. [2025-10-21T18:55:23.032189] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:23.032404] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-21T18:55:23.037090] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-21T18:55:23.037691] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-21T18:55:23.039911] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-21T18:55:23.040281] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-21T18:55:23.351271] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-21T18:55:23.408070] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:23.439411] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T18:55:24.134465] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T18:55:24.150989] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-21T18:55:24.951047] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-21T18:55:25.751028] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-21T18:55:25.820480] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T18:55:26.201061] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T18:55:26.551073] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-21T18:55:26.793328] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T18:55:27.214151] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:55:27.351030] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-21T18:55:28.151060] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-21T18:55:28.404908] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T18:55:28.604289] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T18:55:28.951013] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-21T18:55:29.751036] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-21T18:55:29.803035] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T18:55:29.805192] [INFO ] [REMOTE ] GCV: Full fetch complete (9876 records). [2025-10-21T18:55:29.805268] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-21T18:55:30.171384] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-21T18:55:30.171462] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-21T18:55:30.171718] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-21T18:55:30.171778] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-21T18:55:30.172209] [DEBUG] [LOCAL ] GCV: Trimmed 9876 records to 7809 (keeping 200 days of data) [2025-10-21T18:55:30.217377] [DEBUG] [LOCAL ] GCV: Primary data saved (7809 records). [2025-10-21T18:55:30.217508] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-21T18:55:30.217584] [INFO ] [MAIN ] Update Progress: 901/2366 symbols completed. GCV took 27.4s. Estimated remaining: 3h 7m 42s. Rate: 7.8 symbols/min [2025-10-21T18:55:30.390473] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:30.396630] [DEBUG] [LOCAL ] GDIV: Loaded 3580 existing records from primary storage. [2025-10-21T18:55:30.396841] [INFO ] [MAIN ] GDIV: Loaded 3580 existing records. [2025-10-21T18:55:30.554781] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-21T18:55:30.578626] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:30.579016] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-21T18:55:30.579084] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-21T18:55:30.579209] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-21T18:55:30.579246] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-21T18:55:30.768779] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T18:55:30.855522] [INFO ] [REMOTE ] GCO: Full fetch complete (34763 records). [2025-10-21T18:55:30.877952] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-21T18:55:31.064514] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:31.341102] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-21T18:55:31.341179] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-21T18:55:31.341790] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-21T18:55:31.341850] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-21T18:55:31.342682] [DEBUG] [LOCAL ] GCO: Trimmed 34763 records to 23035 (keeping 200 days of data) [2025-10-21T18:55:31.389778] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-21T18:55:31.476210] [DEBUG] [LOCAL ] GCO: Primary data saved (23035 records). [2025-10-21T18:55:31.476339] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-21T18:55:31.476409] [INFO ] [MAIN ] Update Progress: 902/2366 symbols completed. GCO took 37.6s. Estimated remaining: 3h 7m 24s. Rate: 7.8 symbols/min [2025-10-21T18:55:31.672988] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:31.677689] [DEBUG] [LOCAL ] GDL: Loaded 2525 existing records from primary storage. [2025-10-21T18:55:31.677879] [INFO ] [MAIN ] GDL: Loaded 2525 existing records. [2025-10-21T18:55:31.865627] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:31.865844] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-21T18:55:31.865892] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-21T18:55:31.866013] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-21T18:55:31.866051] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-21T18:55:32.151502] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-21T18:55:32.234332] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:32.367499] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T18:55:32.667934] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T18:55:32.838096] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T18:55:32.951021] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-21T18:55:33.751070] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-21T18:55:34.551012] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-21T18:55:34.782901] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T18:55:35.173060] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T18:55:35.351090] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-21T18:55:35.534896] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T18:55:35.661359] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-21T18:55:36.151030] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-21T18:55:36.598446] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T18:55:36.951097] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-21T18:55:37.590724] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T18:55:37.750992] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-21T18:55:38.371914] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T18:55:38.551013] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-21T18:55:39.158822] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T18:55:39.351103] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-21T18:55:40.151063] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-21T18:55:40.951102] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-21T18:55:41.418927] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T18:55:41.483409] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-21T18:55:41.750997] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-21T18:55:41.848091] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:55:42.551025] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-21T18:55:43.050750] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T18:55:43.062844] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-21T18:55:43.351035] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-21T18:55:43.819689] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-21T18:55:44.151052] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-21T18:55:44.951071] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-21T18:55:45.485923] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T18:55:45.753317] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-21T18:55:45.755902] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T18:55:46.288398] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-21T18:55:46.551098] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-21T18:55:47.351000] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-21T18:55:47.426366] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T18:55:47.433387] [INFO ] [REMOTE ] GD: Full fetch complete (69683 records). [2025-10-21T18:55:47.433522] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-21T18:55:47.834852] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-21T18:55:47.834983] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-21T18:55:47.835879] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-21T18:55:47.835941] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-21T18:55:47.837269] [DEBUG] [LOCAL ] GD: Trimmed 69683 records to 46538 (keeping 200 days of data) [2025-10-21T18:55:47.930875] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:55:48.133910] [DEBUG] [LOCAL ] GD: Primary data saved (46538 records). [2025-10-21T18:55:48.134052] [INFO ] [MAIN ] GD: Full history saved. [2025-10-21T18:55:48.135147] [INFO ] [MAIN ] Update Progress: 903/2366 symbols completed. GD took 32.0s. Estimated remaining: 3h 7m 30s. Rate: 7.8 symbols/min [2025-10-21T18:55:48.159521] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-21T18:55:48.319399] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:48.327460] [DEBUG] [LOCAL ] GDO: Loaded 5840 existing records from primary storage. [2025-10-21T18:55:48.327694] [INFO ] [MAIN ] GDO: Loaded 5840 existing records. [2025-10-21T18:55:48.505122] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:48.505342] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-21T18:55:48.505409] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-21T18:55:48.505682] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-21T18:55:48.505755] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-21T18:55:48.860825] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:48.951052] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-21T18:55:49.414203] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:55:49.750989] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-21T18:55:50.026897] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T18:55:50.551060] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-21T18:55:50.720055] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T18:55:51.351032] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-21T18:55:51.796083] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T18:55:51.970251] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T18:55:52.151025] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-21T18:55:52.782293] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T18:55:52.783739] [INFO ] [REMOTE ] GDIV: Full fetch complete (5418 records). [2025-10-21T18:55:52.783837] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-21T18:55:52.956381] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-21T18:55:53.147000] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-21T18:55:53.147076] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-21T18:55:53.147248] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-21T18:55:53.147287] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-21T18:55:53.147676] [DEBUG] [LOCAL ] GDIV: Trimmed 5418 records to 3542 (keeping 200 days of data) [2025-10-21T18:55:53.168677] [DEBUG] [LOCAL ] GDIV: Primary data saved (3542 records). [2025-10-21T18:55:53.168769] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-21T18:55:53.168858] [INFO ] [MAIN ] Update Progress: 904/2366 symbols completed. GDIV took 23.0s. Estimated remaining: 3h 7m 19s. Rate: 7.8 symbols/min [2025-10-21T18:55:53.343332] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:55:53.378214] [DEBUG] [LOCAL ] GDOT: Loaded 37755 existing records from primary storage. [2025-10-21T18:55:53.378480] [INFO ] [MAIN ] GDOT: Loaded 37755 existing records. [2025-10-21T18:55:53.560918] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T18:55:53.560628] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:55:53.563246] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-21T18:55:53.563305] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-21T18:55:53.563688] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-21T18:55:53.563745] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-21T18:55:53.756205] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-21T18:55:53.930775] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:55:54.436005] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T18:55:54.551058] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-21T18:55:55.241609] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T18:55:55.351068] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-21T18:55:55.937926] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T18:55:56.151061] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-21T18:55:56.951031] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-21T18:55:57.444231] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:55:57.569808] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T18:55:57.751029] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-21T18:55:58.294147] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T18:55:58.551017] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-21T18:55:59.147604] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T18:55:59.351029] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-21T18:56:00.151049] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-21T18:56:00.756026] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T18:56:00.950989] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-21T18:56:01.392434] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-21T18:56:01.571783] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T18:56:01.751051] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-21T18:56:02.417991] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T18:56:02.418911] [INFO ] [REMOTE ] GDL: Full fetch complete (3484 records). [2025-10-21T18:56:02.418976] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-21T18:56:02.559700] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-21T18:56:02.782798] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-21T18:56:02.782875] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-21T18:56:02.783000] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-21T18:56:02.783039] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-21T18:56:02.783378] [DEBUG] [LOCAL ] GDL: Trimmed 3484 records to 2519 (keeping 200 days of data) [2025-10-21T18:56:02.798637] [DEBUG] [LOCAL ] GDL: Primary data saved (2519 records). [2025-10-21T18:56:02.798727] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-21T18:56:02.798796] [INFO ] [MAIN ] Update Progress: 905/2366 symbols completed. GDL took 31.3s. Estimated remaining: 3h 7m 14s. Rate: 7.8 symbols/min [2025-10-21T18:56:02.972882] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:02.991012] [DEBUG] [LOCAL ] GDV: Loaded 19418 existing records from primary storage. [2025-10-21T18:56:02.991266] [INFO ] [MAIN ] GDV: Loaded 19418 existing records. [2025-10-21T18:56:03.176437] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:03.176695] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-21T18:56:03.176753] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-21T18:56:03.176980] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-21T18:56:03.177036] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-21T18:56:03.351996] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-21T18:56:03.539823] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:03.753015] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T18:56:04.156910] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:56:04.156032] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-21T18:56:04.951012] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-21T18:56:05.751002] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-21T18:56:06.041357] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T18:56:06.262507] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T18:56:06.355902] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T18:56:06.551272] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-21T18:56:07.185775] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T18:56:07.187169] [INFO ] [REMOTE ] GDO: Full fetch complete (8503 records). [2025-10-21T18:56:07.187251] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-21T18:56:07.367710] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-21T18:56:07.613528] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-21T18:56:07.613607] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-21T18:56:07.613867] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-21T18:56:07.613928] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-21T18:56:07.614341] [DEBUG] [LOCAL ] GDO: Trimmed 8503 records to 5860 (keeping 200 days of data) [2025-10-21T18:56:07.650436] [DEBUG] [LOCAL ] GDO: Primary data saved (5860 records). [2025-10-21T18:56:07.650571] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-21T18:56:07.650672] [INFO ] [MAIN ] Update Progress: 906/2366 symbols completed. GDO took 19.5s. Estimated remaining: 3h 7m 2s. Rate: 7.8 symbols/min [2025-10-21T18:56:07.836827] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:07.894386] [DEBUG] [LOCAL ] GE: Loaded 53698 existing records from primary storage. [2025-10-21T18:56:07.894716] [INFO ] [MAIN ] GE: Loaded 53698 existing records. [2025-10-21T18:56:08.073199] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:08.073404] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-21T18:56:08.073449] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-21T18:56:08.073874] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-21T18:56:08.073931] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-21T18:56:08.156236] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-21T18:56:08.423017] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:08.950997] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-21T18:56:09.131776] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T18:56:09.572585] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T18:56:09.751010] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-21T18:56:10.551075] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-21T18:56:11.078307] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-21T18:56:11.155253] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T18:56:11.163124] [INFO ] [REMOTE ] GDDY: Full fetch complete (72127 records). [2025-10-21T18:56:11.163236] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-21T18:56:11.275313] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T18:56:11.356111] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-21T18:56:11.568941] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-21T18:56:11.569028] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-21T18:56:11.569920] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-21T18:56:11.569983] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-21T18:56:11.571338] [DEBUG] [LOCAL ] GDDY: Trimmed 72127 records to 49671 (keeping 200 days of data) [2025-10-21T18:56:11.859088] [DEBUG] [LOCAL ] GDDY: Primary data saved (49671 records). [2025-10-21T18:56:11.859214] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-21T18:56:11.859289] [INFO ] [MAIN ] Update Progress: 907/2366 symbols completed. GDDY took 49.2s. Estimated remaining: 3h 6m 48s. Rate: 7.8 symbols/min [2025-10-21T18:56:12.025166] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:12.045839] [DEBUG] [LOCAL ] GEF: Loaded 20852 existing records from primary storage. [2025-10-21T18:56:12.046072] [INFO ] [MAIN ] GEF: Loaded 20852 existing records. [2025-10-21T18:56:12.156223] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-21T18:56:12.227179] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:12.227375] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-21T18:56:12.227421] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-21T18:56:12.227604] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-21T18:56:12.227692] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-21T18:56:12.578762] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:12.951004] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-21T18:56:12.979952] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T18:56:13.751019] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-21T18:56:13.995880] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T18:56:14.173001] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-21T18:56:14.551034] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-21T18:56:14.754460] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T18:56:15.351033] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-21T18:56:16.151003] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-21T18:56:16.473121] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T18:56:16.674695] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-21T18:56:16.840471] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T18:56:16.951001] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-21T18:56:17.751003] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-21T18:56:18.062184] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T18:56:18.551007] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-21T18:56:18.767467] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T18:56:19.351028] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-21T18:56:20.026163] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T18:56:20.151005] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-21T18:56:20.358506] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T18:56:20.951027] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-21T18:56:21.751011] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-21T18:56:22.050440] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T18:56:22.326531] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T18:56:22.551036] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-21T18:56:23.113300] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T18:56:23.351051] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-21T18:56:23.577614] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T18:56:24.151057] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-21T18:56:24.881757] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T18:56:24.950989] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-21T18:56:25.189070] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T18:56:25.751050] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-21T18:56:25.854852] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T18:56:26.551053] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-21T18:56:27.351052] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-21T18:56:27.559775] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T18:56:27.937252] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-21T18:56:28.151030] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-21T18:56:28.523012] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T18:56:28.951015] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-21T18:56:29.625810] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T18:56:29.733027] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T18:56:29.750992] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-21T18:56:30.551023] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-21T18:56:30.769584] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:56:31.351028] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-21T18:56:31.522243] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T18:56:31.525276] [INFO ] [REMOTE ] GDV: Full fetch complete (28393 records). [2025-10-21T18:56:31.525355] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-21T18:56:31.895243] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-21T18:56:31.895318] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-21T18:56:31.895870] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-21T18:56:31.895951] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-21T18:56:31.896600] [DEBUG] [LOCAL ] GDV: Trimmed 28393 records to 19319 (keeping 200 days of data) [2025-10-21T18:56:32.012226] [DEBUG] [LOCAL ] GDV: Primary data saved (19319 records). [2025-10-21T18:56:32.012320] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-21T18:56:32.012398] [INFO ] [MAIN ] Update Progress: 908/2366 symbols completed. GDV took 29.2s. Estimated remaining: 3h 7m 1s. Rate: 7.8 symbols/min [2025-10-21T18:56:32.158989] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-21T18:56:32.189161] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:32.222863] [DEBUG] [LOCAL ] GEL: Loaded 31500 existing records from primary storage. [2025-10-21T18:56:32.223139] [INFO ] [MAIN ] GEL: Loaded 31500 existing records. [2025-10-21T18:56:32.340772] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T18:56:32.427094] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:32.427323] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-21T18:56:32.427394] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-21T18:56:32.427628] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-21T18:56:32.427734] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-21T18:56:32.780027] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:32.951018] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-21T18:56:33.751035] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-21T18:56:34.350366] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T18:56:34.435678] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T18:56:34.551046] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-21T18:56:34.858092] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T18:56:34.861619] [INFO ] [REMOTE ] GEF: Full fetch complete (29325 records). [2025-10-21T18:56:34.861752] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-21T18:56:35.244414] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-21T18:56:35.244517] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-21T18:56:35.245157] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-21T18:56:35.245219] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-21T18:56:35.245956] [DEBUG] [LOCAL ] GEF: Trimmed 29325 records to 20751 (keeping 200 days of data) [2025-10-21T18:56:35.351703] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-21T18:56:35.370076] [DEBUG] [LOCAL ] GEF: Primary data saved (20751 records). [2025-10-21T18:56:35.370206] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-21T18:56:35.370306] [INFO ] [MAIN ] Update Progress: 909/2366 symbols completed. GEF took 23.5s. Estimated remaining: 3h 6m 46s. Rate: 7.8 symbols/min [2025-10-21T18:56:35.538526] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:35.586952] [DEBUG] [LOCAL ] GENI: Loaded 52943 existing records from primary storage. [2025-10-21T18:56:35.587249] [INFO ] [MAIN ] GENI: Loaded 52943 existing records. [2025-10-21T18:56:35.764469] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:35.764719] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-21T18:56:35.764776] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-21T18:56:35.765125] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-21T18:56:35.765182] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-21T18:56:36.126019] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:36.150986] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-21T18:56:36.201635] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T18:56:36.207616] [INFO ] [REMOTE ] GDOT: Full fetch complete (53644 records). [2025-10-21T18:56:36.207733] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-21T18:56:36.586498] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-21T18:56:36.586572] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-21T18:56:36.587318] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-21T18:56:36.587378] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-21T18:56:36.588499] [DEBUG] [LOCAL ] GDOT: Trimmed 53644 records to 37710 (keeping 200 days of data) [2025-10-21T18:56:36.705741] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T18:56:36.826433] [DEBUG] [LOCAL ] GDOT: Primary data saved (37710 records). [2025-10-21T18:56:36.826559] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-21T18:56:36.826634] [INFO ] [MAIN ] Update Progress: 910/2366 symbols completed. GDOT took 43.7s. Estimated remaining: 3h 6m 28s. Rate: 7.8 symbols/min [2025-10-21T18:56:36.965410] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-21T18:56:36.996119] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:37.043427] [DEBUG] [LOCAL ] GEO: Loaded 51753 existing records from primary storage. [2025-10-21T18:56:37.043767] [INFO ] [MAIN ] GEO: Loaded 51753 existing records. [2025-10-21T18:56:37.220937] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:37.221176] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-21T18:56:37.221250] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-21T18:56:37.221514] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-21T18:56:37.221553] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-21T18:56:37.596068] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:37.750991] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-21T18:56:37.845213] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T18:56:38.260256] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T18:56:38.551038] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-21T18:56:39.351055] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-21T18:56:39.717568] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T18:56:40.156823] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-21T18:56:40.174481] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T18:56:40.951082] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-21T18:56:41.703894] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-21T18:56:41.742035] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T18:56:41.750980] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-21T18:56:42.550999] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-21T18:56:42.800381] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:56:43.003373] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T18:56:43.351031] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-21T18:56:44.151000] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-21T18:56:44.344974] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T18:56:44.951130] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-21T18:56:45.016022] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:56:45.499015] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T18:56:45.751027] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-21T18:56:46.551005] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-21T18:56:46.802660] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T18:56:47.351053] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-21T18:56:47.925353] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-21T18:56:47.991421] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T18:56:48.150993] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-21T18:56:48.951003] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-21T18:56:49.215916] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T18:56:49.621180] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T18:56:49.750999] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-21T18:56:50.551044] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-21T18:56:51.127855] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T18:56:51.357504] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-21T18:56:51.362384] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T18:56:52.151043] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-21T18:56:52.284691] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T18:56:52.293169] [INFO ] [REMOTE ] GE: Full fetch complete (77865 records). [2025-10-21T18:56:52.293321] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-21T18:56:52.704758] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T18:56:52.738132] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-21T18:56:52.738549] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-21T18:56:52.739501] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-21T18:56:52.739584] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-21T18:56:52.741050] [DEBUG] [LOCAL ] GE: Trimmed 77865 records to 53698 (keeping 200 days of data) [2025-10-21T18:56:52.953317] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-21T18:56:53.074377] [DEBUG] [LOCAL ] GE: Primary data saved (53698 records). [2025-10-21T18:56:53.074501] [INFO ] [MAIN ] GE: Full history saved. [2025-10-21T18:56:53.075197] [INFO ] [MAIN ] Update Progress: 911/2366 symbols completed. GE took 45.4s. Estimated remaining: 3h 6m 34s. Rate: 7.8 symbols/min [2025-10-21T18:56:53.257986] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:53.294181] [DEBUG] [LOCAL ] GES: Loaded 38154 existing records from primary storage. [2025-10-21T18:56:53.294450] [INFO ] [MAIN ] GES: Loaded 38154 existing records. [2025-10-21T18:56:53.407980] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T18:56:53.491489] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:53.491769] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-21T18:56:53.491822] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-21T18:56:53.492105] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-21T18:56:53.492143] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-21T18:56:53.759272] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-21T18:56:53.846701] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:54.551059] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-21T18:56:54.803084] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T18:56:55.070815] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T18:56:55.074598] [INFO ] [REMOTE ] GEL: Full fetch complete (48043 records). [2025-10-21T18:56:55.074725] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-21T18:56:55.358262] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-21T18:56:55.454887] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-21T18:56:55.454970] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-21T18:56:55.455676] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-21T18:56:55.455737] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-21T18:56:55.456708] [DEBUG] [LOCAL ] GEL: Trimmed 48043 records to 31309 (keeping 200 days of data) [2025-10-21T18:56:55.642944] [DEBUG] [LOCAL ] GEL: Primary data saved (31309 records). [2025-10-21T18:56:55.643068] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-21T18:56:55.643681] [INFO ] [MAIN ] Update Progress: 912/2366 symbols completed. GEL took 23.6s. Estimated remaining: 3h 6m 19s. Rate: 7.8 symbols/min [2025-10-21T18:56:55.816016] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:56:55.842422] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T18:56:55.880488] [DEBUG] [LOCAL ] GETY: Loaded 35268 existing records from primary storage. [2025-10-21T18:56:55.880774] [INFO ] [MAIN ] GETY: Loaded 35268 existing records. [2025-10-21T18:56:56.053847] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:56:56.054041] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-21T18:56:56.054087] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-21T18:56:56.054300] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-21T18:56:56.054355] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-21T18:56:56.152509] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-21T18:56:56.407586] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:56:56.951032] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-21T18:56:57.268989] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T18:56:57.550683] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T18:56:57.751029] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-21T18:56:58.473947] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T18:56:58.551014] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-21T18:56:59.350991] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-21T18:56:59.506259] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T18:57:00.151049] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-21T18:57:00.483434] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T18:57:00.951056] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-21T18:57:01.180737] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T18:57:01.751087] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-21T18:57:02.264814] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T18:57:02.551062] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-21T18:57:02.731887] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T18:57:03.351073] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-21T18:57:03.478126] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T18:57:04.150999] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-21T18:57:04.202197] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T18:57:04.666291] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T18:57:04.951061] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-21T18:57:05.685118] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T18:57:05.750992] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-21T18:57:05.986455] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T18:57:06.551017] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-21T18:57:07.350997] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-21T18:57:07.552123] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T18:57:08.151046] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-21T18:57:08.411818] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T18:57:08.756397] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T18:57:08.951099] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-21T18:57:09.613604] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T18:57:09.751071] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-21T18:57:10.550988] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-21T18:57:10.790396] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T18:57:11.350985] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-21T18:57:11.529004] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T18:57:11.536915] [INFO ] [REMOTE ] GEO: Full fetch complete (75538 records). [2025-10-21T18:57:11.537055] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-21T18:57:11.928170] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-21T18:57:11.928253] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-21T18:57:11.929178] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-21T18:57:11.929275] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-21T18:57:11.930661] [DEBUG] [LOCAL ] GEO: Trimmed 75538 records to 51739 (keeping 200 days of data) [2025-10-21T18:57:12.158434] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-21T18:57:12.163539] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T18:57:12.259724] [DEBUG] [LOCAL ] GEO: Primary data saved (51739 records). [2025-10-21T18:57:12.259865] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-21T18:57:12.260788] [INFO ] [MAIN ] Update Progress: 913/2366 symbols completed. GEO took 35.4s. Estimated remaining: 3h 6m 25s. Rate: 7.8 symbols/min [2025-10-21T18:57:12.431073] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:12.490567] [DEBUG] [LOCAL ] GEV: Loaded 52992 existing records from primary storage. [2025-10-21T18:57:12.491066] [INFO ] [MAIN ] GEV: Loaded 52992 existing records. [2025-10-21T18:57:12.672892] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:12.673099] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-21T18:57:12.673146] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-21T18:57:12.673367] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-21T18:57:12.673424] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-21T18:57:12.958083] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-21T18:57:13.039319] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:13.535359] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T18:57:13.543868] [INFO ] [REMOTE ] GENI: Full fetch complete (76087 records). [2025-10-21T18:57:13.544002] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-21T18:57:13.733888] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T18:57:13.753900] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-21T18:57:13.987025] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-21T18:57:13.987115] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-21T18:57:13.988083] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-21T18:57:13.988210] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-21T18:57:13.989630] [DEBUG] [LOCAL ] GENI: Trimmed 76087 records to 52937 (keeping 200 days of data) [2025-10-21T18:57:14.293624] [DEBUG] [LOCAL ] GENI: Primary data saved (52937 records). [2025-10-21T18:57:14.293800] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-21T18:57:14.293885] [INFO ] [MAIN ] Update Progress: 914/2366 symbols completed. GENI took 38.9s. Estimated remaining: 3h 6m 8s. Rate: 7.8 symbols/min [2025-10-21T18:57:14.478389] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:14.500395] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T18:57:14.502337] [DEBUG] [LOCAL ] GF: Loaded 2662 existing records from primary storage. [2025-10-21T18:57:14.509566] [INFO ] [MAIN ] GF: Loaded 2662 existing records. [2025-10-21T18:57:14.556171] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-21T18:57:14.697236] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:14.697505] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-21T18:57:14.697551] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-21T18:57:14.697715] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-21T18:57:14.697770] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-21T18:57:15.053236] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:15.351072] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-21T18:57:15.902259] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T18:57:15.993679] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-21T18:57:16.059707] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T18:57:16.150977] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-21T18:57:16.951075] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-21T18:57:17.546142] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T18:57:17.751050] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-21T18:57:18.412912] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T18:57:18.551110] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-21T18:57:18.943801] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-21T18:57:19.351058] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-21T18:57:20.033004] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T18:57:20.038973] [INFO ] [REMOTE ] GETY: Full fetch complete (55653 records). [2025-10-21T18:57:20.039071] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-21T18:57:20.156100] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-21T18:57:20.423069] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-21T18:57:20.423141] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-21T18:57:20.423922] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-21T18:57:20.423985] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-21T18:57:20.425160] [DEBUG] [LOCAL ] GETY: Trimmed 55653 records to 35197 (keeping 200 days of data) [2025-10-21T18:57:20.615234] [DEBUG] [LOCAL ] GETY: Primary data saved (35197 records). [2025-10-21T18:57:20.615364] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-21T18:57:20.615989] [INFO ] [MAIN ] Update Progress: 915/2366 symbols completed. GETY took 25.0s. Estimated remaining: 3h 5m 59s. Rate: 7.8 symbols/min [2025-10-21T18:57:20.804930] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:20.835908] [DEBUG] [LOCAL ] GFF: Loaded 29664 existing records from primary storage. [2025-10-21T18:57:20.836161] [INFO ] [MAIN ] GFF: Loaded 29664 existing records. [2025-10-21T18:57:20.953904] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-21T18:57:20.955003] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T18:57:21.029977] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:21.030281] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-21T18:57:21.030337] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-21T18:57:21.030709] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-21T18:57:21.030767] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-21T18:57:21.389485] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:21.756736] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-21T18:57:21.764808] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-21T18:57:22.332155] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T18:57:22.551067] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-21T18:57:22.624614] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T18:57:23.186155] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T18:57:23.351063] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-21T18:57:24.151077] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-21T18:57:24.661213] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T18:57:24.726539] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T18:57:24.951052] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-21T18:57:25.751033] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-21T18:57:26.199967] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T18:57:26.394370] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T18:57:26.399905] [INFO ] [REMOTE ] GES: Full fetch complete (58409 records). [2025-10-21T18:57:26.400004] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-21T18:57:26.556139] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-21T18:57:26.796796] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-21T18:57:26.796874] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-21T18:57:26.797622] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-21T18:57:26.797696] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-21T18:57:26.798833] [DEBUG] [LOCAL ] GES: Trimmed 58409 records to 37978 (keeping 200 days of data) [2025-10-21T18:57:27.027023] [DEBUG] [LOCAL ] GES: Primary data saved (37978 records). [2025-10-21T18:57:27.027162] [INFO ] [MAIN ] GES: Full history saved. [2025-10-21T18:57:27.027865] [INFO ] [MAIN ] Update Progress: 916/2366 symbols completed. GES took 34.0s. Estimated remaining: 3h 5m 49s. Rate: 7.8 symbols/min [2025-10-21T18:57:27.132370] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T18:57:27.202404] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:27.252214] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-21T18:57:27.252546] [INFO ] [MAIN ] GFI: Loaded 53116 existing records. [2025-10-21T18:57:27.351357] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-21T18:57:27.431016] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:27.431225] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-21T18:57:27.431291] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-21T18:57:27.431495] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-21T18:57:27.431535] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-21T18:57:27.803807] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:27.845764] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T18:57:28.151030] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-21T18:57:28.951034] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-21T18:57:29.751029] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-21T18:57:30.111857] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T18:57:30.175192] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T18:57:30.551017] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-21T18:57:31.351033] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-21T18:57:32.151013] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-21T18:57:32.190754] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-21T18:57:32.401675] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T18:57:32.598177] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T18:57:32.599051] [INFO ] [REMOTE ] GF: Full fetch complete (4787 records). [2025-10-21T18:57:32.599127] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-21T18:57:32.890054] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T18:57:32.956085] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-21T18:57:33.016388] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-21T18:57:33.016483] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-21T18:57:33.016728] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-21T18:57:33.016801] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-21T18:57:33.017290] [DEBUG] [LOCAL ] GF: Trimmed 4787 records to 2646 (keeping 200 days of data) [2025-10-21T18:57:33.034226] [DEBUG] [LOCAL ] GF: Primary data saved (2646 records). [2025-10-21T18:57:33.034350] [INFO ] [MAIN ] GF: Full history saved. [2025-10-21T18:57:33.034432] [INFO ] [MAIN ] Update Progress: 917/2366 symbols completed. GF took 18.7s. Estimated remaining: 3h 5m 38s. Rate: 7.8 symbols/min [2025-10-21T18:57:33.751075] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-21T18:57:34.448075] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T18:57:34.551054] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-21T18:57:35.351052] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-21T18:57:36.094021] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T18:57:36.150978] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-21T18:57:36.190310] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-21T18:57:36.951059] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-21T18:57:37.290940] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T18:57:37.473335] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T18:57:37.751091] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-21T18:57:38.550993] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-21T18:57:38.961156] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T18:57:39.104866] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T18:57:39.350987] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-21T18:57:40.151047] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-21T18:57:40.247633] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T18:57:40.951047] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-21T18:57:41.403585] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T18:57:41.751015] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-21T18:57:41.792104] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-21T18:57:42.459722] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T18:57:42.550989] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-21T18:57:42.692366] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T18:57:43.351144] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-21T18:57:44.151004] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-21T18:57:44.473943] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T18:57:44.519623] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-21T18:57:44.951082] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-21T18:57:45.750992] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-21T18:57:46.140204] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T18:57:46.144418] [INFO ] [REMOTE ] GFF: Full fetch complete (43736 records). [2025-10-21T18:57:46.144517] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-21T18:57:46.532440] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-21T18:57:46.532673] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-21T18:57:46.533375] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-21T18:57:46.533446] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-21T18:57:46.534533] [DEBUG] [LOCAL ] GFF: Trimmed 43736 records to 29542 (keeping 200 days of data) [2025-10-21T18:57:46.653540] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-21T18:57:46.676263] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-21T18:57:46.756982] [DEBUG] [LOCAL ] GFF: Primary data saved (29542 records). [2025-10-21T18:57:46.757108] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-21T18:57:46.757667] [INFO ] [MAIN ] Update Progress: 918/2366 symbols completed. GFF took 26.1s. Estimated remaining: 3h 5m 40s. Rate: 7.8 symbols/min [2025-10-21T18:57:47.564290] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T18:57:47.576774] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-21T18:57:49.031536] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-21T18:57:49.043765] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-21T18:57:49.549540] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T18:57:49.560867] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-21T18:57:51.633560] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T18:57:51.645906] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-21T18:57:51.850542] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-21T18:57:51.859066] [INFO ] [REMOTE ] GEV: Full fetch complete (77045 records). [2025-10-21T18:57:51.859171] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-21T18:57:52.253142] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-21T18:57:52.253267] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-21T18:57:52.254290] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-21T18:57:52.254356] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-21T18:57:52.255988] [DEBUG] [LOCAL ] GEV: Trimmed 77045 records to 52992 (keeping 200 days of data) [2025-10-21T18:57:52.593443] [DEBUG] [LOCAL ] GEV: Primary data saved (52992 records). [2025-10-21T18:57:52.593573] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-21T18:57:52.594431] [INFO ] [MAIN ] Update Progress: 919/2366 symbols completed. GEV took 40.3s. Estimated remaining: 3h 5m 30s. Rate: 7.8 symbols/min [2025-10-21T18:57:53.820350] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-21T18:57:53.828762] [INFO ] [REMOTE ] GFI: Full fetch complete (76959 records). [2025-10-21T18:57:53.828889] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-21T18:57:54.216280] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-21T18:57:54.216388] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-21T18:57:54.217420] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-21T18:57:54.217486] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-21T18:57:54.219173] [DEBUG] [LOCAL ] GFI: Trimmed 76959 records to 53116 (keeping 200 days of data) [2025-10-21T18:57:54.536001] [DEBUG] [LOCAL ] GFI: Primary data saved (53116 records). [2025-10-21T18:57:54.536127] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-21T18:57:54.536740] [INFO ] [MAIN ] Update Progress: 920/2366 symbols completed. GFI took 27.5s. Estimated remaining: 3h 5m 13s. Rate: 7.8 symbols/min [2025-10-21T18:57:55.104535] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:55.190013] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:55.236430] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:55.240074] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:57:55.252254] [DEBUG] [LOCAL ] GFR: Loaded 7510 existing records from primary storage. [2025-10-21T18:57:55.252885] [INFO ] [MAIN ] GFR: Loaded 7510 existing records. [2025-10-21T18:57:55.483977] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:55.485429] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-21T18:57:55.500455] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-21T18:57:55.515133] [DEBUG] [LOCAL ] GGG: Loaded 40585 existing records from primary storage. [2025-10-21T18:57:55.516090] [DEBUG] [LOCAL ] GFL: Loaded 47569 existing records from primary storage. [2025-10-21T18:57:55.516294] [INFO ] [MAIN ] GGG: Loaded 40585 existing records. [2025-10-21T18:57:55.516415] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-21T18:57:55.517340] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-21T18:57:55.517092] [DEBUG] [LOCAL ] GGB: Loaded 51536 existing records from primary storage. [2025-10-21T18:57:55.558124] [INFO ] [MAIN ] GFL: Loaded 47569 existing records. [2025-10-21T18:57:55.573471] [INFO ] [MAIN ] GGB: Loaded 51536 existing records. [2025-10-21T18:57:56.157151] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:56.229738] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-21T18:57:56.273040] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:56.304025] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-21T18:57:56.304163] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-21T18:57:56.328304] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-21T18:57:56.394820] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-21T18:57:56.389604] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-21T18:57:56.395094] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-21T18:57:56.395022] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-21T18:57:56.389557] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:57:56.454914] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-21T18:57:56.460157] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-21T18:57:56.537327] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-21T18:57:56.560825] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-21T18:57:56.590498] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:56.620018] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-21T18:57:57.496961] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:57.470893] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:57.503638] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-21T18:57:57.522129] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T18:57:57.509234] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-21T18:57:57.529945] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-21T18:57:57.592212] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:57:57.592755] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-21T18:57:58.295740] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T18:57:58.297990] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-21T18:57:59.093268] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T18:57:59.104993] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-21T18:57:59.137383] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-21T18:57:59.138915] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T18:57:59.151466] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-21T18:57:59.153091] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-21T18:57:59.186805] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T18:57:59.202265] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-21T18:58:00.001981] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T18:58:00.005235] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-21T18:58:00.648555] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T18:58:00.656473] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-21T18:58:00.694251] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T18:58:00.703430] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-21T18:58:00.910040] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T18:58:00.950988] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-21T18:58:01.391987] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-21T18:58:01.700161] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T18:58:01.751011] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-21T18:58:02.212048] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T18:58:02.253705] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-21T18:58:02.551076] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-21T18:58:02.605313] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T18:58:03.213693] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T18:58:03.351050] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-21T18:58:04.151025] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-21T18:58:04.694421] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-21T18:58:04.951112] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-21T18:58:05.008297] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T18:58:05.646525] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T18:58:05.648163] [INFO ] [REMOTE ] GFR: Full fetch complete (12001 records). [2025-10-21T18:58:05.648246] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-21T18:58:05.759691] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-21T18:58:06.020093] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-21T18:58:06.020166] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-21T18:58:06.020415] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-21T18:58:06.020452] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-21T18:58:06.020910] [DEBUG] [LOCAL ] GFR: Trimmed 12001 records to 7423 (keeping 200 days of data) [2025-10-21T18:58:06.059951] [DEBUG] [LOCAL ] GFR: Primary data saved (7423 records). [2025-10-21T18:58:06.060035] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-21T18:58:06.060107] [INFO ] [MAIN ] Update Progress: 921/2366 symbols completed. GFR took 11.5s. Estimated remaining: 3h 5m 11s. Rate: 7.8 symbols/min [2025-10-21T18:58:06.225081] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:06.242025] [DEBUG] [LOCAL ] GGT: Loaded 14586 existing records from primary storage. [2025-10-21T18:58:06.242266] [INFO ] [MAIN ] GGT: Loaded 14586 existing records. [2025-10-21T18:58:06.414002] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:06.414178] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-21T18:58:06.414224] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-21T18:58:06.414434] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-21T18:58:06.414491] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-21T18:58:06.556163] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-21T18:58:06.765522] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:07.215611] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T18:58:07.350986] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-21T18:58:08.151072] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-21T18:58:08.349508] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T18:58:08.764134] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T18:58:08.951082] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-21T18:58:09.741335] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T18:58:09.750969] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-21T18:58:09.793381] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:58:10.492144] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T18:58:10.551046] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-21T18:58:11.351101] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-21T18:58:11.421685] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T18:58:12.151047] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-21T18:58:12.900633] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T18:58:12.951016] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-21T18:58:13.751081] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-21T18:58:13.828565] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T18:58:14.403566] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T18:58:14.551040] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-21T18:58:15.351056] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-21T18:58:15.468517] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T18:58:16.062471] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T18:58:16.151025] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-21T18:58:16.494703] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T18:58:16.951080] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-21T18:58:17.652092] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T18:58:17.750997] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-21T18:58:18.452792] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T18:58:18.459069] [INFO ] [REMOTE ] GGG: Full fetch complete (59444 records). [2025-10-21T18:58:18.459193] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-21T18:58:18.559704] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-21T18:58:18.860547] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-21T18:58:18.860686] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-21T18:58:18.861637] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-21T18:58:18.861720] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-21T18:58:18.862994] [DEBUG] [LOCAL ] GGG: Trimmed 59444 records to 40582 (keeping 200 days of data) [2025-10-21T18:58:19.116737] [DEBUG] [LOCAL ] GGG: Primary data saved (40582 records). [2025-10-21T18:58:19.140278] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-21T18:58:19.143242] [INFO ] [MAIN ] Update Progress: 922/2366 symbols completed. GGG took 24.6s. Estimated remaining: 3h 5m 12s. Rate: 7.8 symbols/min [2025-10-21T18:58:19.178697] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T18:58:19.331027] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:19.335698] [DEBUG] [LOCAL ] GGZ: Loaded 2412 existing records from primary storage. [2025-10-21T18:58:19.335845] [INFO ] [MAIN ] GGZ: Loaded 2412 existing records. [2025-10-21T18:58:19.356796] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-21T18:58:19.521329] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:19.521541] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-21T18:58:19.521591] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-21T18:58:19.521759] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-21T18:58:19.521815] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-21T18:58:19.877491] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:20.151038] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-21T18:58:20.206789] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T18:58:20.734739] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T18:58:20.951007] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-21T18:58:21.254315] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T18:58:21.751036] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-21T18:58:22.551559] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-21T18:58:22.554485] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T18:58:22.555977] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T18:58:23.083095] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T18:58:23.351042] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-21T18:58:23.808754] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T18:58:24.151022] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-21T18:58:24.717559] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T18:58:24.951086] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-21T18:58:25.751029] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-21T18:58:26.551003] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-21T18:58:26.637009] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T18:58:27.350997] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-21T18:58:27.412594] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T18:58:27.541317] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T18:58:28.151017] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-21T18:58:28.908754] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T18:58:28.916030] [INFO ] [REMOTE ] GFL: Full fetch complete (69626 records). [2025-10-21T18:58:28.916178] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-21T18:58:28.960715] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-21T18:58:29.320224] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-21T18:58:29.320311] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-21T18:58:29.321198] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-21T18:58:29.321260] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-21T18:58:29.322514] [DEBUG] [LOCAL ] GFL: Trimmed 69626 records to 47521 (keeping 200 days of data) [2025-10-21T18:58:29.613051] [DEBUG] [LOCAL ] GFL: Primary data saved (47521 records). [2025-10-21T18:58:29.613200] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-21T18:58:29.613441] [INFO ] [MAIN ] Update Progress: 923/2366 symbols completed. GFL took 35.1s. Estimated remaining: 3h 5m 9s. Rate: 7.8 symbols/min [2025-10-21T18:58:29.756605] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-21T18:58:29.789506] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:29.795402] [DEBUG] [LOCAL ] GHC: Loaded 2956 existing records from primary storage. [2025-10-21T18:58:29.795566] [INFO ] [MAIN ] GHC: Loaded 2956 existing records. [2025-10-21T18:58:29.936040] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T18:58:30.004265] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T18:58:30.065440] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:30.065666] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-21T18:58:30.065728] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-21T18:58:30.065854] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-21T18:58:30.065892] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-21T18:58:30.432540] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:30.428313] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-21T18:58:30.551036] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-21T18:58:31.069866] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T18:58:31.351021] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-21T18:58:31.821766] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T18:58:32.151018] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-21T18:58:32.624120] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T18:58:32.951037] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-21T18:58:33.484578] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T18:58:33.751064] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-21T18:58:34.551061] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-21T18:58:35.351059] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-21T18:58:35.499691] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T18:58:35.518096] [INFO ] [REMOTE ] GGB: Full fetch complete (74365 records). [2025-10-21T18:58:35.519133] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T18:58:35.519249] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-21T18:58:35.925816] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T18:58:35.925673] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-21T18:58:35.927161] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-21T18:58:35.928433] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-21T18:58:35.928509] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-21T18:58:35.930296] [DEBUG] [LOCAL ] GGB: Trimmed 74365 records to 51551 (keeping 200 days of data) [2025-10-21T18:58:36.153856] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-21T18:58:36.226330] [DEBUG] [LOCAL ] GGB: Primary data saved (51551 records). [2025-10-21T18:58:36.226452] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-21T18:58:36.226546] [INFO ] [MAIN ] Update Progress: 924/2366 symbols completed. GGB took 41.7s. Estimated remaining: 3h 4m 59s. Rate: 7.8 symbols/min [2025-10-21T18:58:36.399724] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:36.404153] [DEBUG] [LOCAL ] GHG: Loaded 3282 existing records from primary storage. [2025-10-21T18:58:36.404316] [INFO ] [MAIN ] GHG: Loaded 3282 existing records. [2025-10-21T18:58:36.591617] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:36.591855] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-21T18:58:36.591950] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-21T18:58:36.592128] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-21T18:58:36.592185] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-21T18:58:36.677764] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-21T18:58:36.956214] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-21T18:58:36.960603] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:37.404029] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T18:58:37.751095] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-21T18:58:38.271250] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-21T18:58:38.551042] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-21T18:58:39.351036] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-21T18:58:39.414436] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T18:58:39.720063] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-21T18:58:40.151037] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-21T18:58:40.723443] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T18:58:40.724386] [INFO ] [REMOTE ] GGZ: Full fetch complete (3879 records). [2025-10-21T18:58:40.724465] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-21T18:58:40.956155] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-21T18:58:41.097140] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-21T18:58:41.097212] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-21T18:58:41.097333] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-21T18:58:41.097371] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-21T18:58:41.097741] [DEBUG] [LOCAL ] GGZ: Trimmed 3879 records to 2395 (keeping 200 days of data) [2025-10-21T18:58:41.112669] [DEBUG] [LOCAL ] GGZ: Primary data saved (2395 records). [2025-10-21T18:58:41.112735] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-21T18:58:41.112799] [INFO ] [MAIN ] Update Progress: 925/2366 symbols completed. GGZ took 22.0s. Estimated remaining: 3h 4m 47s. Rate: 7.8 symbols/min [2025-10-21T18:58:41.288287] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:41.297456] [DEBUG] [LOCAL ] GHI: Loaded 7558 existing records from primary storage. [2025-10-21T18:58:41.297701] [INFO ] [MAIN ] GHI: Loaded 7558 existing records. [2025-10-21T18:58:41.483937] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:41.484144] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-21T18:58:41.484190] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-21T18:58:41.484386] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-21T18:58:41.484442] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-21T18:58:41.588438] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T18:58:41.756270] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-21T18:58:41.854896] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:42.281753] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T18:58:42.551065] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-21T18:58:43.168258] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T18:58:43.351063] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-21T18:58:44.151023] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-21T18:58:44.188287] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T18:58:44.689636] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T18:58:44.951009] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-21T18:58:45.517326] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T18:58:45.751009] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-21T18:58:46.351615] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T18:58:46.551065] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-21T18:58:47.150461] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T18:58:47.151926] [INFO ] [REMOTE ] GHC: Full fetch complete (3678 records). [2025-10-21T18:58:47.151997] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-21T18:58:47.356179] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-21T18:58:47.533149] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-21T18:58:47.533268] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-21T18:58:47.533441] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-21T18:58:47.533481] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-21T18:58:47.533862] [DEBUG] [LOCAL ] GHC: Trimmed 3678 records to 2964 (keeping 200 days of data) [2025-10-21T18:58:47.552705] [DEBUG] [LOCAL ] GHC: Primary data saved (2964 records). [2025-10-21T18:58:47.552779] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-21T18:58:47.552849] [INFO ] [MAIN ] Update Progress: 926/2366 symbols completed. GHC took 17.9s. Estimated remaining: 3h 4m 38s. Rate: 7.8 symbols/min [2025-10-21T18:58:47.719477] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:47.725913] [DEBUG] [LOCAL ] GHLD: Loaded 4301 existing records from primary storage. [2025-10-21T18:58:47.726082] [INFO ] [MAIN ] GHLD: Loaded 4301 existing records. [2025-10-21T18:58:47.905220] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:47.905462] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-21T18:58:47.905512] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-21T18:58:47.905674] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-21T18:58:47.905732] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-21T18:58:48.156712] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-21T18:58:48.279494] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:48.404116] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T18:58:48.887775] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T18:58:48.951144] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-21T18:58:49.751019] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-21T18:58:49.980958] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T18:58:49.983780] [INFO ] [REMOTE ] GGT: Full fetch complete (18975 records). [2025-10-21T18:58:49.983849] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-21T18:58:50.347073] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-21T18:58:50.347151] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-21T18:58:50.347553] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-21T18:58:50.347595] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-21T18:58:50.348163] [DEBUG] [LOCAL ] GGT: Trimmed 18975 records to 14524 (keeping 200 days of data) [2025-10-21T18:58:50.414831] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T18:58:50.438513] [DEBUG] [LOCAL ] GGT: Primary data saved (14524 records). [2025-10-21T18:58:50.438604] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-21T18:58:50.438696] [INFO ] [MAIN ] Update Progress: 927/2366 symbols completed. GGT took 44.4s. Estimated remaining: 3h 4m 22s. Rate: 7.8 symbols/min [2025-10-21T18:58:50.556192] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-21T18:58:50.608890] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:58:50.623716] [DEBUG] [LOCAL ] GHM: Loaded 14369 existing records from primary storage. [2025-10-21T18:58:50.623915] [INFO ] [MAIN ] GHM: Loaded 14369 existing records. [2025-10-21T18:58:50.798105] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:58:50.798301] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-21T18:58:50.798367] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-21T18:58:50.798537] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-21T18:58:50.798609] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-21T18:58:51.064363] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-21T18:58:51.161820] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:58:51.350987] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-21T18:58:52.151009] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-21T18:58:52.264547] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T18:58:52.602413] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T18:58:52.951039] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-21T18:58:53.300572] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-21T18:58:53.751006] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-21T18:58:54.477136] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T18:58:54.551018] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-21T18:58:55.007739] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T18:58:55.351026] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-21T18:58:55.797525] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T18:58:56.151073] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-21T18:58:56.749819] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T18:58:56.951058] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-21T18:58:57.515540] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T18:58:57.751069] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-21T18:58:58.206091] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T18:58:58.551088] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-21T18:58:58.997523] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T18:58:59.351068] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-21T18:58:59.943342] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T18:59:00.151023] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-21T18:59:00.951010] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-21T18:59:01.209161] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T18:59:01.561182] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T18:59:01.751061] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-21T18:59:02.245204] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T18:59:02.551061] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-21T18:59:03.159832] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T18:59:03.351038] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-21T18:59:03.922067] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T18:59:04.151091] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-21T18:59:04.951115] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-21T18:59:05.119431] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T18:59:05.670418] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T18:59:05.751109] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-21T18:59:06.551008] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-21T18:59:06.615046] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T18:59:07.025772] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T18:59:07.351014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-21T18:59:08.151044] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-21T18:59:08.270158] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T18:59:08.742094] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T18:59:08.951061] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-21T18:59:09.715104] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T18:59:09.751081] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-21T18:59:10.348390] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T18:59:10.349520] [INFO ] [REMOTE ] GHG: Full fetch complete (4178 records). [2025-10-21T18:59:10.349588] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-21T18:59:10.561226] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-21T18:59:10.727563] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-21T18:59:10.727683] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-21T18:59:10.727914] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-21T18:59:10.727975] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-21T18:59:10.728367] [DEBUG] [LOCAL ] GHG: Trimmed 4178 records to 3279 (keeping 200 days of data) [2025-10-21T18:59:10.746382] [DEBUG] [LOCAL ] GHG: Primary data saved (3279 records). [2025-10-21T18:59:10.746483] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-21T18:59:10.746572] [INFO ] [MAIN ] Update Progress: 928/2366 symbols completed. GHG took 34.5s. Estimated remaining: 3h 4m 34s. Rate: 7.8 symbols/min [2025-10-21T18:59:10.921816] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:10.943991] [DEBUG] [LOCAL ] GHY: Loaded 20931 existing records from primary storage. [2025-10-21T18:59:10.944269] [INFO ] [MAIN ] GHY: Loaded 20931 existing records. [2025-10-21T18:59:11.123969] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:11.124213] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-21T18:59:11.124261] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-21T18:59:11.124429] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-21T18:59:11.124468] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-21T18:59:11.356248] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-21T18:59:11.490904] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:11.625825] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T18:59:12.151754] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-21T18:59:12.153536] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T18:59:12.951027] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-21T18:59:13.546000] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T18:59:13.560708] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T18:59:13.751046] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-21T18:59:14.551005] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-21T18:59:14.689724] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T18:59:14.691999] [INFO ] [REMOTE ] GHI: Full fetch complete (11207 records). [2025-10-21T18:59:14.692071] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-21T18:59:15.045491] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-21T18:59:15.045580] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-21T18:59:15.045886] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-21T18:59:15.046766] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-21T18:59:15.047209] [DEBUG] [LOCAL ] GHI: Trimmed 11207 records to 7700 (keeping 200 days of data) [2025-10-21T18:59:15.092561] [DEBUG] [LOCAL ] GHI: Primary data saved (7700 records). [2025-10-21T18:59:15.092684] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-21T18:59:15.092791] [INFO ] [MAIN ] Update Progress: 929/2366 symbols completed. GHI took 34.0s. Estimated remaining: 3h 4m 21s. Rate: 7.8 symbols/min [2025-10-21T18:59:15.262762] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:15.293745] [DEBUG] [LOCAL ] GIB: Loaded 31496 existing records from primary storage. [2025-10-21T18:59:15.294061] [INFO ] [MAIN ] GIB: Loaded 31496 existing records. [2025-10-21T18:59:15.356262] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-21T18:59:15.473125] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:15.473349] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-21T18:59:15.473397] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-21T18:59:15.473597] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-21T18:59:15.473691] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-21T18:59:15.629539] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T18:59:15.840761] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:15.935434] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T18:59:16.151041] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-21T18:59:16.775204] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T18:59:16.776450] [INFO ] [REMOTE ] GHLD: Full fetch complete (5078 records). [2025-10-21T18:59:16.776517] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-21T18:59:16.953800] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-21T18:59:17.147753] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-21T18:59:17.147858] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-21T18:59:17.148037] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-21T18:59:17.148076] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-21T18:59:17.148431] [DEBUG] [LOCAL ] GHLD: Trimmed 5078 records to 4289 (keeping 200 days of data) [2025-10-21T18:59:17.173901] [DEBUG] [LOCAL ] GHLD: Primary data saved (4289 records). [2025-10-21T18:59:17.173967] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-21T18:59:17.174034] [INFO ] [MAIN ] Update Progress: 930/2366 symbols completed. GHLD took 29.6s. Estimated remaining: 3h 4m 5s. Rate: 7.8 symbols/min [2025-10-21T18:59:17.344219] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:17.358180] [DEBUG] [LOCAL ] GIC: Loaded 13388 existing records from primary storage. [2025-10-21T18:59:17.358458] [INFO ] [MAIN ] GIC: Loaded 13388 existing records. [2025-10-21T18:59:17.538107] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:17.538324] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-21T18:59:17.538380] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-21T18:59:17.538532] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-21T18:59:17.538571] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-21T18:59:17.756202] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-21T18:59:17.913279] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:17.972761] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T18:59:18.551074] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-21T18:59:18.972236] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T18:59:19.351034] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-21T18:59:19.603951] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T18:59:20.150999] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-21T18:59:20.700491] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T18:59:20.951066] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-21T18:59:21.142593] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T18:59:21.751015] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-21T18:59:22.060404] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T18:59:22.551059] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-21T18:59:23.170745] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T18:59:23.285095] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T18:59:23.350984] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-21T18:59:24.151008] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-21T18:59:24.362266] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T18:59:24.812478] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T18:59:24.951089] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-21T18:59:25.751021] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-21T18:59:26.422497] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T18:59:26.550991] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-21T18:59:26.699291] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T18:59:27.350992] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-21T18:59:27.712970] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T18:59:28.151005] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-21T18:59:28.396738] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T18:59:28.951037] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-21T18:59:29.385944] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T18:59:29.751003] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-21T18:59:29.760888] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T18:59:30.551078] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-21T18:59:31.095871] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T18:59:31.351021] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-21T18:59:31.511386] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T18:59:32.151015] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-21T18:59:32.692459] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T18:59:32.951021] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-21T18:59:33.039321] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T18:59:33.489248] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T18:59:33.751033] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-21T18:59:34.551044] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-21T18:59:34.881567] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T18:59:35.351058] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-21T18:59:35.888102] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T18:59:36.150998] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-21T18:59:36.385109] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T18:59:36.944338] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T18:59:36.947394] [INFO ] [REMOTE ] GHM: Full fetch complete (22032 records). [2025-10-21T18:59:36.947466] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-21T18:59:36.958851] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-21T18:59:37.321535] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-21T18:59:37.321615] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-21T18:59:37.322173] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-21T18:59:37.322229] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-21T18:59:37.322849] [DEBUG] [LOCAL ] GHM: Trimmed 22032 records to 14348 (keeping 200 days of data) [2025-10-21T18:59:37.405845] [DEBUG] [LOCAL ] GHM: Primary data saved (14348 records). [2025-10-21T18:59:37.405983] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-21T18:59:37.406063] [INFO ] [MAIN ] Update Progress: 931/2366 symbols completed. GHM took 47.0s. Estimated remaining: 3h 4m 17s. Rate: 7.8 symbols/min [2025-10-21T18:59:37.580192] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:37.619695] [DEBUG] [LOCAL ] GIL: Loaded 43989 existing records from primary storage. [2025-10-21T18:59:37.619985] [INFO ] [MAIN ] GIL: Loaded 43989 existing records. [2025-10-21T18:59:37.756180] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-21T18:59:37.809740] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:37.810050] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-21T18:59:37.810100] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-21T18:59:37.810434] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-21T18:59:37.810493] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-21T18:59:38.145059] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T18:59:38.209854] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:38.551091] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-21T18:59:39.284731] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T18:59:39.291100] [INFO ] [REMOTE ] GIB: Full fetch complete (46334 records). [2025-10-21T18:59:39.291206] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-21T18:59:39.361301] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-21T18:59:39.504191] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T18:59:39.606851] [INFO ] [REMOTE ] GHY: Full fetch complete (32419 records). [2025-10-21T18:59:39.631884] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-21T18:59:39.874223] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-21T18:59:39.887196] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-21T18:59:39.898587] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-21T18:59:39.898702] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-21T18:59:40.001837] [DEBUG] [LOCAL ] GIB: Trimmed 46334 records to 31436 (keeping 200 days of data) [2025-10-21T18:59:40.152624] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-21T18:59:40.220608] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-21T18:59:40.222917] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-21T18:59:40.224097] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-21T18:59:40.224590] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-21T18:59:40.232717] [DEBUG] [LOCAL ] GHY: Trimmed 32419 records to 20916 (keeping 200 days of data) [2025-10-21T18:59:40.403090] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T18:59:40.457175] [DEBUG] [LOCAL ] GIB: Primary data saved (31436 records). [2025-10-21T18:59:40.461494] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-21T18:59:40.463479] [INFO ] [MAIN ] Update Progress: 932/2366 symbols completed. GIB took 25.4s. Estimated remaining: 3h 4m 2s. Rate: 7.8 symbols/min [2025-10-21T18:59:40.462734] [DEBUG] [LOCAL ] GHY: Primary data saved (20916 records). [2025-10-21T18:59:40.506108] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-21T18:59:40.526777] [INFO ] [MAIN ] Update Progress: 933/2366 symbols completed. GHY took 29.8s. Estimated remaining: 3h 3m 42s. Rate: 7.8 symbols/min [2025-10-21T18:59:40.788480] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:40.789802] [DEBUG] [LOCAL ] GIS: No existing data file found in primary storage. [2025-10-21T18:59:40.790807] [WARN ] [MAIN ] GIS: No existing data found, performing full refresh instead. [2025-10-21T18:59:40.807043] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-21T18:59:40.806917] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:40.807106] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-21T18:59:40.807254] [DEBUG] [LOCAL ] GIS: No primary data file found to delete. [2025-10-21T18:59:40.807316] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-21T18:59:40.960549] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-21T18:59:41.143332] [DEBUG] [LOCAL ] GKOS: Loaded 42502 existing records from primary storage. [2025-10-21T18:59:41.175605] [INFO ] [MAIN ] GKOS: Loaded 42502 existing records. [2025-10-21T18:59:41.200966] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:41.378687] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:41.378895] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-21T18:59:41.378966] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-21T18:59:41.379202] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-21T18:59:41.379261] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-21T18:59:41.749286] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:41.757965] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-21T18:59:41.773586] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T18:59:42.060827] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T18:59:42.551030] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-21T18:59:43.272972] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T18:59:43.350981] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-21T18:59:43.504162] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T18:59:44.151011] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-21T18:59:44.750841] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T18:59:44.951009] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-21T18:59:45.539235] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T18:59:45.751081] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-21T18:59:46.550983] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-21T18:59:46.586361] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T18:59:47.351023] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-21T18:59:47.578099] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T18:59:48.103478] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T18:59:48.151052] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-21T18:59:48.254485] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T18:59:48.256783] [INFO ] [REMOTE ] GIC: Full fetch complete (19820 records). [2025-10-21T18:59:48.256852] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-21T18:59:48.623008] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-21T18:59:48.623094] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-21T18:59:48.623592] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-21T18:59:48.623632] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-21T18:59:48.624495] [DEBUG] [LOCAL ] GIC: Trimmed 19820 records to 13257 (keeping 200 days of data) [2025-10-21T18:59:48.702989] [DEBUG] [LOCAL ] GIC: Primary data saved (13257 records). [2025-10-21T18:59:48.703128] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-21T18:59:48.703205] [INFO ] [MAIN ] Update Progress: 934/2366 symbols completed. GIC took 31.5s. Estimated remaining: 3h 3m 35s. Rate: 7.8 symbols/min [2025-10-21T18:59:48.870903] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T18:59:48.913376] [DEBUG] [LOCAL ] GL: Loaded 37483 existing records from primary storage. [2025-10-21T18:59:48.913695] [INFO ] [MAIN ] GL: Loaded 37483 existing records. [2025-10-21T18:59:48.956268] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-21T18:59:49.099004] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T18:59:49.099445] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-21T18:59:49.099498] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-21T18:59:49.099841] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-21T18:59:49.099897] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-21T18:59:49.451022] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T18:59:49.751014] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-21T18:59:49.816542] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T18:59:50.197861] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T18:59:50.551022] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-21T18:59:51.351016] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-21T18:59:51.415062] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T18:59:51.836984] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T18:59:52.151035] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-21T18:59:52.951007] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-21T18:59:53.011284] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T18:59:53.734370] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T18:59:53.750979] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-21T18:59:54.422936] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T18:59:54.551020] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-21T18:59:55.327861] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T18:59:55.350979] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-21T18:59:56.151006] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-21T18:59:56.458040] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T18:59:56.951086] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-21T18:59:57.617404] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-21T18:59:57.689982] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T18:59:57.751074] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-21T18:59:58.512234] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T18:59:58.551035] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-21T18:59:59.351059] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-21T18:59:59.390834] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T19:00:00.151064] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-21T19:00:00.397309] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T19:00:00.951017] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-21T19:00:01.608740] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-21T19:00:01.732178] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:00:01.750992] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-21T19:00:02.551114] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-21T19:00:02.920588] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T19:00:03.360017] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-21T19:00:03.364809] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:00:04.073950] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:00:04.151035] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-21T19:00:04.962447] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-21T19:00:04.970479] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T19:00:05.751011] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-21T19:00:06.304481] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T19:00:06.550991] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-21T19:00:06.962263] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T19:00:06.968948] [INFO ] [REMOTE ] GKOS: Full fetch complete (60527 records). [2025-10-21T19:00:06.969069] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-21T19:00:07.361477] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-21T19:00:07.364942] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-21T19:00:07.365546] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-21T19:00:07.367883] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-21T19:00:07.368295] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-21T19:00:07.370701] [DEBUG] [LOCAL ] GKOS: Trimmed 60527 records to 42499 (keeping 200 days of data) [2025-10-21T19:00:07.635758] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:00:07.653774] [INFO ] [REMOTE ] GIL: Full fetch complete (62511 records). [2025-10-21T19:00:07.659983] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-21T19:00:07.661217] [DEBUG] [LOCAL ] GKOS: Primary data saved (42499 records). [2025-10-21T19:00:07.661432] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-21T19:00:07.661519] [INFO ] [MAIN ] Update Progress: 935/2366 symbols completed. GKOS took 27.1s. Estimated remaining: 3h 3m 45s. Rate: 7.8 symbols/min [2025-10-21T19:00:08.031749] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:08.245524] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:00:08.332526] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-21T19:00:08.332630] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-21T19:00:08.332973] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-21T19:00:08.333920] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-21T19:00:08.334819] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-21T19:00:08.336212] [DEBUG] [LOCAL ] GIL: Trimmed 62511 records to 43981 (keeping 200 days of data) [2025-10-21T19:00:08.414273] [DEBUG] [LOCAL ] GLOB: Loaded 48058 existing records from primary storage. [2025-10-21T19:00:08.440928] [INFO ] [MAIN ] GLOB: Loaded 48058 existing records. [2025-10-21T19:00:08.652286] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:08.664037] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-21T19:00:08.664149] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-21T19:00:08.664494] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-21T19:00:08.664592] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-21T19:00:08.940189] [DEBUG] [LOCAL ] GIL: Primary data saved (43981 records). [2025-10-21T19:00:08.940851] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-21T19:00:08.946590] [INFO ] [MAIN ] Update Progress: 936/2366 symbols completed. GIL took 31.5s. Estimated remaining: 3h 3m 27s. Rate: 7.8 symbols/min [2025-10-21T19:00:09.330950] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:09.391766] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:09.392134] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-21T19:00:09.431231] [DEBUG] [LOCAL ] GLP: Loaded 9318 existing records from primary storage. [2025-10-21T19:00:09.431520] [INFO ] [MAIN ] GLP: Loaded 9318 existing records. [2025-10-21T19:00:09.504289] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-21T19:00:09.622839] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:09.623056] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-21T19:00:09.623103] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-21T19:00:09.623272] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-21T19:00:09.623327] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-21T19:00:09.761900] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-21T19:00:09.982570] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:10.035086] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:00:10.551047] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-21T19:00:10.819707] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T19:00:11.351028] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-21T19:00:11.745377] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T19:00:11.969841] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T19:00:12.151010] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-21T19:00:12.951031] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-21T19:00:13.052814] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:00:13.750997] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-21T19:00:14.235150] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-21T19:00:14.472594] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:00:14.550984] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-21T19:00:15.349725] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T19:00:15.358438] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-21T19:00:16.151051] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-21T19:00:16.244502] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T19:00:16.951004] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-21T19:00:17.256779] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-21T19:00:17.262581] [INFO ] [REMOTE ] GL: Full fetch complete (54947 records). [2025-10-21T19:00:17.262708] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-21T19:00:17.648350] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-21T19:00:17.648426] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-21T19:00:17.649204] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-21T19:00:17.649266] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-21T19:00:17.650377] [DEBUG] [LOCAL ] GL: Trimmed 54947 records to 37443 (keeping 200 days of data) [2025-10-21T19:00:17.755094] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-21T19:00:17.886534] [DEBUG] [LOCAL ] GL: Primary data saved (37443 records). [2025-10-21T19:00:17.886733] [INFO ] [MAIN ] GL: Full history saved. [2025-10-21T19:00:17.886842] [INFO ] [MAIN ] Update Progress: 937/2366 symbols completed. GL took 29.2s. Estimated remaining: 3h 3m 22s. Rate: 7.8 symbols/min [2025-10-21T19:00:18.056962] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:18.104928] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-21T19:00:18.105236] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-21T19:00:18.283139] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:18.283381] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-21T19:00:18.283496] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-21T19:00:18.283867] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-21T19:00:18.283923] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-21T19:00:18.494755] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T19:00:18.562050] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-21T19:00:18.567774] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T19:00:18.713846] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:18.738400] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:00:19.351021] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-21T19:00:19.494142] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T19:00:19.502423] [INFO ] [REMOTE ] GIS: Full fetch complete (77841 records). [2025-10-21T19:00:19.502541] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-21T19:00:19.889664] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-21T19:00:19.889766] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-21T19:00:19.890706] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-21T19:00:19.890771] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-21T19:00:19.892210] [DEBUG] [LOCAL ] GIS: Trimmed 77841 records to 53675 (keeping 200 days of data) [2025-10-21T19:00:19.994395] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T19:00:20.151324] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-21T19:00:20.249608] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-21T19:00:20.249782] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-21T19:00:20.249877] [INFO ] [MAIN ] Update Progress: 938/2366 symbols completed. GIS took 39.8s. Estimated remaining: 3h 3m 6s. Rate: 7.8 symbols/min [2025-10-21T19:00:20.424355] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:20.472881] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-21T19:00:20.473185] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-21T19:00:20.645501] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:20.645747] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-21T19:00:20.645797] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-21T19:00:20.646003] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-21T19:00:20.646059] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-21T19:00:20.955940] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-21T19:00:21.016493] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:21.023085] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T19:00:21.751029] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-21T19:00:22.551035] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-21T19:00:22.784733] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T19:00:23.351010] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-21T19:00:23.399366] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T19:00:23.458616] [DEBUG] [REMOTE ] GLOB: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-21T19:00:23.458988] [WARN ] [REMOTE ] GLOB: No data returned for month 2025-06 [2025-10-21T19:00:23.459079] [FATAL] [REMOTE ] GLOB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:00:23.459160] [FATAL] [MAIN ] GLOB: Failed to fetch primary data. [2025-10-21T19:00:23.459196] [WARN ] [MAIN ] GLOB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:00:23.459234] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-21T19:00:23.459289] [DEBUG] [LOCAL ] GLOB: No primary data file found to delete. [2025-10-21T19:00:23.459322] [INFO ] [LOCAL ] GLOB: Starting deletion of derivative data. [2025-10-21T19:00:23.459488] [DEBUG] [LOCAL ] GLOB: Deleted derivative data file. [2025-10-21T19:00:23.460239] [INFO ] [MAIN ] Update Progress: 939/2366 symbols completed. GLOB took 15.8s. Estimated remaining: 3h 2m 51s. Rate: 7.8 symbols/min [2025-10-21T19:00:23.637283] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:23.690578] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-21T19:00:23.690906] [INFO ] [MAIN ] GME: Loaded 53781 existing records. [2025-10-21T19:00:23.887414] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:23.907356] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-21T19:00:23.910318] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-21T19:00:23.911081] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-21T19:00:23.911147] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-21T19:00:23.912636] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T19:00:24.157759] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-21T19:00:24.300793] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:24.817976] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T19:00:24.951282] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-21T19:00:25.751079] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-21T19:00:26.525580] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T19:00:26.550975] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-21T19:00:27.139706] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-21T19:00:27.351009] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-21T19:00:27.423196] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T19:00:28.151061] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-21T19:00:28.951062] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-21T19:00:28.991698] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T19:00:29.571133] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T19:00:29.751013] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-21T19:00:30.551016] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-21T19:00:30.577491] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:00:30.579469] [INFO ] [REMOTE ] GLP: Full fetch complete (14248 records). [2025-10-21T19:00:30.579539] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-21T19:00:30.991337] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-21T19:00:30.991415] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-21T19:00:30.991794] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-21T19:00:30.991858] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-21T19:00:30.992388] [DEBUG] [LOCAL ] GLP: Trimmed 14248 records to 9296 (keeping 200 days of data) [2025-10-21T19:00:31.049161] [DEBUG] [LOCAL ] GLP: Primary data saved (9296 records). [2025-10-21T19:00:31.049372] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-21T19:00:31.049551] [INFO ] [MAIN ] Update Progress: 940/2366 symbols completed. GLP took 22.1s. Estimated remaining: 3h 2m 44s. Rate: 7.8 symbols/min [2025-10-21T19:00:31.233624] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:31.277473] [DEBUG] [LOCAL ] GMED: Loaded 48170 existing records from primary storage. [2025-10-21T19:00:31.277797] [INFO ] [MAIN ] GMED: Loaded 48170 existing records. [2025-10-21T19:00:31.354608] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-21T19:00:31.462968] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:31.463292] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-21T19:00:31.463405] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-21T19:00:31.472931] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-21T19:00:31.486254] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-21T19:00:31.591211] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-21T19:00:31.854496] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:32.151052] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-21T19:00:32.599118] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T19:00:32.951007] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-21T19:00:33.210320] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T19:00:33.751009] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-21T19:00:33.789322] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:00:34.551068] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-21T19:00:35.351035] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-21T19:00:35.560967] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-21T19:00:35.842038] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T19:00:36.059323] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T19:00:36.151006] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-21T19:00:36.951022] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-21T19:00:37.181771] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:00:37.751014] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-21T19:00:37.818024] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T19:00:38.551042] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-21T19:00:39.351025] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-21T19:00:39.723812] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-21T19:00:39.967945] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T19:00:40.151005] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-21T19:00:40.569381] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T19:00:40.857016] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T19:00:40.951070] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-21T19:00:41.751084] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-21T19:00:42.551049] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-21T19:00:42.867283] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-21T19:00:42.992324] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-21T19:00:43.350996] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-21T19:00:43.452628] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:00:44.151161] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-21T19:00:44.152975] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T19:00:44.951089] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-21T19:00:45.561528] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T19:00:45.754098] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-21T19:00:45.759605] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T19:00:46.550994] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-21T19:00:46.902808] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:00:47.351036] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-21T19:00:48.150999] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-21T19:00:48.423741] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-21T19:00:48.695547] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T19:00:48.951057] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-21T19:00:49.316016] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T19:00:49.408422] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T19:00:49.751056] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-21T19:00:50.551090] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-21T19:00:51.312917] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T19:00:51.350985] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-21T19:00:51.845958] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T19:00:52.151028] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-21T19:00:52.341480] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:00:52.951042] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-21T19:00:53.737735] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-21T19:00:53.750991] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-21T19:00:53.880213] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:00:54.551007] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-21T19:00:55.019842] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T19:00:55.351061] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-21T19:00:55.462758] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:00:55.471181] [INFO ] [REMOTE ] GLW: Full fetch complete (77796 records). [2025-10-21T19:00:55.471332] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-21T19:00:55.855445] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-21T19:00:55.855525] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-21T19:00:55.856484] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-21T19:00:55.856548] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-21T19:00:55.858134] [DEBUG] [LOCAL ] GLW: Trimmed 77796 records to 53635 (keeping 200 days of data) [2025-10-21T19:00:56.163400] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-21T19:00:56.190107] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-21T19:00:56.190401] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-21T19:00:56.190495] [INFO ] [MAIN ] Update Progress: 941/2366 symbols completed. GLW took 38.3s. Estimated remaining: 3h 3m 2s. Rate: 7.8 symbols/min [2025-10-21T19:00:56.360705] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:56.385394] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.63 seconds). [2025-10-21T19:00:56.394260] [INFO ] [REMOTE ] GME: Full fetch complete (77923 records). [2025-10-21T19:00:56.394432] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-21T19:00:56.659325] [DEBUG] [LOCAL ] GMRE: Loaded 36823 existing records from primary storage. [2025-10-21T19:00:56.694688] [INFO ] [MAIN ] GMRE: Loaded 36823 existing records. [2025-10-21T19:00:56.994557] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:57.018549] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-21T19:00:57.019129] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-21T19:00:57.018664] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-21T19:00:57.020299] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-21T19:00:57.020459] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-21T19:00:57.020593] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-21T19:00:57.021025] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-21T19:00:57.021137] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-21T19:00:57.100467] [DEBUG] [LOCAL ] GME: Trimmed 77923 records to 53781 (keeping 200 days of data) [2025-10-21T19:00:57.635411] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-21T19:00:57.665600] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:57.673222] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-21T19:00:57.767233] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T19:00:57.767324] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-21T19:00:57.803136] [DEBUG] [LOCAL ] GME: Primary data saved (53781 records). [2025-10-21T19:00:57.803248] [INFO ] [MAIN ] GME: Full history saved. [2025-10-21T19:00:57.804085] [INFO ] [MAIN ] Update Progress: 942/2366 symbols completed. GME took 34.3s. Estimated remaining: 3h 2m 45s. Rate: 7.8 symbols/min [2025-10-21T19:00:57.983117] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:58.005368] [DEBUG] [LOCAL ] GNE: Loaded 18091 existing records from primary storage. [2025-10-21T19:00:58.005594] [INFO ] [MAIN ] GNE: Loaded 18091 existing records. [2025-10-21T19:00:58.180792] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:58.180974] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-21T19:00:58.181050] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-21T19:00:58.181197] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-21T19:00:58.181234] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-21T19:00:58.551360] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-21T19:00:58.551299] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:00:58.665710] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:00:58.674621] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-21T19:00:58.674811] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-21T19:00:59.066257] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-21T19:00:59.066425] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-21T19:00:59.067443] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-21T19:00:59.067632] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-21T19:00:59.069291] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-21T19:00:59.202819] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:00:59.374803] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-21T19:00:59.425540] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-21T19:00:59.425716] [INFO ] [MAIN ] GM: Full history saved. [2025-10-21T19:00:59.426529] [INFO ] [MAIN ] Update Progress: 943/2366 symbols completed. GM took 39.2s. Estimated remaining: 3h 2m 28s. Rate: 7.8 symbols/min [2025-10-21T19:00:59.598310] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:00:59.637916] [DEBUG] [LOCAL ] GNK: Loaded 39773 existing records from primary storage. [2025-10-21T19:00:59.638203] [INFO ] [MAIN ] GNK: Loaded 39773 existing records. [2025-10-21T19:00:59.815414] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:00:59.815633] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-21T19:00:59.815716] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-21T19:00:59.815942] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-21T19:00:59.815997] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-21T19:01:00.159076] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-21T19:01:00.188502] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:00.229785] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:01:00.328061] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T19:01:00.951021] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-21T19:01:01.103380] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:01:01.751061] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-21T19:01:02.422486] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:01:02.551053] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-21T19:01:03.351075] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-21T19:01:03.570869] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T19:01:03.578307] [INFO ] [REMOTE ] GMED: Full fetch complete (70057 records). [2025-10-21T19:01:03.578445] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-21T19:01:03.900083] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-21T19:01:03.991633] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-21T19:01:03.991783] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-21T19:01:03.992731] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-21T19:01:03.992893] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-21T19:01:04.015176] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:01:04.013939] [DEBUG] [LOCAL ] GMED: Trimmed 70057 records to 48118 (keeping 200 days of data) [2025-10-21T19:01:04.185581] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-21T19:01:04.301502] [DEBUG] [LOCAL ] GMED: Primary data saved (48118 records). [2025-10-21T19:01:04.301661] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-21T19:01:04.302141] [INFO ] [MAIN ] Update Progress: 944/2366 symbols completed. GMED took 33.3s. Estimated remaining: 3h 2m 17s. Rate: 7.8 symbols/min [2025-10-21T19:01:04.469193] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:04.516802] [DEBUG] [LOCAL ] GNL: Loaded 46630 existing records from primary storage. [2025-10-21T19:01:04.517128] [INFO ] [MAIN ] GNL: Loaded 46630 existing records. [2025-10-21T19:01:04.694843] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:04.695186] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-21T19:01:04.695265] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-21T19:01:04.695612] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-21T19:01:04.695764] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-21T19:01:04.870216] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T19:01:04.956133] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-21T19:01:05.066795] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:05.751076] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-21T19:01:06.550997] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-21T19:01:06.560066] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T19:01:06.691967] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:01:07.351074] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-21T19:01:07.704817] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T19:01:08.151016] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-21T19:01:08.951143] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-21T19:01:09.022107] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:01:09.152983] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T19:01:09.751025] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-21T19:01:10.562744] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-21T19:01:10.593781] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:01:10.889341] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:01:11.351099] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-21T19:01:12.147898] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:01:12.156122] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-21T19:01:12.916380] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T19:01:12.950992] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-21T19:01:13.316407] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T19:01:13.751073] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-21T19:01:14.409163] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T19:01:14.551022] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-21T19:01:15.351000] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-21T19:01:15.426277] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:01:16.100557] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T19:01:16.150987] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-21T19:01:16.915897] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:01:16.950992] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-21T19:01:17.353852] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T19:01:17.751045] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-21T19:01:18.518436] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:01:18.551018] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-21T19:01:19.351108] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-21T19:01:19.457855] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:01:20.088911] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:01:20.151038] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-21T19:01:20.331067] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T19:01:20.951074] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-21T19:01:21.758817] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-21T19:01:21.765819] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:01:22.550998] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-21T19:01:22.586414] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T19:01:23.322102] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:01:23.351023] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-21T19:01:24.155000] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-21T19:01:24.160827] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T19:01:24.309394] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T19:01:24.951032] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-21T19:01:25.503387] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T19:01:25.751094] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-21T19:01:26.551010] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-21T19:01:26.615518] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T19:01:27.035114] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T19:01:27.039759] [INFO ] [REMOTE ] GMRE: Full fetch complete (52096 records). [2025-10-21T19:01:27.039891] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-21T19:01:27.356108] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-21T19:01:27.435418] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-21T19:01:27.435500] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-21T19:01:27.436313] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-21T19:01:27.436390] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-21T19:01:27.437512] [DEBUG] [LOCAL ] GMRE: Trimmed 52096 records to 36650 (keeping 200 days of data) [2025-10-21T19:01:27.666766] [DEBUG] [LOCAL ] GMRE: Primary data saved (36650 records). [2025-10-21T19:01:27.666907] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-21T19:01:27.666988] [INFO ] [MAIN ] Update Progress: 945/2366 symbols completed. GMRE took 31.5s. Estimated remaining: 3h 2m 32s. Rate: 7.8 symbols/min [2025-10-21T19:01:27.782753] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:01:27.796431] [INFO ] [REMOTE ] GNE: Full fetch complete (22594 records). [2025-10-21T19:01:27.806815] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-21T19:01:27.936459] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:28.155317] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-21T19:01:28.257113] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-21T19:01:28.257994] [DEBUG] [LOCAL ] GNRC: Loaded 45450 existing records from primary storage. [2025-10-21T19:01:28.258087] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-21T19:01:28.258677] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-21T19:01:28.258751] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-21T19:01:28.259307] [INFO ] [MAIN ] GNRC: Loaded 45450 existing records. [2025-10-21T19:01:28.317456] [DEBUG] [LOCAL ] GNE: Trimmed 22594 records to 18119 (keeping 200 days of data) [2025-10-21T19:01:28.533134] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:28.542894] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-21T19:01:28.542949] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-21T19:01:28.547593] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-21T19:01:28.548415] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-21T19:01:28.649151] [DEBUG] [LOCAL ] GNE: Primary data saved (18119 records). [2025-10-21T19:01:28.672782] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-21T19:01:28.678563] [INFO ] [MAIN ] Update Progress: 946/2366 symbols completed. GNE took 30.9s. Estimated remaining: 3h 2m 15s. Rate: 7.8 symbols/min [2025-10-21T19:01:29.043903] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:29.128392] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:29.133053] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-21T19:01:29.133313] [DEBUG] [LOCAL ] GNT: Loaded 8645 existing records from primary storage. [2025-10-21T19:01:29.134577] [INFO ] [MAIN ] GNT: Loaded 8645 existing records. [2025-10-21T19:01:29.260730] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T19:01:29.350156] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:29.350369] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-21T19:01:29.350427] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-21T19:01:29.350600] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-21T19:01:29.350692] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-21T19:01:29.708933] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:29.751011] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-21T19:01:29.803356] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:01:30.551150] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-21T19:01:30.848252] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:01:30.960397] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T19:01:30.966690] [INFO ] [REMOTE ] GNK: Full fetch complete (57300 records). [2025-10-21T19:01:30.966851] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-21T19:01:31.354058] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-21T19:01:31.390966] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-21T19:01:31.391041] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-21T19:01:31.391836] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-21T19:01:31.391899] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-21T19:01:31.393196] [DEBUG] [LOCAL ] GNK: Trimmed 57300 records to 39630 (keeping 200 days of data) [2025-10-21T19:01:31.631562] [DEBUG] [LOCAL ] GNK: Primary data saved (39630 records). [2025-10-21T19:01:31.631743] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-21T19:01:31.632633] [INFO ] [MAIN ] Update Progress: 947/2366 symbols completed. GNK took 32.2s. Estimated remaining: 3h 1m 60s. Rate: 7.8 symbols/min [2025-10-21T19:01:31.827324] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:31.879046] [DEBUG] [LOCAL ] GNW: Loaded 51392 existing records from primary storage. [2025-10-21T19:01:31.879372] [INFO ] [MAIN ] GNW: Loaded 51392 existing records. [2025-10-21T19:01:32.077682] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:32.084712] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-21T19:01:32.086501] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T19:01:32.085728] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-21T19:01:32.110512] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-21T19:01:32.113312] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-21T19:01:32.121193] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:01:32.156307] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-21T19:01:32.487130] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:32.841460] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T19:01:32.951057] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-21T19:01:33.751061] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-21T19:01:34.551069] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-21T19:01:34.665441] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:01:34.673783] [INFO ] [REMOTE ] GNL: Full fetch complete (68162 records). [2025-10-21T19:01:34.674005] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-21T19:01:35.065250] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-21T19:01:35.065342] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-21T19:01:35.066277] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-21T19:01:35.066343] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-21T19:01:35.067688] [DEBUG] [LOCAL ] GNL: Trimmed 68162 records to 46556 (keeping 200 days of data) [2025-10-21T19:01:35.305461] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T19:01:35.359570] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-21T19:01:35.410132] [DEBUG] [LOCAL ] GNL: Primary data saved (46556 records). [2025-10-21T19:01:35.410033] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:01:35.410313] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-21T19:01:35.419669] [INFO ] [MAIN ] Update Progress: 948/2366 symbols completed. GNL took 31.1s. Estimated remaining: 3h 1m 46s. Rate: 7.8 symbols/min [2025-10-21T19:01:35.601635] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:35.642482] [DEBUG] [LOCAL ] GOF: Loaded 42707 existing records from primary storage. [2025-10-21T19:01:35.642778] [INFO ] [MAIN ] GOF: Loaded 42707 existing records. [2025-10-21T19:01:35.815700] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:35.815891] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-21T19:01:35.815940] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-21T19:01:35.816294] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-21T19:01:35.816342] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-21T19:01:36.152709] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-21T19:01:36.176544] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:36.187510] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T19:01:36.951079] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-21T19:01:37.760277] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-21T19:01:37.763724] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:01:38.551056] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-21T19:01:38.608445] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T19:01:39.351052] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-21T19:01:39.553945] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T19:01:40.093156] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T19:01:40.151468] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-21T19:01:40.156418] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T19:01:40.951081] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-21T19:01:41.751029] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-21T19:01:41.882125] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T19:01:42.527260] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-21T19:01:42.526504] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:01:42.550995] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-21T19:01:43.261469] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-21T19:01:43.351042] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-21T19:01:44.151014] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-21T19:01:44.758890] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:01:44.951057] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-21T19:01:45.033692] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:01:45.751065] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-21T19:01:46.551006] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-21T19:01:46.666697] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T19:01:46.739446] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:01:47.351038] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-21T19:01:48.151074] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-21T19:01:48.479065] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T19:01:48.481396] [INFO ] [REMOTE ] GNT: Full fetch complete (11436 records). [2025-10-21T19:01:48.481630] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-21T19:01:48.677391] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T19:01:48.901019] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-21T19:01:48.901097] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-21T19:01:48.901371] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-21T19:01:48.901408] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-21T19:01:48.901878] [DEBUG] [LOCAL ] GNT: Trimmed 11436 records to 8676 (keeping 200 days of data) [2025-10-21T19:01:48.951255] [DEBUG] [LOCAL ] GNT: Primary data saved (8676 records). [2025-10-21T19:01:48.951126] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-21T19:01:48.951543] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-21T19:01:48.952509] [INFO ] [MAIN ] Update Progress: 949/2366 symbols completed. GNT took 20.3s. Estimated remaining: 3h 1m 47s. Rate: 7.8 symbols/min [2025-10-21T19:01:49.121988] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:01:49.152671] [DEBUG] [LOCAL ] GOLF: Loaded 30669 existing records from primary storage. [2025-10-21T19:01:49.152943] [INFO ] [MAIN ] GOLF: Loaded 30669 existing records. [2025-10-21T19:01:49.327187] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:01:49.327393] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-21T19:01:49.327439] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-21T19:01:49.327612] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-21T19:01:49.327682] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-21T19:01:49.679821] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:01:49.751033] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-21T19:01:50.009919] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T19:01:50.550991] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-21T19:01:50.742217] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T19:01:50.888583] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T19:01:51.351028] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-21T19:01:52.151015] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-21T19:01:52.210805] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:01:52.770932] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T19:01:52.951084] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-21T19:01:53.741274] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:01:53.750898] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-21T19:01:54.441757] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T19:01:54.551043] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-21T19:01:55.324005] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:01:55.350989] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-21T19:01:55.615764] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T19:01:56.151025] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-21T19:01:56.951006] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-21T19:01:57.130630] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T19:01:57.756141] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-21T19:01:57.773312] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T19:01:58.414350] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:01:58.551027] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-21T19:01:59.351052] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-21T19:01:59.506589] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:01:59.809202] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T19:02:00.151044] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-21T19:02:00.951006] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-21T19:02:01.036105] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:02:01.689887] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:02:01.750989] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-21T19:02:02.551034] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-21T19:02:03.341875] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-21T19:02:03.351334] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-21T19:02:03.539636] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:02:04.108509] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T19:02:04.151085] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-21T19:02:04.776433] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T19:02:04.951089] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-21T19:02:05.750998] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-21T19:02:05.863186] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:02:06.551004] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-21T19:02:06.685027] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:02:06.949503] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T19:02:07.351074] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-21T19:02:08.151010] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-21T19:02:08.274921] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T19:02:08.650104] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T19:02:08.654489] [INFO ] [REMOTE ] GOLF: Full fetch complete (45307 records). [2025-10-21T19:02:08.654599] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-21T19:02:08.956099] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-21T19:02:09.023821] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-21T19:02:09.023892] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-21T19:02:09.024563] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-21T19:02:09.024623] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-21T19:02:09.025580] [DEBUG] [LOCAL ] GOLF: Trimmed 45307 records to 30473 (keeping 200 days of data) [2025-10-21T19:02:09.211973] [DEBUG] [LOCAL ] GOLF: Primary data saved (30473 records). [2025-10-21T19:02:09.212324] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-21T19:02:09.212421] [INFO ] [MAIN ] Update Progress: 950/2366 symbols completed. GOLF took 20.3s. Estimated remaining: 3h 1m 58s. Rate: 7.8 symbols/min [2025-10-21T19:02:09.377140] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:09.418792] [DEBUG] [LOCAL ] GOOS: Loaded 44284 existing records from primary storage. [2025-10-21T19:02:09.419139] [INFO ] [MAIN ] GOOS: Loaded 44284 existing records. [2025-10-21T19:02:09.595220] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:09.595507] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-21T19:02:09.595569] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-21T19:02:09.596155] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-21T19:02:09.596213] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-21T19:02:09.753963] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-21T19:02:09.959030] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:10.030711] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:02:10.038175] [INFO ] [REMOTE ] GNRC: Full fetch complete (65639 records). [2025-10-21T19:02:10.038321] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-21T19:02:10.422929] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-21T19:02:10.423005] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-21T19:02:10.423851] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-21T19:02:10.423913] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-21T19:02:10.425495] [DEBUG] [LOCAL ] GNRC: Trimmed 65639 records to 45398 (keeping 200 days of data) [2025-10-21T19:02:10.595408] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-21T19:02:10.698907] [DEBUG] [LOCAL ] GNRC: Primary data saved (45398 records). [2025-10-21T19:02:10.699041] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-21T19:02:10.699117] [INFO ] [MAIN ] Update Progress: 951/2366 symbols completed. GNRC took 43.0s. Estimated remaining: 3h 1m 41s. Rate: 7.8 symbols/min [2025-10-21T19:02:10.871468] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:10.898135] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T19:02:10.935794] [DEBUG] [LOCAL ] GOTU: Loaded 36945 existing records from primary storage. [2025-10-21T19:02:10.936078] [INFO ] [MAIN ] GOTU: Loaded 36945 existing records. [2025-10-21T19:02:11.115687] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:11.115933] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-21T19:02:11.116021] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-21T19:02:11.116295] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-21T19:02:11.116352] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-21T19:02:11.362201] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-21T19:02:11.511160] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:11.667416] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T19:02:11.675870] [INFO ] [REMOTE ] GNW: Full fetch complete (73847 records). [2025-10-21T19:02:11.675998] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-21T19:02:12.073240] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-21T19:02:12.073425] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-21T19:02:12.074732] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-21T19:02:12.074910] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-21T19:02:12.076725] [DEBUG] [LOCAL ] GNW: Trimmed 73847 records to 51379 (keeping 200 days of data) [2025-10-21T19:02:12.155154] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-21T19:02:12.200600] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:02:12.397923] [DEBUG] [LOCAL ] GNW: Primary data saved (51379 records). [2025-10-21T19:02:12.398067] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-21T19:02:12.398697] [INFO ] [MAIN ] Update Progress: 952/2366 symbols completed. GNW took 40.8s. Estimated remaining: 3h 1m 25s. Rate: 7.8 symbols/min [2025-10-21T19:02:12.566532] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:12.611036] [DEBUG] [LOCAL ] GPC: Loaded 45947 existing records from primary storage. [2025-10-21T19:02:12.611345] [INFO ] [MAIN ] GPC: Loaded 45947 existing records. [2025-10-21T19:02:12.786051] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:12.786314] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-21T19:02:12.786371] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-21T19:02:12.786697] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-21T19:02:12.786752] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-21T19:02:12.953813] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-21T19:02:13.186808] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:13.369160] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T19:02:13.376237] [INFO ] [REMOTE ] GOF: Full fetch complete (62601 records). [2025-10-21T19:02:13.376332] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-21T19:02:13.757549] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-21T19:02:13.761999] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-21T19:02:13.762182] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-21T19:02:13.763329] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-21T19:02:13.763505] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-21T19:02:13.765134] [DEBUG] [LOCAL ] GOF: Trimmed 62601 records to 42730 (keeping 200 days of data) [2025-10-21T19:02:13.903737] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T19:02:14.085755] [DEBUG] [LOCAL ] GOF: Primary data saved (42730 records). [2025-10-21T19:02:14.085896] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-21T19:02:14.086270] [INFO ] [MAIN ] Update Progress: 953/2366 symbols completed. GOF took 38.7s. Estimated remaining: 3h 1m 8s. Rate: 7.8 symbols/min [2025-10-21T19:02:14.257567] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:14.274380] [DEBUG] [LOCAL ] GPI: Loaded 14844 existing records from primary storage. [2025-10-21T19:02:14.274606] [INFO ] [MAIN ] GPI: Loaded 14844 existing records. [2025-10-21T19:02:14.455185] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:14.455426] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-21T19:02:14.455474] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-21T19:02:14.455624] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-21T19:02:14.455709] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-21T19:02:14.554268] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-21T19:02:14.815856] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:14.846567] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T19:02:15.351114] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-21T19:02:15.396761] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:02:16.151067] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-21T19:02:16.260617] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T19:02:16.346245] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T19:02:16.951105] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-21T19:02:17.751035] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-21T19:02:17.848785] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:02:17.865598] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T19:02:18.551080] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-21T19:02:19.335416] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T19:02:19.350985] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-21T19:02:20.151067] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-21T19:02:20.402876] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:02:20.951049] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-21T19:02:21.064039] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:02:21.286135] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T19:02:21.751028] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-21T19:02:22.551030] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-21T19:02:22.766742] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T19:02:22.997926] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T19:02:23.351089] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-21T19:02:24.022405] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T19:02:24.151024] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-21T19:02:24.509615] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:02:24.951080] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-21T19:02:25.723785] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:02:25.751027] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-21T19:02:25.773488] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T19:02:26.551028] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-21T19:02:27.350991] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-21T19:02:27.444949] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T19:02:27.465458] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T19:02:28.151020] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-21T19:02:28.942323] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:02:28.950982] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-21T19:02:29.751013] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-21T19:02:29.785104] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T19:02:30.035623] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T19:02:30.551004] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-21T19:02:30.764621] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T19:02:31.351024] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-21T19:02:32.151000] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-21T19:02:32.243176] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T19:02:32.278777] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T19:02:32.951076] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-21T19:02:33.572161] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T19:02:33.751030] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-21T19:02:34.211770] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T19:02:34.550996] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-21T19:02:35.351063] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-21T19:02:35.426710] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:02:35.542763] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:02:36.151051] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-21T19:02:36.859179] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:02:36.951001] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-21T19:02:37.116605] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T19:02:37.751025] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-21T19:02:38.550999] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-21T19:02:38.635701] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:02:39.238373] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T19:02:39.351004] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-21T19:02:39.539691] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:02:39.542961] [INFO ] [REMOTE ] GPI: Full fetch complete (21783 records). [2025-10-21T19:02:39.543041] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-21T19:02:39.912757] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-21T19:02:39.912852] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-21T19:02:39.913302] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-21T19:02:39.913362] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-21T19:02:39.913952] [DEBUG] [LOCAL ] GPI: Trimmed 21783 records to 14752 (keeping 200 days of data) [2025-10-21T19:02:40.002990] [DEBUG] [LOCAL ] GPI: Primary data saved (14752 records). [2025-10-21T19:02:40.003122] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-21T19:02:40.003197] [INFO ] [MAIN ] Update Progress: 954/2366 symbols completed. GPI took 25.9s. Estimated remaining: 3h 1m 27s. Rate: 7.8 symbols/min [2025-10-21T19:02:40.152421] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-21T19:02:40.171600] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:40.178026] [DEBUG] [LOCAL ] GPJA: Loaded 4118 existing records from primary storage. [2025-10-21T19:02:40.178386] [INFO ] [MAIN ] GPJA: Loaded 4118 existing records. [2025-10-21T19:02:40.353536] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:40.353772] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-21T19:02:40.353848] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-21T19:02:40.354016] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-21T19:02:40.354056] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-21T19:02:40.707234] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:40.951024] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-21T19:02:41.157820] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:02:41.165032] [INFO ] [REMOTE ] GPC: Full fetch complete (68685 records). [2025-10-21T19:02:41.165147] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-21T19:02:41.569564] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-21T19:02:41.569679] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-21T19:02:41.570710] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-21T19:02:41.570930] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-21T19:02:41.572501] [DEBUG] [LOCAL ] GPC: Trimmed 68685 records to 45944 (keeping 200 days of data) [2025-10-21T19:02:41.696482] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T19:02:41.789946] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-21T19:02:41.900861] [DEBUG] [LOCAL ] GPC: Primary data saved (45944 records). [2025-10-21T19:02:41.901006] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-21T19:02:41.901721] [INFO ] [MAIN ] Update Progress: 955/2366 symbols completed. GPC took 29.5s. Estimated remaining: 3h 1m 11s. Rate: 7.8 symbols/min [2025-10-21T19:02:42.089615] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:42.111321] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T19:02:42.169513] [DEBUG] [LOCAL ] GPK: Loaded 52784 existing records from primary storage. [2025-10-21T19:02:42.169876] [INFO ] [MAIN ] GPK: Loaded 52784 existing records. [2025-10-21T19:02:42.370410] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:42.370608] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-21T19:02:42.370715] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-21T19:02:42.370925] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-21T19:02:42.370981] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-21T19:02:42.567080] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-21T19:02:42.777131] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:43.351050] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-21T19:02:43.482946] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T19:02:43.490058] [INFO ] [REMOTE ] GOOS: Full fetch complete (64687 records). [2025-10-21T19:02:43.490166] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-21T19:02:43.601341] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T19:02:43.893212] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-21T19:02:43.893351] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-21T19:02:43.894348] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-21T19:02:43.894413] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-21T19:02:43.895743] [DEBUG] [LOCAL ] GOOS: Trimmed 64687 records to 44145 (keeping 200 days of data) [2025-10-21T19:02:44.152294] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-21T19:02:44.158712] [DEBUG] [LOCAL ] GOOS: Primary data saved (44145 records). [2025-10-21T19:02:44.158906] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-21T19:02:44.159039] [INFO ] [MAIN ] Update Progress: 956/2366 symbols completed. GOOS took 34.9s. Estimated remaining: 3h 0m 55s. Rate: 7.8 symbols/min [2025-10-21T19:02:44.334340] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:02:44.362297] [DEBUG] [LOCAL ] GPMT: Loaded 25982 existing records from primary storage. [2025-10-21T19:02:44.362591] [INFO ] [MAIN ] GPMT: Loaded 25982 existing records. [2025-10-21T19:02:44.559195] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:02:44.565049] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-21T19:02:44.574241] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-21T19:02:44.575787] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:02:44.584940] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-21T19:02:44.585583] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T19:02:44.585726] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-21T19:02:44.619681] [INFO ] [REMOTE ] GOTU: Full fetch complete (58435 records). [2025-10-21T19:02:44.651753] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-21T19:02:44.960915] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-21T19:02:45.309783] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:02:45.391259] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-21T19:02:45.391342] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-21T19:02:45.392285] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-21T19:02:45.392349] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-21T19:02:45.393508] [DEBUG] [LOCAL ] GOTU: Trimmed 58435 records to 37040 (keeping 200 days of data) [2025-10-21T19:02:45.575165] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T19:02:45.602481] [DEBUG] [LOCAL ] GOTU: Primary data saved (37040 records). [2025-10-21T19:02:45.602628] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-21T19:02:45.602747] [INFO ] [MAIN ] Update Progress: 957/2366 symbols completed. GOTU took 34.9s. Estimated remaining: 3h 0m 38s. Rate: 7.8 symbols/min [2025-10-21T19:02:45.751084] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-21T19:02:46.327234] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T19:02:46.551010] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-21T19:02:47.351070] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-21T19:02:47.905073] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T19:02:48.151126] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-21T19:02:48.278338] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T19:02:48.512934] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-21T19:02:48.951077] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-21T19:02:49.583068] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T19:02:49.751024] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-21T19:02:50.329697] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T19:02:50.551068] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-21T19:02:51.156230] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T19:02:51.351031] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-21T19:02:52.151098] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-21T19:02:52.421214] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T19:02:52.951065] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-21T19:02:53.688543] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T19:02:53.750972] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-21T19:02:53.983556] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:02:54.551066] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-21T19:02:55.350994] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-21T19:02:55.446145] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:02:55.727042] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T19:02:55.992455] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T19:02:55.993461] [INFO ] [REMOTE ] GPJA: Full fetch complete (6846 records). [2025-10-21T19:02:55.993529] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-21T19:02:56.151538] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-21T19:02:56.367169] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-21T19:02:56.367244] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-21T19:02:56.367424] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-21T19:02:56.367461] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-21T19:02:56.367880] [DEBUG] [LOCAL ] GPJA: Trimmed 6846 records to 4112 (keeping 200 days of data) [2025-10-21T19:02:56.392492] [DEBUG] [LOCAL ] GPJA: Primary data saved (4112 records). [2025-10-21T19:02:56.392590] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-21T19:02:56.392685] [INFO ] [MAIN ] Update Progress: 958/2366 symbols completed. GPJA took 16.4s. Estimated remaining: 3h 0m 35s. Rate: 7.8 symbols/min [2025-10-21T19:02:56.951106] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-21T19:02:58.045556] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:02:58.059706] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-21T19:02:58.109023] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:02:58.551078] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-21T19:02:59.669735] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T19:02:59.676491] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-21T19:02:59.987352] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T19:03:00.150991] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-21T19:03:01.331170] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T19:03:01.340022] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-21T19:03:02.180363] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T19:03:02.191352] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-21T19:03:02.425936] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T19:03:02.551045] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-21T19:03:03.524361] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T19:03:03.529200] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-21T19:03:04.062952] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T19:03:04.151068] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-21T19:03:04.476932] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T19:03:04.951086] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-21T19:03:05.881792] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:03:05.893162] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-21T19:03:06.168191] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:03:06.171711] [INFO ] [REMOTE ] GPMT: Full fetch complete (36477 records). [2025-10-21T19:03:06.171797] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-21T19:03:06.543599] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-21T19:03:06.543722] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-21T19:03:06.544347] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-21T19:03:06.544386] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-21T19:03:06.545406] [DEBUG] [LOCAL ] GPMT: Trimmed 36477 records to 26021 (keeping 200 days of data) [2025-10-21T19:03:06.697925] [DEBUG] [LOCAL ] GPMT: Primary data saved (26021 records). [2025-10-21T19:03:06.698046] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-21T19:03:06.698123] [INFO ] [MAIN ] Update Progress: 959/2366 symbols completed. GPMT took 22.5s. Estimated remaining: 3h 0m 31s. Rate: 7.8 symbols/min [2025-10-21T19:03:07.826342] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T19:03:07.838675] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-21T19:03:09.574988] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:03:09.583074] [INFO ] [REMOTE ] GPK: Full fetch complete (76057 records). [2025-10-21T19:03:09.583210] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-21T19:03:09.973269] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-21T19:03:09.973360] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-21T19:03:09.974341] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-21T19:03:09.974405] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-21T19:03:09.975885] [DEBUG] [LOCAL ] GPK: Trimmed 76057 records to 52780 (keeping 200 days of data) [2025-10-21T19:03:10.310711] [DEBUG] [LOCAL ] GPK: Primary data saved (52780 records). [2025-10-21T19:03:10.310849] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-21T19:03:10.311532] [INFO ] [MAIN ] Update Progress: 960/2366 symbols completed. GPK took 28.4s. Estimated remaining: 3h 0m 18s. Rate: 7.8 symbols/min [2025-10-21T19:03:10.879205] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:10.954444] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:11.017107] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:11.065532] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:11.106743] [DEBUG] [LOCAL ] GPRK: Loaded 39821 existing records from primary storage. [2025-10-21T19:03:11.107469] [DEBUG] [LOCAL ] GPOR: Loaded 23397 existing records from primary storage. [2025-10-21T19:03:11.107614] [INFO ] [MAIN ] GPRK: Loaded 39821 existing records. [2025-10-21T19:03:11.107824] [INFO ] [MAIN ] GPOR: Loaded 23397 existing records. [2025-10-21T19:03:11.337373] [DEBUG] [LOCAL ] GRBK: Loaded 26937 existing records from primary storage. [2025-10-21T19:03:11.338740] [INFO ] [MAIN ] GRBK: Loaded 26937 existing records. [2025-10-21T19:03:11.541277] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:11.571091] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-21T19:03:11.565801] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:11.603764] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-21T19:03:11.631061] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-21T19:03:11.631003] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-21T19:03:11.631235] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-21T19:03:11.645386] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-21T19:03:11.646535] [DEBUG] [LOCAL ] GPN: Loaded 51943 existing records from primary storage. [2025-10-21T19:03:11.687096] [INFO ] [MAIN ] GPN: Loaded 51943 existing records. [2025-10-21T19:03:11.681849] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-21T19:03:11.731980] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-21T19:03:11.849216] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:11.953964] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-21T19:03:11.993434] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-21T19:03:12.027573] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-21T19:03:12.065107] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-21T19:03:12.398083] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:12.419233] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-21T19:03:12.590010] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-21T19:03:12.819723] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:12.746272] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-21T19:03:12.820092] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-21T19:03:12.844613] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-21T19:03:13.013404] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:13.058355] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-21T19:03:13.191057] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:13.213089] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-21T19:03:13.425892] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:13.426231] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-21T19:03:14.358224] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T19:03:14.364038] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-21T19:03:14.632498] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T19:03:14.639545] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-21T19:03:14.755602] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T19:03:14.764309] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-21T19:03:14.791664] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:03:14.802076] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-21T19:03:15.567413] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T19:03:15.572239] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-21T19:03:16.288697] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T19:03:16.308518] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-21T19:03:16.309267] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T19:03:16.317883] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-21T19:03:16.449576] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:03:16.459571] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-21T19:03:16.711259] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T19:03:16.951008] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-21T19:03:17.490849] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T19:03:17.636091] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T19:03:17.751030] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-21T19:03:18.082398] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T19:03:18.298200] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:03:18.551028] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-21T19:03:19.351019] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-21T19:03:19.467345] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:03:20.151014] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-21T19:03:20.441696] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:03:20.755994] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T19:03:20.951021] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-21T19:03:21.254386] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T19:03:21.751083] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-21T19:03:22.551089] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-21T19:03:22.585411] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T19:03:22.927888] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T19:03:23.351011] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-21T19:03:23.639756] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:03:24.151019] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-21T19:03:24.951019] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-21T19:03:25.054855] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:03:25.111702] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:03:25.751061] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-21T19:03:26.438596] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T19:03:26.551026] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-21T19:03:26.909554] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T19:03:27.351016] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-21T19:03:28.151029] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-21T19:03:28.340536] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:03:28.633769] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:03:28.950999] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-21T19:03:29.329390] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T19:03:29.751023] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-21T19:03:30.551045] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-21T19:03:30.815352] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:03:30.881889] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:03:31.351011] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-21T19:03:31.652448] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T19:03:32.151057] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-21T19:03:32.850300] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:03:32.950997] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-21T19:03:33.751007] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-21T19:03:33.891397] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:03:34.045772] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T19:03:34.550991] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-21T19:03:34.945744] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:03:35.351035] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-21T19:03:35.991742] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T19:03:36.151030] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-21T19:03:36.665502] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:03:36.669961] [INFO ] [REMOTE ] GRBK: Full fetch complete (40028 records). [2025-10-21T19:03:36.670071] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-21T19:03:36.956257] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-21T19:03:37.069899] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-21T19:03:37.069993] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-21T19:03:37.070685] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-21T19:03:37.070749] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-21T19:03:37.071790] [DEBUG] [LOCAL ] GRBK: Trimmed 40028 records to 26836 (keeping 200 days of data) [2025-10-21T19:03:37.225508] [DEBUG] [LOCAL ] GRBK: Primary data saved (26836 records). [2025-10-21T19:03:37.225631] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-21T19:03:37.225748] [INFO ] [MAIN ] Update Progress: 961/2366 symbols completed. GRBK took 26.9s. Estimated remaining: 3h 0m 38s. Rate: 7.8 symbols/min [2025-10-21T19:03:37.394449] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:37.405247] [DEBUG] [LOCAL ] GRC: Loaded 9306 existing records from primary storage. [2025-10-21T19:03:37.405442] [INFO ] [MAIN ] GRC: Loaded 9306 existing records. [2025-10-21T19:03:37.581767] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:37.582020] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-21T19:03:37.582073] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-21T19:03:37.582216] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-21T19:03:37.582253] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-21T19:03:37.762218] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-21T19:03:37.906573] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T19:03:37.963688] [INFO ] [REMOTE ] GPRK: Full fetch complete (58358 records). [2025-10-21T19:03:37.979185] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-21T19:03:37.984425] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:38.370806] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-21T19:03:38.370900] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-21T19:03:38.371814] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-21T19:03:38.371895] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-21T19:03:38.388801] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T19:03:38.394736] [DEBUG] [LOCAL ] GPRK: Trimmed 58358 records to 39820 (keeping 200 days of data) [2025-10-21T19:03:38.552084] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-21T19:03:38.624358] [DEBUG] [LOCAL ] GPRK: Primary data saved (39820 records). [2025-10-21T19:03:38.624850] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-21T19:03:38.625059] [INFO ] [MAIN ] Update Progress: 962/2366 symbols completed. GPRK took 28.3s. Estimated remaining: 3h 0m 21s. Rate: 7.8 symbols/min [2025-10-21T19:03:38.788933] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:38.809695] [DEBUG] [LOCAL ] GRDN: Loaded 21063 existing records from primary storage. [2025-10-21T19:03:38.809933] [INFO ] [MAIN ] GRDN: Loaded 21063 existing records. [2025-10-21T19:03:38.982346] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:38.982547] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-21T19:03:38.982593] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-21T19:03:38.982771] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-21T19:03:38.982825] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-21T19:03:39.329144] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:39.350978] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-21T19:03:39.606019] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T19:03:39.614211] [INFO ] [REMOTE ] GPN: Full fetch complete (75060 records). [2025-10-21T19:03:39.614359] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-21T19:03:40.040499] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T19:03:40.040881] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-21T19:03:40.045850] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-21T19:03:40.046953] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-21T19:03:40.047048] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-21T19:03:40.047210] [INFO ] [REMOTE ] GPOR: Full fetch complete (34851 records). [2025-10-21T19:03:40.047620] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-21T19:03:40.126538] [DEBUG] [LOCAL ] GPN: Trimmed 75060 records to 51923 (keeping 200 days of data) [2025-10-21T19:03:40.155965] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-21T19:03:40.297964] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T19:03:40.687024] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-21T19:03:40.688361] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-21T19:03:40.689027] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-21T19:03:40.691510] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-21T19:03:40.712189] [DEBUG] [LOCAL ] GPOR: Trimmed 34851 records to 23342 (keeping 200 days of data) [2025-10-21T19:03:40.912147] [DEBUG] [LOCAL ] GPN: Primary data saved (51923 records). [2025-10-21T19:03:40.913555] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-21T19:03:40.915449] [INFO ] [MAIN ] Update Progress: 963/2366 symbols completed. GPN took 30.6s. Estimated remaining: 3h 0m 6s. Rate: 7.8 symbols/min [2025-10-21T19:03:40.963166] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-21T19:03:40.970530] [DEBUG] [LOCAL ] GPOR: Primary data saved (23342 records). [2025-10-21T19:03:41.002004] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-21T19:03:41.002217] [INFO ] [MAIN ] Update Progress: 964/2366 symbols completed. GPOR took 30.7s. Estimated remaining: 2h 59m 47s. Rate: 7.8 symbols/min [2025-10-21T19:03:41.098063] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:03:41.275915] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:41.277604] [DEBUG] [LOCAL ] GRMN: No existing data file found in primary storage. [2025-10-21T19:03:41.294446] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:03:41.292279] [WARN ] [MAIN ] GRMN: No existing data found, performing full refresh instead. [2025-10-21T19:03:41.294949] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-21T19:03:41.295001] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-21T19:03:41.295045] [DEBUG] [LOCAL ] GRMN: No primary data file found to delete. [2025-10-21T19:03:41.295077] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-21T19:03:41.631740] [DEBUG] [LOCAL ] GRND: Loaded 50199 existing records from primary storage. [2025-10-21T19:03:41.655981] [INFO ] [MAIN ] GRND: Loaded 50199 existing records. [2025-10-21T19:03:41.734926] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:41.757916] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-21T19:03:41.885517] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:03:41.885920] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-21T19:03:41.885972] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-21T19:03:41.886190] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-21T19:03:41.886248] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-21T19:03:42.008372] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T19:03:42.255590] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:03:42.341868] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T19:03:42.551063] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-21T19:03:43.351103] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-21T19:03:44.143779] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:03:44.151745] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-21T19:03:44.947322] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T19:03:44.956200] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-21T19:03:44.967899] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:03:45.750988] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-21T19:03:45.967372] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:03:46.551072] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-21T19:03:47.190876] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T19:03:47.350993] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-21T19:03:47.508278] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T19:03:48.150992] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-21T19:03:48.233317] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T19:03:48.951071] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-21T19:03:49.751091] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-21T19:03:49.787297] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:03:50.540379] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:03:50.550990] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-21T19:03:50.633617] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:03:51.273986] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T19:03:51.351063] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-21T19:03:52.151051] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-21T19:03:52.951102] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-21T19:03:53.042270] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:03:53.215147] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T19:03:53.711208] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T19:03:53.750985] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-21T19:03:54.551028] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-21T19:03:55.350998] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-21T19:03:55.517846] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:03:55.564115] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T19:03:56.151030] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-21T19:03:56.338021] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T19:03:56.951056] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-21T19:03:57.751049] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-21T19:03:57.926497] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T19:03:58.551023] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-21T19:03:58.742875] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T19:03:58.743509] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:03:59.005933] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T19:03:59.351048] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-21T19:04:00.151121] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-21T19:04:00.235227] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T19:04:00.237926] [INFO ] [REMOTE ] GRC: Full fetch complete (13413 records). [2025-10-21T19:04:00.237997] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-21T19:04:00.598795] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-21T19:04:00.598875] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-21T19:04:00.599282] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-21T19:04:00.599320] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-21T19:04:00.599808] [DEBUG] [LOCAL ] GRC: Trimmed 13413 records to 9277 (keeping 200 days of data) [2025-10-21T19:04:00.656450] [DEBUG] [LOCAL ] GRC: Primary data saved (9277 records). [2025-10-21T19:04:00.656588] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-21T19:04:00.656694] [INFO ] [MAIN ] Update Progress: 965/2366 symbols completed. GRC took 23.4s. Estimated remaining: 2h 59m 57s. Rate: 7.8 symbols/min [2025-10-21T19:04:00.827075] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:00.858979] [DEBUG] [LOCAL ] GRNT: Loaded 33992 existing records from primary storage. [2025-10-21T19:04:00.859241] [INFO ] [MAIN ] GRNT: Loaded 33992 existing records. [2025-10-21T19:04:00.957536] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-21T19:04:01.048281] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:01.048549] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-21T19:04:01.048699] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-21T19:04:01.050147] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-21T19:04:01.050206] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-21T19:04:01.413602] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:01.751075] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-21T19:04:01.870338] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T19:04:02.551006] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-21T19:04:02.617256] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:04:03.035687] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T19:04:03.351074] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-21T19:04:03.931355] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:04:04.151006] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-21T19:04:04.555512] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T19:04:04.951083] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-21T19:04:05.446744] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:04:05.751065] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-21T19:04:06.021718] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:04:06.551042] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-21T19:04:07.282635] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T19:04:07.350982] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-21T19:04:08.151007] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-21T19:04:08.327454] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T19:04:08.951006] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-21T19:04:09.095850] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:04:09.167861] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T19:04:09.751020] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-21T19:04:10.499382] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T19:04:10.551051] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-21T19:04:11.046439] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T19:04:11.351034] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-21T19:04:12.084496] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T19:04:12.151065] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-21T19:04:12.582455] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:04:12.586918] [INFO ] [REMOTE ] GRDN: Full fetch complete (26463 records). [2025-10-21T19:04:12.587020] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-21T19:04:12.956230] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-21T19:04:13.006363] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-21T19:04:13.006450] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-21T19:04:13.007241] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-21T19:04:13.007341] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-21T19:04:13.008793] [DEBUG] [LOCAL ] GRDN: Trimmed 26463 records to 21184 (keeping 200 days of data) [2025-10-21T19:04:13.136157] [DEBUG] [LOCAL ] GRDN: Primary data saved (21184 records). [2025-10-21T19:04:13.136290] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-21T19:04:13.136373] [INFO ] [MAIN ] Update Progress: 966/2366 symbols completed. GRDN took 34.5s. Estimated remaining: 2h 59m 56s. Rate: 7.8 symbols/min [2025-10-21T19:04:13.322728] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:13.334410] [DEBUG] [LOCAL ] GROV: Loaded 8747 existing records from primary storage. [2025-10-21T19:04:13.334686] [INFO ] [MAIN ] GROV: Loaded 8747 existing records. [2025-10-21T19:04:13.525961] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:13.526164] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-21T19:04:13.526212] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-21T19:04:13.526359] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-21T19:04:13.526415] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-21T19:04:13.756549] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-21T19:04:13.886443] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:14.049363] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:04:14.057794] [INFO ] [REMOTE ] GRND: Full fetch complete (71733 records). [2025-10-21T19:04:14.057975] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-21T19:04:14.483095] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-21T19:04:14.483276] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-21T19:04:14.484336] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-21T19:04:14.484586] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-21T19:04:14.512392] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:04:14.512564] [DEBUG] [LOCAL ] GRND: Trimmed 71733 records to 50203 (keeping 200 days of data) [2025-10-21T19:04:14.569196] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-21T19:04:14.814800] [DEBUG] [LOCAL ] GRND: Primary data saved (50203 records). [2025-10-21T19:04:14.814937] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-21T19:04:14.815014] [INFO ] [MAIN ] Update Progress: 967/2366 symbols completed. GRND took 33.8s. Estimated remaining: 2h 59m 39s. Rate: 7.8 symbols/min [2025-10-21T19:04:15.011986] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:15.017623] [DEBUG] [LOCAL ] GRX: Loaded 4840 existing records from primary storage. [2025-10-21T19:04:15.017800] [INFO ] [MAIN ] GRX: Loaded 4840 existing records. [2025-10-21T19:04:15.200721] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:15.200922] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-21T19:04:15.200969] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-21T19:04:15.201115] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-21T19:04:15.201171] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-21T19:04:15.361890] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-21T19:04:15.547917] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:04:15.589912] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:15.591219] [INFO ] [REMOTE ] GRMN: Full fetch complete (59542 records). [2025-10-21T19:04:15.591455] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-21T19:04:15.994036] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:04:16.031387] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-21T19:04:16.031520] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-21T19:04:16.039256] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-21T19:04:16.039969] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-21T19:04:16.041820] [DEBUG] [LOCAL ] GRMN: Trimmed 59542 records to 39939 (keeping 200 days of data) [2025-10-21T19:04:16.151037] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-21T19:04:16.302163] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:04:16.318412] [DEBUG] [LOCAL ] GRMN: Primary data saved (39939 records). [2025-10-21T19:04:16.318564] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-21T19:04:16.318639] [INFO ] [MAIN ] Update Progress: 968/2366 symbols completed. GRMN took 35.4s. Estimated remaining: 2h 59m 23s. Rate: 7.8 symbols/min [2025-10-21T19:04:16.497297] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:16.546500] [DEBUG] [LOCAL ] GS: Loaded 51784 existing records from primary storage. [2025-10-21T19:04:16.546828] [INFO ] [MAIN ] GS: Loaded 51784 existing records. [2025-10-21T19:04:16.735171] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:16.735770] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-21T19:04:16.735951] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-21T19:04:16.736158] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-21T19:04:16.736200] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-21T19:04:16.855796] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T19:04:16.956182] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-21T19:04:17.105310] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:17.348085] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-21T19:04:17.751063] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-21T19:04:18.551043] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-21T19:04:19.316476] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T19:04:19.350987] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-21T19:04:19.849081] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T19:04:20.150995] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-21T19:04:20.167582] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:04:20.728092] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T19:04:20.951031] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-21T19:04:21.751030] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-21T19:04:22.550992] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-21T19:04:23.016187] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-21T19:04:23.113089] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T19:04:23.134562] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T19:04:23.350999] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-21T19:04:23.963766] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T19:04:24.151005] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-21T19:04:24.951020] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-21T19:04:25.534292] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:04:25.675917] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T19:04:25.750995] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-21T19:04:26.315504] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T19:04:26.551012] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-21T19:04:27.122606] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T19:04:27.351104] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-21T19:04:27.961577] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:04:28.150993] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-21T19:04:28.922929] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T19:04:28.951007] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-21T19:04:29.666740] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T19:04:29.668150] [INFO ] [REMOTE ] GRX: Full fetch complete (6544 records). [2025-10-21T19:04:29.668219] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-21T19:04:29.756163] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-21T19:04:30.029056] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-21T19:04:30.029131] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-21T19:04:30.029314] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-21T19:04:30.029354] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-21T19:04:30.029781] [DEBUG] [LOCAL ] GRX: Trimmed 6544 records to 4844 (keeping 200 days of data) [2025-10-21T19:04:30.057955] [DEBUG] [LOCAL ] GRX: Primary data saved (4844 records). [2025-10-21T19:04:30.058062] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-21T19:04:30.058146] [INFO ] [MAIN ] Update Progress: 969/2366 symbols completed. GRX took 15.2s. Estimated remaining: 2h 59m 24s. Rate: 7.8 symbols/min [2025-10-21T19:04:30.237391] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:30.274510] [DEBUG] [LOCAL ] GSBD: Loaded 39645 existing records from primary storage. [2025-10-21T19:04:30.274827] [INFO ] [MAIN ] GSBD: Loaded 39645 existing records. [2025-10-21T19:04:30.448148] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:30.448406] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-21T19:04:30.448470] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-21T19:04:30.448765] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-21T19:04:30.448838] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-21T19:04:30.556126] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-21T19:04:30.801741] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:31.351013] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-21T19:04:31.414371] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T19:04:32.089024] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-21T19:04:32.151024] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-21T19:04:32.299876] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T19:04:32.873799] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T19:04:32.951041] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-21T19:04:33.751032] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-21T19:04:34.447858] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T19:04:34.550995] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-21T19:04:34.737611] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:04:35.351015] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-21T19:04:36.050623] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T19:04:36.137845] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T19:04:36.150993] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-21T19:04:36.806337] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-21T19:04:36.951032] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-21T19:04:37.751029] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-21T19:04:38.551016] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-21T19:04:39.147044] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:04:39.290548] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-21T19:04:39.350990] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-21T19:04:39.382291] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:04:39.383942] [INFO ] [REMOTE ] GROV: Full fetch complete (13681 records). [2025-10-21T19:04:39.384017] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-21T19:04:39.762279] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-21T19:04:39.762349] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-21T19:04:39.762680] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-21T19:04:39.762741] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-21T19:04:39.763233] [DEBUG] [LOCAL ] GROV: Trimmed 13681 records to 8701 (keeping 200 days of data) [2025-10-21T19:04:39.810253] [DEBUG] [LOCAL ] GROV: Primary data saved (8701 records). [2025-10-21T19:04:39.810383] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-21T19:04:39.810463] [INFO ] [MAIN ] Update Progress: 970/2366 symbols completed. GROV took 26.7s. Estimated remaining: 2h 59m 19s. Rate: 7.8 symbols/min [2025-10-21T19:04:39.985240] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:40.033872] [DEBUG] [LOCAL ] GSK: Loaded 53512 existing records from primary storage. [2025-10-21T19:04:40.034178] [INFO ] [MAIN ] GSK: Loaded 53512 existing records. [2025-10-21T19:04:40.156191] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-21T19:04:40.211409] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:40.211611] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-21T19:04:40.211719] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-21T19:04:40.212017] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-21T19:04:40.212056] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-21T19:04:40.557964] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:40.951092] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-21T19:04:41.612142] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-21T19:04:41.636803] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:04:41.642124] [INFO ] [REMOTE ] GRNT: Full fetch complete (48351 records). [2025-10-21T19:04:41.642208] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-21T19:04:41.756130] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-21T19:04:42.022062] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-21T19:04:42.022150] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-21T19:04:42.022878] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-21T19:04:42.022939] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-21T19:04:42.024033] [DEBUG] [LOCAL ] GRNT: Trimmed 48351 records to 34016 (keeping 200 days of data) [2025-10-21T19:04:42.220063] [DEBUG] [LOCAL ] GRNT: Primary data saved (34016 records). [2025-10-21T19:04:42.220200] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-21T19:04:42.221345] [INFO ] [MAIN ] Update Progress: 971/2366 symbols completed. GRNT took 41.6s. Estimated remaining: 2h 59m 4s. Rate: 7.8 symbols/min [2025-10-21T19:04:42.387829] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:04:42.422621] [DEBUG] [LOCAL ] GSL: Loaded 33197 existing records from primary storage. [2025-10-21T19:04:42.422906] [INFO ] [MAIN ] GSL: Loaded 33197 existing records. [2025-10-21T19:04:42.562888] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-21T19:04:42.604258] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:04:42.604702] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-21T19:04:42.604774] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-21T19:04:42.605092] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-21T19:04:42.605140] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-21T19:04:42.969444] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:04:43.016838] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T19:04:43.350996] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-21T19:04:43.455946] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:04:44.150981] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-21T19:04:44.485145] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T19:04:44.942291] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:04:44.951800] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-21T19:04:45.459024] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T19:04:45.751025] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-21T19:04:46.551077] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-21T19:04:47.044770] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T19:04:47.162676] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T19:04:47.351023] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-21T19:04:48.150994] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-21T19:04:48.562495] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T19:04:48.953745] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-21T19:04:48.958741] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:04:49.751108] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-21T19:04:50.109763] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T19:04:50.497746] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:04:50.550992] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-21T19:04:51.312622] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T19:04:51.350980] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-21T19:04:52.151063] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-21T19:04:52.573324] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T19:04:52.862262] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T19:04:52.950983] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-21T19:04:53.188060] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T19:04:53.751076] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-21T19:04:54.450430] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:04:54.551033] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-21T19:04:54.736245] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T19:04:55.351036] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-21T19:04:56.150997] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-21T19:04:56.410865] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T19:04:56.727287] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:04:56.951014] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-21T19:04:57.751082] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-21T19:04:58.173949] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T19:04:58.550992] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-21T19:04:59.057214] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T19:04:59.100233] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T19:04:59.141659] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T19:04:59.150442] [INFO ] [REMOTE ] GS: Full fetch complete (75838 records). [2025-10-21T19:04:59.150619] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-21T19:04:59.352259] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-21T19:04:59.634162] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-21T19:04:59.634285] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-21T19:04:59.635486] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-21T19:04:59.635557] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-21T19:04:59.637394] [DEBUG] [LOCAL ] GS: Trimmed 75838 records to 51777 (keeping 200 days of data) [2025-10-21T19:05:00.034267] [DEBUG] [LOCAL ] GS: Primary data saved (51777 records). [2025-10-21T19:05:00.034664] [INFO ] [MAIN ] GS: Full history saved. [2025-10-21T19:05:00.034780] [INFO ] [MAIN ] Update Progress: 972/2366 symbols completed. GS took 43.7s. Estimated remaining: 2h 59m 10s. Rate: 7.8 symbols/min [2025-10-21T19:05:00.156179] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-21T19:05:00.217422] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:00.264047] [DEBUG] [LOCAL ] GTES: Loaded 50321 existing records from primary storage. [2025-10-21T19:05:00.264376] [INFO ] [MAIN ] GTES: Loaded 50321 existing records. [2025-10-21T19:05:00.451292] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:00.451527] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-21T19:05:00.451574] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-21T19:05:00.451800] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-21T19:05:00.451855] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-21T19:05:00.830399] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:00.951009] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-21T19:05:01.137179] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T19:05:01.751075] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-21T19:05:02.369234] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T19:05:02.421375] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-21T19:05:02.551050] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-21T19:05:03.196144] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:05:03.351028] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-21T19:05:04.151066] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-21T19:05:04.289934] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:05:04.732694] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:05:04.951044] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-21T19:05:05.592483] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T19:05:05.751049] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-21T19:05:06.551000] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-21T19:05:06.590176] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:05:07.351005] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-21T19:05:07.594872] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T19:05:07.602077] [INFO ] [REMOTE ] GSBD: Full fetch complete (58530 records). [2025-10-21T19:05:07.602204] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-21T19:05:07.998599] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-21T19:05:07.998800] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-21T19:05:07.999683] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-21T19:05:07.999837] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-21T19:05:08.001117] [DEBUG] [LOCAL ] GSBD: Trimmed 58530 records to 39579 (keeping 200 days of data) [2025-10-21T19:05:08.131709] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T19:05:08.148452] [INFO ] [REMOTE ] GSL: Full fetch complete (48274 records). [2025-10-21T19:05:08.151958] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-21T19:05:08.159428] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-21T19:05:08.568816] [DEBUG] [LOCAL ] GSBD: Primary data saved (39579 records). [2025-10-21T19:05:08.579751] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-21T19:05:08.580141] [INFO ] [MAIN ] Update Progress: 973/2366 symbols completed. GSBD took 38.5s. Estimated remaining: 2h 59m 4s. Rate: 7.8 symbols/min [2025-10-21T19:05:08.800859] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-21T19:05:08.806098] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-21T19:05:08.812119] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-21T19:05:08.825702] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-21T19:05:08.857633] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:08.858378] [DEBUG] [LOCAL ] GSL: Trimmed 48274 records to 33081 (keeping 200 days of data) [2025-10-21T19:05:09.079213] [DEBUG] [LOCAL ] GTLS: Loaded 43326 existing records from primary storage. [2025-10-21T19:05:09.083462] [DEBUG] [LOCAL ] GSL: Primary data saved (33081 records). [2025-10-21T19:05:09.083726] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-21T19:05:09.084440] [INFO ] [MAIN ] Update Progress: 974/2366 symbols completed. GSL took 26.9s. Estimated remaining: 2h 58m 46s. Rate: 7.8 symbols/min [2025-10-21T19:05:09.084632] [INFO ] [MAIN ] GTLS: Loaded 43326 existing records. [2025-10-21T19:05:09.454249] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:09.484196] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:09.484903] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-21T19:05:09.485543] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-21T19:05:09.485924] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-21T19:05:09.486051] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-21T19:05:09.591399] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-21T19:05:09.638987] [INFO ] [REMOTE ] GSK: Full fetch complete (77636 records). [2025-10-21T19:05:09.644302] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-21T19:05:09.962553] [DEBUG] [LOCAL ] GTN: Loaded 44989 existing records from primary storage. [2025-10-21T19:05:09.966097] [INFO ] [MAIN ] GTN: Loaded 44989 existing records. [2025-10-21T19:05:10.313106] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:10.342895] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-21T19:05:10.442936] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-21T19:05:10.471951] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:10.490382] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-21T19:05:10.560322] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-21T19:05:10.545842] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-21T19:05:10.584002] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-21T19:05:10.584091] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-21T19:05:10.584062] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-21T19:05:10.585043] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-21T19:05:10.585227] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-21T19:05:10.585281] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-21T19:05:10.693098] [DEBUG] [LOCAL ] GSK: Trimmed 77636 records to 53512 (keeping 200 days of data) [2025-10-21T19:05:11.076984] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:11.128936] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-21T19:05:11.278780] [DEBUG] [LOCAL ] GSK: Primary data saved (53512 records). [2025-10-21T19:05:11.278920] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-21T19:05:11.279781] [INFO ] [MAIN ] Update Progress: 975/2366 symbols completed. GSK took 31.5s. Estimated remaining: 2h 58m 30s. Rate: 7.8 symbols/min [2025-10-21T19:05:11.450489] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:11.481318] [DEBUG] [LOCAL ] GTY: Loaded 30157 existing records from primary storage. [2025-10-21T19:05:11.481593] [INFO ] [MAIN ] GTY: Loaded 30157 existing records. [2025-10-21T19:05:11.660571] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:11.660875] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-21T19:05:11.660925] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-21T19:05:11.661125] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-21T19:05:11.661166] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-21T19:05:12.054595] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:12.055011] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-21T19:05:12.082822] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T19:05:12.151031] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-21T19:05:12.473125] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T19:05:12.526587] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T19:05:12.950998] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-21T19:05:13.347328] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T19:05:13.556925] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T19:05:13.751025] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-21T19:05:14.551007] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-21T19:05:14.750152] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T19:05:15.253202] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T19:05:15.350983] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-21T19:05:15.797730] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T19:05:16.151010] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-21T19:05:16.950997] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-21T19:05:17.037421] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:05:17.358345] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T19:05:17.750999] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-21T19:05:18.375742] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:05:18.551061] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-21T19:05:19.351036] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-21T19:05:19.423183] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T19:05:20.151018] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-21T19:05:20.199689] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:05:20.951007] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-21T19:05:21.279331] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T19:05:21.498748] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T19:05:21.751026] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-21T19:05:22.551045] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-21T19:05:22.615111] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:05:22.783637] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T19:05:23.351028] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-21T19:05:24.151036] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-21T19:05:24.303581] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T19:05:24.776349] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T19:05:24.951027] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-21T19:05:25.448700] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T19:05:25.751040] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-21T19:05:26.245484] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:05:26.551026] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-21T19:05:26.969254] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T19:05:27.351052] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-21T19:05:28.151002] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-21T19:05:28.227199] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:05:28.597030] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T19:05:28.951075] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-21T19:05:29.689277] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:05:29.750996] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-21T19:05:30.101186] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T19:05:30.551029] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-21T19:05:31.351049] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-21T19:05:31.501044] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:05:32.151007] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-21T19:05:32.327213] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:05:32.378383] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T19:05:32.951063] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-21T19:05:33.751086] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-21T19:05:33.802874] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:05:33.813622] [INFO ] [REMOTE ] GTES: Full fetch complete (73903 records). [2025-10-21T19:05:33.813789] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-21T19:05:34.194331] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-21T19:05:34.194409] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-21T19:05:34.195377] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-21T19:05:34.195442] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-21T19:05:34.196781] [DEBUG] [LOCAL ] GTES: Trimmed 73903 records to 50305 (keeping 200 days of data) [2025-10-21T19:05:34.483319] [DEBUG] [LOCAL ] GTES: Primary data saved (50305 records). [2025-10-21T19:05:34.483443] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-21T19:05:34.483518] [INFO ] [MAIN ] Update Progress: 976/2366 symbols completed. GTES took 34.4s. Estimated remaining: 2h 58m 45s. Rate: 7.8 symbols/min [2025-10-21T19:05:34.551793] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-21T19:05:34.665084] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:34.698667] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:05:34.714770] [DEBUG] [LOCAL ] GUG: Loaded 12194 existing records from primary storage. [2025-10-21T19:05:34.715008] [INFO ] [MAIN ] GUG: Loaded 12194 existing records. [2025-10-21T19:05:34.905700] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:34.905939] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-21T19:05:34.905987] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-21T19:05:34.906201] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-21T19:05:34.906258] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-21T19:05:35.291236] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:35.318905] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:05:35.350984] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-21T19:05:35.795157] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T19:05:36.151028] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-21T19:05:36.951013] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-21T19:05:37.136250] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:05:37.143118] [INFO ] [REMOTE ] GTN: Full fetch complete (65878 records). [2025-10-21T19:05:37.143227] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-21T19:05:37.305163] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T19:05:37.552428] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-21T19:05:37.552502] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-21T19:05:37.553345] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-21T19:05:37.553405] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-21T19:05:37.554606] [DEBUG] [LOCAL ] GTN: Trimmed 65878 records to 44864 (keeping 200 days of data) [2025-10-21T19:05:37.755847] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-21T19:05:37.827355] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T19:05:37.835231] [DEBUG] [LOCAL ] GTN: Primary data saved (44864 records). [2025-10-21T19:05:37.835333] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-21T19:05:37.842263] [INFO ] [MAIN ] Update Progress: 977/2366 symbols completed. GTN took 28.7s. Estimated remaining: 2h 58m 31s. Rate: 7.8 symbols/min [2025-10-21T19:05:38.008845] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:38.026167] [DEBUG] [LOCAL ] GUT: Loaded 15737 existing records from primary storage. [2025-10-21T19:05:38.026411] [INFO ] [MAIN ] GUT: Loaded 15737 existing records. [2025-10-21T19:05:38.199964] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:38.200175] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-21T19:05:38.200237] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-21T19:05:38.200384] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-21T19:05:38.200421] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-21T19:05:38.548880] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:38.550977] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-21T19:05:39.347515] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T19:05:39.356296] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-21T19:05:39.625329] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T19:05:40.151023] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-21T19:05:40.735391] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:05:40.740548] [INFO ] [REMOTE ] GTY: Full fetch complete (43853 records). [2025-10-21T19:05:40.740634] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-21T19:05:40.850391] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T19:05:40.961290] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-21T19:05:41.131702] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-21T19:05:41.131787] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-21T19:05:41.132486] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-21T19:05:41.132526] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-21T19:05:41.133408] [DEBUG] [LOCAL ] GTY: Trimmed 43853 records to 30068 (keeping 200 days of data) [2025-10-21T19:05:41.311732] [DEBUG] [LOCAL ] GTY: Primary data saved (30068 records). [2025-10-21T19:05:41.311856] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-21T19:05:41.311930] [INFO ] [MAIN ] Update Progress: 978/2366 symbols completed. GTY took 30.0s. Estimated remaining: 2h 58m 17s. Rate: 7.8 symbols/min [2025-10-21T19:05:41.478985] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:41.479141] [DEBUG] [LOCAL ] GVA: No existing data file found in primary storage. [2025-10-21T19:05:41.479176] [WARN ] [MAIN ] GVA: No existing data found, performing full refresh instead. [2025-10-21T19:05:41.479278] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-21T19:05:41.479318] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-21T19:05:41.479361] [DEBUG] [LOCAL ] GVA: No primary data file found to delete. [2025-10-21T19:05:41.479392] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-21T19:05:41.756090] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-21T19:05:41.826874] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:42.551078] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-21T19:05:42.576474] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T19:05:42.756017] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:05:42.762544] [INFO ] [REMOTE ] GTLS: Full fetch complete (61525 records). [2025-10-21T19:05:42.762690] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-21T19:05:43.154051] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-21T19:05:43.154135] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-21T19:05:43.154886] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-21T19:05:43.154947] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-21T19:05:43.156054] [DEBUG] [LOCAL ] GTLS: Trimmed 61525 records to 43183 (keeping 200 days of data) [2025-10-21T19:05:43.354078] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-21T19:05:43.406522] [DEBUG] [LOCAL ] GTLS: Primary data saved (43183 records). [2025-10-21T19:05:43.406680] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-21T19:05:43.407037] [INFO ] [MAIN ] Update Progress: 979/2366 symbols completed. GTLS took 34.8s. Estimated remaining: 2h 58m 1s. Rate: 7.8 symbols/min [2025-10-21T19:05:43.572944] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:05:43.591945] [DEBUG] [LOCAL ] GWH: Loaded 19537 existing records from primary storage. [2025-10-21T19:05:43.592183] [INFO ] [MAIN ] GWH: Loaded 19537 existing records. [2025-10-21T19:05:43.767613] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:05:43.767924] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-21T19:05:43.767999] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-21T19:05:43.768310] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-21T19:05:43.768368] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-21T19:05:44.081006] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:05:44.147766] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:05:44.150978] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-21T19:05:44.245486] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T19:05:44.849247] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T19:05:44.951025] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-21T19:05:45.751027] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-21T19:05:46.455875] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T19:05:46.550999] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-21T19:05:46.657696] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T19:05:47.351005] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-21T19:05:48.054587] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T19:05:48.150992] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-21T19:05:48.326616] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T19:05:48.951057] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-21T19:05:49.754394] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-21T19:05:49.757223] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:05:49.935403] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T19:05:50.551039] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-21T19:05:50.606035] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T19:05:51.351006] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-21T19:05:51.470243] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T19:05:52.081831] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T19:05:52.151058] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-21T19:05:52.951095] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-21T19:05:53.613139] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:05:53.711977] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T19:05:53.751072] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-21T19:05:54.551087] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-21T19:05:54.663568] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T19:05:55.351029] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-21T19:05:55.532676] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T19:05:56.151025] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-21T19:05:56.214076] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T19:05:56.957760] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-21T19:05:56.960127] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T19:05:57.696879] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T19:05:57.751034] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-21T19:05:58.551078] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-21T19:05:59.071851] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T19:05:59.351018] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-21T19:05:59.424664] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T19:06:00.151025] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-21T19:06:00.951010] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-21T19:06:01.161197] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T19:06:01.191212] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:06:01.751035] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-21T19:06:02.098490] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:06:02.551073] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-21T19:06:02.877959] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:06:03.351041] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-21T19:06:03.937429] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T19:06:04.151036] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-21T19:06:04.471527] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T19:06:04.951026] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-21T19:06:05.519148] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:06:05.751004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-21T19:06:05.820828] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:06:05.823055] [INFO ] [REMOTE ] GUG: Full fetch complete (18879 records). [2025-10-21T19:06:05.823123] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-21T19:06:06.198363] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-21T19:06:06.198437] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-21T19:06:06.198858] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-21T19:06:06.198919] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-21T19:06:06.199427] [DEBUG] [LOCAL ] GUG: Trimmed 18879 records to 12192 (keeping 200 days of data) [2025-10-21T19:06:06.272077] [DEBUG] [LOCAL ] GUG: Primary data saved (12192 records). [2025-10-21T19:06:06.272202] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-21T19:06:06.272275] [INFO ] [MAIN ] Update Progress: 980/2366 symbols completed. GUG took 31.8s. Estimated remaining: 2h 58m 15s. Rate: 7.8 symbols/min [2025-10-21T19:06:06.445752] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:06.483946] [DEBUG] [LOCAL ] GWRE: Loaded 39801 existing records from primary storage. [2025-10-21T19:06:06.484218] [INFO ] [MAIN ] GWRE: Loaded 39801 existing records. [2025-10-21T19:06:06.552672] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-21T19:06:06.662874] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:06.663158] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-21T19:06:06.663216] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-21T19:06:06.663776] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-21T19:06:06.663831] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-21T19:06:06.798918] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T19:06:07.025704] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:07.351020] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-21T19:06:07.932399] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:06:08.151072] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-21T19:06:08.396075] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T19:06:08.401325] [INFO ] [REMOTE ] GVA: Full fetch complete (48379 records). [2025-10-21T19:06:08.401437] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-21T19:06:08.782740] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-21T19:06:08.782820] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-21T19:06:08.783543] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-21T19:06:08.783604] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-21T19:06:08.784669] [DEBUG] [LOCAL ] GVA: Trimmed 48379 records to 32612 (keeping 200 days of data) [2025-10-21T19:06:08.959408] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-21T19:06:08.984359] [DEBUG] [LOCAL ] GVA: Primary data saved (32612 records). [2025-10-21T19:06:08.984455] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-21T19:06:08.984521] [INFO ] [MAIN ] Update Progress: 981/2366 symbols completed. GVA took 27.7s. Estimated remaining: 2h 58m 0s. Rate: 7.8 symbols/min [2025-10-21T19:06:09.168908] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:09.192352] [DEBUG] [LOCAL ] GWW: Loaded 19418 existing records from primary storage. [2025-10-21T19:06:09.192577] [INFO ] [MAIN ] GWW: Loaded 19418 existing records. [2025-10-21T19:06:09.373121] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:09.373382] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-21T19:06:09.373464] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-21T19:06:09.373759] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-21T19:06:09.373831] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-21T19:06:09.756927] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-21T19:06:09.760040] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:09.765569] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:06:09.979431] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T19:06:09.982371] [INFO ] [REMOTE ] GUT: Full fetch complete (22506 records). [2025-10-21T19:06:09.982441] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-21T19:06:10.354986] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-21T19:06:10.355068] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-21T19:06:10.355581] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-21T19:06:10.355622] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-21T19:06:10.356338] [DEBUG] [LOCAL ] GUT: Trimmed 22506 records to 15651 (keeping 200 days of data) [2025-10-21T19:06:10.446715] [DEBUG] [LOCAL ] GUT: Primary data saved (15651 records). [2025-10-21T19:06:10.446851] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-21T19:06:10.446928] [INFO ] [MAIN ] Update Progress: 982/2366 symbols completed. GUT took 32.6s. Estimated remaining: 2h 57m 44s. Rate: 7.8 symbols/min [2025-10-21T19:06:10.551506] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-21T19:06:10.628872] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:10.670528] [DEBUG] [LOCAL ] GXO: Loaded 46617 existing records from primary storage. [2025-10-21T19:06:10.670879] [INFO ] [MAIN ] GXO: Loaded 46617 existing records. [2025-10-21T19:06:10.806039] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T19:06:10.868839] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:10.869043] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-21T19:06:10.869090] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-21T19:06:10.869335] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-21T19:06:10.869372] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-21T19:06:11.218103] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:11.351078] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-21T19:06:11.765872] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T19:06:12.151005] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-21T19:06:12.460400] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T19:06:12.951089] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-21T19:06:13.751031] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-21T19:06:13.796458] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:06:14.062354] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:06:14.551039] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-21T19:06:15.351063] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-21T19:06:15.710807] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T19:06:15.717622] [INFO ] [REMOTE ] GWH: Full fetch complete (24359 records). [2025-10-21T19:06:15.717790] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-21T19:06:16.092819] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-21T19:06:16.092917] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-21T19:06:16.093633] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-21T19:06:16.093732] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-21T19:06:16.094579] [DEBUG] [LOCAL ] GWH: Trimmed 24359 records to 19825 (keeping 200 days of data) [2025-10-21T19:06:16.160980] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-21T19:06:16.172430] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T19:06:16.239633] [DEBUG] [LOCAL ] GWH: Primary data saved (19825 records). [2025-10-21T19:06:16.239797] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-21T19:06:16.239879] [INFO ] [MAIN ] Update Progress: 983/2366 symbols completed. GWH took 32.8s. Estimated remaining: 2h 57m 33s. Rate: 7.8 symbols/min [2025-10-21T19:06:16.418635] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:16.436680] [DEBUG] [LOCAL ] GYLD: Loaded 1544 existing records from primary storage. [2025-10-21T19:06:16.437291] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T19:06:16.437607] [INFO ] [MAIN ] GYLD: Loaded 1544 existing records. [2025-10-21T19:06:16.625936] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:16.626166] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-21T19:06:16.626214] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-21T19:06:16.626371] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-21T19:06:16.626426] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-21T19:06:16.957520] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-21T19:06:16.979111] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:17.751031] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-21T19:06:17.905106] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:06:18.551069] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-21T19:06:18.710713] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T19:06:18.735004] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T19:06:18.840306] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-21T19:06:19.351092] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-21T19:06:20.151053] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-21T19:06:20.360936] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T19:06:20.951099] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-21T19:06:21.751005] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-21T19:06:21.839203] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:06:22.269867] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T19:06:22.551033] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-21T19:06:22.812585] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T19:06:23.351073] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-21T19:06:23.983003] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T19:06:24.151019] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-21T19:06:24.521449] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T19:06:24.951022] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-21T19:06:25.417146] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T19:06:25.751021] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-21T19:06:25.926470] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:06:26.205818] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T19:06:26.551049] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-21T19:06:27.351012] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-21T19:06:28.048717] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:06:28.150985] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-21T19:06:28.950998] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-21T19:06:29.048126] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:06:29.254742] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-21T19:06:29.278681] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:06:29.751047] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-21T19:06:30.109901] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-21T19:06:30.551038] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-21T19:06:30.974458] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-21T19:06:31.351029] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-21T19:06:32.151000] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-21T19:06:32.391150] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:06:32.951046] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-21T19:06:33.565455] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:06:33.751064] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-21T19:06:34.022676] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:06:34.551057] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-21T19:06:35.310414] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:06:35.351013] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-21T19:06:35.677492] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T19:06:36.151013] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-21T19:06:36.962082] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-21T19:06:36.966062] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:06:37.283073] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T19:06:37.286344] [INFO ] [REMOTE ] GWW: Full fetch complete (29059 records). [2025-10-21T19:06:37.286444] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-21T19:06:37.455540] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T19:06:37.691525] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-21T19:06:37.691664] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-21T19:06:37.692300] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-21T19:06:37.692401] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-21T19:06:37.693376] [DEBUG] [LOCAL ] GWW: Trimmed 29059 records to 19293 (keeping 200 days of data) [2025-10-21T19:06:37.755285] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-21T19:06:37.817975] [DEBUG] [LOCAL ] GWW: Primary data saved (19293 records). [2025-10-21T19:06:37.818117] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-21T19:06:37.818211] [INFO ] [MAIN ] Update Progress: 984/2366 symbols completed. GWW took 28.8s. Estimated remaining: 2h 57m 45s. Rate: 7.8 symbols/min [2025-10-21T19:06:37.983384] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:38.027050] [DEBUG] [LOCAL ] H: Loaded 44459 existing records from primary storage. [2025-10-21T19:06:38.027376] [INFO ] [MAIN ] H: Loaded 44459 existing records. [2025-10-21T19:06:38.217190] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:38.223865] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-21T19:06:38.223773] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T19:06:38.224111] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-21T19:06:38.225556] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-21T19:06:38.225635] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-21T19:06:38.556193] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-21T19:06:38.621198] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:39.350996] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-21T19:06:40.151047] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-21T19:06:40.268858] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:06:40.510105] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:06:40.515930] [INFO ] [REMOTE ] GWRE: Full fetch complete (60146 records). [2025-10-21T19:06:40.516042] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-21T19:06:40.629507] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T19:06:40.920850] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-21T19:06:40.920935] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-21T19:06:40.921802] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-21T19:06:40.921866] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-21T19:06:40.923059] [DEBUG] [LOCAL ] GWRE: Trimmed 60146 records to 39681 (keeping 200 days of data) [2025-10-21T19:06:40.972858] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-21T19:06:41.158819] [DEBUG] [LOCAL ] GWRE: Primary data saved (39681 records). [2025-10-21T19:06:41.159043] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-21T19:06:41.159128] [INFO ] [MAIN ] Update Progress: 985/2366 symbols completed. GWRE took 34.9s. Estimated remaining: 2h 57m 31s. Rate: 7.8 symbols/min [2025-10-21T19:06:41.323525] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:41.360259] [DEBUG] [LOCAL ] HAE: Loaded 39456 existing records from primary storage. [2025-10-21T19:06:41.360540] [INFO ] [MAIN ] HAE: Loaded 39456 existing records. [2025-10-21T19:06:41.532569] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:41.532820] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-21T19:06:41.532876] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-21T19:06:41.533108] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-21T19:06:41.533163] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-21T19:06:41.762546] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-21T19:06:41.888721] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:42.551088] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-21T19:06:42.663794] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:06:42.976501] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-21T19:06:42.977326] [INFO ] [REMOTE ] GYLD: Full fetch complete (2087 records). [2025-10-21T19:06:42.977393] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-21T19:06:43.359429] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-21T19:06:43.371957] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-21T19:06:43.372150] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-21T19:06:43.372406] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-21T19:06:43.372484] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-21T19:06:43.374415] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:06:43.381235] [DEBUG] [LOCAL ] GYLD: Trimmed 2087 records to 1549 (keeping 200 days of data) [2025-10-21T19:06:43.392021] [DEBUG] [LOCAL ] GYLD: Primary data saved (1549 records). [2025-10-21T19:06:43.392600] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-21T19:06:43.392751] [INFO ] [MAIN ] Update Progress: 986/2366 symbols completed. GYLD took 27.2s. Estimated remaining: 2h 57m 16s. Rate: 7.8 symbols/min [2025-10-21T19:06:43.557096] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:43.595083] [DEBUG] [LOCAL ] HAFN: Loaded 42843 existing records from primary storage. [2025-10-21T19:06:43.595369] [INFO ] [MAIN ] HAFN: Loaded 42843 existing records. [2025-10-21T19:06:43.768636] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:43.768901] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-21T19:06:43.768948] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-21T19:06:43.769130] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-21T19:06:43.769169] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-21T19:06:44.115347] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:44.150982] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-21T19:06:44.951112] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-21T19:06:45.270343] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T19:06:45.278069] [INFO ] [REMOTE ] GXO: Full fetch complete (69433 records). [2025-10-21T19:06:45.278267] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-21T19:06:45.700323] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-21T19:06:45.700444] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-21T19:06:45.701996] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-21T19:06:45.702064] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-21T19:06:45.704098] [DEBUG] [LOCAL ] GXO: Trimmed 69433 records to 46525 (keeping 200 days of data) [2025-10-21T19:06:45.756138] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-21T19:06:46.041370] [DEBUG] [LOCAL ] GXO: Primary data saved (46525 records). [2025-10-21T19:06:46.045204] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-21T19:06:46.045055] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T19:06:46.057303] [INFO ] [MAIN ] Update Progress: 987/2366 symbols completed. GXO took 35.6s. Estimated remaining: 2h 57m 1s. Rate: 7.8 symbols/min [2025-10-21T19:06:46.248635] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:06:46.274315] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T19:06:46.348412] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-21T19:06:46.348940] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-21T19:06:46.556140] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-21T19:06:46.592372] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:06:46.592757] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-21T19:06:46.593557] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-21T19:06:46.593837] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-21T19:06:46.593903] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-21T19:06:47.029818] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:06:47.157185] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T19:06:47.351080] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-21T19:06:48.151028] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-21T19:06:48.326450] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T19:06:48.950997] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-21T19:06:49.332290] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T19:06:49.612409] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:06:49.751044] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-21T19:06:50.551073] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-21T19:06:50.669357] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T19:06:51.351057] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-21T19:06:51.548791] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:06:52.151009] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-21T19:06:52.289037] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:06:52.951035] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-21T19:06:53.149576] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:06:53.751053] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-21T19:06:53.831729] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:06:54.267194] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T19:06:54.551072] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-21T19:06:55.254843] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T19:06:55.351063] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-21T19:06:56.144184] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:06:56.153181] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-21T19:06:56.951105] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-21T19:06:56.993245] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T19:06:57.555862] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T19:06:57.751078] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-21T19:06:58.551030] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-21T19:06:58.919122] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T19:06:58.951469] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T19:06:59.351037] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-21T19:07:00.093744] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:07:00.150989] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-21T19:07:00.869320] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:07:00.950984] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-21T19:07:01.751055] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-21T19:07:01.814049] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T19:07:02.026598] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T19:07:02.551030] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-21T19:07:03.248289] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:07:03.350987] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-21T19:07:04.151015] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-21T19:07:04.760393] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-21T19:07:04.824847] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T19:07:04.950985] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-21T19:07:05.677298] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T19:07:05.750992] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-21T19:07:06.551010] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-21T19:07:06.640204] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:07:07.305838] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T19:07:07.351028] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-21T19:07:08.151023] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-21T19:07:08.656456] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-21T19:07:08.699279] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:07:08.709111] [INFO ] [REMOTE ] HAE: Full fetch complete (59172 records). [2025-10-21T19:07:08.709379] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-21T19:07:08.960946] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-21T19:07:09.130040] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-21T19:07:09.130128] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-21T19:07:09.131007] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-21T19:07:09.131073] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-21T19:07:09.132256] [DEBUG] [LOCAL ] HAE: Trimmed 59172 records to 39378 (keeping 200 days of data) [2025-10-21T19:07:09.365200] [DEBUG] [LOCAL ] HAE: Primary data saved (39378 records). [2025-10-21T19:07:09.365350] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-21T19:07:09.365435] [INFO ] [MAIN ] Update Progress: 988/2366 symbols completed. HAE took 28.2s. Estimated remaining: 2h 57m 15s. Rate: 7.8 symbols/min [2025-10-21T19:07:09.539090] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:09.579623] [DEBUG] [LOCAL ] HASI: Loaded 47810 existing records from primary storage. [2025-10-21T19:07:09.579939] [INFO ] [MAIN ] HASI: Loaded 47810 existing records. [2025-10-21T19:07:09.756876] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-21T19:07:09.760548] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:09.761768] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-21T19:07:09.761951] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-21T19:07:09.762424] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-21T19:07:09.762573] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-21T19:07:09.952376] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T19:07:10.160855] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:10.551034] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-21T19:07:10.738047] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T19:07:10.744361] [INFO ] [REMOTE ] HAFN: Full fetch complete (64695 records). [2025-10-21T19:07:10.744479] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-21T19:07:11.134469] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-21T19:07:11.134550] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-21T19:07:11.135380] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-21T19:07:11.135442] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-21T19:07:11.136637] [DEBUG] [LOCAL ] HAFN: Trimmed 64695 records to 42724 (keeping 200 days of data) [2025-10-21T19:07:11.358820] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-21T19:07:11.396020] [DEBUG] [LOCAL ] HAFN: Primary data saved (42724 records). [2025-10-21T19:07:11.396168] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-21T19:07:11.396255] [INFO ] [MAIN ] Update Progress: 989/2366 symbols completed. HAFN took 28.0s. Estimated remaining: 2h 56m 60s. Rate: 7.8 symbols/min [2025-10-21T19:07:11.617768] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:11.663696] [DEBUG] [LOCAL ] HAYW: Loaded 48833 existing records from primary storage. [2025-10-21T19:07:11.664000] [INFO ] [MAIN ] HAYW: Loaded 48833 existing records. [2025-10-21T19:07:11.903501] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T19:07:11.908243] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:11.908830] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-21T19:07:11.919337] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-21T19:07:11.920931] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-21T19:07:11.921064] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-21T19:07:12.156800] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-21T19:07:12.310081] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:12.311961] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:07:12.950995] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-21T19:07:13.056323] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T19:07:13.751023] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-21T19:07:14.313030] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T19:07:14.434436] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:07:14.551009] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-21T19:07:15.340299] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:07:15.350988] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-21T19:07:16.151003] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-21T19:07:16.195806] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:07:16.890238] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T19:07:16.950978] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-21T19:07:17.751010] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-21T19:07:18.183673] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T19:07:18.551063] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-21T19:07:18.600718] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T19:07:19.351028] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-21T19:07:19.507077] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:07:20.151053] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-21T19:07:20.613489] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T19:07:20.951004] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-21T19:07:21.062600] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:07:21.069694] [INFO ] [REMOTE ] H: Full fetch complete (63277 records). [2025-10-21T19:07:21.069851] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-21T19:07:21.460903] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-21T19:07:21.461005] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-21T19:07:21.461861] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-21T19:07:21.462003] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-21T19:07:21.464347] [DEBUG] [LOCAL ] H: Trimmed 63277 records to 44375 (keeping 200 days of data) [2025-10-21T19:07:21.583933] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T19:07:21.751687] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-21T19:07:21.793460] [DEBUG] [LOCAL ] H: Primary data saved (44375 records). [2025-10-21T19:07:21.793572] [INFO ] [MAIN ] H: Full history saved. [2025-10-21T19:07:21.793666] [INFO ] [MAIN ] Update Progress: 990/2366 symbols completed. H took 44.0s. Estimated remaining: 2h 56m 56s. Rate: 7.8 symbols/min [2025-10-21T19:07:21.961172] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:21.970091] [DEBUG] [LOCAL ] HBB: Loaded 6459 existing records from primary storage. [2025-10-21T19:07:21.970293] [INFO ] [MAIN ] HBB: Loaded 6459 existing records. [2025-10-21T19:07:22.149333] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:22.149599] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-21T19:07:22.149683] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-21T19:07:22.149841] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-21T19:07:22.149881] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-21T19:07:22.532836] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T19:07:22.531732] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:22.541634] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-21T19:07:22.541756] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-21T19:07:22.556203] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-21T19:07:22.929494] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-21T19:07:22.929568] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-21T19:07:22.930486] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-21T19:07:22.930551] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-21T19:07:22.931920] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-21T19:07:23.250584] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-21T19:07:23.250734] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-21T19:07:23.251302] [INFO ] [MAIN ] Update Progress: 991/2366 symbols completed. HAL took 37.2s. Estimated remaining: 2h 56m 39s. Rate: 7.8 symbols/min [2025-10-21T19:07:23.352241] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-21T19:07:23.428329] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:23.480039] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T19:07:23.513332] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T19:07:23.533875] [DEBUG] [LOCAL ] HBI: Loaded 52948 existing records from primary storage. [2025-10-21T19:07:23.534194] [INFO ] [MAIN ] HBI: Loaded 52948 existing records. [2025-10-21T19:07:23.710815] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:23.711051] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-21T19:07:23.711127] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-21T19:07:23.711351] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-21T19:07:23.711417] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-21T19:07:24.058228] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:24.150987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-21T19:07:24.924246] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T19:07:24.950984] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-21T19:07:25.751056] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-21T19:07:25.818758] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:07:26.195004] [DEBUG] [REMOTE ] HBB: Error fetching primary data for 2025-02: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-21T19:07:26.195198] [WARN ] [REMOTE ] HBB: No data returned for month 2025-02 [2025-10-21T19:07:26.195321] [FATAL] [REMOTE ] HBB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:07:26.195445] [FATAL] [MAIN ] HBB: Failed to fetch primary data. [2025-10-21T19:07:26.195566] [WARN ] [MAIN ] HBB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:07:26.195750] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-21T19:07:26.195866] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-21T19:07:26.195932] [INFO ] [LOCAL ] HBB: Starting deletion of derivative data. [2025-10-21T19:07:26.196154] [DEBUG] [LOCAL ] HBB: Deleted derivative data file. [2025-10-21T19:07:26.196222] [INFO ] [MAIN ] Update Progress: 992/2366 symbols completed. HBB took 4.4s. Estimated remaining: 2h 56m 25s. Rate: 7.8 symbols/min [2025-10-21T19:07:26.363740] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:26.413316] [DEBUG] [LOCAL ] HBM: Loaded 52976 existing records from primary storage. [2025-10-21T19:07:26.413611] [INFO ] [MAIN ] HBM: Loaded 52976 existing records. [2025-10-21T19:07:26.563299] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-21T19:07:26.594206] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:26.594515] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-21T19:07:26.594714] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-21T19:07:26.594989] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-21T19:07:26.595086] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-21T19:07:26.730957] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:07:27.002625] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:27.351024] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-21T19:07:28.151069] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-21T19:07:28.283940] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:07:28.951060] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-21T19:07:29.003928] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T19:07:29.597184] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T19:07:29.751023] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-21T19:07:30.216588] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T19:07:30.551025] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-21T19:07:30.852864] [DEBUG] [REMOTE ] HBM: Error fetching primary data for 2025-01: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-21T19:07:30.852996] [WARN ] [REMOTE ] HBM: No data returned for month 2025-01 [2025-10-21T19:07:30.853066] [FATAL] [REMOTE ] HBM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:07:30.853108] [FATAL] [MAIN ] HBM: Failed to fetch primary data. [2025-10-21T19:07:30.853139] [WARN ] [MAIN ] HBM: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:07:30.853199] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-21T19:07:30.853285] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-21T19:07:30.853335] [INFO ] [LOCAL ] HBM: Starting deletion of derivative data. [2025-10-21T19:07:30.853481] [DEBUG] [LOCAL ] HBM: Deleted derivative data file. [2025-10-21T19:07:30.853548] [INFO ] [MAIN ] Update Progress: 993/2366 symbols completed. HBM took 4.7s. Estimated remaining: 2h 56m 13s. Rate: 7.8 symbols/min [2025-10-21T19:07:31.021501] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:31.067132] [DEBUG] [LOCAL ] HCA: Loaded 46957 existing records from primary storage. [2025-10-21T19:07:31.067406] [INFO ] [MAIN ] HCA: Loaded 46957 existing records. [2025-10-21T19:07:31.260167] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:31.260377] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-21T19:07:31.260443] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-21T19:07:31.260715] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-21T19:07:31.260787] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-21T19:07:31.359528] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-21T19:07:31.622229] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:31.862129] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:07:32.151068] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-21T19:07:32.951054] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-21T19:07:33.050313] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:07:33.750987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-21T19:07:33.826715] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:07:34.531094] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:07:34.550978] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-21T19:07:35.327106] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:07:35.350992] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-21T19:07:35.971234] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T19:07:36.151106] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-21T19:07:36.951011] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-21T19:07:37.064196] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:07:37.071555] [INFO ] [REMOTE ] HASI: Full fetch complete (68319 records). [2025-10-21T19:07:37.071695] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-21T19:07:37.476518] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-21T19:07:37.476592] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-21T19:07:37.477448] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-21T19:07:37.477511] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-21T19:07:37.478795] [DEBUG] [LOCAL ] HASI: Trimmed 68319 records to 47751 (keeping 200 days of data) [2025-10-21T19:07:37.754678] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-21T19:07:37.762048] [DEBUG] [LOCAL ] HASI: Primary data saved (47751 records). [2025-10-21T19:07:37.763017] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-21T19:07:37.763108] [INFO ] [MAIN ] Update Progress: 994/2366 symbols completed. HASI took 28.4s. Estimated remaining: 2h 56m 4s. Rate: 7.8 symbols/min [2025-10-21T19:07:37.939828] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:37.985579] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T19:07:38.030235] [DEBUG] [LOCAL ] HCC: Loaded 45162 existing records from primary storage. [2025-10-21T19:07:38.030525] [INFO ] [MAIN ] HCC: Loaded 45162 existing records. [2025-10-21T19:07:38.213539] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:38.213748] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-21T19:07:38.213800] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-21T19:07:38.213983] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-21T19:07:38.214024] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-21T19:07:38.571834] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-21T19:07:38.577774] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:38.704397] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:07:39.351081] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-21T19:07:39.775137] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T19:07:40.151101] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-21T19:07:40.355718] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T19:07:40.951047] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-21T19:07:41.001267] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:07:41.009781] [INFO ] [REMOTE ] HAYW: Full fetch complete (70921 records). [2025-10-21T19:07:41.010002] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-21T19:07:41.426093] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-21T19:07:41.426203] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-21T19:07:41.427516] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-21T19:07:41.427584] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-21T19:07:41.429705] [DEBUG] [LOCAL ] HAYW: Trimmed 70921 records to 48821 (keeping 200 days of data) [2025-10-21T19:07:41.738900] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:07:41.752051] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-21T19:07:41.763464] [DEBUG] [LOCAL ] HAYW: Primary data saved (48821 records). [2025-10-21T19:07:41.763611] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-21T19:07:41.764290] [INFO ] [MAIN ] Update Progress: 995/2366 symbols completed. HAYW took 30.4s. Estimated remaining: 2h 55m 51s. Rate: 7.8 symbols/min [2025-10-21T19:07:41.933461] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:41.950335] [DEBUG] [LOCAL ] HCI: Loaded 14113 existing records from primary storage. [2025-10-21T19:07:41.950556] [INFO ] [MAIN ] HCI: Loaded 14113 existing records. [2025-10-21T19:07:42.124102] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:07:42.124282] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-21T19:07:42.124328] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-21T19:07:42.124486] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-21T19:07:42.124523] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-21T19:07:42.479589] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:42.515030] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:07:42.551031] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-21T19:07:43.311561] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:07:43.351057] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-21T19:07:43.937430] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T19:07:44.151025] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-21T19:07:44.951030] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-21T19:07:45.020593] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:07:45.709309] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:07:45.751008] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-21T19:07:46.551012] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-21T19:07:46.717972] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:07:46.735064] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T19:07:47.351046] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-21T19:07:48.151035] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-21T19:07:48.687874] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T19:07:48.934628] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T19:07:48.950981] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-21T19:07:49.456339] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T19:07:49.751044] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-21T19:07:50.551004] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-21T19:07:50.658099] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:07:50.823505] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:07:51.351053] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-21T19:07:52.151073] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-21T19:07:52.229392] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:07:52.960459] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-21T19:07:52.981636] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:07:53.096581] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T19:07:53.751030] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-21T19:07:54.535233] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:07:54.550981] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-21T19:07:55.351017] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-21T19:07:55.581808] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T19:07:55.590170] [INFO ] [REMOTE ] HBI: Full fetch complete (76990 records). [2025-10-21T19:07:55.590307] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-21T19:07:56.002883] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-21T19:07:56.002993] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-21T19:07:56.004041] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-21T19:07:56.004160] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-21T19:07:56.005697] [DEBUG] [LOCAL ] HBI: Trimmed 76990 records to 52933 (keeping 200 days of data) [2025-10-21T19:07:56.161628] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-21T19:07:56.233172] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T19:07:56.269483] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T19:07:56.268838] [INFO ] [REMOTE ] HCA: Full fetch complete (68930 records). [2025-10-21T19:07:56.298211] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-21T19:07:56.453200] [DEBUG] [LOCAL ] HBI: Primary data saved (52933 records). [2025-10-21T19:07:56.466199] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-21T19:07:56.466919] [INFO ] [MAIN ] Update Progress: 996/2366 symbols completed. HBI took 33.2s. Estimated remaining: 2h 55m 53s. Rate: 7.8 symbols/min [2025-10-21T19:07:56.856085] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:07:56.882272] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-21T19:07:56.908375] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-21T19:07:56.954859] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-21T19:07:56.941327] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-21T19:07:56.959848] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-21T19:07:56.959624] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-21T19:07:56.960016] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-21T19:07:56.960090] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-21T19:07:56.960173] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-21T19:07:57.010612] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-21T19:07:57.029862] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-21T19:07:57.078165] [DEBUG] [LOCAL ] HCA: Trimmed 68930 records to 46914 (keeping 200 days of data) [2025-10-21T19:07:57.479425] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:07:57.652680] [DEBUG] [LOCAL ] HCA: Primary data saved (46914 records). [2025-10-21T19:07:57.652835] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-21T19:07:57.652919] [INFO ] [MAIN ] Update Progress: 997/2366 symbols completed. HCA took 26.8s. Estimated remaining: 2h 55m 37s. Rate: 7.8 symbols/min [2025-10-21T19:07:57.751006] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-21T19:07:57.860622] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:07:57.975605] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T19:07:57.985111] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-21T19:07:58.551040] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-21T19:07:58.857482] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-21T19:07:59.351054] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-21T19:07:59.680315] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-21T19:08:00.151033] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-21T19:08:00.387194] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-21T19:08:00.951054] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-21T19:08:01.751030] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-21T19:08:02.551018] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-21T19:08:02.627185] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:08:02.754679] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T19:08:02.849303] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-21T19:08:03.351078] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-21T19:08:04.151054] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-21T19:08:04.930875] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:08:04.950979] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-21T19:08:05.066204] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-21T19:08:05.751007] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-21T19:08:06.077735] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-21T19:08:06.551003] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-21T19:08:06.807172] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T19:08:07.351063] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-21T19:08:07.541342] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T19:08:08.151029] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-21T19:08:08.932937] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:08:08.951004] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-21T19:08:09.132977] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:08:09.135709] [INFO ] [REMOTE ] HCI: Full fetch complete (19628 records). [2025-10-21T19:08:09.135794] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-21T19:08:09.507345] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-21T19:08:09.507675] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-21T19:08:09.508258] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-21T19:08:09.508318] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-21T19:08:09.508952] [DEBUG] [LOCAL ] HCI: Trimmed 19628 records to 14056 (keeping 200 days of data) [2025-10-21T19:08:09.596860] [DEBUG] [LOCAL ] HCI: Primary data saved (14056 records). [2025-10-21T19:08:09.596998] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-21T19:08:09.597076] [INFO ] [MAIN ] Update Progress: 998/2366 symbols completed. HCI took 27.8s. Estimated remaining: 2h 55m 35s. Rate: 7.8 symbols/min [2025-10-21T19:08:09.751053] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-21T19:08:10.106765] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-21T19:08:10.522306] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:08:10.550988] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-21T19:08:11.351065] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-21T19:08:11.683069] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-21T19:08:12.154406] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-21T19:08:12.157353] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T19:08:12.165513] [INFO ] [REMOTE ] HCC: Full fetch complete (64874 records). [2025-10-21T19:08:12.165715] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-21T19:08:12.467913] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-21T19:08:12.563033] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-21T19:08:12.563163] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-21T19:08:12.564028] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-21T19:08:12.564091] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-21T19:08:12.565324] [DEBUG] [LOCAL ] HCC: Trimmed 64874 records to 45053 (keeping 200 days of data) [2025-10-21T19:08:12.826141] [DEBUG] [LOCAL ] HCC: Primary data saved (45053 records). [2025-10-21T19:08:12.826266] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-21T19:08:12.826344] [INFO ] [MAIN ] Update Progress: 999/2366 symbols completed. HCC took 35.1s. Estimated remaining: 2h 55m 21s. Rate: 7.8 symbols/min [2025-10-21T19:08:12.950996] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-21T19:08:13.310034] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-21T19:08:13.310691] [INFO ] [REMOTE ] HCXY: Full fetch complete (513 records). [2025-10-21T19:08:13.310758] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-21T19:08:13.482484] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-21T19:08:13.482693] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:08:13.482764] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:08:13.482834] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-21T19:08:13.482895] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-21T19:08:13.482930] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-21T19:08:13.482984] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-21T19:08:13.483038] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols completed. HCXY took 17.0s. Estimated remaining: 2h 55m 4s. Rate: 7.8 symbols/min [2025-10-21T19:08:14.075675] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:14.101320] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:14.165172] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:14.185147] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:14.256337] [DEBUG] [LOCAL ] HEI: Loaded 30890 existing records from primary storage. [2025-10-21T19:08:14.270054] [INFO ] [MAIN ] HEI: Loaded 30890 existing records. [2025-10-21T19:08:14.342487] [DEBUG] [LOCAL ] HE: Loaded 48865 existing records from primary storage. [2025-10-21T19:08:14.373436] [INFO ] [MAIN ] HE: Loaded 48865 existing records. [2025-10-21T19:08:14.373244] [DEBUG] [LOCAL ] HD: Loaded 53482 existing records from primary storage. [2025-10-21T19:08:14.451232] [DEBUG] [LOCAL ] HDB: Loaded 51936 existing records from primary storage. [2025-10-21T19:08:14.446877] [INFO ] [MAIN ] HD: Loaded 53482 existing records. [2025-10-21T19:08:14.505158] [INFO ] [MAIN ] HDB: Loaded 51936 existing records. [2025-10-21T19:08:14.760831] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:14.900970] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-21T19:08:14.911394] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-21T19:08:14.928079] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:14.996947] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-21T19:08:14.985070] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-21T19:08:15.009416] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-21T19:08:15.023463] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:15.041665] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-21T19:08:15.084917] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-21T19:08:15.098183] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-21T19:08:15.092987] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-21T19:08:15.115540] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-21T19:08:15.087780] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:15.136747] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-21T19:08:15.147115] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-21T19:08:15.152401] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-21T19:08:15.171084] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-21T19:08:15.244560] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-21T19:08:15.280382] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-21T19:08:16.244299] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:16.313347] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-21T19:08:16.440614] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:16.466459] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-21T19:08:16.535372] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:16.563180] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-21T19:08:16.562725] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:16.564361] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-21T19:08:17.857518] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T19:08:17.865544] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-21T19:08:18.226209] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T19:08:18.237159] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-21T19:08:18.282881] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:08:18.365030] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T19:08:18.551076] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-21T19:08:19.301957] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T19:08:19.350995] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-21T19:08:20.151026] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-21T19:08:20.243861] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:08:20.350369] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T19:08:20.898777] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T19:08:20.951030] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-21T19:08:21.751011] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-21T19:08:21.909520] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T19:08:22.551072] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-21T19:08:23.098073] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-21T19:08:23.336745] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:08:23.350975] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-21T19:08:24.151009] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-21T19:08:24.275211] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T19:08:24.948932] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T19:08:24.951792] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-21T19:08:25.751007] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-21T19:08:25.903764] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T19:08:26.551026] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-21T19:08:26.876929] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T19:08:26.940494] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T19:08:27.351138] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-21T19:08:28.151044] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-21T19:08:28.294132] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:08:28.660232] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T19:08:28.951030] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-21T19:08:29.751039] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-21T19:08:30.397739] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T19:08:30.413365] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:08:30.551055] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-21T19:08:31.203287] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T19:08:31.351031] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-21T19:08:32.151019] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-21T19:08:32.227195] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:08:32.951028] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-21T19:08:33.535118] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T19:08:33.751000] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-21T19:08:33.828045] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T19:08:34.551034] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-21T19:08:35.066255] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-21T19:08:35.351023] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-21T19:08:36.151046] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-21T19:08:36.184667] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-21T19:08:36.601281] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T19:08:36.951002] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-21T19:08:37.028192] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:08:37.469767] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T19:08:37.751031] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-21T19:08:38.551096] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-21T19:08:39.023627] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T19:08:39.028102] [INFO ] [REMOTE ] HEI: Full fetch complete (47436 records). [2025-10-21T19:08:39.028229] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-21T19:08:39.353577] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-21T19:08:39.454857] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-21T19:08:39.455034] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-21T19:08:39.455936] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-21T19:08:39.456141] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-21T19:08:39.457475] [DEBUG] [LOCAL ] HEI: Trimmed 47436 records to 30723 (keeping 200 days of data) [2025-10-21T19:08:39.591285] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-10-21T19:08:39.704344] [DEBUG] [LOCAL ] HEI: Primary data saved (30723 records). [2025-10-21T19:08:39.704467] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-21T19:08:39.705362] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols completed. HEI took 26.2s. Estimated remaining: 2h 55m 21s. Rate: 7.8 symbols/min [2025-10-21T19:08:39.873369] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:39.883702] [DEBUG] [LOCAL ] HEQ: Loaded 6822 existing records from primary storage. [2025-10-21T19:08:39.883918] [INFO ] [MAIN ] HEQ: Loaded 6822 existing records. [2025-10-21T19:08:40.062562] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:40.062761] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-21T19:08:40.062829] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-21T19:08:40.062963] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-21T19:08:40.063000] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-21T19:08:40.163549] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-21T19:08:40.438014] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:40.468421] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T19:08:40.951035] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-21T19:08:41.179288] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T19:08:41.555197] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-21T19:08:41.751021] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-21T19:08:41.948291] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:08:42.551067] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-21T19:08:43.351009] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-21T19:08:43.503556] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:08:44.007908] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:08:44.151013] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-21T19:08:44.313959] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T19:08:44.517895] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-21T19:08:44.951037] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-21T19:08:45.670133] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T19:08:45.751045] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-21T19:08:46.551046] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-21T19:08:47.351022] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-21T19:08:47.677023] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T19:08:47.685499] [INFO ] [REMOTE ] HDB: Full fetch complete (75648 records). [2025-10-21T19:08:47.685710] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-21T19:08:48.005032] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T19:08:48.091546] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-21T19:08:48.091630] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-21T19:08:48.092574] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-21T19:08:48.092626] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-21T19:08:48.094047] [DEBUG] [LOCAL ] HDB: Trimmed 75648 records to 51909 (keeping 200 days of data) [2025-10-21T19:08:48.155821] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-21T19:08:48.425462] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T19:08:48.436171] [DEBUG] [LOCAL ] HDB: Primary data saved (51909 records). [2025-10-21T19:08:48.436573] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-21T19:08:48.436701] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols completed. HDB took 35.0s. Estimated remaining: 2h 55m 15s. Rate: 7.8 symbols/min [2025-10-21T19:08:48.480130] [INFO ] [REMOTE ] HE: Full fetch complete (72115 records). [2025-10-21T19:08:48.512370] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-21T19:08:48.708664] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:48.797357] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-21T19:08:48.952080] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-21T19:08:49.046979] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-21T19:08:49.047090] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-21T19:08:49.048190] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-21T19:08:49.048276] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-21T19:08:49.049849] [DEBUG] [LOCAL ] HESM: Loaded 48651 existing records from primary storage. [2025-10-21T19:08:49.050363] [INFO ] [MAIN ] HESM: Loaded 48651 existing records. [2025-10-21T19:08:49.135114] [DEBUG] [LOCAL ] HE: Trimmed 72115 records to 48826 (keeping 200 days of data) [2025-10-21T19:08:49.382748] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:49.390046] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-21T19:08:49.393030] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-21T19:08:49.415055] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-21T19:08:49.418816] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-21T19:08:49.762585] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-21T19:08:49.785459] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T19:08:50.091974] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:50.181419] [DEBUG] [LOCAL ] HE: Primary data saved (48826 records). [2025-10-21T19:08:50.181596] [INFO ] [MAIN ] HE: Full history saved. [2025-10-21T19:08:50.181750] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols completed. HE took 36.7s. Estimated remaining: 2h 54m 59s. Rate: 7.8 symbols/min [2025-10-21T19:08:50.424381] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:50.424569] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-21T19:08:50.424605] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-21T19:08:50.424932] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-21T19:08:50.424974] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-21T19:08:50.425014] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-21T19:08:50.425044] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-21T19:08:50.556119] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-21T19:08:50.796044] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:51.323259] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:08:51.351047] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-21T19:08:51.670173] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-21T19:08:51.970003] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-21T19:08:52.150995] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-21T19:08:52.911517] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T19:08:52.951008] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-21T19:08:53.751024] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-21T19:08:53.853256] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:08:53.855690] [INFO ] [REMOTE ] HEQ: Full fetch complete (9535 records). [2025-10-21T19:08:53.855770] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-21T19:08:54.243349] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-21T19:08:54.243440] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-21T19:08:54.243747] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-21T19:08:54.243807] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-21T19:08:54.244218] [DEBUG] [LOCAL ] HEQ: Trimmed 9535 records to 6795 (keeping 200 days of data) [2025-10-21T19:08:54.286208] [DEBUG] [LOCAL ] HEQ: Primary data saved (6795 records). [2025-10-21T19:08:54.286341] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-21T19:08:54.286419] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols completed. HEQ took 14.6s. Estimated remaining: 2h 54m 47s. Rate: 7.8 symbols/min [2025-10-21T19:08:54.463299] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:54.463529] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-21T19:08:54.463632] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-21T19:08:54.463883] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-21T19:08:54.463994] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-21T19:08:54.464116] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-21T19:08:54.464226] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-21T19:08:54.560905] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-21T19:08:54.871966] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T19:08:54.875757] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:54.885154] [INFO ] [REMOTE ] HD: Full fetch complete (77558 records). [2025-10-21T19:08:54.885300] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-21T19:08:54.956865] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-21T19:08:55.274693] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-21T19:08:55.274818] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-21T19:08:55.275797] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-21T19:08:55.275859] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-21T19:08:55.277318] [DEBUG] [LOCAL ] HD: Trimmed 77558 records to 53476 (keeping 200 days of data) [2025-10-21T19:08:55.366987] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-21T19:08:55.611201] [DEBUG] [LOCAL ] HD: Primary data saved (53476 records). [2025-10-21T19:08:55.611350] [INFO ] [MAIN ] HD: Full history saved. [2025-10-21T19:08:55.612176] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols completed. HD took 42.1s. Estimated remaining: 2h 54m 30s. Rate: 7.8 symbols/min [2025-10-21T19:08:55.779279] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:08:55.797602] [DEBUG] [LOCAL ] HFRO: Loaded 16506 existing records from primary storage. [2025-10-21T19:08:55.797873] [INFO ] [MAIN ] HFRO: Loaded 16506 existing records. [2025-10-21T19:08:55.972282] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:08:55.972484] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-21T19:08:55.972531] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-21T19:08:55.972729] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-21T19:08:55.972785] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-21T19:08:56.157363] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-21T19:08:56.339176] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:08:56.924206] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T19:08:56.951175] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:08:56.951394] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-21T19:08:57.244716] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-21T19:08:57.751060] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-21T19:08:58.551022] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-21T19:08:59.351031] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-21T19:08:59.412239] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:08:59.664317] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T19:08:59.821967] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T19:09:00.151120] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-21T19:09:00.720153] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T19:09:00.951072] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-21T19:09:01.522720] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:09:01.751115] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-21T19:09:02.551047] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-21T19:09:03.351053] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-21T19:09:03.397420] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T19:09:03.625710] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T19:09:03.708430] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-21T19:09:04.151083] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-21T19:09:04.951023] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-21T19:09:05.751041] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-21T19:09:05.803005] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:09:06.067090] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T19:09:06.224316] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T19:09:06.551054] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-21T19:09:06.945979] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-21T19:09:07.351023] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-21T19:09:08.151076] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-21T19:09:08.948303] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T19:09:08.957595] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-21T19:09:09.300418] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T19:09:09.312436] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:09:09.751088] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-21T19:09:10.557094] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-21T19:09:10.558725] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T19:09:10.981956] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-21T19:09:11.351017] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-21T19:09:11.595585] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-21T19:09:12.151086] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-21T19:09:12.390678] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-21T19:09:12.951074] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-21T19:09:13.355121] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-21T19:09:13.751025] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-21T19:09:14.550999] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-21T19:09:14.695568] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:09:15.351046] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-21T19:09:16.148571] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T19:09:16.157694] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-21T19:09:16.332201] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T19:09:16.416752] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-21T19:09:16.951023] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-21T19:09:17.184634] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-21T19:09:17.751032] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-21T19:09:18.551076] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-21T19:09:18.903392] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-21T19:09:18.904072] [INFO ] [REMOTE ] HF: Full fetch complete (416 records). [2025-10-21T19:09:18.904172] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-21T19:09:19.080162] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-21T19:09:19.080321] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:09:19.080366] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:09:19.080429] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-21T19:09:19.080489] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-21T19:09:19.080524] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-21T19:09:19.080563] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-21T19:09:19.080617] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols completed. HF took 28.9s. Estimated remaining: 2h 54m 44s. Rate: 7.8 symbols/min [2025-10-21T19:09:19.251131] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:19.267489] [DEBUG] [LOCAL ] HGER: Loaded 15250 existing records from primary storage. [2025-10-21T19:09:19.267753] [INFO ] [MAIN ] HGER: Loaded 15250 existing records. [2025-10-21T19:09:19.356455] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-21T19:09:19.456939] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:19.457248] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-21T19:09:19.457321] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-21T19:09:19.457553] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-21T19:09:19.457612] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-21T19:09:19.669026] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T19:09:19.755352] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-21T19:09:19.875340] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:20.151034] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-21T19:09:20.951043] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-21T19:09:20.967126] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:09:20.968010] [INFO ] [REMOTE ] HFND: Full fetch complete (1759 records). [2025-10-21T19:09:20.968080] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-21T19:09:21.148637] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-21T19:09:21.148855] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:09:21.148945] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:09:21.149039] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-21T19:09:21.149140] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-21T19:09:21.149199] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-21T19:09:21.149251] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-21T19:09:21.149319] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols completed. HFND took 26.9s. Estimated remaining: 2h 54m 29s. Rate: 7.8 symbols/min [2025-10-21T19:09:21.318600] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:21.329104] [DEBUG] [LOCAL ] HGLB: Loaded 9696 existing records from primary storage. [2025-10-21T19:09:21.329280] [INFO ] [MAIN ] HGLB: Loaded 9696 existing records. [2025-10-21T19:09:21.514499] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:21.514782] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-21T19:09:21.514840] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-21T19:09:21.514993] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-21T19:09:21.515049] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-21T19:09:21.756263] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-21T19:09:21.895862] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:22.551035] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-21T19:09:22.568090] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T19:09:22.648147] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:09:23.288113] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T19:09:23.351051] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-21T19:09:23.953952] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:09:24.151028] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-21T19:09:24.884512] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T19:09:24.951005] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-21T19:09:25.750994] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-21T19:09:25.788303] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T19:09:26.499172] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T19:09:26.551039] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-21T19:09:27.332223] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:09:27.351008] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-21T19:09:28.151017] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-21T19:09:28.161336] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T19:09:28.943822] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T19:09:28.950980] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-21T19:09:29.751004] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-21T19:09:29.804613] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T19:09:30.551010] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-21T19:09:30.730991] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T19:09:31.351033] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-21T19:09:32.151005] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-21T19:09:32.306265] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T19:09:32.414561] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T19:09:32.780596] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T19:09:32.951019] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-21T19:09:33.751032] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-21T19:09:34.551006] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-21T19:09:34.802373] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T19:09:34.821807] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T19:09:34.821997] [INFO ] [REMOTE ] HESM: Full fetch complete (69766 records). [2025-10-21T19:09:34.826715] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-21T19:09:34.998526] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-21T19:09:35.261391] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-21T19:09:35.261488] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-21T19:09:35.262471] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-21T19:09:35.262536] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-21T19:09:35.263913] [DEBUG] [LOCAL ] HESM: Trimmed 69766 records to 48621 (keeping 200 days of data) [2025-10-21T19:09:35.351383] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-21T19:09:35.552572] [DEBUG] [LOCAL ] HESM: Primary data saved (48621 records). [2025-10-21T19:09:35.552834] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-21T19:09:35.553377] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols completed. HESM took 47.1s. Estimated remaining: 2h 54m 30s. Rate: 7.8 symbols/min [2025-10-21T19:09:35.722696] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:35.738525] [DEBUG] [LOCAL ] HGTY: Loaded 13382 existing records from primary storage. [2025-10-21T19:09:35.738811] [INFO ] [MAIN ] HGTY: Loaded 13382 existing records. [2025-10-21T19:09:35.956712] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:35.956913] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-21T19:09:35.956960] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-21T19:09:35.957171] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-21T19:09:35.957227] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-21T19:09:36.160021] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-21T19:09:36.311167] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:36.543680] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:09:36.951083] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-21T19:09:37.240312] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T19:09:37.242764] [INFO ] [REMOTE ] HFRO: Full fetch complete (27122 records). [2025-10-21T19:09:37.242837] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-21T19:09:37.610784] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-21T19:09:37.610860] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-21T19:09:37.611381] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-21T19:09:37.611420] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-21T19:09:37.612052] [DEBUG] [LOCAL ] HFRO: Trimmed 27122 records to 16466 (keeping 200 days of data) [2025-10-21T19:09:37.707239] [DEBUG] [LOCAL ] HFRO: Primary data saved (16466 records). [2025-10-21T19:09:37.707363] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-21T19:09:37.707438] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols completed. HFRO took 42.1s. Estimated remaining: 2h 54m 15s. Rate: 7.8 symbols/min [2025-10-21T19:09:37.776064] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-21T19:09:37.885610] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:37.898333] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T19:09:37.903068] [INFO ] [REMOTE ] HGER: Full fetch complete (18867 records). [2025-10-21T19:09:37.903155] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-21T19:09:38.215801] [DEBUG] [LOCAL ] HGV: Loaded 46172 existing records from primary storage. [2025-10-21T19:09:38.226777] [INFO ] [MAIN ] HGV: Loaded 46172 existing records. [2025-10-21T19:09:38.400266] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-21T19:09:38.405758] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-21T19:09:38.411335] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-21T19:09:38.416535] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-21T19:09:38.480212] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:38.480541] [DEBUG] [LOCAL ] HGER: Trimmed 18867 records to 15479 (keeping 200 days of data) [2025-10-21T19:09:38.480777] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-21T19:09:38.480846] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-21T19:09:38.481352] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-21T19:09:38.481419] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-21T19:09:38.557950] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-21T19:09:38.674665] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T19:09:38.721245] [DEBUG] [LOCAL ] HGER: Primary data saved (15479 records). [2025-10-21T19:09:38.744592] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-21T19:09:38.780237] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols completed. HGER took 19.7s. Estimated remaining: 2h 53m 58s. Rate: 7.8 symbols/min [2025-10-21T19:09:39.131132] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:39.138611] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:39.170412] [DEBUG] [LOCAL ] HHH: Loaded 33185 existing records from primary storage. [2025-10-21T19:09:39.170718] [INFO ] [MAIN ] HHH: Loaded 33185 existing records. [2025-10-21T19:09:39.345909] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:39.346266] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-21T19:09:39.346378] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-21T19:09:39.346795] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-21T19:09:39.346861] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-21T19:09:39.357913] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-21T19:09:39.456797] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T19:09:39.707834] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:40.133379] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T19:09:40.150970] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-21T19:09:40.937636] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T19:09:40.950974] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-21T19:09:41.751119] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:09:41.751178] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-21T19:09:42.551239] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-21T19:09:43.160304] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T19:09:43.178038] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T19:09:43.351099] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-21T19:09:44.151075] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-21T19:09:44.909690] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:09:44.951061] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-21T19:09:45.489743] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:09:45.685773] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:09:45.751036] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-21T19:09:46.536317] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T19:09:46.550989] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-21T19:09:47.351024] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-21T19:09:47.554220] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T19:09:48.151020] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-21T19:09:48.620268] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T19:09:48.898221] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T19:09:48.950991] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-21T19:09:49.735377] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T19:09:49.750979] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-21T19:09:50.507444] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T19:09:50.550989] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-21T19:09:51.351051] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-21T19:09:51.574866] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T19:09:51.577107] [INFO ] [REMOTE ] HGLB: Full fetch complete (14421 records). [2025-10-21T19:09:51.577177] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-21T19:09:51.948632] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-21T19:09:51.948773] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-21T19:09:51.949108] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-21T19:09:51.949148] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-21T19:09:51.949589] [DEBUG] [LOCAL ] HGLB: Trimmed 14421 records to 9704 (keeping 200 days of data) [2025-10-21T19:09:52.004349] [DEBUG] [LOCAL ] HGLB: Primary data saved (9704 records). [2025-10-21T19:09:52.004462] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-21T19:09:52.004536] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols completed. HGLB took 30.9s. Estimated remaining: 2h 53m 58s. Rate: 7.8 symbols/min [2025-10-21T19:09:52.153154] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-21T19:09:52.172275] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:52.205995] [DEBUG] [LOCAL ] HI: Loaded 36061 existing records from primary storage. [2025-10-21T19:09:52.206271] [INFO ] [MAIN ] HI: Loaded 36061 existing records. [2025-10-21T19:09:52.379451] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:52.379690] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-21T19:09:52.379748] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-21T19:09:52.379996] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-21T19:09:52.380055] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-21T19:09:52.738037] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:52.956178] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-21T19:09:52.968179] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:09:53.447056] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T19:09:53.750988] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-21T19:09:53.994922] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:09:54.551088] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-21T19:09:54.920799] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T19:09:55.350996] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-21T19:09:55.481452] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T19:09:55.483958] [INFO ] [REMOTE ] HGTY: Full fetch complete (17549 records). [2025-10-21T19:09:55.484025] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-21T19:09:55.840840] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-21T19:09:55.840912] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-21T19:09:55.841259] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-21T19:09:55.841296] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-21T19:09:55.841836] [DEBUG] [LOCAL ] HGTY: Trimmed 17549 records to 13379 (keeping 200 days of data) [2025-10-21T19:09:55.915249] [DEBUG] [LOCAL ] HGTY: Primary data saved (13379 records). [2025-10-21T19:09:55.915372] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-21T19:09:55.915447] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols completed. HGTY took 20.4s. Estimated remaining: 2h 53m 45s. Rate: 7.8 symbols/min [2025-10-21T19:09:56.084619] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:09:56.135213] [DEBUG] [LOCAL ] HIG: Loaded 51188 existing records from primary storage. [2025-10-21T19:09:56.135512] [INFO ] [MAIN ] HIG: Loaded 51188 existing records. [2025-10-21T19:09:56.156182] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-21T19:09:56.316528] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:09:56.316793] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-21T19:09:56.316840] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-21T19:09:56.317026] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-21T19:09:56.317064] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-21T19:09:56.692471] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:09:56.712270] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:09:56.951030] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-21T19:09:57.751021] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-21T19:09:57.829511] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T19:09:58.311294] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T19:09:58.551022] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-21T19:09:58.998973] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T19:09:59.351029] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-21T19:10:00.090811] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:10:00.151004] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-21T19:10:00.951009] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-21T19:10:01.209152] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T19:10:01.751090] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-21T19:10:01.970755] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T19:10:02.551045] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-21T19:10:02.643313] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:10:03.351045] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-21T19:10:03.750037] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T19:10:03.991757] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:10:04.151046] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-21T19:10:04.779484] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T19:10:04.951043] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-21T19:10:05.671840] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T19:10:05.750996] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-21T19:10:06.422031] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:10:06.551016] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-21T19:10:07.351067] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-21T19:10:07.497857] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T19:10:08.151121] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-21T19:10:08.230097] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:10:08.951050] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-21T19:10:09.009612] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:10:09.600697] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:10:09.751042] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-21T19:10:10.544085] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T19:10:10.553587] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-21T19:10:11.196193] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T19:10:11.351022] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-21T19:10:11.965884] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:10:12.151053] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-21T19:10:12.951056] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-21T19:10:12.983545] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:10:13.547475] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T19:10:13.552543] [INFO ] [REMOTE ] HHH: Full fetch complete (46097 records). [2025-10-21T19:10:13.552707] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-21T19:10:13.761264] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-21T19:10:13.941433] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-21T19:10:13.941513] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-21T19:10:13.942271] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-21T19:10:13.942334] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-21T19:10:13.943288] [DEBUG] [LOCAL ] HHH: Trimmed 46097 records to 33152 (keeping 200 days of data) [2025-10-21T19:10:14.139321] [DEBUG] [LOCAL ] HHH: Primary data saved (33152 records). [2025-10-21T19:10:14.139550] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-21T19:10:14.139634] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols completed. HHH took 35.3s. Estimated remaining: 2h 53m 51s. Rate: 7.8 symbols/min [2025-10-21T19:10:14.311734] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:14.334012] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:10:14.369601] [DEBUG] [LOCAL ] HII: Loaded 33610 existing records from primary storage. [2025-10-21T19:10:14.369891] [INFO ] [MAIN ] HII: Loaded 33610 existing records. [2025-10-21T19:10:14.544798] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:14.545055] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-21T19:10:14.545100] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-21T19:10:14.545320] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-21T19:10:14.545375] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-21T19:10:14.556389] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-21T19:10:14.895483] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:15.351010] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-21T19:10:15.448980] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T19:10:15.455352] [INFO ] [REMOTE ] HGV: Full fetch complete (65929 records). [2025-10-21T19:10:15.455459] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-21T19:10:15.883265] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-21T19:10:15.883350] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-21T19:10:15.884213] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-21T19:10:15.884276] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-21T19:10:15.885834] [DEBUG] [LOCAL ] HGV: Trimmed 65929 records to 46110 (keeping 200 days of data) [2025-10-21T19:10:16.145008] [DEBUG] [LOCAL ] HGV: Primary data saved (46110 records). [2025-10-21T19:10:16.145130] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-21T19:10:16.145207] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols completed. HGV took 38.4s. Estimated remaining: 2h 53m 36s. Rate: 7.8 symbols/min [2025-10-21T19:10:16.176632] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-21T19:10:16.320039] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:16.371124] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-21T19:10:16.371424] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-21T19:10:16.551379] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:16.551817] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-21T19:10:16.551894] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-21T19:10:16.552161] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-21T19:10:16.552376] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-21T19:10:16.704274] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-21T19:10:16.955581] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-21T19:10:16.961744] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:16.978722] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T19:10:16.985639] [INFO ] [REMOTE ] HI: Full fetch complete (51093 records). [2025-10-21T19:10:16.985782] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-21T19:10:17.392394] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-21T19:10:17.392527] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-21T19:10:17.393358] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-21T19:10:17.393519] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-21T19:10:17.394790] [DEBUG] [LOCAL ] HI: Trimmed 51093 records to 36113 (keeping 200 days of data) [2025-10-21T19:10:17.501479] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T19:10:17.642231] [DEBUG] [LOCAL ] HI: Primary data saved (36113 records). [2025-10-21T19:10:17.642381] [INFO ] [MAIN ] HI: Full history saved. [2025-10-21T19:10:17.642970] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols completed. HI took 25.6s. Estimated remaining: 2h 53m 20s. Rate: 7.8 symbols/min [2025-10-21T19:10:17.751178] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-21T19:10:17.825235] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:17.849960] [DEBUG] [LOCAL ] HIO: Loaded 24124 existing records from primary storage. [2025-10-21T19:10:17.850256] [INFO ] [MAIN ] HIO: Loaded 24124 existing records. [2025-10-21T19:10:18.035426] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:18.035686] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-21T19:10:18.035743] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-21T19:10:18.035963] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-21T19:10:18.036019] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-21T19:10:18.421949] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:18.551055] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-21T19:10:18.806088] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T19:10:19.351114] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-21T19:10:19.703932] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T19:10:20.151039] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-21T19:10:20.872515] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:10:20.874115] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (3.12 seconds). [2025-10-21T19:10:20.950998] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-21T19:10:21.751077] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-21T19:10:21.828226] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:10:22.551029] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-21T19:10:22.664609] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T19:10:23.351029] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-21T19:10:24.152904] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-21T19:10:24.155665] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T19:10:24.267969] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-21T19:10:24.950997] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-21T19:10:25.288663] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T19:10:25.345854] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:10:25.751020] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-21T19:10:26.551028] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-21T19:10:27.351015] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-21T19:10:27.384163] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-21T19:10:27.442498] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:10:28.151014] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-21T19:10:28.271001] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T19:10:28.643672] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T19:10:28.951060] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-21T19:10:29.751029] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-21T19:10:30.422309] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T19:10:30.550997] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-21T19:10:30.589902] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T19:10:30.744536] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-21T19:10:31.351049] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-21T19:10:32.023250] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:10:32.151015] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-21T19:10:32.928877] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:10:32.951006] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-21T19:10:33.677021] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:10:33.751049] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-21T19:10:33.788662] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T19:10:33.796752] [INFO ] [REMOTE ] HIG: Full fetch complete (73667 records). [2025-10-21T19:10:33.796933] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-21T19:10:34.176252] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-21T19:10:34.176334] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-21T19:10:34.177239] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-21T19:10:34.177303] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-21T19:10:34.178690] [DEBUG] [LOCAL ] HIG: Trimmed 73667 records to 51173 (keeping 200 days of data) [2025-10-21T19:10:34.492461] [DEBUG] [LOCAL ] HIG: Primary data saved (51173 records). [2025-10-21T19:10:34.492591] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-21T19:10:34.493341] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols completed. HIG took 38.6s. Estimated remaining: 2h 53m 25s. Rate: 7.8 symbols/min [2025-10-21T19:10:34.556125] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-21T19:10:34.662624] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:34.684309] [DEBUG] [LOCAL ] HIPO: Loaded 21623 existing records from primary storage. [2025-10-21T19:10:34.684546] [INFO ] [MAIN ] HIPO: Loaded 21623 existing records. [2025-10-21T19:10:34.867138] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:34.867345] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-21T19:10:34.867444] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-21T19:10:34.867723] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-21T19:10:34.867792] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-21T19:10:35.226061] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:35.351034] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-21T19:10:35.705339] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:10:36.151129] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-21T19:10:36.303150] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T19:10:36.595567] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-10-21T19:10:36.896053] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T19:10:36.951070] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-21T19:10:37.751028] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-21T19:10:38.551085] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-21T19:10:39.197077] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:10:39.315979] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-21T19:10:39.339463] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T19:10:39.350968] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-21T19:10:40.151069] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-21T19:10:40.560924] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:10:40.951019] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-21T19:10:41.164673] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T19:10:41.750997] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-21T19:10:42.168214] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T19:10:42.551083] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-21T19:10:43.351021] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-21T19:10:43.780275] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:10:43.785848] [INFO ] [REMOTE ] HIO: Full fetch complete (38025 records). [2025-10-21T19:10:43.785927] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-21T19:10:44.157356] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-21T19:10:44.159545] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-21T19:10:44.160559] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-21T19:10:44.161177] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-21T19:10:44.161241] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-21T19:10:44.162137] [DEBUG] [LOCAL ] HIO: Trimmed 38025 records to 24124 (keeping 200 days of data) [2025-10-21T19:10:44.296453] [DEBUG] [LOCAL ] HIO: Primary data saved (24124 records). [2025-10-21T19:10:44.296569] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-21T19:10:44.296793] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols completed. HIO took 26.7s. Estimated remaining: 2h 53m 20s. Rate: 7.8 symbols/min [2025-10-21T19:10:44.463473] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:44.500680] [DEBUG] [LOCAL ] HIW: Loaded 44503 existing records from primary storage. [2025-10-21T19:10:44.500951] [INFO ] [MAIN ] HIW: Loaded 44503 existing records. [2025-10-21T19:10:44.684008] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:44.684287] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-21T19:10:44.684404] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-21T19:10:44.684689] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-21T19:10:44.684748] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-21T19:10:44.981459] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T19:10:45.026276] [INFO ] [REMOTE ] HII: Full fetch complete (52424 records). [2025-10-21T19:10:45.065893] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:45.042593] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-21T19:10:45.066480] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-21T19:10:45.322485] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (3.57 seconds). [2025-10-21T19:10:45.426183] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T19:10:45.521000] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-21T19:10:45.521068] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-21T19:10:45.521886] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-21T19:10:45.521950] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-21T19:10:45.522923] [DEBUG] [LOCAL ] HII: Trimmed 52424 records to 33494 (keeping 200 days of data) [2025-10-21T19:10:45.724181] [DEBUG] [LOCAL ] HII: Primary data saved (33494 records). [2025-10-21T19:10:45.724301] [INFO ] [MAIN ] HII: Full history saved. [2025-10-21T19:10:45.724382] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols completed. HII took 31.6s. Estimated remaining: 2h 53m 4s. Rate: 7.8 symbols/min [2025-10-21T19:10:45.756125] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-21T19:10:45.900659] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:10:45.918588] [DEBUG] [LOCAL ] HIX: Loaded 20398 existing records from primary storage. [2025-10-21T19:10:45.918850] [INFO ] [MAIN ] HIX: Loaded 20398 existing records. [2025-10-21T19:10:46.096415] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:10:46.096730] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-21T19:10:46.096804] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-21T19:10:46.097009] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-21T19:10:46.097066] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-21T19:10:46.451886] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:10:46.563247] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-21T19:10:46.565430] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T19:10:46.973014] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T19:10:47.351058] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-21T19:10:48.151045] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-21T19:10:48.411490] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:10:48.924310] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T19:10:48.949052] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:10:48.953662] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-21T19:10:49.751050] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-21T19:10:50.034891] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T19:10:50.551051] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-21T19:10:50.853288] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T19:10:51.351035] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-21T19:10:52.151024] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-21T19:10:52.950997] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-21T19:10:53.053372] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:10:53.221498] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T19:10:53.522309] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.97 seconds). [2025-10-21T19:10:53.751027] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-21T19:10:54.515911] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:10:54.551077] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-21T19:10:54.809984] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T19:10:55.351029] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-21T19:10:56.113164] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:10:56.150980] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-21T19:10:56.436868] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T19:10:56.951032] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-21T19:10:57.751056] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-21T19:10:57.977630] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T19:10:58.061177] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T19:10:58.529079] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T19:10:58.550984] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-21T19:10:59.350980] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-21T19:10:59.590278] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T19:11:00.151023] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-21T19:11:00.950997] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-21T19:11:01.339871] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:11:01.751032] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-21T19:11:02.359129] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-21T19:11:02.369316] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-21T19:11:02.369475] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-21T19:11:02.553872] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-21T19:11:02.780761] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-21T19:11:02.780869] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-21T19:11:02.781881] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-21T19:11:02.781964] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-21T19:11:02.808835] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T19:11:02.807257] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-21T19:11:03.065312] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T19:11:03.165749] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-21T19:11:03.165910] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-21T19:11:03.166593] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols completed. HIMS took 47.0s. Estimated remaining: 2h 53m 9s. Rate: 7.8 symbols/min [2025-10-21T19:11:03.334946] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:03.355942] [DEBUG] [LOCAL ] HKD: Loaded 18743 existing records from primary storage. [2025-10-21T19:11:03.355433] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-21T19:11:03.357022] [INFO ] [MAIN ] HKD: Loaded 18743 existing records. [2025-10-21T19:11:03.538630] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:03.538880] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-21T19:11:03.538951] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-21T19:11:03.539148] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-21T19:11:03.539204] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-21T19:11:03.673297] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T19:11:03.717047] [INFO ] [REMOTE ] HIPO: Full fetch complete (31045 records). [2025-10-21T19:11:03.741776] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-21T19:11:04.110244] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:04.156250] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-21T19:11:04.310722] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-21T19:11:04.310812] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-21T19:11:04.311488] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-21T19:11:04.311552] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-21T19:11:04.312354] [DEBUG] [LOCAL ] HIPO: Trimmed 31045 records to 21512 (keeping 200 days of data) [2025-10-21T19:11:04.434312] [DEBUG] [LOCAL ] HIPO: Primary data saved (21512 records). [2025-10-21T19:11:04.434434] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-21T19:11:04.434507] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols completed. HIPO took 29.9s. Estimated remaining: 2h 52m 53s. Rate: 7.8 symbols/min [2025-10-21T19:11:04.602267] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:04.657005] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-21T19:11:04.657310] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-21T19:11:04.832769] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:04.832986] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-21T19:11:04.833032] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-21T19:11:04.833211] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-21T19:11:04.833247] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-21T19:11:04.955331] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-21T19:11:05.210242] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:05.241775] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T19:11:05.373900] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:11:05.751051] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-21T19:11:06.057450] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T19:11:06.551094] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-21T19:11:07.242786] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T19:11:07.351050] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-21T19:11:07.831275] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T19:11:08.151057] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-21T19:11:08.421511] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T19:11:08.951091] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-21T19:11:09.751005] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-21T19:11:09.801084] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:11:10.151491] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T19:11:10.154691] [INFO ] [REMOTE ] HIX: Full fetch complete (29876 records). [2025-10-21T19:11:10.154761] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-21T19:11:10.516214] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-21T19:11:10.516283] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-21T19:11:10.516860] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-21T19:11:10.516924] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-21T19:11:10.517576] [DEBUG] [LOCAL ] HIX: Trimmed 29876 records to 20379 (keeping 200 days of data) [2025-10-21T19:11:10.566013] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-21T19:11:10.638182] [DEBUG] [LOCAL ] HIX: Primary data saved (20379 records). [2025-10-21T19:11:10.638411] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-21T19:11:10.638603] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols completed. HIX took 24.9s. Estimated remaining: 2h 52m 43s. Rate: 7.8 symbols/min [2025-10-21T19:11:10.818203] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:10.832295] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:11:10.876964] [DEBUG] [LOCAL ] HLF: Loaded 48540 existing records from primary storage. [2025-10-21T19:11:10.877289] [INFO ] [MAIN ] HLF: Loaded 48540 existing records. [2025-10-21T19:11:11.049271] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:11.049443] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-21T19:11:11.049490] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-21T19:11:11.049841] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-21T19:11:11.049911] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-21T19:11:11.356331] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-21T19:11:11.395858] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:12.151024] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-21T19:11:12.544025] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T19:11:12.619971] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T19:11:12.951049] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-21T19:11:13.251871] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T19:11:13.751058] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-21T19:11:14.465550] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T19:11:14.509480] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T19:11:14.550985] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-21T19:11:15.351041] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-21T19:11:15.818637] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T19:11:16.151036] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-21T19:11:16.951016] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-21T19:11:17.297574] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-21T19:11:17.705706] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T19:11:17.712785] [INFO ] [REMOTE ] HIW: Full fetch complete (64853 records). [2025-10-21T19:11:17.712919] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-21T19:11:17.756346] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-21T19:11:18.107977] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-21T19:11:18.108078] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-21T19:11:18.109136] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-21T19:11:18.109228] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-21T19:11:18.110517] [DEBUG] [LOCAL ] HIW: Trimmed 64853 records to 44457 (keeping 200 days of data) [2025-10-21T19:11:18.218937] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-21T19:11:18.389974] [DEBUG] [LOCAL ] HIW: Primary data saved (44457 records). [2025-10-21T19:11:18.390097] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-21T19:11:18.390838] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols completed. HIW took 34.1s. Estimated remaining: 2h 52m 35s. Rate: 7.8 symbols/min [2025-10-21T19:11:18.556177] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-21T19:11:18.558471] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:18.593952] [DEBUG] [LOCAL ] HLI: Loaded 30785 existing records from primary storage. [2025-10-21T19:11:18.594234] [INFO ] [MAIN ] HLI: Loaded 30785 existing records. [2025-10-21T19:11:18.767714] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:18.767975] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-21T19:11:18.768024] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-21T19:11:18.768209] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-21T19:11:18.768247] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-21T19:11:19.121442] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:19.351064] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-21T19:11:19.547106] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T19:11:19.791868] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T19:11:20.151012] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-21T19:11:20.608126] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T19:11:20.951023] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-21T19:11:21.168198] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T19:11:21.751032] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-21T19:11:22.449281] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T19:11:22.550985] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-21T19:11:23.351000] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-21T19:11:23.784203] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T19:11:24.160107] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-21T19:11:24.181044] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T19:11:24.711524] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:11:24.951016] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-21T19:11:25.475004] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:11:25.478739] [INFO ] [REMOTE ] HKD: Full fetch complete (27920 records). [2025-10-21T19:11:25.478822] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-21T19:11:25.760554] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-21T19:11:25.857722] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-21T19:11:25.857844] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-21T19:11:25.858430] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-21T19:11:25.858473] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-21T19:11:25.859255] [DEBUG] [LOCAL ] HKD: Trimmed 27920 records to 18717 (keeping 200 days of data) [2025-10-21T19:11:25.963588] [DEBUG] [LOCAL ] HKD: Primary data saved (18717 records). [2025-10-21T19:11:25.963744] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-21T19:11:25.963831] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols completed. HKD took 22.8s. Estimated remaining: 2h 52m 27s. Rate: 7.8 symbols/min [2025-10-21T19:11:26.136895] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:26.166133] [DEBUG] [LOCAL ] HLIO: Loaded 28259 existing records from primary storage. [2025-10-21T19:11:26.166371] [INFO ] [MAIN ] HLIO: Loaded 28259 existing records. [2025-10-21T19:11:26.357465] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:26.357728] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-21T19:11:26.357794] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-21T19:11:26.358036] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-21T19:11:26.358095] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-21T19:11:26.561061] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-21T19:11:26.621578] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T19:11:26.767056] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:27.351056] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-21T19:11:27.914828] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T19:11:27.956522] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T19:11:28.151061] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-21T19:11:28.951068] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-21T19:11:29.090277] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T19:11:29.165343] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-21T19:11:29.751085] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-21T19:11:30.371720] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:11:30.551130] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-21T19:11:30.728858] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T19:11:31.351041] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-21T19:11:32.133797] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:11:32.150995] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-21T19:11:32.640707] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:11:32.951036] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-21T19:11:33.750993] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-21T19:11:33.856286] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:11:34.010116] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T19:11:34.551047] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-21T19:11:35.351024] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-21T19:11:35.561837] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:11:35.968469] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T19:11:36.113415] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T19:11:36.150982] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-21T19:11:36.951027] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-21T19:11:37.577223] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T19:11:37.751020] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-21T19:11:38.551016] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-21T19:11:39.046424] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T19:11:39.075745] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T19:11:39.351023] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-21T19:11:40.017227] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T19:11:40.092066] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:11:40.151029] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-21T19:11:40.951035] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-21T19:11:41.751000] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-21T19:11:42.017659] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:11:42.167759] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T19:11:42.551032] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-21T19:11:43.351020] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-21T19:11:43.405526] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:11:43.414252] [INFO ] [REMOTE ] HLF: Full fetch complete (70878 records). [2025-10-21T19:11:43.414406] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-21T19:11:43.804142] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-21T19:11:43.804231] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-21T19:11:43.805136] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-21T19:11:43.805203] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-21T19:11:43.806558] [DEBUG] [LOCAL ] HLF: Trimmed 70878 records to 48506 (keeping 200 days of data) [2025-10-21T19:11:44.074311] [DEBUG] [LOCAL ] HLF: Primary data saved (48506 records). [2025-10-21T19:11:44.074451] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-21T19:11:44.074531] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols completed. HLF took 33.4s. Estimated remaining: 2h 52m 33s. Rate: 7.8 symbols/min [2025-10-21T19:11:44.156165] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-21T19:11:44.257130] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:44.289343] [DEBUG] [LOCAL ] HLLY: Loaded 33339 existing records from primary storage. [2025-10-21T19:11:44.289633] [INFO ] [MAIN ] HLLY: Loaded 33339 existing records. [2025-10-21T19:11:44.487207] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:44.487597] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-21T19:11:44.487702] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-21T19:11:44.488012] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-21T19:11:44.488081] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-21T19:11:44.843517] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T19:11:44.871039] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-21T19:11:44.871252] [INFO ] [REMOTE ] HLI: Full fetch complete (45374 records). [2025-10-21T19:11:44.915295] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-21T19:11:44.972399] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:44.968221] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-21T19:11:45.356475] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-21T19:11:45.356565] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-21T19:11:45.357399] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-21T19:11:45.357464] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-21T19:11:45.358573] [DEBUG] [LOCAL ] HLI: Trimmed 45374 records to 30693 (keeping 200 days of data) [2025-10-21T19:11:45.547476] [DEBUG] [LOCAL ] HLI: Primary data saved (30693 records). [2025-10-21T19:11:45.547626] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-21T19:11:45.548599] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols completed. HLI took 27.2s. Estimated remaining: 2h 52m 17s. Rate: 7.8 symbols/min [2025-10-21T19:11:45.673164] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:11:45.756135] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-21T19:11:45.758243] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:45.809612] [DEBUG] [LOCAL ] HLN: Loaded 53136 existing records from primary storage. [2025-10-21T19:11:45.809967] [INFO ] [MAIN ] HLN: Loaded 53136 existing records. [2025-10-21T19:11:45.992297] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:45.992537] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-21T19:11:45.992591] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-21T19:11:45.992802] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-21T19:11:45.992859] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-21T19:11:46.361502] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:46.551077] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-21T19:11:46.915067] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T19:11:47.351006] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-21T19:11:47.387406] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-21T19:11:47.396400] [INFO ] [REMOTE ] HL: Full fetch complete (77825 records). [2025-10-21T19:11:47.396522] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-21T19:11:47.805968] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-21T19:11:47.806213] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-21T19:11:47.807347] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-21T19:11:47.807473] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-21T19:11:47.809327] [DEBUG] [LOCAL ] HL: Trimmed 77825 records to 53676 (keeping 200 days of data) [2025-10-21T19:11:47.926520] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T19:11:48.153759] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-21T19:11:48.159951] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-21T19:11:48.160868] [INFO ] [MAIN ] HL: Full history saved. [2025-10-21T19:11:48.160979] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols completed. HL took 43.7s. Estimated remaining: 2h 52m 3s. Rate: 7.8 symbols/min [2025-10-21T19:11:48.335896] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:48.379923] [DEBUG] [LOCAL ] HLT: Loaded 50463 existing records from primary storage. [2025-10-21T19:11:48.380226] [INFO ] [MAIN ] HLT: Loaded 50463 existing records. [2025-10-21T19:11:48.563463] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:48.563726] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-21T19:11:48.563786] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-21T19:11:48.564052] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-21T19:11:48.564094] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-21T19:11:48.946931] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:48.957743] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-21T19:11:48.979898] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T19:11:49.060123] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T19:11:49.751039] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-21T19:11:50.551004] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-21T19:11:50.714581] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:11:50.960382] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:11:51.351026] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-21T19:11:51.911811] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:11:52.151050] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-21T19:11:52.951043] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-21T19:11:53.152518] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:11:53.362805] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T19:11:53.751044] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-21T19:11:54.551071] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-21T19:11:54.941635] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T19:11:55.351057] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-21T19:11:55.584182] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:11:55.744179] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:11:56.151073] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-21T19:11:56.607536] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T19:11:56.611948] [INFO ] [REMOTE ] HLIO: Full fetch complete (37099 records). [2025-10-21T19:11:56.612053] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-21T19:11:56.951725] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-21T19:11:56.984219] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-21T19:11:56.984301] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-21T19:11:56.985047] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-21T19:11:56.985110] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-21T19:11:56.985996] [DEBUG] [LOCAL ] HLIO: Trimmed 37099 records to 28169 (keeping 200 days of data) [2025-10-21T19:11:57.156538] [DEBUG] [LOCAL ] HLIO: Primary data saved (28169 records). [2025-10-21T19:11:57.156694] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-21T19:11:57.156789] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols completed. HLIO took 31.2s. Estimated remaining: 2h 51m 57s. Rate: 7.8 symbols/min [2025-10-21T19:11:57.324133] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:11:57.365953] [DEBUG] [LOCAL ] HLX: Loaded 47458 existing records from primary storage. [2025-10-21T19:11:57.366312] [INFO ] [MAIN ] HLX: Loaded 47458 existing records. [2025-10-21T19:11:57.512540] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T19:11:57.576283] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:11:57.576868] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-21T19:11:57.576918] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-21T19:11:57.577097] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-21T19:11:57.577135] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-21T19:11:57.760870] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-21T19:11:57.927917] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:11:58.551047] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-21T19:11:59.118338] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-21T19:11:59.185195] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:11:59.351043] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-21T19:12:00.150993] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-21T19:12:00.190666] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:12:00.254571] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T19:12:00.950986] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-21T19:12:01.751074] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-21T19:12:01.825811] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:12:02.551050] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-21T19:12:02.848998] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T19:12:02.933139] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T19:12:03.351019] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-21T19:12:04.141571] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:12:04.150978] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-21T19:12:04.697520] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T19:12:04.951004] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-21T19:12:05.756130] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-21T19:12:05.771605] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:12:06.551015] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-21T19:12:06.707303] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T19:12:07.192116] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T19:12:07.350989] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-21T19:12:07.992675] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:12:08.151007] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-21T19:12:08.721746] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:12:08.951041] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-21T19:12:09.370685] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T19:12:09.751084] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-21T19:12:10.551016] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-21T19:12:10.860260] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T19:12:11.296948] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T19:12:11.351026] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-21T19:12:11.993600] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T19:12:11.998591] [INFO ] [REMOTE ] HLLY: Full fetch complete (45971 records). [2025-10-21T19:12:11.998700] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-21T19:12:12.168344] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-21T19:12:12.372416] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-21T19:12:12.372490] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-21T19:12:12.373205] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-21T19:12:12.373269] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-21T19:12:12.374183] [DEBUG] [LOCAL ] HLLY: Trimmed 45971 records to 33260 (keeping 200 days of data) [2025-10-21T19:12:12.559450] [DEBUG] [LOCAL ] HLLY: Primary data saved (33260 records). [2025-10-21T19:12:12.559635] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-21T19:12:12.559759] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols completed. HLLY took 28.5s. Estimated remaining: 2h 51m 59s. Rate: 7.8 symbols/min [2025-10-21T19:12:12.730327] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:12.772687] [DEBUG] [LOCAL ] HMC: Loaded 46338 existing records from primary storage. [2025-10-21T19:12:12.773129] [INFO ] [MAIN ] HMC: Loaded 46338 existing records. [2025-10-21T19:12:12.901581] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T19:12:12.960893] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-21T19:12:12.990459] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:12.990689] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-21T19:12:12.990746] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-21T19:12:12.990950] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-21T19:12:12.991006] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-21T19:12:13.362388] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:13.743432] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:12:13.753748] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-21T19:12:14.551025] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-21T19:12:14.662756] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:12:15.351012] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-21T19:12:15.673596] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T19:12:16.151022] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-21T19:12:16.432106] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:12:16.950988] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-21T19:12:17.143694] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:12:17.751027] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-21T19:12:17.935217] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:12:18.378472] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T19:12:18.551009] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-21T19:12:19.065858] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:12:19.075588] [INFO ] [REMOTE ] HLN: Full fetch complete (77036 records). [2025-10-21T19:12:19.075804] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-21T19:12:19.360320] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-21T19:12:19.485030] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-21T19:12:19.485104] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-21T19:12:19.486051] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-21T19:12:19.486112] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-21T19:12:19.487794] [DEBUG] [LOCAL ] HLN: Trimmed 77036 records to 53131 (keeping 200 days of data) [2025-10-21T19:12:19.803328] [DEBUG] [LOCAL ] HLN: Primary data saved (53131 records). [2025-10-21T19:12:19.803457] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-21T19:12:19.804284] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols completed. HLN took 34.3s. Estimated remaining: 2h 51m 51s. Rate: 7.8 symbols/min [2025-10-21T19:12:19.989070] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:20.017483] [DEBUG] [LOCAL ] HMN: Loaded 23459 existing records from primary storage. [2025-10-21T19:12:20.017846] [INFO ] [MAIN ] HMN: Loaded 23459 existing records. [2025-10-21T19:12:20.175207] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-21T19:12:20.206549] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:20.207002] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-21T19:12:20.207053] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-21T19:12:20.207425] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-21T19:12:20.207497] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-21T19:12:20.616603] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:20.625771] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T19:12:20.951001] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-21T19:12:21.133057] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T19:12:21.756189] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-21T19:12:21.775869] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T19:12:22.006035] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:12:22.551075] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-21T19:12:23.351005] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-21T19:12:23.543429] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:12:23.551916] [INFO ] [REMOTE ] HLT: Full fetch complete (73622 records). [2025-10-21T19:12:23.552050] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-21T19:12:23.919789] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-21T19:12:24.010735] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-21T19:12:24.010828] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-21T19:12:24.011863] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-21T19:12:24.011927] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-21T19:12:24.013283] [DEBUG] [LOCAL ] HLT: Trimmed 73622 records to 50463 (keeping 200 days of data) [2025-10-21T19:12:24.190424] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-21T19:12:24.324296] [DEBUG] [LOCAL ] HLT: Primary data saved (50463 records). [2025-10-21T19:12:24.324421] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-21T19:12:24.324497] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols completed. HLT took 36.2s. Estimated remaining: 2h 51m 39s. Rate: 7.8 symbols/min [2025-10-21T19:12:24.488147] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T19:12:24.524936] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:24.575790] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-21T19:12:24.576105] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-21T19:12:24.760583] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:24.760968] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-21T19:12:24.761019] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-21T19:12:24.761271] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-21T19:12:24.761327] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-21T19:12:24.956717] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-21T19:12:25.125990] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:25.751002] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-21T19:12:25.904045] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T19:12:26.550994] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-21T19:12:26.718234] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:12:26.771916] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T19:12:27.351029] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-21T19:12:28.151005] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-21T19:12:28.235149] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T19:12:28.242189] [INFO ] [REMOTE ] HLX: Full fetch complete (69029 records). [2025-10-21T19:12:28.242323] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-21T19:12:28.636374] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-21T19:12:28.636456] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-21T19:12:28.637369] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-21T19:12:28.637433] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-21T19:12:28.638771] [DEBUG] [LOCAL ] HLX: Trimmed 69029 records to 47394 (keeping 200 days of data) [2025-10-21T19:12:28.898807] [DEBUG] [LOCAL ] HLX: Primary data saved (47394 records). [2025-10-21T19:12:28.898934] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-21T19:12:28.899028] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols completed. HLX took 31.7s. Estimated remaining: 2h 51m 27s. Rate: 7.8 symbols/min [2025-10-21T19:12:28.957744] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-21T19:12:29.084969] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:29.085107] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-21T19:12:29.085143] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-21T19:12:29.085248] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-21T19:12:29.085289] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-21T19:12:29.085329] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-21T19:12:29.085360] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-21T19:12:29.395093] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-21T19:12:29.522861] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:29.524347] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T19:12:29.751010] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-21T19:12:30.551061] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-21T19:12:30.632411] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:12:30.935535] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T19:12:31.351080] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-21T19:12:32.151112] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-21T19:12:32.350268] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:12:32.365214] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-21T19:12:32.365763] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:12:32.367233] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T19:12:32.367378] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-21T19:12:32.377639] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:12:32.378115] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-21T19:12:32.378183] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-21T19:12:32.378220] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-21T19:12:32.378259] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-21T19:12:32.378328] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols completed. HNGE took 3.5s. Estimated remaining: 2h 51m 14s. Rate: 7.8 symbols/min [2025-10-21T19:12:32.565926] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:32.594697] [DEBUG] [LOCAL ] HNI: Loaded 29783 existing records from primary storage. [2025-10-21T19:12:32.594971] [INFO ] [MAIN ] HNI: Loaded 29783 existing records. [2025-10-21T19:12:32.774914] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:32.775223] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-21T19:12:32.775287] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-21T19:12:32.775607] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-21T19:12:32.775705] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-21T19:12:32.952153] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-21T19:12:33.063899] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T19:12:33.205083] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:33.751038] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-21T19:12:34.551042] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-21T19:12:34.793055] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:12:35.032308] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T19:12:35.351000] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-21T19:12:35.597023] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T19:12:36.151081] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-21T19:12:36.951012] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-21T19:12:37.140506] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:12:37.750991] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-21T19:12:38.038171] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:12:38.147337] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T19:12:38.549975] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:12:38.555771] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-21T19:12:39.351080] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-21T19:12:40.151110] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-21T19:12:40.328306] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:12:40.576315] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T19:12:40.951040] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-21T19:12:41.751005] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-21T19:12:42.131300] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T19:12:42.444243] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T19:12:42.509114] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T19:12:42.550984] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-21T19:12:43.351037] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-21T19:12:44.150998] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-21T19:12:44.276315] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T19:12:44.285355] [INFO ] [REMOTE ] HMC: Full fetch complete (68706 records). [2025-10-21T19:12:44.285511] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-21T19:12:44.687461] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T19:12:44.727823] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-21T19:12:44.728136] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-21T19:12:44.729219] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-21T19:12:44.729282] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-21T19:12:44.730424] [DEBUG] [LOCAL ] HMC: Trimmed 68706 records to 46311 (keeping 200 days of data) [2025-10-21T19:12:44.954873] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-21T19:12:44.991489] [DEBUG] [LOCAL ] HMC: Primary data saved (46311 records). [2025-10-21T19:12:44.991579] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-21T19:12:44.991671] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols completed. HMC took 32.4s. Estimated remaining: 2h 51m 13s. Rate: 7.8 symbols/min [2025-10-21T19:12:45.162169] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:45.208912] [DEBUG] [LOCAL ] HOG: Loaded 50715 existing records from primary storage. [2025-10-21T19:12:45.209220] [INFO ] [MAIN ] HOG: Loaded 50715 existing records. [2025-10-21T19:12:45.384973] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:45.385196] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-21T19:12:45.385255] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-21T19:12:45.385471] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-21T19:12:45.385526] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-21T19:12:45.740384] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:45.750984] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-21T19:12:45.914422] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T19:12:45.972515] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T19:12:46.551038] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-21T19:12:47.351061] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-21T19:12:47.395739] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:12:47.420125] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:12:47.424848] [INFO ] [REMOTE ] HMN: Full fetch complete (31580 records). [2025-10-21T19:12:47.424940] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-21T19:12:47.791559] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-21T19:12:47.791637] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-21T19:12:47.792368] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-21T19:12:47.792415] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-21T19:12:47.793384] [DEBUG] [LOCAL ] HMN: Trimmed 31580 records to 23409 (keeping 200 days of data) [2025-10-21T19:12:47.933066] [DEBUG] [LOCAL ] HMN: Primary data saved (23409 records). [2025-10-21T19:12:47.933198] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-21T19:12:47.933276] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols completed. HMN took 28.1s. Estimated remaining: 2h 50m 59s. Rate: 7.8 symbols/min [2025-10-21T19:12:48.100331] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:12:48.146801] [DEBUG] [LOCAL ] HOMB: Loaded 43754 existing records from primary storage. [2025-10-21T19:12:48.147105] [INFO ] [MAIN ] HOMB: Loaded 43754 existing records. [2025-10-21T19:12:48.152675] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-21T19:12:48.324358] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:12:48.324554] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-21T19:12:48.324599] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-21T19:12:48.324806] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-21T19:12:48.324859] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-21T19:12:48.671881] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:12:48.951025] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-21T19:12:49.440326] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T19:12:49.465424] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:12:49.751066] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-21T19:12:50.049708] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T19:12:50.551029] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-21T19:12:51.350997] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-21T19:12:51.452001] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:12:52.020635] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T19:12:52.151080] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-21T19:12:52.448447] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T19:12:52.951081] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-21T19:12:53.751099] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-21T19:12:53.885735] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T19:12:54.507675] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:12:54.551010] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-21T19:12:54.887304] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T19:12:55.351020] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-21T19:12:56.151028] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-21T19:12:56.268458] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:12:56.891190] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T19:12:56.951003] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-21T19:12:57.751037] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-21T19:12:58.146503] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T19:12:58.396749] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T19:12:58.551024] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-21T19:12:59.211448] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:12:59.351036] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-21T19:12:59.901530] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:12:59.906660] [INFO ] [REMOTE ] HNI: Full fetch complete (42102 records). [2025-10-21T19:12:59.906755] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-21T19:13:00.157240] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-21T19:13:00.283173] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-21T19:13:00.283249] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-21T19:13:00.283935] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-21T19:13:00.283996] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-21T19:13:00.284851] [DEBUG] [LOCAL ] HNI: Trimmed 42102 records to 29744 (keeping 200 days of data) [2025-10-21T19:13:00.458885] [DEBUG] [LOCAL ] HNI: Primary data saved (29744 records). [2025-10-21T19:13:00.459018] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-21T19:13:00.459095] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols completed. HNI took 28.1s. Estimated remaining: 2h 50m 58s. Rate: 7.8 symbols/min [2025-10-21T19:13:00.628439] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:00.670060] [DEBUG] [LOCAL ] HOUS: Loaded 45656 existing records from primary storage. [2025-10-21T19:13:00.670384] [INFO ] [MAIN ] HOUS: Loaded 45656 existing records. [2025-10-21T19:13:00.847101] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:00.847288] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-21T19:13:00.847334] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-21T19:13:00.847507] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-21T19:13:00.847545] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-21T19:13:00.956337] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-21T19:13:01.206587] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:01.230100] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T19:13:01.751101] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-21T19:13:02.259196] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T19:13:02.551090] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-21T19:13:03.215570] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-21T19:13:03.279026] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:13:03.351025] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-21T19:13:04.151079] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-21T19:13:04.300549] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:13:04.951067] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-21T19:13:05.397576] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T19:13:05.405837] [INFO ] [REMOTE ] HMY: Full fetch complete (77104 records). [2025-10-21T19:13:05.405971] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-21T19:13:05.761107] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-21T19:13:05.804489] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-21T19:13:05.804716] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-21T19:13:05.805807] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-21T19:13:05.805912] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-21T19:13:05.807434] [DEBUG] [LOCAL ] HMY: Trimmed 77104 records to 53166 (keeping 200 days of data) [2025-10-21T19:13:05.965248] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T19:13:06.175486] [DEBUG] [LOCAL ] HMY: Primary data saved (53166 records). [2025-10-21T19:13:06.175616] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-21T19:13:06.175722] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols completed. HMY took 41.9s. Estimated remaining: 2h 50m 47s. Rate: 7.8 symbols/min [2025-10-21T19:13:06.348378] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:06.364110] [DEBUG] [LOCAL ] HOV: Loaded 14023 existing records from primary storage. [2025-10-21T19:13:06.364327] [INFO ] [MAIN ] HOV: Loaded 14023 existing records. [2025-10-21T19:13:06.501847] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T19:13:06.573825] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-21T19:13:06.579215] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:06.580331] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-21T19:13:06.580426] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-21T19:13:06.580623] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-21T19:13:06.580700] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-21T19:13:06.930614] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:07.351000] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-21T19:13:07.433241] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:13:08.157347] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-21T19:13:08.161742] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:13:08.325582] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T19:13:08.950992] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-21T19:13:09.751052] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-21T19:13:09.835062] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T19:13:09.916752] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T19:13:10.551025] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-21T19:13:11.157925] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:13:11.350998] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-21T19:13:11.460150] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:13:12.151022] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-21T19:13:12.951058] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-21T19:13:13.049474] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:13:13.519425] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:13:13.760688] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-21T19:13:13.768669] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T19:13:14.551032] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-21T19:13:15.351009] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-21T19:13:15.409545] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T19:13:15.489667] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:13:16.151018] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-21T19:13:16.951078] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-21T19:13:17.001413] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T19:13:17.585462] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T19:13:17.593577] [INFO ] [REMOTE ] HOG: Full fetch complete (74299 records). [2025-10-21T19:13:17.593780] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-21T19:13:17.771890] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-21T19:13:18.009463] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-21T19:13:18.009595] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-21T19:13:18.010764] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-21T19:13:18.010858] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-21T19:13:18.027321] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T19:13:18.032974] [DEBUG] [LOCAL ] HOG: Trimmed 74299 records to 50674 (keeping 200 days of data) [2025-10-21T19:13:18.336933] [DEBUG] [LOCAL ] HOG: Primary data saved (50674 records). [2025-10-21T19:13:18.337069] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-21T19:13:18.337145] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols completed. HOG took 33.3s. Estimated remaining: 2h 50m 45s. Rate: 7.8 symbols/min [2025-10-21T19:13:18.551082] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-21T19:13:19.351116] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-21T19:13:19.426996] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:13:20.152793] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T19:13:20.151601] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-21T19:13:20.160741] [INFO ] [REMOTE ] HOMB: Full fetch complete (64477 records). [2025-10-21T19:13:20.160832] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-21T19:13:20.492668] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T19:13:20.593476] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-21T19:13:20.593553] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-21T19:13:20.594486] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-21T19:13:20.594548] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-21T19:13:20.595845] [DEBUG] [LOCAL ] HOMB: Trimmed 64477 records to 43717 (keeping 200 days of data) [2025-10-21T19:13:20.849607] [DEBUG] [LOCAL ] HOMB: Primary data saved (43717 records). [2025-10-21T19:13:20.849756] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-21T19:13:20.850518] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols completed. HOMB took 32.9s. Estimated remaining: 2h 50m 31s. Rate: 7.8 symbols/min [2025-10-21T19:13:20.950996] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-21T19:13:21.693042] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:13:21.750980] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-21T19:13:21.885346] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T19:13:22.551083] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-21T19:13:23.336537] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:13:23.350977] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-21T19:13:23.428580] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T19:13:24.151046] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-21T19:13:24.764090] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:13:24.951033] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-21T19:13:25.230200] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T19:13:25.232900] [INFO ] [REMOTE ] HOV: Full fetch complete (18951 records). [2025-10-21T19:13:25.232991] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-21T19:13:25.650633] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-21T19:13:25.650768] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-21T19:13:25.651367] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-21T19:13:25.651439] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-21T19:13:25.652138] [DEBUG] [LOCAL ] HOV: Trimmed 18951 records to 13930 (keeping 200 days of data) [2025-10-21T19:13:25.736044] [DEBUG] [LOCAL ] HOV: Primary data saved (13930 records). [2025-10-21T19:13:25.736180] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-21T19:13:25.736269] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols completed. HOV took 19.6s. Estimated remaining: 2h 50m 20s. Rate: 7.8 symbols/min [2025-10-21T19:13:26.579484] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:13:26.590042] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-21T19:13:28.383465] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:13:28.392565] [INFO ] [REMOTE ] HOUS: Full fetch complete (64659 records). [2025-10-21T19:13:28.392776] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-21T19:13:28.808889] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-21T19:13:28.808976] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-21T19:13:28.809844] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-21T19:13:28.809907] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-21T19:13:28.812119] [DEBUG] [LOCAL ] HOUS: Trimmed 64659 records to 45708 (keeping 200 days of data) [2025-10-21T19:13:29.061194] [DEBUG] [LOCAL ] HOUS: Primary data saved (45708 records). [2025-10-21T19:13:29.061322] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-21T19:13:29.061402] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols completed. HOUS took 28.6s. Estimated remaining: 2h 50m 6s. Rate: 7.8 symbols/min [2025-10-21T19:13:29.616498] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:29.735603] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:29.726446] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:29.820678] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:29.834484] [DEBUG] [LOCAL ] HPI: Loaded 10790 existing records from primary storage. [2025-10-21T19:13:29.834902] [INFO ] [MAIN ] HPI: Loaded 10790 existing records. [2025-10-21T19:13:29.904437] [DEBUG] [LOCAL ] HPF: Loaded 7516 existing records from primary storage. [2025-10-21T19:13:29.958268] [INFO ] [MAIN ] HPF: Loaded 7516 existing records. [2025-10-21T19:13:30.166320] [DEBUG] [LOCAL ] HP: Loaded 51484 existing records from primary storage. [2025-10-21T19:13:30.246374] [INFO ] [MAIN ] HP: Loaded 51484 existing records. [2025-10-21T19:13:30.264419] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-21T19:13:30.231735] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:30.303435] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-21T19:13:30.317388] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-21T19:13:30.312026] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:30.334275] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-21T19:13:30.370389] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-21T19:13:30.409666] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-21T19:13:30.450371] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-21T19:13:30.531504] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-21T19:13:30.576010] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-21T19:13:30.606390] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-21T19:13:30.934144] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:30.951910] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-21T19:13:30.961171] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-21T19:13:30.955824] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:31.021394] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-21T19:13:31.029152] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-21T19:13:31.026700] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-21T19:13:31.058850] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-21T19:13:31.122414] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-21T19:13:31.161623] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-21T19:13:31.750338] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:31.832344] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-21T19:13:32.084152] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:32.154355] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-21T19:13:32.182279] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:32.199638] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-21T19:13:32.269245] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:32.269559] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-21T19:13:32.632556] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-21T19:13:32.635669] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-21T19:13:32.726157] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T19:13:32.728628] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-21T19:13:33.352309] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:13:33.355535] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-21T19:13:33.366751] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T19:13:33.370126] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-21T19:13:33.633687] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T19:13:33.644987] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-21T19:13:33.758212] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:13:33.771733] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-21T19:13:33.965679] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T19:13:34.080760] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T19:13:34.551034] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-21T19:13:35.051285] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T19:13:35.351065] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-21T19:13:35.380358] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:13:35.522125] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T19:13:36.138153] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:13:36.150978] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-21T19:13:36.870991] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T19:13:36.951063] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-21T19:13:37.751083] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-21T19:13:38.458997] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-21T19:13:38.558040] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-21T19:13:38.564344] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T19:13:39.318939] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T19:13:39.351055] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-21T19:13:40.151040] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-21T19:13:40.951011] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-21T19:13:40.973265] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T19:13:41.116375] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:13:41.677063] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T19:13:41.751051] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-21T19:13:42.551069] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-21T19:13:43.345732] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T19:13:43.350973] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-21T19:13:43.453171] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:13:44.151103] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-21T19:13:44.951090] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-21T19:13:45.099103] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T19:13:45.492335] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-21T19:13:45.704924] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T19:13:45.750981] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-21T19:13:46.520436] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:13:46.550984] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-21T19:13:47.351013] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-21T19:13:48.150996] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-21T19:13:48.319997] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T19:13:48.321812] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:13:48.334764] [INFO ] [REMOTE ] HPI: Full fetch complete (13867 records). [2025-10-21T19:13:48.335198] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-21T19:13:48.710998] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-21T19:13:48.711075] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-21T19:13:48.711383] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-21T19:13:48.711420] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-21T19:13:48.711899] [DEBUG] [LOCAL ] HPI: Trimmed 13867 records to 10779 (keeping 200 days of data) [2025-10-21T19:13:48.778854] [DEBUG] [LOCAL ] HPI: Primary data saved (10779 records). [2025-10-21T19:13:48.778978] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-21T19:13:48.779055] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols completed. HPI took 19.7s. Estimated remaining: 2h 50m 14s. Rate: 7.8 symbols/min [2025-10-21T19:13:48.930935] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T19:13:48.963315] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-21T19:13:48.967609] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:49.020058] [DEBUG] [LOCAL ] HPP: Loaded 51262 existing records from primary storage. [2025-10-21T19:13:49.020392] [INFO ] [MAIN ] HPP: Loaded 51262 existing records. [2025-10-21T19:13:49.197534] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:49.197757] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-21T19:13:49.197821] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-21T19:13:49.198038] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-21T19:13:49.198077] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-21T19:13:49.546150] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:49.749322] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T19:13:49.751152] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-21T19:13:49.751933] [INFO ] [REMOTE ] HPF: Full fetch complete (10564 records). [2025-10-21T19:13:49.752830] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-21T19:13:50.132613] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-21T19:13:50.132764] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-21T19:13:50.133163] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-21T19:13:50.133206] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-21T19:13:50.133735] [DEBUG] [LOCAL ] HPF: Trimmed 10564 records to 7532 (keeping 200 days of data) [2025-10-21T19:13:50.182266] [DEBUG] [LOCAL ] HPF: Primary data saved (7532 records). [2025-10-21T19:13:50.182449] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-21T19:13:50.182550] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols completed. HPF took 21.1s. Estimated remaining: 2h 49m 58s. Rate: 7.8 symbols/min [2025-10-21T19:13:50.355058] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:50.415118] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-21T19:13:50.415638] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-21T19:13:50.562006] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-21T19:13:50.613679] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:50.614144] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-21T19:13:50.614232] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-21T19:13:50.614505] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-21T19:13:50.614563] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-21T19:13:51.017093] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:13:51.360445] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-21T19:13:51.365826] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:13:52.150995] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-21T19:13:52.352306] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:13:52.951017] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-21T19:13:53.468930] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-21T19:13:53.669307] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T19:13:53.751021] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-21T19:13:54.469562] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:13:54.551004] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-21T19:13:55.354890] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-21T19:13:55.360214] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T19:13:56.151001] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-21T19:13:56.236090] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:13:56.951041] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-21T19:13:57.235216] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T19:13:57.751047] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-21T19:13:58.175920] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T19:13:58.319135] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T19:13:58.326719] [INFO ] [REMOTE ] HP: Full fetch complete (74039 records). [2025-10-21T19:13:58.326866] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-21T19:13:58.556240] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-21T19:13:58.726076] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-21T19:13:58.726152] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-21T19:13:58.727098] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-21T19:13:58.727162] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-21T19:13:58.728529] [DEBUG] [LOCAL ] HP: Trimmed 74039 records to 51425 (keeping 200 days of data) [2025-10-21T19:13:59.033915] [DEBUG] [LOCAL ] HP: Primary data saved (51425 records). [2025-10-21T19:13:59.034035] [INFO ] [MAIN ] HP: Full history saved. [2025-10-21T19:13:59.034111] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols completed. HP took 30.0s. Estimated remaining: 2h 49m 52s. Rate: 7.8 symbols/min [2025-10-21T19:13:59.220511] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:13:59.233316] [DEBUG] [LOCAL ] HPS: Loaded 10377 existing records from primary storage. [2025-10-21T19:13:59.233539] [INFO ] [MAIN ] HPS: Loaded 10377 existing records. [2025-10-21T19:13:59.356140] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-21T19:13:59.415270] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:13:59.415617] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-21T19:13:59.415716] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-21T19:13:59.416018] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-21T19:13:59.416086] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-21T19:13:59.670113] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T19:13:59.820506] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:00.151015] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-21T19:14:00.588222] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T19:14:00.685880] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T19:14:00.697589] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T19:14:00.951015] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-21T19:14:01.751089] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-21T19:14:02.551038] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-21T19:14:02.630492] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:14:03.351035] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-21T19:14:03.384015] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T19:14:03.834924] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-21T19:14:04.151042] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-21T19:14:04.951006] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-21T19:14:05.052370] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:14:05.751065] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-21T19:14:06.260563] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T19:14:06.368746] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:14:06.551020] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-21T19:14:07.347476] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T19:14:07.357704] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-21T19:14:08.151039] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-21T19:14:08.221106] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:14:08.951076] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-21T19:14:09.062233] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:14:09.455150] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T19:14:09.751048] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-21T19:14:10.551079] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-21T19:14:10.855974] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T19:14:11.038610] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T19:14:11.351025] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-21T19:14:12.151009] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-21T19:14:12.573438] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T19:14:12.927405] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T19:14:12.950980] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-21T19:14:13.401224] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T19:14:13.750999] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-21T19:14:13.770221] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T19:14:14.551085] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-21T19:14:15.285987] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:14:15.350988] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-21T19:14:15.927972] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T19:14:15.936374] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-21T19:14:15.936533] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-21T19:14:16.160430] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-21T19:14:16.344487] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-21T19:14:16.344563] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-21T19:14:16.345527] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-21T19:14:16.345588] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-21T19:14:16.346937] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-21T19:14:16.464363] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T19:14:16.692835] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-21T19:14:16.692962] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-21T19:14:16.693037] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols completed. HPE took 47.6s. Estimated remaining: 2h 49m 57s. Rate: 7.8 symbols/min [2025-10-21T19:14:16.859298] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:16.885934] [DEBUG] [LOCAL ] HQH: Loaded 25838 existing records from primary storage. [2025-10-21T19:14:16.886226] [INFO ] [MAIN ] HQH: Loaded 25838 existing records. [2025-10-21T19:14:16.959380] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-21T19:14:17.063179] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:17.063390] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-21T19:14:17.063452] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-21T19:14:17.063716] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-21T19:14:17.063773] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-21T19:14:17.417227] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:17.617369] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:14:17.751046] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-21T19:14:18.551030] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-21T19:14:18.854733] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T19:14:18.999862] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T19:14:19.351070] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-21T19:14:20.019867] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T19:14:20.027757] [INFO ] [REMOTE ] HPP: Full fetch complete (73367 records). [2025-10-21T19:14:20.027939] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-21T19:14:20.156152] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-21T19:14:20.415925] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-21T19:14:20.415999] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-21T19:14:20.416914] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-21T19:14:20.416978] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-21T19:14:20.418395] [DEBUG] [LOCAL ] HPP: Trimmed 73367 records to 51238 (keeping 200 days of data) [2025-10-21T19:14:20.694274] [DEBUG] [LOCAL ] HPP: Primary data saved (51238 records). [2025-10-21T19:14:20.694403] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-21T19:14:20.695139] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols completed. HPP took 31.9s. Estimated remaining: 2h 49m 45s. Rate: 7.8 symbols/min [2025-10-21T19:14:20.864145] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:20.887251] [DEBUG] [LOCAL ] HQL: Loaded 16958 existing records from primary storage. [2025-10-21T19:14:20.887525] [INFO ] [MAIN ] HQL: Loaded 16958 existing records. [2025-10-21T19:14:20.956151] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-21T19:14:21.073157] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:21.073417] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-21T19:14:21.073556] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-21T19:14:21.073827] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-21T19:14:21.073883] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-21T19:14:21.381619] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T19:14:21.502993] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:21.522888] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T19:14:21.751032] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-21T19:14:21.852172] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T19:14:22.550993] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-21T19:14:22.860049] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T19:14:23.031167] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T19:14:23.351037] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-21T19:14:24.150998] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-21T19:14:24.322890] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T19:14:24.951057] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-21T19:14:24.985960] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:14:24.988007] [INFO ] [REMOTE ] HPS: Full fetch complete (15110 records). [2025-10-21T19:14:24.988074] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-21T19:14:25.376295] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-21T19:14:25.376370] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-21T19:14:25.376718] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-21T19:14:25.376778] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-21T19:14:25.377241] [DEBUG] [LOCAL ] HPS: Trimmed 15110 records to 10360 (keeping 200 days of data) [2025-10-21T19:14:25.438474] [DEBUG] [LOCAL ] HPS: Primary data saved (10360 records). [2025-10-21T19:14:25.438589] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-21T19:14:25.438688] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols completed. HPS took 26.4s. Estimated remaining: 2h 49m 33s. Rate: 7.8 symbols/min [2025-10-21T19:14:25.606295] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:25.655629] [DEBUG] [LOCAL ] HR: Loaded 52115 existing records from primary storage. [2025-10-21T19:14:25.655969] [INFO ] [MAIN ] HR: Loaded 52115 existing records. [2025-10-21T19:14:25.754409] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-21T19:14:25.845630] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:25.846002] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-21T19:14:25.846203] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-21T19:14:25.846474] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-21T19:14:25.846543] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-21T19:14:26.064202] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T19:14:26.112318] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-21T19:14:26.123213] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-21T19:14:26.568754] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-21T19:14:26.774586] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:26.941820] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:14:26.989037] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-21T19:14:26.989138] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-21T19:14:26.990205] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-21T19:14:26.990280] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-21T19:14:26.991852] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-21T19:14:27.322852] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-21T19:14:27.323018] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-21T19:14:27.323482] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols completed. HPQ took 37.1s. Estimated remaining: 2h 49m 18s. Rate: 7.8 symbols/min [2025-10-21T19:14:27.356142] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-21T19:14:27.500621] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:27.547259] [DEBUG] [LOCAL ] HRB: Loaded 48355 existing records from primary storage. [2025-10-21T19:14:27.547570] [INFO ] [MAIN ] HRB: Loaded 48355 existing records. [2025-10-21T19:14:27.730925] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:14:27.772502] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:27.772740] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-21T19:14:27.772793] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-21T19:14:27.772977] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-21T19:14:27.773015] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-21T19:14:28.114006] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:28.150986] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-21T19:14:28.951040] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-21T19:14:29.131847] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:14:29.706095] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:14:29.751064] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-21T19:14:30.255460] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T19:14:30.551004] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-21T19:14:31.356214] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-21T19:14:31.374916] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T19:14:31.538861] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:14:32.151015] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-21T19:14:32.509454] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T19:14:32.951046] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-21T19:14:33.726197] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T19:14:33.751014] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-21T19:14:34.543031] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:14:34.552394] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-21T19:14:35.351010] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-21T19:14:35.462260] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:14:35.490157] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T19:14:36.151076] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-21T19:14:36.964018] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-21T19:14:36.970627] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:14:37.751012] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-21T19:14:37.827185] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:14:38.147485] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T19:14:38.483734] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T19:14:38.551009] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-21T19:14:39.351000] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-21T19:14:39.526275] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T19:14:40.151030] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-21T19:14:40.891433] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:14:40.950989] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-21T19:14:41.751008] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-21T19:14:41.856336] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:14:42.553030] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-21T19:14:42.558908] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T19:14:42.611818] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T19:14:43.351085] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-21T19:14:44.151009] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-21T19:14:44.294594] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T19:14:44.951067] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-21T19:14:45.105895] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:14:45.250121] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T19:14:45.751036] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-21T19:14:46.551031] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-21T19:14:46.666394] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T19:14:46.711206] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T19:14:47.351083] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-21T19:14:48.133293] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:14:48.150993] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-21T19:14:48.352427] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T19:14:48.951035] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-21T19:14:49.751052] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-21T19:14:49.887769] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:14:49.895000] [INFO ] [REMOTE ] HRB: Full fetch complete (69973 records). [2025-10-21T19:14:49.895130] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-21T19:14:50.059345] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T19:14:50.175496] [INFO ] [REMOTE ] HQL: Full fetch complete (25304 records). [2025-10-21T19:14:50.187028] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-21T19:14:50.485283] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-21T19:14:50.486165] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-21T19:14:50.488820] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-21T19:14:50.488906] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-21T19:14:50.560247] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-21T19:14:50.597998] [DEBUG] [LOCAL ] HRB: Trimmed 69973 records to 48267 (keeping 200 days of data) [2025-10-21T19:14:50.789420] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-21T19:14:50.790552] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-21T19:14:50.794379] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-21T19:14:50.795188] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-21T19:14:50.803965] [DEBUG] [LOCAL ] HQL: Trimmed 25304 records to 16952 (keeping 200 days of data) [2025-10-21T19:14:51.018703] [DEBUG] [LOCAL ] HQL: Primary data saved (16952 records). [2025-10-21T19:14:51.026696] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-21T19:14:51.026825] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols completed. HQL took 30.3s. Estimated remaining: 2h 49m 30s. Rate: 7.8 symbols/min [2025-10-21T19:14:51.238154] [DEBUG] [LOCAL ] HRB: Primary data saved (48267 records). [2025-10-21T19:14:51.250325] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-21T19:14:51.269171] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols completed. HRB took 23.9s. Estimated remaining: 2h 49m 13s. Rate: 7.8 symbols/min [2025-10-21T19:14:51.268751] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:51.454790] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:51.469466] [DEBUG] [LOCAL ] HRI: Loaded 32387 existing records from primary storage. [2025-10-21T19:14:51.469759] [INFO ] [MAIN ] HRI: Loaded 32387 existing records. [2025-10-21T19:14:51.680702] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:51.681220] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-21T19:14:51.681395] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-21T19:14:51.681727] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-21T19:14:51.681834] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-21T19:14:51.836800] [DEBUG] [LOCAL ] HRL: Loaded 53128 existing records from primary storage. [2025-10-21T19:14:51.844586] [INFO ] [MAIN ] HRL: Loaded 53128 existing records. [2025-10-21T19:14:51.857717] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T19:14:52.011982] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-21T19:14:52.020829] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:14:52.157367] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-21T19:14:52.239886] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:52.248003] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-21T19:14:52.251169] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-21T19:14:52.251539] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-21T19:14:52.251599] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-21T19:14:52.430999] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:52.678386] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:52.950979] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-21T19:14:53.520718] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T19:14:53.525231] [INFO ] [REMOTE ] HQH: Full fetch complete (37002 records). [2025-10-21T19:14:53.525304] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-21T19:14:53.755728] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-21T19:14:53.892446] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T19:14:53.939975] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-21T19:14:53.940157] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-21T19:14:53.940866] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-21T19:14:53.940974] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-21T19:14:53.942019] [DEBUG] [LOCAL ] HQH: Trimmed 37002 records to 25808 (keeping 200 days of data) [2025-10-21T19:14:54.094172] [DEBUG] [LOCAL ] HQH: Primary data saved (25808 records). [2025-10-21T19:14:54.094296] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-21T19:14:54.094390] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols completed. HQH took 37.4s. Estimated remaining: 2h 48m 60s. Rate: 7.8 symbols/min [2025-10-21T19:14:54.264292] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:54.297990] [DEBUG] [LOCAL ] HRTG: Loaded 34587 existing records from primary storage. [2025-10-21T19:14:54.298243] [INFO ] [MAIN ] HRTG: Loaded 34587 existing records. [2025-10-21T19:14:54.479098] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:54.479302] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-21T19:14:54.479349] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-21T19:14:54.479529] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-21T19:14:54.479566] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-21T19:14:54.559268] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-21T19:14:54.846198] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:14:54.874112] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T19:14:54.997831] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T19:14:55.351048] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-21T19:14:56.151087] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-21T19:14:56.279365] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T19:14:56.951020] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-21T19:14:57.032173] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:14:57.213898] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:14:57.751006] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-21T19:14:58.474262] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T19:14:58.483093] [INFO ] [REMOTE ] HR: Full fetch complete (75069 records). [2025-10-21T19:14:58.483274] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-21T19:14:58.556216] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-21T19:14:58.908315] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-21T19:14:58.908426] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-21T19:14:58.909883] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-21T19:14:58.909954] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-21T19:14:58.911883] [DEBUG] [LOCAL ] HR: Trimmed 75069 records to 52114 (keeping 200 days of data) [2025-10-21T19:14:59.161270] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T19:14:59.285450] [DEBUG] [LOCAL ] HR: Primary data saved (52114 records). [2025-10-21T19:14:59.285701] [INFO ] [MAIN ] HR: Full history saved. [2025-10-21T19:14:59.285823] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols completed. HR took 33.8s. Estimated remaining: 2h 48m 49s. Rate: 7.8 symbols/min [2025-10-21T19:14:59.356220] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-21T19:14:59.473325] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:14:59.524870] [DEBUG] [LOCAL ] HSBC: Loaded 50998 existing records from primary storage. [2025-10-21T19:14:59.525300] [INFO ] [MAIN ] HSBC: Loaded 50998 existing records. [2025-10-21T19:14:59.720521] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:14:59.721130] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-21T19:14:59.721200] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-21T19:14:59.721627] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-21T19:14:59.721738] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-21T19:15:00.105889] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:00.150978] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-21T19:15:00.407618] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:15:00.951016] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-21T19:15:01.012511] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T19:15:01.751060] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-21T19:15:01.963442] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T19:15:02.383627] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T19:15:02.551003] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-21T19:15:03.081682] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T19:15:03.350991] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-21T19:15:03.746103] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T19:15:04.151029] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-21T19:15:04.951011] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-21T19:15:05.050397] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:15:05.751176] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-21T19:15:06.102126] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-21T19:15:06.512740] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:15:06.551068] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-21T19:15:07.351011] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-21T19:15:07.535885] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:15:08.006052] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T19:15:08.151006] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-21T19:15:08.549401] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T19:15:08.951036] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-21T19:15:09.561948] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T19:15:09.751071] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-21T19:15:10.551020] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-21T19:15:11.066933] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-21T19:15:11.351003] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-21T19:15:11.430170] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:15:11.972629] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:15:12.151037] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-21T19:15:12.951072] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-21T19:15:13.505865] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T19:15:13.534852] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:15:13.750991] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-21T19:15:13.888366] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:15:14.551030] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-21T19:15:15.254758] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T19:15:15.351029] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-21T19:15:16.130320] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T19:15:16.150982] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-21T19:15:16.745465] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T19:15:16.951036] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-21T19:15:17.731257] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:15:17.751034] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-21T19:15:18.551013] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-21T19:15:18.904508] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:15:19.351107] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-21T19:15:19.761802] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T19:15:19.800474] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T19:15:19.806671] [INFO ] [REMOTE ] HRTG: Full fetch complete (44342 records). [2025-10-21T19:15:19.806850] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-21T19:15:20.156204] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-21T19:15:20.375798] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-21T19:15:20.375990] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-21T19:15:20.376821] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-21T19:15:20.376883] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-21T19:15:20.378057] [DEBUG] [LOCAL ] HRTG: Trimmed 44342 records to 34543 (keeping 200 days of data) [2025-10-21T19:15:20.582521] [DEBUG] [LOCAL ] HRTG: Primary data saved (34543 records). [2025-10-21T19:15:20.582671] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-21T19:15:20.583466] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols completed. HRTG took 26.5s. Estimated remaining: 2h 48m 58s. Rate: 7.8 symbols/min [2025-10-21T19:15:20.760766] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:20.783320] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T19:15:20.803552] [DEBUG] [LOCAL ] HSHP: Loaded 14817 existing records from primary storage. [2025-10-21T19:15:20.803795] [INFO ] [MAIN ] HSHP: Loaded 14817 existing records. [2025-10-21T19:15:20.951534] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-21T19:15:20.988407] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:20.988739] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-21T19:15:20.988793] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-21T19:15:20.988966] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-21T19:15:20.989021] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-21T19:15:21.342873] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:21.751038] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-21T19:15:21.961587] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:15:21.969781] [INFO ] [REMOTE ] HRL: Full fetch complete (77024 records). [2025-10-21T19:15:21.969895] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-21T19:15:22.367106] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-21T19:15:22.367189] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-21T19:15:22.368194] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-21T19:15:22.368256] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-21T19:15:22.369683] [DEBUG] [LOCAL ] HRL: Trimmed 77024 records to 53126 (keeping 200 days of data) [2025-10-21T19:15:22.552702] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-21T19:15:22.694399] [DEBUG] [LOCAL ] HRL: Primary data saved (53126 records). [2025-10-21T19:15:22.694547] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-21T19:15:22.694676] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols completed. HRL took 31.4s. Estimated remaining: 2h 48m 43s. Rate: 7.8 symbols/min [2025-10-21T19:15:22.863816] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:22.912862] [DEBUG] [LOCAL ] HSY: Loaded 50468 existing records from primary storage. [2025-10-21T19:15:22.913209] [INFO ] [MAIN ] HSY: Loaded 50468 existing records. [2025-10-21T19:15:23.096527] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:23.097137] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-21T19:15:23.113612] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-21T19:15:23.126581] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-21T19:15:23.126741] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-21T19:15:23.137344] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-21T19:15:23.258900] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:15:23.356243] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-21T19:15:23.524940] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:23.621787] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T19:15:24.151015] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-21T19:15:24.950996] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-21T19:15:25.213415] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:15:25.751013] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-21T19:15:25.953561] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T19:15:26.075866] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T19:15:26.551035] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-21T19:15:27.351010] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-21T19:15:27.531919] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:15:27.586284] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T19:15:28.151040] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-21T19:15:28.951024] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-21T19:15:29.173554] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T19:15:29.751028] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-21T19:15:30.050889] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:15:30.071218] [INFO ] [REMOTE ] HSBC: Full fetch complete (74158 records). [2025-10-21T19:15:30.072259] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T19:15:30.071887] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-21T19:15:30.458063] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-21T19:15:30.458140] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-21T19:15:30.459098] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-21T19:15:30.459163] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-21T19:15:30.460563] [DEBUG] [LOCAL ] HSBC: Trimmed 74158 records to 50992 (keeping 200 days of data) [2025-10-21T19:15:30.559795] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-21T19:15:30.765818] [DEBUG] [LOCAL ] HSBC: Primary data saved (50992 records). [2025-10-21T19:15:30.765926] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-21T19:15:30.766002] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols completed. HSBC took 31.5s. Estimated remaining: 2h 48m 36s. Rate: 7.8 symbols/min [2025-10-21T19:15:30.935513] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:30.935631] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-21T19:15:30.935707] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-21T19:15:30.935842] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-21T19:15:30.935909] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-21T19:15:30.935964] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-21T19:15:30.936000] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-21T19:15:31.292622] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:31.350981] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-21T19:15:31.604077] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:15:31.954049] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:15:31.954581] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-21T19:15:31.954714] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:15:31.954773] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-21T19:15:31.954833] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:15:31.954910] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-21T19:15:31.954987] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-21T19:15:31.955025] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-21T19:15:31.955064] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-21T19:15:31.955118] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols completed. HTB took 1.2s. Estimated remaining: 2h 48m 20s. Rate: 7.8 symbols/min [2025-10-21T19:15:32.098727] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T19:15:32.160458] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-21T19:15:32.164430] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:32.181896] [DEBUG] [LOCAL ] HTD: Loaded 14305 existing records from primary storage. [2025-10-21T19:15:32.182153] [INFO ] [MAIN ] HTD: Loaded 14305 existing records. [2025-10-21T19:15:32.366678] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:32.366899] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-21T19:15:32.366947] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-21T19:15:32.367109] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-21T19:15:32.367148] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-21T19:15:32.738949] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:32.951071] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-21T19:15:33.095030] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T19:15:33.751013] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-21T19:15:33.761920] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T19:15:34.551042] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-21T19:15:34.722902] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T19:15:35.324769] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T19:15:35.350999] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-21T19:15:36.151045] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-21T19:15:36.449396] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:15:36.950987] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-21T19:15:37.445942] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T19:15:37.751036] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-21T19:15:38.551079] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-21T19:15:38.611968] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T19:15:38.759850] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:15:39.351026] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-21T19:15:39.455416] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T19:15:40.151101] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-21T19:15:40.727305] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:15:40.732256] [INFO ] [REMOTE ] HRI: Full fetch complete (46667 records). [2025-10-21T19:15:40.732394] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-21T19:15:40.956167] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-21T19:15:41.115679] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-21T19:15:41.115785] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-21T19:15:41.116633] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-21T19:15:41.116734] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-21T19:15:41.117945] [DEBUG] [LOCAL ] HRI: Trimmed 46667 records to 32283 (keeping 200 days of data) [2025-10-21T19:15:41.318554] [DEBUG] [LOCAL ] HRI: Primary data saved (32283 records). [2025-10-21T19:15:41.318707] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-21T19:15:41.318794] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols completed. HRI took 50.3s. Estimated remaining: 2h 48m 15s. Rate: 7.8 symbols/min [2025-10-21T19:15:41.490589] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:41.490791] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-21T19:15:41.490839] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-21T19:15:41.490967] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-21T19:15:41.491015] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-21T19:15:41.491062] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-21T19:15:41.491099] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-21T19:15:41.766339] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-21T19:15:41.845850] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:42.040908] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T19:15:42.087536] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T19:15:42.297325] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T19:15:42.551059] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-21T19:15:43.351012] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-21T19:15:43.469691] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T19:15:43.622541] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-21T19:15:44.151042] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-21T19:15:44.471988] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-21T19:15:44.951084] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-21T19:15:45.751033] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-21T19:15:46.065264] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-21T19:15:46.551000] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-21T19:15:46.758193] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:15:46.833528] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-21T19:15:47.351010] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-21T19:15:47.680228] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-21T19:15:48.151014] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-21T19:15:48.950996] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-21T19:15:49.137361] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:15:49.139915] [INFO ] [REMOTE ] HSHP: Full fetch complete (23151 records). [2025-10-21T19:15:49.139997] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-21T19:15:49.509679] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-21T19:15:49.509762] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-21T19:15:49.510277] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-21T19:15:49.510323] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-21T19:15:49.511102] [DEBUG] [LOCAL ] HSHP: Trimmed 23151 records to 14708 (keeping 200 days of data) [2025-10-21T19:15:49.599070] [DEBUG] [LOCAL ] HSHP: Primary data saved (14708 records). [2025-10-21T19:15:49.599200] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-21T19:15:49.599274] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols completed. HSHP took 29.0s. Estimated remaining: 2h 48m 8s. Rate: 7.8 symbols/min [2025-10-21T19:15:49.773172] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:49.769714] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-21T19:15:49.818639] [DEBUG] [LOCAL ] HTGC: Loaded 47761 existing records from primary storage. [2025-10-21T19:15:49.818963] [INFO ] [MAIN ] HTGC: Loaded 47761 existing records. [2025-10-21T19:15:49.994943] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:49.995132] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-21T19:15:49.995178] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-21T19:15:49.995355] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-21T19:15:49.995393] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-21T19:15:50.157147] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-21T19:15:50.351835] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:50.550993] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-21T19:15:50.883810] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-21T19:15:50.913046] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T19:15:51.351019] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-21T19:15:52.151024] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-21T19:15:52.950996] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-21T19:15:52.999889] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T19:15:53.056886] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T19:15:53.187686] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-21T19:15:53.751029] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-21T19:15:54.551072] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-21T19:15:55.096789] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T19:15:55.351072] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-21T19:15:55.919332] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T19:15:55.972923] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T19:15:56.151043] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-21T19:15:56.951036] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-21T19:15:57.751028] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-21T19:15:57.793898] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:15:58.071720] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T19:15:58.075296] [INFO ] [REMOTE ] HTD: Full fetch complete (19670 records). [2025-10-21T19:15:58.075382] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-21T19:15:58.160615] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-21T19:15:58.525754] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-21T19:15:58.525851] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-21T19:15:58.526393] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-21T19:15:58.526435] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-21T19:15:58.527177] [DEBUG] [LOCAL ] HTD: Trimmed 19670 records to 14308 (keeping 200 days of data) [2025-10-21T19:15:58.564728] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-21T19:15:58.618302] [DEBUG] [LOCAL ] HTD: Primary data saved (14308 records). [2025-10-21T19:15:58.618438] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-21T19:15:58.618516] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols completed. HTD took 26.7s. Estimated remaining: 2h 48m 1s. Rate: 7.8 symbols/min [2025-10-21T19:15:58.784470] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:58.815330] [DEBUG] [LOCAL ] HTH: Loaded 32664 existing records from primary storage. [2025-10-21T19:15:58.815604] [INFO ] [MAIN ] HTH: Loaded 32664 existing records. [2025-10-21T19:15:58.998445] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:58.999079] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-21T19:15:59.000091] [INFO ] [REMOTE ] HTFC: Full fetch complete (826 records). [2025-10-21T19:15:59.000216] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-21T19:15:59.000334] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-21T19:15:59.000380] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-21T19:15:59.006171] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-21T19:15:59.038794] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-21T19:15:59.364483] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-21T19:15:59.388432] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-21T19:15:59.447034] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:15:59.478244] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:15:59.481119] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-21T19:15:59.487003] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-21T19:15:59.497379] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-21T19:15:59.502636] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-21T19:15:59.521300] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols completed. HTFC took 18.2s. Estimated remaining: 2h 47m 45s. Rate: 7.8 symbols/min [2025-10-21T19:15:59.605831] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:15:59.731443] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:15:59.768744] [DEBUG] [LOCAL ] HUBB: Loaded 36261 existing records from primary storage. [2025-10-21T19:15:59.769001] [INFO ] [MAIN ] HUBB: Loaded 36261 existing records. [2025-10-21T19:15:59.944262] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:15:59.944482] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-21T19:15:59.944528] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-21T19:15:59.944762] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-21T19:15:59.944817] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-21T19:16:00.156135] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-21T19:16:00.306708] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:00.951004] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-21T19:16:01.597817] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-21T19:16:01.751089] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-21T19:16:02.407621] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T19:16:02.501117] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T19:16:02.550995] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-21T19:16:03.351034] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-21T19:16:03.582128] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T19:16:04.151005] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-21T19:16:04.360238] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T19:16:04.935057] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:16:04.950987] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-21T19:16:04.996331] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T19:16:05.004032] [INFO ] [REMOTE ] HSY: Full fetch complete (73654 records). [2025-10-21T19:16:05.004141] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-21T19:16:05.388979] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-21T19:16:05.389074] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-21T19:16:05.390014] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-21T19:16:05.390076] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-21T19:16:05.391445] [DEBUG] [LOCAL ] HSY: Trimmed 73654 records to 50427 (keeping 200 days of data) [2025-10-21T19:16:05.696581] [DEBUG] [LOCAL ] HSY: Primary data saved (50427 records). [2025-10-21T19:16:05.696748] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-21T19:16:05.696834] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols completed. HSY took 43.0s. Estimated remaining: 2h 47m 36s. Rate: 7.8 symbols/min [2025-10-21T19:16:05.760602] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-21T19:16:05.869887] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:05.905365] [DEBUG] [LOCAL ] HUBS: Loaded 40086 existing records from primary storage. [2025-10-21T19:16:05.905633] [INFO ] [MAIN ] HUBS: Loaded 40086 existing records. [2025-10-21T19:16:06.081469] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:06.081702] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-21T19:16:06.081766] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-21T19:16:06.082128] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-21T19:16:06.082184] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-21T19:16:06.407591] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T19:16:06.467464] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:06.550983] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-21T19:16:07.263044] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T19:16:07.351019] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-21T19:16:08.018040] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T19:16:08.151041] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-21T19:16:08.793047] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:16:08.951060] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-21T19:16:09.592125] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:16:09.751054] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-21T19:16:10.206134] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T19:16:10.551023] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-21T19:16:11.351006] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-21T19:16:11.528131] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:16:11.848017] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T19:16:12.151068] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-21T19:16:12.797384] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T19:16:12.951027] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-21T19:16:13.530994] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:16:13.751032] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-21T19:16:14.319090] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T19:16:14.551036] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-21T19:16:15.024447] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T19:16:15.351035] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-21T19:16:16.071693] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T19:16:16.151018] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-21T19:16:16.951040] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-21T19:16:17.183882] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T19:16:17.621004] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T19:16:17.751060] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-21T19:16:18.430067] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T19:16:18.551057] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-21T19:16:19.351087] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-21T19:16:19.450688] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:16:20.083631] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:16:20.151056] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-21T19:16:20.807754] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T19:16:20.951045] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-21T19:16:21.757162] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-21T19:16:21.764772] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:16:22.551006] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-21T19:16:22.605283] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:16:23.133949] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T19:16:23.351062] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-21T19:16:24.016825] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:16:24.151089] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-21T19:16:24.753334] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:16:24.951036] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-21T19:16:25.742894] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:16:25.751097] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-21T19:16:26.351785] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T19:16:26.357011] [INFO ] [REMOTE ] HUBB: Full fetch complete (54238 records). [2025-10-21T19:16:26.357101] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-21T19:16:26.558128] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-21T19:16:26.763835] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-21T19:16:26.763921] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-21T19:16:26.764721] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-21T19:16:26.764785] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-21T19:16:26.765940] [DEBUG] [LOCAL ] HUBB: Trimmed 54238 records to 36142 (keeping 200 days of data) [2025-10-21T19:16:27.001293] [DEBUG] [LOCAL ] HUBB: Primary data saved (36142 records). [2025-10-21T19:16:27.001562] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-21T19:16:27.001704] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols completed. HUBB took 27.5s. Estimated remaining: 2h 47m 45s. Rate: 7.8 symbols/min [2025-10-21T19:16:27.193118] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:27.210427] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:16:27.264500] [DEBUG] [LOCAL ] HUM: Loaded 49347 existing records from primary storage. [2025-10-21T19:16:27.264881] [INFO ] [MAIN ] HUM: Loaded 49347 existing records. [2025-10-21T19:16:27.360162] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-21T19:16:27.443171] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:27.443385] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-21T19:16:27.443465] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-21T19:16:27.443759] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-21T19:16:27.443836] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-21T19:16:27.794132] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:28.150992] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-21T19:16:28.239335] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:16:28.951062] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-21T19:16:29.256592] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:16:29.264522] [INFO ] [REMOTE ] HTGC: Full fetch complete (68865 records). [2025-10-21T19:16:29.264629] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-21T19:16:29.461605] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T19:16:29.677569] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-21T19:16:29.677677] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-21T19:16:29.678631] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-21T19:16:29.678724] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-21T19:16:29.680144] [DEBUG] [LOCAL ] HTGC: Trimmed 68865 records to 47716 (keeping 200 days of data) [2025-10-21T19:16:29.766509] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-21T19:16:29.968803] [DEBUG] [LOCAL ] HTGC: Primary data saved (47716 records). [2025-10-21T19:16:29.968949] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-21T19:16:29.969864] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols completed. HTGC took 40.4s. Estimated remaining: 2h 47m 31s. Rate: 7.8 symbols/min [2025-10-21T19:16:30.192246] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:30.256959] [DEBUG] [LOCAL ] HUN: Loaded 53219 existing records from primary storage. [2025-10-21T19:16:30.257617] [INFO ] [MAIN ] HUN: Loaded 53219 existing records. [2025-10-21T19:16:30.476527] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:30.476907] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-21T19:16:30.477027] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-21T19:16:30.477501] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-21T19:16:30.477577] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-21T19:16:30.581842] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-21T19:16:30.642883] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T19:16:31.028830] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:31.075545] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:16:31.082992] [INFO ] [REMOTE ] HTH: Full fetch complete (46818 records). [2025-10-21T19:16:31.083209] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-21T19:16:31.356198] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-21T19:16:31.571350] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-21T19:16:31.571438] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-21T19:16:31.572273] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-21T19:16:31.572342] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-21T19:16:31.573483] [DEBUG] [LOCAL ] HTH: Trimmed 46818 records to 32547 (keeping 200 days of data) [2025-10-21T19:16:31.808798] [DEBUG] [LOCAL ] HTH: Primary data saved (32547 records). [2025-10-21T19:16:31.808957] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-21T19:16:31.809048] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols completed. HTH took 33.2s. Estimated remaining: 2h 47m 16s. Rate: 7.8 symbols/min [2025-10-21T19:16:31.978484] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:32.016282] [DEBUG] [LOCAL ] HUYA: Loaded 43607 existing records from primary storage. [2025-10-21T19:16:32.016587] [INFO ] [MAIN ] HUYA: Loaded 43607 existing records. [2025-10-21T19:16:32.159229] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-21T19:16:32.202122] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:32.203297] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-21T19:16:32.203406] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-21T19:16:32.203816] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-21T19:16:32.204088] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-21T19:16:32.459672] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:16:32.604415] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:32.951013] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-21T19:16:33.073188] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:16:33.751083] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-21T19:16:34.006851] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T19:16:34.551006] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-21T19:16:34.848062] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:16:34.855191] [INFO ] [REMOTE ] HUBS: Full fetch complete (57089 records). [2025-10-21T19:16:34.855328] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-21T19:16:35.234749] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-21T19:16:35.234829] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-21T19:16:35.235614] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-21T19:16:35.235683] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-21T19:16:35.236815] [DEBUG] [LOCAL ] HUBS: Trimmed 57089 records to 40052 (keeping 200 days of data) [2025-10-21T19:16:35.351068] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-21T19:16:35.491297] [DEBUG] [LOCAL ] HUBS: Primary data saved (40052 records). [2025-10-21T19:16:35.504178] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-21T19:16:35.507712] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols completed. HUBS took 29.8s. Estimated remaining: 2h 47m 4s. Rate: 7.8 symbols/min [2025-10-21T19:16:35.554940] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:16:35.695172] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:35.713385] [DEBUG] [LOCAL ] HVT: Loaded 14991 existing records from primary storage. [2025-10-21T19:16:35.713676] [INFO ] [MAIN ] HVT: Loaded 14991 existing records. [2025-10-21T19:16:35.899334] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:35.899676] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-21T19:16:35.899737] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-21T19:16:35.899926] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-21T19:16:35.899983] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-21T19:16:36.151159] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-21T19:16:36.280983] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:36.298029] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T19:16:36.950995] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-21T19:16:37.137153] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:16:37.751078] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-21T19:16:38.087734] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T19:16:38.507773] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:16:38.551000] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-21T19:16:39.351010] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-21T19:16:39.731891] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T19:16:40.151021] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-21T19:16:40.234443] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:16:40.255877] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T19:16:40.951025] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-21T19:16:41.751013] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-21T19:16:41.871590] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:16:41.979440] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T19:16:42.551009] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-21T19:16:43.351024] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-21T19:16:43.587744] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T19:16:44.122132] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T19:16:44.150987] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-21T19:16:44.289885] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:16:44.951089] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-21T19:16:45.223996] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:16:45.751121] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-21T19:16:46.442839] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:16:46.550995] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-21T19:16:47.351011] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-21T19:16:47.604765] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T19:16:48.004238] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:16:48.151044] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-21T19:16:48.891665] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:16:48.950984] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-21T19:16:49.433921] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:16:49.751072] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-21T19:16:50.551029] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-21T19:16:50.959324] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T19:16:51.293696] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:16:51.350983] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-21T19:16:51.871671] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T19:16:52.151074] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-21T19:16:52.951080] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-21T19:16:53.192951] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:16:53.751026] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-21T19:16:53.859848] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:16:54.100527] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T19:16:54.551082] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-21T19:16:55.350997] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-21T19:16:55.442549] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:16:56.150979] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-21T19:16:56.224383] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T19:16:56.951058] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-21T19:16:57.004538] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:16:57.011791] [INFO ] [REMOTE ] HUYA: Full fetch complete (63949 records). [2025-10-21T19:16:57.011906] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-21T19:16:57.193134] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T19:16:57.433391] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-21T19:16:57.433483] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-21T19:16:57.434435] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-21T19:16:57.434500] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-21T19:16:57.435973] [DEBUG] [LOCAL ] HUYA: Trimmed 63949 records to 43629 (keeping 200 days of data) [2025-10-21T19:16:57.695393] [DEBUG] [LOCAL ] HUYA: Primary data saved (43629 records). [2025-10-21T19:16:57.695537] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-21T19:16:57.695619] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols completed. HUYA took 25.9s. Estimated remaining: 2h 47m 14s. Rate: 7.8 symbols/min [2025-10-21T19:16:57.761566] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-21T19:16:57.875144] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:16:57.929349] [DEBUG] [LOCAL ] HWM: Loaded 52717 existing records from primary storage. [2025-10-21T19:16:57.929672] [INFO ] [MAIN ] HWM: Loaded 52717 existing records. [2025-10-21T19:16:58.116908] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:16:58.117101] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-21T19:16:58.117148] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-21T19:16:58.117350] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-21T19:16:58.117406] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-21T19:16:58.495457] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:16:58.550997] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-21T19:16:58.719025] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-21T19:16:58.763321] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T19:16:59.351073] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-21T19:17:00.151046] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-21T19:17:00.277203] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T19:17:00.526757] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T19:17:00.534491] [INFO ] [REMOTE ] HUM: Full fetch complete (71171 records). [2025-10-21T19:17:00.534608] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-21T19:17:00.926475] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-21T19:17:00.926578] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-21T19:17:00.927492] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-21T19:17:00.927556] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-21T19:17:00.928984] [DEBUG] [LOCAL ] HUM: Trimmed 71171 records to 49322 (keeping 200 days of data) [2025-10-21T19:17:00.983516] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-21T19:17:01.240213] [DEBUG] [LOCAL ] HUM: Primary data saved (49322 records). [2025-10-21T19:17:01.240393] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-21T19:17:01.241321] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols completed. HUM took 34.2s. Estimated remaining: 2h 47m 1s. Rate: 7.8 symbols/min [2025-10-21T19:17:01.412091] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:01.457446] [DEBUG] [LOCAL ] HXL: Loaded 45814 existing records from primary storage. [2025-10-21T19:17:01.457761] [INFO ] [MAIN ] HXL: Loaded 45814 existing records. [2025-10-21T19:17:01.642604] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:01.642827] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-21T19:17:01.642873] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-21T19:17:01.643099] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-21T19:17:01.643156] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-21T19:17:01.753610] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-21T19:17:02.005674] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T19:17:02.040551] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:02.079299] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T19:17:02.551025] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-21T19:17:03.351063] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-21T19:17:03.445750] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T19:17:03.709663] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T19:17:03.718266] [INFO ] [REMOTE ] HUN: Full fetch complete (76986 records). [2025-10-21T19:17:03.718445] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-21T19:17:04.123041] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-21T19:17:04.123150] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-21T19:17:04.124126] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-21T19:17:04.124189] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-21T19:17:04.125552] [DEBUG] [LOCAL ] HUN: Trimmed 76986 records to 53211 (keeping 200 days of data) [2025-10-21T19:17:04.181617] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-21T19:17:04.468291] [DEBUG] [LOCAL ] HUN: Primary data saved (53211 records). [2025-10-21T19:17:04.468428] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-21T19:17:04.469164] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols completed. HUN took 34.5s. Estimated remaining: 2h 46m 48s. Rate: 7.8 symbols/min [2025-10-21T19:17:04.675505] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:04.687908] [DEBUG] [LOCAL ] HY: Loaded 10046 existing records from primary storage. [2025-10-21T19:17:04.688200] [INFO ] [MAIN ] HY: Loaded 10046 existing records. [2025-10-21T19:17:04.877129] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:04.877501] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-21T19:17:04.877736] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-21T19:17:04.878047] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-21T19:17:04.878114] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-21T19:17:04.957281] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-21T19:17:05.109981] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:17:05.218764] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T19:17:05.229445] [INFO ] [REMOTE ] HVT: Full fetch complete (23043 records). [2025-10-21T19:17:05.239778] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-21T19:17:05.399765] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:05.689192] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-21T19:17:05.689266] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-21T19:17:05.689765] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-21T19:17:05.689824] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-21T19:17:05.690398] [DEBUG] [LOCAL ] HVT: Trimmed 23043 records to 14899 (keeping 200 days of data) [2025-10-21T19:17:05.756734] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-21T19:17:05.785314] [DEBUG] [LOCAL ] HVT: Primary data saved (14899 records). [2025-10-21T19:17:05.785417] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-21T19:17:05.785502] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols completed. HVT took 30.3s. Estimated remaining: 2h 46m 32s. Rate: 7.8 symbols/min [2025-10-21T19:17:05.959979] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:05.960221] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-21T19:17:05.960271] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-21T19:17:05.960379] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-21T19:17:05.960428] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-21T19:17:05.960468] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-21T19:17:05.960500] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-21T19:17:06.318979] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:06.551053] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-21T19:17:06.697131] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:17:06.828032] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T19:17:07.351043] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-21T19:17:07.872942] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T19:17:08.151020] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-21T19:17:08.951004] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-21T19:17:09.052993] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:17:09.215288] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-21T19:17:09.751002] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-21T19:17:09.862152] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T19:17:10.551028] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-21T19:17:11.322451] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T19:17:11.351063] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-21T19:17:11.694264] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T19:17:12.151042] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-21T19:17:12.259059] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:17:12.471093] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-21T19:17:12.951023] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-21T19:17:13.751027] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-21T19:17:13.864585] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T19:17:14.551032] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-21T19:17:14.780285] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-21T19:17:15.350997] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-21T19:17:15.703204] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-21T19:17:15.705773] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T19:17:16.151073] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-21T19:17:16.951036] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-21T19:17:17.735616] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:17:17.751011] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-21T19:17:18.068824] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T19:17:18.493223] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T19:17:18.551030] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-21T19:17:19.348401] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:17:19.350975] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-21T19:17:20.151004] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-21T19:17:20.306902] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T19:17:20.951019] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-21T19:17:21.291794] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-21T19:17:21.751003] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-21T19:17:21.943333] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:17:22.102340] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T19:17:22.551040] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-21T19:17:23.351041] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-21T19:17:24.151083] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-21T19:17:24.162586] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T19:17:24.210989] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:17:24.580858] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T19:17:24.951125] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-21T19:17:25.751080] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-21T19:17:26.496332] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T19:17:26.551067] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-21T19:17:27.351054] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-21T19:17:27.911772] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T19:17:27.931943] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T19:17:27.934769] [INFO ] [REMOTE ] HY: Full fetch complete (14937 records). [2025-10-21T19:17:27.934857] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-21T19:17:28.158588] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-21T19:17:28.354923] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-21T19:17:28.355044] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-21T19:17:28.355603] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-21T19:17:28.356340] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-21T19:17:28.357522] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T19:17:28.368431] [DEBUG] [LOCAL ] HY: Trimmed 14937 records to 9945 (keeping 200 days of data) [2025-10-21T19:17:28.436518] [DEBUG] [LOCAL ] HY: Primary data saved (9945 records). [2025-10-21T19:17:28.436773] [INFO ] [MAIN ] HY: Full history saved. [2025-10-21T19:17:28.436898] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols completed. HY took 24.0s. Estimated remaining: 2h 46m 43s. Rate: 7.8 symbols/min [2025-10-21T19:17:28.612163] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:28.612420] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-21T19:17:28.612458] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-21T19:17:28.612583] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-21T19:17:28.612625] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-21T19:17:28.612709] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-21T19:17:28.612752] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-21T19:17:28.956257] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-21T19:17:29.074629] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:29.322796] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-21T19:17:29.751003] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-21T19:17:30.091513] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-21T19:17:30.094036] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T19:17:30.551095] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-21T19:17:31.351031] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-21T19:17:31.578140] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-21T19:17:32.070834] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:17:32.150996] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-21T19:17:32.380445] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-21T19:17:32.951031] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-21T19:17:33.751031] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-21T19:17:34.185245] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T19:17:34.551028] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-21T19:17:35.351034] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-21T19:17:35.533150] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:17:35.766796] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-21T19:17:35.767589] [INFO ] [REMOTE ] HYAC: Full fetch complete (921 records). [2025-10-21T19:17:35.767678] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-21T19:17:35.942374] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-10-21T19:17:35.942568] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:17:35.942635] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:17:35.942730] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-21T19:17:35.942791] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-21T19:17:35.942827] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-21T19:17:35.942865] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-21T19:17:35.942917] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols completed. HYAC took 30.2s. Estimated remaining: 2h 46m 35s. Rate: 7.8 symbols/min [2025-10-21T19:17:36.108835] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:36.119839] [DEBUG] [LOCAL ] HYI: Loaded 9771 existing records from primary storage. [2025-10-21T19:17:36.120038] [INFO ] [MAIN ] HYI: Loaded 9771 existing records. [2025-10-21T19:17:36.156105] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-21T19:17:36.302201] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:36.302443] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-21T19:17:36.302517] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-21T19:17:36.302831] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-21T19:17:36.302885] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-21T19:17:36.606223] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-21T19:17:36.634924] [INFO ] [REMOTE ] HXL: Full fetch complete (66625 records). [2025-10-21T19:17:36.665058] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-21T19:17:36.728552] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:36.956188] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-21T19:17:37.088792] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-21T19:17:37.088875] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-21T19:17:37.089867] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-21T19:17:37.089929] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-21T19:17:37.091246] [DEBUG] [LOCAL ] HXL: Trimmed 66625 records to 45797 (keeping 200 days of data) [2025-10-21T19:17:37.358592] [DEBUG] [LOCAL ] HXL: Primary data saved (45797 records). [2025-10-21T19:17:37.358739] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-21T19:17:37.358823] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols completed. HXL took 36.1s. Estimated remaining: 2h 46m 19s. Rate: 7.8 symbols/min [2025-10-21T19:17:37.526396] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:37.558282] [DEBUG] [LOCAL ] HYT: Loaded 33697 existing records from primary storage. [2025-10-21T19:17:37.558549] [INFO ] [MAIN ] HYT: Loaded 33697 existing records. [2025-10-21T19:17:37.732734] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:37.733011] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-21T19:17:37.733120] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-21T19:17:37.740136] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-21T19:17:37.740362] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T19:17:37.740497] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-21T19:17:37.763381] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-21T19:17:38.097749] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-21T19:17:38.101170] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:38.253807] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T19:17:38.261521] [INFO ] [REMOTE ] HWM: Full fetch complete (76631 records). [2025-10-21T19:17:38.261632] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-21T19:17:38.556234] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-21T19:17:38.644529] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-21T19:17:38.644600] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-21T19:17:38.645578] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-21T19:17:38.645660] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-21T19:17:38.647072] [DEBUG] [LOCAL ] HWM: Trimmed 76631 records to 52705 (keeping 200 days of data) [2025-10-21T19:17:38.951569] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-21T19:17:38.974765] [DEBUG] [LOCAL ] HWM: Primary data saved (52705 records). [2025-10-21T19:17:38.974942] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-21T19:17:38.975031] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols completed. HWM took 41.3s. Estimated remaining: 2h 46m 4s. Rate: 7.8 symbols/min [2025-10-21T19:17:39.143750] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:17:39.149353] [DEBUG] [LOCAL ] HYTR: Loaded 3098 existing records from primary storage. [2025-10-21T19:17:39.149526] [INFO ] [MAIN ] HYTR: Loaded 3098 existing records. [2025-10-21T19:17:39.325484] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:17:39.325804] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-21T19:17:39.325853] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-21T19:17:39.326053] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-21T19:17:39.326108] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-21T19:17:39.356326] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-21T19:17:39.678174] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:17:40.151074] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-21T19:17:40.754962] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T19:17:40.773575] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T19:17:40.951008] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-21T19:17:41.751079] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-21T19:17:42.073526] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-21T19:17:42.192184] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T19:17:42.551033] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-21T19:17:42.859036] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-21T19:17:43.351007] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-21T19:17:44.151016] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-21T19:17:44.787627] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T19:17:44.914996] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T19:17:44.951040] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-21T19:17:45.751081] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-21T19:17:45.769609] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:17:46.551034] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-21T19:17:47.335404] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:17:47.351411] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:17:47.351092] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-21T19:17:48.151015] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-21T19:17:48.857866] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T19:17:48.951036] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-21T19:17:49.035611] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T19:17:49.260616] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-21T19:17:49.751028] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-21T19:17:50.228486] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-21T19:17:50.551045] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-21T19:17:51.351038] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-21T19:17:51.858997] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:17:52.088192] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T19:17:52.151052] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-21T19:17:52.694125] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T19:17:52.951022] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-21T19:17:53.519512] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T19:17:53.751049] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-21T19:17:54.551035] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-21T19:17:54.565170] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T19:17:55.109126] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T19:17:55.351089] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-21T19:17:56.151039] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-21T19:17:56.163872] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T19:17:56.411429] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-21T19:17:56.951074] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-21T19:17:57.751034] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-21T19:17:58.330857] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:17:58.490063] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:17:58.551061] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-21T19:17:59.351063] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-21T19:17:59.699320] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-21T19:17:59.700045] [INFO ] [REMOTE ] HYBX: Full fetch complete (701 records). [2025-10-21T19:17:59.700112] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-21T19:17:59.884439] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-21T19:17:59.884799] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:17:59.884923] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:17:59.885167] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-21T19:17:59.885261] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-21T19:17:59.885438] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-21T19:17:59.885518] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-21T19:17:59.885580] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols completed. HYBX took 31.4s. Estimated remaining: 2h 46m 13s. Rate: 7.8 symbols/min [2025-10-21T19:18:00.081103] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T19:18:00.082848] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:00.118722] [DEBUG] [LOCAL ] HZO: Loaded 28914 existing records from primary storage. [2025-10-21T19:18:00.118968] [INFO ] [MAIN ] HZO: Loaded 28914 existing records. [2025-10-21T19:18:00.156305] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-21T19:18:00.305090] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:00.305298] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-21T19:18:00.305348] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-21T19:18:00.305556] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-21T19:18:00.305613] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-21T19:18:00.708170] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:00.951043] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-21T19:18:01.613869] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T19:18:01.616821] [INFO ] [REMOTE ] HYI: Full fetch complete (13985 records). [2025-10-21T19:18:01.616990] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-21T19:18:01.756327] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-21T19:18:02.035013] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-21T19:18:02.035143] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-21T19:18:02.035732] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-21T19:18:02.035802] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-21T19:18:02.036741] [DEBUG] [LOCAL ] HYI: Trimmed 13985 records to 9697 (keeping 200 days of data) [2025-10-21T19:18:02.103413] [DEBUG] [LOCAL ] HYI: Primary data saved (9697 records). [2025-10-21T19:18:02.103616] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-21T19:18:02.103754] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols completed. HYI took 26.2s. Estimated remaining: 2h 45m 58s. Rate: 7.8 symbols/min [2025-10-21T19:18:02.279482] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:02.288601] [DEBUG] [LOCAL ] IAE: Loaded 6325 existing records from primary storage. [2025-10-21T19:18:02.288845] [INFO ] [MAIN ] IAE: Loaded 6325 existing records. [2025-10-21T19:18:02.472200] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:02.472493] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-21T19:18:02.472542] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-21T19:18:02.472822] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-21T19:18:02.472882] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-21T19:18:02.556522] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-21T19:18:02.878617] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:02.895144] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T19:18:02.923233] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-21T19:18:03.118082] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T19:18:03.351043] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-21T19:18:04.151059] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-21T19:18:04.734516] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T19:18:04.783696] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T19:18:04.789408] [INFO ] [REMOTE ] HYT: Full fetch complete (47888 records). [2025-10-21T19:18:04.789560] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-21T19:18:04.956922] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-21T19:18:05.194256] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-21T19:18:05.194342] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-21T19:18:05.195111] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-21T19:18:05.195173] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-21T19:18:05.196304] [DEBUG] [LOCAL ] HYT: Trimmed 47888 records to 33741 (keeping 200 days of data) [2025-10-21T19:18:05.393864] [DEBUG] [LOCAL ] HYT: Primary data saved (33741 records). [2025-10-21T19:18:05.394010] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-21T19:18:05.394089] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols completed. HYT took 28.0s. Estimated remaining: 2h 45m 45s. Rate: 7.8 symbols/min [2025-10-21T19:18:05.567170] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T19:18:05.570923] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:05.626429] [DEBUG] [LOCAL ] IAG: Loaded 53491 existing records from primary storage. [2025-10-21T19:18:05.626836] [INFO ] [MAIN ] IAG: Loaded 53491 existing records. [2025-10-21T19:18:05.766342] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-21T19:18:05.814742] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:05.815045] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-21T19:18:05.815113] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-21T19:18:05.815423] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-21T19:18:05.815485] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-21T19:18:06.198240] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:06.551406] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-21T19:18:06.933849] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-21T19:18:06.950552] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T19:18:07.351051] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-21T19:18:08.151046] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-21T19:18:08.730773] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T19:18:08.951043] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-21T19:18:09.671272] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T19:18:09.751069] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-21T19:18:09.913876] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:18:10.373207] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:18:10.551049] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-21T19:18:11.023332] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T19:18:11.351094] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-21T19:18:12.151057] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-21T19:18:12.682140] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-21T19:18:12.807127] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T19:18:12.951035] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-21T19:18:13.628964] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T19:18:13.751045] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-21T19:18:14.413757] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T19:18:14.414866] [INFO ] [REMOTE ] HYTR: Full fetch complete (4678 records). [2025-10-21T19:18:14.414932] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-21T19:18:14.556172] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-21T19:18:14.783772] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-21T19:18:14.783864] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-21T19:18:14.784018] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-21T19:18:14.784076] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-21T19:18:14.784433] [DEBUG] [LOCAL ] HYTR: Trimmed 4678 records to 3074 (keeping 200 days of data) [2025-10-21T19:18:14.802734] [DEBUG] [LOCAL ] HYTR: Primary data saved (3074 records). [2025-10-21T19:18:14.802796] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-21T19:18:14.802862] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols completed. HYTR took 35.8s. Estimated remaining: 2h 45m 40s. Rate: 7.8 symbols/min [2025-10-21T19:18:14.969790] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:15.021340] [DEBUG] [LOCAL ] IBM: Loaded 53629 existing records from primary storage. [2025-10-21T19:18:15.021629] [INFO ] [MAIN ] IBM: Loaded 53629 existing records. [2025-10-21T19:18:15.199982] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:15.200198] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-21T19:18:15.200268] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-21T19:18:15.200499] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-21T19:18:15.200556] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-21T19:18:15.308067] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T19:18:15.358800] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-21T19:18:15.571164] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:16.064090] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T19:18:16.151021] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-21T19:18:16.951038] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-21T19:18:17.751038] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-21T19:18:18.039131] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T19:18:18.190872] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T19:18:18.551037] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-21T19:18:18.746153] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T19:18:19.155815] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T19:18:19.351011] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-21T19:18:20.150998] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-21T19:18:20.951045] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-21T19:18:21.195028] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T19:18:21.743951] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T19:18:21.750968] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-21T19:18:21.988218] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:18:22.552273] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-21T19:18:22.554931] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T19:18:22.556998] [INFO ] [REMOTE ] IAE: Full fetch complete (9022 records). [2025-10-21T19:18:22.557076] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-21T19:18:22.920485] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-21T19:18:22.920559] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-21T19:18:22.920804] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-21T19:18:22.920865] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-21T19:18:22.921267] [DEBUG] [LOCAL ] IAE: Trimmed 9022 records to 6338 (keeping 200 days of data) [2025-10-21T19:18:22.976307] [DEBUG] [LOCAL ] IAE: Primary data saved (6338 records). [2025-10-21T19:18:22.976480] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-21T19:18:22.976594] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols completed. IAE took 20.9s. Estimated remaining: 2h 45m 33s. Rate: 7.8 symbols/min [2025-10-21T19:18:23.351029] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-21T19:18:24.151098] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-21T19:18:24.527138] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T19:18:24.894681] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-21T19:18:24.951074] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-21T19:18:25.751073] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-21T19:18:25.854363] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:18:26.034119] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T19:18:26.551028] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-21T19:18:27.351009] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-21T19:18:27.806522] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T19:18:27.911820] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-21T19:18:28.151033] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-21T19:18:28.950995] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-21T19:18:29.160053] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T19:18:29.420905] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T19:18:29.751021] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-21T19:18:30.551017] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-21T19:18:30.654353] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:18:31.351095] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-21T19:18:31.532723] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:18:31.852409] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T19:18:32.151002] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-21T19:18:32.951022] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-21T19:18:33.056453] [DEBUG] [REMOTE ] HZO: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-21T19:18:33.056777] [WARN ] [REMOTE ] HZO: No data returned for month 2025-10 [2025-10-21T19:18:33.056867] [FATAL] [REMOTE ] HZO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:18:33.056984] [FATAL] [MAIN ] HZO: Failed to fetch primary data. [2025-10-21T19:18:33.057051] [WARN ] [MAIN ] HZO: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:18:33.057119] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-21T19:18:33.057182] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-21T19:18:33.057218] [INFO ] [LOCAL ] HZO: Starting deletion of derivative data. [2025-10-21T19:18:33.057371] [DEBUG] [LOCAL ] HZO: Deleted derivative data file. [2025-10-21T19:18:33.057453] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols completed. HZO took 33.2s. Estimated remaining: 2h 45m 28s. Rate: 7.8 symbols/min [2025-10-21T19:18:33.398691] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T19:18:33.751006] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-21T19:18:34.151257] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T19:18:34.551083] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-21T19:18:35.979845] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T19:18:35.991603] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-21T19:18:36.400207] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T19:18:36.412257] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-21T19:18:38.379574] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T19:18:38.391072] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-21T19:18:38.451069] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T19:18:38.462322] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-21T19:18:40.062323] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T19:18:40.070840] [INFO ] [REMOTE ] IAG: Full fetch complete (77503 records). [2025-10-21T19:18:40.070992] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-21T19:18:40.467017] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-21T19:18:40.467095] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-21T19:18:40.468082] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-21T19:18:40.468146] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-21T19:18:40.469484] [DEBUG] [LOCAL ] IAG: Trimmed 77503 records to 53492 (keeping 200 days of data) [2025-10-21T19:18:40.772432] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-21T19:18:40.772674] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-21T19:18:40.773465] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols completed. IAG took 35.4s. Estimated remaining: 2h 45m 20s. Rate: 7.8 symbols/min [2025-10-21T19:18:40.853120] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-21T19:18:40.864543] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-21T19:18:41.800223] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T19:18:41.809260] [INFO ] [REMOTE ] IBM: Full fetch complete (77739 records). [2025-10-21T19:18:41.809415] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-21T19:18:42.195209] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-21T19:18:42.195291] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-21T19:18:42.196270] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-21T19:18:42.196336] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-21T19:18:42.197958] [DEBUG] [LOCAL ] IBM: Trimmed 77739 records to 53628 (keeping 200 days of data) [2025-10-21T19:18:42.526026] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-21T19:18:42.526158] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-21T19:18:42.526233] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols completed. IBM took 27.7s. Estimated remaining: 2h 45m 5s. Rate: 7.8 symbols/min [2025-10-21T19:18:43.148791] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:43.225137] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:43.222962] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:43.278206] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:18:43.358038] [DEBUG] [LOCAL ] IBTA: Loaded 36338 existing records from primary storage. [2025-10-21T19:18:43.360445] [INFO ] [MAIN ] IBTA: Loaded 36338 existing records. [2025-10-21T19:18:43.359217] [DEBUG] [LOCAL ] IBP: Loaded 28823 existing records from primary storage. [2025-10-21T19:18:43.412304] [INFO ] [MAIN ] IBP: Loaded 28823 existing records. [2025-10-21T19:18:43.424631] [DEBUG] [LOCAL ] IBN: Loaded 52844 existing records from primary storage. [2025-10-21T19:18:43.491147] [INFO ] [MAIN ] IBN: Loaded 52844 existing records. [2025-10-21T19:18:43.684357] [DEBUG] [LOCAL ] ICE: Loaded 53012 existing records from primary storage. [2025-10-21T19:18:43.742828] [INFO ] [MAIN ] ICE: Loaded 53012 existing records. [2025-10-21T19:18:43.978490] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:44.110612] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:44.110796] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-21T19:18:44.114414] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:44.120596] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-21T19:18:44.120849] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-21T19:18:44.121192] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-21T19:18:44.121260] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-21T19:18:44.155692] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-21T19:18:44.155918] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-21T19:18:44.196809] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:18:44.183962] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-21T19:18:44.197216] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-21T19:18:44.197119] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-21T19:18:44.197443] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-21T19:18:44.197595] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-21T19:18:44.208209] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-21T19:18:44.273903] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-21T19:18:44.447033] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-21T19:18:44.457528] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-21T19:18:45.523753] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:45.596873] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-21T19:18:45.723028] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:45.709581] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:45.763694] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-21T19:18:45.757545] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-21T19:18:45.797374] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:18:45.797971] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-21T19:18:46.898474] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:18:46.904135] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-21T19:18:46.982864] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T19:18:46.988876] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-21T19:18:47.411557] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T19:18:47.422618] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-21T19:18:47.639551] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T19:18:47.653398] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-21T19:18:47.789425] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T19:18:47.795590] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-21T19:18:48.118341] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T19:18:48.123440] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-21T19:18:48.774976] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T19:18:48.786345] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-21T19:18:48.900073] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:18:48.906751] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-21T19:18:49.394741] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:18:49.405141] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-21T19:18:49.712009] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:18:49.751001] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-21T19:18:50.156038] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:18:50.216717] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T19:18:50.551029] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-21T19:18:50.920270] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T19:18:51.335622] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T19:18:51.350987] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-21T19:18:51.773449] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T19:18:52.151022] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-21T19:18:52.787682] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T19:18:52.951010] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-21T19:18:53.751050] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-21T19:18:53.974971] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T19:18:54.189495] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T19:18:54.551021] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-21T19:18:55.350993] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-21T19:18:55.409257] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T19:18:56.151008] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-21T19:18:56.461103] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T19:18:56.495884] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T19:18:56.951041] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-21T19:18:57.756111] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-21T19:18:57.774993] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T19:18:58.553848] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-21T19:18:58.555506] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T19:18:59.047066] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T19:18:59.351005] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-21T19:19:00.151038] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-21T19:19:00.283398] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T19:19:00.710753] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T19:19:00.951035] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-21T19:19:01.751020] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-21T19:19:02.200514] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T19:19:02.235886] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:19:02.551075] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-21T19:19:03.351054] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-21T19:19:03.874937] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T19:19:04.151024] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-21T19:19:04.479152] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T19:19:04.906259] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:19:04.950982] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-21T19:19:05.751021] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-21T19:19:05.913708] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T19:19:06.124302] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T19:19:06.551068] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-21T19:19:07.351028] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-21T19:19:07.633564] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:19:08.151066] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-21T19:19:08.279277] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:19:08.614611] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T19:19:08.951039] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-21T19:19:09.751007] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-21T19:19:10.114782] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T19:19:10.123852] [INFO ] [REMOTE ] ICE: Full fetch complete (76996 records). [2025-10-21T19:19:10.124029] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-21T19:19:10.436308] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T19:19:10.503832] [INFO ] [REMOTE ] IBP: Full fetch complete (41129 records). [2025-10-21T19:19:10.531392] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-21T19:19:10.570203] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-21T19:19:10.872599] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-21T19:19:10.888550] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-21T19:19:10.890324] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-21T19:19:10.890433] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-21T19:19:10.960736] [DEBUG] [LOCAL ] ICE: Trimmed 76996 records to 53011 (keeping 200 days of data) [2025-10-21T19:19:11.326062] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-21T19:19:11.326790] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-21T19:19:11.333105] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-21T19:19:11.333685] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-21T19:19:11.343006] [DEBUG] [LOCAL ] IBP: Trimmed 41129 records to 28797 (keeping 200 days of data) [2025-10-21T19:19:11.509125] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T19:19:11.635804] [INFO ] [REMOTE ] IBN: Full fetch complete (76627 records). [2025-10-21T19:19:11.639670] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-21T19:19:11.970894] [DEBUG] [LOCAL ] ICE: Primary data saved (53011 records). [2025-10-21T19:19:11.987316] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-21T19:19:12.011507] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols completed. ICE took 29.5s. Estimated remaining: 2h 45m 23s. Rate: 7.8 symbols/min [2025-10-21T19:19:12.052544] [DEBUG] [LOCAL ] IBP: Primary data saved (28797 records). [2025-10-21T19:19:12.090608] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-21T19:19:12.143795] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols completed. IBP took 29.6s. Estimated remaining: 2h 45m 7s. Rate: 7.8 symbols/min [2025-10-21T19:19:12.285463] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T19:19:12.482878] [INFO ] [REMOTE ] IBTA: Full fetch complete (51200 records). [2025-10-21T19:19:12.524820] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-21T19:19:12.694909] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:12.742731] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-21T19:19:12.796037] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:12.811793] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-21T19:19:12.827516] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-21T19:19:12.828098] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-21T19:19:12.890566] [DEBUG] [LOCAL ] IBN: Trimmed 76627 records to 52838 (keeping 200 days of data) [2025-10-21T19:19:13.073760] [DEBUG] [LOCAL ] ICL: Loaded 38359 existing records from primary storage. [2025-10-21T19:19:13.132053] [INFO ] [MAIN ] ICL: Loaded 38359 existing records. [2025-10-21T19:19:13.396059] [DEBUG] [LOCAL ] IDA: Loaded 32795 existing records from primary storage. [2025-10-21T19:19:13.440489] [INFO ] [MAIN ] IDA: Loaded 32795 existing records. [2025-10-21T19:19:13.575760] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-21T19:19:13.584733] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-21T19:19:13.585682] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-21T19:19:13.633815] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-21T19:19:13.694563] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:13.714159] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-21T19:19:13.754456] [DEBUG] [LOCAL ] IBTA: Trimmed 51200 records to 36220 (keeping 200 days of data) [2025-10-21T19:19:13.754301] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-21T19:19:13.768536] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-21T19:19:13.786927] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-21T19:19:13.881923] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:13.958615] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-21T19:19:14.006863] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-21T19:19:14.012133] [DEBUG] [LOCAL ] IBN: Primary data saved (52838 records). [2025-10-21T19:19:14.034886] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-21T19:19:14.035082] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols completed. IBN took 31.5s. Estimated remaining: 2h 44m 52s. Rate: 7.8 symbols/min [2025-10-21T19:19:14.075561] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-21T19:19:14.125469] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-21T19:19:14.367357] [DEBUG] [LOCAL ] IBTA: Primary data saved (36220 records). [2025-10-21T19:19:14.421067] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-21T19:19:14.521498] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols completed. IBTA took 32.0s. Estimated remaining: 2h 44m 36s. Rate: 7.8 symbols/min [2025-10-21T19:19:14.704467] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:15.015848] [DEBUG] [LOCAL ] IDE: Loaded 9091 existing records from primary storage. [2025-10-21T19:19:15.101586] [INFO ] [MAIN ] IDE: Loaded 9091 existing records. [2025-10-21T19:19:15.128959] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:15.134129] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:15.148547] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-21T19:19:15.195617] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:15.221404] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-21T19:19:15.367249] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:15.367410] [DEBUG] [LOCAL ] IDT: Loaded 18522 existing records from primary storage. [2025-10-21T19:19:15.367829] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-21T19:19:15.368256] [INFO ] [MAIN ] IDT: Loaded 18522 existing records. [2025-10-21T19:19:15.368480] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-21T19:19:15.440411] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-21T19:19:15.452226] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-21T19:19:15.736912] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:15.765984] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-21T19:19:15.813723] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-21T19:19:15.870265] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-21T19:19:15.872873] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-21T19:19:16.067032] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:16.083365] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-21T19:19:16.365503] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:16.365942] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-21T19:19:16.626163] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T19:19:16.632736] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-21T19:19:16.737932] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T19:19:16.745699] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-21T19:19:16.934079] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T19:19:16.936806] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-21T19:19:16.964535] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T19:19:16.967272] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-21T19:19:17.511171] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T19:19:17.590385] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T19:19:17.681199] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T19:19:17.755489] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-21T19:19:17.760034] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T19:19:18.397004] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T19:19:18.551010] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-21T19:19:19.351035] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-21T19:19:19.739375] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-21T19:19:20.151030] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-21T19:19:20.947862] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:19:20.949077] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T19:19:20.951023] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-21T19:19:21.751047] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-21T19:19:21.945525] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:19:22.551199] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-21T19:19:22.551439] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T19:19:23.351018] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-21T19:19:23.998962] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T19:19:24.151012] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-21T19:19:24.903200] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T19:19:24.950998] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-21T19:19:25.566063] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:19:25.751033] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-21T19:19:26.457107] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T19:19:26.551013] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-21T19:19:27.091639] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:19:27.261077] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T19:19:27.351074] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-21T19:19:28.095564] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T19:19:28.151030] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-21T19:19:28.951086] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-21T19:19:29.751054] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-21T19:19:29.895064] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T19:19:30.376120] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T19:19:30.395030] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T19:19:30.551044] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-21T19:19:31.351055] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-21T19:19:32.018168] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T19:19:32.151002] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-21T19:19:32.386497] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T19:19:32.951020] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-21T19:19:33.751058] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-21T19:19:33.932518] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:19:34.083560] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:19:34.550995] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-21T19:19:34.748137] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T19:19:35.351032] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-21T19:19:36.006172] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:19:36.112782] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T19:19:36.151073] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-21T19:19:36.930117] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T19:19:36.950986] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-21T19:19:37.751007] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-21T19:19:37.823403] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:19:37.825492] [INFO ] [REMOTE ] IDE: Full fetch complete (12767 records). [2025-10-21T19:19:37.825569] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-21T19:19:38.202784] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-21T19:19:38.202863] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-21T19:19:38.203176] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-21T19:19:38.203217] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-21T19:19:38.203693] [DEBUG] [LOCAL ] IDE: Trimmed 12767 records to 9047 (keeping 200 days of data) [2025-10-21T19:19:38.262780] [DEBUG] [LOCAL ] IDE: Primary data saved (9047 records). [2025-10-21T19:19:38.262907] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-21T19:19:38.263025] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols completed. IDE took 24.2s. Estimated remaining: 2h 44m 47s. Rate: 7.8 symbols/min [2025-10-21T19:19:38.458408] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:38.495768] [DEBUG] [LOCAL ] IEX: Loaded 38423 existing records from primary storage. [2025-10-21T19:19:38.496110] [INFO ] [MAIN ] IEX: Loaded 38423 existing records. [2025-10-21T19:19:38.559495] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-21T19:19:38.690871] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:38.691083] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-21T19:19:38.691130] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-21T19:19:38.691365] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-21T19:19:38.691404] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-21T19:19:39.057060] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:39.144351] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:19:39.150336] [INFO ] [REMOTE ] ICL: Full fetch complete (56021 records). [2025-10-21T19:19:39.150448] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-21T19:19:39.356893] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-21T19:19:39.539905] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-21T19:19:39.539982] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-21T19:19:39.540799] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-21T19:19:39.540861] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-21T19:19:39.542015] [DEBUG] [LOCAL ] ICL: Trimmed 56021 records to 38256 (keeping 200 days of data) [2025-10-21T19:19:39.747751] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:19:39.774728] [DEBUG] [LOCAL ] ICL: Primary data saved (38256 records). [2025-10-21T19:19:39.774848] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-21T19:19:39.774931] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols completed. ICL took 27.8s. Estimated remaining: 2h 44m 32s. Rate: 7.8 symbols/min [2025-10-21T19:19:39.947585] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:39.994371] [DEBUG] [LOCAL ] IFF: Loaded 51225 existing records from primary storage. [2025-10-21T19:19:39.994698] [INFO ] [MAIN ] IFF: Loaded 51225 existing records. [2025-10-21T19:19:40.163111] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-21T19:19:40.167685] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:40.168591] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-21T19:19:40.168687] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-21T19:19:40.168912] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-21T19:19:40.168971] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-21T19:19:40.519535] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:40.638342] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T19:19:40.951021] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-21T19:19:41.689711] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:19:41.750989] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-21T19:19:42.430546] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:19:42.435778] [INFO ] [REMOTE ] IDA: Full fetch complete (45381 records). [2025-10-21T19:19:42.435913] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-21T19:19:42.556109] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-21T19:19:42.819420] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-21T19:19:42.819495] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-21T19:19:42.820316] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-21T19:19:42.820386] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-21T19:19:42.821350] [DEBUG] [LOCAL ] IDA: Trimmed 45381 records to 32767 (keeping 200 days of data) [2025-10-21T19:19:43.024051] [DEBUG] [LOCAL ] IDA: Primary data saved (32767 records). [2025-10-21T19:19:43.024255] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-21T19:19:43.024398] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols completed. IDA took 30.8s. Estimated remaining: 2h 44m 19s. Rate: 7.8 symbols/min [2025-10-21T19:19:43.199207] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T19:19:43.216249] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:43.241687] [DEBUG] [LOCAL ] IFN: Loaded 18570 existing records from primary storage. [2025-10-21T19:19:43.241909] [INFO ] [MAIN ] IFN: Loaded 18570 existing records. [2025-10-21T19:19:43.356076] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-21T19:19:43.422681] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:43.422861] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-21T19:19:43.422907] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-21T19:19:43.423051] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-21T19:19:43.423089] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-21T19:19:43.586615] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T19:19:43.793859] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:44.151041] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-21T19:19:44.624258] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T19:19:44.951041] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-21T19:19:45.751020] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-21T19:19:45.814091] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T19:19:46.122880] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T19:19:46.551024] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-21T19:19:47.341921] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:19:47.350974] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-21T19:19:47.708533] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T19:19:48.151024] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-21T19:19:48.897773] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T19:19:48.950991] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-21T19:19:49.602284] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T19:19:49.751024] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-21T19:19:50.293223] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:19:50.551034] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-21T19:19:51.350991] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-21T19:19:51.508755] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:19:51.582639] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:19:52.151036] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-21T19:19:52.538799] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:19:52.951032] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-21T19:19:53.751007] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-21T19:19:53.973601] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T19:19:54.153508] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T19:19:54.157474] [INFO ] [REMOTE ] IDT: Full fetch complete (24004 records). [2025-10-21T19:19:54.157547] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-21T19:19:54.515536] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-21T19:19:54.515607] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-21T19:19:54.516097] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-21T19:19:54.516155] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-21T19:19:54.516767] [DEBUG] [LOCAL ] IDT: Trimmed 24004 records to 18558 (keeping 200 days of data) [2025-10-21T19:19:54.564243] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-21T19:19:54.628508] [DEBUG] [LOCAL ] IDT: Primary data saved (18558 records). [2025-10-21T19:19:54.628619] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-21T19:19:54.628724] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols completed. IDT took 40.1s. Estimated remaining: 2h 44m 16s. Rate: 7.8 symbols/min [2025-10-21T19:19:54.803322] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:19:54.825168] [DEBUG] [LOCAL ] IFS: Loaded 22330 existing records from primary storage. [2025-10-21T19:19:54.825396] [INFO ] [MAIN ] IFS: Loaded 22330 existing records. [2025-10-21T19:19:55.004000] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:19:55.004419] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-21T19:19:55.004465] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-21T19:19:55.004686] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-21T19:19:55.004743] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-21T19:19:55.366388] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:19:55.360590] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-21T19:19:55.390299] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T19:19:55.713925] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T19:19:56.151066] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-21T19:19:56.950992] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-21T19:19:57.294915] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T19:19:57.371522] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T19:19:57.529178] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T19:19:57.751000] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-21T19:19:58.551043] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-21T19:19:58.822635] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T19:19:59.351020] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-21T19:20:00.094223] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T19:20:00.151013] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-21T19:20:00.211221] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T19:20:00.951069] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-21T19:20:01.751000] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-21T19:20:01.943224] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T19:20:02.153412] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T19:20:02.551071] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-21T19:20:02.848782] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T19:20:03.351051] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-21T19:20:03.375079] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:20:04.151047] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-21T19:20:04.423507] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:20:04.951199] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-21T19:20:05.373432] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T19:20:05.750999] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-21T19:20:06.551037] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-21T19:20:06.625873] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T19:20:06.817985] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T19:20:07.351047] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-21T19:20:08.075712] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T19:20:08.081361] [INFO ] [REMOTE ] IEX: Full fetch complete (53850 records). [2025-10-21T19:20:08.081501] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-21T19:20:08.151504] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-21T19:20:08.468879] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-21T19:20:08.469064] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-21T19:20:08.470036] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-21T19:20:08.470117] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-21T19:20:08.486829] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:20:08.486940] [DEBUG] [LOCAL ] IEX: Trimmed 53850 records to 38376 (keeping 200 days of data) [2025-10-21T19:20:08.726190] [DEBUG] [LOCAL ] IEX: Primary data saved (38376 records). [2025-10-21T19:20:08.726317] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-21T19:20:08.727236] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols completed. IEX took 30.5s. Estimated remaining: 2h 44m 16s. Rate: 7.8 symbols/min [2025-10-21T19:20:08.901753] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:08.912987] [DEBUG] [LOCAL ] IGA: Loaded 10268 existing records from primary storage. [2025-10-21T19:20:08.913249] [INFO ] [MAIN ] IGA: Loaded 10268 existing records. [2025-10-21T19:20:08.956224] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-21T19:20:09.094981] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:09.095154] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-21T19:20:09.095221] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-21T19:20:09.095411] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-21T19:20:09.095468] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-21T19:20:09.453293] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:09.751035] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-21T19:20:09.991960] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:20:10.030070] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T19:20:10.216132] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-21T19:20:10.551035] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-21T19:20:11.172374] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:20:11.351063] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-21T19:20:12.070723] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T19:20:12.151031] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-21T19:20:12.951023] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-21T19:20:13.194951] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T19:20:13.751005] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-21T19:20:13.937354] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:20:13.940635] [INFO ] [REMOTE ] IFN: Full fetch complete (28367 records). [2025-10-21T19:20:13.940731] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-21T19:20:14.299540] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-21T19:20:14.299612] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-21T19:20:14.300170] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-21T19:20:14.300228] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-21T19:20:14.300899] [DEBUG] [LOCAL ] IFN: Trimmed 28367 records to 18608 (keeping 200 days of data) [2025-10-21T19:20:14.412810] [DEBUG] [LOCAL ] IFN: Primary data saved (18608 records). [2025-10-21T19:20:14.412938] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-21T19:20:14.413025] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols completed. IFN took 31.4s. Estimated remaining: 2h 44m 6s. Rate: 7.8 symbols/min [2025-10-21T19:20:14.560953] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-21T19:20:14.586235] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:14.604308] [DEBUG] [LOCAL ] IGD: Loaded 19266 existing records from primary storage. [2025-10-21T19:20:14.604512] [INFO ] [MAIN ] IGD: Loaded 19266 existing records. [2025-10-21T19:20:14.781346] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:14.781619] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-21T19:20:14.781699] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-21T19:20:14.781912] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-21T19:20:14.781968] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-21T19:20:14.971031] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T19:20:15.155694] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:15.351023] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-21T19:20:16.149723] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T19:20:16.153696] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-21T19:20:16.698415] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T19:20:16.951001] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-21T19:20:17.195638] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:20:17.751035] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-21T19:20:18.550988] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-21T19:20:18.647824] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T19:20:18.715181] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T19:20:18.723539] [INFO ] [REMOTE ] IFF: Full fetch complete (73727 records). [2025-10-21T19:20:18.723690] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-21T19:20:19.120900] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-21T19:20:19.120976] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-21T19:20:19.122021] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-21T19:20:19.122084] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-21T19:20:19.123448] [DEBUG] [LOCAL ] IFF: Trimmed 73727 records to 51226 (keeping 200 days of data) [2025-10-21T19:20:19.363805] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-21T19:20:19.371551] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T19:20:19.489165] [DEBUG] [LOCAL ] IFF: Primary data saved (51226 records). [2025-10-21T19:20:19.489309] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-21T19:20:19.489399] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols completed. IFF took 39.7s. Estimated remaining: 2h 43m 55s. Rate: 7.8 symbols/min [2025-10-21T19:20:19.684176] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:19.690503] [DEBUG] [LOCAL ] IGI: Loaded 4077 existing records from primary storage. [2025-10-21T19:20:19.690700] [INFO ] [MAIN ] IGI: Loaded 4077 existing records. [2025-10-21T19:20:19.874103] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:19.874331] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-21T19:20:19.874378] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-21T19:20:19.874543] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-21T19:20:19.874599] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-21T19:20:20.159420] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-21T19:20:20.283697] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:20.519353] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:20:20.524908] [INFO ] [REMOTE ] IFS: Full fetch complete (32273 records). [2025-10-21T19:20:20.525100] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-21T19:20:20.956181] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-21T19:20:20.946274] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:20:21.103217] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-21T19:20:21.103312] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-21T19:20:21.104052] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-21T19:20:21.104121] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-21T19:20:21.105260] [DEBUG] [LOCAL ] IFS: Trimmed 32273 records to 22267 (keeping 200 days of data) [2025-10-21T19:20:21.246784] [DEBUG] [LOCAL ] IFS: Primary data saved (22267 records). [2025-10-21T19:20:21.246925] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-21T19:20:21.247010] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols completed. IFS took 26.6s. Estimated remaining: 2h 43m 40s. Rate: 7.8 symbols/min [2025-10-21T19:20:21.456303] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:21.457369] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-21T19:20:21.492215] [DEBUG] [LOCAL ] IGR: Loaded 30502 existing records from primary storage. [2025-10-21T19:20:21.492518] [INFO ] [MAIN ] IGR: Loaded 30502 existing records. [2025-10-21T19:20:21.670344] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:21.670571] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-21T19:20:21.670618] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-21T19:20:21.670866] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-21T19:20:21.670923] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-21T19:20:21.756255] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-21T19:20:22.025993] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:22.231316] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T19:20:22.551073] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-21T19:20:23.153681] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T19:20:23.351004] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-21T19:20:23.896256] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-21T19:20:24.151053] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-21T19:20:24.688420] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T19:20:24.951031] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-21T19:20:25.528121] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:20:25.751044] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-21T19:20:26.551097] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-21T19:20:26.986257] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T19:20:27.292813] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T19:20:27.351018] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-21T19:20:27.985945] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T19:20:28.151036] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-21T19:20:28.774235] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T19:20:28.951058] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-21T19:20:29.751018] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-21T19:20:30.015010] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T19:20:30.551043] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-21T19:20:31.007569] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T19:20:31.238157] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T19:20:31.351002] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-21T19:20:32.151009] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-21T19:20:32.307754] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:20:32.876299] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:20:32.950993] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-21T19:20:33.735767] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T19:20:33.751019] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-21T19:20:34.551012] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-21T19:20:34.964541] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T19:20:35.351031] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-21T19:20:35.551756] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T19:20:36.108074] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T19:20:36.109580] [INFO ] [REMOTE ] IGI: Full fetch complete (5507 records). [2025-10-21T19:20:36.109670] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-21T19:20:36.156155] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-21T19:20:36.479777] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-21T19:20:36.479866] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-21T19:20:36.480054] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-21T19:20:36.480104] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-21T19:20:36.480479] [DEBUG] [LOCAL ] IGI: Trimmed 5507 records to 4074 (keeping 200 days of data) [2025-10-21T19:20:36.504671] [DEBUG] [LOCAL ] IGI: Primary data saved (4074 records). [2025-10-21T19:20:36.504749] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-21T19:20:36.504819] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols completed. IGI took 17.0s. Estimated remaining: 2h 43m 41s. Rate: 7.8 symbols/min [2025-10-21T19:20:36.675512] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:36.680366] [DEBUG] [LOCAL ] IH: Loaded 2768 existing records from primary storage. [2025-10-21T19:20:36.680531] [INFO ] [MAIN ] IH: Loaded 2768 existing records. [2025-10-21T19:20:36.855039] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:36.855219] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-21T19:20:36.855285] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-21T19:20:36.855419] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-21T19:20:36.855458] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-21T19:20:36.956538] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-21T19:20:37.238952] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:37.532508] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:20:37.751053] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-21T19:20:37.797670] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T19:20:38.551062] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-21T19:20:38.969109] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-21T19:20:39.123023] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T19:20:39.351017] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-21T19:20:40.151000] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-21T19:20:40.529499] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T19:20:40.951070] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-21T19:20:41.313127] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T19:20:41.551263] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:20:41.751015] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-21T19:20:42.470911] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T19:20:42.551039] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-21T19:20:43.351028] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-21T19:20:44.064611] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T19:20:44.089947] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:20:44.151007] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-21T19:20:44.951052] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-21T19:20:45.195966] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T19:20:45.198417] [INFO ] [REMOTE ] IGA: Full fetch complete (14360 records). [2025-10-21T19:20:45.198487] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-21T19:20:45.555861] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T19:20:45.565398] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-21T19:20:45.565503] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-21T19:20:45.567570] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-21T19:20:45.567670] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-21T19:20:45.568239] [DEBUG] [LOCAL ] IGA: Trimmed 14360 records to 10213 (keeping 200 days of data) [2025-10-21T19:20:45.629342] [DEBUG] [LOCAL ] IGA: Primary data saved (10213 records). [2025-10-21T19:20:45.629469] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-21T19:20:45.629548] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols completed. IGA took 36.9s. Estimated remaining: 2h 43m 35s. Rate: 7.8 symbols/min [2025-10-21T19:20:45.756188] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-21T19:20:45.815173] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:45.824370] [DEBUG] [LOCAL ] IHD: Loaded 7362 existing records from primary storage. [2025-10-21T19:20:45.824546] [INFO ] [MAIN ] IHD: Loaded 7362 existing records. [2025-10-21T19:20:46.008860] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:46.009059] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-21T19:20:46.009114] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-21T19:20:46.009275] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-21T19:20:46.009313] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-21T19:20:46.254733] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-21T19:20:46.377029] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:46.551069] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-21T19:20:47.351012] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-21T19:20:47.615980] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T19:20:47.853624] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T19:20:48.151018] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-21T19:20:48.821426] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T19:20:48.951023] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-21T19:20:49.428547] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-21T19:20:49.751025] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-21T19:20:50.243882] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T19:20:50.551034] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-21T19:20:51.351039] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-21T19:20:51.531138] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T19:20:51.961719] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:20:51.962745] [INFO ] [REMOTE ] IH: Full fetch complete (5043 records). [2025-10-21T19:20:51.962816] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-21T19:20:52.156246] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-21T19:20:52.323165] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-21T19:20:52.323238] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-21T19:20:52.323383] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-21T19:20:52.323424] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-21T19:20:52.323798] [DEBUG] [LOCAL ] IH: Trimmed 5043 records to 2764 (keeping 200 days of data) [2025-10-21T19:20:52.339077] [DEBUG] [LOCAL ] IH: Primary data saved (2764 records). [2025-10-21T19:20:52.339148] [INFO ] [MAIN ] IH: Full history saved. [2025-10-21T19:20:52.339220] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols completed. IH took 15.8s. Estimated remaining: 2h 43m 26s. Rate: 7.8 symbols/min [2025-10-21T19:20:52.506757] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:52.531234] [DEBUG] [LOCAL ] IHG: Loaded 24215 existing records from primary storage. [2025-10-21T19:20:52.531468] [INFO ] [MAIN ] IHG: Loaded 24215 existing records. [2025-10-21T19:20:52.706573] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:52.706803] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-21T19:20:52.706849] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-21T19:20:52.707009] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-21T19:20:52.707047] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-21T19:20:52.957602] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-21T19:20:53.062812] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:53.485532] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:20:53.751031] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-21T19:20:53.777125] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:20:53.780935] [INFO ] [REMOTE ] IGD: Full fetch complete (30118 records). [2025-10-21T19:20:53.781008] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-21T19:20:54.148693] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-21T19:20:54.148777] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-21T19:20:54.149445] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-21T19:20:54.149510] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-21T19:20:54.150281] [DEBUG] [LOCAL ] IGD: Trimmed 30118 records to 19195 (keeping 200 days of data) [2025-10-21T19:20:54.259122] [DEBUG] [LOCAL ] IGD: Primary data saved (19195 records). [2025-10-21T19:20:54.259248] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-21T19:20:54.259320] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols completed. IGD took 39.8s. Estimated remaining: 2h 43m 12s. Rate: 7.8 symbols/min [2025-10-21T19:20:54.428415] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:54.463313] [DEBUG] [LOCAL ] IHS: Loaded 37267 existing records from primary storage. [2025-10-21T19:20:54.463578] [INFO ] [MAIN ] IHS: Loaded 37267 existing records. [2025-10-21T19:20:54.556139] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-21T19:20:54.648359] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:54.648561] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-21T19:20:54.648609] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-21T19:20:54.648821] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-21T19:20:54.648874] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-21T19:20:54.910628] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T19:20:55.029554] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:20:55.351041] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-21T19:20:55.948279] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T19:20:56.156170] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-21T19:20:56.161792] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T19:20:56.951071] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-21T19:20:57.288025] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T19:20:57.751045] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-21T19:20:58.177907] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:20:58.182738] [INFO ] [REMOTE ] IGR: Full fetch complete (44560 records). [2025-10-21T19:20:58.182829] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-21T19:20:58.496158] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T19:20:58.554378] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-21T19:20:58.594315] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-21T19:20:58.594395] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-21T19:20:58.595198] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-21T19:20:58.595261] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-21T19:20:58.596367] [DEBUG] [LOCAL ] IGR: Trimmed 44560 records to 30433 (keeping 200 days of data) [2025-10-21T19:20:58.772638] [DEBUG] [LOCAL ] IGR: Primary data saved (30433 records). [2025-10-21T19:20:58.772797] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-21T19:20:58.772874] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols completed. IGR took 37.5s. Estimated remaining: 2h 43m 0s. Rate: 7.8 symbols/min [2025-10-21T19:20:58.949123] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:20:58.956915] [DEBUG] [LOCAL ] IIF: Loaded 5448 existing records from primary storage. [2025-10-21T19:20:58.957113] [INFO ] [MAIN ] IIF: Loaded 5448 existing records. [2025-10-21T19:20:59.142104] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:20:59.142311] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-21T19:20:59.142358] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-21T19:20:59.142493] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-21T19:20:59.142532] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-21T19:20:59.355601] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-21T19:20:59.448574] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T19:20:59.533055] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:00.150991] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-21T19:21:00.506526] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T19:21:00.757703] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-21T19:21:00.951040] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-21T19:21:01.686578] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T19:21:01.751019] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-21T19:21:02.551033] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-21T19:21:03.236535] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T19:21:03.274445] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T19:21:03.351075] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-21T19:21:04.151004] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-21T19:21:04.552924] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T19:21:04.951033] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-21T19:21:05.568589] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:21:05.666787] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:21:05.751066] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-21T19:21:06.551024] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-21T19:21:06.594812] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T19:21:07.106605] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T19:21:07.351018] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-21T19:21:08.006310] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T19:21:08.151029] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-21T19:21:08.951037] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-21T19:21:09.751033] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-21T19:21:10.118374] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T19:21:10.259686] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:21:10.551087] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-21T19:21:10.879405] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T19:21:11.184413] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T19:21:11.351013] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-21T19:21:12.023455] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-21T19:21:12.151078] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-21T19:21:12.880546] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-21T19:21:12.951026] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-21T19:21:13.527131] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T19:21:13.751066] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-21T19:21:14.551057] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-21T19:21:15.054635] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T19:21:15.115093] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-21T19:21:15.351021] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-21T19:21:16.003922] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T19:21:16.005370] [INFO ] [REMOTE ] IIF: Full fetch complete (8858 records). [2025-10-21T19:21:16.005459] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-21T19:21:16.156104] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-21T19:21:16.392494] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-21T19:21:16.392584] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-21T19:21:16.392829] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-21T19:21:16.392889] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-21T19:21:16.393281] [DEBUG] [LOCAL ] IIF: Trimmed 8858 records to 5353 (keeping 200 days of data) [2025-10-21T19:21:16.425151] [DEBUG] [LOCAL ] IIF: Primary data saved (5353 records). [2025-10-21T19:21:16.425260] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-21T19:21:16.425332] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols completed. IIF took 17.7s. Estimated remaining: 2h 43m 4s. Rate: 7.8 symbols/min [2025-10-21T19:21:16.603446] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:16.621065] [DEBUG] [LOCAL ] IIIN: Loaded 16310 existing records from primary storage. [2025-10-21T19:21:16.621362] [INFO ] [MAIN ] IIIN: Loaded 16310 existing records. [2025-10-21T19:21:16.809450] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:16.809665] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-21T19:21:16.809726] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-21T19:21:16.809891] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-21T19:21:16.809948] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-21T19:21:16.956197] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-21T19:21:17.195577] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:17.437939] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T19:21:17.729380] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:21:17.751002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-21T19:21:18.182079] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T19:21:18.551030] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-21T19:21:19.351010] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-21T19:21:19.464002] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:21:19.465980] [INFO ] [REMOTE ] IHD: Full fetch complete (11795 records). [2025-10-21T19:21:19.466046] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-21T19:21:19.827848] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-21T19:21:19.827930] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-21T19:21:19.828219] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-21T19:21:19.828257] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-21T19:21:19.828695] [DEBUG] [LOCAL ] IHD: Trimmed 11795 records to 7394 (keeping 200 days of data) [2025-10-21T19:21:19.870797] [DEBUG] [LOCAL ] IHD: Primary data saved (7394 records). [2025-10-21T19:21:19.870938] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-21T19:21:19.871025] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols completed. IHD took 34.2s. Estimated remaining: 2h 42m 51s. Rate: 7.8 symbols/min [2025-10-21T19:21:20.043813] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:20.062299] [DEBUG] [LOCAL ] IIM: Loaded 15541 existing records from primary storage. [2025-10-21T19:21:20.062557] [INFO ] [MAIN ] IIM: Loaded 15541 existing records. [2025-10-21T19:21:20.160469] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-21T19:21:20.242881] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:20.243073] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-21T19:21:20.243129] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-21T19:21:20.243282] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-21T19:21:20.243318] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-21T19:21:20.597442] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T19:21:20.631750] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:20.951030] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-21T19:21:21.371318] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T19:21:21.751072] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-21T19:21:22.010831] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:21:22.550993] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-21T19:21:22.608830] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T19:21:23.351036] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-21T19:21:24.124105] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:21:24.150998] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-21T19:21:24.549400] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T19:21:24.951029] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-21T19:21:25.652056] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T19:21:25.751029] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-21T19:21:26.057871] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T19:21:26.551076] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-21T19:21:27.268424] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:21:27.351000] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-21T19:21:27.975973] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T19:21:27.980474] [INFO ] [REMOTE ] IHG: Full fetch complete (34255 records). [2025-10-21T19:21:27.980731] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-21T19:21:28.156309] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-21T19:21:28.387673] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-21T19:21:28.387759] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-21T19:21:28.388453] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-21T19:21:28.388509] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-21T19:21:28.389236] [DEBUG] [LOCAL ] IHG: Trimmed 34255 records to 24119 (keeping 200 days of data) [2025-10-21T19:21:28.543734] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:21:28.556073] [DEBUG] [LOCAL ] IHG: Primary data saved (24119 records). [2025-10-21T19:21:28.556216] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-21T19:21:28.556299] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols completed. IHG took 36.2s. Estimated remaining: 2h 42m 45s. Rate: 7.8 symbols/min [2025-10-21T19:21:28.720764] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:28.748322] [DEBUG] [LOCAL ] IIPR: Loaded 29071 existing records from primary storage. [2025-10-21T19:21:28.748592] [INFO ] [MAIN ] IIPR: Loaded 29071 existing records. [2025-10-21T19:21:28.929913] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:28.930114] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-21T19:21:28.930160] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-21T19:21:28.930384] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-21T19:21:28.930440] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-21T19:21:28.963043] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-21T19:21:29.320133] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:29.338446] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T19:21:29.750996] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-21T19:21:29.828941] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T19:21:30.551016] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-21T19:21:30.655523] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T19:21:31.351089] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-21T19:21:31.559846] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:21:32.151018] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-21T19:21:32.354466] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T19:21:32.951029] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-21T19:21:33.615018] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T19:21:33.750992] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-21T19:21:33.843237] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T19:21:34.551004] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-21T19:21:34.898877] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T19:21:34.903589] [INFO ] [REMOTE ] IHS: Full fetch complete (51568 records). [2025-10-21T19:21:34.903718] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-21T19:21:35.277000] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-21T19:21:35.277075] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-21T19:21:35.277856] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-21T19:21:35.277916] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-21T19:21:35.278951] [DEBUG] [LOCAL ] IHS: Trimmed 51568 records to 37245 (keeping 200 days of data) [2025-10-21T19:21:35.356543] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-21T19:21:35.485782] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T19:21:35.510247] [DEBUG] [LOCAL ] IHS: Primary data saved (37245 records). [2025-10-21T19:21:35.510366] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-21T19:21:35.511010] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols completed. IHS took 41.3s. Estimated remaining: 2h 42m 36s. Rate: 7.8 symbols/min [2025-10-21T19:21:35.680932] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:35.721272] [DEBUG] [LOCAL ] IMAX: Loaded 43484 existing records from primary storage. [2025-10-21T19:21:35.721546] [INFO ] [MAIN ] IMAX: Loaded 43484 existing records. [2025-10-21T19:21:35.900176] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:35.900391] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-21T19:21:35.900447] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-21T19:21:35.900621] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-21T19:21:35.900712] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-21T19:21:36.161418] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T19:21:36.161490] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-21T19:21:36.290362] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:36.951026] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-21T19:21:37.597040] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T19:21:37.684271] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T19:21:37.750988] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-21T19:21:38.551013] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-21T19:21:38.684578] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T19:21:39.350997] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-21T19:21:39.491608] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T19:21:40.048131] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T19:21:40.150996] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-21T19:21:40.951031] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-21T19:21:41.124675] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T19:21:41.751049] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-21T19:21:42.501348] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T19:21:42.550985] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-21T19:21:43.147864] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:21:43.351000] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-21T19:21:43.758035] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T19:21:43.959882] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:21:43.962763] [INFO ] [REMOTE ] IIM: Full fetch complete (24933 records). [2025-10-21T19:21:43.962832] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-21T19:21:44.156229] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-21T19:21:44.334149] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-21T19:21:44.334276] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-21T19:21:44.334825] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-21T19:21:44.334886] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-21T19:21:44.335450] [DEBUG] [LOCAL ] IIM: Trimmed 24933 records to 15540 (keeping 200 days of data) [2025-10-21T19:21:44.427029] [DEBUG] [LOCAL ] IIM: Primary data saved (15540 records). [2025-10-21T19:21:44.427152] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-21T19:21:44.427226] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols completed. IIM took 24.6s. Estimated remaining: 2h 42m 30s. Rate: 7.8 symbols/min [2025-10-21T19:21:44.594053] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:44.638876] [DEBUG] [LOCAL ] INFA: Loaded 48813 existing records from primary storage. [2025-10-21T19:21:44.639157] [INFO ] [MAIN ] INFA: Loaded 48813 existing records. [2025-10-21T19:21:44.827434] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:44.827682] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-21T19:21:44.827766] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-21T19:21:44.828076] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-21T19:21:44.828135] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-21T19:21:44.956112] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-21T19:21:45.202406] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:45.402070] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T19:21:45.751021] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-21T19:21:46.181600] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T19:21:46.551053] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-21T19:21:47.342066] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:21:47.351399] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-21T19:21:48.016870] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T19:21:48.151032] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-21T19:21:48.693334] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:21:48.951053] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-21T19:21:49.117057] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T19:21:49.751069] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-21T19:21:50.551063] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-21T19:21:50.587006] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:21:50.768046] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T19:21:51.351029] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-21T19:21:52.002676] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:21:52.151013] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-21T19:21:52.939685] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:21:52.950972] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-21T19:21:53.607737] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:21:53.751037] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-21T19:21:54.545245] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:21:54.555252] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-21T19:21:55.351005] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-21T19:21:55.486793] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:21:55.907282] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:21:55.912037] [INFO ] [REMOTE ] IIPR: Full fetch complete (43757 records). [2025-10-21T19:21:55.912126] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-21T19:21:56.157972] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-21T19:21:56.288231] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-21T19:21:56.288529] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-21T19:21:56.289314] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-21T19:21:56.289374] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-21T19:21:56.290325] [DEBUG] [LOCAL ] IIPR: Trimmed 43757 records to 28934 (keeping 200 days of data) [2025-10-21T19:21:56.462942] [DEBUG] [LOCAL ] IIPR: Primary data saved (28934 records). [2025-10-21T19:21:56.463060] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-21T19:21:56.463133] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols completed. IIPR took 27.9s. Estimated remaining: 2h 42m 27s. Rate: 7.8 symbols/min [2025-10-21T19:21:56.633157] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:21:56.657368] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:21:56.711816] [DEBUG] [LOCAL ] INFY: Loaded 53597 existing records from primary storage. [2025-10-21T19:21:56.712125] [INFO ] [MAIN ] INFY: Loaded 53597 existing records. [2025-10-21T19:21:56.886157] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:21:56.886376] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-21T19:21:56.886425] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-21T19:21:56.886793] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-21T19:21:56.886850] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-21T19:21:56.959743] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-21T19:21:57.240009] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:21:57.751070] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-21T19:21:57.993691] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T19:21:58.000015] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T19:21:58.551015] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-21T19:21:59.225740] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:21:59.351034] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-21T19:22:00.070455] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:22:00.135682] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T19:22:00.150993] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-21T19:22:00.951038] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-21T19:22:01.477706] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T19:22:01.480793] [INFO ] [REMOTE ] IIIN: Full fetch complete (24897 records). [2025-10-21T19:22:01.480904] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-21T19:22:01.756235] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-21T19:22:01.862698] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-21T19:22:01.862785] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-21T19:22:01.863302] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-21T19:22:01.863341] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-21T19:22:01.864002] [DEBUG] [LOCAL ] IIIN: Trimmed 24897 records to 16300 (keeping 200 days of data) [2025-10-21T19:22:01.965392] [DEBUG] [LOCAL ] IIIN: Primary data saved (16300 records). [2025-10-21T19:22:01.965568] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-21T19:22:01.965703] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols completed. IIIN took 45.5s. Estimated remaining: 2h 42m 17s. Rate: 7.8 symbols/min [2025-10-21T19:22:02.167365] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:02.214366] [DEBUG] [LOCAL ] ING: Loaded 50721 existing records from primary storage. [2025-10-21T19:22:02.214702] [INFO ] [MAIN ] ING: Loaded 50721 existing records. [2025-10-21T19:22:02.389369] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:02.389563] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-21T19:22:02.389609] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-21T19:22:02.389912] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-21T19:22:02.389967] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-21T19:22:02.563242] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-21T19:22:02.755484] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:02.937567] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T19:22:03.351082] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-21T19:22:03.594150] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:22:04.151003] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-21T19:22:04.491019] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T19:22:04.956151] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-21T19:22:04.969821] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T19:22:05.744439] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T19:22:05.754443] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-21T19:22:06.551008] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-21T19:22:06.663329] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T19:22:07.360840] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-21T19:22:07.370792] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T19:22:08.156249] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-21T19:22:08.181140] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:22:08.951006] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-21T19:22:09.041369] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:22:09.750990] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-21T19:22:10.019864] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T19:22:10.472369] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:22:10.551065] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-21T19:22:11.023516] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T19:22:11.030321] [INFO ] [REMOTE ] INFA: Full fetch complete (70813 records). [2025-10-21T19:22:11.030440] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-21T19:22:11.353441] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-21T19:22:11.448979] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-21T19:22:11.449061] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-21T19:22:11.450091] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-21T19:22:11.450179] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-21T19:22:11.451570] [DEBUG] [LOCAL ] INFA: Trimmed 70813 records to 48721 (keeping 200 days of data) [2025-10-21T19:22:11.740422] [DEBUG] [LOCAL ] INFA: Primary data saved (48721 records). [2025-10-21T19:22:11.740586] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-21T19:22:11.741046] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols completed. INFA took 27.3s. Estimated remaining: 2h 42m 12s. Rate: 7.8 symbols/min [2025-10-21T19:22:11.914276] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:11.943509] [DEBUG] [LOCAL ] INGM: Loaded 28268 existing records from primary storage. [2025-10-21T19:22:11.943796] [INFO ] [MAIN ] INGM: Loaded 28268 existing records. [2025-10-21T19:22:12.121313] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:12.121517] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-21T19:22:12.121564] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-21T19:22:12.121828] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-21T19:22:12.121885] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-21T19:22:12.153360] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-21T19:22:12.486840] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:12.531541] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T19:22:12.951069] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-21T19:22:13.001891] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:22:13.008854] [INFO ] [REMOTE ] IMAX: Full fetch complete (60981 records). [2025-10-21T19:22:13.008957] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-21T19:22:13.387557] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-21T19:22:13.387663] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-21T19:22:13.388572] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-21T19:22:13.388634] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-21T19:22:13.389982] [DEBUG] [LOCAL ] IMAX: Trimmed 60981 records to 43469 (keeping 200 days of data) [2025-10-21T19:22:13.642761] [DEBUG] [LOCAL ] IMAX: Primary data saved (43469 records). [2025-10-21T19:22:13.642903] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-21T19:22:13.643478] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols completed. IMAX took 38.1s. Estimated remaining: 2h 41m 57s. Rate: 7.8 symbols/min [2025-10-21T19:22:13.754832] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-21T19:22:13.836835] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:13.877977] [DEBUG] [LOCAL ] INGR: Loaded 33774 existing records from primary storage. [2025-10-21T19:22:13.878244] [INFO ] [MAIN ] INGR: Loaded 33774 existing records. [2025-10-21T19:22:14.006997] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:22:14.112307] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:14.131209] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-21T19:22:14.131358] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-21T19:22:14.133155] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-21T19:22:14.133091] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T19:22:14.133275] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-21T19:22:14.548209] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:14.550983] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-21T19:22:15.350990] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-21T19:22:15.662421] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:22:15.711295] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T19:22:16.151032] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-21T19:22:16.848374] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T19:22:16.951025] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-21T19:22:17.751057] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-21T19:22:18.089436] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T19:22:18.421175] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T19:22:18.551054] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-21T19:22:19.210488] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:22:19.351037] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-21T19:22:19.521278] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T19:22:20.151097] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-21T19:22:20.951070] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-21T19:22:21.038177] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:22:21.538036] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T19:22:21.751020] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-21T19:22:22.193413] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T19:22:22.551036] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-21T19:22:23.351048] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-21T19:22:23.473605] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T19:22:24.005040] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T19:22:24.151019] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-21T19:22:24.445405] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:22:24.951026] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-21T19:22:25.574170] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:22:25.751034] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-21T19:22:26.266820] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T19:22:26.551072] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-21T19:22:27.037098] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T19:22:27.351011] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-21T19:22:27.759992] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:22:28.151137] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-21T19:22:28.951097] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-21T19:22:29.238880] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:22:29.541416] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:22:29.751197] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-21T19:22:30.551054] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-21T19:22:30.605078] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T19:22:30.852811] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T19:22:31.351022] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-21T19:22:31.940670] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T19:22:32.151097] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-21T19:22:32.951079] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-21T19:22:33.028120] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:22:33.677012] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T19:22:33.751024] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-21T19:22:34.551080] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-21T19:22:34.877137] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T19:22:35.246917] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T19:22:35.252832] [INFO ] [REMOTE ] INGR: Full fetch complete (50727 records). [2025-10-21T19:22:35.252926] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-21T19:22:35.355139] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-21T19:22:35.643449] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-21T19:22:35.643552] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-21T19:22:35.644451] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-21T19:22:35.644516] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-21T19:22:35.645627] [DEBUG] [LOCAL ] INGR: Trimmed 50727 records to 33761 (keeping 200 days of data) [2025-10-21T19:22:35.858459] [DEBUG] [LOCAL ] INGR: Primary data saved (33761 records). [2025-10-21T19:22:35.858598] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-21T19:22:35.858702] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols completed. INGR took 22.2s. Estimated remaining: 2h 42m 6s. Rate: 7.8 symbols/min [2025-10-21T19:22:36.036543] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:36.074034] [DEBUG] [LOCAL ] INN: Loaded 41658 existing records from primary storage. [2025-10-21T19:22:36.074313] [INFO ] [MAIN ] INN: Loaded 41658 existing records. [2025-10-21T19:22:36.154265] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-21T19:22:36.271536] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:36.271953] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-21T19:22:36.272039] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-21T19:22:36.272365] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-21T19:22:36.272460] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-21T19:22:36.415535] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T19:22:36.680580] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:36.951031] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-21T19:22:37.286748] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T19:22:37.382819] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:22:37.387556] [INFO ] [REMOTE ] INGM: Full fetch complete (41779 records). [2025-10-21T19:22:37.387710] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-21T19:22:37.756204] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-21T19:22:37.809231] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-21T19:22:37.809337] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-21T19:22:37.810110] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-21T19:22:37.810176] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-21T19:22:37.811532] [DEBUG] [LOCAL ] INGM: Trimmed 41779 records to 28216 (keeping 200 days of data) [2025-10-21T19:22:37.983430] [DEBUG] [LOCAL ] INGM: Primary data saved (28216 records). [2025-10-21T19:22:37.983552] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-21T19:22:37.983629] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols completed. INGM took 26.2s. Estimated remaining: 2h 41m 52s. Rate: 7.8 symbols/min [2025-10-21T19:22:38.155565] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:38.155822] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-21T19:22:38.155869] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-21T19:22:38.155982] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-21T19:22:38.156025] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-21T19:22:38.156067] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-21T19:22:38.156101] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-21T19:22:38.440176] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T19:22:38.554725] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:38.554863] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-21T19:22:39.351077] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-21T19:22:39.978200] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T19:22:40.151032] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-21T19:22:40.951046] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-21T19:22:41.218158] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:22:41.283042] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T19:22:41.311251] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-21T19:22:41.535047] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (3.78 seconds). [2025-10-21T19:22:41.542821] [INFO ] [REMOTE ] ING: Full fetch complete (73445 records). [2025-10-21T19:22:41.542984] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-21T19:22:41.543825] [FATAL] [VALIDATOR ] ING: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T19:22:41.543919] [FATAL] [MAIN ] ING: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:22:41.543986] [WARN ] [MAIN ] ING: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:22:41.544032] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-21T19:22:41.544128] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-10-21T19:22:41.544176] [INFO ] [LOCAL ] ING: Starting deletion of derivative data. [2025-10-21T19:22:41.544350] [DEBUG] [LOCAL ] ING: Deleted derivative data file. [2025-10-21T19:22:41.545074] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols completed. ING took 39.6s. Estimated remaining: 2h 41m 40s. Rate: 7.8 symbols/min [2025-10-21T19:22:41.718730] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:41.759289] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-21T19:22:41.762147] [DEBUG] [LOCAL ] INSP: Loaded 38552 existing records from primary storage. [2025-10-21T19:22:41.762472] [INFO ] [MAIN ] INSP: Loaded 38552 existing records. [2025-10-21T19:22:41.958275] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:41.958484] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-21T19:22:41.958533] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-21T19:22:41.959013] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-21T19:22:41.959103] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-21T19:22:42.353228] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:42.551045] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-21T19:22:43.351048] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-21T19:22:43.830198] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T19:22:43.838561] [INFO ] [REMOTE ] INFY: Full fetch complete (77746 records). [2025-10-21T19:22:43.838711] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-21T19:22:44.153598] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-21T19:22:44.248231] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-21T19:22:44.248346] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-21T19:22:44.249551] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-21T19:22:44.249705] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-21T19:22:44.260638] [DEBUG] [LOCAL ] INFY: Trimmed 77746 records to 53596 (keeping 200 days of data) [2025-10-21T19:22:44.278738] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T19:22:44.602559] [DEBUG] [LOCAL ] INFY: Primary data saved (53596 records). [2025-10-21T19:22:44.602728] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-21T19:22:44.602836] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols completed. INFY took 48.1s. Estimated remaining: 2h 41m 27s. Rate: 7.8 symbols/min [2025-10-21T19:22:44.730505] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T19:22:44.798485] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:22:44.834519] [DEBUG] [LOCAL ] INSW: Loaded 39541 existing records from primary storage. [2025-10-21T19:22:44.834809] [INFO ] [MAIN ] INSW: Loaded 39541 existing records. [2025-10-21T19:22:44.956192] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-21T19:22:45.012622] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:22:45.012855] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-21T19:22:45.012910] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-21T19:22:45.013125] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-21T19:22:45.013180] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-21T19:22:45.367695] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:22:45.740144] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:22:45.750969] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-21T19:22:46.339127] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T19:22:46.551024] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-21T19:22:47.241863] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:22:47.351013] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-21T19:22:48.042909] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:22:48.151035] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-21T19:22:48.694268] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T19:22:48.951001] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-21T19:22:49.712269] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:22:49.750983] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-21T19:22:50.089906] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T19:22:50.551042] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-21T19:22:51.223453] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T19:22:51.351047] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-21T19:22:51.930881] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:22:52.151027] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-21T19:22:52.951037] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-21T19:22:53.751093] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-21T19:23:05.288618] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (13.94 seconds). [2025-10-21T19:23:05.295851] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-21T19:23:06.709055] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:23:06.716346] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-21T19:23:07.320361] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (14.37 seconds). [2025-10-21T19:23:07.329757] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-21T19:23:07.405975] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (13.65 seconds). [2025-10-21T19:23:07.411378] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-21T19:23:07.699715] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (15.55 seconds). [2025-10-21T19:23:07.708580] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-21T19:23:08.306199] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-21T19:23:08.313377] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-21T19:23:08.806554] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:23:08.815188] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-21T19:23:09.137540] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T19:23:09.145681] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-21T19:23:09.589839] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:23:09.595902] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-21T19:23:10.278532] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (3.56 seconds). [2025-10-21T19:23:10.287294] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-21T19:23:10.425831] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T19:23:10.451002] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-21T19:23:10.452496] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T19:23:10.460295] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-21T19:23:10.539975] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:23:10.545833] [INFO ] [REMOTE ] INN: Full fetch complete (57663 records). [2025-10-21T19:23:10.545987] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-21T19:23:10.930297] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-21T19:23:10.930421] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-21T19:23:10.931446] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-21T19:23:10.931511] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-21T19:23:10.932747] [DEBUG] [LOCAL ] INN: Trimmed 57663 records to 41558 (keeping 200 days of data) [2025-10-21T19:23:11.168718] [DEBUG] [LOCAL ] INN: Primary data saved (41558 records). [2025-10-21T19:23:11.168926] [INFO ] [MAIN ] INN: Full history saved. [2025-10-21T19:23:11.169516] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols completed. INN took 35.3s. Estimated remaining: 2h 41m 40s. Rate: 7.8 symbols/min [2025-10-21T19:23:11.336187] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:11.385812] [DEBUG] [LOCAL ] INVH: Loaded 53195 existing records from primary storage. [2025-10-21T19:23:11.386125] [INFO ] [MAIN ] INVH: Loaded 53195 existing records. [2025-10-21T19:23:11.571866] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:11.572117] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-21T19:23:11.572223] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-21T19:23:11.572554] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-21T19:23:11.572612] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-21T19:23:11.963859] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T19:23:11.984271] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:11.990741] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-21T19:23:11.990425] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:23:12.001939] [INFO ] [REMOTE ] INR: Full fetch complete (37055 records). [2025-10-21T19:23:12.002675] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-21T19:23:12.003301] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-21T19:23:12.201500] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-21T19:23:12.202040] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:23:12.202124] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:23:12.202211] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-21T19:23:12.202454] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-21T19:23:12.202547] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-21T19:23:12.202663] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-21T19:23:12.202758] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols completed. INR took 34.2s. Estimated remaining: 2h 41m 25s. Rate: 7.8 symbols/min [2025-10-21T19:23:12.332322] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T19:23:12.363555] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-21T19:23:12.413489] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:12.442302] [DEBUG] [LOCAL ] INVX: Loaded 29241 existing records from primary storage. [2025-10-21T19:23:12.442543] [INFO ] [MAIN ] INVX: Loaded 29241 existing records. [2025-10-21T19:23:12.614579] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:12.614772] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-21T19:23:12.614822] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-21T19:23:12.615002] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-21T19:23:12.615059] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-21T19:23:12.957407] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:12.957622] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-21T19:23:13.765407] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T19:23:13.776110] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-21T19:23:13.820295] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:23:13.829372] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-21T19:23:13.876847] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:23:13.886817] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-21T19:23:14.261460] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:23:14.268232] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-21T19:23:15.070372] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T19:23:15.080364] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-21T19:23:15.380297] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T19:23:15.389005] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-21T19:23:15.479951] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T19:23:15.486583] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-21T19:23:15.516559] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:23:15.527778] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-21T19:23:16.408292] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T19:23:16.414266] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-21T19:23:16.527732] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T19:23:16.540584] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-21T19:23:16.824065] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T19:23:16.830913] [INFO ] [REMOTE ] INSP: Full fetch complete (53868 records). [2025-10-21T19:23:16.831056] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-21T19:23:17.178064] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:23:17.223536] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-21T19:23:17.257703] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-21T19:23:17.257849] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-21T19:23:17.258629] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-21T19:23:17.258713] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-21T19:23:17.259859] [DEBUG] [LOCAL ] INSP: Trimmed 53868 records to 38568 (keeping 200 days of data) [2025-10-21T19:23:17.486272] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:23:17.496920] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-21T19:23:17.523631] [DEBUG] [LOCAL ] INSP: Primary data saved (38568 records). [2025-10-21T19:23:17.523797] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-21T19:23:17.523886] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols completed. INSP took 36.0s. Estimated remaining: 2h 41m 14s. Rate: 7.8 symbols/min [2025-10-21T19:23:17.693480] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:17.743512] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-21T19:23:17.743870] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-21T19:23:17.925190] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:17.925365] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-21T19:23:17.925410] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-21T19:23:17.925586] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-21T19:23:17.925623] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-21T19:23:18.304989] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:18.306200] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-21T19:23:18.339436] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T19:23:18.351343] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-21T19:23:18.741704] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:23:18.750204] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-21T19:23:18.780158] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T19:23:19.351015] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-21T19:23:19.702157] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T19:23:20.151984] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:23:20.151165] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-21T19:23:20.293379] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:23:20.541267] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-21T19:23:20.951053] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-21T19:23:21.570194] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T19:23:21.751024] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-21T19:23:22.208440] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T19:23:22.214194] [INFO ] [REMOTE ] INSW: Full fetch complete (59581 records). [2025-10-21T19:23:22.214301] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-21T19:23:22.575013] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-21T19:23:22.595180] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-21T19:23:22.595256] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-21T19:23:22.596184] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-21T19:23:22.596262] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-21T19:23:22.597731] [DEBUG] [LOCAL ] INSW: Trimmed 59581 records to 39351 (keeping 200 days of data) [2025-10-21T19:23:22.833391] [DEBUG] [LOCAL ] INSW: Primary data saved (39351 records). [2025-10-21T19:23:22.833533] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-21T19:23:22.833611] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols completed. INSW took 38.2s. Estimated remaining: 2h 41m 4s. Rate: 7.8 symbols/min [2025-10-21T19:23:23.000706] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:23.049099] [DEBUG] [LOCAL ] IOT: Loaded 53478 existing records from primary storage. [2025-10-21T19:23:23.049440] [INFO ] [MAIN ] IOT: Loaded 53478 existing records. [2025-10-21T19:23:23.229975] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:23.230216] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-21T19:23:23.230280] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-21T19:23:23.230539] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-21T19:23:23.230618] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-21T19:23:23.351845] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-21T19:23:23.604935] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:23.637533] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:23:24.081087] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T19:23:24.151037] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-21T19:23:24.951085] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-21T19:23:25.391420] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-21T19:23:25.751017] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-21T19:23:25.924275] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:23:26.442803] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T19:23:26.550988] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-21T19:23:26.935738] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T19:23:27.351019] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-21T19:23:28.151016] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-21T19:23:28.275435] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T19:23:28.335208] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T19:23:28.951028] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-21T19:23:29.751056] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-21T19:23:29.934200] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:23:30.551032] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-21T19:23:31.351012] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-21T19:23:31.540515] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:23:31.617671] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-21T19:23:31.921261] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T19:23:31.930162] [INFO ] [REMOTE ] INVH: Full fetch complete (76970 records). [2025-10-21T19:23:31.930314] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-21T19:23:32.156577] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-21T19:23:32.390765] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-21T19:23:32.390867] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-21T19:23:32.391973] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-21T19:23:32.392045] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-21T19:23:32.393611] [DEBUG] [LOCAL ] INVH: Trimmed 76970 records to 53194 (keeping 200 days of data) [2025-10-21T19:23:32.651427] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T19:23:32.672177] [INFO ] [REMOTE ] INVX: Full fetch complete (42847 records). [2025-10-21T19:23:32.676532] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-21T19:23:32.880573] [DEBUG] [LOCAL ] INVH: Primary data saved (53194 records). [2025-10-21T19:23:32.905832] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-21T19:23:32.906424] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols completed. INVH took 21.7s. Estimated remaining: 2h 40m 59s. Rate: 7.8 symbols/min [2025-10-21T19:23:32.955435] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-21T19:23:33.326299] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:33.365900] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-21T19:23:33.366077] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-21T19:23:33.367132] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-21T19:23:33.367334] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-21T19:23:33.368870] [DEBUG] [LOCAL ] INVX: Trimmed 42847 records to 29141 (keeping 200 days of data) [2025-10-21T19:23:33.580945] [DEBUG] [LOCAL ] IP: Loaded 53306 existing records from primary storage. [2025-10-21T19:23:33.584573] [DEBUG] [LOCAL ] INVX: Primary data saved (29141 records). [2025-10-21T19:23:33.585423] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-21T19:23:33.585695] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols completed. INVX took 21.4s. Estimated remaining: 2h 40m 43s. Rate: 7.8 symbols/min [2025-10-21T19:23:33.591100] [INFO ] [MAIN ] IP: Loaded 53306 existing records. [2025-10-21T19:23:33.970118] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:23:33.981864] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:33.982164] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-21T19:23:33.982226] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-21T19:23:33.982537] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-21T19:23:33.982594] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-21T19:23:34.391768] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:34.392251] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-21T19:23:34.393485] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-21T19:23:34.394476] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-21T19:23:34.577216] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:23:34.577719] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-21T19:23:34.577881] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-21T19:23:34.578465] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-21T19:23:34.578527] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-21T19:23:34.956263] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T19:23:35.034746] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:23:35.036314] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-21T19:23:35.038511] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-10-21T19:23:35.351020] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-21T19:23:36.151796] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-21T19:23:36.154602] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:23:36.839840] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T19:23:36.951003] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-21T19:23:37.174228] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T19:23:37.751121] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-21T19:23:38.551010] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-21T19:23:38.688997] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:23:38.835468] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-21T19:23:39.351004] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-21T19:23:39.665971] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T19:23:39.860730] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T19:23:40.151047] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-21T19:23:40.951011] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-21T19:23:41.176498] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:23:41.751035] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-21T19:23:42.551003] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-21T19:23:42.639519] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-10-21T19:23:42.896219] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T19:23:43.351038] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-21T19:23:43.495491] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:23:44.151064] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-21T19:23:44.579395] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T19:23:44.951076] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-21T19:23:45.062320] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T19:23:45.751044] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-21T19:23:45.818678] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:23:46.526499] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:23:46.550990] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-21T19:23:47.351016] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-21T19:23:47.516831] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T19:23:48.151154] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-21T19:23:48.519267] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T19:23:48.951036] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-21T19:23:49.751047] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-21T19:23:49.884085] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T19:23:50.081809] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-21T19:23:50.556150] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-21T19:23:50.568165] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T19:23:50.577057] [INFO ] [REMOTE ] IOT: Full fetch complete (77554 records). [2025-10-21T19:23:50.577207] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-21T19:23:51.018563] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-21T19:23:51.018748] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-21T19:23:51.019939] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-21T19:23:51.020113] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-21T19:23:51.021725] [DEBUG] [LOCAL ] IOT: Trimmed 77554 records to 53478 (keeping 200 days of data) [2025-10-21T19:23:51.141570] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T19:23:51.354514] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-21T19:23:51.367316] [DEBUG] [LOCAL ] IOT: Primary data saved (53478 records). [2025-10-21T19:23:51.367391] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-21T19:23:51.367461] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols completed. IOT took 28.5s. Estimated remaining: 2h 40m 47s. Rate: 7.8 symbols/min [2025-10-21T19:23:52.151073] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-21T19:23:53.189380] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T19:23:53.201495] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-21T19:23:53.346801] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-21T19:23:53.594214] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T19:23:53.751044] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-21T19:23:54.551008] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-21T19:23:54.974453] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:23:55.351092] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-21T19:23:55.437718] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:23:56.151068] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-21T19:23:57.136533] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-21T19:23:57.148036] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-21T19:23:57.288566] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T19:23:57.371756] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T19:23:57.751063] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-21T19:23:58.551039] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-21T19:23:59.544589] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:23:59.553583] [INFO ] [REMOTE ] IPG: Full fetch complete (77435 records). [2025-10-21T19:23:59.553769] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-21T19:23:59.989415] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-21T19:23:59.989793] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-21T19:23:59.991027] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.84 seconds). [2025-10-21T19:23:59.992067] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-21T19:23:59.999992] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-21T19:24:00.001089] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-21T19:24:00.001341] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-21T19:24:00.002258] [DEBUG] [LOCAL ] IPG: Trimmed 77435 records to 53330 (keeping 200 days of data) [2025-10-21T19:24:00.661706] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-21T19:24:00.662208] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-21T19:24:00.668787] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-21T19:24:00.667610] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-21T19:24:00.668940] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-21T19:24:00.679424] [INFO ] [REMOTE ] IP: Full fetch complete (77415 records). [2025-10-21T19:24:00.680271] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-21T19:24:00.768985] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-21T19:24:01.193457] [DEBUG] [LOCAL ] IPG: Primary data saved (53330 records). [2025-10-21T19:24:01.210698] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-21T19:24:01.238771] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols completed. IPG took 27.7s. Estimated remaining: 2h 40m 42s. Rate: 7.8 symbols/min [2025-10-21T19:24:01.361198] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-21T19:24:01.387780] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-21T19:24:01.389360] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-21T19:24:01.389747] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-21T19:24:01.402412] [DEBUG] [LOCAL ] IP: Trimmed 77415 records to 53304 (keeping 200 days of data) [2025-10-21T19:24:01.635675] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-21T19:24:01.685032] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-21T19:24:01.685854] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols completed. IONQ took 44.2s. Estimated remaining: 2h 40m 26s. Rate: 7.8 symbols/min [2025-10-21T19:24:01.829982] [DEBUG] [LOCAL ] IP: Primary data saved (53304 records). [2025-10-21T19:24:01.830120] [INFO ] [MAIN ] IP: Full history saved. [2025-10-21T19:24:01.830200] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols completed. IP took 28.9s. Estimated remaining: 2h 40m 10s. Rate: 7.8 symbols/min [2025-10-21T19:24:02.517856] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:02.598569] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:02.601057] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:02.622153] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:02.641032] [DEBUG] [LOCAL ] IQI: Loaded 17832 existing records from primary storage. [2025-10-21T19:24:02.647310] [INFO ] [MAIN ] IQI: Loaded 17832 existing records. [2025-10-21T19:24:02.743418] [DEBUG] [LOCAL ] IPI: Loaded 21513 existing records from primary storage. [2025-10-21T19:24:02.773077] [INFO ] [MAIN ] IPI: Loaded 21513 existing records. [2025-10-21T19:24:02.965554] [DEBUG] [LOCAL ] IR: Loaded 52765 existing records from primary storage. [2025-10-21T19:24:02.985474] [INFO ] [MAIN ] IR: Loaded 52765 existing records. [2025-10-21T19:24:03.025435] [DEBUG] [LOCAL ] IQV: Loaded 50022 existing records from primary storage. [2025-10-21T19:24:02.988932] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:03.092772] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-21T19:24:03.092958] [INFO ] [MAIN ] IQV: Loaded 50022 existing records. [2025-10-21T19:24:03.096446] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-21T19:24:03.194844] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-21T19:24:03.197774] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:03.232435] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-21T19:24:03.232341] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-21T19:24:03.281371] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-21T19:24:03.405572] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-21T19:24:03.426355] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-21T19:24:03.518751] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:03.559956] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-21T19:24:03.575758] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-21T19:24:03.602319] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-21T19:24:03.636402] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-21T19:24:03.865105] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:04.018309] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-21T19:24:04.113069] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-21T19:24:04.202691] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-21T19:24:04.250991] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-21T19:24:04.624729] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:04.730011] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-21T19:24:04.880566] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:04.905599] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-21T19:24:04.943914] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:04.970818] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-21T19:24:05.120597] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:05.120942] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-21T19:24:05.917292] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T19:24:05.921330] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-21T19:24:06.124560] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:24:06.128422] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-21T19:24:06.440342] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:24:06.451845] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-21T19:24:06.590103] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:24:06.600071] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-21T19:24:07.020076] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T19:24:07.025053] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-21T19:24:07.157823] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:24:07.161961] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-21T19:24:07.985891] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T19:24:07.989981] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-21T19:24:08.118149] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T19:24:08.157952] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-21T19:24:08.163310] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T19:24:08.188072] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T19:24:08.950989] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-21T19:24:09.124300] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T19:24:09.742750] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T19:24:09.753159] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-21T19:24:10.551111] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-21T19:24:10.694197] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T19:24:10.787615] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:24:11.351008] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-21T19:24:11.436839] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-21T19:24:12.151041] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-21T19:24:12.271355] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T19:24:12.951037] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-21T19:24:13.726709] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:24:13.750977] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-21T19:24:13.945866] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:24:14.551098] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-21T19:24:15.351044] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-21T19:24:15.673237] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T19:24:15.962607] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-21T19:24:16.151021] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-21T19:24:16.436190] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T19:24:16.951114] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-21T19:24:17.751070] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-21T19:24:17.792978] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:24:17.879292] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T19:24:18.550999] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-21T19:24:18.731965] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T19:24:19.343977] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T19:24:19.346897] [INFO ] [REMOTE ] IQI: Full fetch complete (26406 records). [2025-10-21T19:24:19.346982] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-21T19:24:19.359349] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-21T19:24:19.756332] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-21T19:24:19.756410] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-21T19:24:19.756949] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-21T19:24:19.757011] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-21T19:24:19.757732] [DEBUG] [LOCAL ] IQI: Trimmed 26406 records to 17852 (keeping 200 days of data) [2025-10-21T19:24:19.864006] [DEBUG] [LOCAL ] IQI: Primary data saved (17852 records). [2025-10-21T19:24:19.864147] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-21T19:24:19.864229] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols completed. IQI took 18.0s. Estimated remaining: 2h 40m 13s. Rate: 7.8 symbols/min [2025-10-21T19:24:20.037472] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:20.087409] [DEBUG] [LOCAL ] IRM: Loaded 49015 existing records from primary storage. [2025-10-21T19:24:20.087757] [INFO ] [MAIN ] IRM: Loaded 49015 existing records. [2025-10-21T19:24:20.156157] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-21T19:24:20.267111] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:20.267346] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-21T19:24:20.267393] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-21T19:24:20.267587] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-21T19:24:20.267675] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-21T19:24:20.617093] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:20.950997] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-21T19:24:21.187683] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T19:24:21.246770] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T19:24:21.751058] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-21T19:24:22.551114] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-21T19:24:22.594510] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:24:22.810234] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T19:24:23.351065] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-21T19:24:24.107054] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:24:24.150988] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-21T19:24:24.278446] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T19:24:24.951066] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-21T19:24:25.750995] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-21T19:24:25.859073] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T19:24:26.551022] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-21T19:24:26.647672] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:24:27.118947] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T19:24:27.123444] [INFO ] [REMOTE ] IPI: Full fetch complete (30264 records). [2025-10-21T19:24:27.123564] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-21T19:24:27.360214] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-21T19:24:27.520561] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-21T19:24:27.520737] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-21T19:24:27.521727] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-21T19:24:27.521793] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-21T19:24:27.522836] [DEBUG] [LOCAL ] IPI: Trimmed 30264 records to 21499 (keeping 200 days of data) [2025-10-21T19:24:27.657248] [DEBUG] [LOCAL ] IPI: Primary data saved (21499 records). [2025-10-21T19:24:27.657457] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-21T19:24:27.657566] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols completed. IPI took 25.8s. Estimated remaining: 2h 40m 6s. Rate: 7.8 symbols/min [2025-10-21T19:24:27.845009] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:27.871150] [DEBUG] [LOCAL ] IRS: Loaded 23243 existing records from primary storage. [2025-10-21T19:24:27.871472] [INFO ] [MAIN ] IRS: Loaded 23243 existing records. [2025-10-21T19:24:28.074083] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:28.074534] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-21T19:24:28.074674] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-21T19:24:28.074929] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-21T19:24:28.074987] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-21T19:24:28.154355] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-21T19:24:28.475796] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:28.493999] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T19:24:28.951010] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-21T19:24:29.136208] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:24:29.751097] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-21T19:24:29.893551] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:24:30.551068] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-21T19:24:30.603365] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:24:31.070381] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T19:24:31.351093] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-21T19:24:32.151010] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-21T19:24:32.283457] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T19:24:32.401046] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T19:24:32.956103] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-21T19:24:32.972760] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:24:32.981595] [INFO ] [REMOTE ] IQV: Full fetch complete (72537 records). [2025-10-21T19:24:32.981761] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-21T19:24:33.382385] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-21T19:24:33.382491] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-21T19:24:33.383551] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-21T19:24:33.383618] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-21T19:24:33.385193] [DEBUG] [LOCAL ] IQV: Trimmed 72537 records to 50013 (keeping 200 days of data) [2025-10-21T19:24:33.683932] [DEBUG] [LOCAL ] IQV: Primary data saved (50013 records). [2025-10-21T19:24:33.684057] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-21T19:24:33.684134] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols completed. IQV took 31.8s. Estimated remaining: 2h 39m 56s. Rate: 7.8 symbols/min [2025-10-21T19:24:33.760047] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-21T19:24:33.857209] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:33.904101] [DEBUG] [LOCAL ] IRT: Loaded 50527 existing records from primary storage. [2025-10-21T19:24:33.904385] [INFO ] [MAIN ] IRT: Loaded 50527 existing records. [2025-10-21T19:24:34.084345] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:34.084564] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-21T19:24:34.084672] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-21T19:24:34.084994] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-21T19:24:34.085034] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-21T19:24:34.443581] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:34.551000] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-21T19:24:34.598252] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:24:34.779430] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T19:24:35.351085] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-21T19:24:36.151021] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-21T19:24:36.332936] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:24:36.357533] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:24:36.951028] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-21T19:24:37.553944] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T19:24:37.617954] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-21T19:24:37.751061] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-21T19:24:38.551020] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-21T19:24:39.290309] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T19:24:39.350982] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-21T19:24:40.150998] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-21T19:24:40.361385] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:24:40.369701] [INFO ] [REMOTE ] IR: Full fetch complete (76485 records). [2025-10-21T19:24:40.369867] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-21T19:24:40.826488] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-21T19:24:40.826677] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-21T19:24:40.827922] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-21T19:24:40.828779] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-21T19:24:40.831231] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:24:40.847617] [DEBUG] [LOCAL ] IR: Trimmed 76485 records to 52756 (keeping 200 days of data) [2025-10-21T19:24:40.854571] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T19:24:40.953436] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-21T19:24:41.178317] [DEBUG] [LOCAL ] IR: Primary data saved (52756 records). [2025-10-21T19:24:41.178451] [INFO ] [MAIN ] IR: Full history saved. [2025-10-21T19:24:41.179253] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols completed. IR took 39.3s. Estimated remaining: 2h 39m 48s. Rate: 7.8 symbols/min [2025-10-21T19:24:41.367131] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:41.385428] [DEBUG] [LOCAL ] ISD: Loaded 15782 existing records from primary storage. [2025-10-21T19:24:41.385686] [INFO ] [MAIN ] ISD: Loaded 15782 existing records. [2025-10-21T19:24:41.557212] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:41.557417] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-21T19:24:41.557482] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-21T19:24:41.557699] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-21T19:24:41.557769] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-21T19:24:41.756165] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-21T19:24:41.910529] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:42.551043] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-21T19:24:42.642266] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:24:43.350998] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-21T19:24:43.526053] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:24:43.625327] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T19:24:44.151046] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-21T19:24:44.731725] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:24:44.951055] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-21T19:24:45.195810] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T19:24:45.751046] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-21T19:24:46.342493] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:24:46.551015] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-21T19:24:46.669679] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:24:47.351008] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-21T19:24:48.151034] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-21T19:24:48.287134] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T19:24:48.345969] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T19:24:48.951086] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-21T19:24:49.751108] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-21T19:24:49.811991] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:24:49.812505] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T19:24:50.551169] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-21T19:24:51.351012] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-21T19:24:51.437389] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:24:52.156386] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-21T19:24:52.169096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T19:24:52.428430] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T19:24:52.951054] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-21T19:24:53.221549] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:24:53.751027] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-21T19:24:54.537326] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:24:54.550979] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-21T19:24:54.743935] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T19:24:55.351058] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-21T19:24:56.151004] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-21T19:24:56.261314] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:24:56.318928] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T19:24:56.951073] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-21T19:24:57.750995] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-21T19:24:57.888516] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:24:57.897313] [INFO ] [REMOTE ] IRM: Full fetch complete (72190 records). [2025-10-21T19:24:57.897507] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-21T19:24:58.014938] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T19:24:58.317750] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-21T19:24:58.317915] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-21T19:24:58.319023] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-21T19:24:58.319107] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-21T19:24:58.320491] [DEBUG] [LOCAL ] IRM: Trimmed 72190 records to 48973 (keeping 200 days of data) [2025-10-21T19:24:58.551197] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-21T19:24:58.627058] [DEBUG] [LOCAL ] IRM: Primary data saved (48973 records). [2025-10-21T19:24:58.627189] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-21T19:24:58.627526] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols completed. IRM took 38.8s. Estimated remaining: 2h 39m 51s. Rate: 7.8 symbols/min [2025-10-21T19:24:58.807274] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:24:58.846852] [DEBUG] [LOCAL ] IT: Loaded 42199 existing records from primary storage. [2025-10-21T19:24:58.847140] [INFO ] [MAIN ] IT: Loaded 42199 existing records. [2025-10-21T19:24:59.027480] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:24:59.027721] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-21T19:24:59.027780] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-21T19:24:59.028082] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-21T19:24:59.028132] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-21T19:24:59.359528] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-21T19:24:59.387971] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:24:59.478805] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T19:24:59.538258] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T19:25:00.151052] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-21T19:25:00.879234] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:25:00.951030] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-21T19:25:01.344380] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:25:01.751132] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-21T19:25:02.171780] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:25:02.551032] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-21T19:25:03.040869] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T19:25:03.046044] [INFO ] [REMOTE ] IRS: Full fetch complete (32696 records). [2025-10-21T19:25:03.046220] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-21T19:25:03.359859] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-21T19:25:03.570174] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-21T19:25:03.570307] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-21T19:25:03.571848] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-21T19:25:03.571939] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-21T19:25:03.573230] [DEBUG] [LOCAL ] IRS: Trimmed 32696 records to 23350 (keeping 200 days of data) [2025-10-21T19:25:03.745853] [DEBUG] [LOCAL ] IRS: Primary data saved (23350 records). [2025-10-21T19:25:03.746012] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-21T19:25:03.746102] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols completed. IRS took 36.1s. Estimated remaining: 2h 39m 40s. Rate: 7.8 symbols/min [2025-10-21T19:25:03.988028] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:04.021573] [DEBUG] [LOCAL ] ITGR: Loaded 31097 existing records from primary storage. [2025-10-21T19:25:04.021883] [INFO ] [MAIN ] ITGR: Loaded 31097 existing records. [2025-10-21T19:25:04.152705] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-21T19:25:04.152341] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T19:25:04.251992] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:04.252202] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-21T19:25:04.252249] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-21T19:25:04.252428] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-21T19:25:04.252467] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-21T19:25:04.626193] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:04.950997] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-21T19:25:05.197723] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T19:25:05.198475] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T19:25:05.208964] [INFO ] [REMOTE ] ISD: Full fetch complete (24159 records). [2025-10-21T19:25:05.209610] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-21T19:25:05.210237] [INFO ] [REMOTE ] IRT: Full fetch complete (72895 records). [2025-10-21T19:25:05.216079] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-21T19:25:05.766169] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-21T19:25:05.992167] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-21T19:25:05.998736] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-21T19:25:06.039253] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-21T19:25:06.035363] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-21T19:25:06.039585] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-21T19:25:06.039510] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-21T19:25:06.040512] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-21T19:25:06.040868] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-21T19:25:06.042305] [DEBUG] [LOCAL ] ISD: Trimmed 24159 records to 15750 (keeping 200 days of data) [2025-10-21T19:25:06.043141] [DEBUG] [LOCAL ] IRT: Trimmed 72895 records to 50486 (keeping 200 days of data) [2025-10-21T19:25:06.245786] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T19:25:06.256514] [DEBUG] [LOCAL ] ISD: Primary data saved (15750 records). [2025-10-21T19:25:06.258184] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-21T19:25:06.258584] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols completed. ISD took 25.1s. Estimated remaining: 2h 39m 27s. Rate: 7.8 symbols/min [2025-10-21T19:25:06.540304] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:06.568110] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-21T19:25:06.688582] [DEBUG] [LOCAL ] ITT: Loaded 32539 existing records from primary storage. [2025-10-21T19:25:06.692932] [INFO ] [MAIN ] ITT: Loaded 32539 existing records. [2025-10-21T19:25:06.736043] [DEBUG] [LOCAL ] IRT: Primary data saved (50486 records). [2025-10-21T19:25:06.749794] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-21T19:25:06.765275] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols completed. IRT took 33.1s. Estimated remaining: 2h 39m 11s. Rate: 7.8 symbols/min [2025-10-21T19:25:07.059781] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:07.076330] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:07.076554] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-21T19:25:07.076920] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-21T19:25:07.077101] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-21T19:25:07.077141] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-21T19:25:07.422705] [DEBUG] [LOCAL ] ITUB: Loaded 53327 existing records from primary storage. [2025-10-21T19:25:07.472489] [INFO ] [MAIN ] ITUB: Loaded 53327 existing records. [2025-10-21T19:25:07.513999] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:07.567491] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-21T19:25:07.631823] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T19:25:07.734586] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:07.735376] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-21T19:25:07.735464] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-21T19:25:07.748371] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-21T19:25:07.748516] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-21T19:25:07.784103] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:25:08.154049] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:08.150993] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-21T19:25:08.912403] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T19:25:08.950985] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-21T19:25:09.631177] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T19:25:09.751000] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-21T19:25:10.551055] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-21T19:25:10.794268] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T19:25:11.139716] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T19:25:11.351000] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-21T19:25:12.035490] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T19:25:12.151009] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-21T19:25:12.956834] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-21T19:25:12.973608] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T19:25:13.611114] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:25:13.751018] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-21T19:25:14.488044] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T19:25:14.550985] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-21T19:25:15.084926] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:25:15.351026] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-21T19:25:16.092040] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:25:16.151014] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-21T19:25:16.806078] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:25:16.950998] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-21T19:25:17.529995] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:25:17.751046] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-21T19:25:18.551059] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-21T19:25:18.787348] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:25:19.307213] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T19:25:19.351019] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-21T19:25:20.138584] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:25:20.150982] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-21T19:25:20.951080] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-21T19:25:21.085255] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:25:21.376154] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:25:21.751106] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-21T19:25:21.891290] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:25:22.551040] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-21T19:25:23.235776] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T19:25:23.350984] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-21T19:25:24.148329] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T19:25:24.157575] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-21T19:25:24.951066] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-21T19:25:25.220715] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T19:25:25.526959] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T19:25:25.751010] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-21T19:25:26.287386] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T19:25:26.294548] [INFO ] [REMOTE ] IT: Full fetch complete (57793 records). [2025-10-21T19:25:26.294725] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-21T19:25:26.558100] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-21T19:25:26.679219] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-21T19:25:26.679297] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-21T19:25:26.680144] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-21T19:25:26.680205] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-21T19:25:26.681283] [DEBUG] [LOCAL ] IT: Trimmed 57793 records to 42230 (keeping 200 days of data) [2025-10-21T19:25:26.937044] [DEBUG] [LOCAL ] IT: Primary data saved (42230 records). [2025-10-21T19:25:26.937240] [INFO ] [MAIN ] IT: Full history saved. [2025-10-21T19:25:26.937850] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols completed. IT took 28.3s. Estimated remaining: 2h 39m 17s. Rate: 7.8 symbols/min [2025-10-21T19:25:26.995226] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T19:25:27.127392] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:27.172335] [DEBUG] [LOCAL ] ITW: Loaded 45637 existing records from primary storage. [2025-10-21T19:25:27.172639] [INFO ] [MAIN ] ITW: Loaded 45637 existing records. [2025-10-21T19:25:27.345989] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:27.346170] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-21T19:25:27.346216] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-21T19:25:27.346409] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-21T19:25:27.346447] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-21T19:25:27.357491] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-21T19:25:27.751100] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:27.791285] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T19:25:28.151024] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-21T19:25:28.709155] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T19:25:28.951044] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-21T19:25:29.751073] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-21T19:25:29.959568] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T19:25:30.112727] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:25:30.117548] [INFO ] [REMOTE ] ITGR: Full fetch complete (43060 records). [2025-10-21T19:25:30.117688] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-21T19:25:30.485231] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-21T19:25:30.485309] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-21T19:25:30.486075] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-21T19:25:30.486136] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-21T19:25:30.487058] [DEBUG] [LOCAL ] ITGR: Trimmed 43060 records to 31006 (keeping 200 days of data) [2025-10-21T19:25:30.570976] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-21T19:25:30.674912] [DEBUG] [LOCAL ] ITGR: Primary data saved (31006 records). [2025-10-21T19:25:30.675051] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-21T19:25:30.675131] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols completed. ITGR took 26.9s. Estimated remaining: 2h 39m 5s. Rate: 7.8 symbols/min [2025-10-21T19:25:30.842380] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:30.884335] [DEBUG] [LOCAL ] IVR: Loaded 47946 existing records from primary storage. [2025-10-21T19:25:30.884621] [INFO ] [MAIN ] IVR: Loaded 47946 existing records. [2025-10-21T19:25:31.094167] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:31.094390] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-21T19:25:31.094516] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-21T19:25:31.094796] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-21T19:25:31.094917] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-21T19:25:31.351637] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-21T19:25:31.495885] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T19:25:31.500638] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:32.150987] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-21T19:25:32.337538] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:25:32.390485] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T19:25:32.951074] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-21T19:25:33.756821] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-21T19:25:33.761526] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:25:33.985578] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:25:34.551026] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-21T19:25:34.958795] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T19:25:34.963926] [INFO ] [REMOTE ] ITT: Full fetch complete (47526 records). [2025-10-21T19:25:34.964026] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-21T19:25:35.353661] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-21T19:25:35.353731] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-21T19:25:35.353892] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-21T19:25:35.355389] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-21T19:25:35.355457] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-21T19:25:35.356432] [DEBUG] [LOCAL ] ITT: Trimmed 47526 records to 32438 (keeping 200 days of data) [2025-10-21T19:25:35.554031] [DEBUG] [LOCAL ] ITT: Primary data saved (32438 records). [2025-10-21T19:25:35.554155] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-21T19:25:35.554705] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols completed. ITT took 29.3s. Estimated remaining: 2h 38m 54s. Rate: 7.8 symbols/min [2025-10-21T19:25:35.725758] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:35.759204] [DEBUG] [LOCAL ] IVT: Loaded 31523 existing records from primary storage. [2025-10-21T19:25:35.759489] [INFO ] [MAIN ] IVT: Loaded 31523 existing records. [2025-10-21T19:25:35.940166] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:35.940394] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-21T19:25:35.940463] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-21T19:25:35.940773] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-21T19:25:35.940832] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-21T19:25:36.155118] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-21T19:25:36.305480] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:36.336849] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:25:36.944258] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:25:36.952535] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-21T19:25:37.751034] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-21T19:25:37.984051] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:25:38.136136] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T19:25:38.551027] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-21T19:25:39.351026] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-21T19:25:39.485478] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T19:25:40.151092] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-21T19:25:40.208429] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T19:25:40.951055] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-21T19:25:41.161598] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T19:25:41.751090] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-21T19:25:41.961693] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:25:42.436292] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:25:42.551026] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-21T19:25:43.351060] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-21T19:25:43.503939] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:25:44.151014] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-21T19:25:44.204983] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T19:25:44.625498] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T19:25:44.951033] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-21T19:25:45.751036] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-21T19:25:45.929068] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T19:25:45.937231] [INFO ] [REMOTE ] ITUB: Full fetch complete (77316 records). [2025-10-21T19:25:45.937341] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-21T19:25:46.348250] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-21T19:25:46.348352] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-21T19:25:46.349378] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-21T19:25:46.349460] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-21T19:25:46.368252] [DEBUG] [LOCAL ] ITUB: Trimmed 77316 records to 53322 (keeping 200 days of data) [2025-10-21T19:25:46.378948] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T19:25:46.555463] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-21T19:25:46.743192] [DEBUG] [LOCAL ] ITUB: Primary data saved (53322 records). [2025-10-21T19:25:46.743929] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-21T19:25:46.744862] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols completed. ITUB took 40.0s. Estimated remaining: 2h 38m 50s. Rate: 7.8 symbols/min [2025-10-21T19:25:46.744710] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:25:46.932303] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:46.983941] [DEBUG] [LOCAL ] IVZ: Loaded 53129 existing records from primary storage. [2025-10-21T19:25:46.984261] [INFO ] [MAIN ] IVZ: Loaded 53129 existing records. [2025-10-21T19:25:47.160425] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:47.160677] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-21T19:25:47.160737] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-21T19:25:47.160983] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-21T19:25:47.161020] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-21T19:25:47.356136] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-21T19:25:47.520210] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:48.151044] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-21T19:25:48.572949] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T19:25:48.607004] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T19:25:48.951061] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-21T19:25:49.666500] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:25:49.750983] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-21T19:25:50.489318] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T19:25:50.550991] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-21T19:25:51.351051] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-21T19:25:51.449079] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:25:52.151006] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-21T19:25:52.203987] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T19:25:52.657067] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:25:52.951012] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-21T19:25:53.659351] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:25:53.751051] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-21T19:25:54.551066] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-21T19:25:54.676031] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T19:25:55.329251] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:25:55.350991] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-21T19:25:55.381289] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T19:25:56.151012] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-21T19:25:56.951108] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-21T19:25:57.290051] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T19:25:57.473670] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-21T19:25:57.482055] [INFO ] [REMOTE ] ITW: Full fetch complete (66746 records). [2025-10-21T19:25:57.482253] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-21T19:25:57.756299] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-21T19:25:57.922464] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-21T19:25:57.922613] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-21T19:25:57.923629] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-21T19:25:57.923722] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-21T19:25:57.925195] [DEBUG] [LOCAL ] ITW: Trimmed 66746 records to 45596 (keeping 200 days of data) [2025-10-21T19:25:58.213524] [DEBUG] [LOCAL ] ITW: Primary data saved (45596 records). [2025-10-21T19:25:58.213686] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-21T19:25:58.214326] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols completed. ITW took 31.3s. Estimated remaining: 2h 38m 47s. Rate: 7.8 symbols/min [2025-10-21T19:25:58.351683] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T19:25:58.432264] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:25:58.455582] [DEBUG] [LOCAL ] IX: Loaded 22282 existing records from primary storage. [2025-10-21T19:25:58.455877] [INFO ] [MAIN ] IX: Loaded 22282 existing records. [2025-10-21T19:25:58.556203] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-21T19:25:58.645075] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:25:58.645303] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-21T19:25:58.645353] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-21T19:25:58.645551] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-21T19:25:58.645609] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-21T19:25:59.038733] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:25:59.351002] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-21T19:25:59.723823] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T19:25:59.855930] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T19:26:00.151028] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-21T19:26:00.951040] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-21T19:26:01.526675] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T19:26:01.728403] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T19:26:01.750984] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-21T19:26:02.052186] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T19:26:02.551023] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-21T19:26:03.351008] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-21T19:26:03.644537] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T19:26:03.652472] [INFO ] [REMOTE ] IVR: Full fetch complete (69105 records). [2025-10-21T19:26:03.652598] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-21T19:26:04.015034] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:26:04.056994] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T19:26:04.146850] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-21T19:26:04.146932] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-21T19:26:04.147990] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-21T19:26:04.148063] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-21T19:26:04.149542] [DEBUG] [LOCAL ] IVR: Trimmed 69105 records to 47886 (keeping 200 days of data) [2025-10-21T19:26:04.200223] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-21T19:26:04.451794] [DEBUG] [LOCAL ] IVR: Primary data saved (47886 records). [2025-10-21T19:26:04.452204] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-21T19:26:04.452308] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols completed. IVR took 33.8s. Estimated remaining: 2h 38m 37s. Rate: 7.8 symbols/min [2025-10-21T19:26:04.644039] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:04.686369] [DEBUG] [LOCAL ] J: Loaded 40502 existing records from primary storage. [2025-10-21T19:26:04.686674] [INFO ] [MAIN ] J: Loaded 40502 existing records. [2025-10-21T19:26:04.889506] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:04.889765] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-21T19:26:04.889822] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-21T19:26:04.890246] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-21T19:26:04.890304] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-21T19:26:04.956308] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-21T19:26:05.290889] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:05.652492] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T19:26:05.658386] [INFO ] [REMOTE ] IVT: Full fetch complete (45814 records). [2025-10-21T19:26:05.658469] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-21T19:26:05.756235] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-21T19:26:06.034377] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-21T19:26:06.034453] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-21T19:26:06.035272] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-21T19:26:06.035356] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-21T19:26:06.036293] [DEBUG] [LOCAL ] IVT: Trimmed 45814 records to 31476 (keeping 200 days of data) [2025-10-21T19:26:06.230710] [DEBUG] [LOCAL ] IVT: Primary data saved (31476 records). [2025-10-21T19:26:06.230899] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-21T19:26:06.231589] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols completed. IVT took 30.7s. Estimated remaining: 2h 38m 23s. Rate: 7.8 symbols/min [2025-10-21T19:26:06.401904] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:06.443835] [DEBUG] [LOCAL ] JBGS: Loaded 41953 existing records from primary storage. [2025-10-21T19:26:06.444122] [INFO ] [MAIN ] JBGS: Loaded 41953 existing records. [2025-10-21T19:26:06.556308] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-21T19:26:06.626371] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:06.626616] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-21T19:26:06.626774] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-21T19:26:06.627014] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-21T19:26:06.627070] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-21T19:26:06.906024] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:26:07.052762] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:07.351017] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-21T19:26:07.440833] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T19:26:07.487672] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T19:26:08.151031] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-21T19:26:08.951042] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-21T19:26:09.236682] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:26:09.462927] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T19:26:09.751029] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-21T19:26:09.854631] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T19:26:10.551034] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-21T19:26:11.103696] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T19:26:11.350995] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-21T19:26:11.739183] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T19:26:12.151064] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-21T19:26:12.821327] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T19:26:12.951000] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-21T19:26:13.146611] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T19:26:13.751106] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-21T19:26:14.383479] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T19:26:14.551013] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-21T19:26:15.351047] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-21T19:26:15.405790] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:26:16.156157] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-21T19:26:16.172595] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T19:26:16.889570] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:26:16.950985] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-21T19:26:17.751050] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-21T19:26:17.906403] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:26:18.551069] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-21T19:26:18.620269] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:26:18.962359] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T19:26:19.351099] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-21T19:26:20.012753] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T19:26:20.020972] [INFO ] [REMOTE ] IVZ: Full fetch complete (77036 records). [2025-10-21T19:26:20.021096] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-21T19:26:20.164904] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-21T19:26:20.421878] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-21T19:26:20.422038] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-21T19:26:20.423167] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-21T19:26:20.423245] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-21T19:26:20.443818] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:26:20.450121] [DEBUG] [LOCAL ] IVZ: Trimmed 77036 records to 53133 (keeping 200 days of data) [2025-10-21T19:26:20.762523] [DEBUG] [LOCAL ] IVZ: Primary data saved (53133 records). [2025-10-21T19:26:20.762679] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-21T19:26:20.763582] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols completed. IVZ took 34.0s. Estimated remaining: 2h 38m 23s. Rate: 7.8 symbols/min [2025-10-21T19:26:20.938514] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:20.951059] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-21T19:26:20.981762] [DEBUG] [LOCAL ] JBI: Loaded 42783 existing records from primary storage. [2025-10-21T19:26:20.982052] [INFO ] [MAIN ] JBI: Loaded 42783 existing records. [2025-10-21T19:26:21.165361] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:21.165550] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-21T19:26:21.165596] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-21T19:26:21.165811] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-21T19:26:21.165867] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-21T19:26:21.543606] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:21.712067] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T19:26:21.750978] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-21T19:26:22.016805] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T19:26:22.551031] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-21T19:26:23.351251] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T19:26:23.351390] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-21T19:26:23.993927] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:26:24.151027] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-21T19:26:24.676620] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:26:24.951041] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-21T19:26:25.589837] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T19:26:25.705867] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T19:26:25.750982] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-21T19:26:26.551070] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-21T19:26:26.845788] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T19:26:26.849395] [INFO ] [REMOTE ] IX: Full fetch complete (28589 records). [2025-10-21T19:26:26.849492] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-21T19:26:27.215992] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-21T19:26:27.216069] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-21T19:26:27.216636] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-21T19:26:27.216715] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-21T19:26:27.217429] [DEBUG] [LOCAL ] IX: Trimmed 28589 records to 22198 (keeping 200 days of data) [2025-10-21T19:26:27.344837] [DEBUG] [LOCAL ] IX: Primary data saved (22198 records). [2025-10-21T19:26:27.344962] [INFO ] [MAIN ] IX: Full history saved. [2025-10-21T19:26:27.345041] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols completed. IX took 29.1s. Estimated remaining: 2h 38m 14s. Rate: 7.8 symbols/min [2025-10-21T19:26:27.356184] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-21T19:26:27.538295] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:27.583540] [DEBUG] [LOCAL ] JBL: Loaded 48383 existing records from primary storage. [2025-10-21T19:26:27.583853] [INFO ] [MAIN ] JBL: Loaded 48383 existing records. [2025-10-21T19:26:27.762145] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:27.762327] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-21T19:26:27.762375] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-21T19:26:27.762559] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-21T19:26:27.762595] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-21T19:26:28.151055] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-21T19:26:28.168710] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T19:26:28.183901] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:28.798210] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T19:26:28.951051] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-21T19:26:29.750994] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-21T19:26:29.782801] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T19:26:30.380771] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T19:26:30.551077] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-21T19:26:31.151701] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:26:31.351041] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-21T19:26:31.511955] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T19:26:32.151011] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-21T19:26:32.768601] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T19:26:32.774339] [INFO ] [REMOTE ] JBGS: Full fetch complete (59201 records). [2025-10-21T19:26:32.774459] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-21T19:26:32.960149] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-21T19:26:33.155815] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-21T19:26:33.155889] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-21T19:26:33.156741] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-21T19:26:33.156801] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-21T19:26:33.157887] [DEBUG] [LOCAL ] JBGS: Trimmed 59201 records to 41810 (keeping 200 days of data) [2025-10-21T19:26:33.405258] [DEBUG] [LOCAL ] JBGS: Primary data saved (41810 records). [2025-10-21T19:26:33.405458] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-21T19:26:33.406094] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols completed. JBGS took 27.2s. Estimated remaining: 2h 38m 4s. Rate: 7.8 symbols/min [2025-10-21T19:26:33.576877] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:33.605435] [DEBUG] [LOCAL ] JBND: Loaded 27243 existing records from primary storage. [2025-10-21T19:26:33.605745] [INFO ] [MAIN ] JBND: Loaded 27243 existing records. [2025-10-21T19:26:33.751673] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-21T19:26:33.787024] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:33.787476] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-21T19:26:33.787583] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-21T19:26:33.787871] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-21T19:26:33.787942] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-21T19:26:33.963689] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:26:34.053584] [INFO ] [REMOTE ] J: Full fetch complete (59778 records). [2025-10-21T19:26:34.064946] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-21T19:26:34.286835] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:34.554500] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-21T19:26:34.554935] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-21T19:26:34.555822] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-21T19:26:34.556818] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-21T19:26:34.556992] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-21T19:26:34.558315] [DEBUG] [LOCAL ] J: Trimmed 59778 records to 40509 (keeping 200 days of data) [2025-10-21T19:26:34.814864] [DEBUG] [LOCAL ] J: Primary data saved (40509 records). [2025-10-21T19:26:34.815101] [INFO ] [MAIN ] J: Full history saved. [2025-10-21T19:26:34.815244] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols completed. J took 30.4s. Estimated remaining: 2h 37m 50s. Rate: 7.8 symbols/min [2025-10-21T19:26:34.925747] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T19:26:35.027101] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:35.027371] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-21T19:26:35.027441] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-21T19:26:35.027678] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-21T19:26:35.027745] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-21T19:26:35.027916] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-21T19:26:35.028044] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-21T19:26:35.154741] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T19:26:35.356183] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-21T19:26:35.419998] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:35.611338] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T19:26:36.151041] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-21T19:26:36.369617] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:26:36.369960] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-21T19:26:36.370049] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:26:36.370098] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-21T19:26:36.370157] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:26:36.370228] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-21T19:26:36.370290] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-21T19:26:36.370324] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-21T19:26:36.370362] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-21T19:26:36.370450] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols completed. JBS took 1.6s. Estimated remaining: 2h 37m 36s. Rate: 7.8 symbols/min [2025-10-21T19:26:36.539083] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:36.539225] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-21T19:26:36.539261] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-21T19:26:36.539365] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-21T19:26:36.539427] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-21T19:26:36.539494] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-21T19:26:36.539537] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-21T19:26:36.897054] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:36.939970] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:26:36.950988] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-21T19:26:37.750994] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-21T19:26:38.186499] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T19:26:38.255298] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T19:26:38.551005] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-21T19:26:39.351040] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-21T19:26:39.544580] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:26:40.151074] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-21T19:26:40.951050] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-21T19:26:41.031061] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:26:41.450624] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:26:41.751035] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-21T19:26:42.272317] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T19:26:42.551098] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-21T19:26:43.296545] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T19:26:43.350984] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-21T19:26:43.590132] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T19:26:44.151008] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-21T19:26:44.626418] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-21T19:26:44.951073] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-21T19:26:45.611047] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T19:26:45.750984] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-21T19:26:46.550986] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-21T19:26:46.722237] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T19:26:47.187635] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T19:26:47.351028] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-21T19:26:48.059628] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T19:26:48.150990] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-21T19:26:48.803149] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T19:26:48.950982] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-21T19:26:49.211851] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T19:26:49.751096] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-21T19:26:50.335031] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:26:50.551127] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-21T19:26:50.823522] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T19:26:51.351057] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-21T19:26:51.932756] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:26:52.151080] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-21T19:26:52.635522] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:26:52.951072] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-21T19:26:53.554811] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T19:26:53.751002] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-21T19:26:54.249045] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T19:26:54.551038] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-21T19:26:55.354144] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-21T19:26:55.358907] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:26:55.935217] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:26:55.941404] [INFO ] [REMOTE ] JBI: Full fetch complete (63662 records). [2025-10-21T19:26:55.941537] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-21T19:26:56.156142] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-21T19:26:56.333488] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-21T19:26:56.333594] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-21T19:26:56.334736] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-21T19:26:56.334800] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-21T19:26:56.336020] [DEBUG] [LOCAL ] JBI: Trimmed 63662 records to 42692 (keeping 200 days of data) [2025-10-21T19:26:56.577543] [DEBUG] [LOCAL ] JBI: Primary data saved (42692 records). [2025-10-21T19:26:56.577743] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-21T19:26:56.581045] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols completed. JBI took 35.8s. Estimated remaining: 2h 37m 41s. Rate: 7.8 symbols/min [2025-10-21T19:26:56.706900] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T19:26:56.782849] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:56.792172] [DEBUG] [LOCAL ] JCE: Loaded 7308 existing records from primary storage. [2025-10-21T19:26:56.792372] [INFO ] [MAIN ] JCE: Loaded 7308 existing records. [2025-10-21T19:26:56.964555] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-21T19:26:56.969478] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:26:56.970334] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-21T19:26:56.970385] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-21T19:26:56.970558] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-21T19:26:56.970600] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-21T19:26:57.325291] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:26:57.751061] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-21T19:26:57.847452] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:26:58.371861] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T19:26:58.551030] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-21T19:26:59.009531] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T19:26:59.015867] [INFO ] [REMOTE ] JBND: Full fetch complete (35988 records). [2025-10-21T19:26:59.016003] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-21T19:26:59.356333] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-21T19:26:59.426551] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-21T19:26:59.426632] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-21T19:26:59.427378] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-21T19:26:59.427582] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-21T19:26:59.428571] [DEBUG] [LOCAL ] JBND: Trimmed 35988 records to 27324 (keeping 200 days of data) [2025-10-21T19:26:59.595024] [DEBUG] [LOCAL ] JBND: Primary data saved (27324 records). [2025-10-21T19:26:59.595173] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-21T19:26:59.595260] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols completed. JBND took 26.2s. Estimated remaining: 2h 37m 29s. Rate: 7.8 symbols/min [2025-10-21T19:26:59.772672] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:26:59.824410] [DEBUG] [LOCAL ] JCI: Loaded 53523 existing records from primary storage. [2025-10-21T19:26:59.824750] [INFO ] [MAIN ] JCI: Loaded 53523 existing records. [2025-10-21T19:27:00.011222] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T19:27:00.036347] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:00.038885] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-21T19:27:00.039005] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-21T19:27:00.045915] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-21T19:27:00.061397] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-21T19:27:00.063263] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:27:00.160927] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-21T19:27:00.499260] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:00.951042] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-21T19:27:01.751043] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-21T19:27:02.324264] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T19:27:02.551054] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-21T19:27:02.748202] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T19:27:03.095144] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T19:27:03.351027] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-21T19:27:03.862190] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-21T19:27:04.151013] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-21T19:27:04.312995] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T19:27:04.951079] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-21T19:27:05.751008] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-21T19:27:05.895579] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:27:06.551068] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-21T19:27:06.730530] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T19:27:06.909881] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-21T19:27:06.970979] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:27:06.977585] [INFO ] [REMOTE ] JBTM: Full fetch complete (47194 records). [2025-10-21T19:27:06.977741] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-21T19:27:07.356948] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-21T19:27:07.360575] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-21T19:27:07.360696] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-21T19:27:07.361573] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-21T19:27:07.361777] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-21T19:27:07.362765] [DEBUG] [LOCAL ] JBTM: Trimmed 47194 records to 33651 (keeping 200 days of data) [2025-10-21T19:27:07.564467] [DEBUG] [LOCAL ] JBTM: Primary data saved (33651 records). [2025-10-21T19:27:07.564611] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-21T19:27:07.564714] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols completed. JBTM took 31.2s. Estimated remaining: 2h 37m 21s. Rate: 7.8 symbols/min [2025-10-21T19:27:07.730694] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:07.772253] [DEBUG] [LOCAL ] JEF: Loaded 50184 existing records from primary storage. [2025-10-21T19:27:07.772541] [INFO ] [MAIN ] JEF: Loaded 50184 existing records. [2025-10-21T19:27:07.951893] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:07.952129] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-21T19:27:07.952181] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-21T19:27:07.952440] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-21T19:27:07.952496] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-21T19:27:08.157181] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-21T19:27:08.254330] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T19:27:08.317699] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:08.951022] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-21T19:27:09.513176] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T19:27:09.751006] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-21T19:27:10.128066] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T19:27:10.551067] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-21T19:27:10.661256] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:27:10.668996] [INFO ] [REMOTE ] JBL: Full fetch complete (70639 records). [2025-10-21T19:27:10.669159] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-21T19:27:11.051528] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-21T19:27:11.051685] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-21T19:27:11.052624] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-21T19:27:11.052775] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-21T19:27:11.058485] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-21T19:27:11.061162] [DEBUG] [LOCAL ] JBL: Trimmed 70639 records to 48345 (keeping 200 days of data) [2025-10-21T19:27:11.351017] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-21T19:27:11.355225] [DEBUG] [LOCAL ] JBL: Primary data saved (48345 records). [2025-10-21T19:27:11.355467] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-21T19:27:11.355947] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols completed. JBL took 44.0s. Estimated remaining: 2h 37m 9s. Rate: 7.8 symbols/min [2025-10-21T19:27:11.526146] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:11.567209] [DEBUG] [LOCAL ] JELD: Loaded 46009 existing records from primary storage. [2025-10-21T19:27:11.567512] [INFO ] [MAIN ] JELD: Loaded 46009 existing records. [2025-10-21T19:27:11.759091] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:11.759302] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-21T19:27:11.759379] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-21T19:27:11.759807] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-21T19:27:11.759881] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-21T19:27:12.141597] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:12.150978] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-21T19:27:12.951062] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-21T19:27:13.421693] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T19:27:13.552750] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:27:13.751017] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-21T19:27:14.361623] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T19:27:14.534943] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T19:27:14.550983] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-21T19:27:15.158350] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:27:15.351001] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-21T19:27:16.151031] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-21T19:27:16.951002] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-21T19:27:17.268278] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T19:27:17.340580] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:27:17.751027] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-21T19:27:18.551023] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-21T19:27:18.707099] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T19:27:18.854857] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:27:19.351020] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-21T19:27:20.151003] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-21T19:27:20.364715] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:27:20.951014] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-21T19:27:21.109580] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:27:21.751052] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-21T19:27:21.894346] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:27:22.550995] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-21T19:27:22.895257] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T19:27:23.350983] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-21T19:27:23.541739] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:27:24.151059] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-21T19:27:24.216443] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T19:27:24.951035] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-21T19:27:25.217679] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:27:25.355147] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T19:27:25.751004] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-21T19:27:26.120033] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T19:27:26.551029] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-21T19:27:27.360191] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-21T19:27:27.367660] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T19:27:28.151021] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-21T19:27:28.398693] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T19:27:28.951058] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-21T19:27:28.987972] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T19:27:29.391428] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T19:27:29.400949] [INFO ] [REMOTE ] JCI: Full fetch complete (77648 records). [2025-10-21T19:27:29.401166] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-21T19:27:29.751812] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-21T19:27:29.980731] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-21T19:27:29.980849] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-21T19:27:29.982589] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-21T19:27:29.983307] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-21T19:27:29.986743] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:27:29.999474] [DEBUG] [LOCAL ] JCI: Trimmed 77648 records to 53519 (keeping 200 days of data) [2025-10-21T19:27:30.334283] [DEBUG] [LOCAL ] JCI: Primary data saved (53519 records). [2025-10-21T19:27:30.334423] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-21T19:27:30.334503] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols completed. JCI took 30.7s. Estimated remaining: 2h 37m 13s. Rate: 7.8 symbols/min [2025-10-21T19:27:30.518036] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:30.547238] [DEBUG] [LOCAL ] JFR: Loaded 30952 existing records from primary storage. [2025-10-21T19:27:30.547500] [INFO ] [MAIN ] JFR: Loaded 30952 existing records. [2025-10-21T19:27:30.559105] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-21T19:27:30.667371] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T19:27:30.748372] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:30.748602] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-21T19:27:30.748690] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-21T19:27:30.748931] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-21T19:27:30.748988] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-21T19:27:31.121332] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:31.351065] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-21T19:27:32.151040] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-21T19:27:32.236169] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:27:32.823212] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T19:27:32.950987] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-21T19:27:33.046097] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:27:33.048536] [INFO ] [REMOTE ] JCE: Full fetch complete (9691 records). [2025-10-21T19:27:33.048618] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-21T19:27:33.407858] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-21T19:27:33.407954] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-21T19:27:33.408221] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-21T19:27:33.408260] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-21T19:27:33.408880] [DEBUG] [LOCAL ] JCE: Trimmed 9691 records to 7278 (keeping 200 days of data) [2025-10-21T19:27:33.452887] [DEBUG] [LOCAL ] JCE: Primary data saved (7278 records). [2025-10-21T19:27:33.453025] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-21T19:27:33.453144] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols completed. JCE took 36.9s. Estimated remaining: 2h 37m 1s. Rate: 7.8 symbols/min [2025-10-21T19:27:33.620774] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:33.635013] [DEBUG] [LOCAL ] JGH: Loaded 12697 existing records from primary storage. [2025-10-21T19:27:33.635232] [INFO ] [MAIN ] JGH: Loaded 12697 existing records. [2025-10-21T19:27:33.756250] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-21T19:27:33.818540] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:33.818908] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-21T19:27:33.818961] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-21T19:27:33.819114] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-21T19:27:33.819164] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-21T19:27:34.166110] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:34.550990] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-21T19:27:34.666910] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T19:27:35.351005] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-21T19:27:35.444350] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:27:35.544142] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T19:27:36.151041] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-21T19:27:36.951002] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-21T19:27:37.065147] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:27:37.073900] [INFO ] [REMOTE ] JEF: Full fetch complete (73341 records). [2025-10-21T19:27:37.074045] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-21T19:27:37.473495] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-21T19:27:37.473596] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-21T19:27:37.474728] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-21T19:27:37.474808] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-21T19:27:37.492911] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T19:27:37.499591] [DEBUG] [LOCAL ] JEF: Trimmed 73341 records to 50196 (keeping 200 days of data) [2025-10-21T19:27:37.500339] [INFO ] [REMOTE ] JELD: Full fetch complete (64585 records). [2025-10-21T19:27:37.500601] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-21T19:27:37.773721] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-21T19:27:38.107741] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-21T19:27:38.109229] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-21T19:27:38.117850] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-21T19:27:38.118197] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-21T19:27:38.148518] [DEBUG] [LOCAL ] JELD: Trimmed 64585 records to 45921 (keeping 200 days of data) [2025-10-21T19:27:38.261384] [DEBUG] [LOCAL ] JEF: Primary data saved (50196 records). [2025-10-21T19:27:38.286903] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-21T19:27:38.287049] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols completed. JEF took 30.7s. Estimated remaining: 2h 36m 50s. Rate: 7.8 symbols/min [2025-10-21T19:27:38.626504] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T19:27:38.659253] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T19:27:38.678131] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:38.678992] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-21T19:27:38.674070] [DEBUG] [LOCAL ] JELD: Primary data saved (45921 records). [2025-10-21T19:27:38.688032] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-21T19:27:38.688167] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols completed. JELD took 27.3s. Estimated remaining: 2h 36m 35s. Rate: 7.8 symbols/min [2025-10-21T19:27:38.873801] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:38.879012] [DEBUG] [LOCAL ] JHI: Loaded 4157 existing records from primary storage. [2025-10-21T19:27:38.879229] [INFO ] [MAIN ] JHI: Loaded 4157 existing records. [2025-10-21T19:27:39.004889] [DEBUG] [LOCAL ] JHG: Loaded 47569 existing records from primary storage. [2025-10-21T19:27:39.015512] [INFO ] [MAIN ] JHG: Loaded 47569 existing records. [2025-10-21T19:27:39.153716] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:39.171750] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-21T19:27:39.171830] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-21T19:27:39.184316] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-21T19:27:39.184445] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-21T19:27:39.355798] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-21T19:27:39.388302] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:39.405459] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-21T19:27:39.432992] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-21T19:27:39.462508] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T19:27:39.462588] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-21T19:27:39.500346] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-21T19:27:39.867018] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:40.047169] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:40.151015] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-21T19:27:40.868890] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T19:27:40.951011] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-21T19:27:41.707193] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:27:41.751115] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-21T19:27:42.307279] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T19:27:42.329215] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:27:42.551058] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-21T19:27:43.295605] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T19:27:43.351029] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-21T19:27:44.126739] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T19:27:44.151020] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-21T19:27:44.910545] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T19:27:44.951047] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-21T19:27:45.681844] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:27:45.750987] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-21T19:27:46.540673] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T19:27:46.550985] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-21T19:27:47.316240] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:27:47.350981] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-21T19:27:48.163011] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-21T19:27:48.167391] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T19:27:48.950995] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-21T19:27:49.315551] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:27:49.408311] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-21T19:27:49.751038] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-21T19:27:50.316230] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T19:27:50.551077] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-21T19:27:51.148996] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T19:27:51.351046] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-21T19:27:51.977421] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T19:27:52.151063] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-21T19:27:52.951063] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-21T19:27:53.228027] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T19:27:53.232082] [INFO ] [REMOTE ] JGH: Full fetch complete (16419 records). [2025-10-21T19:27:53.232153] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-21T19:27:53.589749] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-21T19:27:53.589827] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-21T19:27:53.590167] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-21T19:27:53.590207] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-21T19:27:53.590747] [DEBUG] [LOCAL ] JGH: Trimmed 16419 records to 12652 (keeping 200 days of data) [2025-10-21T19:27:53.666427] [DEBUG] [LOCAL ] JGH: Primary data saved (12652 records). [2025-10-21T19:27:53.666555] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-21T19:27:53.666629] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols completed. JGH took 20.2s. Estimated remaining: 2h 36m 35s. Rate: 7.8 symbols/min [2025-10-21T19:27:53.757540] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-21T19:27:53.839361] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:27:53.844550] [DEBUG] [LOCAL ] JHS: Loaded 2931 existing records from primary storage. [2025-10-21T19:27:53.844724] [INFO ] [MAIN ] JHS: Loaded 2931 existing records. [2025-10-21T19:27:54.025618] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:27:54.025945] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-21T19:27:54.025998] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-21T19:27:54.026150] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-21T19:27:54.026206] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-21T19:27:54.328698] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T19:27:54.406791] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:27:54.550999] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-21T19:27:55.097150] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T19:27:55.287980] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T19:27:55.350996] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-21T19:27:56.151045] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-21T19:27:56.693974] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T19:27:56.962677] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-21T19:27:56.968494] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:27:57.445783] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T19:27:57.751015] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-21T19:27:58.551063] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-21T19:27:59.117866] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T19:27:59.351001] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-21T19:27:59.433754] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:27:59.815140] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-21T19:28:00.151024] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-21T19:28:00.951083] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-21T19:28:01.751001] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-21T19:28:02.024369] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T19:28:02.130750] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T19:28:02.190437] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-21T19:28:02.551034] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-21T19:28:02.997896] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T19:28:03.351032] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-21T19:28:03.770793] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-21T19:28:04.151018] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-21T19:28:04.951068] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-21T19:28:05.734819] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T19:28:05.735771] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:28:05.747310] [INFO ] [REMOTE ] JHI: Full fetch complete (5813 records). [2025-10-21T19:28:05.747820] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-21T19:28:05.759450] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-21T19:28:06.103421] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-21T19:28:06.103492] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-21T19:28:06.103628] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-21T19:28:06.103700] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-21T19:28:06.104050] [DEBUG] [LOCAL ] JHI: Trimmed 5813 records to 4184 (keeping 200 days of data) [2025-10-21T19:28:06.131175] [DEBUG] [LOCAL ] JHI: Primary data saved (4184 records). [2025-10-21T19:28:06.131260] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-21T19:28:06.131339] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols completed. JHI took 27.4s. Estimated remaining: 2h 36m 32s. Rate: 7.8 symbols/min [2025-10-21T19:28:06.307283] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:06.353619] [DEBUG] [LOCAL ] JHX: Loaded 53195 existing records from primary storage. [2025-10-21T19:28:06.353933] [INFO ] [MAIN ] JHX: Loaded 53195 existing records. [2025-10-21T19:28:06.526871] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:06.527061] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-21T19:28:06.527106] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-21T19:28:06.527411] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-21T19:28:06.527466] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-21T19:28:06.557677] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-21T19:28:06.884107] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:07.182369] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T19:28:07.351027] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-21T19:28:08.151011] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-21T19:28:08.320904] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T19:28:08.395528] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:28:08.951019] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-21T19:28:09.481575] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T19:28:09.751010] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-21T19:28:09.775736] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T19:28:10.230391] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-21T19:28:10.551048] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-21T19:28:11.131204] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:28:11.351018] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-21T19:28:11.973260] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T19:28:12.151064] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-21T19:28:12.951030] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-21T19:28:13.395352] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T19:28:13.751021] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-21T19:28:14.293219] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T19:28:14.551044] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-21T19:28:15.161007] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T19:28:15.166839] [INFO ] [REMOTE ] JFR: Full fetch complete (48379 records). [2025-10-21T19:28:15.166957] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-21T19:28:15.357022] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-21T19:28:15.568879] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-21T19:28:15.568954] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-21T19:28:15.569728] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-21T19:28:15.569790] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-21T19:28:15.570700] [DEBUG] [LOCAL ] JFR: Trimmed 48379 records to 31046 (keeping 200 days of data) [2025-10-21T19:28:15.750703] [DEBUG] [LOCAL ] JFR: Primary data saved (31046 records). [2025-10-21T19:28:15.750836] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-21T19:28:15.750924] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols completed. JFR took 45.4s. Estimated remaining: 2h 36m 26s. Rate: 7.8 symbols/min [2025-10-21T19:28:15.922267] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:15.938374] [DEBUG] [LOCAL ] JILL: Loaded 15604 existing records from primary storage. [2025-10-21T19:28:15.938576] [INFO ] [MAIN ] JILL: Loaded 15604 existing records. [2025-10-21T19:28:16.117611] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:16.117848] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-21T19:28:16.117916] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-21T19:28:16.118145] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-21T19:28:16.118202] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-21T19:28:16.162732] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-21T19:28:16.492009] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:16.520606] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T19:28:16.682138] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-21T19:28:16.961149] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-21T19:28:16.964045] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T19:28:17.751019] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-21T19:28:17.765222] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T19:28:18.317668] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T19:28:18.550999] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-21T19:28:19.351061] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-21T19:28:20.151127] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-21T19:28:20.299041] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T19:28:20.317230] [INFO ] [REMOTE ] JHG: Full fetch complete (68627 records). [2025-10-21T19:28:20.317605] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T19:28:20.318077] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-21T19:28:20.735030] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-21T19:28:20.735111] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-21T19:28:20.736128] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-21T19:28:20.736190] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-21T19:28:20.737504] [DEBUG] [LOCAL ] JHG: Trimmed 68627 records to 47511 (keeping 200 days of data) [2025-10-21T19:28:20.951713] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-21T19:28:21.017508] [DEBUG] [LOCAL ] JHG: Primary data saved (47511 records). [2025-10-21T19:28:21.017692] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-21T19:28:21.018121] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols completed. JHG took 42.7s. Estimated remaining: 2h 36m 16s. Rate: 7.8 symbols/min [2025-10-21T19:28:21.187420] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:21.225034] [DEBUG] [LOCAL ] JKS: Loaded 39426 existing records from primary storage. [2025-10-21T19:28:21.225324] [INFO ] [MAIN ] JKS: Loaded 39426 existing records. [2025-10-21T19:28:21.399790] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:21.400013] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-21T19:28:21.400061] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-21T19:28:21.400257] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-21T19:28:21.400312] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-21T19:28:21.755005] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-21T19:28:21.759960] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:21.987071] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T19:28:22.020059] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T19:28:22.357083] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T19:28:22.358204] [INFO ] [REMOTE ] JHS: Full fetch complete (4530 records). [2025-10-21T19:28:22.358274] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-21T19:28:22.556798] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-21T19:28:22.723479] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-21T19:28:22.723554] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-21T19:28:22.723708] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-21T19:28:22.723766] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-21T19:28:22.724103] [DEBUG] [LOCAL ] JHS: Trimmed 4530 records to 2986 (keeping 200 days of data) [2025-10-21T19:28:22.741622] [DEBUG] [LOCAL ] JHS: Primary data saved (2986 records). [2025-10-21T19:28:22.741711] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-21T19:28:22.741787] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols completed. JHS took 29.1s. Estimated remaining: 2h 36m 2s. Rate: 7.8 symbols/min [2025-10-21T19:28:22.916846] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:22.949413] [DEBUG] [LOCAL ] JLL: Loaded 31753 existing records from primary storage. [2025-10-21T19:28:22.949703] [INFO ] [MAIN ] JLL: Loaded 31753 existing records. [2025-10-21T19:28:23.133529] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:23.133792] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-21T19:28:23.133842] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-21T19:28:23.134022] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-21T19:28:23.134092] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-21T19:28:23.356103] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-21T19:28:23.507285] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:23.710271] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T19:28:24.151082] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-21T19:28:24.951079] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-21T19:28:25.014543] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T19:28:25.194744] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T19:28:25.751036] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-21T19:28:26.555249] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-21T19:28:26.560358] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:28:26.785603] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T19:28:27.351009] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-21T19:28:27.924577] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:28:28.151088] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-21T19:28:28.840118] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:28:28.951010] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-21T19:28:29.510777] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:28:29.751081] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-21T19:28:30.505997] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T19:28:30.550988] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-21T19:28:30.655595] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T19:28:31.351025] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-21T19:28:32.150995] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-21T19:28:32.287261] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T19:28:32.951024] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-21T19:28:33.192826] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:28:33.475633] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T19:28:33.751026] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-21T19:28:34.541783] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:28:34.550974] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-21T19:28:35.351036] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-21T19:28:35.613091] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T19:28:35.914896] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T19:28:36.151040] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-21T19:28:36.806783] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T19:28:36.950990] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-21T19:28:37.106134] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T19:28:37.751038] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-21T19:28:38.396416] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T19:28:38.551031] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-21T19:28:39.231538] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T19:28:39.351027] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-21T19:28:39.927338] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T19:28:40.151028] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-21T19:28:40.951004] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-21T19:28:41.205701] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T19:28:41.213868] [INFO ] [REMOTE ] JHX: Full fetch complete (62291 records). [2025-10-21T19:28:41.213985] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-21T19:28:41.608473] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-21T19:28:41.608633] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-21T19:28:41.609591] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-21T19:28:41.609714] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-21T19:28:41.611195] [DEBUG] [LOCAL ] JHX: Trimmed 62291 records to 53200 (keeping 200 days of data) [2025-10-21T19:28:41.736736] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:28:41.751868] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-21T19:28:41.966880] [DEBUG] [LOCAL ] JHX: Primary data saved (53200 records). [2025-10-21T19:28:41.967008] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-21T19:28:41.967086] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols completed. JHX took 35.8s. Estimated remaining: 2h 36m 6s. Rate: 7.8 symbols/min [2025-10-21T19:28:42.083888] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T19:28:42.160299] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:42.166847] [DEBUG] [LOCAL ] JLS: Loaded 4066 existing records from primary storage. [2025-10-21T19:28:42.167022] [INFO ] [MAIN ] JLS: Loaded 4066 existing records. [2025-10-21T19:28:42.344427] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:42.344685] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-21T19:28:42.344754] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-21T19:28:42.344897] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-21T19:28:42.344936] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-21T19:28:42.559905] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-21T19:28:42.714290] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:43.254867] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T19:28:43.350995] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-21T19:28:43.851610] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T19:28:44.151087] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-21T19:28:44.913358] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T19:28:44.913545] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T19:28:44.921610] [INFO ] [REMOTE ] JKS: Full fetch complete (58723 records). [2025-10-21T19:28:44.921781] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-21T19:28:44.956118] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-21T19:28:45.337142] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-21T19:28:45.337223] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-21T19:28:45.338124] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-21T19:28:45.338188] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-21T19:28:45.339325] [DEBUG] [LOCAL ] JKS: Trimmed 58723 records to 39289 (keeping 200 days of data) [2025-10-21T19:28:45.583380] [DEBUG] [LOCAL ] JKS: Primary data saved (39289 records). [2025-10-21T19:28:45.583510] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-21T19:28:45.583592] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols completed. JKS took 24.6s. Estimated remaining: 2h 35m 54s. Rate: 7.8 symbols/min [2025-10-21T19:28:45.661956] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T19:28:45.757700] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:45.757760] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-21T19:28:45.805626] [DEBUG] [LOCAL ] JMIA: Loaded 51222 existing records from primary storage. [2025-10-21T19:28:45.805971] [INFO ] [MAIN ] JMIA: Loaded 51222 existing records. [2025-10-21T19:28:45.986094] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:28:45.986287] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-21T19:28:45.986334] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-21T19:28:45.986518] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-21T19:28:45.986554] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-21T19:28:46.347813] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:46.378473] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:28:46.550999] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-21T19:28:47.351100] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-21T19:28:47.727425] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-21T19:28:48.021234] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:28:48.150988] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-21T19:28:48.951044] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-21T19:28:49.599507] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T19:28:49.751013] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-21T19:28:49.940813] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T19:28:50.551075] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-21T19:28:51.140756] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:28:51.351008] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-21T19:28:51.481388] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T19:28:51.483973] [INFO ] [REMOTE ] JILL: Full fetch complete (22371 records). [2025-10-21T19:28:51.484064] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-21T19:28:51.856490] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-21T19:28:51.856578] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-21T19:28:51.857060] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-21T19:28:51.857122] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-21T19:28:51.857983] [DEBUG] [LOCAL ] JILL: Trimmed 22371 records to 15442 (keeping 200 days of data) [2025-10-21T19:28:51.948377] [DEBUG] [LOCAL ] JILL: Primary data saved (15442 records). [2025-10-21T19:28:51.948503] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-21T19:28:51.948579] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols completed. JILL took 36.2s. Estimated remaining: 2h 35m 45s. Rate: 7.8 symbols/min [2025-10-21T19:28:52.114511] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:28:52.114695] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-21T19:28:52.114745] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-21T19:28:52.114852] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-21T19:28:52.114892] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-21T19:28:52.114932] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-21T19:28:52.114962] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-21T19:28:52.157326] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-21T19:28:52.475693] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:28:52.885188] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:28:52.888080] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T19:28:52.951084] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-21T19:28:53.289827] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-21T19:28:53.751095] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-21T19:28:54.551010] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-21T19:28:55.119059] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:28:55.129500] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T19:28:55.351025] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-21T19:28:56.150998] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-21T19:28:56.507195] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:28:56.511572] [INFO ] [REMOTE ] JLL: Full fetch complete (45067 records). [2025-10-21T19:28:56.511690] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-21T19:28:56.751375] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T19:28:56.898436] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-21T19:28:56.898513] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-21T19:28:56.899336] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-21T19:28:56.899397] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-21T19:28:56.900357] [DEBUG] [LOCAL ] JLL: Trimmed 45067 records to 31598 (keeping 200 days of data) [2025-10-21T19:28:56.958925] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-21T19:28:57.091325] [DEBUG] [LOCAL ] JLL: Primary data saved (31598 records). [2025-10-21T19:28:57.091454] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-21T19:28:57.091534] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols completed. JLL took 34.3s. Estimated remaining: 2h 35m 35s. Rate: 7.8 symbols/min [2025-10-21T19:28:57.751024] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-21T19:28:58.292860] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-21T19:28:58.551084] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-21T19:28:58.749861] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:28:59.098357] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T19:28:59.100184] [INFO ] [REMOTE ] JLS: Full fetch complete (5825 records). [2025-10-21T19:28:59.100281] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-21T19:28:59.356246] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-21T19:28:59.469960] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-21T19:28:59.470041] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-21T19:28:59.470231] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-21T19:28:59.470291] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-21T19:28:59.470679] [DEBUG] [LOCAL ] JLS: Trimmed 5825 records to 4074 (keeping 200 days of data) [2025-10-21T19:28:59.494727] [DEBUG] [LOCAL ] JLS: Primary data saved (4074 records). [2025-10-21T19:28:59.494800] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-21T19:28:59.494869] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols completed. JLS took 17.5s. Estimated remaining: 2h 35m 21s. Rate: 7.8 symbols/min [2025-10-21T19:29:00.151041] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-21T19:29:00.768769] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:29:00.951022] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-21T19:29:01.344820] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-21T19:29:01.348510] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T19:29:01.751051] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-21T19:29:02.551071] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-21T19:29:03.004069] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T19:29:03.351082] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-21T19:29:03.465907] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T19:29:03.839103] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T19:29:04.151048] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-21T19:29:04.951064] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-21T19:29:05.421821] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T19:29:05.751081] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-21T19:29:05.843792] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:29:06.224878] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T19:29:06.551023] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-21T19:29:07.010103] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-21T19:29:07.351053] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-21T19:29:08.151049] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-21T19:29:08.596085] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T19:29:08.951057] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-21T19:29:09.203794] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T19:29:09.442202] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T19:29:09.443142] [INFO ] [REMOTE ] JMM: Full fetch complete (2295 records). [2025-10-21T19:29:09.443215] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-21T19:29:09.642558] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-21T19:29:09.642804] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:29:09.642872] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:29:09.642947] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-21T19:29:09.643014] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-21T19:29:09.643053] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-21T19:29:09.643094] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-21T19:29:09.643157] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols completed. JMM took 17.7s. Estimated remaining: 2h 35m 16s. Rate: 7.8 symbols/min [2025-10-21T19:29:09.751031] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-21T19:29:11.727915] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T19:29:11.740269] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-21T19:29:13.546199] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T19:29:13.558764] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-21T19:29:15.627971] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T19:29:15.636938] [INFO ] [REMOTE ] JMIA: Full fetch complete (73460 records). [2025-10-21T19:29:15.637045] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-21T19:29:16.031610] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-21T19:29:16.031734] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-21T19:29:16.032887] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-21T19:29:16.032954] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-21T19:29:16.034371] [DEBUG] [LOCAL ] JMIA: Trimmed 73460 records to 51203 (keeping 200 days of data) [2025-10-21T19:29:16.330209] [DEBUG] [LOCAL ] JMIA: Primary data saved (51203 records). [2025-10-21T19:29:16.330347] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-21T19:29:16.330437] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols completed. JMIA took 30.7s. Estimated remaining: 2h 35m 7s. Rate: 7.8 symbols/min [2025-10-21T19:29:16.975261] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:16.962448] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:17.038815] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:17.110533] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:17.114472] [DEBUG] [LOCAL ] JOF: Loaded 6925 existing records from primary storage. [2025-10-21T19:29:17.115319] [INFO ] [MAIN ] JOF: Loaded 6925 existing records. [2025-10-21T19:29:17.346780] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:17.348952] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-21T19:29:17.364933] [DEBUG] [LOCAL ] JOE: Loaded 23890 existing records from primary storage. [2025-10-21T19:29:17.364525] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-21T19:29:17.366902] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-21T19:29:17.367264] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-21T19:29:17.367074] [INFO ] [MAIN ] JOE: Loaded 23890 existing records. [2025-10-21T19:29:17.403111] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-21T19:29:17.428493] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-21T19:29:17.463126] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-21T19:29:17.513220] [INFO ] [MAIN ] JOBY: Loaded 53809 existing records. [2025-10-21T19:29:18.033966] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:18.058845] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-21T19:29:18.064740] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-21T19:29:18.058676] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:18.110445] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-21T19:29:18.129758] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-21T19:29:18.168767] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-21T19:29:18.168712] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-21T19:29:18.259793] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-21T19:29:18.262982] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:18.286368] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-21T19:29:18.285968] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-21T19:29:18.302218] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-21T19:29:18.333461] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-21T19:29:18.343842] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-21T19:29:18.528258] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:18.596303] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-21T19:29:19.294797] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:19.346702] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-21T19:29:19.380161] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:19.385397] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-21T19:29:19.420423] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T19:29:19.423585] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:19.427110] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-21T19:29:19.426555] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-21T19:29:20.040609] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T19:29:20.042113] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-21T19:29:20.661088] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T19:29:20.666826] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-21T19:29:20.767005] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T19:29:20.769335] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-21T19:29:21.596389] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-21T19:29:21.607192] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-21T19:29:21.619744] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T19:29:21.622182] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-21T19:29:21.641385] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T19:29:21.646891] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-21T19:29:21.770168] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-21T19:29:21.781300] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-21T19:29:22.271786] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T19:29:22.273535] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-21T19:29:22.703413] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-21T19:29:22.705864] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-21T19:29:22.722985] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:29:23.322892] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T19:29:23.351002] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-21T19:29:23.439269] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T19:29:23.799411] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T19:29:24.151045] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-21T19:29:24.281012] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-21T19:29:24.951020] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-21T19:29:25.476670] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T19:29:25.674876] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T19:29:25.751020] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-21T19:29:26.551014] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-21T19:29:26.720692] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T19:29:27.351032] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-21T19:29:28.151091] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-21T19:29:28.838018] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-21T19:29:28.951006] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-21T19:29:29.310303] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T19:29:29.495201] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-21T19:29:29.751022] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-21T19:29:30.551083] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-21T19:29:31.088155] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T19:29:31.284176] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T19:29:31.285742] [INFO ] [REMOTE ] JOF: Full fetch complete (9471 records). [2025-10-21T19:29:31.285809] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-21T19:29:31.360685] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-21T19:29:31.653710] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-21T19:29:31.653792] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-21T19:29:31.654038] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-21T19:29:31.654077] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-21T19:29:31.654488] [DEBUG] [LOCAL ] JOF: Trimmed 9471 records to 6932 (keeping 200 days of data) [2025-10-21T19:29:31.695956] [DEBUG] [LOCAL ] JOF: Primary data saved (6932 records). [2025-10-21T19:29:31.696064] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-21T19:29:31.696138] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols completed. JOF took 15.3s. Estimated remaining: 2h 35m 8s. Rate: 7.8 symbols/min [2025-10-21T19:29:31.874984] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:31.926288] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T19:29:31.949787] [DEBUG] [LOCAL ] JPC: Loaded 37073 existing records from primary storage. [2025-10-21T19:29:31.950404] [INFO ] [MAIN ] JPC: Loaded 37073 existing records. [2025-10-21T19:29:32.134405] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:32.134617] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-21T19:29:32.134696] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-21T19:29:32.134891] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-21T19:29:32.134930] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-21T19:29:32.156596] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-21T19:29:32.511161] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:32.555126] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:29:32.951032] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-21T19:29:33.751001] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-21T19:29:34.042099] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T19:29:34.446998] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T19:29:34.550992] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-21T19:29:35.351043] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-21T19:29:36.150999] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-21T19:29:36.257951] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-21T19:29:36.475498] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T19:29:36.716393] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T19:29:36.951103] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-21T19:29:37.694485] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T19:29:37.750999] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-21T19:29:38.551049] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-21T19:29:39.123971] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T19:29:39.322829] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-21T19:29:39.350976] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-21T19:29:39.717539] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T19:29:39.721190] [INFO ] [REMOTE ] JOE: Full fetch complete (35550 records). [2025-10-21T19:29:39.721263] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-21T19:29:40.100390] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-21T19:29:40.100463] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-21T19:29:40.101157] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-21T19:29:40.101217] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-21T19:29:40.101972] [DEBUG] [LOCAL ] JOE: Trimmed 35550 records to 23783 (keeping 200 days of data) [2025-10-21T19:29:40.152032] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-21T19:29:40.242263] [DEBUG] [LOCAL ] JOE: Primary data saved (23783 records). [2025-10-21T19:29:40.242380] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-21T19:29:40.242453] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols completed. JOE took 23.9s. Estimated remaining: 2h 35m 1s. Rate: 7.8 symbols/min [2025-10-21T19:29:40.410612] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:40.459025] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-21T19:29:40.459322] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-21T19:29:40.631031] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:40.631267] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-21T19:29:40.631320] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-21T19:29:40.631498] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-21T19:29:40.631535] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-21T19:29:40.953674] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-21T19:29:40.979230] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:41.648190] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-21T19:29:41.674306] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T19:29:41.751016] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-21T19:29:42.551160] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-21T19:29:43.152213] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-21T19:29:43.186026] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:29:43.351002] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-21T19:29:44.151026] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-21T19:29:44.795937] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T19:29:44.830384] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T19:29:44.950991] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-21T19:29:45.751021] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-21T19:29:46.257254] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:29:46.473787] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-21T19:29:46.548808] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T19:29:46.556695] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-21T19:29:46.558672] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-21T19:29:46.558840] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-21T19:29:47.011247] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-21T19:29:47.011340] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-21T19:29:47.012464] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-21T19:29:47.012541] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-21T19:29:47.014201] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-21T19:29:47.355325] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-21T19:29:47.363723] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-21T19:29:47.363968] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-21T19:29:47.364059] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols completed. JNJ took 31.0s. Estimated remaining: 2h 34m 52s. Rate: 7.8 symbols/min [2025-10-21T19:29:47.559447] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:47.590905] [DEBUG] [LOCAL ] JQC: Loaded 33824 existing records from primary storage. [2025-10-21T19:29:47.591181] [INFO ] [MAIN ] JQC: Loaded 33824 existing records. [2025-10-21T19:29:47.770202] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:47.770447] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-21T19:29:47.770514] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-21T19:29:47.770779] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-21T19:29:47.770856] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-21T19:29:48.148096] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:48.150986] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-21T19:29:48.937105] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T19:29:48.950989] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-21T19:29:49.431902] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-10-21T19:29:49.594800] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:29:49.751050] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-21T19:29:50.383113] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T19:29:50.551045] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-21T19:29:50.784366] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:29:51.351052] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-21T19:29:52.151018] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-21T19:29:52.751795] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:29:52.951022] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-21T19:29:53.266528] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-21T19:29:53.572368] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T19:29:53.751038] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-21T19:29:54.378190] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T19:29:54.384456] [INFO ] [REMOTE ] JPC: Full fetch complete (55059 records). [2025-10-21T19:29:54.384611] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-21T19:29:54.564209] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-21T19:29:54.782283] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-21T19:29:54.782381] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-21T19:29:54.783201] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-21T19:29:54.783262] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-21T19:29:54.784349] [DEBUG] [LOCAL ] JPC: Trimmed 55059 records to 37060 (keeping 200 days of data) [2025-10-21T19:29:55.003694] [DEBUG] [LOCAL ] JPC: Primary data saved (37060 records). [2025-10-21T19:29:55.003912] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-21T19:29:55.004065] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols completed. JPC took 23.3s. Estimated remaining: 2h 34m 44s. Rate: 7.8 symbols/min [2025-10-21T19:29:55.179240] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:29:55.196828] [DEBUG] [LOCAL ] JRI: Loaded 15423 existing records from primary storage. [2025-10-21T19:29:55.197066] [INFO ] [MAIN ] JRI: Loaded 15423 existing records. [2025-10-21T19:29:55.402804] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:29:55.372818] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-21T19:29:55.403696] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-21T19:29:55.404024] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-21T19:29:55.406134] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T19:29:55.413574] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-21T19:29:55.413731] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-21T19:29:55.773877] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:29:56.151082] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-21T19:29:56.813118] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-21T19:29:56.951052] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-21T19:29:57.445506] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:29:57.751048] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-21T19:29:58.166094] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-21T19:29:58.550992] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-21T19:29:58.919546] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T19:29:59.186942] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-21T19:29:59.351031] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-21T19:30:00.151080] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-21T19:30:00.951003] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-21T19:30:01.154251] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T19:30:01.315628] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.76 seconds). [2025-10-21T19:30:01.324507] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-21T19:30:01.324718] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-21T19:30:01.751954] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-21T19:30:01.820785] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-21T19:30:01.821043] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-21T19:30:01.822111] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-21T19:30:01.822188] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-21T19:30:01.823752] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53809 (keeping 200 days of data) [2025-10-21T19:30:01.990081] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-10-21T19:30:02.208130] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T19:30:02.309179] [DEBUG] [LOCAL ] JOBY: Primary data saved (53809 records). [2025-10-21T19:30:02.309337] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-21T19:30:02.309419] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols completed. JOBY took 46.0s. Estimated remaining: 2h 34m 36s. Rate: 7.8 symbols/min [2025-10-21T19:30:02.485386] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:02.497857] [DEBUG] [LOCAL ] JRS: Loaded 11623 existing records from primary storage. [2025-10-21T19:30:02.498097] [INFO ] [MAIN ] JRS: Loaded 11623 existing records. [2025-10-21T19:30:02.562199] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-21T19:30:02.681676] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:02.681973] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-21T19:30:02.682029] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-21T19:30:02.682188] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-21T19:30:02.682243] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-21T19:30:02.993723] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T19:30:03.071708] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:03.351027] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-21T19:30:04.150997] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-21T19:30:04.377173] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T19:30:04.633915] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T19:30:04.951016] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-21T19:30:05.470969] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T19:30:05.751025] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-21T19:30:06.542254] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T19:30:06.550975] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-21T19:30:07.182145] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-21T19:30:07.245361] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T19:30:07.350986] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-21T19:30:08.151025] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-21T19:30:08.644384] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T19:30:08.950991] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-21T19:30:09.164464] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T19:30:09.751014] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-21T19:30:09.792225] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-21T19:30:10.551018] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-21T19:30:10.689710] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T19:30:11.351010] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-21T19:30:11.382639] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T19:30:12.151025] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-21T19:30:12.927225] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:30:12.950974] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-21T19:30:13.524533] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T19:30:13.751022] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-21T19:30:13.785086] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T19:30:14.551001] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-21T19:30:14.701188] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T19:30:15.351012] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-21T19:30:15.950450] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T19:30:15.956428] [INFO ] [REMOTE ] JQC: Full fetch complete (49963 records). [2025-10-21T19:30:15.956529] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-21T19:30:16.164541] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-21T19:30:16.369221] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-21T19:30:16.369366] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-21T19:30:16.370350] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-21T19:30:16.370555] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-21T19:30:16.382882] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T19:30:16.387471] [DEBUG] [LOCAL ] JQC: Trimmed 49963 records to 33940 (keeping 200 days of data) [2025-10-21T19:30:16.580416] [DEBUG] [LOCAL ] JQC: Primary data saved (33940 records). [2025-10-21T19:30:16.580546] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-21T19:30:16.580672] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols completed. JQC took 29.2s. Estimated remaining: 2h 34m 35s. Rate: 7.8 symbols/min [2025-10-21T19:30:16.746541] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:16.786241] [DEBUG] [LOCAL ] JXN: Loaded 44551 existing records from primary storage. [2025-10-21T19:30:16.786516] [INFO ] [MAIN ] JXN: Loaded 44551 existing records. [2025-10-21T19:30:16.967394] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:16.961614] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-21T19:30:16.968406] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-21T19:30:16.968471] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-21T19:30:16.969015] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-21T19:30:16.969094] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-21T19:30:17.268804] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T19:30:17.341345] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:17.751077] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-21T19:30:18.551079] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-21T19:30:19.000101] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T19:30:19.054034] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:30:19.305252] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T19:30:19.351020] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-21T19:30:20.151058] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-21T19:30:20.844634] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:30:20.951022] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-21T19:30:20.989257] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T19:30:21.748641] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T19:30:21.751610] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-21T19:30:22.551029] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-21T19:30:23.351021] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-21T19:30:23.467279] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T19:30:24.152714] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-21T19:30:24.158272] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-21T19:30:24.294915] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T19:30:24.298113] [INFO ] [REMOTE ] JRS: Full fetch complete (16214 records). [2025-10-21T19:30:24.298235] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-21T19:30:24.694736] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-21T19:30:24.694857] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-21T19:30:24.695681] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-21T19:30:24.695752] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-21T19:30:24.696611] [DEBUG] [LOCAL ] JRS: Trimmed 16214 records to 11594 (keeping 200 days of data) [2025-10-21T19:30:24.770796] [DEBUG] [LOCAL ] JRS: Primary data saved (11594 records). [2025-10-21T19:30:24.770987] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-21T19:30:24.771085] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols completed. JRS took 22.5s. Estimated remaining: 2h 34m 28s. Rate: 7.8 symbols/min [2025-10-21T19:30:24.956239] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-21T19:30:24.962103] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:25.015478] [DEBUG] [LOCAL ] K: Loaded 50372 existing records from primary storage. [2025-10-21T19:30:25.015849] [INFO ] [MAIN ] K: Loaded 50372 existing records. [2025-10-21T19:30:25.193181] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:25.193385] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-21T19:30:25.193431] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-21T19:30:25.193612] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-21T19:30:25.193687] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-21T19:30:25.549582] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:25.751024] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-21T19:30:25.836712] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T19:30:25.845319] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-21T19:30:25.845561] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-21T19:30:25.978532] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:30:26.273309] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-21T19:30:26.273395] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-21T19:30:26.274407] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-21T19:30:26.274472] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-21T19:30:26.275900] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-21T19:30:26.560388] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-21T19:30:26.611325] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-21T19:30:26.611472] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-21T19:30:26.611553] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols completed. JPM took 46.4s. Estimated remaining: 2h 34m 14s. Rate: 7.8 symbols/min [2025-10-21T19:30:26.784006] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:26.798514] [DEBUG] [LOCAL ] KAI: Loaded 13606 existing records from primary storage. [2025-10-21T19:30:26.798744] [INFO ] [MAIN ] KAI: Loaded 13606 existing records. [2025-10-21T19:30:26.990534] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:26.990770] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-21T19:30:26.990839] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-21T19:30:26.991040] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-21T19:30:26.991096] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-21T19:30:27.358086] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-21T19:30:27.363869] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:27.392515] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:30:27.546380] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:30:27.549512] [INFO ] [REMOTE ] JRI: Full fetch complete (23063 records). [2025-10-21T19:30:27.549585] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-21T19:30:27.915316] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-21T19:30:27.915394] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-21T19:30:27.915906] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-21T19:30:27.915971] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-21T19:30:27.916526] [DEBUG] [LOCAL ] JRI: Trimmed 23063 records to 15402 (keeping 200 days of data) [2025-10-21T19:30:28.021857] [DEBUG] [LOCAL ] JRI: Primary data saved (15402 records). [2025-10-21T19:30:28.022002] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-21T19:30:28.022082] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols completed. JRI took 33.0s. Estimated remaining: 2h 34m 0s. Rate: 7.8 symbols/min [2025-10-21T19:30:28.156103] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-21T19:30:28.202960] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:28.237904] [DEBUG] [LOCAL ] KAR: Loaded 39864 existing records from primary storage. [2025-10-21T19:30:28.238174] [INFO ] [MAIN ] KAR: Loaded 39864 existing records. [2025-10-21T19:30:28.412180] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:28.412369] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-21T19:30:28.412414] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-21T19:30:28.412714] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-21T19:30:28.412770] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-21T19:30:28.769268] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:28.799594] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:30:28.951029] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-21T19:30:29.751082] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-21T19:30:29.803418] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:30:30.551034] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-21T19:30:30.610720] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:30:31.064782] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T19:30:31.351024] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-21T19:30:32.151081] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-21T19:30:32.194993] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:30:32.224420] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T19:30:32.951080] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-21T19:30:33.757287] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-21T19:30:33.760090] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T19:30:34.550996] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-21T19:30:34.628817] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:30:34.686476] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T19:30:35.351076] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-21T19:30:35.931432] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T19:30:36.151075] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-21T19:30:36.293904] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T19:30:36.951070] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-21T19:30:37.626817] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T19:30:37.751063] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-21T19:30:38.444305] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T19:30:38.550988] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-21T19:30:39.351077] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-21T19:30:39.502681] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T19:30:39.893908] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T19:30:40.151097] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-21T19:30:40.433985] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T19:30:40.951051] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-21T19:30:41.476876] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T19:30:41.751028] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-21T19:30:42.369361] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T19:30:42.551048] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-21T19:30:43.290224] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T19:30:43.351000] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-21T19:30:43.507928] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:30:44.151032] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-21T19:30:44.911181] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:30:44.951003] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-21T19:30:45.064041] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T19:30:45.751087] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-21T19:30:46.551003] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-21T19:30:46.686076] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:30:47.334270] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:30:47.350997] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-21T19:30:47.892499] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:30:48.151034] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-21T19:30:48.916431] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T19:30:48.922992] [INFO ] [REMOTE ] JXN: Full fetch complete (65529 records). [2025-10-21T19:30:48.923093] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-21T19:30:48.961148] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-21T19:30:49.360423] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-21T19:30:49.360521] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-21T19:30:49.361914] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-21T19:30:49.361983] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-21T19:30:49.363392] [DEBUG] [LOCAL ] JXN: Trimmed 65529 records to 44418 (keeping 200 days of data) [2025-10-21T19:30:49.657623] [DEBUG] [LOCAL ] JXN: Primary data saved (44418 records). [2025-10-21T19:30:49.657890] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-21T19:30:49.658104] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols completed. JXN took 33.1s. Estimated remaining: 2h 34m 7s. Rate: 7.8 symbols/min [2025-10-21T19:30:49.752386] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-21T19:30:49.859359] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:49.883372] [DEBUG] [LOCAL ] KB: Loaded 23270 existing records from primary storage. [2025-10-21T19:30:49.883684] [INFO ] [MAIN ] KB: Loaded 23270 existing records. [2025-10-21T19:30:50.109332] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T19:30:50.116161] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:50.124277] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-21T19:30:50.124501] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-21T19:30:50.124739] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-21T19:30:50.124908] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-21T19:30:50.124852] [INFO ] [REMOTE ] K: Full fetch complete (72296 records). [2025-10-21T19:30:50.170711] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-21T19:30:50.870554] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:50.914197] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-21T19:30:50.947550] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T19:30:50.982283] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-21T19:30:50.984293] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-21T19:30:50.985413] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-21T19:30:50.983778] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:30:50.985880] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-21T19:30:50.991581] [DEBUG] [LOCAL ] K: Trimmed 72296 records to 50401 (keeping 200 days of data) [2025-10-21T19:30:51.287556] [DEBUG] [LOCAL ] K: Primary data saved (50401 records). [2025-10-21T19:30:51.287717] [INFO ] [MAIN ] K: Full history saved. [2025-10-21T19:30:51.287829] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols completed. K took 26.5s. Estimated remaining: 2h 33m 53s. Rate: 7.8 symbols/min [2025-10-21T19:30:51.356241] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-21T19:30:51.456918] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:51.478664] [DEBUG] [LOCAL ] KBDC: Loaded 22651 existing records from primary storage. [2025-10-21T19:30:51.478911] [INFO ] [MAIN ] KBDC: Loaded 22651 existing records. [2025-10-21T19:30:51.652127] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:51.652360] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-21T19:30:51.652406] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-21T19:30:51.652565] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-21T19:30:51.652602] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-21T19:30:52.050761] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:52.095104] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T19:30:52.150999] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-21T19:30:52.253932] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T19:30:52.951077] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-21T19:30:53.481065] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:30:53.751062] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-21T19:30:54.049153] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T19:30:54.551044] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-21T19:30:54.645869] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T19:30:55.351064] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-21T19:30:55.957395] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T19:30:56.151950] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-21T19:30:56.152946] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T19:30:56.951020] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-21T19:30:57.636068] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:30:57.642394] [INFO ] [REMOTE ] KAR: Full fetch complete (56859 records). [2025-10-21T19:30:57.642516] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-21T19:30:57.754337] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-21T19:30:57.989164] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T19:30:58.073978] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-21T19:30:58.074052] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-21T19:30:58.074922] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-21T19:30:58.074986] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-21T19:30:58.076078] [DEBUG] [LOCAL ] KAR: Trimmed 56859 records to 39768 (keeping 200 days of data) [2025-10-21T19:30:58.300490] [DEBUG] [LOCAL ] KAR: Primary data saved (39768 records). [2025-10-21T19:30:58.300627] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-21T19:30:58.300742] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols completed. KAR took 30.3s. Estimated remaining: 2h 33m 44s. Rate: 7.8 symbols/min [2025-10-21T19:30:58.470832] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:30:58.514062] [DEBUG] [LOCAL ] KBH: Loaded 48759 existing records from primary storage. [2025-10-21T19:30:58.514369] [INFO ] [MAIN ] KBH: Loaded 48759 existing records. [2025-10-21T19:30:58.556545] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-21T19:30:58.642045] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T19:30:58.715870] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:30:58.716107] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-21T19:30:58.716153] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-21T19:30:58.716399] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-21T19:30:58.716454] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-21T19:30:59.076448] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:30:59.351033] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-21T19:30:59.656252] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:31:00.151123] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-21T19:31:00.951094] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-21T19:31:01.411502] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T19:31:01.460508] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:31:01.751020] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-21T19:31:02.275330] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-21T19:31:02.278156] [INFO ] [REMOTE ] KAI: Full fetch complete (19268 records). [2025-10-21T19:31:02.278251] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-21T19:31:02.556122] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-21T19:31:02.647504] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-21T19:31:02.647595] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-21T19:31:02.648106] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-21T19:31:02.648168] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-21T19:31:02.648936] [DEBUG] [LOCAL ] KAI: Trimmed 19268 records to 13490 (keeping 200 days of data) [2025-10-21T19:31:02.731076] [DEBUG] [LOCAL ] KAI: Primary data saved (13490 records). [2025-10-21T19:31:02.731198] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-21T19:31:02.731275] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols completed. KAI took 36.1s. Estimated remaining: 2h 33m 33s. Rate: 7.8 symbols/min [2025-10-21T19:31:02.900071] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:02.915150] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T19:31:02.956821] [DEBUG] [LOCAL ] KBR: Loaded 48051 existing records from primary storage. [2025-10-21T19:31:02.957102] [INFO ] [MAIN ] KBR: Loaded 48051 existing records. [2025-10-21T19:31:03.135229] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:03.135465] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-21T19:31:03.135532] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-21T19:31:03.135868] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-21T19:31:03.135924] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-21T19:31:03.361324] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-21T19:31:03.484984] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:03.798245] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T19:31:04.151018] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-21T19:31:04.782022] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T19:31:04.951055] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-21T19:31:05.280560] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T19:31:05.751051] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-21T19:31:06.551050] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-21T19:31:06.586171] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:31:07.327450] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:31:07.350987] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-21T19:31:07.523613] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T19:31:08.151056] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-21T19:31:08.933751] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:31:08.950977] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-21T19:31:08.991790] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T19:31:09.751025] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-21T19:31:10.550999] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-21T19:31:10.618495] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T19:31:10.837308] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:31:11.351043] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-21T19:31:12.151007] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-21T19:31:12.301673] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T19:31:12.809063] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T19:31:12.951022] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-21T19:31:13.174116] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T19:31:13.751035] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-21T19:31:14.234350] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:31:14.551068] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-21T19:31:15.159575] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:31:15.351025] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-21T19:31:15.605148] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T19:31:16.151006] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-21T19:31:16.518342] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T19:31:16.951055] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-21T19:31:17.751038] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-21T19:31:17.800428] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T19:31:17.849091] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T19:31:18.551077] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-21T19:31:19.328539] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:31:19.350992] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-21T19:31:19.884850] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T19:31:20.151031] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-21T19:31:20.951056] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-21T19:31:21.033232] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:31:21.358354] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T19:31:21.363286] [INFO ] [REMOTE ] KB: Full fetch complete (33599 records). [2025-10-21T19:31:21.363391] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-21T19:31:21.738153] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-21T19:31:21.738253] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-21T19:31:21.738948] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-21T19:31:21.739233] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-21T19:31:21.740143] [DEBUG] [LOCAL ] KB: Trimmed 33599 records to 23189 (keeping 200 days of data) [2025-10-21T19:31:21.792233] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-21T19:31:21.881824] [DEBUG] [LOCAL ] KB: Primary data saved (23189 records). [2025-10-21T19:31:21.881937] [INFO ] [MAIN ] KB: Full history saved. [2025-10-21T19:31:21.882008] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols completed. KB took 32.2s. Estimated remaining: 2h 33m 37s. Rate: 7.8 symbols/min [2025-10-21T19:31:22.054040] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:22.103873] [DEBUG] [LOCAL ] KD: Loaded 52354 existing records from primary storage. [2025-10-21T19:31:22.104168] [INFO ] [MAIN ] KD: Loaded 52354 existing records. [2025-10-21T19:31:22.279903] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:22.280077] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-21T19:31:22.280122] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-21T19:31:22.280322] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-21T19:31:22.280377] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-21T19:31:22.558362] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-21T19:31:22.638816] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:22.667725] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T19:31:23.139322] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:31:23.144588] [INFO ] [REMOTE ] KBDC: Full fetch complete (30891 records). [2025-10-21T19:31:23.144700] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-21T19:31:23.356187] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-21T19:31:23.507523] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-21T19:31:23.507593] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-21T19:31:23.508215] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-21T19:31:23.508275] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-21T19:31:23.508992] [DEBUG] [LOCAL ] KBDC: Trimmed 30891 records to 22747 (keeping 200 days of data) [2025-10-21T19:31:23.639812] [DEBUG] [LOCAL ] KBDC: Primary data saved (22747 records). [2025-10-21T19:31:23.639931] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-21T19:31:23.640002] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols completed. KBDC took 32.4s. Estimated remaining: 2h 33m 23s. Rate: 7.8 symbols/min [2025-10-21T19:31:23.808831] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:23.815102] [DEBUG] [LOCAL ] KEN: Loaded 4695 existing records from primary storage. [2025-10-21T19:31:23.815257] [INFO ] [MAIN ] KEN: Loaded 4695 existing records. [2025-10-21T19:31:23.995046] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:23.995262] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-21T19:31:23.995311] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-21T19:31:23.995574] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-21T19:31:23.995691] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-21T19:31:24.163288] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-21T19:31:24.299891] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T19:31:24.395730] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:24.951050] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-21T19:31:25.304484] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T19:31:25.523747] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T19:31:25.750991] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-21T19:31:25.861521] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T19:31:26.551043] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-21T19:31:27.128816] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:31:27.351062] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-21T19:31:27.804149] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T19:31:28.157975] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-21T19:31:28.160593] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T19:31:28.810450] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T19:31:28.951046] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-21T19:31:29.751109] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-21T19:31:30.551041] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-21T19:31:30.843999] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T19:31:30.851437] [INFO ] [REMOTE ] KBR: Full fetch complete (69927 records). [2025-10-21T19:31:30.851548] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-21T19:31:31.251588] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-21T19:31:31.251753] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-21T19:31:31.252862] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-21T19:31:31.252981] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-21T19:31:31.254493] [DEBUG] [LOCAL ] KBR: Trimmed 69927 records to 47999 (keeping 200 days of data) [2025-10-21T19:31:31.352451] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-21T19:31:31.366976] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T19:31:31.515412] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:31:31.606908] [DEBUG] [LOCAL ] KBR: Primary data saved (47999 records). [2025-10-21T19:31:31.607048] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-21T19:31:31.607128] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols completed. KBR took 28.9s. Estimated remaining: 2h 33m 16s. Rate: 7.8 symbols/min [2025-10-21T19:31:31.778942] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:31.809767] [DEBUG] [LOCAL ] KEP: Loaded 32390 existing records from primary storage. [2025-10-21T19:31:31.810029] [INFO ] [MAIN ] KEP: Loaded 32390 existing records. [2025-10-21T19:31:31.988317] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:31.988507] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-21T19:31:31.988557] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-21T19:31:31.988776] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-21T19:31:31.988834] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-21T19:31:32.151337] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-21T19:31:32.379206] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:32.835453] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-21T19:31:32.875870] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T19:31:32.951032] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-21T19:31:33.751066] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-21T19:31:34.558863] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-21T19:31:34.577661] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:31:34.943820] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T19:31:35.191445] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T19:31:35.351072] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-21T19:31:35.963780] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T19:31:36.151043] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-21T19:31:36.950992] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-21T19:31:37.193750] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T19:31:37.751031] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-21T19:31:38.551014] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-21T19:31:38.698095] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T19:31:38.705991] [INFO ] [REMOTE ] KBH: Full fetch complete (71107 records). [2025-10-21T19:31:38.706130] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-21T19:31:38.842099] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T19:31:39.115159] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-21T19:31:39.115247] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-21T19:31:39.116202] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-21T19:31:39.116264] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-21T19:31:39.117584] [DEBUG] [LOCAL ] KBH: Trimmed 71107 records to 48751 (keeping 200 days of data) [2025-10-21T19:31:39.209075] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T19:31:39.355685] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-21T19:31:39.416549] [DEBUG] [LOCAL ] KBH: Primary data saved (48751 records). [2025-10-21T19:31:39.416678] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-21T19:31:39.416767] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols completed. KBH took 41.1s. Estimated remaining: 2h 33m 8s. Rate: 7.8 symbols/min [2025-10-21T19:31:39.588094] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:39.624476] [DEBUG] [LOCAL ] KEX: Loaded 38824 existing records from primary storage. [2025-10-21T19:31:39.624781] [INFO ] [MAIN ] KEX: Loaded 38824 existing records. [2025-10-21T19:31:39.802965] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:31:39.803200] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-21T19:31:39.803256] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-21T19:31:39.803421] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-21T19:31:39.803460] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-21T19:31:40.098916] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:31:40.156135] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-21T19:31:40.189089] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:40.951083] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-21T19:31:41.445140] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T19:31:41.461092] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T19:31:41.462045] [INFO ] [REMOTE ] KEN: Full fetch complete (5922 records). [2025-10-21T19:31:41.462111] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-21T19:31:41.756232] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-21T19:31:41.834858] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-21T19:31:41.834963] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-21T19:31:41.835162] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-21T19:31:41.835203] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-21T19:31:41.835583] [DEBUG] [LOCAL ] KEN: Trimmed 5922 records to 4665 (keeping 200 days of data) [2025-10-21T19:31:41.863573] [DEBUG] [LOCAL ] KEN: Primary data saved (4665 records). [2025-10-21T19:31:41.863711] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-21T19:31:41.863800] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols completed. KEN took 18.2s. Estimated remaining: 2h 32m 55s. Rate: 7.8 symbols/min [2025-10-21T19:31:42.035827] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:31:42.035991] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-21T19:31:42.036027] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-21T19:31:42.036141] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-21T19:31:42.036182] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-21T19:31:42.036220] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-21T19:31:42.036250] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-21T19:31:42.385034] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:31:42.551140] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-21T19:31:43.114735] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T19:31:43.351032] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-21T19:31:44.133337] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:31:44.150991] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-21T19:31:44.951011] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-21T19:31:45.026326] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:31:45.664460] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T19:31:45.751084] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-21T19:31:46.215505] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T19:31:46.551085] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-21T19:31:47.351071] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-21T19:31:47.601793] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:31:47.700522] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:31:48.151041] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-21T19:31:48.444459] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:31:48.951042] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-21T19:31:49.564838] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T19:31:49.751011] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-21T19:31:50.267014] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T19:31:50.551094] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-21T19:31:51.352677] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T19:31:51.351087] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-21T19:31:51.937803] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T19:31:52.151018] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-21T19:31:52.951028] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-21T19:31:53.298844] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T19:31:53.591504] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:31:53.751066] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-21T19:31:54.551003] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-21T19:31:54.640376] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:31:55.351050] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-21T19:31:55.658775] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:31:56.138428] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:31:56.150986] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-21T19:31:56.558445] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T19:31:56.951086] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-21T19:31:57.507715] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T19:31:57.751095] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-21T19:31:58.561748] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-21T19:31:58.569844] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T19:31:59.116213] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:31:59.351023] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-21T19:31:59.871534] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:32:00.151034] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-21T19:32:00.951027] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-21T19:32:01.589240] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T19:32:01.660522] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T19:32:01.751039] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-21T19:32:02.385816] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T19:32:02.391424] [INFO ] [REMOTE ] KEP: Full fetch complete (42411 records). [2025-10-21T19:32:02.391569] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-21T19:32:02.555203] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-21T19:32:02.796436] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-21T19:32:02.796512] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-21T19:32:02.797343] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-21T19:32:02.797404] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-21T19:32:02.798449] [DEBUG] [LOCAL ] KEP: Trimmed 42411 records to 32502 (keeping 200 days of data) [2025-10-21T19:32:02.980617] [DEBUG] [LOCAL ] KEP: Primary data saved (32502 records). [2025-10-21T19:32:02.980766] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-21T19:32:02.981634] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols completed. KEP took 31.4s. Estimated remaining: 2h 33m 1s. Rate: 7.8 symbols/min [2025-10-21T19:32:03.151364] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:03.193176] [DEBUG] [LOCAL ] KEYS: Loaded 43295 existing records from primary storage. [2025-10-21T19:32:03.193468] [INFO ] [MAIN ] KEYS: Loaded 43295 existing records. [2025-10-21T19:32:03.354748] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-21T19:32:03.375919] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:03.377361] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-21T19:32:03.377475] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-21T19:32:03.377860] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-21T19:32:03.377919] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-21T19:32:03.730018] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T19:32:03.777357] [INFO ] [REMOTE ] KD: Full fetch complete (76120 records). [2025-10-21T19:32:03.777220] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:03.777859] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-21T19:32:04.161491] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-21T19:32:04.179820] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-21T19:32:04.180615] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-21T19:32:04.181967] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-21T19:32:04.190629] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-21T19:32:04.208909] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T19:32:04.217690] [DEBUG] [LOCAL ] KD: Trimmed 76120 records to 52344 (keeping 200 days of data) [2025-10-21T19:32:04.518729] [DEBUG] [LOCAL ] KD: Primary data saved (52344 records). [2025-10-21T19:32:04.518902] [INFO ] [MAIN ] KD: Full history saved. [2025-10-21T19:32:04.519735] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols completed. KD took 42.6s. Estimated remaining: 2h 32m 47s. Rate: 7.8 symbols/min [2025-10-21T19:32:04.688361] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:04.692830] [DEBUG] [LOCAL ] KF: Loaded 2366 existing records from primary storage. [2025-10-21T19:32:04.692967] [INFO ] [MAIN ] KF: Loaded 2366 existing records. [2025-10-21T19:32:04.873127] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:04.873296] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-21T19:32:04.873342] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-21T19:32:04.873480] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-21T19:32:04.873535] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-21T19:32:04.964604] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-21T19:32:05.236448] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:05.331535] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T19:32:05.643205] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T19:32:05.751080] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-21T19:32:06.307226] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T19:32:06.392488] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T19:32:06.551035] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-21T19:32:07.351051] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-21T19:32:07.796480] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T19:32:08.135935] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:32:08.150986] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-21T19:32:08.951030] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-21T19:32:09.569825] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:32:09.751025] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-21T19:32:10.160464] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T19:32:10.167554] [INFO ] [REMOTE ] KEX: Full fetch complete (56094 records). [2025-10-21T19:32:10.167755] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-21T19:32:10.547910] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-21T19:32:10.547990] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-21T19:32:10.548848] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-21T19:32:10.548914] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-21T19:32:10.550122] [DEBUG] [LOCAL ] KEX: Trimmed 56094 records to 38788 (keeping 200 days of data) [2025-10-21T19:32:10.551013] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-21T19:32:10.775620] [DEBUG] [LOCAL ] KEX: Primary data saved (38788 records). [2025-10-21T19:32:10.775788] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-21T19:32:10.775885] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols completed. KEX took 31.4s. Estimated remaining: 2h 32m 38s. Rate: 7.8 symbols/min [2025-10-21T19:32:10.948605] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:10.969542] [DEBUG] [LOCAL ] KFRC: Loaded 20727 existing records from primary storage. [2025-10-21T19:32:10.969781] [INFO ] [MAIN ] KFRC: Loaded 20727 existing records. [2025-10-21T19:32:11.147232] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:11.148027] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-21T19:32:11.148104] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-21T19:32:11.148381] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-21T19:32:11.148439] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-21T19:32:11.239071] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T19:32:11.358841] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-21T19:32:11.530159] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:11.553914] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:32:12.151071] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-21T19:32:12.682231] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T19:32:12.951028] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-21T19:32:13.034739] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:32:13.751021] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-21T19:32:14.332170] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:32:14.553943] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-21T19:32:14.561906] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T19:32:14.984252] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T19:32:15.351040] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-21T19:32:15.802095] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T19:32:16.151035] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-21T19:32:16.951001] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-21T19:32:17.213080] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T19:32:17.221574] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-21T19:32:17.221738] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-21T19:32:17.417281] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T19:32:17.420982] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T19:32:17.420850] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:32:17.422340] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:32:17.422419] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-21T19:32:17.422481] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-21T19:32:17.422515] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-21T19:32:17.422553] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-21T19:32:17.422607] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols completed. KEY took 35.6s. Estimated remaining: 2h 32m 29s. Rate: 7.8 symbols/min [2025-10-21T19:32:17.591819] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:17.602495] [DEBUG] [LOCAL ] KFS: Loaded 8699 existing records from primary storage. [2025-10-21T19:32:17.602712] [INFO ] [MAIN ] KFS: Loaded 8699 existing records. [2025-10-21T19:32:17.761141] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-21T19:32:17.793938] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:17.794133] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-21T19:32:17.794179] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-21T19:32:17.794334] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-21T19:32:17.794388] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-21T19:32:18.166143] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:18.551025] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-21T19:32:19.103353] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T19:32:19.104329] [INFO ] [REMOTE ] KF: Full fetch complete (3512 records). [2025-10-21T19:32:19.104404] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-21T19:32:19.356293] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-21T19:32:19.469956] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-21T19:32:19.470030] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-21T19:32:19.470164] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-21T19:32:19.470202] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-21T19:32:19.470532] [DEBUG] [LOCAL ] KF: Trimmed 3512 records to 2359 (keeping 200 days of data) [2025-10-21T19:32:19.484120] [DEBUG] [LOCAL ] KF: Primary data saved (2359 records). [2025-10-21T19:32:19.484178] [INFO ] [MAIN ] KF: Full history saved. [2025-10-21T19:32:19.484241] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols completed. KF took 15.0s. Estimated remaining: 2h 32m 15s. Rate: 7.8 symbols/min [2025-10-21T19:32:19.662553] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:19.695785] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T19:32:19.733407] [DEBUG] [LOCAL ] KFY: Loaded 29744 existing records from primary storage. [2025-10-21T19:32:19.733736] [INFO ] [MAIN ] KFY: Loaded 29744 existing records. [2025-10-21T19:32:19.851294] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-21T19:32:19.927717] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:19.927919] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-21T19:32:19.927969] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-21T19:32:19.928178] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-21T19:32:19.928235] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-21T19:32:20.160521] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-21T19:32:20.289288] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:20.951009] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-21T19:32:21.118303] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T19:32:21.751026] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-21T19:32:22.328841] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T19:32:22.551025] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-21T19:32:22.606343] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T19:32:23.351007] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-21T19:32:23.582947] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:32:24.036180] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-21T19:32:24.151038] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-21T19:32:24.951031] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-21T19:32:25.642081] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T19:32:25.751018] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-21T19:32:26.100331] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T19:32:26.515385] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T19:32:26.551017] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-21T19:32:27.351004] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-21T19:32:27.468908] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T19:32:28.131424] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:32:28.150974] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-21T19:32:28.951015] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-21T19:32:29.224429] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:32:29.751028] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-21T19:32:30.128620] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T19:32:30.510632] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T19:32:30.551025] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-21T19:32:31.351039] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-21T19:32:31.581514] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T19:32:32.151034] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-21T19:32:32.884468] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:32:32.950992] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-21T19:32:33.537948] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T19:32:33.751048] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-21T19:32:33.943323] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T19:32:34.551117] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-21T19:32:35.111116] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T19:32:35.351052] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-21T19:32:35.612012] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T19:32:36.151055] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-21T19:32:36.310220] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:32:36.951029] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-21T19:32:36.963896] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T19:32:37.751050] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-21T19:32:38.090231] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T19:32:38.551217] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-21T19:32:39.259925] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T19:32:39.346676] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T19:32:39.350968] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-21T19:32:40.069122] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T19:32:40.150997] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-21T19:32:40.925389] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T19:32:40.927277] [INFO ] [REMOTE ] KFS: Full fetch complete (11173 records). [2025-10-21T19:32:40.927343] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-21T19:32:40.956122] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-21T19:32:41.334710] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-21T19:32:41.334809] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-21T19:32:41.335117] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-21T19:32:41.335193] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-21T19:32:41.335706] [DEBUG] [LOCAL ] KFS: Trimmed 11173 records to 8691 (keeping 200 days of data) [2025-10-21T19:32:41.387712] [DEBUG] [LOCAL ] KFS: Primary data saved (8691 records). [2025-10-21T19:32:41.387875] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-21T19:32:41.387972] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols completed. KFS took 24.0s. Estimated remaining: 2h 32m 22s. Rate: 7.8 symbols/min [2025-10-21T19:32:41.565327] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:41.618447] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-21T19:32:41.618777] [INFO ] [MAIN ] KGC: Loaded 53700 existing records. [2025-10-21T19:32:41.757761] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-21T19:32:41.799865] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:41.800220] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-21T19:32:41.800291] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-21T19:32:41.800504] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-21T19:32:41.800545] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-21T19:32:42.179867] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:42.195963] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T19:32:42.551037] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-21T19:32:43.235869] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T19:32:43.351101] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-21T19:32:44.129444] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:32:44.151057] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-21T19:32:44.611813] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T19:32:44.616948] [INFO ] [REMOTE ] KFRC: Full fetch complete (26958 records). [2025-10-21T19:32:44.617062] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-21T19:32:44.956195] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-21T19:32:45.018317] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-21T19:32:45.018409] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-21T19:32:45.019027] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-21T19:32:45.019101] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-21T19:32:45.019937] [DEBUG] [LOCAL ] KFRC: Trimmed 26958 records to 20800 (keeping 200 days of data) [2025-10-21T19:32:45.149344] [DEBUG] [LOCAL ] KFRC: Primary data saved (20800 records). [2025-10-21T19:32:45.149487] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-21T19:32:45.149592] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols completed. KFRC took 34.4s. Estimated remaining: 2h 32m 10s. Rate: 7.8 symbols/min [2025-10-21T19:32:45.324475] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:45.367059] [DEBUG] [LOCAL ] KGS: Loaded 46120 existing records from primary storage. [2025-10-21T19:32:45.367402] [INFO ] [MAIN ] KGS: Loaded 46120 existing records. [2025-10-21T19:32:45.557564] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:45.557838] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-21T19:32:45.557905] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-21T19:32:45.558116] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-21T19:32:45.558170] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-21T19:32:45.756386] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-21T19:32:45.928974] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T19:32:45.965893] [INFO ] [REMOTE ] KEYS: Full fetch complete (63114 records). [2025-10-21T19:32:45.965724] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:45.966462] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-21T19:32:46.374772] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-21T19:32:46.374855] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-21T19:32:46.375741] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-21T19:32:46.375804] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-21T19:32:46.377078] [DEBUG] [LOCAL ] KEYS: Trimmed 63114 records to 43207 (keeping 200 days of data) [2025-10-21T19:32:46.556618] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-21T19:32:46.640344] [DEBUG] [LOCAL ] KEYS: Primary data saved (43207 records). [2025-10-21T19:32:46.640615] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-21T19:32:46.641286] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols completed. KEYS took 43.7s. Estimated remaining: 2h 31m 56s. Rate: 7.8 symbols/min [2025-10-21T19:32:46.832529] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:46.854405] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T19:32:46.915808] [DEBUG] [LOCAL ] KIM: Loaded 53012 existing records from primary storage. [2025-10-21T19:32:46.916165] [INFO ] [MAIN ] KIM: Loaded 53012 existing records. [2025-10-21T19:32:47.101947] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:47.102249] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-21T19:32:47.102363] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-21T19:32:47.109308] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-21T19:32:47.109397] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-21T19:32:47.188882] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T19:32:47.356228] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-21T19:32:47.493445] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:48.156786] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-21T19:32:48.159816] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T19:32:48.217294] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T19:32:48.951035] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-21T19:32:49.751021] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-21T19:32:50.008056] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T19:32:50.551067] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-21T19:32:50.618168] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:32:51.180732] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T19:32:51.351021] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-21T19:32:51.929289] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:32:52.151060] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-21T19:32:52.951058] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-21T19:32:53.409321] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T19:32:53.695888] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T19:32:53.751053] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-21T19:32:54.551059] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-21T19:32:54.602115] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:32:55.317411] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T19:32:55.350995] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-21T19:32:55.849566] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T19:32:55.854802] [INFO ] [REMOTE ] KFY: Full fetch complete (43305 records). [2025-10-21T19:32:55.854901] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-21T19:32:56.153937] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-21T19:32:56.243833] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-21T19:32:56.243939] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-21T19:32:56.245389] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-21T19:32:56.245456] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-21T19:32:56.246690] [DEBUG] [LOCAL ] KFY: Trimmed 43305 records to 29615 (keeping 200 days of data) [2025-10-21T19:32:56.437457] [DEBUG] [LOCAL ] KFY: Primary data saved (29615 records). [2025-10-21T19:32:56.437669] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-21T19:32:56.437810] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols completed. KFY took 37.0s. Estimated remaining: 2h 31m 51s. Rate: 7.8 symbols/min [2025-10-21T19:32:56.615826] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:32:56.640105] [DEBUG] [LOCAL ] KIO: Loaded 21766 existing records from primary storage. [2025-10-21T19:32:56.640448] [INFO ] [MAIN ] KIO: Loaded 21766 existing records. [2025-10-21T19:32:56.830616] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:32:56.831016] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-21T19:32:56.831282] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-21T19:32:56.831593] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-21T19:32:56.831693] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-21T19:32:56.954513] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-21T19:32:57.108807] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T19:32:57.266274] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:32:57.751087] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-21T19:32:58.471384] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-21T19:32:58.551011] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-21T19:32:58.807136] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:32:59.228770] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T19:32:59.351005] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-21T19:33:00.151017] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-21T19:33:00.838028] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T19:33:00.877166] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:33:00.950992] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-21T19:33:01.550833] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:33:01.751066] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-21T19:33:02.551001] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-21T19:33:02.676068] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:33:02.873252] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T19:33:03.351082] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-21T19:33:04.151001] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-21T19:33:04.316636] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:33:04.951012] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-21T19:33:05.371269] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T19:33:05.751142] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-21T19:33:05.802114] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T19:33:06.035365] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:33:06.551035] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-21T19:33:07.350993] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-21T19:33:07.462867] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T19:33:08.150997] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-21T19:33:08.224035] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T19:33:08.231133] [INFO ] [REMOTE ] KGS: Full fetch complete (66544 records). [2025-10-21T19:33:08.231238] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-21T19:33:08.646362] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-21T19:33:08.646436] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-21T19:33:08.647347] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-21T19:33:08.647408] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-21T19:33:08.648708] [DEBUG] [LOCAL ] KGS: Trimmed 66544 records to 46136 (keeping 200 days of data) [2025-10-21T19:33:08.914754] [DEBUG] [LOCAL ] KGS: Primary data saved (46136 records). [2025-10-21T19:33:08.914865] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-21T19:33:08.914938] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols completed. KGS took 23.8s. Estimated remaining: 2h 31m 48s. Rate: 7.8 symbols/min [2025-10-21T19:33:08.957711] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-21T19:33:09.085683] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:09.140324] [DEBUG] [LOCAL ] KKR: Loaded 53503 existing records from primary storage. [2025-10-21T19:33:09.140748] [INFO ] [MAIN ] KKR: Loaded 53503 existing records. [2025-10-21T19:33:09.323473] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:09.324221] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-21T19:33:09.335937] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-21T19:33:09.336814] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-21T19:33:09.337418] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-21T19:33:09.337260] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T19:33:09.712667] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-21T19:33:09.763333] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-21T19:33:09.799984] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:10.551062] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-21T19:33:10.764908] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:33:11.351038] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-21T19:33:11.928393] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-21T19:33:12.151028] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-21T19:33:12.524779] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T19:33:12.815541] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T19:33:12.951032] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-21T19:33:13.129315] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T19:33:13.751053] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-21T19:33:14.551038] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-21T19:33:14.760005] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T19:33:15.351027] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-21T19:33:15.524417] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:33:15.583475] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T19:33:16.151051] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-21T19:33:16.951040] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-21T19:33:17.109931] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T19:33:17.250601] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T19:33:17.751075] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-21T19:33:18.550997] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-21T19:33:18.826023] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:33:19.217750] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-21T19:33:19.351084] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-21T19:33:20.151064] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-21T19:33:20.199170] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:33:20.780230] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T19:33:20.951018] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-21T19:33:21.751074] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-21T19:33:22.277854] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-21T19:33:22.286846] [INFO ] [REMOTE ] KGC: Full fetch complete (77873 records). [2025-10-21T19:33:22.287076] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-21T19:33:22.559310] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-21T19:33:22.699296] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-21T19:33:22.699419] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-21T19:33:22.700571] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-21T19:33:22.700639] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-21T19:33:22.702177] [DEBUG] [LOCAL ] KGC: Trimmed 77873 records to 53700 (keeping 200 days of data) [2025-10-21T19:33:22.930927] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T19:33:23.054883] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T19:33:23.073722] [INFO ] [REMOTE ] KIM: Full fetch complete (76969 records). [2025-10-21T19:33:23.080777] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-21T19:33:23.089779] [DEBUG] [LOCAL ] KGC: Primary data saved (53700 records). [2025-10-21T19:33:23.089960] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-21T19:33:23.090536] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols completed. KGC took 41.7s. Estimated remaining: 2h 31m 46s. Rate: 7.8 symbols/min [2025-10-21T19:33:23.362803] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-21T19:33:23.491967] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:23.609117] [DEBUG] [LOCAL ] KKRS: Loaded 5590 existing records from primary storage. [2025-10-21T19:33:23.619572] [INFO ] [MAIN ] KKRS: Loaded 5590 existing records. [2025-10-21T19:33:23.800194] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-21T19:33:23.805403] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-21T19:33:23.811509] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-21T19:33:23.816722] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-21T19:33:23.865771] [DEBUG] [LOCAL ] KIM: Trimmed 76969 records to 53000 (keeping 200 days of data) [2025-10-21T19:33:23.869313] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:23.869510] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-21T19:33:23.869566] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-21T19:33:23.869858] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-21T19:33:23.869914] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-21T19:33:24.458744] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:24.471108] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-21T19:33:24.563228] [DEBUG] [LOCAL ] KIM: Primary data saved (53000 records). [2025-10-21T19:33:24.563464] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-21T19:33:24.564218] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols completed. KIM took 37.9s. Estimated remaining: 2h 31m 32s. Rate: 7.8 symbols/min [2025-10-21T19:33:24.778536] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:24.784123] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-21T19:33:24.788930] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-21T19:33:24.792458] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-21T19:33:24.804625] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-21T19:33:24.805448] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T19:33:24.805693] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-21T19:33:24.805828] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-21T19:33:24.812057] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-21T19:33:24.846365] [INFO ] [REMOTE ] KIO: Full fetch complete (32297 records). [2025-10-21T19:33:24.878296] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-21T19:33:24.956100] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-21T19:33:25.078291] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-21T19:33:25.474420] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:25.566195] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-21T19:33:25.566276] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-21T19:33:25.567184] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-21T19:33:25.567248] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-21T19:33:25.568038] [DEBUG] [LOCAL ] KIO: Trimmed 32297 records to 21750 (keeping 200 days of data) [2025-10-21T19:33:25.705543] [DEBUG] [LOCAL ] KIO: Primary data saved (21750 records). [2025-10-21T19:33:25.705746] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-21T19:33:25.705859] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols completed. KIO took 29.3s. Estimated remaining: 2h 31m 18s. Rate: 7.8 symbols/min [2025-10-21T19:33:25.762523] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-21T19:33:25.878601] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:25.878841] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-21T19:33:25.878883] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-21T19:33:25.879005] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-21T19:33:25.879054] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-21T19:33:25.879101] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-21T19:33:25.879133] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-21T19:33:26.247446] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:26.418436] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T19:33:26.418611] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:33:26.551007] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-21T19:33:27.351047] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-21T19:33:27.546159] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:33:27.546330] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-21T19:33:27.546413] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:33:27.546457] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-21T19:33:27.546489] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:33:27.546524] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-21T19:33:27.546571] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-21T19:33:27.546606] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-21T19:33:27.546693] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-21T19:33:27.546759] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols completed. KLAR took 1.8s. Estimated remaining: 2h 31m 5s. Rate: 7.8 symbols/min [2025-10-21T19:33:27.712576] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:27.744700] [DEBUG] [LOCAL ] KLC: Loaded 36293 existing records from primary storage. [2025-10-21T19:33:27.744969] [INFO ] [MAIN ] KLC: Loaded 36293 existing records. [2025-10-21T19:33:27.921298] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:27.921465] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-21T19:33:27.921510] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-21T19:33:27.921756] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-21T19:33:27.921814] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-21T19:33:28.159981] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-21T19:33:28.287383] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:28.405946] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:33:28.406292] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-21T19:33:28.406395] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:33:28.406461] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-21T19:33:28.406534] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:33:28.406619] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-21T19:33:28.406739] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-21T19:33:28.406796] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-21T19:33:28.406855] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-21T19:33:28.406917] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols completed. KKRT took 3.8s. Estimated remaining: 2h 30m 50s. Rate: 7.8 symbols/min [2025-10-21T19:33:28.573110] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T19:33:28.641819] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:28.694771] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-21T19:33:28.695116] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-21T19:33:28.868049] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:28.868240] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-21T19:33:28.868287] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-21T19:33:28.868564] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-21T19:33:28.868602] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-21T19:33:28.956239] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-21T19:33:29.219102] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:29.751084] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-21T19:33:30.337733] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T19:33:30.551047] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-21T19:33:30.675271] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T19:33:31.255547] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T19:33:31.351023] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-21T19:33:32.151073] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-21T19:33:32.158783] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T19:33:32.951074] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-21T19:33:33.596678] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T19:33:33.751096] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-21T19:33:33.957467] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T19:33:34.258951] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T19:33:34.551060] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-21T19:33:35.351074] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-21T19:33:36.151106] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-21T19:33:36.588685] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T19:33:36.719910] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-21T19:33:36.748864] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T19:33:36.951028] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-21T19:33:37.751025] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-21T19:33:38.323307] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T19:33:38.551095] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-21T19:33:38.810881] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T19:33:39.135803] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T19:33:39.136851] [INFO ] [REMOTE ] KKRS: Full fetch complete (7543 records). [2025-10-21T19:33:39.136917] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-21T19:33:39.356209] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-21T19:33:39.500564] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-21T19:33:39.500686] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-21T19:33:39.500920] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-21T19:33:39.500963] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-21T19:33:39.501490] [DEBUG] [LOCAL ] KKRS: Trimmed 7543 records to 5573 (keeping 200 days of data) [2025-10-21T19:33:39.538097] [DEBUG] [LOCAL ] KKRS: Primary data saved (5573 records). [2025-10-21T19:33:39.538231] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-21T19:33:39.538311] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols completed. KKRS took 16.4s. Estimated remaining: 2h 30m 46s. Rate: 7.8 symbols/min [2025-10-21T19:33:39.709159] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:39.714702] [DEBUG] [LOCAL ] KMPB: Loaded 3558 existing records from primary storage. [2025-10-21T19:33:39.714861] [INFO ] [MAIN ] KMPB: Loaded 3558 existing records. [2025-10-21T19:33:39.886685] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:39.886892] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-21T19:33:39.886939] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-21T19:33:39.887071] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-21T19:33:39.887107] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-21T19:33:40.157302] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-21T19:33:40.245716] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:40.541278] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T19:33:40.951076] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-21T19:33:41.751001] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-21T19:33:42.107498] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T19:33:42.196283] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-21T19:33:42.259831] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:33:42.551046] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-21T19:33:43.351037] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-21T19:33:44.151030] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-21T19:33:44.151725] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T19:33:44.951079] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-21T19:33:45.639907] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-21T19:33:45.648839] [INFO ] [REMOTE ] KKR: Full fetch complete (77652 records). [2025-10-21T19:33:45.648993] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-21T19:33:45.757535] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-21T19:33:46.076574] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-21T19:33:46.076722] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-21T19:33:46.077972] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-21T19:33:46.078060] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-21T19:33:46.079621] [DEBUG] [LOCAL ] KKR: Trimmed 77652 records to 53500 (keeping 200 days of data) [2025-10-21T19:33:46.416281] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:33:46.444184] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T19:33:46.471822] [DEBUG] [LOCAL ] KKR: Primary data saved (53500 records). [2025-10-21T19:33:46.472270] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-21T19:33:46.472530] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols completed. KKR took 37.6s. Estimated remaining: 2h 30m 37s. Rate: 7.8 symbols/min [2025-10-21T19:33:46.556976] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-21T19:33:46.603061] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T19:33:46.684876] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:46.721128] [DEBUG] [LOCAL ] KMPR: Loaded 40452 existing records from primary storage. [2025-10-21T19:33:46.721431] [INFO ] [MAIN ] KMPR: Loaded 40452 existing records. [2025-10-21T19:33:46.910017] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:46.910442] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-21T19:33:46.910495] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-21T19:33:46.910880] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-21T19:33:46.910936] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-21T19:33:47.193508] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T19:33:47.272159] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:47.351008] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-21T19:33:48.151083] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-21T19:33:48.819117] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:33:48.951024] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-21T19:33:49.465839] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T19:33:49.751040] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-21T19:33:49.901786] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:33:50.221428] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T19:33:50.551025] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-21T19:33:51.351022] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-21T19:33:51.770980] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:33:51.827629] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T19:33:52.151063] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-21T19:33:52.656465] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T19:33:52.951022] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-21T19:33:53.750995] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-21T19:33:54.315033] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T19:33:54.551029] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-21T19:33:54.643751] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T19:33:55.351053] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-21T19:33:55.853288] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T19:33:55.873765] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T19:33:56.151050] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-21T19:33:56.760626] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:33:56.761589] [INFO ] [REMOTE ] KMPB: Full fetch complete (4961 records). [2025-10-21T19:33:56.761687] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-21T19:33:56.957707] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-21T19:33:57.145054] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-21T19:33:57.145150] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-21T19:33:57.145375] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-21T19:33:57.145430] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-21T19:33:57.145896] [DEBUG] [LOCAL ] KMPB: Trimmed 4961 records to 3533 (keeping 200 days of data) [2025-10-21T19:33:57.168137] [DEBUG] [LOCAL ] KMPB: Primary data saved (3533 records). [2025-10-21T19:33:57.168230] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-21T19:33:57.168307] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols completed. KMPB took 17.6s. Estimated remaining: 2h 30m 32s. Rate: 7.8 symbols/min [2025-10-21T19:33:57.352834] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:33:57.394435] [DEBUG] [LOCAL ] KMT: Loaded 42948 existing records from primary storage. [2025-10-21T19:33:57.394854] [INFO ] [MAIN ] KMT: Loaded 42948 existing records. [2025-10-21T19:33:57.576671] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:33:57.576908] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-21T19:33:57.576956] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-21T19:33:57.577145] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-21T19:33:57.577200] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-21T19:33:57.761720] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-21T19:33:57.934863] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:33:58.349816] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T19:33:58.551027] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-21T19:33:59.351057] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-21T19:33:59.962166] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T19:34:00.002388] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T19:34:00.151028] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-21T19:34:00.682497] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T19:34:00.951045] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-21T19:34:01.751045] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-21T19:34:01.924315] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T19:34:02.551093] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-21T19:34:02.942300] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T19:34:02.998808] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T19:34:03.351032] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-21T19:34:04.033323] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:34:04.150996] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-21T19:34:04.794947] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T19:34:04.951034] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-21T19:34:05.671916] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:34:05.751029] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-21T19:34:06.222526] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T19:34:06.551084] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-21T19:34:07.351015] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-21T19:34:07.686268] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T19:34:08.137884] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:34:08.150967] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-21T19:34:08.957112] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-21T19:34:08.962734] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T19:34:09.739512] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T19:34:09.750979] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-21T19:34:10.173008] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:34:10.178962] [INFO ] [REMOTE ] KLC: Full fetch complete (50526 records). [2025-10-21T19:34:10.179050] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-21T19:34:10.557050] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-21T19:34:10.558635] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-21T19:34:10.558755] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-21T19:34:10.559558] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-21T19:34:10.559668] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-21T19:34:10.560849] [DEBUG] [LOCAL ] KLC: Trimmed 50526 records to 36207 (keeping 200 days of data) [2025-10-21T19:34:10.760130] [DEBUG] [LOCAL ] KLC: Primary data saved (36207 records). [2025-10-21T19:34:10.760262] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-21T19:34:10.760352] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols completed. KLC took 43.2s. Estimated remaining: 2h 30m 30s. Rate: 7.8 symbols/min [2025-10-21T19:34:11.351026] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-21T19:34:11.465464] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T19:34:11.539258] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:34:11.547710] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-21T19:34:11.547863] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-21T19:34:11.936176] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-21T19:34:11.936270] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-21T19:34:11.937315] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-21T19:34:11.937400] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-21T19:34:11.938780] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-21T19:34:12.154673] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-21T19:34:12.256508] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-21T19:34:12.256632] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-21T19:34:12.256747] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols completed. KMI took 43.8s. Estimated remaining: 2h 30m 17s. Rate: 7.8 symbols/min [2025-10-21T19:34:13.064088] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:34:13.074032] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-21T19:34:13.605468] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:34:13.751050] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-21T19:34:14.667524] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T19:34:14.677277] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-21T19:34:15.234121] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T19:34:15.350977] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-21T19:34:16.462982] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:34:16.470242] [INFO ] [REMOTE ] KMPR: Full fetch complete (53461 records). [2025-10-21T19:34:16.470353] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-21T19:34:16.897089] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-21T19:34:16.897192] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-21T19:34:16.898157] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-21T19:34:16.898240] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-21T19:34:16.899381] [DEBUG] [LOCAL ] KMPR: Trimmed 53461 records to 40497 (keeping 200 days of data) [2025-10-21T19:34:17.052199] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:34:17.143732] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-21T19:34:17.180287] [DEBUG] [LOCAL ] KMPR: Primary data saved (40497 records). [2025-10-21T19:34:17.180381] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-21T19:34:17.180450] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols completed. KMPR took 30.7s. Estimated remaining: 2h 30m 6s. Rate: 7.8 symbols/min [2025-10-21T19:34:18.669693] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T19:34:18.678808] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-21T19:34:20.188586] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T19:34:20.194946] [INFO ] [REMOTE ] KMT: Full fetch complete (61914 records). [2025-10-21T19:34:20.195070] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-21T19:34:20.585589] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-21T19:34:20.585716] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-21T19:34:20.586815] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-21T19:34:20.586892] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-21T19:34:20.588213] [DEBUG] [LOCAL ] KMT: Trimmed 61914 records to 42860 (keeping 200 days of data) [2025-10-21T19:34:20.843380] [DEBUG] [LOCAL ] KMT: Primary data saved (42860 records). [2025-10-21T19:34:20.843505] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-21T19:34:20.844106] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols completed. KMT took 23.7s. Estimated remaining: 2h 29m 55s. Rate: 7.8 symbols/min [2025-10-21T19:34:21.448609] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:21.526816] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:21.539804] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:21.557568] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:21.569743] [DEBUG] [LOCAL ] KNOP: Loaded 10181 existing records from primary storage. [2025-10-21T19:34:21.570263] [INFO ] [MAIN ] KNOP: Loaded 10181 existing records. [2025-10-21T19:34:21.711103] [DEBUG] [LOCAL ] KN: Loaded 38488 existing records from primary storage. [2025-10-21T19:34:21.723707] [INFO ] [MAIN ] KN: Loaded 38488 existing records. [2025-10-21T19:34:21.910024] [DEBUG] [LOCAL ] KNF: Loaded 36667 existing records from primary storage. [2025-10-21T19:34:21.921786] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:21.940608] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-21T19:34:21.940808] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-21T19:34:21.980676] [INFO ] [MAIN ] KNF: Loaded 36667 existing records. [2025-10-21T19:34:21.941911] [DEBUG] [LOCAL ] KMX: Loaded 53284 existing records from primary storage. [2025-10-21T19:34:21.996855] [INFO ] [MAIN ] KMX: Loaded 53284 existing records. [2025-10-21T19:34:21.998580] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-21T19:34:22.016614] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-21T19:34:22.036477] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:22.177332] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-21T19:34:22.204098] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-21T19:34:22.306232] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-21T19:34:22.331958] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-21T19:34:22.647420] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:22.688246] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-21T19:34:22.670866] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:22.731177] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-21T19:34:22.731266] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-21T19:34:22.755439] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-21T19:34:22.791575] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-21T19:34:22.796861] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-21T19:34:22.874816] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-21T19:34:22.880357] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-21T19:34:23.285939] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:23.362452] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-21T19:34:23.639029] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:23.689084] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-21T19:34:23.854975] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:23.871163] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-21T19:34:23.876055] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:23.876324] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-21T19:34:24.562821] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T19:34:24.565366] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-21T19:34:24.919676] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T19:34:24.926179] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-21T19:34:25.285886] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T19:34:25.288468] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-21T19:34:25.308887] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T19:34:25.316334] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-21T19:34:25.849101] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T19:34:25.859259] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-21T19:34:26.211072] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T19:34:26.218453] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-21T19:34:26.226631] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T19:34:26.229914] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-21T19:34:26.796706] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T19:34:26.807049] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-21T19:34:27.053713] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T19:34:27.254015] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T19:34:27.350982] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-21T19:34:27.584157] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:34:28.151093] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-21T19:34:28.288896] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T19:34:28.951152] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-21T19:34:29.107033] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:34:29.667550] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:34:29.751081] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-21T19:34:29.978271] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T19:34:30.551015] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-21T19:34:31.336352] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:34:31.350974] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-21T19:34:31.715449] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T19:34:31.821209] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T19:34:32.151021] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-21T19:34:32.951004] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-21T19:34:33.496690] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T19:34:33.751088] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-21T19:34:34.544208] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:34:34.554669] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-21T19:34:34.585524] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T19:34:35.351039] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-21T19:34:36.044103] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:34:36.086670] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T19:34:36.151073] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-21T19:34:36.951079] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-21T19:34:37.751006] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-21T19:34:38.023190] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T19:34:38.293101] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:34:38.551029] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-21T19:34:38.950841] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T19:34:39.351022] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-21T19:34:39.806170] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T19:34:40.151071] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-21T19:34:40.253251] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T19:34:40.950997] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-21T19:34:41.431391] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:34:41.751059] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-21T19:34:41.981767] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T19:34:41.984371] [INFO ] [REMOTE ] KNOP: Full fetch complete (14711 records). [2025-10-21T19:34:41.984443] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-21T19:34:42.359147] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-21T19:34:42.359227] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-21T19:34:42.359588] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-21T19:34:42.359626] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-21T19:34:42.360126] [DEBUG] [LOCAL ] KNOP: Trimmed 14711 records to 10137 (keeping 200 days of data) [2025-10-21T19:34:42.417626] [DEBUG] [LOCAL ] KNOP: Primary data saved (10137 records). [2025-10-21T19:34:42.417804] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-21T19:34:42.417917] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols completed. KNOP took 21.6s. Estimated remaining: 2h 30m 0s. Rate: 7.8 symbols/min [2025-10-21T19:34:42.557755] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-21T19:34:42.589589] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:42.613492] [DEBUG] [LOCAL ] KNSL: Loaded 18516 existing records from primary storage. [2025-10-21T19:34:42.613765] [INFO ] [MAIN ] KNSL: Loaded 18516 existing records. [2025-10-21T19:34:42.788544] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:42.788804] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-21T19:34:42.788892] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-21T19:34:42.789105] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-21T19:34:42.789159] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-21T19:34:43.145833] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:43.351007] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-21T19:34:43.655278] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T19:34:43.714831] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T19:34:44.151036] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-21T19:34:44.569680] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:34:44.951052] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-21T19:34:45.751051] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-21T19:34:46.030479] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T19:34:46.182631] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-21T19:34:46.551100] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-21T19:34:47.081437] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:34:47.351084] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-21T19:34:48.151036] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-21T19:34:48.427157] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:34:48.810281] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:34:48.951024] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-21T19:34:49.661779] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T19:34:49.751039] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-21T19:34:50.019841] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T19:34:50.026148] [INFO ] [REMOTE ] KNF: Full fetch complete (51457 records). [2025-10-21T19:34:50.026239] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-21T19:34:50.402725] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-21T19:34:50.402809] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-21T19:34:50.403618] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-21T19:34:50.403703] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-21T19:34:50.404685] [DEBUG] [LOCAL ] KNF: Trimmed 51457 records to 36664 (keeping 200 days of data) [2025-10-21T19:34:50.576213] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-21T19:34:50.632788] [DEBUG] [LOCAL ] KNF: Primary data saved (36664 records). [2025-10-21T19:34:50.632900] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-21T19:34:50.632975] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols completed. KNF took 29.8s. Estimated remaining: 2h 29m 53s. Rate: 7.8 symbols/min [2025-10-21T19:34:50.800057] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:50.840792] [DEBUG] [LOCAL ] KNTK: Loaded 47220 existing records from primary storage. [2025-10-21T19:34:50.841127] [INFO ] [MAIN ] KNTK: Loaded 47220 existing records. [2025-10-21T19:34:51.017352] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:51.017529] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-21T19:34:51.017575] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-21T19:34:51.017787] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-21T19:34:51.017844] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-21T19:34:51.340882] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T19:34:51.351345] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-21T19:34:51.399015] [INFO ] [REMOTE ] KN: Full fetch complete (56601 records). [2025-10-21T19:34:51.442897] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-21T19:34:51.442797] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:51.832697] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T19:34:51.855292] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-21T19:34:51.855348] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-21T19:34:51.856205] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-21T19:34:51.856265] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-21T19:34:51.857286] [DEBUG] [LOCAL ] KN: Trimmed 56601 records to 38436 (keeping 200 days of data) [2025-10-21T19:34:52.074681] [DEBUG] [LOCAL ] KN: Primary data saved (38436 records). [2025-10-21T19:34:52.074806] [INFO ] [MAIN ] KN: Full history saved. [2025-10-21T19:34:52.075554] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols completed. KN took 31.2s. Estimated remaining: 2h 29m 39s. Rate: 7.8 symbols/min [2025-10-21T19:34:52.151316] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-21T19:34:52.247480] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:52.298606] [DEBUG] [LOCAL ] KNX: Loaded 52639 existing records from primary storage. [2025-10-21T19:34:52.298943] [INFO ] [MAIN ] KNX: Loaded 52639 existing records. [2025-10-21T19:34:52.490608] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:34:52.503739] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-21T19:34:52.505040] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T19:34:52.504292] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-21T19:34:52.507915] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-21T19:34:52.513368] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-21T19:34:52.557708] [INFO ] [REMOTE ] KMX: Full fetch complete (76396 records). [2025-10-21T19:34:52.587375] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-21T19:34:52.956255] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-21T19:34:53.180850] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:53.286075] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-21T19:34:53.286151] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-21T19:34:53.287164] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-21T19:34:53.287226] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-21T19:34:53.288818] [DEBUG] [LOCAL ] KMX: Trimmed 76396 records to 53285 (keeping 200 days of data) [2025-10-21T19:34:53.411453] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T19:34:53.626560] [DEBUG] [LOCAL ] KMX: Primary data saved (53285 records). [2025-10-21T19:34:53.626708] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-21T19:34:53.626794] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols completed. KMX took 32.8s. Estimated remaining: 2h 29m 26s. Rate: 7.8 symbols/min [2025-10-21T19:34:53.756269] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-21T19:34:53.801070] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:34:53.801197] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-21T19:34:53.801233] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-21T19:34:53.801338] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-21T19:34:53.801381] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-21T19:34:53.801476] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-21T19:34:53.801526] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-21T19:34:54.166014] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:34:54.551061] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-21T19:34:54.762039] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T19:34:55.351005] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-21T19:34:55.629202] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T19:34:55.692893] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T19:34:56.151036] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-21T19:34:56.951007] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-21T19:34:57.242538] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T19:34:57.751023] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-21T19:34:58.077275] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-21T19:34:58.402771] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T19:34:58.551102] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-21T19:34:59.337764] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:34:59.350973] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-21T19:34:59.738841] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:35:00.150988] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-21T19:35:00.807554] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T19:35:00.951017] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-21T19:35:01.751090] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-21T19:35:01.951341] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T19:35:02.550997] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-21T19:35:02.651352] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-21T19:35:03.351054] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-21T19:35:03.600834] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T19:35:04.119418] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T19:35:04.150999] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-21T19:35:04.402639] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T19:35:04.951127] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-21T19:35:05.751092] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-21T19:35:06.551065] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-21T19:35:06.713138] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:35:06.890408] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-21T19:35:06.937138] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T19:35:06.941065] [INFO ] [REMOTE ] KNSL: Full fetch complete (27244 records). [2025-10-21T19:35:06.941225] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-21T19:35:07.309904] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-21T19:35:07.309979] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-21T19:35:07.310589] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-21T19:35:07.310631] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-21T19:35:07.311294] [DEBUG] [LOCAL ] KNSL: Trimmed 27244 records to 18446 (keeping 200 days of data) [2025-10-21T19:35:07.359389] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-21T19:35:07.427568] [DEBUG] [LOCAL ] KNSL: Primary data saved (18446 records). [2025-10-21T19:35:07.427712] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-21T19:35:07.427823] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols completed. KNSL took 25.0s. Estimated remaining: 2h 29m 24s. Rate: 7.8 symbols/min [2025-10-21T19:35:07.599133] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:07.599296] [DEBUG] [LOCAL ] KODK: No existing data file found in primary storage. [2025-10-21T19:35:07.599334] [WARN ] [MAIN ] KODK: No existing data found, performing full refresh instead. [2025-10-21T19:35:07.599450] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-21T19:35:07.599492] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-21T19:35:07.599532] [DEBUG] [LOCAL ] KODK: No primary data file found to delete. [2025-10-21T19:35:07.599566] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-21T19:35:07.961226] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:08.151026] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-21T19:35:08.300268] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:35:08.951068] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-21T19:35:09.751096] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-21T19:35:09.942678] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T19:35:10.041860] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-21T19:35:10.551092] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-21T19:35:10.622697] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:35:11.362461] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-21T19:35:11.367825] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T19:35:12.151064] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-21T19:35:12.951083] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-21T19:35:13.000068] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:35:13.040014] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-21T19:35:13.299056] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T19:35:13.751034] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-21T19:35:14.379730] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T19:35:14.551032] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-21T19:35:15.351012] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-21T19:35:15.622052] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T19:35:16.151005] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-21T19:35:16.209313] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T19:35:16.951035] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-21T19:35:17.751006] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-21T19:35:17.789968] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T19:35:17.962575] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-21T19:35:18.285246] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T19:35:18.551032] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-21T19:35:19.351032] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-21T19:35:19.494783] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:35:20.151035] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-21T19:35:20.201798] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:35:20.695705] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-21T19:35:20.704038] [INFO ] [REMOTE ] KNX: Full fetch complete (76298 records). [2025-10-21T19:35:20.704148] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-21T19:35:20.957701] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-21T19:35:21.136574] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-21T19:35:21.136732] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-21T19:35:21.137891] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-21T19:35:21.138169] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-21T19:35:21.140312] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T19:35:21.151615] [DEBUG] [LOCAL ] KNX: Trimmed 76298 records to 52645 (keeping 200 days of data) [2025-10-21T19:35:21.460690] [DEBUG] [LOCAL ] KNX: Primary data saved (52645 records). [2025-10-21T19:35:21.460822] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-21T19:35:21.460896] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols completed. KNX took 29.4s. Estimated remaining: 2h 29m 22s. Rate: 7.8 symbols/min [2025-10-21T19:35:21.628436] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:21.653989] [DEBUG] [LOCAL ] KOF: Loaded 26742 existing records from primary storage. [2025-10-21T19:35:21.654226] [INFO ] [MAIN ] KOF: Loaded 26742 existing records. [2025-10-21T19:35:21.753855] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-21T19:35:21.834393] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:21.834587] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-21T19:35:21.834692] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-21T19:35:21.834877] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-21T19:35:21.834916] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-21T19:35:22.185284] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:22.551017] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-21T19:35:23.351088] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-21T19:35:23.542972] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T19:35:23.551529] [INFO ] [REMOTE ] KNTK: Full fetch complete (65727 records). [2025-10-21T19:35:23.551759] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-21T19:35:23.948349] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-21T19:35:23.948670] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-21T19:35:23.949952] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-21T19:35:23.950090] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-21T19:35:23.984193] [DEBUG] [LOCAL ] KNTK: Trimmed 65727 records to 47232 (keeping 200 days of data) [2025-10-21T19:35:23.986836] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.03 seconds). [2025-10-21T19:35:24.137278] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:35:24.151004] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-21T19:35:24.321446] [DEBUG] [LOCAL ] KNTK: Primary data saved (47232 records). [2025-10-21T19:35:24.321544] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-21T19:35:24.321631] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols completed. KNTK took 33.7s. Estimated remaining: 2h 29m 10s. Rate: 7.8 symbols/min [2025-10-21T19:35:24.499784] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:24.518069] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T19:35:24.535812] [DEBUG] [LOCAL ] KOP: Loaded 17454 existing records from primary storage. [2025-10-21T19:35:24.536121] [INFO ] [MAIN ] KOP: Loaded 17454 existing records. [2025-10-21T19:35:24.716099] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:24.716299] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-21T19:35:24.716346] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-21T19:35:24.716527] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-21T19:35:24.716585] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-21T19:35:24.962194] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-21T19:35:25.082395] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:25.751034] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-21T19:35:26.494204] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:35:26.550987] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-21T19:35:26.838144] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-21T19:35:26.879926] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T19:35:27.351026] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-21T19:35:28.041983] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T19:35:28.090433] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T19:35:28.151023] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-21T19:35:28.951047] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-21T19:35:29.072485] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:35:29.751027] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-21T19:35:30.551020] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-21T19:35:30.661960] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:35:30.823599] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T19:35:31.351023] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-21T19:35:31.561165] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:35:32.151049] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-21T19:35:32.392769] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T19:35:32.951074] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-21T19:35:33.466788] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T19:35:33.751041] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-21T19:35:34.551155] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-21T19:35:35.026240] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T19:35:35.081418] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T19:35:35.351087] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-21T19:35:36.156629] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-21T19:35:36.180094] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:35:36.247887] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:35:36.256468] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-21T19:35:36.256629] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-21T19:35:36.463475] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T19:35:36.464300] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:35:36.464375] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:35:36.464448] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-21T19:35:36.464517] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-21T19:35:36.464558] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-21T19:35:36.464635] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-21T19:35:36.464753] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols completed. KO took 42.8s. Estimated remaining: 2h 29m 6s. Rate: 7.8 symbols/min [2025-10-21T19:35:36.663074] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:36.667439] [DEBUG] [LOCAL ] KORE: Loaded 2176 existing records from primary storage. [2025-10-21T19:35:36.667617] [INFO ] [MAIN ] KORE: Loaded 2176 existing records. [2025-10-21T19:35:36.868920] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:36.869173] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-21T19:35:36.869222] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-21T19:35:36.869366] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-21T19:35:36.869438] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-21T19:35:36.956197] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-21T19:35:37.268556] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T19:35:37.267887] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:37.751054] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-21T19:35:38.175100] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T19:35:38.551031] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-21T19:35:38.623924] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T19:35:39.351028] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-21T19:35:39.481952] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T19:35:40.151114] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-21T19:35:40.951067] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-21T19:35:41.109005] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T19:35:41.125206] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T19:35:41.128770] [INFO ] [REMOTE ] KODK: Full fetch complete (63372 records). [2025-10-21T19:35:41.129272] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-21T19:35:41.525805] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-21T19:35:41.529137] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-21T19:35:41.529276] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T19:35:41.531830] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-21T19:35:41.531895] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-21T19:35:41.533035] [DEBUG] [LOCAL ] KODK: Trimmed 63372 records to 43762 (keeping 200 days of data) [2025-10-21T19:35:41.751099] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-21T19:35:41.778064] [DEBUG] [LOCAL ] KODK: Primary data saved (43762 records). [2025-10-21T19:35:41.778180] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-21T19:35:41.778249] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols completed. KODK took 34.4s. Estimated remaining: 2h 28m 56s. Rate: 7.8 symbols/min [2025-10-21T19:35:41.950098] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:42.000639] [DEBUG] [LOCAL ] KOS: Loaded 53095 existing records from primary storage. [2025-10-21T19:35:42.001058] [INFO ] [MAIN ] KOS: Loaded 53095 existing records. [2025-10-21T19:35:42.181736] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:42.181937] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-21T19:35:42.181984] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-21T19:35:42.182157] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-21T19:35:42.182195] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-21T19:35:42.266819] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-21T19:35:42.554824] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:42.554928] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-21T19:35:42.996269] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T19:35:43.351039] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-21T19:35:44.151071] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-21T19:35:44.951040] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-21T19:35:45.177032] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T19:35:45.218883] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:35:45.751003] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-21T19:35:46.163003] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T19:35:46.172004] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-21T19:35:46.551034] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-21T19:35:47.351037] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-21T19:35:47.643631] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T19:35:48.151032] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-21T19:35:48.586257] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T19:35:48.951069] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-21T19:35:49.004272] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:35:49.751097] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-21T19:35:50.086570] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T19:35:50.551051] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-21T19:35:50.831501] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T19:35:50.834677] [INFO ] [REMOTE ] KOP: Full fetch complete (25443 records). [2025-10-21T19:35:50.834775] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-21T19:35:51.087003] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T19:35:51.205591] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-21T19:35:51.205683] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-21T19:35:51.206176] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-21T19:35:51.206216] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-21T19:35:51.206835] [DEBUG] [LOCAL ] KOP: Trimmed 25443 records to 17428 (keeping 200 days of data) [2025-10-21T19:35:51.308084] [DEBUG] [LOCAL ] KOP: Primary data saved (17428 records). [2025-10-21T19:35:51.308209] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-21T19:35:51.308285] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols completed. KOP took 27.0s. Estimated remaining: 2h 28m 50s. Rate: 7.8 symbols/min [2025-10-21T19:35:51.361108] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-21T19:35:51.493449] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:51.540478] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-21T19:35:51.540813] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-21T19:35:51.714117] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:51.714288] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-21T19:35:51.714360] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-21T19:35:51.714709] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-21T19:35:51.714780] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-21T19:35:52.062948] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:52.151028] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-21T19:35:52.660878] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T19:35:52.951009] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-21T19:35:53.645225] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T19:35:53.750988] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-21T19:35:54.346461] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T19:35:54.351212] [INFO ] [REMOTE ] KOF: Full fetch complete (38167 records). [2025-10-21T19:35:54.351295] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-21T19:35:54.557360] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-21T19:35:54.743853] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-21T19:35:54.743927] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-21T19:35:54.744629] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-21T19:35:54.744703] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-21T19:35:54.745482] [DEBUG] [LOCAL ] KOF: Trimmed 38167 records to 26600 (keeping 200 days of data) [2025-10-21T19:35:54.904920] [DEBUG] [LOCAL ] KOF: Primary data saved (26600 records). [2025-10-21T19:35:54.905045] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-21T19:35:54.905120] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols completed. KOF took 33.4s. Estimated remaining: 2h 28m 38s. Rate: 7.8 symbols/min [2025-10-21T19:35:55.074259] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:55.116574] [DEBUG] [LOCAL ] KRC: Loaded 48217 existing records from primary storage. [2025-10-21T19:35:55.116912] [INFO ] [MAIN ] KRC: Loaded 48217 existing records. [2025-10-21T19:35:55.314858] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:55.315108] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-21T19:35:55.315162] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-21T19:35:55.315353] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-21T19:35:55.315407] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-21T19:35:55.379242] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-21T19:35:55.677728] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:35:55.711287] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T19:35:55.943936] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T19:35:56.151014] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-21T19:35:56.352207] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:35:56.606862] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T19:35:56.951063] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-21T19:35:57.751033] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-21T19:35:58.551052] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-21T19:35:58.808721] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T19:35:59.123025] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T19:35:59.124082] [INFO ] [REMOTE ] KORE: Full fetch complete (4144 records). [2025-10-21T19:35:59.124149] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-21T19:35:59.378203] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-21T19:35:59.518309] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-21T19:35:59.518434] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-21T19:35:59.518589] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-21T19:35:59.518852] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-21T19:35:59.520106] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T19:35:59.529700] [DEBUG] [LOCAL ] KORE: Trimmed 4144 records to 2184 (keeping 200 days of data) [2025-10-21T19:35:59.541557] [DEBUG] [LOCAL ] KORE: Primary data saved (2184 records). [2025-10-21T19:35:59.541619] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-21T19:35:59.541716] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols completed. KORE took 23.1s. Estimated remaining: 2h 28m 28s. Rate: 7.8 symbols/min [2025-10-21T19:35:59.707436] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:35:59.746427] [DEBUG] [LOCAL ] KREF: Loaded 38036 existing records from primary storage. [2025-10-21T19:35:59.746713] [INFO ] [MAIN ] KREF: Loaded 38036 existing records. [2025-10-21T19:35:59.924046] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:35:59.924293] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-21T19:35:59.924341] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-21T19:35:59.924513] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-21T19:35:59.924553] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-21T19:36:00.161731] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-21T19:36:00.287037] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:00.951088] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-21T19:36:01.733724] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-21T19:36:01.750968] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-21T19:36:02.019553] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T19:36:02.551012] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-21T19:36:02.834734] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T19:36:03.351069] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-21T19:36:03.886226] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T19:36:03.954142] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:36:04.151056] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-21T19:36:04.951061] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-21T19:36:04.980679] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T19:36:05.450511] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:36:05.751053] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-21T19:36:06.550997] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-21T19:36:07.001863] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T19:36:07.288088] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T19:36:07.351071] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-21T19:36:07.980539] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T19:36:08.151029] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-21T19:36:08.735266] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:36:08.951052] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-21T19:36:09.751005] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-21T19:36:10.050150] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T19:36:10.430875] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T19:36:10.551027] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-21T19:36:11.350995] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-21T19:36:11.618405] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T19:36:11.991302] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T19:36:12.151027] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-21T19:36:12.834849] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T19:36:12.951020] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-21T19:36:13.756703] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-21T19:36:13.762906] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T19:36:14.551039] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-21T19:36:14.736384] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:36:15.255690] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T19:36:15.351045] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-21T19:36:15.686245] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:36:16.151061] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-21T19:36:16.950990] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-21T19:36:17.300610] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T19:36:17.751006] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-21T19:36:18.018968] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:36:18.189754] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T19:36:18.551038] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-21T19:36:19.351088] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-21T19:36:19.451835] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T19:36:19.986208] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T19:36:20.151011] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-21T19:36:20.951064] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-21T19:36:21.076608] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T19:36:21.456605] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T19:36:21.554224] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T19:36:21.564050] [INFO ] [REMOTE ] KR: Full fetch complete (77843 records). [2025-10-21T19:36:21.564298] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-21T19:36:21.756298] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-21T19:36:22.003776] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-21T19:36:22.003897] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-21T19:36:22.005329] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-21T19:36:22.005398] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-21T19:36:22.007474] [DEBUG] [LOCAL ] KR: Trimmed 77843 records to 53681 (keeping 200 days of data) [2025-10-21T19:36:22.370412] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-21T19:36:22.370934] [INFO ] [MAIN ] KR: Full history saved. [2025-10-21T19:36:22.371072] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols completed. KR took 31.1s. Estimated remaining: 2h 28m 34s. Rate: 7.8 symbols/min [2025-10-21T19:36:22.549794] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:22.551086] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-21T19:36:22.600498] [DEBUG] [LOCAL ] KRG: Loaded 49298 existing records from primary storage. [2025-10-21T19:36:22.600932] [INFO ] [MAIN ] KRG: Loaded 49298 existing records. [2025-10-21T19:36:22.789396] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:22.789734] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-21T19:36:22.789793] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-21T19:36:22.790405] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-21T19:36:22.790464] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-21T19:36:23.187086] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:23.312349] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T19:36:23.351008] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-21T19:36:24.151042] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-21T19:36:24.657013] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-21T19:36:24.951021] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-21T19:36:25.047082] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T19:36:25.053758] [INFO ] [REMOTE ] KREF: Full fetch complete (52886 records). [2025-10-21T19:36:25.053861] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-21T19:36:25.441696] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-21T19:36:25.441783] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-21T19:36:25.442682] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-21T19:36:25.442745] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-21T19:36:25.443795] [DEBUG] [LOCAL ] KREF: Trimmed 52886 records to 38066 (keeping 200 days of data) [2025-10-21T19:36:25.674218] [DEBUG] [LOCAL ] KREF: Primary data saved (38066 records). [2025-10-21T19:36:25.674432] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-21T19:36:25.674552] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols completed. KREF took 26.1s. Estimated remaining: 2h 28m 22s. Rate: 7.8 symbols/min [2025-10-21T19:36:25.756359] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-21T19:36:25.848484] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:25.848677] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-21T19:36:25.848731] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-21T19:36:25.848837] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-21T19:36:25.848880] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-21T19:36:25.848920] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-21T19:36:25.848995] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-21T19:36:26.203757] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:26.361419] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-21T19:36:26.370157] [INFO ] [REMOTE ] KOS: Full fetch complete (77023 records). [2025-10-21T19:36:26.370339] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-21T19:36:26.551958] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-21T19:36:26.822515] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-21T19:36:26.817113] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:36:26.840121] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-21T19:36:26.844491] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-21T19:36:26.844719] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-21T19:36:26.845121] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:36:26.849709] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T19:36:26.845684] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-21T19:36:26.849838] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-21T19:36:26.850066] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:36:26.859314] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-21T19:36:26.860913] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-21T19:36:26.861076] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-21T19:36:26.861214] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-21T19:36:26.861303] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols completed. KRMN took 1.2s. Estimated remaining: 2h 28m 9s. Rate: 7.8 symbols/min [2025-10-21T19:36:26.872778] [DEBUG] [LOCAL ] KOS: Trimmed 77023 records to 53093 (keeping 200 days of data) [2025-10-21T19:36:27.141122] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:27.268857] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T19:36:27.320181] [INFO ] [REMOTE ] KRC: Full fetch complete (70013 records). [2025-10-21T19:36:27.354982] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-21T19:36:27.354588] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-21T19:36:27.444904] [DEBUG] [LOCAL ] KRO: Loaded 26644 existing records from primary storage. [2025-10-21T19:36:27.488019] [INFO ] [MAIN ] KRO: Loaded 26644 existing records. [2025-10-21T19:36:27.477427] [DEBUG] [LOCAL ] KOS: Primary data saved (53093 records). [2025-10-21T19:36:27.493549] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-21T19:36:27.559782] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols completed. KOS took 45.8s. Estimated remaining: 2h 27m 54s. Rate: 7.8 symbols/min [2025-10-21T19:36:28.022707] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:28.075030] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-21T19:36:28.075193] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-21T19:36:28.091477] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-21T19:36:28.130428] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-21T19:36:28.130304] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:28.225723] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-21T19:36:28.232817] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-21T19:36:28.246192] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-21T19:36:28.260345] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-21T19:36:28.305261] [DEBUG] [LOCAL ] KRC: Trimmed 70013 records to 48149 (keeping 200 days of data) [2025-10-21T19:36:28.583330] [DEBUG] [LOCAL ] KRP: Loaded 36203 existing records from primary storage. [2025-10-21T19:36:28.633722] [INFO ] [MAIN ] KRP: Loaded 36203 existing records. [2025-10-21T19:36:28.943990] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:28.966549] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-21T19:36:29.081302] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:29.097157] [DEBUG] [LOCAL ] KRC: Primary data saved (48149 records). [2025-10-21T19:36:29.097726] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-21T19:36:29.098068] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-21T19:36:29.098372] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols completed. KRC took 34.2s. Estimated remaining: 2h 27m 41s. Rate: 7.8 symbols/min [2025-10-21T19:36:29.098203] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-21T19:36:29.109715] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-21T19:36:29.134343] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-21T19:36:29.405018] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:29.417434] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T19:36:29.468546] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-21T19:36:29.705419] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:29.725154] [DEBUG] [LOCAL ] KSS: Loaded 53591 existing records from primary storage. [2025-10-21T19:36:29.725497] [INFO ] [MAIN ] KSS: Loaded 53591 existing records. [2025-10-21T19:36:29.756269] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-21T19:36:29.905981] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:29.906336] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-21T19:36:29.906395] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-21T19:36:29.906747] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-21T19:36:29.906803] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-21T19:36:30.229182] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T19:36:30.286833] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:30.551035] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-21T19:36:31.272404] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:36:31.350987] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-21T19:36:31.494661] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T19:36:32.151051] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-21T19:36:32.799204] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T19:36:32.951067] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-21T19:36:32.998968] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:36:33.099099] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T19:36:33.750999] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-21T19:36:34.551059] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-21T19:36:34.850338] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T19:36:34.881869] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T19:36:35.351026] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-21T19:36:35.913489] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:36:36.151002] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-21T19:36:36.600387] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T19:36:36.951050] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-21T19:36:37.750997] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-21T19:36:38.210823] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T19:36:38.508202] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:36:38.550978] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-21T19:36:39.351007] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-21T19:36:39.444624] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:36:39.995375] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T19:36:40.151019] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-21T19:36:40.951138] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-21T19:36:41.354424] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T19:36:41.751020] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-21T19:36:41.806866] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T19:36:42.092926] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T19:36:42.551086] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-21T19:36:43.254349] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T19:36:43.350999] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-21T19:36:44.151013] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-21T19:36:44.261539] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:36:44.737156] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T19:36:44.951002] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-21T19:36:44.967980] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T19:36:45.751056] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-21T19:36:46.333043] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T19:36:46.550985] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-21T19:36:46.945876] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:36:47.351059] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-21T19:36:48.150996] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-21T19:36:48.255019] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:36:48.706917] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T19:36:48.951055] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-21T19:36:49.751002] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-21T19:36:50.164366] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T19:36:50.225028] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T19:36:50.551017] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-21T19:36:51.351006] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-21T19:36:51.437255] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:36:52.151002] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-21T19:36:52.478393] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T19:36:52.685233] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T19:36:52.951027] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-21T19:36:53.575979] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T19:36:53.583659] [INFO ] [REMOTE ] KRG: Full fetch complete (71341 records). [2025-10-21T19:36:53.583783] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-21T19:36:53.756295] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-21T19:36:53.971275] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-21T19:36:53.971422] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-21T19:36:53.972473] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-21T19:36:53.972537] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-21T19:36:53.973991] [DEBUG] [LOCAL ] KRG: Trimmed 71341 records to 49291 (keeping 200 days of data) [2025-10-21T19:36:54.206857] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T19:36:54.295775] [DEBUG] [LOCAL ] KRG: Primary data saved (49291 records). [2025-10-21T19:36:54.295901] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-21T19:36:54.295977] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols completed. KRG took 31.9s. Estimated remaining: 2h 27m 49s. Rate: 7.8 symbols/min [2025-10-21T19:36:54.461521] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:54.461723] [DEBUG] [LOCAL ] KT: No existing data file found in primary storage. [2025-10-21T19:36:54.461769] [WARN ] [MAIN ] KT: No existing data found, performing full refresh instead. [2025-10-21T19:36:54.461889] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-21T19:36:54.461928] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-21T19:36:54.461969] [DEBUG] [LOCAL ] KT: No primary data file found to delete. [2025-10-21T19:36:54.461999] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-21T19:36:54.557927] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-21T19:36:54.808604] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:55.150157] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:36:55.155301] [INFO ] [REMOTE ] KRP: Full fetch complete (54981 records). [2025-10-21T19:36:55.155407] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-21T19:36:55.362095] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-21T19:36:55.547820] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-21T19:36:55.547929] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-21T19:36:55.548839] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-21T19:36:55.548900] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-21T19:36:55.550131] [DEBUG] [LOCAL ] KRP: Trimmed 54981 records to 36048 (keeping 200 days of data) [2025-10-21T19:36:55.760613] [DEBUG] [LOCAL ] KRP: Primary data saved (36048 records). [2025-10-21T19:36:55.760769] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-21T19:36:55.760848] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols completed. KRP took 28.2s. Estimated remaining: 2h 27m 36s. Rate: 7.8 symbols/min [2025-10-21T19:36:55.927186] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:55.963951] [DEBUG] [LOCAL ] KTB: Loaded 40517 existing records from primary storage. [2025-10-21T19:36:55.964263] [INFO ] [MAIN ] KTB: Loaded 40517 existing records. [2025-10-21T19:36:56.161126] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-21T19:36:56.165675] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:56.166576] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-21T19:36:56.166632] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-21T19:36:56.166855] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-21T19:36:56.166898] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-21T19:36:56.517613] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:56.796791] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T19:36:56.951023] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-21T19:36:57.034087] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:36:57.434231] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T19:36:57.439271] [INFO ] [REMOTE ] KRO: Full fetch complete (35288 records). [2025-10-21T19:36:57.439438] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-21T19:36:57.756180] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-21T19:36:57.821805] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-21T19:36:57.821895] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-21T19:36:57.822686] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-21T19:36:57.822750] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-21T19:36:57.823532] [DEBUG] [LOCAL ] KRO: Trimmed 35288 records to 26642 (keeping 200 days of data) [2025-10-21T19:36:57.975163] [DEBUG] [LOCAL ] KRO: Primary data saved (26642 records). [2025-10-21T19:36:57.975302] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-21T19:36:57.975380] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols completed. KRO took 31.1s. Estimated remaining: 2h 27m 23s. Rate: 7.8 symbols/min [2025-10-21T19:36:58.143894] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:36:58.156702] [DEBUG] [LOCAL ] KTF: Loaded 11669 existing records from primary storage. [2025-10-21T19:36:58.156918] [INFO ] [MAIN ] KTF: Loaded 11669 existing records. [2025-10-21T19:36:58.333131] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:36:58.333328] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-21T19:36:58.333373] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-21T19:36:58.333525] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-21T19:36:58.333561] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-21T19:36:58.574588] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-21T19:36:58.691340] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:36:59.054172] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T19:36:59.348041] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:36:59.355082] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-21T19:37:00.151022] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-21T19:37:00.231935] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:37:00.951570] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-21T19:37:00.957309] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T19:37:01.170457] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T19:37:01.751074] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-21T19:37:02.551039] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-21T19:37:02.941581] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-21T19:37:03.361337] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-21T19:37:03.367045] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T19:37:03.407460] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T19:37:04.151030] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-21T19:37:04.951045] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-21T19:37:05.195858] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:37:05.751014] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-21T19:37:05.837251] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:37:05.939446] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:37:06.551040] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-21T19:37:07.350996] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-21T19:37:07.745671] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T19:37:07.754119] [INFO ] [REMOTE ] KSS: Full fetch complete (77751 records). [2025-10-21T19:37:07.754256] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-21T19:37:08.151522] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-21T19:37:08.151892] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-21T19:37:08.152804] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-21T19:37:08.154005] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-21T19:37:08.154172] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-21T19:37:08.169453] [DEBUG] [LOCAL ] KSS: Trimmed 77751 records to 53589 (keeping 200 days of data) [2025-10-21T19:37:08.182579] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T19:37:08.505868] [DEBUG] [LOCAL ] KSS: Primary data saved (53589 records). [2025-10-21T19:37:08.505994] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-21T19:37:08.507011] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols completed. KSS took 39.4s. Estimated remaining: 2h 27m 18s. Rate: 7.8 symbols/min [2025-10-21T19:37:08.675815] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:08.675958] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-21T19:37:08.675994] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-21T19:37:08.676099] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-21T19:37:08.676153] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-21T19:37:08.676196] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-21T19:37:08.676229] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-21T19:37:08.956328] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-21T19:37:09.040752] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:09.067791] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:37:09.172959] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T19:37:09.751094] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-21T19:37:10.303098] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T19:37:10.551085] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-21T19:37:11.292255] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T19:37:11.350988] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-21T19:37:11.586337] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T19:37:12.151015] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-21T19:37:12.785111] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T19:37:12.867898] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T19:37:12.950994] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-21T19:37:13.751034] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-21T19:37:14.551019] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-21T19:37:14.622066] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T19:37:15.259031] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T19:37:15.351054] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-21T19:37:15.426614] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T19:37:16.133488] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T19:37:16.150989] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-21T19:37:16.951092] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-21T19:37:17.078413] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T19:37:17.516678] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:37:17.751011] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-21T19:37:18.546267] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:37:18.550969] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-21T19:37:19.350999] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-21T19:37:19.437981] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T19:37:20.151027] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-21T19:37:20.912578] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T19:37:20.950992] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-21T19:37:20.992438] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T19:37:21.688462] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T19:37:21.690260] [INFO ] [REMOTE ] KTF: Full fetch complete (17289 records). [2025-10-21T19:37:21.690329] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-21T19:37:21.756201] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-21T19:37:22.056090] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-21T19:37:22.056161] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-21T19:37:22.056526] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-21T19:37:22.056565] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-21T19:37:22.057076] [DEBUG] [LOCAL ] KTF: Trimmed 17289 records to 11685 (keeping 200 days of data) [2025-10-21T19:37:22.129008] [DEBUG] [LOCAL ] KTF: Primary data saved (11685 records). [2025-10-21T19:37:22.129142] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-21T19:37:22.129245] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols completed. KTF took 24.2s. Estimated remaining: 2h 27m 16s. Rate: 7.8 symbols/min [2025-10-21T19:37:22.283921] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T19:37:22.300517] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:22.351991] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-21T19:37:22.352283] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-21T19:37:22.526637] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:22.526878] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-21T19:37:22.526926] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-21T19:37:22.527113] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-21T19:37:22.527149] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-21T19:37:22.556244] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-21T19:37:22.881028] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:23.351074] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-21T19:37:23.769444] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-21T19:37:24.150997] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-21T19:37:24.248128] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:37:24.951084] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-21T19:37:25.420360] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T19:37:25.751136] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-21T19:37:25.845257] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:37:26.551110] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-21T19:37:27.128774] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T19:37:27.351024] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-21T19:37:27.630630] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T19:37:28.151025] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-21T19:37:28.761470] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T19:37:28.951015] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-21T19:37:29.751081] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-21T19:37:30.122892] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T19:37:30.551083] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-21T19:37:30.687254] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:37:30.692940] [INFO ] [REMOTE ] KTB: Full fetch complete (58222 records). [2025-10-21T19:37:30.693062] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-21T19:37:31.087719] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-21T19:37:31.088062] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-21T19:37:31.089368] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-21T19:37:31.089478] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-21T19:37:31.103884] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T19:37:31.125752] [DEBUG] [LOCAL ] KTB: Trimmed 58222 records to 40377 (keeping 200 days of data) [2025-10-21T19:37:31.128019] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:37:31.139095] [INFO ] [REMOTE ] KT: Full fetch complete (66789 records). [2025-10-21T19:37:31.139226] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-21T19:37:31.354849] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-21T19:37:31.826136] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-21T19:37:31.826876] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-21T19:37:31.826810] [DEBUG] [LOCAL ] KTB: Primary data saved (40377 records). [2025-10-21T19:37:31.828158] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-21T19:37:31.828236] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-21T19:37:31.828420] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-21T19:37:31.829086] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols completed. KTB took 36.1s. Estimated remaining: 2h 27m 10s. Rate: 7.8 symbols/min [2025-10-21T19:37:31.929047] [DEBUG] [LOCAL ] KT: Trimmed 66789 records to 45470 (keeping 200 days of data) [2025-10-21T19:37:32.089806] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:32.175293] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-21T19:37:32.263521] [DEBUG] [LOCAL ] KVYO: Loaded 50869 existing records from primary storage. [2025-10-21T19:37:32.272734] [INFO ] [MAIN ] KVYO: Loaded 50869 existing records. [2025-10-21T19:37:32.407716] [DEBUG] [LOCAL ] KT: Primary data saved (45470 records). [2025-10-21T19:37:32.411907] [INFO ] [MAIN ] KT: Full history saved. [2025-10-21T19:37:32.432536] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols completed. KT took 38.1s. Estimated remaining: 2h 26m 55s. Rate: 7.8 symbols/min [2025-10-21T19:37:32.575790] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:32.617065] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-21T19:37:32.617319] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-21T19:37:32.629915] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T19:37:32.646252] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-21T19:37:32.647893] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-21T19:37:32.679231] [INFO ] [REMOTE ] KUKE: Full fetch complete (9347 records). [2025-10-21T19:37:32.702434] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-21T19:37:32.733075] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:33.138554] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T19:37:33.159954] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:37:33.172606] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:37:33.183921] [DEBUG] [LOCAL ] KW: Loaded 40515 existing records from primary storage. [2025-10-21T19:37:33.201846] [INFO ] [MAIN ] KW: Loaded 40515 existing records. [2025-10-21T19:37:33.190633] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-21T19:37:33.202050] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-21T19:37:33.213201] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-21T19:37:33.222562] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-21T19:37:33.238222] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols completed. KUKE took 24.7s. Estimated remaining: 2h 26m 41s. Rate: 7.8 symbols/min [2025-10-21T19:37:33.451566] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:33.467532] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-21T19:37:33.655619] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:33.660598] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:33.661354] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-21T19:37:33.661405] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-21T19:37:33.661609] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-21T19:37:33.661721] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-21T19:37:33.871827] [DEBUG] [LOCAL ] KWR: Loaded 15952 existing records from primary storage. [2025-10-21T19:37:33.897071] [INFO ] [MAIN ] KWR: Loaded 15952 existing records. [2025-10-21T19:37:34.185820] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:34.186272] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-21T19:37:34.251446] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:34.251985] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-21T19:37:34.252145] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-21T19:37:34.252388] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-21T19:37:34.252446] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-21T19:37:34.384114] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T19:37:34.559459] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-21T19:37:34.648068] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:35.251618] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:37:35.351006] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-21T19:37:35.742054] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:37:36.151051] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-21T19:37:36.185587] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T19:37:36.951011] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-21T19:37:37.048066] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:37:37.495139] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:37:37.751012] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-21T19:37:38.551063] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-21T19:37:38.643683] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:37:39.147992] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T19:37:39.351049] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-21T19:37:39.511510] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T19:37:39.918290] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T19:37:40.151021] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-21T19:37:40.951069] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-21T19:37:41.751052] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-21T19:37:41.806285] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T19:37:41.930841] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T19:37:42.551084] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-21T19:37:43.350984] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-21T19:37:43.523920] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:37:43.671019] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T19:37:44.151047] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-21T19:37:44.951013] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-21T19:37:45.048401] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:37:45.122680] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T19:37:45.751091] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-21T19:37:46.003164] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T19:37:46.551086] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-21T19:37:46.905269] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T19:37:47.351074] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-21T19:37:48.151050] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-21T19:37:48.296728] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:37:48.951185] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-21T19:37:49.234204] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T19:37:49.298369] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T19:37:49.751077] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-21T19:37:50.507520] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:37:50.550989] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-21T19:37:50.785251] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T19:37:51.351054] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-21T19:37:52.151003] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-21T19:37:52.220853] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T19:37:52.285075] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T19:37:52.951027] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-21T19:37:53.654091] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T19:37:53.751049] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-21T19:37:54.550995] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-21T19:37:54.632010] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T19:37:55.350990] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-21T19:37:55.521446] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T19:37:55.918491] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T19:37:56.151080] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-21T19:37:56.951000] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-21T19:37:56.991497] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T19:37:57.025623] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:37:57.027760] [INFO ] [REMOTE ] KWR: Full fetch complete (23228 records). [2025-10-21T19:37:57.027867] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-21T19:37:57.408548] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-21T19:37:57.408622] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-21T19:37:57.409138] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-21T19:37:57.409210] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-21T19:37:57.409818] [DEBUG] [LOCAL ] KWR: Trimmed 23228 records to 15865 (keeping 200 days of data) [2025-10-21T19:37:57.506593] [DEBUG] [LOCAL ] KWR: Primary data saved (15865 records). [2025-10-21T19:37:57.506747] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-21T19:37:57.506829] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols completed. KWR took 24.2s. Estimated remaining: 2h 26m 49s. Rate: 7.8 symbols/min [2025-10-21T19:37:57.672299] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:37:57.703728] [DEBUG] [LOCAL ] KYN: Loaded 30326 existing records from primary storage. [2025-10-21T19:37:57.703998] [INFO ] [MAIN ] KYN: Loaded 30326 existing records. [2025-10-21T19:37:57.757527] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-21T19:37:57.884198] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:37:57.884425] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-21T19:37:57.884472] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-21T19:37:57.884696] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-21T19:37:57.884752] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-21T19:37:58.227694] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:37:58.551067] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-21T19:37:59.154761] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T19:37:59.351005] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-21T19:37:59.662861] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T19:37:59.670943] [INFO ] [REMOTE ] KVYO: Full fetch complete (72193 records). [2025-10-21T19:37:59.671056] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-21T19:38:00.072622] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-21T19:38:00.072802] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-21T19:38:00.074015] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-21T19:38:00.074383] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-21T19:38:00.099828] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T19:38:00.119067] [DEBUG] [LOCAL ] KVYO: Trimmed 72193 records to 50885 (keeping 200 days of data) [2025-10-21T19:38:00.130713] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T19:38:00.176330] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-21T19:38:00.222103] [INFO ] [REMOTE ] KVUE: Full fetch complete (77844 records). [2025-10-21T19:38:00.224714] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-21T19:38:00.822527] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-21T19:38:00.823443] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-21T19:38:00.836848] [DEBUG] [LOCAL ] KVYO: Primary data saved (50885 records). [2025-10-21T19:38:00.828617] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-21T19:38:00.836975] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-21T19:38:00.837047] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-21T19:38:00.837164] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols completed. KVYO took 29.0s. Estimated remaining: 2h 26m 37s. Rate: 7.8 symbols/min [2025-10-21T19:38:00.938683] [DEBUG] [LOCAL ] KVUE: Trimmed 77844 records to 53667 (keeping 200 days of data) [2025-10-21T19:38:01.007290] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-21T19:38:01.103905] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:01.363483] [DEBUG] [LOCAL ] L: Loaded 41243 existing records from primary storage. [2025-10-21T19:38:01.367543] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-21T19:38:01.367901] [INFO ] [MAIN ] L: Loaded 41243 existing records. [2025-10-21T19:38:01.367973] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-21T19:38:01.374116] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols completed. KVUE took 39.2s. Estimated remaining: 2h 26m 23s. Rate: 7.8 symbols/min [2025-10-21T19:38:01.744900] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:01.738226] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:01.745670] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-21T19:38:01.745761] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-21T19:38:01.746100] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-21T19:38:01.746226] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-21T19:38:02.056782] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T19:38:02.097362] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-21T19:38:02.120386] [DEBUG] [LOCAL ] LAC: Loaded 52554 existing records from primary storage. [2025-10-21T19:38:02.140378] [INFO ] [MAIN ] LAC: Loaded 52554 existing records. [2025-10-21T19:38:02.201993] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:02.358104] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:02.358308] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-21T19:38:02.358364] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-21T19:38:02.358537] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-21T19:38:02.358574] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-21T19:38:02.556358] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-21T19:38:02.707875] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:38:02.736635] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:03.351018] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-21T19:38:03.434599] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:38:04.151032] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-21T19:38:04.183562] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T19:38:04.632067] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T19:38:04.951095] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-21T19:38:05.751027] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-21T19:38:06.252277] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T19:38:06.467337] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T19:38:06.473367] [INFO ] [REMOTE ] KW: Full fetch complete (57265 records). [2025-10-21T19:38:06.473463] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-21T19:38:06.556143] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-21T19:38:06.877601] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-21T19:38:06.877782] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-21T19:38:06.878746] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-21T19:38:06.878825] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-21T19:38:06.897211] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T19:38:06.904501] [DEBUG] [LOCAL ] KW: Trimmed 57265 records to 40418 (keeping 200 days of data) [2025-10-21T19:38:07.137587] [DEBUG] [LOCAL ] KW: Primary data saved (40418 records). [2025-10-21T19:38:07.137732] [INFO ] [MAIN ] KW: Full history saved. [2025-10-21T19:38:07.137845] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols completed. KW took 34.7s. Estimated remaining: 2h 26m 13s. Rate: 7.8 symbols/min [2025-10-21T19:38:07.305844] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:07.327630] [DEBUG] [LOCAL ] LAD: Loaded 23301 existing records from primary storage. [2025-10-21T19:38:07.327917] [INFO ] [MAIN ] LAD: Loaded 23301 existing records. [2025-10-21T19:38:07.357857] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-21T19:38:07.505146] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:07.505343] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-21T19:38:07.505389] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-21T19:38:07.505590] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-21T19:38:07.505628] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-21T19:38:07.857216] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:08.151066] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-21T19:38:08.249181] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:38:08.951050] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-21T19:38:09.264863] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T19:38:09.568465] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:38:09.751051] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-21T19:38:10.232980] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T19:38:10.551031] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-21T19:38:11.350995] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-21T19:38:11.688525] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T19:38:11.922112] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:38:12.151047] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-21T19:38:12.732429] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:38:12.951070] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-21T19:38:13.505734] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T19:38:13.751079] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-21T19:38:14.551034] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-21T19:38:14.926381] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T19:38:15.046883] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:38:15.351017] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-21T19:38:15.803425] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T19:38:16.151021] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-21T19:38:16.951069] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-21T19:38:17.233876] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T19:38:17.520339] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:38:17.678245] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T19:38:17.751028] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-21T19:38:18.551016] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-21T19:38:19.281585] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:38:19.351137] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-21T19:38:19.876207] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T19:38:20.151075] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-21T19:38:20.906133] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:38:20.951061] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-21T19:38:21.500159] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T19:38:21.751079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-21T19:38:22.551011] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-21T19:38:23.347196] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-21T19:38:23.358113] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-21T19:38:23.586069] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T19:38:24.151047] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-21T19:38:24.432073] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T19:38:24.459760] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T19:38:24.951043] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-21T19:38:25.502012] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T19:38:25.751027] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-21T19:38:26.173306] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T19:38:26.551022] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-21T19:38:27.350988] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-21T19:38:27.609795] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:38:27.772109] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:38:27.777165] [INFO ] [REMOTE ] KYN: Full fetch complete (44372 records). [2025-10-21T19:38:27.777332] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-21T19:38:28.162942] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-21T19:38:28.160526] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-21T19:38:28.163746] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-21T19:38:28.164532] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-21T19:38:28.164688] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-21T19:38:28.165623] [DEBUG] [LOCAL ] KYN: Trimmed 44372 records to 30292 (keeping 200 days of data) [2025-10-21T19:38:28.356405] [DEBUG] [LOCAL ] KYN: Primary data saved (30292 records). [2025-10-21T19:38:28.356838] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-21T19:38:28.357669] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols completed. KYN took 30.9s. Estimated remaining: 2h 26m 18s. Rate: 7.8 symbols/min [2025-10-21T19:38:28.536314] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:28.577758] [DEBUG] [LOCAL ] LADR: Loaded 39435 existing records from primary storage. [2025-10-21T19:38:28.578050] [INFO ] [MAIN ] LADR: Loaded 39435 existing records. [2025-10-21T19:38:28.762558] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:28.762912] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-21T19:38:28.763094] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-21T19:38:28.763597] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-21T19:38:28.763695] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-21T19:38:28.956057] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-21T19:38:29.082048] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:38:29.209062] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:29.751064] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-21T19:38:30.154363] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T19:38:30.496261] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T19:38:30.551035] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-21T19:38:31.351002] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-21T19:38:31.429263] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T19:38:31.437008] [INFO ] [REMOTE ] L: Full fetch complete (59408 records). [2025-10-21T19:38:31.437141] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-21T19:38:31.841252] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-21T19:38:31.841327] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-21T19:38:31.842223] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-21T19:38:31.842284] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-21T19:38:31.844429] [DEBUG] [LOCAL ] L: Trimmed 59408 records to 41211 (keeping 200 days of data) [2025-10-21T19:38:32.081486] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:38:32.131286] [DEBUG] [LOCAL ] L: Primary data saved (41211 records). [2025-10-21T19:38:32.131415] [INFO ] [MAIN ] L: Full history saved. [2025-10-21T19:38:32.132018] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols completed. L took 31.3s. Estimated remaining: 2h 26m 7s. Rate: 7.8 symbols/min [2025-10-21T19:38:32.156956] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-21T19:38:32.308934] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:32.314388] [DEBUG] [LOCAL ] LANV: Loaded 2795 existing records from primary storage. [2025-10-21T19:38:32.314590] [INFO ] [MAIN ] LANV: Loaded 2795 existing records. [2025-10-21T19:38:32.490994] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:32.491204] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-21T19:38:32.491252] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-21T19:38:32.491393] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-21T19:38:32.491450] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-21T19:38:32.853485] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:32.951006] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-21T19:38:33.437047] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:38:33.512610] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T19:38:33.751039] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-21T19:38:34.126348] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-21T19:38:34.134930] [INFO ] [REMOTE ] LAC: Full fetch complete (76140 records). [2025-10-21T19:38:34.135094] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-21T19:38:34.539573] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-21T19:38:34.539739] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-21T19:38:34.540857] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-21T19:38:34.540920] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-21T19:38:34.542315] [DEBUG] [LOCAL ] LAC: Trimmed 76140 records to 52565 (keeping 200 days of data) [2025-10-21T19:38:34.587259] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-21T19:38:34.864815] [DEBUG] [LOCAL ] LAC: Primary data saved (52565 records). [2025-10-21T19:38:34.865637] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-21T19:38:34.866610] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols completed. LAC took 33.5s. Estimated remaining: 2h 25m 54s. Rate: 7.8 symbols/min [2025-10-21T19:38:34.866483] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T19:38:35.043613] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:35.043799] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-21T19:38:35.043841] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-21T19:38:35.043963] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-21T19:38:35.044004] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-21T19:38:35.044043] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-21T19:38:35.044074] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-21T19:38:35.127305] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T19:38:35.365161] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-21T19:38:35.404897] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:35.853122] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T19:38:36.151041] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-21T19:38:36.916744] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T19:38:36.951012] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-21T19:38:37.751016] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-21T19:38:38.551002] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-21T19:38:38.595220] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:38:39.123447] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:38:39.142578] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T19:38:39.351050] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-21T19:38:39.846872] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-21T19:38:40.151038] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-21T19:38:40.951049] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-21T19:38:41.271329] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T19:38:41.401215] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T19:38:41.751024] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-21T19:38:42.551033] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-21T19:38:42.990482] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T19:38:42.994421] [INFO ] [REMOTE ] LAD: Full fetch complete (35402 records). [2025-10-21T19:38:42.994502] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-21T19:38:43.364857] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-21T19:38:43.367718] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-21T19:38:43.367800] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-21T19:38:43.368696] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-21T19:38:43.368864] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-21T19:38:43.369716] [DEBUG] [LOCAL ] LAD: Trimmed 35402 records to 23222 (keeping 200 days of data) [2025-10-21T19:38:43.507729] [DEBUG] [LOCAL ] LAD: Primary data saved (23222 records). [2025-10-21T19:38:43.507873] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-21T19:38:43.507950] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols completed. LAD took 36.4s. Estimated remaining: 2h 25m 47s. Rate: 7.8 symbols/min [2025-10-21T19:38:43.676422] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:43.691717] [DEBUG] [LOCAL ] LAW: Loaded 14803 existing records from primary storage. [2025-10-21T19:38:43.691930] [INFO ] [MAIN ] LAW: Loaded 14803 existing records. [2025-10-21T19:38:43.865530] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:43.865740] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-21T19:38:43.865792] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-21T19:38:43.865933] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-21T19:38:43.865971] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-21T19:38:44.153804] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-21T19:38:44.228302] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:44.253339] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:38:44.734271] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T19:38:44.770775] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T19:38:44.951038] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-21T19:38:45.341017] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-21T19:38:45.751069] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-21T19:38:46.551009] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-21T19:38:47.351043] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-21T19:38:47.405432] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:38:47.999218] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T19:38:48.111248] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:38:48.151002] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-21T19:38:48.951082] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-21T19:38:49.710292] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T19:38:49.750978] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-21T19:38:49.766594] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T19:38:50.551119] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-21T19:38:51.210772] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T19:38:51.351011] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-21T19:38:51.439535] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T19:38:51.981755] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T19:38:51.982758] [INFO ] [REMOTE ] LANV: Full fetch complete (4243 records). [2025-10-21T19:38:51.982826] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-21T19:38:52.153808] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-21T19:38:52.340829] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-21T19:38:52.340906] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-21T19:38:52.341046] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-21T19:38:52.341106] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-21T19:38:52.341442] [DEBUG] [LOCAL ] LANV: Trimmed 4243 records to 2794 (keeping 200 days of data) [2025-10-21T19:38:52.356208] [DEBUG] [LOCAL ] LANV: Primary data saved (2794 records). [2025-10-21T19:38:52.356271] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-21T19:38:52.356336] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols completed. LANV took 20.2s. Estimated remaining: 2h 25m 41s. Rate: 7.8 symbols/min [2025-10-21T19:38:52.522486] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:38:52.562580] [DEBUG] [LOCAL ] LAZ: Loaded 44543 existing records from primary storage. [2025-10-21T19:38:52.562918] [INFO ] [MAIN ] LAZ: Loaded 44543 existing records. [2025-10-21T19:38:52.758763] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:38:52.758947] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-21T19:38:52.758994] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-21T19:38:52.759195] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-21T19:38:52.759251] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-21T19:38:52.957722] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-21T19:38:53.126173] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:38:53.751056] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-21T19:38:53.809870] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T19:38:53.830796] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T19:38:54.551056] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-21T19:38:55.350993] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-21T19:38:55.390393] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:38:56.151053] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-21T19:38:56.261558] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T19:38:56.800966] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T19:38:56.951111] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-21T19:38:57.594488] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T19:38:57.742377] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T19:38:57.750965] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-21T19:38:58.551055] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-21T19:38:58.728795] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T19:38:59.351066] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-21T19:38:59.881362] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:39:00.151026] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-21T19:39:00.951015] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-21T19:39:01.204228] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T19:39:01.750998] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-21T19:39:01.925141] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T19:39:02.176046] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:39:02.551021] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-21T19:39:03.351014] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-21T19:39:03.445139] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:39:03.531257] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T19:39:04.151082] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-21T19:39:04.951068] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-21T19:39:05.083214] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T19:39:05.756106] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-21T19:39:05.772660] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T19:39:05.964685] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T19:39:06.551059] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-21T19:39:07.351065] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-21T19:39:07.651592] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:39:07.659846] [INFO ] [REMOTE ] LAR: Full fetch complete (62080 records). [2025-10-21T19:39:07.659995] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-21T19:39:07.877852] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-10-21T19:39:07.878501] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:39:07.878573] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:39:07.878684] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-21T19:39:07.878778] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-21T19:39:07.878819] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-21T19:39:07.878858] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-21T19:39:07.878919] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols completed. LAR took 33.0s. Estimated remaining: 2h 25m 40s. Rate: 7.8 symbols/min [2025-10-21T19:39:08.050665] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:08.075700] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:39:08.114932] [DEBUG] [LOCAL ] LB: Loaded 37212 existing records from primary storage. [2025-10-21T19:39:08.115213] [INFO ] [MAIN ] LB: Loaded 37212 existing records. [2025-10-21T19:39:08.157151] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-21T19:39:08.292558] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:08.292786] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-21T19:39:08.292835] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-21T19:39:08.293006] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-21T19:39:08.293043] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-21T19:39:08.655286] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:08.797000] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:39:08.951012] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-21T19:39:09.513105] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T19:39:09.519375] [INFO ] [REMOTE ] LADR: Full fetch complete (55565 records). [2025-10-21T19:39:09.519476] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-21T19:39:09.756204] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-21T19:39:09.901178] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-21T19:39:09.901263] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-21T19:39:09.902134] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-21T19:39:09.902195] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-21T19:39:09.903280] [DEBUG] [LOCAL ] LADR: Trimmed 55565 records to 39406 (keeping 200 days of data) [2025-10-21T19:39:10.136759] [DEBUG] [LOCAL ] LADR: Primary data saved (39406 records). [2025-10-21T19:39:10.136883] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-21T19:39:10.137413] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols completed. LADR took 41.8s. Estimated remaining: 2h 25m 27s. Rate: 7.8 symbols/min [2025-10-21T19:39:10.307504] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:10.362155] [DEBUG] [LOCAL ] LBRT: Loaded 53003 existing records from primary storage. [2025-10-21T19:39:10.362485] [INFO ] [MAIN ] LBRT: Loaded 53003 existing records. [2025-10-21T19:39:10.545012] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:10.545415] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-21T19:39:10.545518] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-21T19:39:10.545780] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-21T19:39:10.545900] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-21T19:39:10.566605] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-21T19:39:10.700300] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T19:39:10.889822] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T19:39:10.960958] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:11.351097] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-21T19:39:12.151051] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-21T19:39:12.271258] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T19:39:12.319362] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T19:39:12.951008] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-21T19:39:13.728585] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T19:39:13.750986] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-21T19:39:13.970083] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T19:39:13.973284] [INFO ] [REMOTE ] LAW: Full fetch complete (20961 records). [2025-10-21T19:39:13.973380] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-21T19:39:14.333022] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-21T19:39:14.333097] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-21T19:39:14.333532] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-21T19:39:14.333591] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-21T19:39:14.334156] [DEBUG] [LOCAL ] LAW: Trimmed 20961 records to 14777 (keeping 200 days of data) [2025-10-21T19:39:14.413986] [DEBUG] [LOCAL ] LAW: Primary data saved (14777 records). [2025-10-21T19:39:14.414124] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-21T19:39:14.414202] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols completed. LAW took 30.9s. Estimated remaining: 2h 25m 17s. Rate: 7.8 symbols/min [2025-10-21T19:39:14.551030] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-21T19:39:15.356145] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-21T19:39:15.374514] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T19:39:15.872979] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T19:39:16.151013] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-21T19:39:16.950994] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-21T19:39:17.016722] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:39:17.672944] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:39:17.751032] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-21T19:39:18.550999] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-21T19:39:18.748326] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:39:19.351004] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-21T19:39:19.416062] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T19:39:19.422485] [INFO ] [REMOTE ] LAZ: Full fetch complete (65416 records). [2025-10-21T19:39:19.422603] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-21T19:39:19.830635] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-21T19:39:19.830767] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-21T19:39:19.831916] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-21T19:39:19.832005] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-21T19:39:19.833503] [DEBUG] [LOCAL ] LAZ: Trimmed 65416 records to 44474 (keeping 200 days of data) [2025-10-21T19:39:19.918515] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T19:39:20.124491] [DEBUG] [LOCAL ] LAZ: Primary data saved (44474 records). [2025-10-21T19:39:20.124612] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-21T19:39:20.125182] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols completed. LAZ took 27.8s. Estimated remaining: 2h 25m 7s. Rate: 7.8 symbols/min [2025-10-21T19:39:20.151007] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-21T19:39:21.117054] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:39:21.128353] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-21T19:39:21.753804] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T19:39:21.763283] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-21T19:39:22.947693] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T19:39:22.959482] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-21T19:39:23.241328] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T19:39:23.351040] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-21T19:39:24.642128] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T19:39:24.652763] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-21T19:39:24.694465] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T19:39:24.951065] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-21T19:39:26.517966] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T19:39:26.529441] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-21T19:39:26.561021] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T19:39:26.570986] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-21T19:39:28.029845] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:39:28.038311] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-21T19:39:28.135972] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T19:39:28.150981] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-21T19:39:29.026161] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T19:39:29.035463] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-21T19:39:30.010822] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T19:39:30.022097] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-21T19:39:30.531900] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T19:39:30.537611] [INFO ] [REMOTE ] LB: Full fetch complete (55893 records). [2025-10-21T19:39:30.537746] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-21T19:39:30.916635] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-21T19:39:30.916751] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-21T19:39:30.917662] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-21T19:39:30.917725] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-21T19:39:30.918927] [DEBUG] [LOCAL ] LB: Trimmed 55893 records to 37118 (keeping 200 days of data) [2025-10-21T19:39:31.140380] [DEBUG] [LOCAL ] LB: Primary data saved (37118 records). [2025-10-21T19:39:31.140520] [INFO ] [MAIN ] LB: Full history saved. [2025-10-21T19:39:31.140598] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols completed. LB took 23.3s. Estimated remaining: 2h 25m 2s. Rate: 7.8 symbols/min [2025-10-21T19:39:31.928700] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T19:39:31.940162] [INFO ] [REMOTE ] LBRT: Full fetch complete (76912 records). [2025-10-21T19:39:31.940309] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-21T19:39:32.329637] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-21T19:39:32.329747] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-21T19:39:32.330767] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-21T19:39:32.330830] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-21T19:39:32.332151] [DEBUG] [LOCAL ] LBRT: Trimmed 76912 records to 53003 (keeping 200 days of data) [2025-10-21T19:39:32.650508] [DEBUG] [LOCAL ] LBRT: Primary data saved (53003 records). [2025-10-21T19:39:32.650692] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-21T19:39:32.651439] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols completed. LBRT took 22.5s. Estimated remaining: 2h 24m 49s. Rate: 7.8 symbols/min [2025-10-21T19:39:33.202298] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:33.253459] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:33.288356] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:33.350019] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:33.376392] [DEBUG] [LOCAL ] LCII: Loaded 27217 existing records from primary storage. [2025-10-21T19:39:33.388222] [INFO ] [MAIN ] LCII: Loaded 27217 existing records. [2025-10-21T19:39:33.528442] [DEBUG] [LOCAL ] LDI: Loaded 44983 existing records from primary storage. [2025-10-21T19:39:33.555612] [INFO ] [MAIN ] LDI: Loaded 44983 existing records. [2025-10-21T19:39:33.604582] [DEBUG] [LOCAL ] LDOS: Loaded 44754 existing records from primary storage. [2025-10-21T19:39:33.685323] [INFO ] [MAIN ] LDOS: Loaded 44754 existing records. [2025-10-21T19:39:33.685194] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:33.731066] [DEBUG] [LOCAL ] LC: Loaded 48258 existing records from primary storage. [2025-10-21T19:39:33.768197] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-21T19:39:33.754695] [INFO ] [MAIN ] LC: Loaded 48258 existing records. [2025-10-21T19:39:33.807786] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-21T19:39:33.892123] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-21T19:39:33.902568] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-21T19:39:34.099917] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:34.162673] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-21T19:39:34.162802] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-21T19:39:34.202770] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-21T19:39:34.197504] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:34.223740] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-21T19:39:34.235820] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-21T19:39:34.223669] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-21T19:39:34.279394] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-21T19:39:34.381050] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-21T19:39:34.489775] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:34.548132] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-21T19:39:34.614754] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-21T19:39:34.700000] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-21T19:39:34.733846] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-21T19:39:35.197870] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:35.296193] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-21T19:39:35.583858] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:35.634823] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-21T19:39:35.661973] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:35.682876] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:35.683208] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-21T19:39:35.683418] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-21T19:39:36.595767] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:39:36.600897] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-21T19:39:36.966870] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T19:39:36.973608] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-21T19:39:37.089233] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T19:39:37.099235] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-21T19:39:37.512341] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T19:39:37.522148] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-21T19:39:37.826401] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T19:39:37.833226] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-21T19:39:37.886368] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T19:39:37.893914] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-21T19:39:38.323591] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:39:38.551076] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-21T19:39:39.216837] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:39:39.305997] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T19:39:39.355067] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-21T19:39:39.358973] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T19:39:40.157960] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-21T19:39:40.176376] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T19:39:40.951074] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-21T19:39:41.020221] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T19:39:41.394017] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T19:39:41.751051] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-21T19:39:42.482461] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T19:39:42.550985] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-21T19:39:42.650936] [DEBUG] [REMOTE ] LCII: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-21T19:39:42.651128] [WARN ] [REMOTE ] LCII: No data returned for month 2025-05 [2025-10-21T19:39:42.651213] [FATAL] [REMOTE ] LCII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:39:42.651305] [FATAL] [MAIN ] LCII: Failed to fetch primary data. [2025-10-21T19:39:42.651370] [WARN ] [MAIN ] LCII: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:39:42.651441] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-21T19:39:42.651514] [DEBUG] [LOCAL ] LCII: No primary data file found to delete. [2025-10-21T19:39:42.651569] [INFO ] [LOCAL ] LCII: Starting deletion of derivative data. [2025-10-21T19:39:42.651744] [DEBUG] [LOCAL ] LCII: Deleted derivative data file. [2025-10-21T19:39:42.651824] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols completed. LCII took 10.0s. Estimated remaining: 2h 24m 43s. Rate: 7.8 symbols/min [2025-10-21T19:39:42.820096] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:39:42.834070] [DEBUG] [LOCAL ] LDP: Loaded 12697 existing records from primary storage. [2025-10-21T19:39:42.834286] [INFO ] [MAIN ] LDP: Loaded 12697 existing records. [2025-10-21T19:39:43.010919] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:39:43.011104] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-21T19:39:43.011150] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-21T19:39:43.011300] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-21T19:39:43.011338] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-21T19:39:43.354824] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-21T19:39:43.367922] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:39:43.467527] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:39:44.151028] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-21T19:39:44.950998] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-21T19:39:45.153291] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T19:39:45.441624] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:39:45.750998] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-21T19:39:46.135094] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T19:39:46.551021] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-21T19:39:47.249958] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T19:39:47.277864] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:39:47.351012] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-21T19:39:48.151102] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-21T19:39:48.951070] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-21T19:39:49.037233] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T19:39:49.514989] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T19:39:49.751041] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-21T19:39:50.409885] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T19:39:50.550989] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-21T19:39:50.704571] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T19:39:51.351039] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-21T19:39:52.151674] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-21T19:39:52.154188] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T19:39:52.794232] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:39:52.951006] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-21T19:39:53.751058] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-21T19:39:53.789797] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T19:39:54.232917] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:39:54.551072] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-21T19:39:54.767305] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T19:39:55.351028] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-21T19:39:56.139390] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:39:56.150968] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-21T19:39:56.233546] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T19:39:56.951048] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-21T19:39:57.616400] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T19:39:57.750995] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-21T19:39:58.201226] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T19:39:58.551040] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-21T19:39:59.205209] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T19:39:59.351016] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-21T19:40:00.151078] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-21T19:40:00.502016] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T19:40:00.951016] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-21T19:40:01.015120] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T19:40:01.028296] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T19:40:01.028041] [INFO ] [REMOTE ] LDOS: Full fetch complete (67016 records). [2025-10-21T19:40:01.031069] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-21T19:40:01.415968] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-21T19:40:01.416042] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-21T19:40:01.417014] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-21T19:40:01.417075] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-21T19:40:01.418296] [DEBUG] [LOCAL ] LDOS: Trimmed 67016 records to 44723 (keeping 200 days of data) [2025-10-21T19:40:01.714282] [DEBUG] [LOCAL ] LDOS: Primary data saved (44723 records). [2025-10-21T19:40:01.714453] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-21T19:40:01.714563] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols completed. LDOS took 29.1s. Estimated remaining: 2h 24m 46s. Rate: 7.8 symbols/min [2025-10-21T19:40:01.756137] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-21T19:40:01.897133] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:01.934800] [DEBUG] [LOCAL ] LEA: Loaded 41313 existing records from primary storage. [2025-10-21T19:40:01.935108] [INFO ] [MAIN ] LEA: Loaded 41313 existing records. [2025-10-21T19:40:02.179907] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:02.180139] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-21T19:40:02.180190] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-21T19:40:02.180413] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-21T19:40:02.180470] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-21T19:40:02.553610] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:02.553749] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-21T19:40:02.820061] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:40:03.351014] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-21T19:40:03.645184] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T19:40:04.013060] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-21T19:40:04.021479] [INFO ] [REMOTE ] LDI: Full fetch complete (62062 records). [2025-10-21T19:40:04.021638] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-21T19:40:04.164782] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-21T19:40:04.432800] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-21T19:40:04.432919] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-21T19:40:04.433994] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-21T19:40:04.434064] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-21T19:40:04.435478] [DEBUG] [LOCAL ] LDI: Trimmed 62062 records to 45083 (keeping 200 days of data) [2025-10-21T19:40:04.704789] [DEBUG] [LOCAL ] LDI: Primary data saved (45083 records). [2025-10-21T19:40:04.704923] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-21T19:40:04.705005] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols completed. LDI took 32.0s. Estimated remaining: 2h 24m 34s. Rate: 7.8 symbols/min [2025-10-21T19:40:04.903849] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:04.959978] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-21T19:40:04.964282] [DEBUG] [LOCAL ] LEG: Loaded 50094 existing records from primary storage. [2025-10-21T19:40:04.965185] [INFO ] [MAIN ] LEG: Loaded 50094 existing records. [2025-10-21T19:40:05.113830] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T19:40:05.124951] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T19:40:05.212465] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:05.212635] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-21T19:40:05.212720] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-21T19:40:05.212960] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-21T19:40:05.213027] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-21T19:40:05.578405] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:05.751028] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-21T19:40:06.551064] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-21T19:40:06.777040] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T19:40:06.785101] [INFO ] [REMOTE ] LC: Full fetch complete (70684 records). [2025-10-21T19:40:06.785272] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-21T19:40:07.190489] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-21T19:40:07.190609] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-21T19:40:07.191733] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-21T19:40:07.191848] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-21T19:40:07.193503] [DEBUG] [LOCAL ] LC: Trimmed 70684 records to 48247 (keeping 200 days of data) [2025-10-21T19:40:07.319952] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T19:40:07.369199] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-21T19:40:07.434073] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T19:40:07.521303] [DEBUG] [LOCAL ] LC: Primary data saved (48247 records). [2025-10-21T19:40:07.521441] [INFO ] [MAIN ] LC: Full history saved. [2025-10-21T19:40:07.521525] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols completed. LC took 34.9s. Estimated remaining: 2h 24m 22s. Rate: 7.8 symbols/min [2025-10-21T19:40:07.708148] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:07.764453] [DEBUG] [LOCAL ] LEN: Loaded 53202 existing records from primary storage. [2025-10-21T19:40:07.764812] [INFO ] [MAIN ] LEN: Loaded 53202 existing records. [2025-10-21T19:40:07.962534] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:07.962762] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-21T19:40:07.962813] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-21T19:40:07.962999] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-21T19:40:07.963036] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-21T19:40:08.158475] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-21T19:40:08.316510] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:08.951032] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-21T19:40:09.319454] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T19:40:09.345881] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T19:40:09.348013] [INFO ] [REMOTE ] LDP: Full fetch complete (18743 records). [2025-10-21T19:40:09.348102] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-21T19:40:09.725349] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-21T19:40:09.725466] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-21T19:40:09.725966] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-21T19:40:09.726030] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-21T19:40:09.726819] [DEBUG] [LOCAL ] LDP: Trimmed 18743 records to 12691 (keeping 200 days of data) [2025-10-21T19:40:09.763556] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-21T19:40:09.817250] [DEBUG] [LOCAL ] LDP: Primary data saved (12691 records). [2025-10-21T19:40:09.817401] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-21T19:40:09.817495] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols completed. LDP took 27.2s. Estimated remaining: 2h 24m 9s. Rate: 7.8 symbols/min [2025-10-21T19:40:09.998930] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:10.018316] [DEBUG] [LOCAL ] LEO: Loaded 16617 existing records from primary storage. [2025-10-21T19:40:10.018575] [INFO ] [MAIN ] LEO: Loaded 16617 existing records. [2025-10-21T19:40:10.205318] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:10.205576] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-21T19:40:10.205624] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-21T19:40:10.205845] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-21T19:40:10.205899] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-21T19:40:10.558177] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-21T19:40:10.583879] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:10.617325] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T19:40:11.350996] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-21T19:40:11.687316] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T19:40:12.151015] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-21T19:40:12.294172] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T19:40:12.460173] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T19:40:12.951062] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-21T19:40:13.750998] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-21T19:40:14.080707] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T19:40:14.325138] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:40:14.551016] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-21T19:40:15.203171] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T19:40:15.351035] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-21T19:40:16.139848] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T19:40:16.150976] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-21T19:40:16.951071] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-21T19:40:17.256438] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T19:40:17.751020] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-21T19:40:17.816951] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T19:40:18.551052] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-21T19:40:18.846559] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T19:40:19.351014] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-21T19:40:19.727954] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T19:40:19.762819] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T19:40:20.151084] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-21T19:40:20.884700] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T19:40:20.950987] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-21T19:40:21.229629] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:40:21.751035] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-21T19:40:22.519444] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:40:22.551088] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-21T19:40:22.721093] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T19:40:23.351026] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-21T19:40:24.106345] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T19:40:24.151023] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-21T19:40:24.951046] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-21T19:40:25.077684] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T19:40:25.176254] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T19:40:25.751040] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-21T19:40:26.362336] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:40:26.551041] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-21T19:40:27.215070] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:40:27.351026] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-21T19:40:28.045929] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T19:40:28.151024] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-21T19:40:28.956187] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-21T19:40:28.970270] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T19:40:29.751079] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T19:40:29.751176] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-21T19:40:29.759020] [INFO ] [REMOTE ] LEA: Full fetch complete (60625 records). [2025-10-21T19:40:29.759125] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-21T19:40:30.158261] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-21T19:40:30.158350] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-21T19:40:30.159297] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-21T19:40:30.159359] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-21T19:40:30.160582] [DEBUG] [LOCAL ] LEA: Trimmed 60625 records to 41237 (keeping 200 days of data) [2025-10-21T19:40:30.423794] [DEBUG] [LOCAL ] LEA: Primary data saved (41237 records). [2025-10-21T19:40:30.423925] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-21T19:40:30.424706] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols completed. LEA took 28.7s. Estimated remaining: 2h 24m 13s. Rate: 7.8 symbols/min [2025-10-21T19:40:30.556217] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-21T19:40:30.608384] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:30.662167] [DEBUG] [LOCAL ] LEVI: Loaded 51821 existing records from primary storage. [2025-10-21T19:40:30.662532] [INFO ] [MAIN ] LEVI: Loaded 51821 existing records. [2025-10-21T19:40:30.867981] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:30.868419] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-21T19:40:30.868504] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-21T19:40:30.868890] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-21T19:40:30.869016] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-21T19:40:31.175754] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-21T19:40:31.294929] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:31.306440] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T19:40:31.350986] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-21T19:40:31.549522] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T19:40:31.558882] [INFO ] [REMOTE ] LEG: Full fetch complete (72849 records). [2025-10-21T19:40:31.559001] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-21T19:40:31.940442] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-21T19:40:31.940517] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-21T19:40:31.941478] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-21T19:40:31.941540] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-21T19:40:31.942873] [DEBUG] [LOCAL ] LEG: Trimmed 72849 records to 50008 (keeping 200 days of data) [2025-10-21T19:40:32.152681] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-21T19:40:32.234541] [DEBUG] [LOCAL ] LEG: Primary data saved (50008 records). [2025-10-21T19:40:32.234700] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-21T19:40:32.235515] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols completed. LEG took 27.5s. Estimated remaining: 2h 23m 60s. Rate: 7.8 symbols/min [2025-10-21T19:40:32.420426] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T19:40:32.426576] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:32.445588] [DEBUG] [LOCAL ] LFT: Loaded 18230 existing records from primary storage. [2025-10-21T19:40:32.445843] [INFO ] [MAIN ] LFT: Loaded 18230 existing records. [2025-10-21T19:40:32.621560] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:32.621790] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-21T19:40:32.621841] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-21T19:40:32.622003] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-21T19:40:32.622041] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-21T19:40:32.956480] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-21T19:40:32.976201] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:33.426737] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T19:40:33.751002] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-21T19:40:34.551153] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-21T19:40:34.847342] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T19:40:35.312944] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:40:35.351017] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-21T19:40:35.687510] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T19:40:36.151124] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-21T19:40:36.951068] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-21T19:40:37.006242] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T19:40:37.382460] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T19:40:37.750988] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-21T19:40:37.896504] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T19:40:38.550998] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-21T19:40:39.351018] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-21T19:40:39.455085] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:40:39.471942] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:40:40.151088] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-21T19:40:40.951007] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-21T19:40:41.010443] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T19:40:41.440261] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T19:40:41.751044] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-21T19:40:41.802378] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T19:40:41.805140] [INFO ] [REMOTE ] LEO: Full fetch complete (26417 records). [2025-10-21T19:40:41.805209] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-21T19:40:42.164567] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-21T19:40:42.164639] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-21T19:40:42.165165] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-21T19:40:42.165205] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-21T19:40:42.165814] [DEBUG] [LOCAL ] LEO: Trimmed 26417 records to 16799 (keeping 200 days of data) [2025-10-21T19:40:42.258240] [DEBUG] [LOCAL ] LEO: Primary data saved (16799 records). [2025-10-21T19:40:42.258362] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-21T19:40:42.258437] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols completed. LEO took 32.4s. Estimated remaining: 2h 23m 54s. Rate: 7.8 symbols/min [2025-10-21T19:40:42.430520] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:42.446601] [DEBUG] [LOCAL ] LGI: Loaded 10042 existing records from primary storage. [2025-10-21T19:40:42.446876] [INFO ] [MAIN ] LGI: Loaded 10042 existing records. [2025-10-21T19:40:42.556216] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-21T19:40:42.650276] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:42.650716] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-21T19:40:42.650877] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-21T19:40:42.651109] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-21T19:40:42.651183] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-21T19:40:42.874813] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T19:40:43.022743] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:43.351046] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-21T19:40:44.106364] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T19:40:44.151042] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-21T19:40:44.459508] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T19:40:44.885390] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T19:40:44.951108] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-21T19:40:45.751050] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-21T19:40:45.917115] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T19:40:46.551065] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-21T19:40:47.351061] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-21T19:40:47.723320] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T19:40:47.909915] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T19:40:48.151064] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-21T19:40:48.951035] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-21T19:40:49.669798] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-21T19:40:49.751043] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-21T19:40:49.788380] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T19:40:49.826803] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T19:40:50.551002] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-21T19:40:50.598619] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T19:40:50.606987] [INFO ] [REMOTE ] LEN: Full fetch complete (77217 records). [2025-10-21T19:40:50.607134] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-21T19:40:51.022084] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-21T19:40:51.022181] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-21T19:40:51.023266] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-21T19:40:51.023330] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-21T19:40:51.024808] [DEBUG] [LOCAL ] LEN: Trimmed 77217 records to 53200 (keeping 200 days of data) [2025-10-21T19:40:51.353819] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-21T19:40:51.353727] [DEBUG] [LOCAL ] LEN: Primary data saved (53200 records). [2025-10-21T19:40:51.354128] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-21T19:40:51.354441] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols completed. LEN took 43.8s. Estimated remaining: 2h 23m 48s. Rate: 7.8 symbols/min [2025-10-21T19:40:51.543767] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:40:51.580624] [DEBUG] [LOCAL ] LH: Loaded 37275 existing records from primary storage. [2025-10-21T19:40:51.580934] [INFO ] [MAIN ] LH: Loaded 37275 existing records. [2025-10-21T19:40:51.702028] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T19:40:51.784301] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:40:51.784520] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-21T19:40:51.784566] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-21T19:40:51.784798] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-21T19:40:51.784854] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-21T19:40:52.131913] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:40:52.150982] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-21T19:40:52.950990] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-21T19:40:53.239376] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:40:53.683682] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T19:40:53.751070] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-21T19:40:53.784144] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T19:40:54.551014] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-21T19:40:55.351034] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-21T19:40:55.425898] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T19:40:56.081855] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T19:40:56.156217] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-21T19:40:56.157914] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T19:40:56.951017] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-21T19:40:57.751020] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-21T19:40:57.782435] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T19:40:57.800882] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T19:40:58.551005] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-21T19:40:58.767285] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T19:40:59.351023] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-21T19:41:00.151081] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-21T19:41:00.190927] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:41:00.951073] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-21T19:41:01.131143] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T19:41:01.572938] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T19:41:01.751023] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-21T19:41:02.549211] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T19:41:02.552364] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-21T19:41:02.664504] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T19:41:03.351041] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-21T19:41:04.082715] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T19:41:04.151005] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-21T19:41:04.431187] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:41:04.439540] [INFO ] [REMOTE ] LEVI: Full fetch complete (74975 records). [2025-10-21T19:41:04.439728] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-21T19:41:04.825982] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-21T19:41:04.826064] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-21T19:41:04.827073] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-21T19:41:04.827137] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-21T19:41:04.828472] [DEBUG] [LOCAL ] LEVI: Trimmed 74975 records to 51823 (keeping 200 days of data) [2025-10-21T19:41:04.951053] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-21T19:41:05.047810] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:41:05.054940] [INFO ] [REMOTE ] LGI: Full fetch complete (14466 records). [2025-10-21T19:41:05.056584] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-21T19:41:05.467102] [DEBUG] [LOCAL ] LEVI: Primary data saved (51823 records). [2025-10-21T19:41:05.484614] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-21T19:41:05.496267] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols completed. LEVI took 35.1s. Estimated remaining: 2h 23m 46s. Rate: 7.8 symbols/min [2025-10-21T19:41:05.628386] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-21T19:41:05.628935] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-21T19:41:05.629338] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-21T19:41:05.645201] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-21T19:41:05.682379] [DEBUG] [LOCAL ] LGI: Trimmed 14466 records to 10022 (keeping 200 days of data) [2025-10-21T19:41:05.699581] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:05.752678] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-21T19:41:05.762186] [DEBUG] [LOCAL ] LGI: Primary data saved (10022 records). [2025-10-21T19:41:05.762396] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-21T19:41:05.762494] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols completed. LGI took 23.5s. Estimated remaining: 2h 23m 31s. Rate: 7.8 symbols/min [2025-10-21T19:41:05.954705] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:05.969708] [DEBUG] [LOCAL ] LHX: Loaded 48528 existing records from primary storage. [2025-10-21T19:41:05.969944] [INFO ] [MAIN ] LHX: Loaded 48528 existing records. [2025-10-21T19:41:06.159466] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:06.168551] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-21T19:41:06.168908] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-21T19:41:06.169448] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-21T19:41:06.169544] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-21T19:41:06.169388] [DEBUG] [LOCAL ] LII: Loaded 27796 existing records from primary storage. [2025-10-21T19:41:06.232708] [INFO ] [MAIN ] LII: Loaded 27796 existing records. [2025-10-21T19:41:06.514232] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:06.558150] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-21T19:41:06.588955] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-21T19:41:06.605565] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-21T19:41:06.642819] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-21T19:41:06.865055] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:06.896799] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-21T19:41:06.917771] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T19:41:06.903425] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:41:07.179036] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:07.351076] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-21T19:41:08.151092] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-21T19:41:08.729260] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T19:41:08.834049] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T19:41:08.951010] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-21T19:41:09.163789] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T19:41:09.166368] [INFO ] [REMOTE ] LFT: Full fetch complete (23824 records). [2025-10-21T19:41:09.166439] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-21T19:41:09.527110] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-21T19:41:09.527188] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-21T19:41:09.527671] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-21T19:41:09.527732] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-21T19:41:09.528423] [DEBUG] [LOCAL ] LFT: Trimmed 23824 records to 18162 (keeping 200 days of data) [2025-10-21T19:41:09.633219] [DEBUG] [LOCAL ] LFT: Primary data saved (18162 records). [2025-10-21T19:41:09.633359] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-21T19:41:09.633438] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols completed. LFT took 37.4s. Estimated remaining: 2h 23m 20s. Rate: 7.8 symbols/min [2025-10-21T19:41:09.756113] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-21T19:41:09.810372] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:09.854636] [DEBUG] [LOCAL ] LION: Loaded 46794 existing records from primary storage. [2025-10-21T19:41:09.854971] [INFO ] [MAIN ] LION: Loaded 46794 existing records. [2025-10-21T19:41:10.029100] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:10.029304] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-21T19:41:10.029350] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-21T19:41:10.029547] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-21T19:41:10.029603] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-21T19:41:10.397808] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:10.414603] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T19:41:10.550986] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-21T19:41:11.351026] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-21T19:41:11.560091] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T19:41:11.706917] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T19:41:12.151048] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-21T19:41:12.478196] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T19:41:12.951059] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-21T19:41:13.751030] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-21T19:41:13.863532] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:41:14.044502] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T19:41:14.551064] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-21T19:41:15.140102] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T19:41:15.351065] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-21T19:41:15.588302] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T19:41:16.151089] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-21T19:41:16.735869] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T19:41:16.951029] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-21T19:41:17.520863] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T19:41:17.750998] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-21T19:41:18.195516] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T19:41:18.551082] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-21T19:41:19.351119] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-21T19:41:19.514355] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:41:19.802121] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T19:41:20.151161] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-21T19:41:20.659131] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T19:41:20.950995] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-21T19:41:21.326725] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T19:41:21.751075] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-21T19:41:22.551023] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-21T19:41:22.918986] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T19:41:23.214725] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:41:23.351004] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-21T19:41:23.429537] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T19:41:24.151033] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-21T19:41:24.761273] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:41:24.951077] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-21T19:41:25.751035] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-21T19:41:25.998804] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T19:41:26.551002] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-21T19:41:26.582723] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T19:41:26.978835] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T19:41:26.983672] [INFO ] [REMOTE ] LII: Full fetch complete (41689 records). [2025-10-21T19:41:26.983767] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-21T19:41:27.369349] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-21T19:41:27.367013] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-21T19:41:27.370525] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-21T19:41:27.371428] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-21T19:41:27.371572] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-21T19:41:27.372709] [DEBUG] [LOCAL ] LII: Trimmed 41689 records to 27758 (keeping 200 days of data) [2025-10-21T19:41:27.545235] [DEBUG] [LOCAL ] LII: Primary data saved (27758 records). [2025-10-21T19:41:27.545366] [INFO ] [MAIN ] LII: Full history saved. [2025-10-21T19:41:27.545443] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols completed. LII took 21.8s. Estimated remaining: 2h 23m 22s. Rate: 7.8 symbols/min [2025-10-21T19:41:27.714112] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:27.719908] [DEBUG] [LOCAL ] LITB: Loaded 3871 existing records from primary storage. [2025-10-21T19:41:27.720049] [INFO ] [MAIN ] LITB: Loaded 3871 existing records. [2025-10-21T19:41:27.904951] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:27.905341] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-21T19:41:27.905460] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-21T19:41:27.905622] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-21T19:41:27.905721] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-21T19:41:28.153835] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-21T19:41:28.204748] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:41:28.269463] [INFO ] [REMOTE ] LH: Full fetch complete (54924 records). [2025-10-21T19:41:28.289283] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:28.289399] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-21T19:41:28.668482] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-21T19:41:28.668559] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-21T19:41:28.669582] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-21T19:41:28.670316] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-21T19:41:28.671490] [DEBUG] [LOCAL ] LH: Trimmed 54924 records to 37192 (keeping 200 days of data) [2025-10-21T19:41:28.915354] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T19:41:28.955025] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-21T19:41:28.954942] [DEBUG] [LOCAL ] LH: Primary data saved (37192 records). [2025-10-21T19:41:28.956054] [INFO ] [MAIN ] LH: Full history saved. [2025-10-21T19:41:28.956171] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols completed. LH took 37.6s. Estimated remaining: 2h 23m 8s. Rate: 7.8 symbols/min [2025-10-21T19:41:29.124884] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:29.174015] [DEBUG] [LOCAL ] LLY: Loaded 53228 existing records from primary storage. [2025-10-21T19:41:29.174364] [INFO ] [MAIN ] LLY: Loaded 53228 existing records. [2025-10-21T19:41:29.349316] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:29.349509] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-21T19:41:29.349555] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-21T19:41:29.349791] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-21T19:41:29.349847] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-21T19:41:29.527994] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T19:41:29.712699] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:29.750997] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-21T19:41:30.059278] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T19:41:30.551085] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-21T19:41:31.351029] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-21T19:41:31.790771] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T19:41:32.151038] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-21T19:41:32.271770] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-21T19:41:32.310575] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T19:41:32.951066] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-21T19:41:33.725775] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T19:41:33.750994] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-21T19:41:34.551059] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-21T19:41:35.222601] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-21T19:41:35.353045] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-21T19:41:35.369721] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-21T19:41:35.410115] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T19:41:36.151039] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-21T19:41:36.165316] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T19:41:36.951017] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-21T19:41:37.751023] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-21T19:41:37.891362] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:41:37.899087] [INFO ] [REMOTE ] LION: Full fetch complete (57840 records). [2025-10-21T19:41:37.899198] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-21T19:41:38.303272] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-21T19:41:38.303353] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-21T19:41:38.304303] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-21T19:41:38.304364] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-21T19:41:38.305628] [DEBUG] [LOCAL ] LION: Trimmed 57840 records to 46849 (keeping 200 days of data) [2025-10-21T19:41:38.563681] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-21T19:41:38.572156] [DEBUG] [LOCAL ] LION: Primary data saved (46849 records). [2025-10-21T19:41:38.573309] [INFO ] [MAIN ] LION: Full history saved. [2025-10-21T19:41:38.574311] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols completed. LION took 28.9s. Estimated remaining: 2h 23m 2s. Rate: 7.8 symbols/min [2025-10-21T19:41:38.750356] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:38.780996] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T19:41:38.847436] [DEBUG] [LOCAL ] LMND: Loaded 52135 existing records from primary storage. [2025-10-21T19:41:38.847905] [INFO ] [MAIN ] LMND: Loaded 52135 existing records. [2025-10-21T19:41:39.030235] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:39.030479] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-21T19:41:39.030537] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-21T19:41:39.030859] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-21T19:41:39.030915] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-21T19:41:39.135964] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T19:41:39.356190] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-21T19:41:39.393586] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:40.043340] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-21T19:41:40.151031] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-21T19:41:40.951070] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-21T19:41:41.123989] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T19:41:41.243239] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-21T19:41:41.751087] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-21T19:41:42.399368] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T19:41:42.551019] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-21T19:41:42.994203] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T19:41:43.351057] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-21T19:41:43.732415] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T19:41:43.739608] [INFO ] [REMOTE ] LHX: Full fetch complete (70812 records). [2025-10-21T19:41:43.739746] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-21T19:41:43.822786] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T19:41:44.143990] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-21T19:41:44.144089] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-21T19:41:44.145160] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-21T19:41:44.145223] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-21T19:41:44.146538] [DEBUG] [LOCAL ] LHX: Trimmed 70812 records to 48528 (keeping 200 days of data) [2025-10-21T19:41:44.206088] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-21T19:41:44.455855] [DEBUG] [LOCAL ] LHX: Primary data saved (48528 records). [2025-10-21T19:41:44.455992] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-21T19:41:44.456070] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols completed. LHX took 39.0s. Estimated remaining: 2h 22m 53s. Rate: 7.8 symbols/min [2025-10-21T19:41:44.627405] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:44.682996] [DEBUG] [LOCAL ] LMT: Loaded 49622 existing records from primary storage. [2025-10-21T19:41:44.683302] [INFO ] [MAIN ] LMT: Loaded 49622 existing records. [2025-10-21T19:41:44.864603] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:44.864824] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-21T19:41:44.864872] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-21T19:41:44.865065] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-21T19:41:44.865103] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-21T19:41:44.956134] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-21T19:41:45.235708] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:45.690789] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T19:41:45.751033] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-21T19:41:46.183026] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T19:41:46.551012] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-21T19:41:47.351053] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-21T19:41:47.956912] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:41:47.959341] [INFO ] [REMOTE ] LITB: Full fetch complete (5773 records). [2025-10-21T19:41:47.959501] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-21T19:41:48.151689] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-21T19:41:48.355282] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-21T19:41:48.355974] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-21T19:41:48.356436] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-21T19:41:48.356704] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-21T19:41:48.357940] [DEBUG] [LOCAL ] LITB: Trimmed 5773 records to 3861 (keeping 200 days of data) [2025-10-21T19:41:48.381899] [DEBUG] [LOCAL ] LITB: Primary data saved (3861 records). [2025-10-21T19:41:48.382168] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-21T19:41:48.382411] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols completed. LITB took 20.8s. Estimated remaining: 2h 22m 42s. Rate: 7.8 symbols/min [2025-10-21T19:41:48.579286] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-21T19:41:48.643958] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:41:48.655227] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T19:41:48.720593] [DEBUG] [LOCAL ] LNC: Loaded 51511 existing records from primary storage. [2025-10-21T19:41:48.721143] [INFO ] [MAIN ] LNC: Loaded 51511 existing records. [2025-10-21T19:41:48.931020] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:41:48.931243] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-21T19:41:48.931290] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-21T19:41:48.931463] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-21T19:41:48.931499] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-21T19:41:48.961404] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-21T19:41:49.282833] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:41:49.751012] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-21T19:41:50.017292] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T19:41:50.551101] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-21T19:41:50.862201] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T19:41:51.350998] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-21T19:41:51.457848] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T19:41:52.151032] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-21T19:41:52.951074] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-21T19:41:53.011101] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-21T19:41:53.103379] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T19:41:53.708226] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:41:53.751030] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-21T19:41:54.551069] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-21T19:41:54.732915] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T19:41:55.351068] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-21T19:41:55.883631] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-21T19:41:56.151022] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-21T19:41:56.951007] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-21T19:41:57.096945] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-21T19:41:57.265339] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:41:57.751056] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-21T19:41:57.918773] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T19:41:58.551043] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-21T19:41:59.047276] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T19:41:59.351129] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-21T19:41:59.415354] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T19:42:00.151036] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-21T19:42:00.308003] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:42:00.951025] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-21T19:42:01.751094] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-21T19:42:02.106777] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-21T19:42:02.234201] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-21T19:42:02.551043] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-21T19:42:03.007057] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T19:42:03.120361] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T19:42:03.351033] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-21T19:42:04.151067] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-21T19:42:04.575115] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T19:42:04.657222] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:42:04.951026] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-21T19:42:05.751056] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-21T19:42:06.359660] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T19:42:06.551051] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-21T19:42:06.763083] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T19:42:07.351120] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-21T19:42:07.896260] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T19:42:08.151063] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-21T19:42:08.641424] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T19:42:08.951120] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-21T19:42:09.751075] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-21T19:42:09.902859] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:42:10.012012] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-10-21T19:42:10.551046] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-21T19:42:11.350996] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-21T19:42:11.839969] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (2.89 seconds). [2025-10-21T19:42:11.848777] [INFO ] [REMOTE ] LMND: Full fetch complete (75463 records). [2025-10-21T19:42:11.848900] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-21T19:42:12.255120] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-21T19:42:12.255295] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-21T19:42:12.256625] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-21T19:42:12.256792] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-21T19:42:12.258688] [DEBUG] [LOCAL ] LMND: Trimmed 75463 records to 52124 (keeping 200 days of data) [2025-10-21T19:42:12.386194] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-21T19:42:12.482022] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-21T19:42:12.531832] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T19:42:12.556921] [INFO ] [REMOTE ] LLY: Full fetch complete (77202 records). [2025-10-21T19:42:12.557892] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-21T19:42:12.747409] [DEBUG] [LOCAL ] LMND: Primary data saved (52124 records). [2025-10-21T19:42:12.758945] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-21T19:42:12.770743] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols completed. LMND took 34.2s. Estimated remaining: 2h 22m 49s. Rate: 7.8 symbols/min [2025-10-21T19:42:13.095809] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-21T19:42:13.239082] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:13.263961] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-21T19:42:13.287739] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-21T19:42:13.287859] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-21T19:42:13.289312] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-21T19:42:13.289690] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-21T19:42:13.295238] [DEBUG] [LOCAL ] LND: Loaded 4966 existing records from primary storage. [2025-10-21T19:42:13.292355] [DEBUG] [LOCAL ] LLY: Trimmed 77202 records to 53192 (keeping 200 days of data) [2025-10-21T19:42:13.295770] [INFO ] [MAIN ] LND: Loaded 4966 existing records. [2025-10-21T19:42:13.600729] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:13.600977] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-21T19:42:13.601024] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-21T19:42:13.601188] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-21T19:42:13.601244] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-21T19:42:14.134242] [DEBUG] [LOCAL ] LLY: Primary data saved (53192 records). [2025-10-21T19:42:14.148281] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-21T19:42:14.164658] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols completed. LLY took 45.2s. Estimated remaining: 2h 22m 35s. Rate: 7.8 symbols/min [2025-10-21T19:42:14.168066] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:14.210822] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-21T19:42:14.336021] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:14.381548] [DEBUG] [LOCAL ] LNG: Loaded 51168 existing records from primary storage. [2025-10-21T19:42:14.381864] [INFO ] [MAIN ] LNG: Loaded 51168 existing records. [2025-10-21T19:42:14.558251] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:14.558625] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-21T19:42:14.558714] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-21T19:42:14.559027] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-21T19:42:14.559083] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-21T19:42:14.920127] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:14.920555] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-21T19:42:14.950854] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T19:42:14.957215] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-21T19:42:15.144156] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:42:15.152555] [INFO ] [REMOTE ] LNC: Full fetch complete (74563 records). [2025-10-21T19:42:15.152749] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-21T19:42:15.360115] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-21T19:42:15.543276] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-21T19:42:15.543355] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-21T19:42:15.544518] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-21T19:42:15.544581] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-21T19:42:15.546021] [DEBUG] [LOCAL ] LNC: Trimmed 74563 records to 51488 (keeping 200 days of data) [2025-10-21T19:42:15.856264] [DEBUG] [LOCAL ] LNC: Primary data saved (51488 records). [2025-10-21T19:42:15.856389] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-21T19:42:15.856815] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols completed. LNC took 27.5s. Estimated remaining: 2h 22m 22s. Rate: 7.8 symbols/min [2025-10-21T19:42:16.031555] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:16.045533] [DEBUG] [LOCAL ] LNN: Loaded 11478 existing records from primary storage. [2025-10-21T19:42:16.045782] [INFO ] [MAIN ] LNN: Loaded 11478 existing records. [2025-10-21T19:42:16.156154] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-21T19:42:16.234851] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:16.235825] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T19:42:16.238688] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-21T19:42:16.238759] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-21T19:42:16.239300] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-21T19:42:16.239358] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-21T19:42:16.599255] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:16.951011] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-21T19:42:17.012024] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T19:42:17.589016] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T19:42:17.751036] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-21T19:42:18.363200] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T19:42:18.551002] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-21T19:42:18.643508] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-21T19:42:18.651208] [INFO ] [REMOTE ] LMT: Full fetch complete (72529 records). [2025-10-21T19:42:18.651336] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-21T19:42:19.032721] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-21T19:42:19.032803] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-21T19:42:19.033808] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-21T19:42:19.033869] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-21T19:42:19.035184] [DEBUG] [LOCAL ] LMT: Trimmed 72529 records to 49628 (keeping 200 days of data) [2025-10-21T19:42:19.342927] [DEBUG] [LOCAL ] LMT: Primary data saved (49628 records). [2025-10-21T19:42:19.343054] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-21T19:42:19.344112] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols completed. LMT took 34.9s. Estimated remaining: 2h 22m 11s. Rate: 7.8 symbols/min [2025-10-21T19:42:19.356195] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-21T19:42:19.522286] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:19.529680] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T19:42:19.573310] [DEBUG] [LOCAL ] LOAR: Loaded 42010 existing records from primary storage. [2025-10-21T19:42:19.573611] [INFO ] [MAIN ] LOAR: Loaded 42010 existing records. [2025-10-21T19:42:19.747970] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:19.748223] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-21T19:42:19.748277] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-21T19:42:19.748456] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-21T19:42:19.748492] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-21T19:42:20.050500] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T19:42:20.110385] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:20.150986] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-21T19:42:20.951035] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-21T19:42:21.522218] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:42:21.535123] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:42:21.751055] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-21T19:42:22.551077] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-21T19:42:23.160406] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T19:42:23.351035] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-21T19:42:23.629178] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T19:42:24.151050] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-21T19:42:24.575494] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:42:24.951042] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-21T19:42:24.982755] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T19:42:25.751060] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-21T19:42:26.341670] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T19:42:26.551006] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-21T19:42:26.622173] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T19:42:27.351026] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-21T19:42:27.885580] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T19:42:28.151088] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-21T19:42:28.286592] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:42:28.734206] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T19:42:28.951077] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-21T19:42:29.751046] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-21T19:42:30.551011] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-21T19:42:30.720077] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:42:30.820753] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:42:31.218475] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T19:42:31.219830] [INFO ] [REMOTE ] LND: Full fetch complete (7805 records). [2025-10-21T19:42:31.219899] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-21T19:42:31.361763] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-21T19:42:31.594192] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-21T19:42:31.594289] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-21T19:42:31.594543] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-21T19:42:31.594605] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-21T19:42:31.595054] [DEBUG] [LOCAL ] LND: Trimmed 7805 records to 4930 (keeping 200 days of data) [2025-10-21T19:42:31.622992] [DEBUG] [LOCAL ] LND: Primary data saved (4930 records). [2025-10-21T19:42:31.623116] [INFO ] [MAIN ] LND: Full history saved. [2025-10-21T19:42:31.623198] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols completed. LND took 18.9s. Estimated remaining: 2h 22m 7s. Rate: 7.8 symbols/min [2025-10-21T19:42:31.821405] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:31.847678] [DEBUG] [LOCAL ] LOB: Loaded 26844 existing records from primary storage. [2025-10-21T19:42:31.847955] [INFO ] [MAIN ] LOB: Loaded 26844 existing records. [2025-10-21T19:42:32.020406] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:32.020620] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-21T19:42:32.020697] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-21T19:42:32.020922] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-21T19:42:32.020977] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-21T19:42:32.158230] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-21T19:42:32.387520] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:32.951019] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-21T19:42:32.984743] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T19:42:33.402535] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T19:42:33.751032] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-21T19:42:34.214912] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T19:42:34.551067] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-21T19:42:35.350994] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-21T19:42:35.635310] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T19:42:35.734206] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T19:42:36.151071] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-21T19:42:36.719602] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T19:42:36.951085] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-21T19:42:37.264236] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:42:37.751055] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-21T19:42:38.466737] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T19:42:38.510962] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T19:42:38.551006] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-21T19:42:39.351101] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-21T19:42:39.467788] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T19:42:40.151079] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-21T19:42:40.840098] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T19:42:40.950997] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-21T19:42:41.423132] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T19:42:41.751038] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-21T19:42:42.423168] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T19:42:42.551001] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-21T19:42:42.656247] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T19:42:43.350026] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T19:42:43.352232] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-21T19:42:44.151016] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-21T19:42:44.416210] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T19:42:44.951030] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-21T19:42:44.971261] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T19:42:45.751077] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-21T19:42:46.551063] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-21T19:42:46.779808] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T19:42:46.781016] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T19:42:46.795395] [INFO ] [REMOTE ] LNN: Full fetch complete (16024 records). [2025-10-21T19:42:46.795483] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-21T19:42:47.165037] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-21T19:42:47.165112] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-21T19:42:47.165438] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-21T19:42:47.165521] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-21T19:42:47.166063] [DEBUG] [LOCAL ] LNN: Trimmed 16024 records to 11431 (keeping 200 days of data) [2025-10-21T19:42:47.235249] [DEBUG] [LOCAL ] LNN: Primary data saved (11431 records). [2025-10-21T19:42:47.235373] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-21T19:42:47.235449] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols completed. LNN took 31.4s. Estimated remaining: 2h 22m 6s. Rate: 7.8 symbols/min [2025-10-21T19:42:47.356145] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-21T19:42:47.406592] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:47.412295] [DEBUG] [LOCAL ] LOCL: Loaded 3814 existing records from primary storage. [2025-10-21T19:42:47.412440] [INFO ] [MAIN ] LOCL: Loaded 3814 existing records. [2025-10-21T19:42:47.588410] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:47.588724] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-21T19:42:47.588779] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-21T19:42:47.588896] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-21T19:42:47.588941] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-21T19:42:47.816550] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T19:42:47.965452] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:48.151040] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-21T19:42:48.951014] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-21T19:42:49.349444] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T19:42:49.472405] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T19:42:49.508006] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T19:42:49.751041] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-21T19:42:50.551044] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-21T19:42:51.166121] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T19:42:51.174983] [INFO ] [REMOTE ] LOAR: Full fetch complete (56018 records). [2025-10-21T19:42:51.175143] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-21T19:42:51.355451] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-21T19:42:51.565366] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-21T19:42:51.565483] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-21T19:42:51.566555] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-21T19:42:51.566819] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-21T19:42:51.568112] [DEBUG] [LOCAL ] LOAR: Trimmed 56018 records to 42020 (keeping 200 days of data) [2025-10-21T19:42:51.759019] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:42:51.835317] [DEBUG] [LOCAL ] LOAR: Primary data saved (42020 records). [2025-10-21T19:42:51.835448] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-21T19:42:51.836049] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols completed. LOAR took 32.5s. Estimated remaining: 2h 21m 56s. Rate: 7.8 symbols/min [2025-10-21T19:42:52.007327] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:52.041020] [DEBUG] [LOCAL ] LOMA: Loaded 32769 existing records from primary storage. [2025-10-21T19:42:52.041311] [INFO ] [MAIN ] LOMA: Loaded 32769 existing records. [2025-10-21T19:42:52.142632] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T19:42:52.156122] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-21T19:42:52.226254] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:52.226446] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-21T19:42:52.226493] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-21T19:42:52.226696] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-21T19:42:52.226752] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-21T19:42:52.574972] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:52.951076] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-21T19:42:53.567790] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T19:42:53.751097] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-21T19:42:54.361386] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T19:42:54.551024] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-21T19:42:54.934943] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T19:42:54.939375] [INFO ] [REMOTE ] LOB: Full fetch complete (38567 records). [2025-10-21T19:42:54.939454] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-21T19:42:55.312772] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-21T19:42:55.312879] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-21T19:42:55.313629] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-21T19:42:55.313710] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-21T19:42:55.314467] [DEBUG] [LOCAL ] LOB: Trimmed 38567 records to 26778 (keeping 200 days of data) [2025-10-21T19:42:55.367307] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-21T19:42:55.476402] [DEBUG] [LOCAL ] LOB: Primary data saved (26778 records). [2025-10-21T19:42:55.476524] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-21T19:42:55.476600] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols completed. LOB took 23.9s. Estimated remaining: 2h 21m 45s. Rate: 7.8 symbols/min [2025-10-21T19:42:55.597392] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T19:42:55.677109] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:42:55.725811] [DEBUG] [LOCAL ] LOW: Loaded 52993 existing records from primary storage. [2025-10-21T19:42:55.726138] [INFO ] [MAIN ] LOW: Loaded 52993 existing records. [2025-10-21T19:42:55.902819] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:42:55.903059] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-21T19:42:55.903132] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-21T19:42:55.903331] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-21T19:42:55.903372] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-21T19:42:55.984483] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T19:42:56.156187] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-21T19:42:56.273487] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:42:56.951043] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-21T19:42:57.462293] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T19:42:57.751073] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-21T19:42:58.551002] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-21T19:42:58.777696] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T19:42:59.351080] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-21T19:42:59.474592] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:42:59.883182] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T19:43:00.151058] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-21T19:43:00.951054] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-21T19:43:01.027522] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:43:01.500442] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T19:43:01.751037] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-21T19:43:02.551051] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-21T19:43:02.560192] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T19:43:03.347394] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T19:43:03.354377] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-21T19:43:03.356346] [INFO ] [REMOTE ] LNG: Full fetch complete (74723 records). [2025-10-21T19:43:03.356432] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-21T19:43:03.752879] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-21T19:43:03.752972] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-21T19:43:03.754129] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-21T19:43:03.754195] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-21T19:43:03.755695] [DEBUG] [LOCAL ] LNG: Trimmed 74723 records to 51114 (keeping 200 days of data) [2025-10-21T19:43:03.872864] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-21T19:43:04.087788] [DEBUG] [LOCAL ] LNG: Primary data saved (51114 records). [2025-10-21T19:43:04.087960] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-21T19:43:04.088100] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols completed. LNG took 49.9s. Estimated remaining: 2h 21m 38s. Rate: 7.8 symbols/min [2025-10-21T19:43:04.158443] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-21T19:43:04.310930] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:04.347455] [DEBUG] [LOCAL ] LPG: Loaded 39541 existing records from primary storage. [2025-10-21T19:43:04.347824] [INFO ] [MAIN ] LPG: Loaded 39541 existing records. [2025-10-21T19:43:04.521764] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:04.521960] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-21T19:43:04.522006] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-21T19:43:04.522182] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-21T19:43:04.522219] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-21T19:43:04.877185] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:04.951014] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-21T19:43:05.491595] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:43:05.751072] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-21T19:43:06.049888] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (5.10 seconds). [2025-10-21T19:43:06.418061] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:43:06.551018] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-21T19:43:07.035010] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T19:43:07.351026] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-21T19:43:08.151017] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-21T19:43:08.437368] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T19:43:08.608678] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-21T19:43:08.951027] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-21T19:43:08.976499] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T19:43:09.750990] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-21T19:43:10.232119] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:43:10.551088] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-21T19:43:11.266108] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T19:43:11.351030] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-21T19:43:12.151008] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-21T19:43:12.183102] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T19:43:12.713495] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T19:43:12.950998] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-21T19:43:13.396853] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T19:43:13.751022] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-21T19:43:14.253796] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-21T19:43:14.428786] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:43:14.434619] [INFO ] [REMOTE ] LOMA: Full fetch complete (47809 records). [2025-10-21T19:43:14.434748] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-21T19:43:14.556112] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-21T19:43:14.813087] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-21T19:43:14.813169] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-21T19:43:14.813994] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-21T19:43:14.814056] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-21T19:43:14.815017] [DEBUG] [LOCAL ] LOMA: Trimmed 47809 records to 32809 (keeping 200 days of data) [2025-10-21T19:43:14.994299] [DEBUG] [LOCAL ] LOMA: Primary data saved (32809 records). [2025-10-21T19:43:14.994424] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-21T19:43:14.995118] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols completed. LOMA took 23.2s. Estimated remaining: 2h 21m 33s. Rate: 7.8 symbols/min [2025-10-21T19:43:15.162537] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:15.191372] [DEBUG] [LOCAL ] LPL: Loaded 28753 existing records from primary storage. [2025-10-21T19:43:15.191706] [INFO ] [MAIN ] LPL: Loaded 28753 existing records. [2025-10-21T19:43:15.295096] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:43:15.353189] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-21T19:43:15.375168] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:15.375337] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-21T19:43:15.375382] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-21T19:43:15.375545] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-21T19:43:15.375581] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-21T19:43:15.721419] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:16.151023] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-21T19:43:16.951029] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-21T19:43:17.295234] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T19:43:17.393037] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T19:43:17.398992] [INFO ] [REMOTE ] LOCL: Full fetch complete (4547 records). [2025-10-21T19:43:17.398832] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T19:43:17.399310] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-21T19:43:17.761222] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-21T19:43:17.792404] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-21T19:43:17.792492] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-21T19:43:17.792707] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-21T19:43:17.792768] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-21T19:43:17.793122] [DEBUG] [LOCAL ] LOCL: Trimmed 4547 records to 3714 (keeping 200 days of data) [2025-10-21T19:43:17.814314] [DEBUG] [LOCAL ] LOCL: Primary data saved (3714 records). [2025-10-21T19:43:17.814402] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-21T19:43:17.814490] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols completed. LOCL took 30.6s. Estimated remaining: 2h 21m 21s. Rate: 7.8 symbols/min [2025-10-21T19:43:17.983463] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:18.023344] [DEBUG] [LOCAL ] LPX: Loaded 40152 existing records from primary storage. [2025-10-21T19:43:18.023682] [INFO ] [MAIN ] LPX: Loaded 40152 existing records. [2025-10-21T19:43:18.230422] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:18.230685] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-21T19:43:18.230746] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-21T19:43:18.230950] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-21T19:43:18.231201] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-21T19:43:18.558281] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-21T19:43:18.659185] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:19.356256] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-21T19:43:19.382122] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T19:43:20.150999] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-21T19:43:20.511834] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T19:43:20.911460] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:43:20.950983] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-21T19:43:21.304374] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T19:43:21.751013] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-21T19:43:22.438445] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:43:22.551049] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-21T19:43:23.186374] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:43:23.351020] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-21T19:43:23.553111] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T19:43:24.151072] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-21T19:43:24.776503] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T19:43:24.951030] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-21T19:43:25.761425] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-21T19:43:25.772245] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:43:25.797287] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T19:43:26.551053] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-21T19:43:27.351051] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-21T19:43:27.395042] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T19:43:27.475678] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T19:43:28.151022] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-21T19:43:28.909440] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:43:28.951063] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-21T19:43:29.231606] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T19:43:29.751088] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-21T19:43:30.551033] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-21T19:43:30.602282] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T19:43:31.351099] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-21T19:43:31.734907] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T19:43:32.042995] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-21T19:43:32.150992] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-21T19:43:32.201519] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:43:32.951032] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-21T19:43:33.750989] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-21T19:43:34.021050] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:43:34.176897] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T19:43:34.551031] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-21T19:43:35.137264] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:43:35.144681] [INFO ] [REMOTE ] LPG: Full fetch complete (58910 records). [2025-10-21T19:43:35.144911] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-21T19:43:35.351975] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-21T19:43:35.554683] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-21T19:43:35.554883] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-21T19:43:35.555912] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-21T19:43:35.564221] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-21T19:43:35.579512] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T19:43:35.588138] [DEBUG] [LOCAL ] LPG: Trimmed 58910 records to 39396 (keeping 200 days of data) [2025-10-21T19:43:35.588758] [INFO ] [REMOTE ] LOW: Full fetch complete (76719 records). [2025-10-21T19:43:35.589227] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-21T19:43:36.124976] [DEBUG] [LOCAL ] LPG: Primary data saved (39396 records). [2025-10-21T19:43:36.127427] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-21T19:43:36.127540] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols completed. LPG took 32.0s. Estimated remaining: 2h 21m 22s. Rate: 7.8 symbols/min [2025-10-21T19:43:36.156160] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-21T19:43:36.331330] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-21T19:43:36.336887] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-21T19:43:36.343415] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-21T19:43:36.348635] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-21T19:43:36.403069] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:36.403924] [DEBUG] [LOCAL ] LOW: Trimmed 76719 records to 52978 (keeping 200 days of data) [2025-10-21T19:43:36.736267] [DEBUG] [LOCAL ] LRN: Loaded 39505 existing records from primary storage. [2025-10-21T19:43:36.739035] [INFO ] [MAIN ] LRN: Loaded 39505 existing records. [2025-10-21T19:43:36.868096] [DEBUG] [LOCAL ] LOW: Primary data saved (52978 records). [2025-10-21T19:43:36.889227] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-21T19:43:36.889406] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols completed. LOW took 41.4s. Estimated remaining: 2h 21m 8s. Rate: 7.8 symbols/min [2025-10-21T19:43:36.979470] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:37.013512] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-21T19:43:37.018933] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-21T19:43:37.052061] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-21T19:43:37.052308] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-21T19:43:37.256605] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:37.265024] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:43:37.357048] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-21T19:43:37.554106] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:37.567874] [DEBUG] [LOCAL ] LSPD: Loaded 42440 existing records from primary storage. [2025-10-21T19:43:37.568185] [INFO ] [MAIN ] LSPD: Loaded 42440 existing records. [2025-10-21T19:43:37.746940] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:37.747345] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-21T19:43:37.747423] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-21T19:43:37.747735] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-21T19:43:37.747812] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-21T19:43:37.780346] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-21T19:43:37.966753] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T19:43:38.172679] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:38.551034] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-21T19:43:38.891909] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:43:39.028865] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T19:43:39.351027] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-21T19:43:39.986674] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:43:40.151083] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-21T19:43:40.895536] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T19:43:40.951023] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-21T19:43:41.746308] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T19:43:41.753952] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-21T19:43:42.556098] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-21T19:43:42.566369] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T19:43:42.573572] [INFO ] [REMOTE ] LPL: Full fetch complete (37468 records). [2025-10-21T19:43:42.573748] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-21T19:43:42.957374] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-21T19:43:42.957454] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-21T19:43:42.958322] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-21T19:43:42.958402] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-21T19:43:42.959339] [DEBUG] [LOCAL ] LPL: Trimmed 37468 records to 28918 (keeping 200 days of data) [2025-10-21T19:43:43.118770] [DEBUG] [LOCAL ] LPL: Primary data saved (28918 records). [2025-10-21T19:43:43.118898] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-21T19:43:43.118975] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols completed. LPL took 28.1s. Estimated remaining: 2h 20m 59s. Rate: 7.8 symbols/min [2025-10-21T19:43:43.315437] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:43.317574] [DEBUG] [LOCAL ] LTC: No existing data file found in primary storage. [2025-10-21T19:43:43.317426] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T19:43:43.325859] [WARN ] [MAIN ] LTC: No existing data found, performing full refresh instead. [2025-10-21T19:43:43.326374] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-21T19:43:43.326813] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-21T19:43:43.326881] [DEBUG] [LOCAL ] LTC: No primary data file found to delete. [2025-10-21T19:43:43.326915] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-21T19:43:43.357195] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-21T19:43:43.698414] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:44.151041] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-21T19:43:44.311925] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T19:43:44.941065] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:43:44.950974] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-21T19:43:45.257425] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T19:43:45.751066] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-21T19:43:46.551018] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-21T19:43:46.668390] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T19:43:47.351048] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-21T19:43:47.557309] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:43:47.877840] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T19:43:48.151079] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-21T19:43:48.606447] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T19:43:48.951001] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-21T19:43:49.223333] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T19:43:49.751071] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-21T19:43:50.223420] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T19:43:50.551022] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-21T19:43:51.128327] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T19:43:51.351010] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-21T19:43:52.070193] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:43:52.151082] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-21T19:43:52.324788] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T19:43:52.951052] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-21T19:43:53.476716] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:43:53.751041] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-21T19:43:54.528151] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:43:54.551002] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-21T19:43:55.261016] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T19:43:55.350984] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-21T19:43:56.081843] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T19:43:56.088480] [INFO ] [REMOTE ] LPX: Full fetch complete (58751 records). [2025-10-21T19:43:56.088594] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-21T19:43:56.156257] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-21T19:43:56.470731] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-21T19:43:56.470854] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-21T19:43:56.471825] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-21T19:43:56.472036] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-21T19:43:56.483028] [DEBUG] [LOCAL ] LPX: Trimmed 58751 records to 40110 (keeping 200 days of data) [2025-10-21T19:43:56.499815] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T19:43:56.750453] [DEBUG] [LOCAL ] LPX: Primary data saved (40110 records). [2025-10-21T19:43:56.750578] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-21T19:43:56.751149] [INFO ] [MAIN ] Update Progress: 1272/2366 symbols completed. LPX took 38.9s. Estimated remaining: 2h 20m 57s. Rate: 7.8 symbols/min [2025-10-21T19:43:56.917188] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:43:56.951073] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-21T19:43:56.967844] [DEBUG] [LOCAL ] LTH: Loaded 51686 existing records from primary storage. [2025-10-21T19:43:56.968175] [INFO ] [MAIN ] LTH: Loaded 51686 existing records. [2025-10-21T19:43:57.143057] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:43:57.143271] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-21T19:43:57.143327] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-21T19:43:57.143539] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-21T19:43:57.143595] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-21T19:43:57.494955] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:43:57.513267] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T19:43:57.751024] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-21T19:43:58.032691] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T19:43:58.551016] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-21T19:43:59.356696] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-21T19:43:59.375942] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T19:44:00.151003] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-21T19:44:00.198155] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T19:44:00.204961] [INFO ] [REMOTE ] LSPD: Full fetch complete (62234 records). [2025-10-21T19:44:00.205063] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-21T19:44:00.587901] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-21T19:44:00.587975] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-21T19:44:00.588862] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-21T19:44:00.588925] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-21T19:44:00.590114] [DEBUG] [LOCAL ] LSPD: Trimmed 62234 records to 42387 (keeping 200 days of data) [2025-10-21T19:44:00.828285] [DEBUG] [LOCAL ] LSPD: Primary data saved (42387 records). [2025-10-21T19:44:00.828398] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-21T19:44:00.828473] [INFO ] [MAIN ] Update Progress: 1273/2366 symbols completed. LSPD took 23.9s. Estimated remaining: 2h 20m 46s. Rate: 7.8 symbols/min [2025-10-21T19:44:00.968170] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-21T19:44:01.003700] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:01.040185] [DEBUG] [LOCAL ] LTM: Loaded 39040 existing records from primary storage. [2025-10-21T19:44:01.040444] [INFO ] [MAIN ] LTM: Loaded 39040 existing records. [2025-10-21T19:44:01.218130] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:01.218376] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-21T19:44:01.218444] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-21T19:44:01.218967] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-21T19:44:01.219024] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-21T19:44:01.437862] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-21T19:44:01.620835] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:01.750987] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-21T19:44:01.852748] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:44:02.551014] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-21T19:44:02.865854] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T19:44:02.891731] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T19:44:03.351100] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-21T19:44:03.755426] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T19:44:04.151024] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-21T19:44:04.951002] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-21T19:44:05.066087] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:44:05.260486] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:44:05.751059] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-21T19:44:06.357877] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:44:06.551052] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-21T19:44:07.341685] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T19:44:07.350972] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-21T19:44:07.949892] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:44:08.151078] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-21T19:44:08.945544] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T19:44:08.953734] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-21T19:44:09.507635] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T19:44:09.751035] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-21T19:44:10.551024] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-21T19:44:10.771032] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T19:44:11.234553] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:44:11.240731] [INFO ] [REMOTE ] LRN: Full fetch complete (58340 records). [2025-10-21T19:44:11.240854] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-21T19:44:11.355868] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-21T19:44:11.692033] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-21T19:44:11.692228] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-21T19:44:11.693525] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-21T19:44:11.693629] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-21T19:44:11.724262] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T19:44:11.732211] [DEBUG] [LOCAL ] LRN: Trimmed 58340 records to 39446 (keeping 200 days of data) [2025-10-21T19:44:11.733377] [INFO ] [REMOTE ] LTC: Full fetch complete (43824 records). [2025-10-21T19:44:11.733504] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-21T19:44:12.157802] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-21T19:44:12.545562] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-21T19:44:12.552740] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-21T19:44:12.568562] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-21T19:44:12.575365] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-21T19:44:12.590883] [DEBUG] [LOCAL ] LTC: Trimmed 43824 records to 30677 (keeping 200 days of data) [2025-10-21T19:44:12.599890] [DEBUG] [LOCAL ] LRN: Primary data saved (39446 records). [2025-10-21T19:44:12.600496] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-21T19:44:12.600936] [INFO ] [MAIN ] Update Progress: 1274/2366 symbols completed. LRN took 36.5s. Estimated remaining: 2h 20m 42s. Rate: 7.8 symbols/min [2025-10-21T19:44:12.910385] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:13.002348] [DEBUG] [LOCAL ] LTC: Primary data saved (30677 records). [2025-10-21T19:44:13.002553] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-21T19:44:13.002683] [INFO ] [MAIN ] Update Progress: 1275/2366 symbols completed. LTC took 29.9s. Estimated remaining: 2h 20m 28s. Rate: 7.8 symbols/min [2025-10-21T19:44:13.173332] [DEBUG] [LOCAL ] LU: Loaded 49163 existing records from primary storage. [2025-10-21T19:44:13.225709] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:13.222333] [INFO ] [MAIN ] LU: Loaded 49163 existing records. [2025-10-21T19:44:13.459676] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T19:44:13.457477] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:13.467289] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-21T19:44:13.479690] [DEBUG] [LOCAL ] LUCK: Loaded 24157 existing records from primary storage. [2025-10-21T19:44:13.480362] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-21T19:44:13.480080] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-21T19:44:13.480563] [INFO ] [MAIN ] LUCK: Loaded 24157 existing records. [2025-10-21T19:44:13.485977] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-21T19:44:13.486829] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-21T19:44:13.678518] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:44:13.754520] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-21T19:44:13.840195] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:13.877589] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-21T19:44:13.879850] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-21T19:44:13.896488] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-21T19:44:13.904733] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-21T19:44:14.278440] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:14.456973] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:14.550976] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-21T19:44:15.092194] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:44:15.143268] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T19:44:15.351008] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-21T19:44:16.156212] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-21T19:44:16.178209] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T19:44:16.811195] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T19:44:16.951034] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-21T19:44:17.751023] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-21T19:44:17.830225] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:44:18.441554] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T19:44:18.551076] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-21T19:44:19.351016] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-21T19:44:19.520764] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:44:19.883010] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T19:44:20.151025] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-21T19:44:20.951037] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-21T19:44:21.004093] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:44:21.446821] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T19:44:21.751117] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-21T19:44:22.551072] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-21T19:44:22.824213] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T19:44:23.234033] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T19:44:23.351001] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-21T19:44:23.717677] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T19:44:24.151032] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-21T19:44:24.950994] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-21T19:44:25.040304] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T19:44:25.490555] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T19:44:25.751041] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-21T19:44:26.551004] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-21T19:44:26.724744] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T19:44:27.145060] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:44:27.153251] [INFO ] [REMOTE ] LTM: Full fetch complete (51124 records). [2025-10-21T19:44:27.153351] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-21T19:44:27.360627] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-21T19:44:27.535666] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-21T19:44:27.535749] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-21T19:44:27.536583] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-21T19:44:27.536621] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-21T19:44:27.538559] [DEBUG] [LOCAL ] LTM: Trimmed 51124 records to 39164 (keeping 200 days of data) [2025-10-21T19:44:27.780249] [DEBUG] [LOCAL ] LTM: Primary data saved (39164 records). [2025-10-21T19:44:27.781071] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-21T19:44:27.781756] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:44:27.781904] [INFO ] [MAIN ] Update Progress: 1276/2366 symbols completed. LTM took 27.0s. Estimated remaining: 2h 20m 26s. Rate: 7.8 symbols/min [2025-10-21T19:44:27.955088] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:28.006567] [DEBUG] [LOCAL ] LUMN: Loaded 53645 existing records from primary storage. [2025-10-21T19:44:28.006923] [INFO ] [MAIN ] LUMN: Loaded 53645 existing records. [2025-10-21T19:44:28.156669] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-21T19:44:28.187983] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:28.188178] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-21T19:44:28.188232] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-21T19:44:28.188573] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-21T19:44:28.188631] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-21T19:44:28.553988] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:28.951072] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-21T19:44:29.049909] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:44:29.563010] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:44:29.751019] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-21T19:44:30.133365] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T19:44:30.551086] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-21T19:44:31.351040] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-21T19:44:31.503278] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:44:32.151082] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-21T19:44:32.336464] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T19:44:32.951051] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-21T19:44:33.117397] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T19:44:33.236902] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T19:44:33.751055] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-21T19:44:34.418827] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T19:44:34.551058] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-21T19:44:34.824094] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T19:44:35.351048] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-10-21T19:44:36.151026] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-21T19:44:36.416431] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T19:44:36.424454] [INFO ] [REMOTE ] LTH: Full fetch complete (74760 records). [2025-10-21T19:44:36.424568] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-21T19:44:36.813450] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-21T19:44:36.813544] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-21T19:44:36.814618] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-21T19:44:36.814755] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-21T19:44:36.816257] [DEBUG] [LOCAL ] LTH: Trimmed 74760 records to 51653 (keeping 200 days of data) [2025-10-21T19:44:36.995789] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-21T19:44:37.053285] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:44:37.153963] [DEBUG] [LOCAL ] LTH: Primary data saved (51653 records). [2025-10-21T19:44:37.154089] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-21T19:44:37.154471] [INFO ] [MAIN ] Update Progress: 1277/2366 symbols completed. LTH took 40.4s. Estimated remaining: 2h 20m 20s. Rate: 7.8 symbols/min [2025-10-21T19:44:37.276827] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T19:44:37.280369] [INFO ] [REMOTE ] LUCK: Full fetch complete (39414 records). [2025-10-21T19:44:37.280483] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-21T19:44:37.654884] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-21T19:44:37.654956] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-21T19:44:37.655721] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-21T19:44:37.655780] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-21T19:44:37.656573] [DEBUG] [LOCAL ] LUCK: Trimmed 39414 records to 23955 (keeping 200 days of data) [2025-10-21T19:44:37.752015] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-10-21T19:44:37.796526] [DEBUG] [LOCAL ] LUCK: Primary data saved (23955 records). [2025-10-21T19:44:37.796637] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-21T19:44:37.796754] [INFO ] [MAIN ] Update Progress: 1278/2366 symbols completed. LUCK took 24.8s. Estimated remaining: 2h 20m 6s. Rate: 7.8 symbols/min [2025-10-21T19:44:38.611246] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:44:38.622040] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-21T19:44:39.757013] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T19:44:39.769553] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-10-21T19:44:40.245723] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T19:44:40.255900] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-21T19:44:41.634522] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T19:44:41.645857] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-10-21T19:44:41.964226] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T19:44:41.975083] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-21T19:44:43.619505] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T19:44:43.630794] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-10-21T19:44:43.690890] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T19:44:43.699272] [INFO ] [REMOTE ] LU: Full fetch complete (70940 records). [2025-10-21T19:44:43.699433] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-21T19:44:44.111281] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-21T19:44:44.111363] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-21T19:44:44.112747] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-21T19:44:44.112819] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-21T19:44:44.114114] [DEBUG] [LOCAL ] LU: Trimmed 70940 records to 49218 (keeping 200 days of data) [2025-10-21T19:44:44.377177] [DEBUG] [LOCAL ] LU: Primary data saved (49218 records). [2025-10-21T19:44:44.377298] [INFO ] [MAIN ] LU: Full history saved. [2025-10-21T19:44:44.377375] [INFO ] [MAIN ] Update Progress: 1279/2366 symbols completed. LU took 31.8s. Estimated remaining: 2h 19m 57s. Rate: 7.8 symbols/min [2025-10-21T19:44:45.541212] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T19:44:45.553058] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-10-21T19:44:47.486689] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T19:44:47.498607] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-10-21T19:44:49.363529] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:44:49.375221] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-10-21T19:44:51.590803] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T19:44:51.602213] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-10. [2025-10-21T19:44:53.735683] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-21T19:44:53.747451] [INFO ] [REMOTE ] LUMN: Full fetch complete (77778 records). [2025-10-21T19:44:53.747596] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-10-21T19:44:54.133598] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-10-21T19:44:54.133693] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-10-21T19:44:54.134713] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-10-21T19:44:54.134774] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-10-21T19:44:54.136171] [DEBUG] [LOCAL ] LUMN: Trimmed 77778 records to 53645 (keeping 200 days of data) [2025-10-21T19:44:54.426595] [DEBUG] [LOCAL ] LUMN: Primary data saved (53645 records). [2025-10-21T19:44:54.426744] [INFO ] [MAIN ] LUMN: Full history saved. [2025-10-21T19:44:54.427544] [INFO ] [MAIN ] Update Progress: 1280/2366 symbols completed. LUMN took 26.6s. Estimated remaining: 2h 19m 51s. Rate: 7.8 symbols/min [2025-10-21T19:44:55.080191] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:55.090045] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:55.117432] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:55.139703] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:55.140197] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-21T19:44:55.140422] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-21T19:44:55.140563] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-21T19:44:55.140627] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-21T19:44:55.140725] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-21T19:44:55.140771] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-21T19:44:55.266026] [DEBUG] [LOCAL ] LVWR: Loaded 18569 existing records from primary storage. [2025-10-21T19:44:55.277718] [INFO ] [MAIN ] LVWR: Loaded 18569 existing records. [2025-10-21T19:44:55.636939] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-21T19:44:55.692447] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-21T19:44:55.748877] [INFO ] [MAIN ] LVS: Loaded 53570 existing records. [2025-10-21T19:44:55.734683] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-21T19:44:55.743483] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:55.804998] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-21T19:44:55.826752] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-21T19:44:55.901004] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-21T19:44:55.906940] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:55.967553] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-21T19:44:55.935941] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-21T19:44:56.222073] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:56.272211] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:44:56.271659] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-21T19:44:56.272358] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-21T19:44:56.294500] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:56.294841] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-21T19:44:56.305361] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-21T19:44:56.352703] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-21T19:44:56.336326] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:44:56.355287] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-21T19:44:56.362210] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-21T19:44:56.369023] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-21T19:44:56.388763] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-21T19:44:56.434038] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:44:56.474391] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-21T19:44:56.488015] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-21T19:44:56.503562] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-21T19:44:56.579054] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-21T19:44:56.711895] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-21T19:44:56.738565] [INFO ] [MAIN ] Update Progress: 1281/2366 symbols completed. LUXE took 2.3s. Estimated remaining: 2h 19m 39s. Rate: 7.8 symbols/min [2025-10-21T19:44:56.798969] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:56.824693] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-21T19:44:57.323779] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:57.380014] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:44:57.371049] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-21T19:44:57.481324] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:57.486278] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-21T19:44:57.486431] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-21T19:44:57.489315] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-21T19:44:57.526508] [DEBUG] [LOCAL ] LW: Loaded 51191 existing records from primary storage. [2025-10-21T19:44:57.526851] [INFO ] [MAIN ] LW: Loaded 51191 existing records. [2025-10-21T19:44:57.698947] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:44:57.699152] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-21T19:44:57.699202] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-21T19:44:57.699394] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-21T19:44:57.699430] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-21T19:44:58.050192] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:44:58.050582] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-21T19:44:58.094135] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:44:58.095768] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-21T19:44:58.591137] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-21T19:44:58.592924] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-21T19:44:59.177611] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T19:44:59.179857] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-21T19:44:59.215757] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T19:44:59.226864] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-21T19:44:59.516377] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T19:44:59.527207] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-21T19:44:59.621042] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T19:44:59.631770] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-21T19:44:59.914795] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T19:44:59.919142] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-21T19:45:01.769085] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-21T19:45:01.781222] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-21T19:45:01.870781] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-21T19:45:01.881435] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-21T19:45:01.923044] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T19:45:01.932222] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-21T19:45:02.101597] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-10-21T19:45:02.111953] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-21T19:45:04.279509] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-21T19:45:04.309163] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-21T19:45:04.307593] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-21T19:45:04.321808] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-21T19:45:04.674789] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-21T19:45:04.686838] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-21T19:45:04.906285] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-21T19:45:04.911426] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-21T19:45:05.802493] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T19:45:05.807334] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-21T19:45:06.292034] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:45:06.305906] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-21T19:45:06.356890] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T19:45:06.371695] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-21T19:45:06.426402] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T19:45:06.443911] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-21T19:45:06.881238] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T19:45:06.885575] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-21T19:45:07.866913] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:45:07.873756] [INFO ] [REMOTE ] LVWR: Full fetch complete (20711 records). [2025-10-21T19:45:07.873978] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-21T19:45:08.280720] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-21T19:45:08.296505] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-21T19:45:08.306117] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-21T19:45:08.309388] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-21T19:45:08.312995] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T19:45:08.311583] [DEBUG] [LOCAL ] LVWR: Trimmed 20711 records to 18596 (keeping 200 days of data) [2025-10-21T19:45:08.325745] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-21T19:45:08.443069] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T19:45:08.470274] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-21T19:45:08.480051] [DEBUG] [LOCAL ] LVWR: Primary data saved (18596 records). [2025-10-21T19:45:08.481311] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-21T19:45:08.481414] [INFO ] [MAIN ] Update Progress: 1282/2366 symbols completed. LVWR took 14.0s. Estimated remaining: 2h 19m 35s. Rate: 7.8 symbols/min [2025-10-21T19:45:08.620759] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-21T19:45:08.701562] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:08.719228] [DEBUG] [LOCAL ] LXFR: Loaded 16472 existing records from primary storage. [2025-10-21T19:45:08.719468] [INFO ] [MAIN ] LXFR: Loaded 16472 existing records. [2025-10-21T19:45:08.897669] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:08.897928] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-21T19:45:08.898005] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-21T19:45:08.898190] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-21T19:45:08.898230] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-21T19:45:08.963224] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-21T19:45:09.266989] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:09.751084] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-21T19:45:10.133801] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:45:10.352846] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T19:45:10.442416] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T19:45:10.550990] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-21T19:45:10.741099] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:45:11.351030] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-21T19:45:11.628813] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T19:45:12.151042] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-21T19:45:12.951026] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-21T19:45:13.327679] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-21T19:45:13.354568] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T19:45:13.751035] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-21T19:45:14.565110] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-21T19:45:14.568741] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:45:14.798140] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T19:45:15.351072] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-21T19:45:16.151042] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-21T19:45:16.951025] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-21T19:45:17.193615] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T19:45:17.215864] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T19:45:17.751086] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-21T19:45:18.551031] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-21T19:45:18.696699] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T19:45:18.980221] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (4.42 seconds). [2025-10-21T19:45:19.351050] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-21T19:45:19.511835] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T19:45:20.151068] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-21T19:45:20.919964] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T19:45:20.950978] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-21T19:45:21.198979] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T19:45:21.530502] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-10-21T19:45:21.751079] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-21T19:45:22.550999] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-21T19:45:22.623096] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T19:45:22.631288] [INFO ] [REMOTE ] LW: Full fetch complete (74771 records). [2025-10-21T19:45:22.631404] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-21T19:45:23.018269] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-21T19:45:23.018350] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-21T19:45:23.019400] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-21T19:45:23.019464] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-21T19:45:23.020806] [DEBUG] [LOCAL ] LW: Trimmed 74771 records to 51180 (keeping 200 days of data) [2025-10-21T19:45:23.334279] [DEBUG] [LOCAL ] LW: Primary data saved (51180 records). [2025-10-21T19:45:23.334527] [INFO ] [MAIN ] LW: Full history saved. [2025-10-21T19:45:23.335247] [INFO ] [MAIN ] Update Progress: 1283/2366 symbols completed. LW took 26.5s. Estimated remaining: 2h 19m 33s. Rate: 7.8 symbols/min [2025-10-21T19:45:23.356685] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-21T19:45:23.511375] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:23.535228] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:45:23.544431] [INFO ] [REMOTE ] LVS: Full fetch complete (77722 records). [2025-10-21T19:45:23.544565] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-21T19:45:23.887700] [DEBUG] [LOCAL ] LXP: Loaded 50793 existing records from primary storage. [2025-10-21T19:45:23.909424] [INFO ] [MAIN ] LXP: Loaded 50793 existing records. [2025-10-21T19:45:24.055060] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-21T19:45:24.082437] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-21T19:45:24.099550] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-21T19:45:24.120914] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-21T19:45:24.176661] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-21T19:45:24.217637] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:24.218846] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-21T19:45:24.219218] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-21T19:45:24.219493] [DEBUG] [LOCAL ] LVS: Trimmed 77722 records to 53570 (keeping 200 days of data) [2025-10-21T19:45:24.219869] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-21T19:45:24.219950] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-21T19:45:24.220798] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-21T19:45:24.589322] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T19:45:24.849011] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:24.952431] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-21T19:45:24.955766] [DEBUG] [LOCAL ] LVS: Primary data saved (53570 records). [2025-10-21T19:45:24.955841] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-21T19:45:24.956684] [INFO ] [MAIN ] Update Progress: 1284/2366 symbols completed. LVS took 30.5s. Estimated remaining: 2h 19m 20s. Rate: 7.8 symbols/min [2025-10-21T19:45:25.127721] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:25.159463] [DEBUG] [LOCAL ] LXU: Loaded 31669 existing records from primary storage. [2025-10-21T19:45:25.159745] [INFO ] [MAIN ] LXU: Loaded 31669 existing records. [2025-10-21T19:45:25.342558] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:25.342787] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-21T19:45:25.342839] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-21T19:45:25.343025] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-21T19:45:25.343079] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-21T19:45:25.729278] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:25.751012] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-21T19:45:26.090748] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:45:26.254177] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T19:45:26.551085] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-21T19:45:26.617360] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T19:45:27.351103] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-21T19:45:28.131542] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:45:28.150975] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-21T19:45:28.190423] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T19:45:28.951034] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-21T19:45:29.751018] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-21T19:45:29.860256] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T19:45:29.892119] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T19:45:29.900470] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-21T19:45:29.900600] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-21T19:45:30.310738] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-21T19:45:30.310841] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-21T19:45:30.312024] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-21T19:45:30.312087] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-21T19:45:30.313559] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-21T19:45:30.555633] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-21T19:45:30.642701] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-21T19:45:30.642838] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-21T19:45:30.643386] [INFO ] [MAIN ] Update Progress: 1285/2366 symbols completed. LUV took 36.2s. Estimated remaining: 2h 19m 11s. Rate: 7.8 symbols/min [2025-10-21T19:45:30.816913] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:30.871480] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-21T19:45:30.871928] [INFO ] [MAIN ] LYB: Loaded 53621 existing records. [2025-10-21T19:45:31.051982] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:31.052336] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-21T19:45:31.052450] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-21T19:45:31.052714] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-21T19:45:31.069160] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-21T19:45:31.132835] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T19:45:31.352204] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-21T19:45:31.430630] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:31.538502] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T19:45:32.151061] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-21T19:45:32.872553] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:45:32.951050] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-21T19:45:33.127732] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:45:33.130423] [INFO ] [REMOTE ] LXFR: Full fetch complete (24692 records). [2025-10-21T19:45:33.130524] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-21T19:45:33.494329] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-21T19:45:33.494431] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-21T19:45:33.494963] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-21T19:45:33.495023] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-21T19:45:33.495730] [DEBUG] [LOCAL ] LXFR: Trimmed 24692 records to 16437 (keeping 200 days of data) [2025-10-21T19:45:33.593109] [DEBUG] [LOCAL ] LXFR: Primary data saved (16437 records). [2025-10-21T19:45:33.593254] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-21T19:45:33.593332] [INFO ] [MAIN ] Update Progress: 1286/2366 symbols completed. LXFR took 25.1s. Estimated remaining: 2h 18m 59s. Rate: 7.8 symbols/min [2025-10-21T19:45:33.756837] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-21T19:45:33.759260] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:33.809674] [DEBUG] [LOCAL ] LYG: Loaded 52666 existing records from primary storage. [2025-10-21T19:45:33.809962] [INFO ] [MAIN ] LYG: Loaded 52666 existing records. [2025-10-21T19:45:33.987543] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:33.987787] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-21T19:45:33.987847] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-21T19:45:33.988088] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-21T19:45:33.988156] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-21T19:45:34.362419] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:34.363998] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:45:34.551070] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-21T19:45:35.350996] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-21T19:45:35.455620] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T19:45:36.151096] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-21T19:45:36.298364] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T19:45:36.951025] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-21T19:45:37.136310] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T19:45:37.543246] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T19:45:37.751061] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-21T19:45:38.551036] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-21T19:45:38.638519] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:45:39.137313] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T19:45:39.351044] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-21T19:45:40.047312] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T19:45:40.151075] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-21T19:45:40.951087] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-21T19:45:41.044195] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:45:41.750989] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-21T19:45:41.995375] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T19:45:42.261284] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-21T19:45:42.551020] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-21T19:45:43.351110] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-21T19:45:43.651464] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T19:45:43.963571] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T19:45:44.151008] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-21T19:45:44.694932] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T19:45:44.951112] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-21T19:45:45.750996] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-21T19:45:45.991467] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T19:45:46.551006] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-21T19:45:47.034119] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T19:45:47.060061] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T19:45:47.351048] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-21T19:45:48.151004] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-21T19:45:48.383588] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T19:45:48.951047] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-21T19:45:49.092397] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T19:45:49.751002] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-21T19:45:49.843897] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:45:50.302208] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T19:45:50.307005] [INFO ] [REMOTE ] LXU: Full fetch complete (45258 records). [2025-10-21T19:45:50.307098] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-21T19:45:50.556096] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-21T19:45:50.682532] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-21T19:45:50.682608] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-21T19:45:50.683424] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-21T19:45:50.683485] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-21T19:45:50.684424] [DEBUG] [LOCAL ] LXU: Trimmed 45258 records to 31582 (keeping 200 days of data) [2025-10-21T19:45:50.870786] [DEBUG] [LOCAL ] LXU: Primary data saved (31582 records). [2025-10-21T19:45:50.870913] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-21T19:45:50.870989] [INFO ] [MAIN ] Update Progress: 1287/2366 symbols completed. LXU took 25.9s. Estimated remaining: 2h 18m 59s. Rate: 7.8 symbols/min [2025-10-21T19:45:51.044112] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:51.094607] [DEBUG] [LOCAL ] LYV: Loaded 51086 existing records from primary storage. [2025-10-21T19:45:51.095065] [INFO ] [MAIN ] LYV: Loaded 51086 existing records. [2025-10-21T19:45:51.275785] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:51.276011] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-21T19:45:51.276059] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-21T19:45:51.276227] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-21T19:45:51.276264] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-21T19:45:51.354584] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-21T19:45:51.668777] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T19:45:51.673041] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:52.151051] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-21T19:45:52.472670] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T19:45:52.668597] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T19:45:52.951002] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-21T19:45:53.751025] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-21T19:45:54.440168] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-21T19:45:54.550992] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-21T19:45:54.686108] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T19:45:54.694002] [INFO ] [REMOTE ] LXP: Full fetch complete (72867 records). [2025-10-21T19:45:54.694134] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-21T19:45:55.085590] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-21T19:45:55.085722] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-21T19:45:55.086768] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-21T19:45:55.086842] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-21T19:45:55.088434] [DEBUG] [LOCAL ] LXP: Trimmed 72867 records to 50786 (keeping 200 days of data) [2025-10-21T19:45:55.354403] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-21T19:45:55.386535] [DEBUG] [LOCAL ] LXP: Primary data saved (50786 records). [2025-10-21T19:45:55.387052] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-21T19:45:55.387610] [INFO ] [MAIN ] Update Progress: 1288/2366 symbols completed. LXP took 32.1s. Estimated remaining: 2h 18m 49s. Rate: 7.8 symbols/min [2025-10-21T19:45:55.560992] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:45:55.595215] [DEBUG] [LOCAL ] LZB: Loaded 35168 existing records from primary storage. [2025-10-21T19:45:55.595497] [INFO ] [MAIN ] LZB: Loaded 35168 existing records. [2025-10-21T19:45:55.774674] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:45:55.775023] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-21T19:45:55.775090] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-21T19:45:55.775472] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-21T19:45:55.775531] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-21T19:45:55.961438] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T19:45:56.152824] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-21T19:45:56.182214] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:45:56.261607] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T19:45:56.808333] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T19:45:56.951027] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-21T19:45:57.751035] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-21T19:45:58.288722] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T19:45:58.551095] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-21T19:45:58.861496] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T19:45:59.137683] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T19:45:59.351104] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-21T19:46:00.151082] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-21T19:46:00.545686] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T19:46:00.951041] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-21T19:46:01.685240] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-21T19:46:01.751044] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-21T19:46:01.750896] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T19:46:02.551012] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-21T19:46:02.819556] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T19:46:03.351067] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-21T19:46:03.954374] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T19:46:04.151003] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-21T19:46:04.788585] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-21T19:46:04.951121] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-21T19:46:05.143035] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T19:46:05.751018] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-21T19:46:05.863915] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:46:05.874250] [INFO ] [REMOTE ] LYB: Full fetch complete (77635 records). [2025-10-21T19:46:05.874495] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-21T19:46:06.246906] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T19:46:06.281669] [INFO ] [REMOTE ] LYG: Full fetch complete (76234 records). [2025-10-21T19:46:06.312350] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-21T19:46:06.440122] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-21T19:46:06.453257] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-21T19:46:06.455126] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-21T19:46:06.455219] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-21T19:46:06.511540] [DEBUG] [LOCAL ] LYB: Trimmed 77635 records to 53621 (keeping 200 days of data) [2025-10-21T19:46:06.561285] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-21T19:46:07.169187] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-21T19:46:07.173815] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-21T19:46:07.191049] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-21T19:46:07.200143] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-21T19:46:07.199917] [DEBUG] [LOCAL ] LYB: Primary data saved (53621 records). [2025-10-21T19:46:07.200876] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-21T19:46:07.201500] [INFO ] [MAIN ] Update Progress: 1289/2366 symbols completed. LYB took 36.6s. Estimated remaining: 2h 18m 45s. Rate: 7.8 symbols/min [2025-10-21T19:46:07.285995] [DEBUG] [LOCAL ] LYG: Trimmed 76234 records to 52661 (keeping 200 days of data) [2025-10-21T19:46:07.469226] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:07.513864] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T19:46:07.535974] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-21T19:46:07.557278] [DEBUG] [LOCAL ] LZM: Loaded 14708 existing records from primary storage. [2025-10-21T19:46:07.557803] [INFO ] [MAIN ] LZM: Loaded 14708 existing records. [2025-10-21T19:46:07.887085] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:07.899367] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-21T19:46:07.899559] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-21T19:46:07.899992] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-21T19:46:07.938101] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-21T19:46:07.993484] [DEBUG] [LOCAL ] LYG: Primary data saved (52661 records). [2025-10-21T19:46:08.028694] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-21T19:46:08.042857] [INFO ] [MAIN ] Update Progress: 1290/2366 symbols completed. LYG took 34.4s. Estimated remaining: 2h 18m 31s. Rate: 7.8 symbols/min [2025-10-21T19:46:08.429279] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:08.569289] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:08.569871] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-21T19:46:08.610817] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T19:46:08.662908] [DEBUG] [LOCAL ] M: Loaded 53544 existing records from primary storage. [2025-10-21T19:46:08.663236] [INFO ] [MAIN ] M: Loaded 53544 existing records. [2025-10-21T19:46:08.844192] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:08.844512] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-21T19:46:08.844602] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-21T19:46:08.844834] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-21T19:46:08.844890] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-21T19:46:08.952419] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-21T19:46:09.165626] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T19:46:09.252719] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:09.363619] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T19:46:09.751024] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-21T19:46:10.551039] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-21T19:46:10.723346] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T19:46:11.200179] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:46:11.351038] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-21T19:46:12.075980] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T19:46:12.150980] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-21T19:46:12.330201] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:46:12.951033] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-21T19:46:13.597177] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T19:46:13.751002] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-21T19:46:14.246401] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T19:46:14.551053] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-21T19:46:15.351001] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-21T19:46:15.445422] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T19:46:16.007985] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:46:16.151041] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-21T19:46:16.951050] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-21T19:46:17.089832] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:46:17.604316] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T19:46:17.751063] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-21T19:46:18.551058] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-21T19:46:18.723882] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T19:46:18.964759] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T19:46:19.351085] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-21T19:46:19.660977] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T19:46:19.668718] [INFO ] [REMOTE ] LZB: Full fetch complete (50971 records). [2025-10-21T19:46:19.668882] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-21T19:46:20.056042] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-21T19:46:20.056154] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-21T19:46:20.057053] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-21T19:46:20.057133] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-21T19:46:20.058282] [DEBUG] [LOCAL ] LZB: Trimmed 50971 records to 35070 (keeping 200 days of data) [2025-10-21T19:46:20.152353] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-21T19:46:20.172815] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T19:46:20.292274] [DEBUG] [LOCAL ] LZB: Primary data saved (35070 records). [2025-10-21T19:46:20.292413] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-21T19:46:20.292921] [INFO ] [MAIN ] Update Progress: 1291/2366 symbols completed. LZB took 24.9s. Estimated remaining: 2h 18m 27s. Rate: 7.8 symbols/min [2025-10-21T19:46:20.461020] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:20.511999] [DEBUG] [LOCAL ] MA: Loaded 52467 existing records from primary storage. [2025-10-21T19:46:20.512318] [INFO ] [MAIN ] MA: Loaded 52467 existing records. [2025-10-21T19:46:20.698347] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:20.699342] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-21T19:46:20.699400] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-21T19:46:20.700335] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-21T19:46:20.700391] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-21T19:46:20.953265] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-21T19:46:21.067423] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:21.088777] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T19:46:21.096950] [INFO ] [REMOTE ] LYV: Full fetch complete (74119 records). [2025-10-21T19:46:21.097093] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-21T19:46:21.481487] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-21T19:46:21.481561] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-21T19:46:21.482604] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-21T19:46:21.482696] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-21T19:46:21.484114] [DEBUG] [LOCAL ] LYV: Trimmed 74119 records to 51013 (keeping 200 days of data) [2025-10-21T19:46:21.752139] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-21T19:46:21.792840] [DEBUG] [LOCAL ] LYV: Primary data saved (51013 records). [2025-10-21T19:46:21.792955] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-21T19:46:21.793030] [INFO ] [MAIN ] Update Progress: 1292/2366 symbols completed. LYV took 30.9s. Estimated remaining: 2h 18m 14s. Rate: 7.8 symbols/min [2025-10-21T19:46:21.963815] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:22.006492] [DEBUG] [LOCAL ] MAA: Loaded 42908 existing records from primary storage. [2025-10-21T19:46:22.006804] [INFO ] [MAIN ] MAA: Loaded 42908 existing records. [2025-10-21T19:46:22.183136] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:22.183334] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-21T19:46:22.183380] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-21T19:46:22.183581] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-21T19:46:22.183636] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-21T19:46:22.541757] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:22.550976] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-21T19:46:22.584588] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T19:46:22.929358] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T19:46:23.351058] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-21T19:46:24.151002] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-21T19:46:24.194257] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T19:46:24.923897] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T19:46:24.950976] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-21T19:46:25.248794] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T19:46:25.746702] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:46:25.750972] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-21T19:46:26.555166] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-21T19:46:26.556121] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T19:46:27.351022] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-21T19:46:27.856210] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T19:46:28.151088] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-21T19:46:28.865420] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T19:46:28.951015] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-21T19:46:29.751062] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-21T19:46:30.087082] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T19:46:30.551052] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-21T19:46:30.714160] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T19:46:30.856423] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T19:46:31.351059] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-21T19:46:32.150993] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-21T19:46:32.483968] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T19:46:32.485198] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T19:46:32.500625] [INFO ] [REMOTE ] LZM: Full fetch complete (19809 records). [2025-10-21T19:46:32.501141] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-21T19:46:32.863982] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-21T19:46:32.864073] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-21T19:46:32.864495] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-21T19:46:32.864544] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-21T19:46:32.865122] [DEBUG] [LOCAL ] LZM: Trimmed 19809 records to 14736 (keeping 200 days of data) [2025-10-21T19:46:32.944165] [DEBUG] [LOCAL ] LZM: Primary data saved (14736 records). [2025-10-21T19:46:32.944293] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-21T19:46:32.944367] [INFO ] [MAIN ] Update Progress: 1293/2366 symbols completed. LZM took 25.7s. Estimated remaining: 2h 18m 9s. Rate: 7.8 symbols/min [2025-10-21T19:46:32.956231] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-21T19:46:33.114732] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:33.160764] [DEBUG] [LOCAL ] MAC: Loaded 49690 existing records from primary storage. [2025-10-21T19:46:33.161054] [INFO ] [MAIN ] MAC: Loaded 49690 existing records. [2025-10-21T19:46:33.335555] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:33.335817] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-21T19:46:33.335881] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-21T19:46:33.336111] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-21T19:46:33.336194] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-21T19:46:33.690633] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:33.750988] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-21T19:46:34.179435] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T19:46:34.550994] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-21T19:46:34.652377] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:46:35.082307] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T19:46:35.351025] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-21T19:46:36.150987] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-21T19:46:36.407912] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:46:36.925086] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T19:46:36.950977] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-21T19:46:37.751014] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-21T19:46:38.274386] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T19:46:38.551059] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-21T19:46:38.672545] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T19:46:39.351030] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-21T19:46:39.707436] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T19:46:40.150984] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-21T19:46:40.251922] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T19:46:40.955166] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-21T19:46:40.960614] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:46:41.751056] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-21T19:46:42.101580] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T19:46:42.110220] [INFO ] [REMOTE ] M: Full fetch complete (77658 records). [2025-10-21T19:46:42.110349] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-21T19:46:42.505302] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-21T19:46:42.505416] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-21T19:46:42.506683] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-21T19:46:42.506830] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-21T19:46:42.508409] [DEBUG] [LOCAL ] M: Trimmed 77658 records to 53544 (keeping 200 days of data) [2025-10-21T19:46:42.565135] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-21T19:46:42.856242] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T19:46:42.886688] [DEBUG] [LOCAL ] M: Primary data saved (53544 records). [2025-10-21T19:46:42.886807] [INFO ] [MAIN ] M: Full history saved. [2025-10-21T19:46:42.886878] [INFO ] [MAIN ] Update Progress: 1294/2366 symbols completed. M took 34.8s. Estimated remaining: 2h 18m 3s. Rate: 7.8 symbols/min [2025-10-21T19:46:43.058789] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:43.095526] [DEBUG] [LOCAL ] MAGN: Loaded 36341 existing records from primary storage. [2025-10-21T19:46:43.095845] [INFO ] [MAIN ] MAGN: Loaded 36341 existing records. [2025-10-21T19:46:43.282378] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:43.282636] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-21T19:46:43.282786] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-21T19:46:43.282985] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-21T19:46:43.283040] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-21T19:46:43.355030] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-21T19:46:43.605925] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T19:46:43.697786] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:44.150997] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-10-21T19:46:44.760354] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-21T19:46:44.772829] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:46:44.951099] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-21T19:46:45.756208] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-21T19:46:45.780915] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T19:46:45.848094] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T19:46:46.551066] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-21T19:46:47.296704] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T19:46:47.351097] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-10-21T19:46:48.001484] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T19:46:48.151032] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-21T19:46:48.944042] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:46:48.954178] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-21T19:46:49.481371] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T19:46:49.751079] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-10-21T19:46:50.280899] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T19:46:50.551026] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-21T19:46:51.165957] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:46:51.351060] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-10-21T19:46:52.143490] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T19:46:52.153007] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-21T19:46:52.951063] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-21T19:46:53.092302] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:46:53.751159] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-10. [2025-10-21T19:46:53.975153] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T19:46:54.301361] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T19:46:54.551038] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-21T19:46:55.221176] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T19:46:55.228928] [INFO ] [REMOTE ] MAC: Full fetch complete (71587 records). [2025-10-21T19:46:55.229043] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-10-21T19:46:55.365593] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-21T19:46:55.619453] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-10-21T19:46:55.619552] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-10-21T19:46:55.620678] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-10-21T19:46:55.620772] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-10-21T19:46:55.622147] [DEBUG] [LOCAL ] MAC: Trimmed 71587 records to 49653 (keeping 200 days of data) [2025-10-21T19:46:55.921891] [DEBUG] [LOCAL ] MAC: Primary data saved (49653 records). [2025-10-21T19:46:55.922028] [INFO ] [MAIN ] MAC: Full history saved. [2025-10-21T19:46:55.922558] [INFO ] [MAIN ] Update Progress: 1295/2366 symbols completed. MAC took 23.0s. Estimated remaining: 2h 18m 0s. Rate: 7.8 symbols/min [2025-10-21T19:46:56.088953] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:46:56.128609] [DEBUG] [LOCAL ] MAIN: Loaded 41956 existing records from primary storage. [2025-10-21T19:46:56.129014] [INFO ] [MAIN ] MAIN: Loaded 41956 existing records. [2025-10-21T19:46:56.160797] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-21T19:46:56.315836] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:46:56.316035] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-21T19:46:56.316094] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-21T19:46:56.316292] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-21T19:46:56.316332] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-21T19:46:56.679169] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:46:56.795382] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-21T19:46:56.882111] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:46:56.951006] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-21T19:46:57.751060] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-21T19:46:57.779512] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T19:46:58.323960] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T19:46:58.551058] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-21T19:46:59.351017] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-21T19:46:59.462889] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T19:46:59.938503] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:47:00.151057] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-21T19:47:00.951067] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-21T19:47:01.759256] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-21T19:47:01.762317] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-21T19:47:01.926463] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T19:47:02.551028] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-21T19:47:02.776725] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T19:47:02.785040] [INFO ] [REMOTE ] MAA: Full fetch complete (61774 records). [2025-10-21T19:47:02.785315] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-21T19:47:03.213220] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-21T19:47:03.213415] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-21T19:47:03.215263] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-21T19:47:03.215445] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-21T19:47:03.236729] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T19:47:03.244716] [DEBUG] [LOCAL ] MAA: Trimmed 61774 records to 42974 (keeping 200 days of data) [2025-10-21T19:47:03.358136] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-21T19:47:03.547509] [DEBUG] [LOCAL ] MAA: Primary data saved (42974 records). [2025-10-21T19:47:03.547777] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-21T19:47:03.547934] [INFO ] [MAIN ] Update Progress: 1296/2366 symbols completed. MAA took 41.8s. Estimated remaining: 2h 17m 52s. Rate: 7.8 symbols/min [2025-10-21T19:47:03.747269] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:03.794635] [DEBUG] [LOCAL ] MAN: Loaded 44330 existing records from primary storage. [2025-10-21T19:47:03.795069] [INFO ] [MAIN ] MAN: Loaded 44330 existing records. [2025-10-21T19:47:03.982686] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:03.982979] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-21T19:47:03.983030] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-21T19:47:03.983301] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-21T19:47:03.983359] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-21T19:47:04.159465] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-21T19:47:04.422148] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:04.543820] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-21T19:47:04.552324] [INFO ] [REMOTE ] MA: Full fetch complete (76406 records). [2025-10-21T19:47:04.552468] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-21T19:47:04.944116] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-21T19:47:04.944193] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-21T19:47:04.945271] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-21T19:47:04.945332] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-21T19:47:04.946782] [DEBUG] [LOCAL ] MA: Trimmed 76406 records to 52465 (keeping 200 days of data) [2025-10-21T19:47:05.003612] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-21T19:47:05.284490] [DEBUG] [LOCAL ] MA: Primary data saved (52465 records). [2025-10-21T19:47:05.284633] [INFO ] [MAIN ] MA: Full history saved. [2025-10-21T19:47:05.285447] [INFO ] [MAIN ] Update Progress: 1297/2366 symbols completed. MA took 45.0s. Estimated remaining: 2h 17m 40s. Rate: 7.8 symbols/min [2025-10-21T19:47:05.527945] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:05.552862] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T19:47:05.589730] [DEBUG] [LOCAL ] MANU: Loaded 27281 existing records from primary storage. [2025-10-21T19:47:05.590139] [INFO ] [MAIN ] MANU: Loaded 27281 existing records. [2025-10-21T19:47:05.756714] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-21T19:47:05.779405] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:05.781221] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-21T19:47:05.781309] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-21T19:47:05.781576] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-21T19:47:05.781669] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-21T19:47:06.099497] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-21T19:47:06.186391] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:06.551023] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-21T19:47:06.593802] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T19:47:07.351056] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-21T19:47:07.489101] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T19:47:07.496599] [INFO ] [REMOTE ] MAGN: Full fetch complete (51907 records). [2025-10-21T19:47:07.496822] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-21T19:47:07.890075] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-21T19:47:07.890163] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-21T19:47:07.891060] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-21T19:47:07.891127] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-21T19:47:07.892206] [DEBUG] [LOCAL ] MAGN: Trimmed 51907 records to 36252 (keeping 200 days of data) [2025-10-21T19:47:08.102272] [DEBUG] [LOCAL ] MAGN: Primary data saved (36252 records). [2025-10-21T19:47:08.102420] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-21T19:47:08.102503] [INFO ] [MAIN ] Update Progress: 1298/2366 symbols completed. MAGN took 25.2s. Estimated remaining: 2h 17m 28s. Rate: 7.8 symbols/min [2025-10-21T19:47:08.161846] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-21T19:47:08.308669] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:08.341506] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:47:08.396721] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T19:47:08.427106] [DEBUG] [LOCAL ] MAS: Loaded 52281 existing records from primary storage. [2025-10-21T19:47:08.427558] [INFO ] [MAIN ] MAS: Loaded 52281 existing records. [2025-10-21T19:47:08.677802] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:08.678039] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-21T19:47:08.678113] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-21T19:47:08.678370] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-21T19:47:08.678429] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-21T19:47:08.956345] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-21T19:47:09.261874] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:09.296397] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T19:47:09.751040] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-21T19:47:09.821711] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T19:47:10.551012] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-21T19:47:11.308963] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:47:11.350992] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-21T19:47:12.150995] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-21T19:47:12.283471] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T19:47:12.745440] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T19:47:12.950989] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-21T19:47:13.062532] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T19:47:13.750993] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-21T19:47:14.551051] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-21T19:47:14.596031] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:47:14.959287] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T19:47:15.351040] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-21T19:47:16.004963] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T19:47:16.151466] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-21T19:47:16.615395] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T19:47:16.951073] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-21T19:47:17.748756] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T19:47:17.757721] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-21T19:47:18.391071] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:47:18.551033] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-21T19:47:19.351069] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-21T19:47:19.581160] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T19:47:19.853636] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T19:47:20.151024] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-21T19:47:20.843972] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T19:47:20.951071] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-21T19:47:21.751034] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-21T19:47:21.959266] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:47:22.039998] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T19:47:22.551040] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-21T19:47:23.071569] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T19:47:23.351026] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-21T19:47:23.928004] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:47:24.151044] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-21T19:47:24.930353] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T19:47:24.950981] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-21T19:47:25.489510] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T19:47:25.751092] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-21T19:47:26.551074] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-21T19:47:26.603723] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:47:27.318953] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T19:47:27.324123] [INFO ] [REMOTE ] MANU: Full fetch complete (39310 records). [2025-10-21T19:47:27.324249] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-21T19:47:27.356165] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-21T19:47:27.717330] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-21T19:47:27.717430] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-21T19:47:27.718261] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-21T19:47:27.718322] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-21T19:47:27.719205] [DEBUG] [LOCAL ] MANU: Trimmed 39310 records to 27249 (keeping 200 days of data) [2025-10-21T19:47:27.874630] [DEBUG] [LOCAL ] MANU: Primary data saved (27249 records). [2025-10-21T19:47:27.874971] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-21T19:47:27.875120] [INFO ] [MAIN ] Update Progress: 1299/2366 symbols completed. MANU took 22.6s. Estimated remaining: 2h 17m 30s. Rate: 7.8 symbols/min [2025-10-21T19:47:28.046074] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:28.076960] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T19:47:28.116474] [DEBUG] [LOCAL ] MATV: Loaded 35365 existing records from primary storage. [2025-10-21T19:47:28.116778] [INFO ] [MAIN ] MATV: Loaded 35365 existing records. [2025-10-21T19:47:28.158717] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-21T19:47:28.293253] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:28.293511] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-21T19:47:28.293559] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-21T19:47:28.293778] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-21T19:47:28.293861] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-21T19:47:28.641447] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:28.951063] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-21T19:47:29.057735] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T19:47:29.751012] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-21T19:47:29.982876] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T19:47:30.281916] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T19:47:30.551068] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-21T19:47:31.350997] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-21T19:47:31.400746] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T19:47:32.150997] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-21T19:47:32.238461] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:47:32.753884] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T19:47:32.951025] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-21T19:47:33.610117] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T19:47:33.751073] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-21T19:47:34.551099] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-21T19:47:34.582267] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T19:47:34.589742] [INFO ] [REMOTE ] MAN: Full fetch complete (62812 records). [2025-10-21T19:47:34.589889] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-21T19:47:34.967449] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-21T19:47:34.967528] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-21T19:47:34.968490] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-21T19:47:34.968551] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-21T19:47:34.969760] [DEBUG] [LOCAL ] MAN: Trimmed 62812 records to 44311 (keeping 200 days of data) [2025-10-21T19:47:35.228167] [DEBUG] [LOCAL ] MAN: Primary data saved (44311 records). [2025-10-21T19:47:35.228295] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-21T19:47:35.228373] [INFO ] [MAIN ] Update Progress: 1300/2366 symbols completed. MAN took 31.7s. Estimated remaining: 2h 17m 22s. Rate: 7.8 symbols/min [2025-10-21T19:47:35.354915] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-21T19:47:35.406848] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:35.434511] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T19:47:35.471960] [DEBUG] [LOCAL ] MATX: Loaded 32025 existing records from primary storage. [2025-10-21T19:47:35.472226] [INFO ] [MAIN ] MATX: Loaded 32025 existing records. [2025-10-21T19:47:35.649794] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:35.650021] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-21T19:47:35.650070] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-21T19:47:35.650277] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-21T19:47:35.650333] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-21T19:47:36.018608] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:36.151012] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-21T19:47:36.292354] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T19:47:36.735403] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T19:47:36.951002] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-21T19:47:37.303329] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T19:47:37.463896] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T19:47:37.472106] [INFO ] [REMOTE ] MAS: Full fetch complete (75366 records). [2025-10-21T19:47:37.472242] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-21T19:47:37.756144] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-21T19:47:37.862865] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-21T19:47:37.862945] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-21T19:47:37.864108] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-21T19:47:37.864175] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-21T19:47:37.865624] [DEBUG] [LOCAL ] MAS: Trimmed 75366 records to 52251 (keeping 200 days of data) [2025-10-21T19:47:38.177338] [DEBUG] [LOCAL ] MAS: Primary data saved (52251 records). [2025-10-21T19:47:38.177471] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-21T19:47:38.178255] [INFO ] [MAIN ] Update Progress: 1301/2366 symbols completed. MAS took 30.1s. Estimated remaining: 2h 17m 10s. Rate: 7.8 symbols/min [2025-10-21T19:47:38.346383] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:38.377837] [DEBUG] [LOCAL ] MAX: Loaded 30945 existing records from primary storage. [2025-10-21T19:47:38.378129] [INFO ] [MAIN ] MAX: Loaded 30945 existing records. [2025-10-21T19:47:38.566473] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-21T19:47:38.572479] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:38.572895] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-21T19:47:38.573795] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-21T19:47:38.574061] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-21T19:47:38.574118] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-21T19:47:38.932247] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:39.230038] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T19:47:39.351010] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-21T19:47:39.948377] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T19:47:40.151085] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-21T19:47:40.769901] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:47:40.951110] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-21T19:47:41.751001] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-21T19:47:42.049919] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:47:42.057257] [INFO ] [REMOTE ] MAIN: Full fetch complete (60409 records). [2025-10-21T19:47:42.057406] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-21T19:47:42.411174] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T19:47:42.483063] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-21T19:47:42.483149] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-21T19:47:42.484108] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-21T19:47:42.484173] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-21T19:47:42.485424] [DEBUG] [LOCAL ] MAIN: Trimmed 60409 records to 41978 (keeping 200 days of data) [2025-10-21T19:47:42.573000] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-21T19:47:42.745481] [DEBUG] [LOCAL ] MAIN: Primary data saved (41978 records). [2025-10-21T19:47:42.745608] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-21T19:47:42.746246] [INFO ] [MAIN ] Update Progress: 1302/2366 symbols completed. MAIN took 46.8s. Estimated remaining: 2h 17m 0s. Rate: 7.8 symbols/min [2025-10-21T19:47:42.914916] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:42.956997] [DEBUG] [LOCAL ] MBC: Loaded 43967 existing records from primary storage. [2025-10-21T19:47:42.957286] [INFO ] [MAIN ] MBC: Loaded 43967 existing records. [2025-10-21T19:47:43.139201] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:43.139508] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-21T19:47:43.157698] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-21T19:47:43.158061] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-21T19:47:43.158128] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-21T19:47:43.191525] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T19:47:43.357620] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-21T19:47:43.525754] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:43.897564] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T19:47:44.151038] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-21T19:47:44.616271] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T19:47:44.951071] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-21T19:47:45.704692] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T19:47:45.751057] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-21T19:47:46.469019] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T19:47:46.551129] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-21T19:47:47.282822] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T19:47:47.351117] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-21T19:47:48.114771] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T19:47:48.151002] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-21T19:47:48.827704] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T19:47:48.951026] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-21T19:47:49.556183] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T19:47:49.751141] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-21T19:47:50.232526] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T19:47:50.551031] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-21T19:47:51.175304] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T19:47:51.351028] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-21T19:47:51.833049] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T19:47:51.838067] [INFO ] [REMOTE ] MATV: Full fetch complete (52163 records). [2025-10-21T19:47:51.838167] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-21T19:47:52.156210] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-21T19:47:52.242454] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-21T19:47:52.242585] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-21T19:47:52.244794] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-21T19:47:52.244872] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-21T19:47:52.246801] [DEBUG] [LOCAL ] MATV: Trimmed 52163 records to 35183 (keeping 200 days of data) [2025-10-21T19:47:52.490709] [DEBUG] [LOCAL ] MATV: Primary data saved (35183 records). [2025-10-21T19:47:52.490983] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-21T19:47:52.491678] [INFO ] [MAIN ] Update Progress: 1303/2366 symbols completed. MATV took 24.6s. Estimated remaining: 2h 16m 54s. Rate: 7.8 symbols/min [2025-10-21T19:47:52.679113] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:47:52.702260] [DEBUG] [LOCAL ] MBI: Loaded 24304 existing records from primary storage. [2025-10-21T19:47:52.702544] [INFO ] [MAIN ] MBI: Loaded 24304 existing records. [2025-10-21T19:47:52.910895] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:47:52.933815] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:47:52.941837] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-21T19:47:52.942496] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-21T19:47:52.942833] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-21T19:47:52.942901] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-21T19:47:52.957723] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-21T19:47:53.309256] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:47:53.572561] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T19:47:53.751058] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-21T19:47:54.275307] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T19:47:54.551058] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-21T19:47:55.344037] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T19:47:55.352830] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-21T19:47:55.686069] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:47:56.151022] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-21T19:47:56.556933] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T19:47:56.951078] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-21T19:47:57.560236] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T19:47:57.751048] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-21T19:47:58.524225] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T19:47:58.550990] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-21T19:47:58.857515] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:47:59.351035] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-21T19:48:00.064449] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T19:48:00.151009] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-21T19:48:00.545917] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:48:00.951028] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-21T19:48:01.751118] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-21T19:48:01.932125] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T19:48:02.551068] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-21T19:48:02.763012] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T19:48:02.950099] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T19:48:03.351034] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-21T19:48:03.900896] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T19:48:04.151073] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-21T19:48:04.643609] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T19:48:04.951077] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-21T19:48:05.751008] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-21T19:48:05.789023] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T19:48:06.274417] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T19:48:06.551017] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-21T19:48:07.152310] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T19:48:07.351022] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-21T19:48:08.001283] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T19:48:08.006991] [INFO ] [REMOTE ] MATX: Full fetch complete (43858 records). [2025-10-21T19:48:08.007123] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-21T19:48:08.164235] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-21T19:48:08.461883] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-21T19:48:08.462812] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-21T19:48:08.464697] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-21T19:48:08.465695] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-21T19:48:08.465518] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T19:48:08.473535] [DEBUG] [LOCAL ] MATX: Trimmed 43858 records to 31987 (keeping 200 days of data) [2025-10-21T19:48:08.698201] [DEBUG] [LOCAL ] MATX: Primary data saved (31987 records). [2025-10-21T19:48:08.698309] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-21T19:48:08.698391] [INFO ] [MAIN ] Update Progress: 1304/2366 symbols completed. MATX took 33.5s. Estimated remaining: 2h 16m 53s. Rate: 7.8 symbols/min [2025-10-21T19:48:08.870369] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:08.870534] [DEBUG] [LOCAL ] MC: No existing data file found in primary storage. [2025-10-21T19:48:08.870571] [WARN ] [MAIN ] MC: No existing data found, performing full refresh instead. [2025-10-21T19:48:08.870772] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-21T19:48:08.870844] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-21T19:48:08.870900] [DEBUG] [LOCAL ] MC: No primary data file found to delete. [2025-10-21T19:48:08.870933] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-21T19:48:08.959838] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-21T19:48:09.225077] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:09.618614] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T19:48:09.624152] [INFO ] [REMOTE ] MAX: Full fetch complete (45191 records). [2025-10-21T19:48:09.624241] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-21T19:48:09.751617] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-21T19:48:09.964223] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T19:48:10.030034] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-21T19:48:10.030106] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-21T19:48:10.030945] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-21T19:48:10.031007] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-21T19:48:10.031849] [DEBUG] [LOCAL ] MAX: Trimmed 45191 records to 30845 (keeping 200 days of data) [2025-10-21T19:48:10.203693] [DEBUG] [LOCAL ] MAX: Primary data saved (30845 records). [2025-10-21T19:48:10.203814] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-21T19:48:10.203890] [INFO ] [MAIN ] Update Progress: 1305/2366 symbols completed. MAX took 32.0s. Estimated remaining: 2h 16m 40s. Rate: 7.8 symbols/min [2025-10-21T19:48:10.371546] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:10.384331] [DEBUG] [LOCAL ] MCB: Loaded 11359 existing records from primary storage. [2025-10-21T19:48:10.384535] [INFO ] [MAIN ] MCB: Loaded 11359 existing records. [2025-10-21T19:48:10.556416] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-21T19:48:10.561125] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:10.562128] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-21T19:48:10.562178] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-21T19:48:10.562521] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-21T19:48:10.562579] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-21T19:48:10.914706] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:11.351068] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-21T19:48:11.824864] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T19:48:12.150994] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-21T19:48:12.234415] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T19:48:12.951038] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-21T19:48:13.203220] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T19:48:13.693573] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T19:48:13.751002] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-21T19:48:14.551076] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-21T19:48:14.803169] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-21T19:48:15.351079] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-21T19:48:15.548401] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (4.99 seconds). [2025-10-21T19:48:15.845366] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T19:48:16.151027] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-21T19:48:16.334748] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T19:48:16.951051] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-21T19:48:17.670015] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T19:48:17.738736] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:48:17.750991] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-21T19:48:18.551083] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-21T19:48:19.349502] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T19:48:19.359217] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-21T19:48:20.151006] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-21T19:48:20.197057] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T19:48:20.951064] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-21T19:48:20.959276] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T19:48:21.429416] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T19:48:21.751066] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-21T19:48:22.551049] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-21T19:48:22.635621] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:48:23.351100] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-21T19:48:23.390349] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T19:48:23.399128] [INFO ] [REMOTE ] MBC: Full fetch complete (63082 records). [2025-10-21T19:48:23.399381] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-21T19:48:23.693823] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T19:48:23.731243] [INFO ] [REMOTE ] MBI: Full fetch complete (36081 records). [2025-10-21T19:48:23.746594] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-21T19:48:24.087069] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-21T19:48:24.089431] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-21T19:48:24.098991] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-21T19:48:24.115514] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-21T19:48:24.156239] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-21T19:48:24.217516] [DEBUG] [LOCAL ] MBC: Trimmed 63082 records to 43908 (keeping 200 days of data) [2025-10-21T19:48:24.423961] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-21T19:48:24.437015] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-21T19:48:24.438259] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-21T19:48:24.446152] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-21T19:48:24.460261] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T19:48:24.559234] [DEBUG] [LOCAL ] MBI: Trimmed 36081 records to 24151 (keeping 200 days of data) [2025-10-21T19:48:24.662765] [DEBUG] [LOCAL ] MBC: Primary data saved (43908 records). [2025-10-21T19:48:24.688696] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-21T19:48:24.689089] [INFO ] [MAIN ] Update Progress: 1306/2366 symbols completed. MBC took 41.9s. Estimated remaining: 2h 16m 38s. Rate: 7.8 symbols/min [2025-10-21T19:48:24.852086] [DEBUG] [LOCAL ] MBI: Primary data saved (24151 records). [2025-10-21T19:48:24.862507] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-21T19:48:24.867799] [INFO ] [MAIN ] Update Progress: 1307/2366 symbols completed. MBI took 32.4s. Estimated remaining: 2h 16m 24s. Rate: 7.8 symbols/min [2025-10-21T19:48:24.956237] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-21T19:48:25.002857] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:25.025683] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-21T19:48:25.025855] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-21T19:48:25.026327] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-21T19:48:25.053005] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-21T19:48:25.072800] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-21T19:48:25.099708] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:25.099791] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-21T19:48:25.208291] [DEBUG] [LOCAL ] MCI: Loaded 6235 existing records from primary storage. [2025-10-21T19:48:25.224186] [INFO ] [MAIN ] MCI: Loaded 6235 existing records. [2025-10-21T19:48:25.631967] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:25.660258] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:25.660706] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-21T19:48:25.661097] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-21T19:48:25.661488] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-21T19:48:25.661637] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-21T19:48:25.754207] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-21T19:48:25.772459] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T19:48:26.052322] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T19:48:26.074334] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:26.551082] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-21T19:48:27.351036] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-21T19:48:27.711429] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T19:48:27.842119] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T19:48:28.126683] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T19:48:28.150983] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-21T19:48:28.822516] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T19:48:28.824728] [INFO ] [REMOTE ] MCB: Full fetch complete (16652 records). [2025-10-21T19:48:28.824795] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-21T19:48:28.963683] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-21T19:48:29.189975] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-21T19:48:29.190053] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-21T19:48:29.190506] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-21T19:48:29.190566] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-21T19:48:29.191163] [DEBUG] [LOCAL ] MCB: Trimmed 16652 records to 11340 (keeping 200 days of data) [2025-10-21T19:48:29.259146] [DEBUG] [LOCAL ] MCB: Primary data saved (11340 records). [2025-10-21T19:48:29.259275] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-21T19:48:29.259348] [INFO ] [MAIN ] Update Progress: 1308/2366 symbols completed. MCB took 19.1s. Estimated remaining: 2h 16m 14s. Rate: 7.8 symbols/min [2025-10-21T19:48:29.431686] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:29.468121] [DEBUG] [LOCAL ] MCK: Loaded 38322 existing records from primary storage. [2025-10-21T19:48:29.468393] [INFO ] [MAIN ] MCK: Loaded 38322 existing records. [2025-10-21T19:48:29.649171] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:29.649378] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-21T19:48:29.649428] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-21T19:48:29.650443] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-21T19:48:29.650501] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-21T19:48:29.755871] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-21T19:48:30.035310] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:30.550996] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-21T19:48:30.585409] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T19:48:30.782786] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T19:48:31.351040] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-21T19:48:32.151560] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-21T19:48:32.153908] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T19:48:32.951013] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-21T19:48:33.305614] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-21T19:48:33.702944] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T19:48:33.730242] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T19:48:33.750990] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-21T19:48:34.551040] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-21T19:48:35.298455] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T19:48:35.350992] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-21T19:48:36.150997] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-21T19:48:36.554275] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T19:48:36.897306] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T19:48:36.908266] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T19:48:36.911752] [INFO ] [REMOTE ] MC: Full fetch complete (63101 records). [2025-10-21T19:48:36.911965] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-21T19:48:36.956206] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-21T19:48:37.372130] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-21T19:48:37.372270] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-21T19:48:37.374101] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-21T19:48:37.374220] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-21T19:48:37.376057] [DEBUG] [LOCAL ] MC: Trimmed 63101 records to 43725 (keeping 200 days of data) [2025-10-21T19:48:37.648541] [DEBUG] [LOCAL ] MC: Primary data saved (43725 records). [2025-10-21T19:48:37.648713] [INFO ] [MAIN ] MC: Full history saved. [2025-10-21T19:48:37.648797] [INFO ] [MAIN ] Update Progress: 1309/2366 symbols completed. MC took 29.0s. Estimated remaining: 2h 16m 7s. Rate: 7.8 symbols/min [2025-10-21T19:48:37.756235] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-21T19:48:37.821867] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:37.832449] [DEBUG] [LOCAL ] MCN: Loaded 8069 existing records from primary storage. [2025-10-21T19:48:37.832710] [INFO ] [MAIN ] MCN: Loaded 8069 existing records. [2025-10-21T19:48:38.013501] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:38.013767] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-21T19:48:38.013816] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-21T19:48:38.013975] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-21T19:48:38.014029] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-21T19:48:38.368356] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:38.551072] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-21T19:48:39.189205] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-21T19:48:39.351066] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-21T19:48:39.396700] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T19:48:39.398523] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:48:40.151077] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-21T19:48:40.951039] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-21T19:48:41.305563] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T19:48:41.667682] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T19:48:41.751098] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-21T19:48:41.947556] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:48:42.551088] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-21T19:48:42.579088] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T19:48:43.293665] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T19:48:43.350986] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-21T19:48:44.085252] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T19:48:44.151003] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-21T19:48:44.858893] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T19:48:44.951003] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-21T19:48:45.754057] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T19:48:45.751109] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-21T19:48:46.551043] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-21T19:48:47.351078] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-21T19:48:47.365726] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T19:48:47.962146] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T19:48:48.151026] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-21T19:48:48.951023] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-21T19:48:49.058475] [DEBUG] [REMOTE ] MCN: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-21T19:48:49.058867] [WARN ] [REMOTE ] MCN: No data returned for month 2025-06 [2025-10-21T19:48:49.058961] [FATAL] [REMOTE ] MCN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:48:49.059038] [FATAL] [MAIN ] MCN: Failed to fetch primary data. [2025-10-21T19:48:49.059073] [WARN ] [MAIN ] MCN: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:48:49.059125] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-21T19:48:49.059204] [DEBUG] [LOCAL ] MCN: No primary data file found to delete. [2025-10-21T19:48:49.059241] [INFO ] [LOCAL ] MCN: Starting deletion of derivative data. [2025-10-21T19:48:49.059385] [DEBUG] [LOCAL ] MCN: Deleted derivative data file. [2025-10-21T19:48:49.059485] [INFO ] [MAIN ] Update Progress: 1310/2366 symbols completed. MCN took 11.4s. Estimated remaining: 2h 16m 2s. Rate: 7.8 symbols/min [2025-10-21T19:48:49.245867] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:49.246055] [DEBUG] [LOCAL ] MCO: No existing data file found in primary storage. [2025-10-21T19:48:49.246093] [WARN ] [MAIN ] MCO: No existing data found, performing full refresh instead. [2025-10-21T19:48:49.246207] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-21T19:48:49.246248] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-21T19:48:49.246292] [DEBUG] [LOCAL ] MCO: No primary data file found to delete. [2025-10-21T19:48:49.246325] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-21T19:48:49.381365] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T19:48:49.649031] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:49.750996] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-21T19:48:50.471237] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-21T19:48:50.550986] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-21T19:48:51.273345] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T19:48:51.351033] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-21T19:48:52.151067] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-21T19:48:52.679559] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T19:48:52.913544] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T19:48:52.951015] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-21T19:48:53.388795] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T19:48:53.751089] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-21T19:48:54.551026] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-21T19:48:54.649066] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:48:55.135016] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T19:48:55.351150] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-21T19:48:55.855629] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-21T19:48:55.964446] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:48:56.151051] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-21T19:48:56.951107] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-21T19:48:57.173039] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T19:48:57.181696] [INFO ] [REMOTE ] MCD: Full fetch complete (77139 records). [2025-10-21T19:48:57.181846] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-21T19:48:57.377704] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T19:48:57.378630] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:48:57.378865] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:48:57.379003] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-21T19:48:57.379130] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-21T19:48:57.379229] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-21T19:48:57.379310] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-21T19:48:57.379398] [INFO ] [MAIN ] Update Progress: 1311/2366 symbols completed. MCD took 32.7s. Estimated remaining: 2h 15m 55s. Rate: 7.8 symbols/min [2025-10-21T19:48:57.430021] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T19:48:57.564227] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:48:57.574325] [DEBUG] [LOCAL ] MCR: Loaded 8879 existing records from primary storage. [2025-10-21T19:48:57.574512] [INFO ] [MAIN ] MCR: Loaded 8879 existing records. [2025-10-21T19:48:57.749209] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:48:57.749424] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-21T19:48:57.749481] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-21T19:48:57.749670] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-21T19:48:57.749732] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-21T19:48:57.760509] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-21T19:48:58.103068] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:48:58.551089] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-21T19:48:59.351142] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-21T19:48:59.353926] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T19:49:00.151037] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-21T19:49:00.214223] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T19:49:00.265679] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T19:49:00.951029] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-21T19:49:01.019353] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:49:01.020848] [INFO ] [REMOTE ] MCI: Full fetch complete (9810 records). [2025-10-21T19:49:01.020919] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-21T19:49:01.376731] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-21T19:49:01.376810] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-21T19:49:01.377049] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-21T19:49:01.377086] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-21T19:49:01.377480] [DEBUG] [LOCAL ] MCI: Trimmed 9810 records to 6222 (keeping 200 days of data) [2025-10-21T19:49:01.414412] [DEBUG] [LOCAL ] MCI: Primary data saved (6222 records). [2025-10-21T19:49:01.414507] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-21T19:49:01.414585] [INFO ] [MAIN ] Update Progress: 1312/2366 symbols completed. MCI took 36.5s. Estimated remaining: 2h 15m 44s. Rate: 7.8 symbols/min [2025-10-21T19:49:01.607960] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:01.629316] [DEBUG] [LOCAL ] MCS: Loaded 21228 existing records from primary storage. [2025-10-21T19:49:01.629547] [INFO ] [MAIN ] MCS: Loaded 21228 existing records. [2025-10-21T19:49:01.753741] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-21T19:49:01.788932] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T19:49:01.822102] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:01.822272] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-21T19:49:01.822317] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-21T19:49:01.822487] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-21T19:49:01.822541] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-21T19:49:02.184038] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:02.551072] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-21T19:49:03.335509] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T19:49:03.351032] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-21T19:49:03.707054] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T19:49:04.151004] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-21T19:49:04.446279] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T19:49:04.951070] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-21T19:49:04.966854] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T19:49:05.751025] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-21T19:49:06.457593] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T19:49:06.551017] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-21T19:49:06.777544] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T19:49:07.351066] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-21T19:49:08.107515] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:49:08.151060] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-21T19:49:08.954081] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-21T19:49:08.960091] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T19:49:09.017225] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T19:49:09.751045] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-21T19:49:10.414634] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T19:49:10.513835] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T19:49:10.550982] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-21T19:49:11.316000] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T19:49:11.350997] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-21T19:49:12.127991] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T19:49:12.150988] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-21T19:49:12.951007] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-21T19:49:13.751009] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-21T19:49:13.842359] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:49:13.865481] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T19:49:14.551099] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-21T19:49:15.315948] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T19:49:15.351309] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-21T19:49:15.970909] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T19:49:16.092029] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T19:49:16.097454] [INFO ] [REMOTE ] MCK: Full fetch complete (56708 records). [2025-10-21T19:49:16.097580] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-21T19:49:16.159981] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-21T19:49:16.508554] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-21T19:49:16.508637] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-21T19:49:16.509706] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-21T19:49:16.509770] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-21T19:49:16.510935] [DEBUG] [LOCAL ] MCK: Trimmed 56708 records to 38187 (keeping 200 days of data) [2025-10-21T19:49:16.759186] [DEBUG] [LOCAL ] MCK: Primary data saved (38187 records). [2025-10-21T19:49:16.759334] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-21T19:49:16.759417] [INFO ] [MAIN ] Update Progress: 1313/2366 symbols completed. MCK took 47.5s. Estimated remaining: 2h 15m 42s. Rate: 7.8 symbols/min [2025-10-21T19:49:16.943186] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:16.943754] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T19:49:16.946535] [INFO ] [REMOTE ] MCR: Full fetch complete (13487 records). [2025-10-21T19:49:16.946682] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-21T19:49:16.952311] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-21T19:49:17.132315] [DEBUG] [LOCAL ] MCY: Loaded 23809 existing records from primary storage. [2025-10-21T19:49:17.159317] [INFO ] [MAIN ] MCY: Loaded 23809 existing records. [2025-10-21T19:49:17.545303] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-21T19:49:17.537449] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:17.545458] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-21T19:49:17.546029] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-21T19:49:17.546116] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-21T19:49:17.545618] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-21T19:49:17.546240] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-21T19:49:17.546809] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-10-21T19:49:17.546890] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-21T19:49:17.546999] [DEBUG] [LOCAL ] MCR: Trimmed 13487 records to 8854 (keeping 200 days of data) [2025-10-21T19:49:17.753781] [DEBUG] [LOCAL ] MCR: Primary data saved (8854 records). [2025-10-21T19:49:17.778563] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-21T19:49:17.778431] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-21T19:49:17.794067] [INFO ] [MAIN ] Update Progress: 1314/2366 symbols completed. MCR took 20.4s. Estimated remaining: 2h 15m 29s. Rate: 7.8 symbols/min [2025-10-21T19:49:18.060363] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:18.127496] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T19:49:18.195807] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:18.237164] [DEBUG] [LOCAL ] MD: Loaded 38589 existing records from primary storage. [2025-10-21T19:49:18.237480] [INFO ] [MAIN ] MD: Loaded 38589 existing records. [2025-10-21T19:49:18.416123] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:18.416348] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-21T19:49:18.416407] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-21T19:49:18.416621] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-21T19:49:18.416713] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-21T19:49:18.557126] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-21T19:49:18.782197] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:19.350987] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-21T19:49:20.120884] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T19:49:20.150987] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-21T19:49:20.275327] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T19:49:20.720100] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T19:49:20.951135] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-21T19:49:21.751079] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-21T19:49:22.032972] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T19:49:22.040106] [INFO ] [REMOTE ] MCO: Full fetch complete (58204 records). [2025-10-21T19:49:22.040212] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-21T19:49:22.440110] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-21T19:49:22.440220] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-21T19:49:22.441298] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-21T19:49:22.441407] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-21T19:49:22.463470] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T19:49:22.463605] [DEBUG] [LOCAL ] MCO: Trimmed 58204 records to 39453 (keeping 200 days of data) [2025-10-21T19:49:22.560040] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-21T19:49:22.716491] [DEBUG] [LOCAL ] MCO: Primary data saved (39453 records). [2025-10-21T19:49:22.716627] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-21T19:49:22.716734] [INFO ] [MAIN ] Update Progress: 1315/2366 symbols completed. MCO took 33.7s. Estimated remaining: 2h 15m 19s. Rate: 7.8 symbols/min [2025-10-21T19:49:22.872577] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T19:49:22.910107] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:22.918556] [DEBUG] [LOCAL ] MDST: Loaded 6125 existing records from primary storage. [2025-10-21T19:49:22.918791] [INFO ] [MAIN ] MDST: Loaded 6125 existing records. [2025-10-21T19:49:23.101218] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:23.101436] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-21T19:49:23.101488] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-21T19:49:23.101687] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-21T19:49:23.101745] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-21T19:49:23.356223] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-21T19:49:23.467692] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:23.899901] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T19:49:24.151007] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-21T19:49:24.408600] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T19:49:24.951120] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-21T19:49:25.533269] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T19:49:25.629727] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T19:49:25.751077] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-21T19:49:26.551102] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-21T19:49:27.124063] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T19:49:27.351024] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-21T19:49:27.680769] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T19:49:28.151074] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-21T19:49:28.924054] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T19:49:28.950991] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-21T19:49:29.347267] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T19:49:29.751073] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-21T19:49:30.374804] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T19:49:30.551022] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-21T19:49:30.852721] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T19:49:31.165165] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T19:49:31.351066] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-21T19:49:32.151094] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-21T19:49:32.875187] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T19:49:32.950997] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-21T19:49:33.307417] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T19:49:33.311536] [INFO ] [REMOTE ] MCS: Full fetch complete (30669 records). [2025-10-21T19:49:33.311620] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-21T19:49:33.684569] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-21T19:49:33.684661] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-21T19:49:33.685291] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-21T19:49:33.685330] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-21T19:49:33.686035] [DEBUG] [LOCAL ] MCS: Trimmed 30669 records to 21229 (keeping 200 days of data) [2025-10-21T19:49:33.771026] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-21T19:49:33.811946] [DEBUG] [LOCAL ] MCS: Primary data saved (21229 records). [2025-10-21T19:49:33.812096] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-21T19:49:33.812177] [INFO ] [MAIN ] Update Progress: 1316/2366 symbols completed. MCS took 32.4s. Estimated remaining: 2h 15m 14s. Rate: 7.8 symbols/min [2025-10-21T19:49:33.981397] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:49:34.028796] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-21T19:49:34.029097] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-21T19:49:34.207303] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:49:34.207669] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-21T19:49:34.207771] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-21T19:49:34.213807] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-21T19:49:34.223513] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-21T19:49:34.256156] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:49:34.531159] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T19:49:34.556179] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-21T19:49:34.621465] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:49:35.351078] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-21T19:49:35.784164] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T19:49:35.916302] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:49:36.151059] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-21T19:49:36.951095] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-21T19:49:37.455720] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T19:49:37.513328] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T19:49:37.751087] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-21T19:49:38.310774] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T19:49:38.551021] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-21T19:49:39.351034] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-21T19:49:39.618179] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:49:40.151041] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-21T19:49:40.951075] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-21T19:49:41.174921] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T19:49:41.302425] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T19:49:41.751069] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-21T19:49:42.270418] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T19:49:42.516934] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T19:49:42.550994] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-21T19:49:43.351031] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-21T19:49:44.092710] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:49:44.150998] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-21T19:49:44.800489] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T19:49:44.950991] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-21T19:49:45.137766] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T19:49:45.751015] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-21T19:49:46.140901] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T19:49:46.144567] [INFO ] [REMOTE ] MCY: Full fetch complete (40860 records). [2025-10-21T19:49:46.144699] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-21T19:49:46.529196] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-21T19:49:46.529281] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-21T19:49:46.530179] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-21T19:49:46.530242] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-21T19:49:46.531277] [DEBUG] [LOCAL ] MCY: Trimmed 40860 records to 23711 (keeping 200 days of data) [2025-10-21T19:49:46.597523] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-21T19:49:46.690086] [DEBUG] [LOCAL ] MCY: Primary data saved (23711 records). [2025-10-21T19:49:46.690213] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-21T19:49:46.690291] [INFO ] [MAIN ] Update Progress: 1317/2366 symbols completed. MCY took 29.9s. Estimated remaining: 2h 15m 11s. Rate: 7.8 symbols/min [2025-10-21T19:49:47.351002] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-21T19:49:47.360852] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T19:49:47.672772] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T19:49:48.151062] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-21T19:49:48.854491] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T19:49:48.951161] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-21T19:49:48.985990] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:49:48.989321] [INFO ] [REMOTE ] MDST: Full fetch complete (8824 records). [2025-10-21T19:49:48.989453] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-21T19:49:49.507506] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-21T19:49:49.507585] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-21T19:49:49.507876] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-21T19:49:49.507939] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-21T19:49:49.508461] [DEBUG] [LOCAL ] MDST: Trimmed 8824 records to 6139 (keeping 200 days of data) [2025-10-21T19:49:49.548275] [DEBUG] [LOCAL ] MDST: Primary data saved (6139 records). [2025-10-21T19:49:49.548449] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-21T19:49:49.548547] [INFO ] [MAIN ] Update Progress: 1318/2366 symbols completed. MDST took 26.8s. Estimated remaining: 2h 14m 59s. Rate: 7.8 symbols/min [2025-10-21T19:49:49.751107] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-21T19:49:50.844490] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:49:50.856020] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-21T19:49:51.220257] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T19:49:51.351007] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-21T19:49:52.897104] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-21T19:49:52.909290] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-21T19:49:52.928012] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T19:49:52.935568] [INFO ] [REMOTE ] MD: Full fetch complete (55224 records). [2025-10-21T19:49:52.935752] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-21T19:49:53.324753] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-21T19:49:53.324843] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-21T19:49:53.325758] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-21T19:49:53.325820] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-21T19:49:53.327039] [DEBUG] [LOCAL ] MD: Trimmed 55224 records to 38586 (keeping 200 days of data) [2025-10-21T19:49:53.548867] [DEBUG] [LOCAL ] MD: Primary data saved (38586 records). [2025-10-21T19:49:53.549015] [INFO ] [MAIN ] MD: Full history saved. [2025-10-21T19:49:53.549332] [INFO ] [MAIN ] Update Progress: 1319/2366 symbols completed. MD took 35.7s. Estimated remaining: 2h 14m 48s. Rate: 7.8 symbols/min [2025-10-21T19:49:54.703518] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T19:49:54.714457] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-21T19:49:56.629973] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T19:49:56.641932] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-21T19:49:58.489482] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T19:49:58.500861] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-21T19:50:00.321703] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T19:50:00.333475] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-21T19:50:01.570611] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T19:50:01.579472] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-21T19:50:01.579682] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-21T19:50:01.978454] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-21T19:50:01.978534] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-21T19:50:01.979607] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-21T19:50:01.979695] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-21T19:50:01.981277] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-21T19:50:02.323293] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-21T19:50:02.323483] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-21T19:50:02.324062] [INFO ] [MAIN ] Update Progress: 1320/2366 symbols completed. MDT took 28.5s. Estimated remaining: 2h 14m 41s. Rate: 7.8 symbols/min [2025-10-21T19:50:02.988626] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:03.120916] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:03.102227] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:03.123429] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:03.135603] [DEBUG] [LOCAL ] MDV: Loaded 8358 existing records from primary storage. [2025-10-21T19:50:03.136011] [INFO ] [MAIN ] MDV: Loaded 8358 existing records. [2025-10-21T19:50:03.262516] [DEBUG] [LOCAL ] MEC: Loaded 16516 existing records from primary storage. [2025-10-21T19:50:03.289176] [INFO ] [MAIN ] MEC: Loaded 16516 existing records. [2025-10-21T19:50:03.283711] [DEBUG] [LOCAL ] MED: Loaded 21123 existing records from primary storage. [2025-10-21T19:50:03.354919] [INFO ] [MAIN ] MED: Loaded 21123 existing records. [2025-10-21T19:50:03.567989] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:03.630083] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-21T19:50:03.630156] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-21T19:50:03.631241] [DEBUG] [LOCAL ] MDU: Loaded 48046 existing records from primary storage. [2025-10-21T19:50:03.642265] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-21T19:50:03.677093] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-21T19:50:03.642211] [INFO ] [MAIN ] MDU: Loaded 48046 existing records. [2025-10-21T19:50:03.856978] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:03.907919] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-21T19:50:03.925086] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-21T19:50:03.970113] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:04.026032] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-21T19:50:04.070091] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-21T19:50:04.050257] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-21T19:50:04.113271] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-21T19:50:04.235677] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-21T19:50:04.343956] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-21T19:50:04.530123] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:04.640735] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-21T19:50:04.711108] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-21T19:50:04.838387] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:04.838587] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-21T19:50:04.855988] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-21T19:50:04.856113] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-21T19:50:05.061925] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:05.092306] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-21T19:50:05.540003] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:05.562094] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-21T19:50:05.638639] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:05.639327] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-21T19:50:05.768729] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T19:50:05.770623] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-21T19:50:06.197537] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T19:50:06.201148] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-21T19:50:06.394872] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:50:06.397025] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-21T19:50:06.666206] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T19:50:06.671583] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-21T19:50:06.984734] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T19:50:06.988245] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-21T19:50:07.223200] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T19:50:07.225996] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-21T19:50:07.310361] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:50:07.320516] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-21T19:50:07.695370] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T19:50:07.701533] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-21T19:50:07.767420] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T19:50:07.771843] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-21T19:50:08.014444] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T19:50:08.017104] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-21T19:50:08.705767] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T19:50:08.709547] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-21T19:50:08.802957] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:50:08.806567] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-21T19:50:08.859198] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T19:50:08.951629] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-21T19:50:08.951554] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T19:50:09.423846] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-21T19:50:09.573539] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T19:50:09.751017] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-21T19:50:10.321898] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T19:50:10.548543] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T19:50:10.551124] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-21T19:50:11.274414] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T19:50:11.351033] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-21T19:50:12.150997] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-21T19:50:12.388974] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T19:50:12.771223] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T19:50:12.951002] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-21T19:50:13.751040] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-21T19:50:13.990831] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T19:50:14.551060] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-21T19:50:14.661256] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T19:50:15.351036] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-21T19:50:15.615019] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T19:50:16.150999] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-21T19:50:16.213049] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T19:50:16.214607] [INFO ] [REMOTE ] MDV: Full fetch complete (11679 records). [2025-10-21T19:50:16.214699] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-21T19:50:16.580488] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-21T19:50:16.580578] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-21T19:50:16.580883] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-21T19:50:16.580942] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-21T19:50:16.581380] [DEBUG] [LOCAL ] MDV: Trimmed 11679 records to 8346 (keeping 200 days of data) [2025-10-21T19:50:16.632008] [DEBUG] [LOCAL ] MDV: Primary data saved (8346 records). [2025-10-21T19:50:16.632122] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-21T19:50:16.632196] [INFO ] [MAIN ] Update Progress: 1321/2366 symbols completed. MDV took 14.3s. Estimated remaining: 2h 14m 39s. Rate: 7.8 symbols/min [2025-10-21T19:50:16.805440] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:16.836418] [DEBUG] [LOCAL ] MEG: Loaded 31609 existing records from primary storage. [2025-10-21T19:50:16.836729] [INFO ] [MAIN ] MEG: Loaded 31609 existing records. [2025-10-21T19:50:16.956177] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-21T19:50:17.028882] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:17.029257] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-21T19:50:17.029397] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-21T19:50:17.029708] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-21T19:50:17.029767] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-21T19:50:17.364635] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T19:50:17.442423] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:17.733982] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T19:50:17.750986] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-21T19:50:18.551028] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-21T19:50:19.171321] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T19:50:19.351042] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-21T19:50:19.955000] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T19:50:20.151016] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-21T19:50:20.583540] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T19:50:20.951032] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-21T19:50:21.731630] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T19:50:21.750989] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-21T19:50:22.455736] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T19:50:22.551001] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-21T19:50:23.353619] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-21T19:50:23.356106] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T19:50:23.930025] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T19:50:24.151021] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-21T19:50:24.353285] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T19:50:24.951039] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-21T19:50:25.467346] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T19:50:25.751106] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-21T19:50:26.551009] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-21T19:50:26.633884] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T19:50:26.785240] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T19:50:27.330213] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T19:50:27.333535] [INFO ] [REMOTE ] MEC: Full fetch complete (22991 records). [2025-10-21T19:50:27.333614] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-21T19:50:27.356180] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-21T19:50:27.706169] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-21T19:50:27.706280] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-21T19:50:27.706861] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-21T19:50:27.706924] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-21T19:50:27.707596] [DEBUG] [LOCAL ] MEC: Trimmed 22991 records to 16796 (keeping 200 days of data) [2025-10-21T19:50:27.802742] [DEBUG] [LOCAL ] MEC: Primary data saved (16796 records). [2025-10-21T19:50:27.802876] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-21T19:50:27.802977] [INFO ] [MAIN ] Update Progress: 1322/2366 symbols completed. MEC took 25.5s. Estimated remaining: 2h 14m 34s. Rate: 7.8 symbols/min [2025-10-21T19:50:27.974370] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:27.994370] [DEBUG] [LOCAL ] MEGI: Loaded 19796 existing records from primary storage. [2025-10-21T19:50:27.994588] [INFO ] [MAIN ] MEGI: Loaded 19796 existing records. [2025-10-21T19:50:28.174447] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:28.154820] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-21T19:50:28.175123] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-21T19:50:28.175893] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-21T19:50:28.176084] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-21T19:50:28.176139] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-21T19:50:28.540425] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:28.638806] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T19:50:28.951041] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-21T19:50:29.241404] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T19:50:29.751001] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-21T19:50:30.551027] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-21T19:50:30.602384] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T19:50:30.844836] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T19:50:31.351023] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-21T19:50:31.672122] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T19:50:31.675330] [INFO ] [REMOTE ] MED: Full fetch complete (31819 records). [2025-10-21T19:50:31.675415] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-21T19:50:32.049051] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-21T19:50:32.049138] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-21T19:50:32.049823] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-21T19:50:32.049886] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-21T19:50:32.050616] [DEBUG] [LOCAL ] MED: Trimmed 31819 records to 21011 (keeping 200 days of data) [2025-10-21T19:50:32.153481] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-21T19:50:32.176106] [DEBUG] [LOCAL ] MED: Primary data saved (21011 records). [2025-10-21T19:50:32.176196] [INFO ] [MAIN ] MED: Full history saved. [2025-10-21T19:50:32.176267] [INFO ] [MAIN ] Update Progress: 1323/2366 symbols completed. MED took 29.8s. Estimated remaining: 2h 14m 23s. Rate: 7.8 symbols/min [2025-10-21T19:50:32.349990] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:32.379920] [DEBUG] [LOCAL ] MEI: Loaded 31501 existing records from primary storage. [2025-10-21T19:50:32.380196] [INFO ] [MAIN ] MEI: Loaded 31501 existing records. [2025-10-21T19:50:32.561217] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:32.561414] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-21T19:50:32.561460] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-21T19:50:32.561675] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-21T19:50:32.561732] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-21T19:50:32.935169] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:32.950985] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-21T19:50:33.235068] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T19:50:33.302106] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T19:50:33.751019] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-21T19:50:34.308764] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T19:50:34.351918] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:50:34.551044] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-21T19:50:35.351070] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-21T19:50:35.840866] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T19:50:36.151024] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-21T19:50:36.850109] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T19:50:36.951019] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-21T19:50:37.288107] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T19:50:37.751101] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-21T19:50:38.275923] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T19:50:38.551000] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-21T19:50:38.831138] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T19:50:39.351049] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-21T19:50:39.804533] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T19:50:39.811377] [INFO ] [REMOTE ] MEG: Full fetch complete (47471 records). [2025-10-21T19:50:39.811621] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-21T19:50:40.160422] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-21T19:50:40.213385] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-21T19:50:40.213469] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-21T19:50:40.214403] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-21T19:50:40.214466] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-21T19:50:40.215439] [DEBUG] [LOCAL ] MEG: Trimmed 47471 records to 31613 (keeping 200 days of data) [2025-10-21T19:50:40.404464] [DEBUG] [LOCAL ] MEG: Primary data saved (31613 records). [2025-10-21T19:50:40.404613] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-21T19:50:40.404729] [INFO ] [MAIN ] Update Progress: 1324/2366 symbols completed. MEG took 23.8s. Estimated remaining: 2h 14m 16s. Rate: 7.8 symbols/min [2025-10-21T19:50:40.586346] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:40.636695] [DEBUG] [LOCAL ] MET: Loaded 53307 existing records from primary storage. [2025-10-21T19:50:40.637030] [INFO ] [MAIN ] MET: Loaded 53307 existing records. [2025-10-21T19:50:40.830577] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:40.830889] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-21T19:50:40.830945] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-21T19:50:40.831143] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-21T19:50:40.831199] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-21T19:50:40.956140] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-21T19:50:41.231197] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:41.236190] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T19:50:41.244407] [INFO ] [REMOTE ] MDU: Full fetch complete (70675 records). [2025-10-21T19:50:41.244520] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-21T19:50:41.649317] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-21T19:50:41.649472] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-21T19:50:41.650856] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-21T19:50:41.650934] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-21T19:50:41.652386] [DEBUG] [LOCAL ] MDU: Trimmed 70675 records to 48021 (keeping 200 days of data) [2025-10-21T19:50:41.753279] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-21T19:50:41.855161] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T19:50:41.989986] [DEBUG] [LOCAL ] MDU: Primary data saved (48021 records). [2025-10-21T19:50:41.990148] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-21T19:50:41.991153] [INFO ] [MAIN ] Update Progress: 1325/2366 symbols completed. MDU took 39.7s. Estimated remaining: 2h 14m 4s. Rate: 7.8 symbols/min [2025-10-21T19:50:42.177947] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:42.175749] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T19:50:42.224177] [DEBUG] [LOCAL ] MFA: Loaded 45743 existing records from primary storage. [2025-10-21T19:50:42.224456] [INFO ] [MAIN ] MFA: Loaded 45743 existing records. [2025-10-21T19:50:42.405123] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:42.405391] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-21T19:50:42.405459] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-21T19:50:42.405700] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-21T19:50:42.405755] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-21T19:50:42.553637] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-21T19:50:42.769004] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:43.350997] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-21T19:50:43.526477] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T19:50:44.150999] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-21T19:50:44.228191] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T19:50:44.918714] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T19:50:44.950986] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-21T19:50:45.751060] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-21T19:50:45.933418] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T19:50:46.465080] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T19:50:46.536153] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:50:46.550972] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-21T19:50:47.351069] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-21T19:50:47.799999] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T19:50:48.151006] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-21T19:50:48.310124] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T19:50:48.951052] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-21T19:50:49.751011] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-21T19:50:49.980007] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:50:50.504787] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T19:50:50.550989] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-21T19:50:51.279322] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T19:50:51.350997] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-21T19:50:51.919867] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T19:50:52.151043] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-21T19:50:52.951012] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-21T19:50:53.165826] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T19:50:53.542629] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T19:50:53.751054] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-21T19:50:54.551013] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-21T19:50:54.740222] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T19:50:55.350999] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-21T19:50:55.751396] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T19:50:55.821752] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T19:50:55.826430] [INFO ] [REMOTE ] MEI: Full fetch complete (45368 records). [2025-10-21T19:50:55.826516] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-21T19:50:56.138909] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T19:50:56.154855] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-21T19:50:56.237130] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-21T19:50:56.237220] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-21T19:50:56.238081] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-21T19:50:56.238144] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-21T19:50:56.239229] [DEBUG] [LOCAL ] MEI: Trimmed 45368 records to 31387 (keeping 200 days of data) [2025-10-21T19:50:56.419938] [DEBUG] [LOCAL ] MEI: Primary data saved (31387 records). [2025-10-21T19:50:56.420072] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-21T19:50:56.420803] [INFO ] [MAIN ] Update Progress: 1326/2366 symbols completed. MEI took 24.2s. Estimated remaining: 2h 14m 1s. Rate: 7.8 symbols/min [2025-10-21T19:50:56.597431] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:50:56.604935] [DEBUG] [LOCAL ] MFAN: Loaded 4316 existing records from primary storage. [2025-10-21T19:50:56.605142] [INFO ] [MAIN ] MFAN: Loaded 4316 existing records. [2025-10-21T19:50:56.780162] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:50:56.780383] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-21T19:50:56.780448] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-21T19:50:56.780694] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-21T19:50:56.780780] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-21T19:50:56.960145] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-21T19:50:57.143500] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:50:57.751006] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-21T19:50:57.833438] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T19:50:58.086760] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T19:50:58.255933] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-21T19:50:58.551048] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-21T19:50:59.351100] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-21T19:51:00.140763] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:51:00.152181] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-21T19:51:00.521297] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T19:51:00.951023] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-21T19:51:01.751013] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-21T19:51:02.233521] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T19:51:02.432323] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-21T19:51:02.550998] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-21T19:51:02.761698] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T19:51:03.351037] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-21T19:51:04.151015] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-21T19:51:04.254995] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:51:04.352282] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T19:51:04.951021] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-21T19:51:05.751073] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-21T19:51:05.944293] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T19:51:05.943577] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T19:51:05.957098] [INFO ] [REMOTE ] MEGI: Full fetch complete (29041 records). [2025-10-21T19:51:05.957275] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-21T19:51:06.343945] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-21T19:51:06.344022] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-21T19:51:06.344707] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-21T19:51:06.344769] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-21T19:51:06.345446] [DEBUG] [LOCAL ] MEGI: Trimmed 29041 records to 19774 (keeping 200 days of data) [2025-10-21T19:51:06.462807] [DEBUG] [LOCAL ] MEGI: Primary data saved (19774 records). [2025-10-21T19:51:06.462939] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-21T19:51:06.463018] [INFO ] [MAIN ] Update Progress: 1327/2366 symbols completed. MEGI took 38.7s. Estimated remaining: 2h 13m 55s. Rate: 7.8 symbols/min [2025-10-21T19:51:06.556101] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-21T19:51:06.634383] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:06.666450] [DEBUG] [LOCAL ] MFAO: Loaded 3969 existing records from primary storage. [2025-10-21T19:51:06.666692] [INFO ] [MAIN ] MFAO: Loaded 3969 existing records. [2025-10-21T19:51:06.850050] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:06.850236] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-21T19:51:06.850284] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-21T19:51:06.850406] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-21T19:51:06.850443] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-21T19:51:07.213567] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T19:51:07.242620] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:07.350992] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-10. [2025-10-21T19:51:07.978414] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T19:51:08.151025] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-21T19:51:08.951016] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-21T19:51:09.217792] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T19:51:09.228454] [INFO ] [REMOTE ] MFA: Full fetch complete (65287 records). [2025-10-21T19:51:09.228732] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-10-21T19:51:09.634881] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-10-21T19:51:09.636693] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-10-21T19:51:09.636878] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T19:51:09.638007] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-10-21T19:51:09.639832] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-10-21T19:51:09.641331] [DEBUG] [LOCAL ] MFA: Trimmed 65287 records to 45661 (keeping 200 days of data) [2025-10-21T19:51:09.752906] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-21T19:51:09.921760] [DEBUG] [LOCAL ] MFA: Primary data saved (45661 records). [2025-10-21T19:51:09.921907] [INFO ] [MAIN ] MFA: Full history saved. [2025-10-21T19:51:09.922628] [INFO ] [MAIN ] Update Progress: 1328/2366 symbols completed. MFA took 27.9s. Estimated remaining: 2h 13m 44s. Rate: 7.8 symbols/min [2025-10-21T19:51:10.096226] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:10.134889] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T19:51:10.206973] [DEBUG] [LOCAL ] MFC: Loaded 51048 existing records from primary storage. [2025-10-21T19:51:10.207352] [INFO ] [MAIN ] MFC: Loaded 51048 existing records. [2025-10-21T19:51:10.387588] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:10.387821] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-21T19:51:10.387879] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-21T19:51:10.388057] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-21T19:51:10.388094] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-21T19:51:10.493124] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T19:51:10.551263] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-21T19:51:10.753815] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:11.181781] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T19:51:11.351035] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-21T19:51:12.151096] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-21T19:51:12.897559] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T19:51:12.951001] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-21T19:51:13.751105] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-21T19:51:14.030941] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:51:14.130939] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T19:51:14.313906] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T19:51:14.551052] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-21T19:51:15.351052] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-21T19:51:15.915680] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T19:51:16.151034] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-21T19:51:16.322028] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T19:51:16.794361] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-21T19:51:16.951042] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-21T19:51:17.504858] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-21T19:51:17.751044] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-21T19:51:18.551037] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-21T19:51:19.036999] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T19:51:19.350998] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-21T19:51:19.405181] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T19:51:19.918330] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T19:51:20.151032] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-21T19:51:20.849806] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T19:51:20.951066] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-21T19:51:21.494779] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T19:51:21.751055] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-21T19:51:22.333925] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T19:51:22.551048] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-21T19:51:23.072900] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-21T19:51:23.351060] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-21T19:51:23.910382] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T19:51:24.151047] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-10-21T19:51:24.605281] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T19:51:24.951055] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-21T19:51:25.756117] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-10. [2025-10-21T19:51:25.772004] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:51:25.780747] [INFO ] [REMOTE ] MET: Full fetch complete (77366 records). [2025-10-21T19:51:25.780884] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-21T19:51:26.164716] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-21T19:51:26.164804] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-21T19:51:26.165877] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-21T19:51:26.165937] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-21T19:51:26.167278] [DEBUG] [LOCAL ] MET: Trimmed 77366 records to 53305 (keeping 200 days of data) [2025-10-21T19:51:26.471238] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T19:51:26.475031] [INFO ] [REMOTE ] MFAO: Full fetch complete (5489 records). [2025-10-21T19:51:26.475397] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-10-21T19:51:26.552635] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-21T19:51:26.676548] [DEBUG] [LOCAL ] MET: Primary data saved (53305 records). [2025-10-21T19:51:26.684433] [INFO ] [MAIN ] MET: Full history saved. [2025-10-21T19:51:26.741907] [INFO ] [MAIN ] Update Progress: 1329/2366 symbols completed. MET took 46.3s. Estimated remaining: 2h 13m 43s. Rate: 7.8 symbols/min [2025-10-21T19:51:27.029731] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-10-21T19:51:27.034311] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-10-21T19:51:27.049234] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-10-21T19:51:27.051080] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-10-21T19:51:27.052610] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:27.053220] [DEBUG] [LOCAL ] MFAO: Trimmed 5489 records to 3968 (keeping 200 days of data) [2025-10-21T19:51:27.077769] [DEBUG] [LOCAL ] MFAO: Primary data saved (3968 records). [2025-10-21T19:51:27.077916] [INFO ] [MAIN ] MFAO: Full history saved. [2025-10-21T19:51:27.078034] [INFO ] [MAIN ] Update Progress: 1330/2366 symbols completed. MFAO took 20.6s. Estimated remaining: 2h 13m 30s. Rate: 7.8 symbols/min [2025-10-21T19:51:27.262862] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:27.279083] [DEBUG] [LOCAL ] MFG: Loaded 49621 existing records from primary storage. [2025-10-21T19:51:27.279463] [INFO ] [MAIN ] MFG: Loaded 49621 existing records. [2025-10-21T19:51:27.359091] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-10-21T19:51:27.369531] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:51:27.399784] [INFO ] [REMOTE ] MFAN: Full fetch complete (5986 records). [2025-10-21T19:51:27.400133] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-21T19:51:27.400467] [DEBUG] [LOCAL ] MFM: Loaded 14274 existing records from primary storage. [2025-10-21T19:51:27.401091] [INFO ] [MAIN ] MFM: Loaded 14274 existing records. [2025-10-21T19:51:27.582876] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:27.642432] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-21T19:51:27.664051] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-21T19:51:27.694678] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-21T19:51:27.694779] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-21T19:51:27.964358] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:28.013675] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-10-21T19:51:28.030897] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-10-21T19:51:28.171732] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-10-21T19:51:28.206786] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-10-21T19:51:28.499920] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-21T19:51:28.517030] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-21T19:51:28.522876] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-21T19:51:28.522139] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:28.538485] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-21T19:51:28.544041] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-21T19:51:28.602766] [DEBUG] [LOCAL ] MFAN: Trimmed 5986 records to 4348 (keeping 200 days of data) [2025-10-21T19:51:28.732665] [DEBUG] [LOCAL ] MFAN: Primary data saved (4348 records). [2025-10-21T19:51:28.733017] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-21T19:51:28.738447] [INFO ] [MAIN ] Update Progress: 1331/2366 symbols completed. MFAN took 32.3s. Estimated remaining: 2h 13m 17s. Rate: 7.8 symbols/min [2025-10-21T19:51:28.887520] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:28.959044] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-10-21T19:51:28.984060] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:28.984459] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-10-21T19:51:28.984510] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-10-21T19:51:28.984615] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-10-21T19:51:28.984684] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-21T19:51:28.984743] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-21T19:51:28.984776] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-10-21T19:51:29.366567] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:29.371238] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T19:51:29.403731] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-21T19:51:29.751058] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-10-21T19:51:30.065764] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-21T19:51:30.102829] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:51:30.551050] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-10-21T19:51:31.351006] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-10-21T19:51:31.607276] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-21T19:51:32.122733] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T19:51:32.150980] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-10-21T19:51:32.951049] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-10-21T19:51:33.744755] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T19:51:33.750975] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-10-21T19:51:33.954377] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T19:51:34.538574] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T19:51:34.550971] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-10-21T19:51:35.351053] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-10-21T19:51:35.649103] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T19:51:36.151029] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-10-21T19:51:36.942212] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:51:36.951163] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-10-21T19:51:37.390457] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T19:51:37.751062] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-10-21T19:51:38.225683] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T19:51:38.551029] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-10-21T19:51:38.575077] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T19:51:38.873785] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-21T19:51:39.351053] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-10-21T19:51:40.151048] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-10-21T19:51:40.951069] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-10-21T19:51:40.990617] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T19:51:41.126583] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T19:51:41.259534] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-21T19:51:41.751028] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-10-21T19:51:42.551037] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-10-21T19:51:42.703573] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T19:51:42.813822] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-21T19:51:43.351042] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-10-21T19:51:44.151048] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-10-21T19:51:44.924564] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:51:44.950978] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-10-21T19:51:45.071181] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T19:51:45.751082] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-10-21T19:51:45.766163] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T19:51:46.551063] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-10-21T19:51:47.351058] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-10-21T19:51:47.425717] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T19:51:47.687857] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T19:51:48.150996] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-10. [2025-10-21T19:51:48.185946] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T19:51:48.951048] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-10. [2025-10-21T19:51:49.751045] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-10-21T19:51:49.814986] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T19:51:49.822894] [INFO ] [REMOTE ] MFC: Full fetch complete (74373 records). [2025-10-21T19:51:49.823008] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-10-21T19:51:49.931205] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T19:51:49.934069] [INFO ] [REMOTE ] MFM: Full fetch complete (19352 records). [2025-10-21T19:51:49.944604] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-10-21T19:51:50.531088] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-10-21T19:51:50.543297] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-10-21T19:51:50.553029] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-10-21T19:51:50.564026] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-10-21T19:51:50.588529] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-10-21T19:51:50.588436] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-10-21T19:51:50.588638] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-10-21T19:51:50.589027] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-10-21T19:51:50.589078] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-10-21T19:51:50.590126] [DEBUG] [LOCAL ] MFM: Trimmed 19352 records to 14170 (keeping 200 days of data) [2025-10-21T19:51:50.591140] [DEBUG] [LOCAL ] MFC: Trimmed 74373 records to 51013 (keeping 200 days of data) [2025-10-21T19:51:50.766577] [DEBUG] [LOCAL ] MFM: Primary data saved (14170 records). [2025-10-21T19:51:50.773835] [INFO ] [MAIN ] MFM: Full history saved. [2025-10-21T19:51:50.776703] [INFO ] [MAIN ] Update Progress: 1332/2366 symbols completed. MFM took 23.7s. Estimated remaining: 2h 13m 21s. Rate: 7.8 symbols/min [2025-10-21T19:51:51.041441] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T19:51:51.070505] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:51.158453] [DEBUG] [LOCAL ] MFC: Primary data saved (51013 records). [2025-10-21T19:51:51.158826] [INFO ] [MAIN ] MFC: Full history saved. [2025-10-21T19:51:51.159615] [INFO ] [MAIN ] Update Progress: 1333/2366 symbols completed. MFC took 41.2s. Estimated remaining: 2h 13m 7s. Rate: 7.8 symbols/min [2025-10-21T19:51:51.244803] [DEBUG] [LOCAL ] MFSG: Loaded 5899 existing records from primary storage. [2025-10-21T19:51:51.256011] [INFO ] [MAIN ] MFSG: Loaded 5899 existing records. [2025-10-21T19:51:51.351399] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-10-21T19:51:51.448128] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:51.535809] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:51.536302] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-10-21T19:51:51.536441] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-10-21T19:51:51.540217] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-10-21T19:51:51.540347] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-10-21T19:51:51.645883] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T19:51:51.634177] [DEBUG] [LOCAL ] MFSI: Loaded 12471 existing records from primary storage. [2025-10-21T19:51:51.669489] [INFO ] [MAIN ] MFSI: Loaded 12471 existing records. [2025-10-21T19:51:52.031589] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T19:51:52.102040] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:52.131013] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-10-21T19:51:52.143827] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-10-21T19:51:52.154782] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-10-21T19:51:52.149580] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-10-21T19:51:52.172739] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-10-21T19:51:52.281517] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:52.583318] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T19:51:52.670542] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:52.951045] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-10-21T19:51:53.531896] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T19:51:53.751036] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-10-21T19:51:54.243079] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-21T19:51:54.551079] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-10. [2025-10-21T19:51:55.239711] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T19:51:55.241028] [INFO ] [REMOTE ] MFSB: Full fetch complete (2021 records). [2025-10-21T19:51:55.241096] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-10-21T19:51:55.363446] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-10-21T19:51:55.443920] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-21T19:51:55.444089] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:51:55.444164] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:51:55.444225] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-10-21T19:51:55.444306] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-10-21T19:51:55.444368] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-10-21T19:51:55.444436] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-10-21T19:51:55.444524] [INFO ] [MAIN ] Update Progress: 1334/2366 symbols completed. MFSB took 26.7s. Estimated remaining: 2h 12m 57s. Rate: 7.8 symbols/min [2025-10-21T19:51:55.620760] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:51:55.624751] [DEBUG] [LOCAL ] MFSV: Loaded 2924 existing records from primary storage. [2025-10-21T19:51:55.624886] [INFO ] [MAIN ] MFSV: Loaded 2924 existing records. [2025-10-21T19:51:55.802730] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:51:55.802909] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-10-21T19:51:55.802955] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-10-21T19:51:55.803090] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-10-21T19:51:55.803145] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-10-21T19:51:56.162678] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-10-21T19:51:56.175684] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:51:56.591227] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T19:51:56.950997] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-10-21T19:51:57.296528] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-21T19:51:57.431126] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T19:51:57.751021] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-10-21T19:51:58.294023] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T19:51:58.551003] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-10-21T19:51:58.980007] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T19:51:59.351032] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-10-21T19:52:00.010009] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T19:52:00.151081] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-10-21T19:52:00.951080] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-10-21T19:52:01.539455] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T19:52:01.751098] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-10-21T19:52:02.398758] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T19:52:02.551047] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-10-21T19:52:03.351018] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-10-21T19:52:03.512086] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T19:52:03.627707] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T19:52:03.832134] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T19:52:04.151019] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-10-21T19:52:04.902944] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T19:52:04.950989] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-10-21T19:52:05.751061] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-10-21T19:52:05.849526] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T19:52:06.551038] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-10-21T19:52:07.351041] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-10-21T19:52:07.712628] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T19:52:07.759878] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:52:07.802460] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T19:52:08.151015] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-10-21T19:52:08.581209] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-21T19:52:08.951030] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-10-21T19:52:09.268900] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-21T19:52:09.751062] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-10-21T19:52:10.176288] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T19:52:10.551039] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-10-21T19:52:11.133441] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T19:52:11.351056] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-10-21T19:52:11.899847] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-21T19:52:12.151064] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-10-21T19:52:12.733305] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T19:52:12.951048] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-10-21T19:52:13.618052] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-21T19:52:13.751021] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-10-21T19:52:14.518543] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T19:52:14.551039] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-10-21T19:52:15.188089] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-21T19:52:15.351066] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-10-21T19:52:16.030261] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T19:52:16.151015] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-10. [2025-10-21T19:52:16.951049] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-10-21T19:52:16.993893] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T19:52:16.995285] [INFO ] [REMOTE ] MFSV: Full fetch complete (3626 records). [2025-10-21T19:52:16.995351] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-10-21T19:52:17.374085] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-10-21T19:52:17.374161] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-10-21T19:52:17.374290] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-10-21T19:52:17.374330] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-10-21T19:52:17.374691] [DEBUG] [LOCAL ] MFSV: Trimmed 3626 records to 2921 (keeping 200 days of data) [2025-10-21T19:52:17.392074] [DEBUG] [LOCAL ] MFSV: Primary data saved (2921 records). [2025-10-21T19:52:17.392134] [INFO ] [MAIN ] MFSV: Full history saved. [2025-10-21T19:52:17.392196] [INFO ] [MAIN ] Update Progress: 1335/2366 symbols completed. MFSV took 21.9s. Estimated remaining: 2h 13m 0s. Rate: 7.8 symbols/min [2025-10-21T19:52:17.566236] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:52:17.581787] [DEBUG] [LOCAL ] MG: Loaded 15611 existing records from primary storage. [2025-10-21T19:52:17.581991] [INFO ] [MAIN ] MG: Loaded 15611 existing records. [2025-10-21T19:52:17.691440] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:52:17.754153] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-10. [2025-10-21T19:52:17.776924] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:52:17.777506] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-10-21T19:52:17.777562] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-10-21T19:52:17.777853] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-10-21T19:52:17.777911] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-10-21T19:52:18.148516] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:52:18.551066] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-10-21T19:52:18.868638] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T19:52:18.871732] [INFO ] [REMOTE ] MFSI: Full fetch complete (14863 records). [2025-10-21T19:52:18.871808] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-10-21T19:52:19.241086] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-10-21T19:52:19.241178] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-10-21T19:52:19.241587] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-10-21T19:52:19.241626] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-10-21T19:52:19.242203] [DEBUG] [LOCAL ] MFSI: Trimmed 14863 records to 12557 (keeping 200 days of data) [2025-10-21T19:52:19.316509] [DEBUG] [LOCAL ] MFSI: Primary data saved (12557 records). [2025-10-21T19:52:19.316634] [INFO ] [MAIN ] MFSI: Full history saved. [2025-10-21T19:52:19.316750] [INFO ] [MAIN ] Update Progress: 1336/2366 symbols completed. MFSI took 28.2s. Estimated remaining: 2h 12m 48s. Rate: 7.8 symbols/min [2025-10-21T19:52:19.361391] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-10. [2025-10-21T19:52:19.488431] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:52:19.537043] [DEBUG] [LOCAL ] MGA: Loaded 50442 existing records from primary storage. [2025-10-21T19:52:19.537395] [INFO ] [MAIN ] MGA: Loaded 50442 existing records. [2025-10-21T19:52:19.657159] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T19:52:19.737413] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:52:19.737609] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-10-21T19:52:19.737683] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-10-21T19:52:19.738151] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-10-21T19:52:19.738207] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-10-21T19:52:20.081084] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:52:20.150995] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-10-21T19:52:20.202245] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T19:52:20.204047] [INFO ] [REMOTE ] MFSG: Full fetch complete (6762 records). [2025-10-21T19:52:20.204114] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-10-21T19:52:20.567855] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-10-21T19:52:20.568165] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-10-21T19:52:20.568392] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-10-21T19:52:20.568468] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-10-21T19:52:20.568892] [DEBUG] [LOCAL ] MFSG: Trimmed 6762 records to 5924 (keeping 200 days of data) [2025-10-21T19:52:20.603867] [DEBUG] [LOCAL ] MFSG: Primary data saved (5924 records). [2025-10-21T19:52:20.603977] [INFO ] [MAIN ] MFSG: Full history saved. [2025-10-21T19:52:20.604053] [INFO ] [MAIN ] Update Progress: 1337/2366 symbols completed. MFSG took 29.8s. Estimated remaining: 2h 12m 35s. Rate: 7.8 symbols/min [2025-10-21T19:52:20.775376] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:52:20.781898] [DEBUG] [LOCAL ] MGF: Loaded 4141 existing records from primary storage. [2025-10-21T19:52:20.782048] [INFO ] [MAIN ] MGF: Loaded 4141 existing records. [2025-10-21T19:52:20.957126] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-10-21T19:52:20.962229] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:52:20.963444] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-10-21T19:52:20.963497] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-10-21T19:52:20.963915] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-10-21T19:52:20.963973] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-10-21T19:52:21.317028] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:52:21.751005] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-10. [2025-10-21T19:52:21.819173] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T19:52:21.843122] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T19:52:22.551034] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-10-21T19:52:23.351062] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-10-21T19:52:23.556836] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T19:52:23.564636] [INFO ] [REMOTE ] MFG: Full fetch complete (69780 records). [2025-10-21T19:52:23.564779] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-10-21T19:52:23.697587] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T19:52:23.917105] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T19:52:23.988672] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-10-21T19:52:23.988761] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-10-21T19:52:23.989894] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-10-21T19:52:23.989977] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-10-21T19:52:23.991355] [DEBUG] [LOCAL ] MFG: Trimmed 69780 records to 49585 (keeping 200 days of data) [2025-10-21T19:52:24.156136] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-10-21T19:52:24.268237] [DEBUG] [LOCAL ] MFG: Primary data saved (49585 records). [2025-10-21T19:52:24.268382] [INFO ] [MAIN ] MFG: Full history saved. [2025-10-21T19:52:24.268462] [INFO ] [MAIN ] Update Progress: 1338/2366 symbols completed. MFG took 57.5s. Estimated remaining: 2h 12m 25s. Rate: 7.8 symbols/min [2025-10-21T19:52:24.437596] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:52:24.486891] [DEBUG] [LOCAL ] MGM: Loaded 53607 existing records from primary storage. [2025-10-21T19:52:24.487220] [INFO ] [MAIN ] MGM: Loaded 53607 existing records. [2025-10-21T19:52:24.674046] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:52:24.674277] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-10-21T19:52:24.674327] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-10-21T19:52:24.674537] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-10-21T19:52:24.674596] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-10-21T19:52:24.955845] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-10-21T19:52:25.054689] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:52:25.193362] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T19:52:25.751014] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-10-21T19:52:26.252275] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T19:52:26.551019] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-10-21T19:52:26.603778] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:52:27.351019] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-10-21T19:52:28.151032] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-10-21T19:52:28.334793] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T19:52:28.359933] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T19:52:28.798889] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T19:52:28.951048] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-10-21T19:52:29.751032] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-10-21T19:52:30.553968] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-10-21T19:52:30.557478] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T19:52:31.351079] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-10-21T19:52:31.588951] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T19:52:31.691797] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T19:52:31.941982] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T19:52:32.151028] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-10-21T19:52:32.736535] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T19:52:32.951041] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-10-21T19:52:33.751070] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-10-21T19:52:34.551008] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-10-21T19:52:34.627966] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:52:35.351138] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-10-21T19:52:35.719443] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T19:52:35.741460] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T19:52:35.966356] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T19:52:36.151120] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-10-21T19:52:36.903504] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T19:52:36.950985] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-10-21T19:52:37.750990] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-10-21T19:52:37.844354] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T19:52:38.551076] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-10-21T19:52:39.126216] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T19:52:39.351078] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-10-21T19:52:39.547899] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T19:52:39.953761] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T19:52:40.151050] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-10. [2025-10-21T19:52:40.951018] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-10-21T19:52:41.102474] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T19:52:41.105047] [INFO ] [REMOTE ] MG: Full fetch complete (23298 records). [2025-10-21T19:52:41.105117] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-10-21T19:52:41.466857] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-10-21T19:52:41.466935] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-10-21T19:52:41.467412] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-10-21T19:52:41.467450] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-10-21T19:52:41.468062] [DEBUG] [LOCAL ] MG: Trimmed 23298 records to 15529 (keeping 200 days of data) [2025-10-21T19:52:41.539951] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T19:52:41.566007] [DEBUG] [LOCAL ] MG: Primary data saved (15529 records). [2025-10-21T19:52:41.566169] [INFO ] [MAIN ] MG: Full history saved. [2025-10-21T19:52:41.566291] [INFO ] [MAIN ] Update Progress: 1339/2366 symbols completed. MG took 24.2s. Estimated remaining: 2h 12m 24s. Rate: 7.8 symbols/min [2025-10-21T19:52:41.734594] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:52:41.742013] [DEBUG] [LOCAL ] MGR: Loaded 5576 existing records from primary storage. [2025-10-21T19:52:41.742174] [INFO ] [MAIN ] MGR: Loaded 5576 existing records. [2025-10-21T19:52:41.756258] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-10. [2025-10-21T19:52:41.920475] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:52:41.920687] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-10-21T19:52:41.920743] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-10-21T19:52:41.920901] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-10-21T19:52:41.920960] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-10-21T19:52:42.268102] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:52:42.408029] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T19:52:42.409214] [INFO ] [REMOTE ] MGF: Full fetch complete (5763 records). [2025-10-21T19:52:42.409299] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-10-21T19:52:42.556129] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-10-21T19:52:42.780624] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-10-21T19:52:42.780728] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-10-21T19:52:42.780917] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-10-21T19:52:42.780964] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-10-21T19:52:42.781339] [DEBUG] [LOCAL ] MGF: Trimmed 5763 records to 4170 (keeping 200 days of data) [2025-10-21T19:52:42.805111] [DEBUG] [LOCAL ] MGF: Primary data saved (4170 records). [2025-10-21T19:52:42.805201] [INFO ] [MAIN ] MGF: Full history saved. [2025-10-21T19:52:42.805277] [INFO ] [MAIN ] Update Progress: 1340/2366 symbols completed. MGF took 22.2s. Estimated remaining: 2h 12m 11s. Rate: 7.8 symbols/min [2025-10-21T19:52:42.970668] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:52:42.976771] [DEBUG] [LOCAL ] MGRB: Loaded 4005 existing records from primary storage. [2025-10-21T19:52:42.976948] [INFO ] [MAIN ] MGRB: Loaded 4005 existing records. [2025-10-21T19:52:43.154381] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:52:43.154618] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-10-21T19:52:43.154701] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-10-21T19:52:43.154838] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-10-21T19:52:43.154877] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-10-21T19:52:43.356538] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-10-21T19:52:43.503586] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:52:44.010881] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T19:52:44.151021] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-10-21T19:52:44.312063] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T19:52:44.898924] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T19:52:44.951069] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-10-21T19:52:45.286836] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-21T19:52:45.751087] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-10-21T19:52:46.313065] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T19:52:46.551068] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-10-21T19:52:47.257345] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-21T19:52:47.351102] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-10-21T19:52:48.151028] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-10-21T19:52:48.761142] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T19:52:48.951095] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-10-21T19:52:49.395348] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T19:52:49.751069] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-10-21T19:52:50.551078] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-10-21T19:52:50.659899] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T19:52:50.665770] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T19:52:51.351035] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-10-21T19:52:51.880323] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-21T19:52:52.151039] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-10-21T19:52:52.465695] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T19:52:52.778203] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-21T19:52:52.951050] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-10-21T19:52:53.751025] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-10-21T19:52:54.342999] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T19:52:54.550994] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-10-21T19:52:54.730352] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T19:52:55.267765] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T19:52:55.350975] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-10-21T19:52:55.934073] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T19:52:56.151024] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-10-21T19:52:56.951080] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-10-21T19:52:57.548116] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T19:52:57.751002] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-10-21T19:52:58.067841] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T19:52:58.353462] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T19:52:58.551007] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-10-21T19:52:59.351026] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-10. [2025-10-21T19:53:00.062688] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T19:53:00.064338] [INFO ] [REMOTE ] MGR: Full fetch complete (7847 records). [2025-10-21T19:53:00.064417] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-10-21T19:53:00.155871] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-10-21T19:53:00.490794] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T19:53:00.524481] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-10-21T19:53:00.524719] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-10-21T19:53:00.524991] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-10-21T19:53:00.525085] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-10-21T19:53:00.525922] [DEBUG] [LOCAL ] MGR: Trimmed 7847 records to 5572 (keeping 200 days of data) [2025-10-21T19:53:00.561207] [DEBUG] [LOCAL ] MGR: Primary data saved (5572 records). [2025-10-21T19:53:00.561315] [INFO ] [MAIN ] MGR: Full history saved. [2025-10-21T19:53:00.561393] [INFO ] [MAIN ] Update Progress: 1341/2366 symbols completed. MGR took 19.0s. Estimated remaining: 2h 12m 11s. Rate: 7.8 symbols/min [2025-10-21T19:53:00.746624] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:00.751142] [DEBUG] [LOCAL ] MGRD: Loaded 2218 existing records from primary storage. [2025-10-21T19:53:00.751292] [INFO ] [MAIN ] MGRD: Loaded 2218 existing records. [2025-10-21T19:53:00.932285] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:53:00.932544] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-10-21T19:53:00.932595] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-10-21T19:53:00.932805] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-10-21T19:53:00.932863] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-10-21T19:53:00.963150] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-10-21T19:53:01.030000] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T19:53:01.299770] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:01.751082] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-10-21T19:53:02.233246] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-21T19:53:02.550993] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-10-21T19:53:03.034162] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T19:53:03.031914] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T19:53:03.351055] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-10-21T19:53:04.151024] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-10-21T19:53:04.618279] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T19:53:04.951000] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-10-21T19:53:05.095262] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:53:05.338250] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-21T19:53:05.751032] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-10-21T19:53:06.551023] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-10-21T19:53:07.179463] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T19:53:07.350991] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-10-21T19:53:07.494746] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T19:53:07.910096] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T19:53:08.151027] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-10. [2025-10-21T19:53:08.951037] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-10-21T19:53:09.415745] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T19:53:09.751051] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-10-21T19:53:09.971545] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T19:53:09.979351] [INFO ] [REMOTE ] MGA: Full fetch complete (73710 records). [2025-10-21T19:53:09.979475] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-10-21T19:53:10.086966] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T19:53:10.379862] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-10-21T19:53:10.379963] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-10-21T19:53:10.381130] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-10-21T19:53:10.381193] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-10-21T19:53:10.382586] [DEBUG] [LOCAL ] MGA: Trimmed 73710 records to 50432 (keeping 200 days of data) [2025-10-21T19:53:10.552412] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-10-21T19:53:10.682721] [DEBUG] [LOCAL ] MGA: Primary data saved (50432 records). [2025-10-21T19:53:10.682848] [INFO ] [MAIN ] MGA: Full history saved. [2025-10-21T19:53:10.683618] [INFO ] [MAIN ] Update Progress: 1342/2366 symbols completed. MGA took 51.4s. Estimated remaining: 2h 12m 5s. Rate: 7.8 symbols/min [2025-10-21T19:53:10.852018] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:10.861467] [DEBUG] [LOCAL ] MGRE: Loaded 6471 existing records from primary storage. [2025-10-21T19:53:10.861702] [INFO ] [MAIN ] MGRE: Loaded 6471 existing records. [2025-10-21T19:53:11.074660] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:53:11.078423] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-10-21T19:53:11.078264] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-21T19:53:11.078613] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-10-21T19:53:11.080190] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-10-21T19:53:11.080247] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-10-21T19:53:11.356193] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-10-21T19:53:11.450170] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:11.835570] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T19:53:12.151032] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-10. [2025-10-21T19:53:12.951017] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-10. [2025-10-21T19:53:13.106755] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T19:53:13.115131] [INFO ] [REMOTE ] MGM: Full fetch complete (77761 records). [2025-10-21T19:53:13.115263] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-10-21T19:53:13.520380] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T19:53:13.520458] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-10-21T19:53:13.520606] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-10-21T19:53:13.522676] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-10-21T19:53:13.522767] [INFO ] [REMOTE ] MGRB: Full fetch complete (5523 records). [2025-10-21T19:53:13.522900] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-10-21T19:53:13.522956] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-10-21T19:53:13.627712] [DEBUG] [LOCAL ] MGM: Trimmed 77761 records to 53605 (keeping 200 days of data) [2025-10-21T19:53:13.760250] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-10-21T19:53:14.129577] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-10-21T19:53:14.132680] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-10-21T19:53:14.132933] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-10-21T19:53:14.132984] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-10-21T19:53:14.164714] [DEBUG] [LOCAL ] MGRB: Trimmed 5523 records to 3996 (keeping 200 days of data) [2025-10-21T19:53:14.229602] [DEBUG] [LOCAL ] MGRB: Primary data saved (3996 records). [2025-10-21T19:53:14.230885] [INFO ] [MAIN ] MGRB: Full history saved. [2025-10-21T19:53:14.238393] [INFO ] [MAIN ] Update Progress: 1343/2366 symbols completed. MGRB took 31.4s. Estimated remaining: 2h 11m 54s. Rate: 7.8 symbols/min [2025-10-21T19:53:14.238499] [DEBUG] [LOCAL ] MGM: Primary data saved (53605 records). [2025-10-21T19:53:14.270586] [INFO ] [MAIN ] MGM: Full history saved. [2025-10-21T19:53:14.294791] [INFO ] [MAIN ] Update Progress: 1344/2366 symbols completed. MGM took 50.0s. Estimated remaining: 2h 11m 41s. Rate: 7.8 symbols/min [2025-10-21T19:53:14.426463] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-21T19:53:14.594086] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:14.591157] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:14.594488] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-10-21T19:53:14.594568] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-10-21T19:53:14.594925] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-10-21T19:53:14.595011] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-21T19:53:14.551267] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-10-21T19:53:14.595847] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-21T19:53:14.595899] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-10-21T19:53:14.921315] [DEBUG] [LOCAL ] MGY: Loaded 52437 existing records from primary storage. [2025-10-21T19:53:14.942545] [INFO ] [MAIN ] MGY: Loaded 52437 existing records. [2025-10-21T19:53:15.040215] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:15.103479] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T19:53:15.180355] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:53:15.180543] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-10-21T19:53:15.180611] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-21T19:53:15.180878] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-10-21T19:53:15.180936] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-10-21T19:53:15.354124] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-10. [2025-10-21T19:53:15.541019] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:16.052755] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T19:53:16.053692] [INFO ] [REMOTE ] MGRD: Full fetch complete (3292 records). [2025-10-21T19:53:16.053767] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-10-21T19:53:16.157418] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-10-21T19:53:16.424828] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-10-21T19:53:16.424903] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-10-21T19:53:16.425014] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-10-21T19:53:16.425051] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-10-21T19:53:16.425393] [DEBUG] [LOCAL ] MGRD: Trimmed 3292 records to 2207 (keeping 200 days of data) [2025-10-21T19:53:16.438784] [DEBUG] [LOCAL ] MGRD: Primary data saved (2207 records). [2025-10-21T19:53:16.438854] [INFO ] [MAIN ] MGRD: Full history saved. [2025-10-21T19:53:16.438920] [INFO ] [MAIN ] Update Progress: 1345/2366 symbols completed. MGRD took 15.9s. Estimated remaining: 2h 11m 29s. Rate: 7.8 symbols/min [2025-10-21T19:53:16.609743] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:16.622938] [DEBUG] [LOCAL ] MHD: Loaded 12053 existing records from primary storage. [2025-10-21T19:53:16.623122] [INFO ] [MAIN ] MHD: Loaded 12053 existing records. [2025-10-21T19:53:16.799879] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:53:16.800111] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-10-21T19:53:16.800164] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-10-21T19:53:16.800340] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-10-21T19:53:16.800394] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-10-21T19:53:16.907945] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T19:53:16.957829] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-10-21T19:53:17.187704] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:17.204878] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:53:17.205116] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-10-21T19:53:17.205204] [FATAL] [REMOTE ] MH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:53:17.205274] [FATAL] [MAIN ] MH: Failed to fetch primary data. [2025-10-21T19:53:17.205338] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:53:17.205406] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-10-21T19:53:17.205477] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-10-21T19:53:17.205529] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-10-21T19:53:17.205570] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-10-21T19:53:17.205613] [INFO ] [MAIN ] Update Progress: 1346/2366 symbols completed. MH took 2.9s. Estimated remaining: 2h 11m 16s. Rate: 7.8 symbols/min [2025-10-21T19:53:17.370284] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:17.381095] [DEBUG] [LOCAL ] MHF: Loaded 9023 existing records from primary storage. [2025-10-21T19:53:17.381284] [INFO ] [MAIN ] MHF: Loaded 9023 existing records. [2025-10-21T19:53:17.558605] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:53:17.558852] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-10-21T19:53:17.558906] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-10-21T19:53:17.559055] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-10-21T19:53:17.559093] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-10-21T19:53:17.756241] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-10-21T19:53:17.913047] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:18.411795] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T19:53:18.551057] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-10-21T19:53:19.351036] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-10-21T19:53:19.488324] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T19:53:20.152055] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-10-21T19:53:20.155500] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T19:53:20.907527] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T19:53:20.951087] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-10-21T19:53:21.739883] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T19:53:21.750968] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-10-21T19:53:22.366822] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-21T19:53:22.551057] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-10-21T19:53:23.310582] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T19:53:23.350989] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-10-21T19:53:24.012380] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T19:53:24.151078] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-10-21T19:53:24.951045] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-10-21T19:53:25.016350] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T19:53:25.615228] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T19:53:25.751094] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-10-21T19:53:26.481329] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T19:53:26.551043] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-10-21T19:53:27.351009] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-10-21T19:53:27.426066] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T19:53:28.048704] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T19:53:28.151013] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-10-21T19:53:28.951022] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-10-21T19:53:29.129904] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T19:53:29.564557] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:53:29.751002] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-10-21T19:53:30.515470] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T19:53:30.550981] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-10-21T19:53:31.351005] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-10-21T19:53:31.476118] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T19:53:32.151010] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-10-21T19:53:32.918712] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T19:53:32.950982] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-10-21T19:53:33.014161] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T19:53:33.751034] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-10-21T19:53:33.813947] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T19:53:34.551014] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-10-21T19:53:34.658723] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T19:53:35.351019] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-10. [2025-10-21T19:53:36.063253] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T19:53:36.064539] [INFO ] [REMOTE ] MGRE: Full fetch complete (9193 records). [2025-10-21T19:53:36.064606] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-10-21T19:53:36.155702] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-10-21T19:53:36.213716] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T19:53:36.468848] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-10-21T19:53:36.468927] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-10-21T19:53:36.469218] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-10-21T19:53:36.469258] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-10-21T19:53:36.469678] [DEBUG] [LOCAL ] MGRE: Trimmed 9193 records to 6470 (keeping 200 days of data) [2025-10-21T19:53:36.507981] [DEBUG] [LOCAL ] MGRE: Primary data saved (6470 records). [2025-10-21T19:53:36.508097] [INFO ] [MAIN ] MGRE: Full history saved. [2025-10-21T19:53:36.508177] [INFO ] [MAIN ] Update Progress: 1347/2366 symbols completed. MGRE took 25.8s. Estimated remaining: 2h 11m 17s. Rate: 7.8 symbols/min [2025-10-21T19:53:36.674584] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:36.715917] [DEBUG] [LOCAL ] MHK: Loaded 42112 existing records from primary storage. [2025-10-21T19:53:36.716235] [INFO ] [MAIN ] MHK: Loaded 42112 existing records. [2025-10-21T19:53:36.892399] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:53:36.892606] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-10-21T19:53:36.892681] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-10-21T19:53:36.892941] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-10-21T19:53:36.892980] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-10-21T19:53:36.950991] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-10-21T19:53:37.250413] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:37.264903] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T19:53:37.723847] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T19:53:37.750993] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-10-21T19:53:38.551084] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-10. [2025-10-21T19:53:39.034449] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T19:53:39.351068] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-10-21T19:53:39.844897] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T19:53:39.847452] [INFO ] [REMOTE ] MHD: Full fetch complete (18142 records). [2025-10-21T19:53:39.847565] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-10-21T19:53:39.972845] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T19:53:40.156126] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-10-21T19:53:40.245415] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-10-21T19:53:40.245509] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-10-21T19:53:40.246181] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-10-21T19:53:40.246253] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-10-21T19:53:40.246960] [DEBUG] [LOCAL ] MHD: Trimmed 18142 records to 12010 (keeping 200 days of data) [2025-10-21T19:53:40.319738] [DEBUG] [LOCAL ] MHD: Primary data saved (12010 records). [2025-10-21T19:53:40.319864] [INFO ] [MAIN ] MHD: Full history saved. [2025-10-21T19:53:40.319951] [INFO ] [MAIN ] Update Progress: 1348/2366 symbols completed. MHD took 23.9s. Estimated remaining: 2h 11m 6s. Rate: 7.8 symbols/min [2025-10-21T19:53:40.487676] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:40.487906] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-10-21T19:53:40.487948] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-10-21T19:53:40.488056] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-10-21T19:53:40.488095] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-21T19:53:40.488134] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-21T19:53:40.488189] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-10-21T19:53:40.833664] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:40.951014] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-10-21T19:53:41.301607] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-21T19:53:41.756213] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-10-21T19:53:41.769883] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T19:53:42.545562] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T19:53:42.550981] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-10-21T19:53:43.351055] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-10-21T19:53:43.364875] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T19:53:44.151081] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-10. [2025-10-21T19:53:44.951033] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-10-21T19:53:44.974490] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:53:44.976602] [INFO ] [REMOTE ] MHF: Full fetch complete (12807 records). [2025-10-21T19:53:44.976781] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-10-21T19:53:45.383410] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-10-21T19:53:45.383526] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-10-21T19:53:45.383931] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-10-21T19:53:45.384021] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-10-21T19:53:45.386121] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T19:53:45.390012] [DEBUG] [LOCAL ] MHF: Trimmed 12807 records to 9061 (keeping 200 days of data) [2025-10-21T19:53:45.446625] [DEBUG] [LOCAL ] MHF: Primary data saved (9061 records). [2025-10-21T19:53:45.446761] [INFO ] [MAIN ] MHF: Full history saved. [2025-10-21T19:53:45.446836] [INFO ] [MAIN ] Update Progress: 1349/2366 symbols completed. MHF took 28.2s. Estimated remaining: 2h 10m 57s. Rate: 7.8 symbols/min [2025-10-21T19:53:45.614534] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:45.624161] [DEBUG] [LOCAL ] MHN: Loaded 7475 existing records from primary storage. [2025-10-21T19:53:45.624364] [INFO ] [MAIN ] MHN: Loaded 7475 existing records. [2025-10-21T19:53:45.762750] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-10-21T19:53:45.803479] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:53:45.803742] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-10-21T19:53:45.803805] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-10-21T19:53:45.803968] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-10-21T19:53:45.804020] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-10-21T19:53:46.160509] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:46.258957] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T19:53:46.538598] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T19:53:46.550984] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-10-21T19:53:47.351019] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-10-21T19:53:48.116022] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T19:53:48.159521] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-10-21T19:53:48.165406] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T19:53:48.896859] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T19:53:48.951076] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-10-21T19:53:49.649003] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T19:53:49.751033] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-10-21T19:53:50.551040] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-10-21T19:53:50.598046] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T19:53:51.351064] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-10-21T19:53:51.457109] [DEBUG] [REMOTE ] MGY: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-21T19:53:51.457422] [WARN ] [REMOTE ] MGY: No data returned for month 2025-05 [2025-10-21T19:53:51.457507] [FATAL] [REMOTE ] MGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:53:51.457586] [FATAL] [MAIN ] MGY: Failed to fetch primary data. [2025-10-21T19:53:51.457667] [WARN ] [MAIN ] MGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:53:51.457779] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-10-21T19:53:51.457864] [DEBUG] [LOCAL ] MGY: No primary data file found to delete. [2025-10-21T19:53:51.457912] [INFO ] [LOCAL ] MGY: Starting deletion of derivative data. [2025-10-21T19:53:51.458171] [DEBUG] [LOCAL ] MGY: Deleted derivative data file. [2025-10-21T19:53:51.458272] [INFO ] [MAIN ] Update Progress: 1350/2366 symbols completed. MGY took 37.2s. Estimated remaining: 2h 10m 48s. Rate: 7.8 symbols/min [2025-10-21T19:53:51.630675] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:53:51.653676] [DEBUG] [LOCAL ] MHO: Loaded 23788 existing records from primary storage. [2025-10-21T19:53:51.653899] [INFO ] [MAIN ] MHO: Loaded 23788 existing records. [2025-10-21T19:53:51.832158] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:53:51.832329] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-10-21T19:53:51.832375] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-10-21T19:53:51.832634] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-10-21T19:53:51.832721] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-10-21T19:53:52.156912] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-10-21T19:53:52.183607] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:53:52.226392] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:53:52.610675] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T19:53:52.951024] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-10-21T19:53:53.751074] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-10-21T19:53:54.299963] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T19:53:54.551057] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-10-21T19:53:55.351063] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-10-21T19:53:55.641520] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:53:55.694359] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-21T19:53:55.957188] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T19:53:56.151086] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-10-21T19:53:56.771388] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-21T19:53:56.951049] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-10-21T19:53:57.609009] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T19:53:57.751032] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-10-21T19:53:58.500722] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T19:53:58.551012] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-10-21T19:53:59.351053] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-10-21T19:54:00.057246] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T19:54:00.151020] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-10-21T19:54:00.532193] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T19:54:00.951029] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-10-21T19:54:01.751009] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-10-21T19:54:01.970517] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T19:54:02.155960] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T19:54:02.551009] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-10-21T19:54:02.692126] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T19:54:03.282784] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T19:54:03.351050] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-10. [2025-10-21T19:54:04.084270] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T19:54:04.085759] [INFO ] [REMOTE ] MHN: Full fetch complete (11404 records). [2025-10-21T19:54:04.085826] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-10-21T19:54:04.156265] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-10-21T19:54:04.439356] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-10-21T19:54:04.439432] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-10-21T19:54:04.439722] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-10-21T19:54:04.439782] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-10-21T19:54:04.440205] [DEBUG] [LOCAL ] MHN: Trimmed 11404 records to 7437 (keeping 200 days of data) [2025-10-21T19:54:04.482427] [DEBUG] [LOCAL ] MHN: Primary data saved (7437 records). [2025-10-21T19:54:04.482517] [INFO ] [MAIN ] MHN: Full history saved. [2025-10-21T19:54:04.482586] [INFO ] [MAIN ] Update Progress: 1351/2366 symbols completed. MHN took 19.0s. Estimated remaining: 2h 10m 44s. Rate: 7.8 symbols/min [2025-10-21T19:54:04.651051] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:54:04.651184] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-10-21T19:54:04.651218] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-10-21T19:54:04.651323] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-10-21T19:54:04.651363] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-21T19:54:04.651402] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-21T19:54:04.651434] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-10-21T19:54:04.798345] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T19:54:04.956195] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-10-21T19:54:05.010998] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:54:05.359933] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-21T19:54:05.751014] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-10-21T19:54:06.551091] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-10-21T19:54:06.795498] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-21T19:54:07.337835] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T19:54:07.350970] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-10-21T19:54:08.151023] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-10-21T19:54:08.459001] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-21T19:54:08.951000] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-10-21T19:54:08.975097] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T19:54:09.325042] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-21T19:54:09.751007] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-10-21T19:54:09.937492] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:54:09.937857] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-10-21T19:54:09.937951] [FATAL] [REMOTE ] MIAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:54:09.937995] [FATAL] [MAIN ] MIAX: Failed to fetch primary data. [2025-10-21T19:54:09.938054] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:54:09.938123] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-10-21T19:54:09.938185] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-10-21T19:54:09.938220] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-10-21T19:54:09.938258] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-10-21T19:54:09.938302] [INFO ] [MAIN ] Update Progress: 1352/2366 symbols completed. MIAX took 5.5s. Estimated remaining: 2h 10m 34s. Rate: 7.8 symbols/min [2025-10-21T19:54:10.112443] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:54:10.129602] [DEBUG] [LOCAL ] MIN: Loaded 13919 existing records from primary storage. [2025-10-21T19:54:10.129870] [INFO ] [MAIN ] MIN: Loaded 13919 existing records. [2025-10-21T19:54:10.308858] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:54:10.309072] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-10-21T19:54:10.309119] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-10-21T19:54:10.309276] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-10-21T19:54:10.309314] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-10-21T19:54:10.556294] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-10. [2025-10-21T19:54:10.673217] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:54:11.153678] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T19:54:11.154353] [INFO ] [REMOTE ] MHLA: Full fetch complete (1504 records). [2025-10-21T19:54:11.154418] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-10-21T19:54:11.154766] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T19:54:11.154847] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:54:11.154909] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:54:11.154978] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-10-21T19:54:11.155039] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-10-21T19:54:11.155074] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-10-21T19:54:11.155112] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-10-21T19:54:11.155162] [INFO ] [MAIN ] Update Progress: 1353/2366 symbols completed. MHLA took 30.8s. Estimated remaining: 2h 10m 22s. Rate: 7.8 symbols/min [2025-10-21T19:54:11.328386] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:54:11.354908] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-10-21T19:54:11.377458] [DEBUG] [LOCAL ] MIR: Loaded 51381 existing records from primary storage. [2025-10-21T19:54:11.377836] [INFO ] [MAIN ] MIR: Loaded 51381 existing records. [2025-10-21T19:54:11.566519] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:54:11.566737] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-10-21T19:54:11.566791] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-10-21T19:54:11.566973] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-10-21T19:54:11.567011] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-10-21T19:54:11.925084] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:54:12.151012] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-10-21T19:54:12.455406] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T19:54:12.951027] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-10-21T19:54:13.667346] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T19:54:13.751003] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-10-21T19:54:13.987038] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T19:54:14.551010] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-10. [2025-10-21T19:54:14.608829] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T19:54:15.351063] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-10-21T19:54:16.151051] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-10-21T19:54:16.244426] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T19:54:16.251027] [INFO ] [REMOTE ] MHK: Full fetch complete (61235 records). [2025-10-21T19:54:16.251185] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-10-21T19:54:16.633639] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-10-21T19:54:16.633897] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-10-21T19:54:16.634949] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-10-21T19:54:16.635068] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-10-21T19:54:16.637305] [DEBUG] [LOCAL ] MHK: Trimmed 61235 records to 42005 (keeping 200 days of data) [2025-10-21T19:54:16.889408] [DEBUG] [LOCAL ] MHK: Primary data saved (42005 records). [2025-10-21T19:54:16.889671] [INFO ] [MAIN ] MHK: Full history saved. [2025-10-21T19:54:16.889817] [INFO ] [MAIN ] Update Progress: 1354/2366 symbols completed. MHK took 40.4s. Estimated remaining: 2h 10m 13s. Rate: 7.8 symbols/min [2025-10-21T19:54:16.974755] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-10-21T19:54:17.062941] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:54:17.063269] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-10-21T19:54:17.063445] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-10-21T19:54:17.063556] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-10-21T19:54:17.063605] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-21T19:54:17.078118] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-21T19:54:17.088092] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-10-21T19:54:17.154027] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T19:54:17.460076] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:54:17.514394] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T19:54:17.578723] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T19:54:17.751004] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-10-21T19:54:18.097493] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-21T19:54:18.551021] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-10-21T19:54:19.005832] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T19:54:19.351047] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-10-21T19:54:20.151072] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-10-21T19:54:20.937095] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T19:54:20.950972] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-10-21T19:54:21.113276] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T19:54:21.751000] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-10-21T19:54:21.835182] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T19:54:22.551074] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-10-21T19:54:22.877520] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T19:54:23.339778] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T19:54:23.350968] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-10-21T19:54:24.151068] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-10-21T19:54:24.175776] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T19:54:24.951023] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-10-21T19:54:25.756436] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-10. [2025-10-21T19:54:25.769587] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T19:54:26.070523] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T19:54:26.551079] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-10-21T19:54:26.963231] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T19:54:26.969217] [INFO ] [REMOTE ] MHO: Full fetch complete (36574 records). [2025-10-21T19:54:26.969452] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-10-21T19:54:27.320428] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T19:54:27.363308] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-10-21T19:54:27.412971] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-10-21T19:54:27.413058] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-10-21T19:54:27.413853] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-10-21T19:54:27.413916] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-10-21T19:54:27.414737] [DEBUG] [LOCAL ] MHO: Trimmed 36574 records to 23733 (keeping 200 days of data) [2025-10-21T19:54:27.554332] [DEBUG] [LOCAL ] MHO: Primary data saved (23733 records). [2025-10-21T19:54:27.554469] [INFO ] [MAIN ] MHO: Full history saved. [2025-10-21T19:54:27.554551] [INFO ] [MAIN ] Update Progress: 1355/2366 symbols completed. MHO took 36.1s. Estimated remaining: 2h 10m 7s. Rate: 7.8 symbols/min [2025-10-21T19:54:27.725585] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:54:27.729463] [DEBUG] [LOCAL ] MITP: Loaded 2277 existing records from primary storage. [2025-10-21T19:54:27.729613] [INFO ] [MAIN ] MITP: Loaded 2277 existing records. [2025-10-21T19:54:27.948896] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:54:27.949243] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-10-21T19:54:27.949298] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-10-21T19:54:27.949480] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-10-21T19:54:27.949540] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-10-21T19:54:28.154223] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-10-21T19:54:28.234865] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T19:54:28.339216] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:54:28.750459] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T19:54:28.951017] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-10. [2025-10-21T19:54:29.751017] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-10-21T19:54:29.859894] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T19:54:29.862843] [INFO ] [REMOTE ] MIN: Full fetch complete (17672 records). [2025-10-21T19:54:29.862910] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-10-21T19:54:30.225987] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-10-21T19:54:30.226083] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-10-21T19:54:30.226485] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-10-21T19:54:30.226525] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-10-21T19:54:30.227220] [DEBUG] [LOCAL ] MIN: Trimmed 17672 records to 13992 (keeping 200 days of data) [2025-10-21T19:54:30.310461] [DEBUG] [LOCAL ] MIN: Primary data saved (13992 records). [2025-10-21T19:54:30.310601] [INFO ] [MAIN ] MIN: Full history saved. [2025-10-21T19:54:30.310704] [INFO ] [MAIN ] Update Progress: 1356/2366 symbols completed. MIN took 20.4s. Estimated remaining: 2h 9m 56s. Rate: 7.8 symbols/min [2025-10-21T19:54:30.485065] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:54:30.507842] [DEBUG] [LOCAL ] MITT: Loaded 22548 existing records from primary storage. [2025-10-21T19:54:30.508139] [INFO ] [MAIN ] MITT: Loaded 22548 existing records. [2025-10-21T19:54:30.556274] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-10-21T19:54:30.693832] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:54:30.694093] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-10-21T19:54:30.694159] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-10-21T19:54:30.694379] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-10-21T19:54:30.694437] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-10-21T19:54:31.053233] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:54:31.086729] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-21T19:54:31.351047] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-10-21T19:54:31.546581] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T19:54:32.151047] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-10-21T19:54:32.572611] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T19:54:32.573385] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-21T19:54:32.951027] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-10-21T19:54:33.751049] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-10-21T19:54:34.059151] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T19:54:34.109102] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-21T19:54:34.551054] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-10-21T19:54:34.879348] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-21T19:54:35.351068] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-10-21T19:54:36.151051] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-10-21T19:54:36.546880] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T19:54:36.592996] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T19:54:36.951017] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-10-21T19:54:37.292176] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-21T19:54:37.751032] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-10-21T19:54:38.182169] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T19:54:38.551037] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-10-21T19:54:39.024098] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T19:54:39.351024] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-10-21T19:54:40.151118] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-10-21T19:54:40.491238] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-21T19:54:40.950995] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-10-21T19:54:41.117414] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T19:54:41.751019] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-10-21T19:54:41.985446] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T19:54:42.352593] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T19:54:42.551024] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-10. [2025-10-21T19:54:43.012193] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T19:54:43.013285] [INFO ] [REMOTE ] MITN: Full fetch complete (2356 records). [2025-10-21T19:54:43.013356] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-10-21T19:54:43.221934] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T19:54:43.222138] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:54:43.222204] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:54:43.222258] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-10-21T19:54:43.222346] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-10-21T19:54:43.222400] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-10-21T19:54:43.222443] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-10-21T19:54:43.222499] [INFO ] [MAIN ] Update Progress: 1357/2366 symbols completed. MITN took 26.3s. Estimated remaining: 2h 9m 52s. Rate: 7.8 symbols/min [2025-10-21T19:54:43.351050] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-10-21T19:54:43.895901] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-21T19:54:44.151045] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-10-21T19:54:44.951052] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-10-21T19:54:45.201296] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T19:54:45.397548] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T19:54:45.751041] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-10-21T19:54:46.551099] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-10-21T19:54:46.998093] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T19:54:47.351040] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-10-21T19:54:48.150990] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-10-21T19:54:48.231150] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T19:54:48.369837] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T19:54:48.584065] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T19:54:48.951037] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-10-21T19:54:49.751090] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-10-21T19:54:50.550997] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-10-21T19:54:50.690168] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T19:54:50.820490] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T19:54:50.966741] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T19:54:51.351024] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-10-21T19:54:52.151022] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-10-21T19:54:52.645229] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T19:54:52.950991] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-10-21T19:54:53.206894] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T19:54:53.626005] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T19:54:53.751590] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-10. [2025-10-21T19:54:54.194081] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T19:54:54.194895] [INFO ] [REMOTE ] MITP: Full fetch complete (3243 records). [2025-10-21T19:54:54.194961] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-10-21T19:54:54.552336] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-10. [2025-10-21T19:54:54.552954] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-10-21T19:54:54.553671] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-10-21T19:54:54.553823] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-10-21T19:54:54.553864] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-10-21T19:54:54.554191] [DEBUG] [LOCAL ] MITP: Trimmed 3243 records to 2255 (keeping 200 days of data) [2025-10-21T19:54:54.567542] [DEBUG] [LOCAL ] MITP: Primary data saved (2255 records). [2025-10-21T19:54:54.567603] [INFO ] [MAIN ] MITP: Full history saved. [2025-10-21T19:54:54.567692] [INFO ] [MAIN ] Update Progress: 1358/2366 symbols completed. MITP took 27.0s. Estimated remaining: 2h 9m 47s. Rate: 7.8 symbols/min [2025-10-21T19:54:55.351031] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-10-21T19:54:55.755428] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T19:54:55.759131] [INFO ] [REMOTE ] MITT: Full fetch complete (33567 records). [2025-10-21T19:54:55.759229] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-10-21T19:54:56.153130] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-10-21T19:54:56.153228] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-10-21T19:54:56.154059] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-10-21T19:54:56.154120] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-10-21T19:54:56.154933] [DEBUG] [LOCAL ] MITT: Trimmed 33567 records to 22416 (keeping 200 days of data) [2025-10-21T19:54:56.282800] [DEBUG] [LOCAL ] MITT: Primary data saved (22416 records). [2025-10-21T19:54:56.282928] [INFO ] [MAIN ] MITT: Full history saved. [2025-10-21T19:54:56.283006] [INFO ] [MAIN ] Update Progress: 1359/2366 symbols completed. MITT took 26.0s. Estimated remaining: 2h 9m 35s. Rate: 7.8 symbols/min [2025-10-21T19:54:57.036277] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:54:57.047553] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-10-21T19:54:58.750540] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T19:54:58.761902] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-10. [2025-10-21T19:55:00.582334] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T19:55:00.590915] [INFO ] [REMOTE ] MIR: Full fetch complete (73953 records). [2025-10-21T19:55:00.591083] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-10-21T19:55:00.970716] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-10-21T19:55:00.970802] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-10-21T19:55:00.971823] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-10-21T19:55:00.971884] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-10-21T19:55:00.973195] [DEBUG] [LOCAL ] MIR: Trimmed 73953 records to 51399 (keeping 200 days of data) [2025-10-21T19:55:01.270585] [DEBUG] [LOCAL ] MIR: Primary data saved (51399 records). [2025-10-21T19:55:01.270744] [INFO ] [MAIN ] MIR: Full history saved. [2025-10-21T19:55:01.271415] [INFO ] [MAIN ] Update Progress: 1360/2366 symbols completed. MIR took 50.1s. Estimated remaining: 2h 9m 25s. Rate: 7.8 symbols/min [2025-10-21T19:55:01.887532] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:01.965086] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:01.969076] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:01.965886] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:01.979815] [DEBUG] [LOCAL ] MIY: Loaded 6244 existing records from primary storage. [2025-10-21T19:55:01.980102] [INFO ] [MAIN ] MIY: Loaded 6244 existing records. [2025-10-21T19:55:02.228008] [DEBUG] [LOCAL ] MKL: Loaded 34079 existing records from primary storage. [2025-10-21T19:55:02.247092] [DEBUG] [LOCAL ] MLI: Loaded 43423 existing records from primary storage. [2025-10-21T19:55:02.273356] [INFO ] [MAIN ] MLI: Loaded 43423 existing records. [2025-10-21T19:55:02.246527] [INFO ] [MAIN ] MKL: Loaded 34079 existing records. [2025-10-21T19:55:02.273078] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:02.296390] [DEBUG] [LOCAL ] MKC: Loaded 52529 existing records from primary storage. [2025-10-21T19:55:02.319612] [INFO ] [MAIN ] MKC: Loaded 52529 existing records. [2025-10-21T19:55:02.423545] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-10-21T19:55:02.531514] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-10-21T19:55:02.625975] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-10-21T19:55:02.667746] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-10-21T19:55:02.816241] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:02.890161] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-10-21T19:55:02.941061] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:02.904606] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:02.946390] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-10-21T19:55:02.956831] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-10-21T19:55:02.967287] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-10-21T19:55:02.977572] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-10-21T19:55:02.977902] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-10-21T19:55:02.978056] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-10-21T19:55:02.978214] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-10-21T19:55:02.978300] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-10-21T19:55:02.978708] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-10-21T19:55:02.984287] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-10-21T19:55:02.984172] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-10-21T19:55:03.906893] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:04.008532] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-10-21T19:55:04.296826] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:04.386354] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-10-21T19:55:04.386110] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:04.392029] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:04.393098] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-10-21T19:55:04.393927] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-10-21T19:55:04.765319] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T19:55:04.767071] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-10-21T19:55:05.337791] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T19:55:05.339490] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-10-21T19:55:05.750911] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T19:55:05.759260] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-10-21T19:55:05.836966] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T19:55:05.844581] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-10-21T19:55:05.931244] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T19:55:05.933047] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-10-21T19:55:06.510429] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-21T19:55:06.520477] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-10-21T19:55:06.687430] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T19:55:06.689587] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-10-21T19:55:07.121522] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T19:55:07.130109] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-10-21T19:55:07.434148] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T19:55:07.435873] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-10-21T19:55:07.489363] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T19:55:07.779297] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T19:55:07.828265] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-21T19:55:08.150997] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-10-21T19:55:08.907245] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T19:55:08.924278] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T19:55:08.951010] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-10-21T19:55:09.751074] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-10-21T19:55:10.363801] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:55:10.551038] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-10-21T19:55:10.814200] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T19:55:11.351038] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-10-21T19:55:11.557955] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:55:12.151010] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-10-21T19:55:12.951040] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-10-21T19:55:13.078871] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T19:55:13.674810] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T19:55:13.750992] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-10-21T19:55:14.551074] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-10-21T19:55:14.904134] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T19:55:15.061144] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T19:55:15.184842] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T19:55:15.351039] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-10-21T19:55:16.151083] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-10. [2025-10-21T19:55:16.941500] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T19:55:16.943307] [INFO ] [REMOTE ] MIY: Full fetch complete (8695 records). [2025-10-21T19:55:16.943491] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-10-21T19:55:16.956204] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-10-21T19:55:17.331504] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-10-21T19:55:17.331612] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-10-21T19:55:17.331968] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-10-21T19:55:17.332050] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-10-21T19:55:17.332924] [DEBUG] [LOCAL ] MIY: Trimmed 8695 records to 6214 (keeping 200 days of data) [2025-10-21T19:55:17.402811] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T19:55:17.417439] [DEBUG] [LOCAL ] MIY: Primary data saved (6214 records). [2025-10-21T19:55:17.418007] [INFO ] [MAIN ] MIY: Full history saved. [2025-10-21T19:55:17.418113] [INFO ] [MAIN ] Update Progress: 1361/2366 symbols completed. MIY took 16.1s. Estimated remaining: 2h 9m 23s. Rate: 7.8 symbols/min [2025-10-21T19:55:17.598714] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:17.625374] [DEBUG] [LOCAL ] MLM: Loaded 29020 existing records from primary storage. [2025-10-21T19:55:17.625701] [INFO ] [MAIN ] MLM: Loaded 29020 existing records. [2025-10-21T19:55:17.763286] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-10-21T19:55:17.805741] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:17.805915] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-10-21T19:55:17.805976] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-10-21T19:55:17.806225] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-10-21T19:55:17.806281] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-10-21T19:55:18.173303] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:18.498081] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T19:55:18.551028] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-10-21T19:55:19.351067] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-10-21T19:55:19.600501] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T19:55:19.704411] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T19:55:20.151071] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-10-21T19:55:20.706168] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T19:55:20.950992] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-10-21T19:55:21.610818] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T19:55:21.751046] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-10-21T19:55:22.132831] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T19:55:22.551069] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-10-21T19:55:23.351042] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-10-21T19:55:23.603140] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T19:55:23.897438] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T19:55:24.151023] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-10-21T19:55:24.874350] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T19:55:24.951061] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-10-21T19:55:25.735054] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:55:25.750973] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-10. [2025-10-21T19:55:26.195891] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T19:55:26.551004] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-10-21T19:55:26.616007] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:55:26.624447] [INFO ] [REMOTE ] MKC: Full fetch complete (75945 records). [2025-10-21T19:55:26.624575] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-10-21T19:55:27.024667] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-10-21T19:55:27.024755] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-10-21T19:55:27.025794] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-10-21T19:55:27.025855] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-10-21T19:55:27.027190] [DEBUG] [LOCAL ] MKC: Trimmed 75945 records to 52527 (keeping 200 days of data) [2025-10-21T19:55:27.345808] [DEBUG] [LOCAL ] MKC: Primary data saved (52527 records). [2025-10-21T19:55:27.345937] [INFO ] [MAIN ] MKC: Full history saved. [2025-10-21T19:55:27.346450] [INFO ] [MAIN ] Update Progress: 1362/2366 symbols completed. MKC took 26.1s. Estimated remaining: 2h 9m 17s. Rate: 7.8 symbols/min [2025-10-21T19:55:27.357630] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-10-21T19:55:27.520147] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:27.548219] [DEBUG] [LOCAL ] MLNK: Loaded 27135 existing records from primary storage. [2025-10-21T19:55:27.548537] [INFO ] [MAIN ] MLNK: Loaded 27135 existing records. [2025-10-21T19:55:27.746068] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:27.746260] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-10-21T19:55:27.746306] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-10-21T19:55:27.746471] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-10-21T19:55:27.746508] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-10-21T19:55:28.114869] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:28.135890] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T19:55:28.150974] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-10-21T19:55:28.772089] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:55:28.951030] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-10-21T19:55:29.751074] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-10-21T19:55:29.859952] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T19:55:29.920318] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T19:55:30.551075] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-10-21T19:55:30.739240] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T19:55:31.351031] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-10. [2025-10-21T19:55:31.923145] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T19:55:32.151029] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-10-21T19:55:32.636914] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T19:55:32.642279] [INFO ] [REMOTE ] MKL: Full fetch complete (49940 records). [2025-10-21T19:55:32.642388] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-10-21T19:55:32.956300] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-10-21T19:55:33.040813] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-10-21T19:55:33.040886] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-10-21T19:55:33.041884] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-10-21T19:55:33.041950] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-10-21T19:55:33.043080] [DEBUG] [LOCAL ] MKL: Trimmed 49940 records to 33977 (keeping 200 days of data) [2025-10-21T19:55:33.252832] [DEBUG] [LOCAL ] MKL: Primary data saved (33977 records). [2025-10-21T19:55:33.252977] [INFO ] [MAIN ] MKL: Full history saved. [2025-10-21T19:55:33.253053] [INFO ] [MAIN ] Update Progress: 1363/2366 symbols completed. MKL took 32.0s. Estimated remaining: 2h 9m 8s. Rate: 7.8 symbols/min [2025-10-21T19:55:33.424765] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:33.430166] [DEBUG] [LOCAL ] MLP: Loaded 3092 existing records from primary storage. [2025-10-21T19:55:33.430315] [INFO ] [MAIN ] MLP: Loaded 3092 existing records. [2025-10-21T19:55:33.609442] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:33.609862] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-10-21T19:55:33.609931] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-10-21T19:55:33.610173] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-10-21T19:55:33.610305] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-10-21T19:55:33.762373] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-10. [2025-10-21T19:55:33.992344] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:34.016161] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T19:55:34.021252] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T19:55:34.551037] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-10-21T19:55:35.156073] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T19:55:35.162526] [INFO ] [REMOTE ] MLI: Full fetch complete (63200 records). [2025-10-21T19:55:35.162621] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-10-21T19:55:35.356210] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-10-21T19:55:35.546622] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-10-21T19:55:35.546775] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-10-21T19:55:35.547835] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-10-21T19:55:35.547986] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-10-21T19:55:35.549214] [DEBUG] [LOCAL ] MLI: Trimmed 63200 records to 43432 (keeping 200 days of data) [2025-10-21T19:55:35.814394] [DEBUG] [LOCAL ] MLI: Primary data saved (43432 records). [2025-10-21T19:55:35.814537] [INFO ] [MAIN ] MLI: Full history saved. [2025-10-21T19:55:35.814635] [INFO ] [MAIN ] Update Progress: 1364/2366 symbols completed. MLI took 34.5s. Estimated remaining: 2h 8m 57s. Rate: 7.8 symbols/min [2025-10-21T19:55:35.977634] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T19:55:36.022303] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:36.036984] [DEBUG] [LOCAL ] MLR: Loaded 12314 existing records from primary storage. [2025-10-21T19:55:36.037219] [INFO ] [MAIN ] MLR: Loaded 12314 existing records. [2025-10-21T19:55:36.156226] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-10-21T19:55:36.227402] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:36.227974] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-10-21T19:55:36.228052] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-21T19:55:36.228213] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-10-21T19:55:36.228252] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-10-21T19:55:36.598304] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:36.600201] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T19:55:36.883357] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T19:55:36.951077] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-10-21T19:55:37.751052] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-10-21T19:55:37.786248] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T19:55:38.551004] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-10-21T19:55:38.909842] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T19:55:39.351013] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-10-21T19:55:39.420080] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T19:55:40.151072] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-10-21T19:55:40.528920] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T19:55:40.951074] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-10-21T19:55:41.467923] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T19:55:41.750999] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-10-21T19:55:41.801748] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T19:55:42.226984] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T19:55:42.551099] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-10-21T19:55:43.351152] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-10-21T19:55:43.563506] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T19:55:43.826445] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T19:55:44.151086] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-10-21T19:55:44.951133] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-10-21T19:55:45.129784] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T19:55:45.751103] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-10-21T19:55:46.022616] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T19:55:46.551051] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-10-21T19:55:46.580846] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T19:55:47.351004] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-10-21T19:55:47.670375] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T19:55:48.151058] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-10-21T19:55:48.173108] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T19:55:48.951002] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-10-21T19:55:49.318297] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T19:55:49.725122] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T19:55:49.751028] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-10-21T19:55:50.551027] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-10-21T19:55:50.703724] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T19:55:51.350995] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-10-21T19:55:51.739157] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T19:55:52.005593] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T19:55:52.151034] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-10. [2025-10-21T19:55:52.951049] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-10-21T19:55:53.054710] [DEBUG] [REMOTE ] MLR: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-21T19:55:53.055070] [WARN ] [REMOTE ] MLR: No data returned for month 2025-09 [2025-10-21T19:55:53.055163] [FATAL] [REMOTE ] MLR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:55:53.055253] [FATAL] [MAIN ] MLR: Failed to fetch primary data. [2025-10-21T19:55:53.055315] [WARN ] [MAIN ] MLR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:55:53.055388] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-10-21T19:55:53.055453] [DEBUG] [LOCAL ] MLR: No primary data file found to delete. [2025-10-21T19:55:53.055490] [INFO ] [LOCAL ] MLR: Starting deletion of derivative data. [2025-10-21T19:55:53.055737] [DEBUG] [LOCAL ] MLR: Deleted derivative data file. [2025-10-21T19:55:53.055825] [INFO ] [MAIN ] Update Progress: 1365/2366 symbols completed. MLR took 17.2s. Estimated remaining: 2h 8m 56s. Rate: 7.8 symbols/min [2025-10-21T19:55:53.247970] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:53.300168] [DEBUG] [LOCAL ] MMC: Loaded 51958 existing records from primary storage. [2025-10-21T19:55:53.300475] [INFO ] [MAIN ] MMC: Loaded 51958 existing records. [2025-10-21T19:55:53.479816] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:53.487761] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-10-21T19:55:53.499316] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-10-21T19:55:53.499620] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-10-21T19:55:53.500291] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-10-21T19:55:53.534572] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T19:55:53.608086] [INFO ] [REMOTE ] MLNK: Full fetch complete (37659 records). [2025-10-21T19:55:53.610619] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-10-21T19:55:53.773238] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-10-21T19:55:54.145134] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:54.272008] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-10-21T19:55:54.272091] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-10-21T19:55:54.272879] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-10-21T19:55:54.272942] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-10-21T19:55:54.273867] [DEBUG] [LOCAL ] MLNK: Trimmed 37659 records to 27266 (keeping 200 days of data) [2025-10-21T19:55:54.428164] [DEBUG] [LOCAL ] MLNK: Primary data saved (27266 records). [2025-10-21T19:55:54.428299] [INFO ] [MAIN ] MLNK: Full history saved. [2025-10-21T19:55:54.428391] [INFO ] [MAIN ] Update Progress: 1366/2366 symbols completed. MLNK took 27.1s. Estimated remaining: 2h 8m 44s. Rate: 7.8 symbols/min [2025-10-21T19:55:54.501124] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T19:55:54.556114] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-10-21T19:55:54.604701] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:55:54.616556] [DEBUG] [LOCAL ] MMD: Loaded 10770 existing records from primary storage. [2025-10-21T19:55:54.616834] [INFO ] [MAIN ] MMD: Loaded 10770 existing records. [2025-10-21T19:55:54.791580] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:55:54.791866] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-10-21T19:55:54.791926] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-10-21T19:55:54.792337] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-10-21T19:55:54.792394] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-10-21T19:55:55.137964] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:55:55.351018] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-10-21T19:55:56.151057] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-10-21T19:55:56.361947] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T19:55:56.397459] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T19:55:56.951041] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-10-21T19:55:57.428570] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T19:55:57.480624] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T19:55:57.751024] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-10-21T19:55:58.551071] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-10-21T19:55:59.014815] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T19:55:59.351011] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-10. [2025-10-21T19:55:59.423863] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T19:56:00.151096] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-10-21T19:56:00.657505] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T19:56:00.662775] [INFO ] [REMOTE ] MLM: Full fetch complete (45162 records). [2025-10-21T19:56:00.662978] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-10-21T19:56:00.957104] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-10-21T19:56:01.047329] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-10-21T19:56:01.047407] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-10-21T19:56:01.048293] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-10-21T19:56:01.048355] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-10-21T19:56:01.049277] [DEBUG] [LOCAL ] MLM: Trimmed 45162 records to 28871 (keeping 200 days of data) [2025-10-21T19:56:01.227448] [DEBUG] [LOCAL ] MLM: Primary data saved (28871 records). [2025-10-21T19:56:01.228403] [INFO ] [MAIN ] MLM: Full history saved. [2025-10-21T19:56:01.228492] [INFO ] [MAIN ] Update Progress: 1367/2366 symbols completed. MLM took 43.8s. Estimated remaining: 2h 8m 35s. Rate: 7.8 symbols/min [2025-10-21T19:56:01.398848] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:56:01.415567] [DEBUG] [LOCAL ] MMI: Loaded 15464 existing records from primary storage. [2025-10-21T19:56:01.415834] [INFO ] [MAIN ] MMI: Loaded 15464 existing records. [2025-10-21T19:56:01.598847] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:56:01.599161] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-10-21T19:56:01.599330] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-10-21T19:56:01.599518] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-10-21T19:56:01.599573] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-10-21T19:56:01.709868] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T19:56:01.756106] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-10-21T19:56:01.967870] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:56:02.539176] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T19:56:02.550984] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-10-21T19:56:03.005415] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T19:56:03.048337] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:56:03.351017] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-10-21T19:56:03.892842] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-21T19:56:04.151033] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-10-21T19:56:04.922454] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T19:56:04.951013] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-10-21T19:56:05.751053] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-10-21T19:56:05.873773] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T19:56:06.551021] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-10-21T19:56:07.139789] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T19:56:07.350994] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-10-21T19:56:07.405556] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T19:56:08.098558] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T19:56:08.150981] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-10-21T19:56:08.951054] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-10-21T19:56:09.140290] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T19:56:09.395550] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T19:56:09.751038] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-10-21T19:56:10.551070] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-10. [2025-10-21T19:56:11.182732] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T19:56:11.183817] [INFO ] [REMOTE ] MLP: Full fetch complete (4399 records). [2025-10-21T19:56:11.183887] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-10-21T19:56:11.351680] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-10-21T19:56:11.567484] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-10-21T19:56:11.567578] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-10-21T19:56:11.567774] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-10-21T19:56:11.567847] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-10-21T19:56:11.568409] [DEBUG] [LOCAL ] MLP: Trimmed 4399 records to 3066 (keeping 200 days of data) [2025-10-21T19:56:11.586011] [DEBUG] [LOCAL ] MLP: Primary data saved (3066 records). [2025-10-21T19:56:11.586088] [INFO ] [MAIN ] MLP: Full history saved. [2025-10-21T19:56:11.586237] [INFO ] [MAIN ] Update Progress: 1368/2366 symbols completed. MLP took 38.3s. Estimated remaining: 2h 8m 29s. Rate: 7.8 symbols/min [2025-10-21T19:56:11.793640] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T19:56:11.792055] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:56:11.804518] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-10-21T19:56:11.804768] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-10-21T19:56:11.805294] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-10-21T19:56:11.805358] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-21T19:56:11.805433] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-21T19:56:11.805490] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-10-21T19:56:12.165690] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-10-21T19:56:12.172064] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:56:12.428545] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T19:56:12.951022] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-10-21T19:56:13.152451] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:56:13.152839] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-10-21T19:56:13.152943] [FATAL] [REMOTE ] MMID: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:56:13.153012] [FATAL] [MAIN ] MMID: Failed to fetch primary data. [2025-10-21T19:56:13.153079] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:56:13.153158] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-10-21T19:56:13.153223] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-10-21T19:56:13.153258] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-10-21T19:56:13.153295] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-10-21T19:56:13.153337] [INFO ] [MAIN ] Update Progress: 1369/2366 symbols completed. MMID took 1.6s. Estimated remaining: 2h 8m 17s. Rate: 7.8 symbols/min [2025-10-21T19:56:13.320737] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:56:13.320895] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-10-21T19:56:13.320930] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-10-21T19:56:13.321034] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-10-21T19:56:13.321073] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-21T19:56:13.321111] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-21T19:56:13.321142] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-10-21T19:56:13.682231] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:56:13.750998] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-10-21T19:56:14.097870] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T19:56:14.289762] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-21T19:56:14.551078] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-10-21T19:56:15.351043] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-10-21T19:56:15.560823] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T19:56:16.151079] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-10-21T19:56:16.951016] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-10-21T19:56:16.982317] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T19:56:17.067435] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T19:56:17.317464] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-21T19:56:17.751048] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-10-21T19:56:18.551002] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-10-21T19:56:18.709035] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-21T19:56:19.351036] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-10-21T19:56:19.777885] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-21T19:56:20.150999] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-10-21T19:56:20.255282] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T19:56:20.951066] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-10-21T19:56:21.061214] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T19:56:21.377397] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-21T19:56:21.751052] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-10-21T19:56:22.551053] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-10-21T19:56:22.608811] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T19:56:23.351046] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-10. [2025-10-21T19:56:23.494212] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T19:56:24.151019] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-10-21T19:56:24.252846] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T19:56:24.255019] [INFO ] [REMOTE ] MMD: Full fetch complete (17019 records). [2025-10-21T19:56:24.255105] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-10-21T19:56:24.640988] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-10-21T19:56:24.641064] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-10-21T19:56:24.641471] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-10-21T19:56:24.641510] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-10-21T19:56:24.642030] [DEBUG] [LOCAL ] MMD: Trimmed 17019 records to 10750 (keeping 200 days of data) [2025-10-21T19:56:24.709719] [DEBUG] [LOCAL ] MMD: Primary data saved (10750 records). [2025-10-21T19:56:24.709833] [INFO ] [MAIN ] MMD: Full history saved. [2025-10-21T19:56:24.709907] [INFO ] [MAIN ] Update Progress: 1370/2366 symbols completed. MMD took 30.3s. Estimated remaining: 2h 8m 12s. Rate: 7.8 symbols/min [2025-10-21T19:56:24.888399] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:56:24.945274] [DEBUG] [LOCAL ] MMM: Loaded 53112 existing records from primary storage. [2025-10-21T19:56:24.945564] [INFO ] [MAIN ] MMM: Loaded 53112 existing records. [2025-10-21T19:56:24.956704] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-10-21T19:56:25.075843] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T19:56:25.149384] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:56:25.149598] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-10-21T19:56:25.149668] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-10-21T19:56:25.150226] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-10-21T19:56:25.150283] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-10-21T19:56:25.513025] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:56:25.751023] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-10-21T19:56:26.261130] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-21T19:56:26.551110] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-10. [2025-10-21T19:56:26.841534] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T19:56:27.350981] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-10-21T19:56:27.588732] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T19:56:27.591936] [INFO ] [REMOTE ] MMI: Full fetch complete (21758 records). [2025-10-21T19:56:27.592006] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-10-21T19:56:27.955298] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-10-21T19:56:27.955373] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-10-21T19:56:27.955890] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-10-21T19:56:27.955950] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-10-21T19:56:27.956511] [DEBUG] [LOCAL ] MMI: Trimmed 21758 records to 15428 (keeping 200 days of data) [2025-10-21T19:56:28.047255] [DEBUG] [LOCAL ] MMI: Primary data saved (15428 records). [2025-10-21T19:56:28.047380] [INFO ] [MAIN ] MMI: Full history saved. [2025-10-21T19:56:28.047478] [INFO ] [MAIN ] Update Progress: 1371/2366 symbols completed. MMI took 26.8s. Estimated remaining: 2h 8m 1s. Rate: 7.8 symbols/min [2025-10-21T19:56:28.156140] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-10-21T19:56:28.247472] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:56:28.283508] [DEBUG] [LOCAL ] MMS: Loaded 33590 existing records from primary storage. [2025-10-21T19:56:28.283818] [INFO ] [MAIN ] MMS: Loaded 33590 existing records. [2025-10-21T19:56:28.460984] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:56:28.461201] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-10-21T19:56:28.461249] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-10-21T19:56:28.461438] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-10-21T19:56:28.461476] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-10-21T19:56:28.822250] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:56:28.950998] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-10-21T19:56:29.049327] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T19:56:29.295106] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T19:56:29.751033] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-10-21T19:56:30.174880] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T19:56:30.550992] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-10-21T19:56:31.350995] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-10-21T19:56:31.749429] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T19:56:32.151023] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-10-21T19:56:32.408134] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T19:56:32.470585] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-21T19:56:32.516244] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T19:56:32.951085] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-10-21T19:56:33.751114] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-10-21T19:56:34.551006] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-10-21T19:56:34.894759] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T19:56:34.931601] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T19:56:34.983526] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T19:56:35.351085] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-10-21T19:56:36.151090] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-10-21T19:56:36.581000] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T19:56:36.951028] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-10. [2025-10-21T19:56:37.438498] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T19:56:37.751061] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-10-21T19:56:37.780305] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:56:37.790278] [INFO ] [REMOTE ] MMC: Full fetch complete (75199 records). [2025-10-21T19:56:37.790417] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-10-21T19:56:38.175693] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-10-21T19:56:38.175778] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-10-21T19:56:38.176876] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-10-21T19:56:38.176937] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-10-21T19:56:38.178445] [DEBUG] [LOCAL ] MMC: Trimmed 75199 records to 51948 (keeping 200 days of data) [2025-10-21T19:56:38.496100] [DEBUG] [LOCAL ] MMC: Primary data saved (51948 records). [2025-10-21T19:56:38.496225] [INFO ] [MAIN ] MMC: Full history saved. [2025-10-21T19:56:38.496982] [INFO ] [MAIN ] Update Progress: 1372/2366 symbols completed. MMC took 45.4s. Estimated remaining: 2h 7m 56s. Rate: 7.8 symbols/min [2025-10-21T19:56:38.560334] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-10. [2025-10-21T19:56:38.668042] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:56:38.680630] [DEBUG] [LOCAL ] MMT: Loaded 10181 existing records from primary storage. [2025-10-21T19:56:38.680881] [INFO ] [MAIN ] MMT: Loaded 10181 existing records. [2025-10-21T19:56:38.858319] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:56:38.858512] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-10-21T19:56:38.858562] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-10-21T19:56:38.858766] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-10-21T19:56:38.858822] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-10-21T19:56:39.150071] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T19:56:39.151247] [INFO ] [REMOTE ] MMKT: Full fetch complete (2136 records). [2025-10-21T19:56:39.151350] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-10-21T19:56:39.304696] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:56:39.355896] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-10-21T19:56:39.425223] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T19:56:39.425418] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:56:39.425618] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:56:39.425726] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-10-21T19:56:39.425913] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-10-21T19:56:39.425971] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-10-21T19:56:39.443879] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-10-21T19:56:39.446435] [INFO ] [MAIN ] Update Progress: 1373/2366 symbols completed. MMKT took 26.3s. Estimated remaining: 2h 7m 43s. Rate: 7.8 symbols/min [2025-10-21T19:56:39.447814] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T19:56:39.624990] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:56:39.643014] [DEBUG] [LOCAL ] MMU: Loaded 16694 existing records from primary storage. [2025-10-21T19:56:39.643262] [INFO ] [MAIN ] MMU: Loaded 16694 existing records. [2025-10-21T19:56:39.824952] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:56:39.825174] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-10-21T19:56:39.825220] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-10-21T19:56:39.825407] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-10-21T19:56:39.825466] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-10-21T19:56:40.156125] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-10-21T19:56:40.196889] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:56:40.951056] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-10-21T19:56:41.422568] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T19:56:41.698296] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T19:56:41.714324] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T19:56:41.751019] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-10-21T19:56:42.551028] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-10-21T19:56:43.156768] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:56:43.295957] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T19:56:43.351019] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-10-21T19:56:44.151010] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-10-21T19:56:44.414706] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T19:56:44.951049] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-10-21T19:56:45.392943] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T19:56:45.751007] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-10-21T19:56:46.551082] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-10-21T19:56:46.746361] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T19:56:47.102352] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T19:56:47.135448] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T19:56:47.351017] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-10-21T19:56:48.111003] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T19:56:48.150999] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-10-21T19:56:48.951069] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-10-21T19:56:49.538035] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T19:56:49.648259] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T19:56:49.751009] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-10-21T19:56:50.551012] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-10-21T19:56:50.714381] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T19:56:51.351008] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-10-21T19:56:52.150992] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-10-21T19:56:52.606895] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T19:56:52.757777] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T19:56:52.889414] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T19:56:52.950988] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-10-21T19:56:53.751001] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-10-21T19:56:53.759293] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T19:56:54.551014] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-10-21T19:56:54.577716] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T19:56:55.351012] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-10-21T19:56:55.592162] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T19:56:56.151028] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-10-21T19:56:56.951017] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-10-21T19:56:57.272919] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T19:56:57.678394] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T19:56:57.750995] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-10-21T19:56:57.882202] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T19:56:58.551024] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-10-21T19:56:59.354736] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-10-21T19:56:59.357587] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T19:56:59.671076] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T19:57:00.151006] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-10. [2025-10-21T19:57:00.275982] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T19:57:00.951024] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-10. [2025-10-21T19:57:01.751057] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-10-21T19:57:01.916103] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T19:57:01.924393] [INFO ] [REMOTE ] MMM: Full fetch complete (77220 records). [2025-10-21T19:57:01.924514] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-10-21T19:57:02.320356] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-10-21T19:57:02.320434] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-10-21T19:57:02.321572] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-10-21T19:57:02.321636] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-10-21T19:57:02.323043] [DEBUG] [LOCAL ] MMM: Trimmed 77220 records to 53112 (keeping 200 days of data) [2025-10-21T19:57:02.551728] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-10-21T19:57:02.653513] [DEBUG] [LOCAL ] MMM: Primary data saved (53112 records). [2025-10-21T19:57:02.653703] [INFO ] [MAIN ] MMM: Full history saved. [2025-10-21T19:57:02.654471] [INFO ] [MAIN ] Update Progress: 1374/2366 symbols completed. MMM took 37.9s. Estimated remaining: 2h 7m 46s. Rate: 7.8 symbols/min [2025-10-21T19:57:02.823697] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:02.850898] [DEBUG] [LOCAL ] MNR: Loaded 25017 existing records from primary storage. [2025-10-21T19:57:02.851158] [INFO ] [MAIN ] MNR: Loaded 25017 existing records. [2025-10-21T19:57:03.051292] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:57:03.051515] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-10-21T19:57:03.051566] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-10-21T19:57:03.051805] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-10-21T19:57:03.051864] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-10-21T19:57:03.303293] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-21T19:57:03.318738] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T19:57:03.354122] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-10. [2025-10-21T19:57:03.348896] [INFO ] [REMOTE ] MMS: Full fetch complete (51198 records). [2025-10-21T19:57:03.395310] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-10-21T19:57:03.444257] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T19:57:03.521972] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:03.890987] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-10-21T19:57:03.891112] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-10-21T19:57:03.892548] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-10-21T19:57:03.892615] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-10-21T19:57:03.894210] [DEBUG] [LOCAL ] MMS: Trimmed 51198 records to 33484 (keeping 200 days of data) [2025-10-21T19:57:04.122277] [DEBUG] [LOCAL ] MMS: Primary data saved (33484 records). [2025-10-21T19:57:04.122495] [INFO ] [MAIN ] MMS: Full history saved. [2025-10-21T19:57:04.122605] [INFO ] [MAIN ] Update Progress: 1375/2366 symbols completed. MMS took 36.1s. Estimated remaining: 2h 7m 34s. Rate: 7.8 symbols/min [2025-10-21T19:57:04.156232] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-10-21T19:57:04.288068] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T19:57:04.318182] [INFO ] [REMOTE ] MMT: Full fetch complete (15936 records). [2025-10-21T19:57:04.319943] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:04.320300] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-10-21T19:57:04.681093] [DEBUG] [LOCAL ] MNSO: Loaded 44180 existing records from primary storage. [2025-10-21T19:57:04.709947] [INFO ] [MAIN ] MNSO: Loaded 44180 existing records. [2025-10-21T19:57:04.825835] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-10-21T19:57:04.832108] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-10-21T19:57:04.850359] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-10-21T19:57:04.862712] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-10-21T19:57:04.885181] [DEBUG] [LOCAL ] MMT: Trimmed 15936 records to 10203 (keeping 200 days of data) [2025-10-21T19:57:04.955707] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-10-21T19:57:04.985302] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:57:05.007414] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-10-21T19:57:05.009076] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-10-21T19:57:05.015237] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-10-21T19:57:05.017874] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-10-21T19:57:05.107800] [DEBUG] [LOCAL ] MMT: Primary data saved (10203 records). [2025-10-21T19:57:05.120073] [INFO ] [MAIN ] MMT: Full history saved. [2025-10-21T19:57:05.125370] [INFO ] [MAIN ] Update Progress: 1376/2366 symbols completed. MMT took 26.6s. Estimated remaining: 2h 7m 22s. Rate: 7.8 symbols/min [2025-10-21T19:57:05.550902] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:05.552404] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-10-21T19:57:05.562933] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-10-21T19:57:05.563635] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T19:57:05.569218] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-10-21T19:57:05.573477] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-21T19:57:05.578903] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-21T19:57:05.579340] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-10-21T19:57:05.738513] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:05.754354] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-10-21T19:57:06.079681] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T19:57:06.106742] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:06.551016] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-10. [2025-10-21T19:57:07.312921] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T19:57:07.350980] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-10-21T19:57:07.592199] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T19:57:07.595590] [INFO ] [REMOTE ] MMU: Full fetch complete (24995 records). [2025-10-21T19:57:07.595725] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-10-21T19:57:07.973158] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-10-21T19:57:07.973266] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-10-21T19:57:07.973906] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-10-21T19:57:07.973972] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-10-21T19:57:07.974861] [DEBUG] [LOCAL ] MMU: Trimmed 24995 records to 16751 (keeping 200 days of data) [2025-10-21T19:57:08.075204] [DEBUG] [LOCAL ] MMU: Primary data saved (16751 records). [2025-10-21T19:57:08.075346] [INFO ] [MAIN ] MMU: Full history saved. [2025-10-21T19:57:08.075423] [INFO ] [MAIN ] Update Progress: 1377/2366 symbols completed. MMU took 28.6s. Estimated remaining: 2h 7m 10s. Rate: 7.8 symbols/min [2025-10-21T19:57:08.158685] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-10-21T19:57:08.258208] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:08.258381] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-10-21T19:57:08.258419] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-10-21T19:57:08.258529] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-10-21T19:57:08.258572] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-21T19:57:08.258613] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-21T19:57:08.258671] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-10-21T19:57:08.487699] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:57:08.537766] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-10-21T19:57:08.548912] [FATAL] [REMOTE ] MNTN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:57:08.549089] [FATAL] [MAIN ] MNTN: Failed to fetch primary data. [2025-10-21T19:57:08.549431] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:57:08.554919] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-10-21T19:57:08.565288] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-10-21T19:57:08.570502] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-10-21T19:57:08.608805] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-10-21T19:57:08.623998] [INFO ] [MAIN ] Update Progress: 1378/2366 symbols completed. MNTN took 3.5s. Estimated remaining: 2h 6m 58s. Rate: 7.8 symbols/min [2025-10-21T19:57:08.629533] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:08.816068] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:08.858598] [DEBUG] [LOCAL ] MOD: Loaded 44610 existing records from primary storage. [2025-10-21T19:57:08.859217] [INFO ] [MAIN ] MOD: Loaded 44610 existing records. [2025-10-21T19:57:08.956263] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-10-21T19:57:09.044892] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:57:09.045375] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-10-21T19:57:09.045451] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-10-21T19:57:09.045845] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-10-21T19:57:09.045909] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-10-21T19:57:09.169506] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T19:57:09.430925] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:09.750992] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-10-21T19:57:10.551071] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-10-21T19:57:11.082494] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T19:57:11.209891] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-21T19:57:11.351073] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-10-21T19:57:12.151046] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-10-21T19:57:12.203145] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T19:57:12.501121] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T19:57:12.951083] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-10-21T19:57:13.751078] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-10-21T19:57:14.230009] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-21T19:57:14.310485] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T19:57:14.551011] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-10-21T19:57:15.082601] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T19:57:15.351055] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-10-21T19:57:16.151011] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-10-21T19:57:16.229626] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T19:57:16.418540] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T19:57:16.951029] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-10-21T19:57:17.751022] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-10-21T19:57:18.436758] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-21T19:57:18.506698] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T19:57:18.551002] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-10-21T19:57:19.018278] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-21T19:57:19.351061] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-10-21T19:57:20.151083] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-10-21T19:57:20.242908] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T19:57:20.950999] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-10-21T19:57:21.419201] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T19:57:21.676522] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-21T19:57:21.751037] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-10-21T19:57:22.551048] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-10-21T19:57:22.748851] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T19:57:22.749479] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T19:57:23.351074] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-10-21T19:57:24.151036] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-10-21T19:57:24.242691] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T19:57:24.756202] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T19:57:24.951002] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-10-21T19:57:25.751035] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-10-21T19:57:26.117517] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T19:57:26.511868] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T19:57:26.551032] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-10-21T19:57:27.269890] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T19:57:27.350981] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-10-21T19:57:28.151015] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-10-21T19:57:28.797355] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-21T19:57:28.951100] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-10-21T19:57:29.000392] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T19:57:29.496886] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T19:57:29.751090] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-10-21T19:57:30.551054] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-10-21T19:57:31.270286] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-21T19:57:31.306056] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T19:57:31.350986] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-10-21T19:57:31.726687] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T19:57:32.151089] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-10-21T19:57:32.951070] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-10-21T19:57:33.173462] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T19:57:33.590036] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-21T19:57:33.750991] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-10-21T19:57:34.527183] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T19:57:34.550997] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-10. [2025-10-21T19:57:35.351037] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-10. [2025-10-21T19:57:35.999027] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-21T19:57:36.151051] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-10. [2025-10-21T19:57:36.259579] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T19:57:36.266722] [INFO ] [REMOTE ] MNSO: Full fetch complete (64768 records). [2025-10-21T19:57:36.266835] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-10-21T19:57:36.385488] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T19:57:36.417393] [INFO ] [REMOTE ] MNR: Full fetch complete (36910 records). [2025-10-21T19:57:36.442465] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-10-21T19:57:36.985775] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-10-21T19:57:37.042860] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-10-21T19:57:37.053469] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-10-21T19:57:37.075823] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-10-21T19:57:37.100077] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-10-21T19:57:37.140339] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-10-21T19:57:37.140444] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-10-21T19:57:37.141593] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-10-21T19:57:37.141776] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-10-21T19:57:37.163357] [DEBUG] [LOCAL ] MNSO: Trimmed 64768 records to 44129 (keeping 200 days of data) [2025-10-21T19:57:37.165306] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T19:57:37.176020] [DEBUG] [LOCAL ] MNR: Trimmed 36910 records to 25091 (keeping 200 days of data) [2025-10-21T19:57:37.237971] [INFO ] [REMOTE ] MO: Full fetch complete (77541 records). [2025-10-21T19:57:37.264879] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-10-21T19:57:37.649308] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T19:57:37.650937] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T19:57:37.702776] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T19:57:37.702457] [DEBUG] [LOCAL ] MNR: Primary data saved (25091 records). [2025-10-21T19:57:37.711988] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-10-21T19:57:37.712068] [INFO ] [MAIN ] MNR: Full history saved. [2025-10-21T19:57:37.712249] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-10-21T19:57:37.737679] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-10-21T19:57:37.739760] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-10-21T19:57:37.740097] [INFO ] [MAIN ] Update Progress: 1379/2366 symbols completed. MO took 29.7s. Estimated remaining: 2h 7m 5s. Rate: 7.8 symbols/min [2025-10-21T19:57:37.745501] [INFO ] [MAIN ] Update Progress: 1380/2366 symbols completed. MNR took 35.1s. Estimated remaining: 2h 6m 52s. Rate: 7.8 symbols/min [2025-10-21T19:57:38.090441] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:38.092807] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:38.154517] [DEBUG] [LOCAL ] MNSO: Primary data saved (44129 records). [2025-10-21T19:57:38.154677] [INFO ] [MAIN ] MNSO: Full history saved. [2025-10-21T19:57:38.154778] [INFO ] [MAIN ] Update Progress: 1381/2366 symbols completed. MNSO took 34.0s. Estimated remaining: 2h 6m 39s. Rate: 7.8 symbols/min [2025-10-21T19:57:38.306204] [DEBUG] [LOCAL ] MODG: Loaded 51551 existing records from primary storage. [2025-10-21T19:57:38.317114] [DEBUG] [LOCAL ] MOH: Loaded 43003 existing records from primary storage. [2025-10-21T19:57:38.347949] [INFO ] [MAIN ] MODG: Loaded 51551 existing records. [2025-10-21T19:57:38.359406] [INFO ] [MAIN ] MOH: Loaded 43003 existing records. [2025-10-21T19:57:38.408753] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:38.669268] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:57:38.702139] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-10-21T19:57:38.714202] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-10-21T19:57:38.717094] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-10-21T19:57:38.734004] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-10-21T19:57:38.740187] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:57:38.788685] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-10-21T19:57:38.822397] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-10-21T19:57:38.872745] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-10-21T19:57:38.880432] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-10-21T19:57:38.880240] [DEBUG] [LOCAL ] MOS: Loaded 53512 existing records from primary storage. [2025-10-21T19:57:38.914757] [INFO ] [MAIN ] MOS: Loaded 53512 existing records. [2025-10-21T19:57:39.448012] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:39.582203] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:57:39.540274] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-10-21T19:57:39.603168] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-10-21T19:57:39.620171] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-10-21T19:57:39.605216] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-21T19:57:39.669077] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-10-21T19:57:39.684248] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-10-21T19:57:39.716306] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-10. [2025-10-21T19:57:39.915454] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:39.937203] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-10-21T19:57:40.149909] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:40.150980] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-10-21T19:57:41.299050] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T19:57:41.306052] [INFO ] [REMOTE ] MOD: Full fetch complete (66411 records). [2025-10-21T19:57:41.306176] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-10-21T19:57:41.505787] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T19:57:41.566487] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-10-21T19:57:41.671114] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-21T19:57:41.769475] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-10-21T19:57:41.769242] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-10-21T19:57:41.769601] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-10-21T19:57:41.771446] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-10-21T19:57:41.771779] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-10-21T19:57:41.782758] [DEBUG] [LOCAL ] MOD: Trimmed 66411 records to 44532 (keeping 200 days of data) [2025-10-21T19:57:41.802141] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T19:57:42.069719] [DEBUG] [LOCAL ] MOD: Primary data saved (44532 records). [2025-10-21T19:57:42.069838] [INFO ] [MAIN ] MOD: Full history saved. [2025-10-21T19:57:42.070593] [INFO ] [MAIN ] Update Progress: 1382/2366 symbols completed. MOD took 33.4s. Estimated remaining: 2h 6m 29s. Rate: 7.8 symbols/min [2025-10-21T19:57:42.238956] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:57:42.261327] [DEBUG] [LOCAL ] MOV: Loaded 21500 existing records from primary storage. [2025-10-21T19:57:42.261563] [INFO ] [MAIN ] MOV: Loaded 21500 existing records. [2025-10-21T19:57:42.435996] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:57:42.436208] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-10-21T19:57:42.436254] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-10-21T19:57:42.436428] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-10-21T19:57:42.436464] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-10-21T19:57:42.556171] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-10-21T19:57:42.796036] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:57:43.187873] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T19:57:43.351036] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-10-21T19:57:43.682088] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T19:57:44.151057] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-10-21T19:57:44.260452] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:57:44.343940] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T19:57:44.951123] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-10-21T19:57:45.750997] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-10-21T19:57:45.831639] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T19:57:46.551057] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-10-21T19:57:46.772222] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T19:57:46.848706] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T19:57:47.351077] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-10-21T19:57:48.151074] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-10-21T19:57:48.191262] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T19:57:48.859140] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T19:57:48.950992] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-10-21T19:57:49.269625] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T19:57:49.751070] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-10-21T19:57:50.551015] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-10-21T19:57:50.679675] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T19:57:51.351006] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-10-21T19:57:51.470185] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T19:57:52.148475] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T19:57:52.156629] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-10-21T19:57:52.683853] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T19:57:52.951032] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-10-21T19:57:53.161515] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T19:57:53.751085] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-10-21T19:57:54.362810] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T19:57:54.551003] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-10-21T19:57:54.568041] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T19:57:55.351096] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-10-21T19:57:56.032888] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T19:57:56.151021] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-10-21T19:57:56.951013] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-10-21T19:57:56.992956] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T19:57:57.750993] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-10-21T19:57:58.065112] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T19:57:58.160552] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T19:57:58.551076] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-10-21T19:57:59.351000] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-10-21T19:57:59.541534] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T19:57:59.597928] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T19:58:00.151033] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-10-21T19:58:00.951070] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-10-21T19:58:01.751024] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-10-21T19:58:01.841474] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-21T19:58:02.551061] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-10-21T19:58:02.704457] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-21T19:58:02.774969] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T19:58:03.351071] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-10-21T19:58:03.798163] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-21T19:58:04.151008] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-10-21T19:58:04.733950] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T19:58:04.950985] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-10. [2025-10-21T19:58:05.415210] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T19:58:05.750994] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-10-21T19:58:06.072535] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T19:58:06.485869] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T19:58:06.494138] [INFO ] [REMOTE ] MOH: Full fetch complete (59692 records). [2025-10-21T19:58:06.494399] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-10-21T19:58:06.559282] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-10-21T19:58:06.885852] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-10-21T19:58:06.885954] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-10-21T19:58:06.886969] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-10-21T19:58:06.887033] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-10-21T19:58:06.888424] [DEBUG] [LOCAL ] MOH: Trimmed 59692 records to 43015 (keeping 200 days of data) [2025-10-21T19:58:07.150311] [DEBUG] [LOCAL ] MOH: Primary data saved (43015 records). [2025-10-21T19:58:07.150440] [INFO ] [MAIN ] MOH: Full history saved. [2025-10-21T19:58:07.150518] [INFO ] [MAIN ] Update Progress: 1383/2366 symbols completed. MOH took 29.4s. Estimated remaining: 2h 6m 33s. Rate: 7.8 symbols/min [2025-10-21T19:58:07.328828] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:58:07.356692] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-10. [2025-10-21T19:58:07.380119] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-21T19:58:07.380481] [INFO ] [MAIN ] MP: Loaded 53744 existing records. [2025-10-21T19:58:07.561770] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:58:07.562769] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-10-21T19:58:07.562968] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-10-21T19:58:07.563463] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-10-21T19:58:07.563536] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-10-21T19:58:07.690962] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T19:58:07.927211] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-21T19:58:08.049748] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:58:08.151036] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-10-21T19:58:08.811347] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T19:58:08.819275] [INFO ] [REMOTE ] MODG: Full fetch complete (74810 records). [2025-10-21T19:58:08.819390] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-10-21T19:58:08.965591] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-10. [2025-10-21T19:58:09.218887] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-10-21T19:58:09.218968] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-10-21T19:58:09.220035] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-10-21T19:58:09.220098] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-10-21T19:58:09.221453] [DEBUG] [LOCAL ] MODG: Trimmed 74810 records to 51537 (keeping 200 days of data) [2025-10-21T19:58:09.508765] [DEBUG] [LOCAL ] MODG: Primary data saved (51537 records). [2025-10-21T19:58:09.508889] [INFO ] [MAIN ] MODG: Full history saved. [2025-10-21T19:58:09.508964] [INFO ] [MAIN ] Update Progress: 1384/2366 symbols completed. MODG took 31.8s. Estimated remaining: 2h 6m 22s. Rate: 7.8 symbols/min [2025-10-21T19:58:09.681737] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:58:09.693042] [DEBUG] [LOCAL ] MPA: Loaded 5274 existing records from primary storage. [2025-10-21T19:58:09.693370] [INFO ] [MAIN ] MPA: Loaded 5274 existing records. [2025-10-21T19:58:09.769175] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-10-21T19:58:09.880038] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:58:09.880362] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-10-21T19:58:09.880472] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-10-21T19:58:09.880758] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-10-21T19:58:09.880870] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-10-21T19:58:10.030021] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T19:58:10.216061] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T19:58:10.245001] [INFO ] [REMOTE ] MOV: Full fetch complete (30491 records). [2025-10-21T19:58:10.269747] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-10-21T19:58:10.364175] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:58:10.557315] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-10-21T19:58:10.672500] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-10-21T19:58:10.672617] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-10-21T19:58:10.673529] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-10-21T19:58:10.673604] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-10-21T19:58:10.674456] [DEBUG] [LOCAL ] MOV: Trimmed 30491 records to 21325 (keeping 200 days of data) [2025-10-21T19:58:10.799639] [DEBUG] [LOCAL ] MOV: Primary data saved (21325 records). [2025-10-21T19:58:10.799784] [INFO ] [MAIN ] MOV: Full history saved. [2025-10-21T19:58:10.799858] [INFO ] [MAIN ] Update Progress: 1385/2366 symbols completed. MOV took 28.7s. Estimated remaining: 2h 6m 9s. Rate: 7.8 symbols/min [2025-10-21T19:58:10.971314] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:58:11.024468] [DEBUG] [LOCAL ] MPC: Loaded 51981 existing records from primary storage. [2025-10-21T19:58:11.024836] [INFO ] [MAIN ] MPC: Loaded 51981 existing records. [2025-10-21T19:58:11.130633] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T19:58:11.210932] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:58:11.211185] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-10-21T19:58:11.211247] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-10-21T19:58:11.211440] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-10-21T19:58:11.211497] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-10-21T19:58:11.353628] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-10-21T19:58:11.578803] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:58:11.605732] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T19:58:12.043799] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T19:58:12.150987] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-10-21T19:58:12.951126] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-10. [2025-10-21T19:58:13.751009] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-10-21T19:58:13.868245] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T19:58:13.878389] [INFO ] [REMOTE ] MOS: Full fetch complete (77630 records). [2025-10-21T19:58:13.878689] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-10-21T19:58:14.306745] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-10-21T19:58:14.306920] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-10-21T19:58:14.308196] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-10-21T19:58:14.308454] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-10-21T19:58:14.336048] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-21T19:58:14.336190] [DEBUG] [LOCAL ] MOS: Trimmed 77630 records to 53511 (keeping 200 days of data) [2025-10-21T19:58:14.555777] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-10-21T19:58:14.670427] [DEBUG] [LOCAL ] MOS: Primary data saved (53511 records). [2025-10-21T19:58:14.670570] [INFO ] [MAIN ] MOS: Full history saved. [2025-10-21T19:58:14.671513] [INFO ] [MAIN ] Update Progress: 1386/2366 symbols completed. MOS took 36.5s. Estimated remaining: 2h 5m 59s. Rate: 7.8 symbols/min [2025-10-21T19:58:14.838629] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:58:14.889534] [DEBUG] [LOCAL ] MPLX: Loaded 50822 existing records from primary storage. [2025-10-21T19:58:14.889864] [INFO ] [MAIN ] MPLX: Loaded 50822 existing records. [2025-10-21T19:58:15.066798] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:58:15.067051] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-10-21T19:58:15.067101] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-10-21T19:58:15.067279] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-10-21T19:58:15.067316] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-10-21T19:58:15.158347] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T19:58:15.354522] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-10-21T19:58:15.448112] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:58:15.573438] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T19:58:16.150989] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-10-21T19:58:16.951011] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-10-21T19:58:17.300130] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T19:58:17.751093] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-10-21T19:58:17.905623] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T19:58:18.288310] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T19:58:18.448658] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T19:58:18.550986] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-10-21T19:58:19.237536] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T19:58:19.350984] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-10-21T19:58:20.120880] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T19:58:20.151060] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-10-21T19:58:20.771156] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-21T19:58:20.951019] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-10-21T19:58:21.751061] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-10-21T19:58:22.550996] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-10-21T19:58:22.815502] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T19:58:23.149745] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T19:58:23.350993] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-10-21T19:58:23.453128] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T19:58:24.151036] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-10-21T19:58:24.951091] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-10-21T19:58:25.330191] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-21T19:58:25.545720] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-21T19:58:25.751006] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-10. [2025-10-21T19:58:25.981448] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:58:26.389400] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T19:58:26.390684] [INFO ] [REMOTE ] MPA: Full fetch complete (7032 records). [2025-10-21T19:58:26.390757] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-10-21T19:58:26.557286] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-10-21T19:58:26.761450] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-10-21T19:58:26.761526] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-10-21T19:58:26.761729] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-10-21T19:58:26.761819] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-10-21T19:58:26.762211] [DEBUG] [LOCAL ] MPA: Trimmed 7032 records to 5218 (keeping 200 days of data) [2025-10-21T19:58:26.792920] [DEBUG] [LOCAL ] MPA: Primary data saved (5218 records). [2025-10-21T19:58:26.793025] [INFO ] [MAIN ] MPA: Full history saved. [2025-10-21T19:58:26.793096] [INFO ] [MAIN ] Update Progress: 1387/2366 symbols completed. MPA took 17.3s. Estimated remaining: 2h 5m 54s. Rate: 7.8 symbols/min [2025-10-21T19:58:26.960689] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:58:26.967541] [DEBUG] [LOCAL ] MPV: Loaded 4405 existing records from primary storage. [2025-10-21T19:58:26.967793] [INFO ] [MAIN ] MPV: Loaded 4405 existing records. [2025-10-21T19:58:27.145084] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:58:27.145310] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-10-21T19:58:27.145357] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-10-21T19:58:27.145483] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-10-21T19:58:27.145519] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-10-21T19:58:27.356138] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-10-21T19:58:27.504220] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:58:28.151066] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-10-21T19:58:28.581989] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T19:58:28.770408] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T19:58:28.951012] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-10-21T19:58:29.227120] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T19:58:29.751069] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-10-21T19:58:30.551024] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-10-21T19:58:30.700819] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T19:58:31.351002] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-10-21T19:58:31.676104] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T19:58:31.971831] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T19:58:32.151032] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-10-21T19:58:32.729932] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T19:58:32.951051] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-10-21T19:58:33.672430] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T19:58:33.750998] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-10-21T19:58:33.918396] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T19:58:34.359708] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T19:58:34.551064] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-10-21T19:58:35.290302] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T19:58:35.351056] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-10-21T19:58:36.151024] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-10-21T19:58:36.951029] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-10-21T19:58:37.678528] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-21T19:58:37.750981] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-10-21T19:58:37.981034] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T19:58:38.558199] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-10-21T19:58:38.565300] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T19:58:39.179725] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T19:58:39.351139] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-10-21T19:58:39.928418] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T19:58:39.974873] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-21T19:58:40.151000] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-10-21T19:58:40.756756] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T19:58:40.951020] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-10-21T19:58:41.751043] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-10-21T19:58:42.386634] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-21T19:58:42.551041] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-10-21T19:58:43.351002] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-10-21T19:58:43.507214] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-21T19:58:43.758688] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T19:58:44.151072] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-10-21T19:58:44.951095] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-10. [2025-10-21T19:58:45.032834] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T19:58:45.383381] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-21T19:58:45.384438] [INFO ] [REMOTE ] MPV: Full fetch complete (7605 records). [2025-10-21T19:58:45.384505] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-10-21T19:58:45.742591] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-10-21T19:58:45.742698] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-10-21T19:58:45.742910] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-10-21T19:58:45.742950] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-10-21T19:58:45.743314] [DEBUG] [LOCAL ] MPV: Trimmed 7605 records to 4372 (keeping 200 days of data) [2025-10-21T19:58:45.756501] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-10-21T19:58:45.770324] [DEBUG] [LOCAL ] MPV: Primary data saved (4372 records). [2025-10-21T19:58:45.770393] [INFO ] [MAIN ] MPV: Full history saved. [2025-10-21T19:58:45.770463] [INFO ] [MAIN ] Update Progress: 1388/2366 symbols completed. MPV took 19.0s. Estimated remaining: 2h 5m 55s. Rate: 7.8 symbols/min [2025-10-21T19:58:45.941939] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:58:46.014516] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T19:58:46.028572] [DEBUG] [LOCAL ] MPW: Loaded 53498 existing records from primary storage. [2025-10-21T19:58:46.029331] [INFO ] [MAIN ] MPW: Loaded 53498 existing records. [2025-10-21T19:58:46.204253] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:58:46.204457] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-10-21T19:58:46.204505] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-10-21T19:58:46.204735] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-10-21T19:58:46.204793] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-10-21T19:58:46.554274] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-10. [2025-10-21T19:58:46.554177] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:58:47.351081] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-10-21T19:58:47.424007] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T19:58:47.431903] [INFO ] [REMOTE ] MPC: Full fetch complete (75741 records). [2025-10-21T19:58:47.432021] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-10-21T19:58:47.833033] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-10-21T19:58:47.833140] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-10-21T19:58:47.834410] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-10-21T19:58:47.834493] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-10-21T19:58:47.862410] [DEBUG] [LOCAL ] MPC: Trimmed 75741 records to 51933 (keeping 200 days of data) [2025-10-21T19:58:47.863815] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-21T19:58:48.155244] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-10-21T19:58:48.199684] [DEBUG] [LOCAL ] MPC: Primary data saved (51933 records). [2025-10-21T19:58:48.199799] [INFO ] [MAIN ] MPC: Full history saved. [2025-10-21T19:58:48.200478] [INFO ] [MAIN ] Update Progress: 1389/2366 symbols completed. MPC took 37.4s. Estimated remaining: 2h 5m 43s. Rate: 7.8 symbols/min [2025-10-21T19:58:48.369551] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:58:48.376963] [DEBUG] [LOCAL ] MPX: Loaded 4023 existing records from primary storage. [2025-10-21T19:58:48.377177] [INFO ] [MAIN ] MPX: Loaded 4023 existing records. [2025-10-21T19:58:48.556571] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:58:48.556844] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-10-21T19:58:48.556895] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-10-21T19:58:48.557023] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-10-21T19:58:48.557060] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-10-21T19:58:48.915776] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:58:48.950980] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-10-21T19:58:49.654871] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T19:58:49.751022] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-10-21T19:58:50.008555] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T19:58:50.234496] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-21T19:58:50.357609] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T19:58:50.551015] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-10. [2025-10-21T19:58:51.351053] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-10-21T19:58:52.151069] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-10-21T19:58:52.759599] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T19:58:52.951090] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-10-21T19:58:53.172180] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T19:58:53.343685] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-21T19:58:53.400988] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-10 (2.85 seconds). [2025-10-21T19:58:53.409824] [INFO ] [REMOTE ] MP: Full fetch complete (77580 records). [2025-10-21T19:58:53.410013] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-10-21T19:58:53.759332] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-10-21T19:58:53.807392] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-10-21T19:58:53.807472] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-10-21T19:58:53.808602] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-10-21T19:58:53.808690] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-10-21T19:58:53.810142] [DEBUG] [LOCAL ] MP: Trimmed 77580 records to 53744 (keeping 200 days of data) [2025-10-21T19:58:54.123033] [DEBUG] [LOCAL ] MP: Primary data saved (53744 records). [2025-10-21T19:58:54.123171] [INFO ] [MAIN ] MP: Full history saved. [2025-10-21T19:58:54.123740] [INFO ] [MAIN ] Update Progress: 1390/2366 symbols completed. MP took 47.0s. Estimated remaining: 2h 5m 34s. Rate: 7.8 symbols/min [2025-10-21T19:58:54.302444] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:58:54.313914] [DEBUG] [LOCAL ] MQT: Loaded 8156 existing records from primary storage. [2025-10-21T19:58:54.314142] [INFO ] [MAIN ] MQT: Loaded 8156 existing records. [2025-10-21T19:58:54.509766] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:58:54.513095] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-10-21T19:58:54.513209] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-10-21T19:58:54.513746] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T19:58:54.515059] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-10-21T19:58:54.515528] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-10-21T19:58:54.556169] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-10-21T19:58:54.910508] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:58:55.351008] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-10-21T19:58:56.126511] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T19:58:56.150982] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-10-21T19:58:56.386468] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T19:58:56.919398] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T19:58:56.950981] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-10-21T19:58:57.751017] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-10-21T19:58:57.763201] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T19:58:58.099439] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-21T19:58:58.551009] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-10-21T19:58:59.351008] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-10-21T19:58:59.487773] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T19:59:00.151010] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-10-21T19:59:00.159171] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T19:59:00.951047] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-10-21T19:59:01.751056] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-10-21T19:59:02.194168] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T19:59:02.551022] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-10-21T19:59:02.649232] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-21T19:59:02.670448] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T19:59:03.153987] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-21T19:59:03.351024] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-10-21T19:59:04.151042] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-10. [2025-10-21T19:59:04.757035] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T19:59:04.758229] [INFO ] [REMOTE ] MPX: Full fetch complete (6501 records). [2025-10-21T19:59:04.758301] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-10-21T19:59:04.956785] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-10-21T19:59:05.126692] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-10-21T19:59:05.126776] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-10-21T19:59:05.126952] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-10-21T19:59:05.126990] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-10-21T19:59:05.127362] [DEBUG] [LOCAL ] MPX: Trimmed 6501 records to 3999 (keeping 200 days of data) [2025-10-21T19:59:05.152243] [DEBUG] [LOCAL ] MPX: Primary data saved (3999 records). [2025-10-21T19:59:05.152505] [INFO ] [MAIN ] MPX: Full history saved. [2025-10-21T19:59:05.152709] [INFO ] [MAIN ] Update Progress: 1391/2366 symbols completed. MPX took 17.0s. Estimated remaining: 2h 5m 29s. Rate: 7.8 symbols/min [2025-10-21T19:59:05.328472] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:05.365067] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T19:59:05.383462] [DEBUG] [LOCAL ] MQY: Loaded 16735 existing records from primary storage. [2025-10-21T19:59:05.383760] [INFO ] [MAIN ] MQY: Loaded 16735 existing records. [2025-10-21T19:59:05.558604] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:59:05.558828] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-10-21T19:59:05.558906] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-10-21T19:59:05.559161] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-10-21T19:59:05.559218] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-10-21T19:59:05.757728] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-10-21T19:59:05.774511] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T19:59:05.926991] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:06.551019] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-10-21T19:59:07.340523] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T19:59:07.350968] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-10-21T19:59:07.505141] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T19:59:08.100530] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T19:59:08.151027] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-10-21T19:59:08.889836] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T19:59:08.951043] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-10. [2025-10-21T19:59:09.751020] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-10-21T19:59:09.768755] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T19:59:09.770379] [INFO ] [REMOTE ] MQT: Full fetch complete (13025 records). [2025-10-21T19:59:09.770449] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-10-21T19:59:10.127480] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-10-21T19:59:10.127586] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-10-21T19:59:10.127985] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-10-21T19:59:10.128048] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-10-21T19:59:10.128558] [DEBUG] [LOCAL ] MQT: Trimmed 13025 records to 8058 (keeping 200 days of data) [2025-10-21T19:59:10.176766] [DEBUG] [LOCAL ] MQT: Primary data saved (8058 records). [2025-10-21T19:59:10.176904] [INFO ] [MAIN ] MQT: Full history saved. [2025-10-21T19:59:10.176984] [INFO ] [MAIN ] Update Progress: 1392/2366 symbols completed. MQT took 16.1s. Estimated remaining: 2h 5m 19s. Rate: 7.8 symbols/min [2025-10-21T19:59:10.347361] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:10.382995] [DEBUG] [LOCAL ] MRC: Loaded 37338 existing records from primary storage. [2025-10-21T19:59:10.383302] [INFO ] [MAIN ] MRC: Loaded 37338 existing records. [2025-10-21T19:59:10.578291] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-10-21T19:59:10.582904] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:59:10.583919] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-10-21T19:59:10.583966] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-10-21T19:59:10.584154] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-10-21T19:59:10.584208] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-10-21T19:59:10.932026] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:11.351008] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-10. [2025-10-21T19:59:11.612155] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T19:59:11.737331] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T19:59:12.151082] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-10-21T19:59:12.951050] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-10-21T19:59:13.292094] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T19:59:13.300460] [INFO ] [REMOTE ] MPLX: Full fetch complete (74335 records). [2025-10-21T19:59:13.300580] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-10-21T19:59:13.744319] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-10-21T19:59:13.744483] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-10-21T19:59:13.746930] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T19:59:13.746043] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-10-21T19:59:13.754422] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-10-21T19:59:13.755885] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-10-21T19:59:13.757230] [DEBUG] [LOCAL ] MPLX: Trimmed 74335 records to 50784 (keeping 200 days of data) [2025-10-21T19:59:14.074807] [DEBUG] [LOCAL ] MPLX: Primary data saved (50784 records). [2025-10-21T19:59:14.074943] [INFO ] [MAIN ] MPLX: Full history saved. [2025-10-21T19:59:14.075722] [INFO ] [MAIN ] Update Progress: 1393/2366 symbols completed. MPLX took 59.4s. Estimated remaining: 2h 5m 9s. Rate: 7.8 symbols/min [2025-10-21T19:59:14.245827] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:14.303675] [DEBUG] [LOCAL ] MRK: Loaded 53790 existing records from primary storage. [2025-10-21T19:59:14.303975] [INFO ] [MAIN ] MRK: Loaded 53790 existing records. [2025-10-21T19:59:14.479848] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:59:14.480074] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-10-21T19:59:14.480134] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-10-21T19:59:14.480348] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-10-21T19:59:14.480402] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-10-21T19:59:14.557784] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-10-21T19:59:14.846144] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:14.882262] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T19:59:14.972922] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T19:59:15.351090] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-10-21T19:59:16.049960] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T19:59:16.150985] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-10-21T19:59:16.374970] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T19:59:16.951078] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-10-21T19:59:17.662627] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T19:59:17.751104] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-10-21T19:59:18.551015] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-10-21T19:59:18.862450] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T19:59:19.351086] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-10-21T19:59:19.568383] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T19:59:19.867850] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-21T19:59:20.151091] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-10-21T19:59:20.951059] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-10-21T19:59:21.175027] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T19:59:21.460721] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-21T19:59:21.547489] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T19:59:21.751054] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-10-21T19:59:22.551002] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-10. [2025-10-21T19:59:22.689755] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T19:59:23.351035] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-10-21T19:59:24.151069] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-10-21T19:59:24.306433] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T19:59:24.448574] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T19:59:24.457156] [INFO ] [REMOTE ] MPW: Full fetch complete (77576 records). [2025-10-21T19:59:24.457315] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-10-21T19:59:24.851743] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-10-21T19:59:24.851820] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-10-21T19:59:24.852875] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-10-21T19:59:24.852937] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-10-21T19:59:24.854330] [DEBUG] [LOCAL ] MPW: Trimmed 77576 records to 53486 (keeping 200 days of data) [2025-10-21T19:59:24.954371] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-10-21T19:59:25.164790] [DEBUG] [LOCAL ] MPW: Primary data saved (53486 records). [2025-10-21T19:59:25.164933] [INFO ] [MAIN ] MPW: Full history saved. [2025-10-21T19:59:25.165015] [INFO ] [MAIN ] Update Progress: 1394/2366 symbols completed. MPW took 39.4s. Estimated remaining: 2h 5m 3s. Rate: 7.8 symbols/min [2025-10-21T19:59:25.340382] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:25.340580] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-10-21T19:59:25.340783] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-10-21T19:59:25.341069] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-10-21T19:59:25.341122] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-21T19:59:25.359830] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-21T19:59:25.359915] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-10-21T19:59:25.438811] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T19:59:25.722559] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:25.751003] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-10-21T19:59:26.551088] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-10-21T19:59:26.746554] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T19:59:26.754380] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T19:59:26.755904] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-10-21T19:59:26.756024] [FATAL] [REMOTE ] MRP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:59:26.756097] [FATAL] [MAIN ] MRP: Failed to fetch primary data. [2025-10-21T19:59:26.756162] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:59:26.756233] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-10-21T19:59:26.756302] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-10-21T19:59:26.756338] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-10-21T19:59:26.756404] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-10-21T19:59:26.756463] [INFO ] [MAIN ] Update Progress: 1395/2366 symbols completed. MRP took 1.6s. Estimated remaining: 2h 4m 51s. Rate: 7.8 symbols/min [2025-10-21T19:59:26.930739] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:26.982932] [DEBUG] [LOCAL ] MS: Loaded 53688 existing records from primary storage. [2025-10-21T19:59:26.983282] [INFO ] [MAIN ] MS: Loaded 53688 existing records. [2025-10-21T19:59:27.162684] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:59:27.162920] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-10-21T19:59:27.162968] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-10-21T19:59:27.163229] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-10-21T19:59:27.163285] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-10-21T19:59:27.370479] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-10-21T19:59:27.535139] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:27.565194] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-21T19:59:28.151072] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-10-21T19:59:28.850911] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T19:59:28.951063] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-10-21T19:59:29.751019] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-10-21T19:59:30.373745] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T19:59:30.492811] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T19:59:30.550979] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-10-21T19:59:31.351044] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-10-21T19:59:31.695480] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T19:59:31.863439] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T19:59:32.151066] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-10-21T19:59:32.951088] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-10-21T19:59:33.237922] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T19:59:33.623872] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T19:59:33.751050] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-10-21T19:59:34.526012] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T19:59:34.550997] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-10-21T19:59:35.351044] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-10-21T19:59:36.103557] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-10-21T19:59:36.150985] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-10-21T19:59:36.548410] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T19:59:36.604639] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T19:59:36.951052] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-10. [2025-10-21T19:59:37.751073] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-10. [2025-10-21T19:59:38.167569] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T19:59:38.171669] [INFO ] [REMOTE ] MQY: Full fetch complete (26169 records). [2025-10-21T19:59:38.171826] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-10-21T19:59:38.539011] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-21T19:59:38.562775] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-10-21T19:59:38.572516] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-10-21T19:59:38.582740] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-10-21T19:59:38.583874] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-10-21T19:59:38.583951] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-10-21T19:59:38.584961] [DEBUG] [LOCAL ] MQY: Trimmed 26169 records to 16629 (keeping 200 days of data) [2025-10-21T19:59:38.685826] [DEBUG] [LOCAL ] MQY: Primary data saved (16629 records). [2025-10-21T19:59:38.685957] [INFO ] [MAIN ] MQY: Full history saved. [2025-10-21T19:59:38.686032] [INFO ] [MAIN ] Update Progress: 1396/2366 symbols completed. MQY took 33.5s. Estimated remaining: 2h 4m 47s. Rate: 7.8 symbols/min [2025-10-21T19:59:38.854365] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:38.873887] [DEBUG] [LOCAL ] MSA: Loaded 18915 existing records from primary storage. [2025-10-21T19:59:38.874205] [INFO ] [MAIN ] MSA: Loaded 18915 existing records. [2025-10-21T19:59:39.055165] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:59:39.055379] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-10-21T19:59:39.055459] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-21T19:59:39.055673] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-10-21T19:59:39.055730] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-10-21T19:59:39.227606] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T19:59:39.285173] [INFO ] [REMOTE ] MRC: Full fetch complete (55165 records). [2025-10-21T19:59:39.317297] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-10-21T19:59:39.356194] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-10-21T19:59:39.599385] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:39.818782] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-10-21T19:59:39.818856] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-10-21T19:59:39.819737] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-10-21T19:59:39.819797] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-10-21T19:59:39.820839] [DEBUG] [LOCAL ] MRC: Trimmed 55165 records to 37214 (keeping 200 days of data) [2025-10-21T19:59:40.026892] [DEBUG] [LOCAL ] MRC: Primary data saved (37214 records). [2025-10-21T19:59:40.027016] [INFO ] [MAIN ] MRC: Full history saved. [2025-10-21T19:59:40.027401] [INFO ] [MAIN ] Update Progress: 1397/2366 symbols completed. MRC took 29.9s. Estimated remaining: 2h 4m 35s. Rate: 7.8 symbols/min [2025-10-21T19:59:40.151042] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-10-21T19:59:40.645843] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T19:59:40.951028] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-10-21T19:59:40.994831] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T19:59:41.751033] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-10-21T19:59:41.956718] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-10-21T19:59:42.112492] [DEBUG] [REMOTE ] MSA: Error fetching primary data for 2025-02: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-10-21T19:59:42.112687] [WARN ] [REMOTE ] MSA: No data returned for month 2025-02 [2025-10-21T19:59:42.112762] [FATAL] [REMOTE ] MSA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T19:59:42.112805] [FATAL] [MAIN ] MSA: Failed to fetch primary data. [2025-10-21T19:59:42.112862] [WARN ] [MAIN ] MSA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T19:59:42.112942] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-10-21T19:59:42.113035] [DEBUG] [LOCAL ] MSA: No primary data file found to delete. [2025-10-21T19:59:42.113092] [INFO ] [LOCAL ] MSA: Starting deletion of derivative data. [2025-10-21T19:59:42.113230] [DEBUG] [LOCAL ] MSA: Deleted derivative data file. [2025-10-21T19:59:42.113299] [INFO ] [MAIN ] Update Progress: 1398/2366 symbols completed. MSA took 3.4s. Estimated remaining: 2h 4m 23s. Rate: 7.8 symbols/min [2025-10-21T19:59:42.550999] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-10-21T19:59:42.807554] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T19:59:43.351036] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-10-21T19:59:44.775180] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-21T19:59:44.786814] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-10-21T19:59:45.224897] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T19:59:45.235999] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-10-21T19:59:47.093143] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-21T19:59:47.104967] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-10. [2025-10-21T19:59:47.224992] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T19:59:47.236899] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-10-21T19:59:47.938201] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T19:59:47.946485] [INFO ] [REMOTE ] MRK: Full fetch complete (77968 records). [2025-10-21T19:59:47.946610] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-10-21T19:59:48.333002] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-10-21T19:59:48.333082] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-10-21T19:59:48.334151] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-10-21T19:59:48.334213] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-10-21T19:59:48.335615] [DEBUG] [LOCAL ] MRK: Trimmed 77968 records to 53790 (keeping 200 days of data) [2025-10-21T19:59:48.667367] [DEBUG] [LOCAL ] MRK: Primary data saved (53790 records). [2025-10-21T19:59:48.667521] [INFO ] [MAIN ] MRK: Full history saved. [2025-10-21T19:59:48.668421] [INFO ] [MAIN ] Update Progress: 1399/2366 symbols completed. MRK took 34.6s. Estimated remaining: 2h 4m 14s. Rate: 7.8 symbols/min [2025-10-21T19:59:49.099669] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T19:59:49.111130] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-10-21T19:59:51.112943] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T19:59:51.124598] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-10. [2025-10-21T19:59:51.969986] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T19:59:51.978773] [INFO ] [REMOTE ] MS: Full fetch complete (77858 records). [2025-10-21T19:59:51.978943] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-10-21T19:59:52.367700] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-10-21T19:59:52.367813] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-10-21T19:59:52.368931] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-10-21T19:59:52.368997] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-10-21T19:59:52.370407] [DEBUG] [LOCAL ] MS: Trimmed 77858 records to 53688 (keeping 200 days of data) [2025-10-21T19:59:52.691793] [DEBUG] [LOCAL ] MS: Primary data saved (53688 records). [2025-10-21T19:59:52.691913] [INFO ] [MAIN ] MS: Full history saved. [2025-10-21T19:59:52.691987] [INFO ] [MAIN ] Update Progress: 1400/2366 symbols completed. MS took 25.9s. Estimated remaining: 2h 4m 4s. Rate: 7.8 symbols/min [2025-10-21T19:59:53.224130] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:53.363982] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:53.380739] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-10-21T19:59:53.382221] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:53.382292] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-10-21T19:59:53.398959] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-10-21T19:59:53.403050] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-21T19:59:53.402923] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T19:59:53.403781] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-21T19:59:53.404026] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-10-21T19:59:53.537476] [DEBUG] [LOCAL ] MSD: Loaded 16558 existing records from primary storage. [2025-10-21T19:59:53.537897] [INFO ] [MAIN ] MSD: Loaded 16558 existing records. [2025-10-21T19:59:53.531390] [DEBUG] [LOCAL ] MSB: Loaded 7950 existing records from primary storage. [2025-10-21T19:59:53.620297] [INFO ] [MAIN ] MSB: Loaded 7950 existing records. [2025-10-21T19:59:53.693910] [DEBUG] [LOCAL ] MSCI: Loaded 34427 existing records from primary storage. [2025-10-21T19:59:53.874858] [INFO ] [MAIN ] MSCI: Loaded 34427 existing records. [2025-10-21T19:59:54.214153] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:59:54.242282] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-10-21T19:59:54.273064] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:59:54.278320] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-10-21T19:59:54.321913] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:54.333513] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-10-21T19:59:54.344277] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-10-21T19:59:54.333639] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-10-21T19:59:54.354035] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-10-21T19:59:54.348566] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-10-21T19:59:54.382400] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T19:59:54.432411] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-10-21T19:59:54.407142] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-10-21T19:59:54.446386] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-10-21T19:59:54.446481] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-10-21T19:59:54.483348] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-10-21T19:59:54.512880] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-10-21T19:59:54.878735] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T19:59:54.960987] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-10-21T19:59:55.252350] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:55.275250] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-10-21T19:59:55.466979] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:55.491418] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-10-21T19:59:55.532082] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T19:59:55.533050] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-10-21T19:59:55.763922] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T19:59:55.765440] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-10-21T19:59:55.968960] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T19:59:55.972188] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-10-21T19:59:56.218273] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-21T19:59:56.219313] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-10-21T19:59:56.442585] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T19:59:56.446232] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-10-21T19:59:56.576902] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-21T19:59:56.577903] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-10-21T19:59:56.791782] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T19:59:56.917217] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T19:59:56.929327] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-21T19:59:56.942996] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T19:59:56.950977] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-10-21T19:59:57.715068] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T19:59:57.750982] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-10-21T19:59:58.551053] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-10-21T19:59:58.566419] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T19:59:59.351019] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-10-21T20:00:00.052780] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T20:00:00.133214] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T20:00:00.151001] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-10-21T20:00:00.951075] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-10-21T20:00:01.571519] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T20:00:01.751029] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-10-21T20:00:02.551026] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-10-21T20:00:03.084819] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T20:00:03.351023] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-10-21T20:00:04.150995] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-10-21T20:00:04.168484] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-10-21T20:00:04.556078] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T20:00:04.856220] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T20:00:04.950997] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-10-21T20:00:04.968457] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T20:00:05.728714] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T20:00:05.751070] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-10-21T20:00:06.257215] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-21T20:00:06.551081] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-10-21T20:00:07.351078] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-10-21T20:00:08.151062] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-10-21T20:00:08.558561] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T20:00:08.662908] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T20:00:08.841440] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-21T20:00:08.951049] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-10. [2025-10-21T20:00:09.473111] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-21T20:00:09.473901] [INFO ] [REMOTE ] MSC: Full fetch complete (2494 records). [2025-10-21T20:00:09.473969] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-10-21T20:00:09.650868] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-21T20:00:09.651105] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:00:09.651174] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:00:09.651246] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-10-21T20:00:09.651309] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-10-21T20:00:09.651345] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-10-21T20:00:09.651383] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-10-21T20:00:09.651437] [INFO ] [MAIN ] Update Progress: 1401/2366 symbols completed. MSC took 16.9s. Estimated remaining: 2h 4m 3s. Rate: 7.8 symbols/min [2025-10-21T20:00:09.756250] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-10-21T20:00:09.839478] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:00:09.877384] [DEBUG] [LOCAL ] MSDL: Loaded 38684 existing records from primary storage. [2025-10-21T20:00:09.877721] [INFO ] [MAIN ] MSDL: Loaded 38684 existing records. [2025-10-21T20:00:10.057673] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:00:10.057919] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-10-21T20:00:10.057968] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-10-21T20:00:10.058171] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-10-21T20:00:10.058210] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-10-21T20:00:10.412515] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:00:10.551057] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-10-21T20:00:11.351009] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-10-21T20:00:11.444983] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T20:00:11.791864] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T20:00:11.859424] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T20:00:12.151035] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-10-21T20:00:12.951043] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-10-21T20:00:13.153569] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T20:00:13.751130] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-10-21T20:00:14.235192] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T20:00:14.551056] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-10-21T20:00:15.156425] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T20:00:15.351042] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-10-21T20:00:15.597314] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T20:00:16.151077] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-10-21T20:00:16.784183] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T20:00:16.951044] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-10-21T20:00:17.516982] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T20:00:17.751071] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-10. [2025-10-21T20:00:18.415160] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T20:00:18.551139] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-10-21T20:00:18.886228] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T20:00:18.890807] [INFO ] [REMOTE ] MSD: Full fetch complete (23119 records). [2025-10-21T20:00:18.891000] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-10-21T20:00:19.305555] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-10-21T20:00:19.305754] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-10-21T20:00:19.306746] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-10-21T20:00:19.306818] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-10-21T20:00:19.308000] [DEBUG] [LOCAL ] MSD: Trimmed 23119 records to 16587 (keeping 200 days of data) [2025-10-21T20:00:19.355874] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-10-21T20:00:19.415731] [DEBUG] [LOCAL ] MSD: Primary data saved (16587 records). [2025-10-21T20:00:19.422912] [INFO ] [MAIN ] MSD: Full history saved. [2025-10-21T20:00:19.423068] [INFO ] [MAIN ] Update Progress: 1402/2366 symbols completed. MSD took 26.7s. Estimated remaining: 2h 3m 57s. Rate: 7.8 symbols/min [2025-10-21T20:00:19.500978] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T20:00:19.603059] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:00:19.630249] [DEBUG] [LOCAL ] MSGE: Loaded 27014 existing records from primary storage. [2025-10-21T20:00:19.630519] [INFO ] [MAIN ] MSGE: Loaded 27014 existing records. [2025-10-21T20:00:19.805629] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:00:19.805865] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-10-21T20:00:19.805912] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-10-21T20:00:19.806083] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-10-21T20:00:19.806120] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-10-21T20:00:20.153415] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-10-21T20:00:20.157167] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:00:20.820562] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T20:00:20.951058] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-10-21T20:00:21.589598] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T20:00:21.751034] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-10-21T20:00:22.310842] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T20:00:22.551046] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-10-21T20:00:23.094230] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T20:00:23.351064] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-10-21T20:00:23.785267] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T20:00:24.151084] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-10-21T20:00:24.582279] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T20:00:24.951037] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-10-21T20:00:25.663272] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T20:00:25.705833] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T20:00:25.751093] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-10. [2025-10-21T20:00:26.543201] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T20:00:26.545697] [INFO ] [REMOTE ] MSB: Full fetch complete (13165 records). [2025-10-21T20:00:26.545830] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-10-21T20:00:26.558474] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-10-21T20:00:26.939914] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-10-21T20:00:26.940002] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-10-21T20:00:26.940308] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-10-21T20:00:26.940349] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-10-21T20:00:26.940831] [DEBUG] [LOCAL ] MSB: Trimmed 13165 records to 7970 (keeping 200 days of data) [2025-10-21T20:00:26.987021] [DEBUG] [LOCAL ] MSB: Primary data saved (7970 records). [2025-10-21T20:00:26.987137] [INFO ] [MAIN ] MSB: Full history saved. [2025-10-21T20:00:26.987229] [INFO ] [MAIN ] Update Progress: 1403/2366 symbols completed. MSB took 34.3s. Estimated remaining: 2h 3m 49s. Rate: 7.8 symbols/min [2025-10-21T20:00:27.156365] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:00:27.174472] [DEBUG] [LOCAL ] MSGS: Loaded 17291 existing records from primary storage. [2025-10-21T20:00:27.174734] [INFO ] [MAIN ] MSGS: Loaded 17291 existing records. [2025-10-21T20:00:27.348328] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:00:27.348584] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-10-21T20:00:27.348631] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-10-21T20:00:27.348824] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-10-21T20:00:27.348869] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-10-21T20:00:27.359713] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-10. [2025-10-21T20:00:27.704259] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:00:28.040799] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T20:00:28.151059] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-10-21T20:00:28.951044] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-10-21T20:00:28.990457] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T20:00:28.995566] [INFO ] [REMOTE ] MSCI: Full fetch complete (50567 records). [2025-10-21T20:00:28.995693] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-10-21T20:00:29.395913] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-10-21T20:00:29.395998] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-10-21T20:00:29.396887] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-10-21T20:00:29.396947] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-10-21T20:00:29.397989] [DEBUG] [LOCAL ] MSCI: Trimmed 50567 records to 34327 (keeping 200 days of data) [2025-10-21T20:00:29.620111] [DEBUG] [LOCAL ] MSCI: Primary data saved (34327 records). [2025-10-21T20:00:29.620281] [INFO ] [MAIN ] MSCI: Full history saved. [2025-10-21T20:00:29.620367] [INFO ] [MAIN ] Update Progress: 1404/2366 symbols completed. MSCI took 36.9s. Estimated remaining: 2h 3m 38s. Rate: 7.8 symbols/min [2025-10-21T20:00:29.768959] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-10-21T20:00:29.801406] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:00:29.818059] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T20:00:29.835283] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T20:00:29.877039] [DEBUG] [LOCAL ] MSI: Loaded 39863 existing records from primary storage. [2025-10-21T20:00:29.877321] [INFO ] [MAIN ] MSI: Loaded 39863 existing records. [2025-10-21T20:00:30.051939] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:00:30.052210] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-10-21T20:00:30.052258] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-10-21T20:00:30.052437] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-10-21T20:00:30.052490] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-10-21T20:00:30.413058] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:00:30.551041] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-10-21T20:00:31.186721] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T20:00:31.308552] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T20:00:31.351033] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-10-21T20:00:32.151092] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-10-21T20:00:32.334723] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T20:00:32.951024] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-10-21T20:00:33.649627] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T20:00:33.751085] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-10-21T20:00:34.274058] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T20:00:34.551028] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-10-21T20:00:34.775845] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T20:00:35.351094] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-10. [2025-10-21T20:00:36.019292] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T20:00:36.151059] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-10-21T20:00:36.951008] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-10-21T20:00:37.017844] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T20:00:37.025183] [INFO ] [REMOTE ] MSDL: Full fetch complete (56274 records). [2025-10-21T20:00:37.025295] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-10-21T20:00:37.423682] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-10-21T20:00:37.423767] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-10-21T20:00:37.424666] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-10-21T20:00:37.424727] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-10-21T20:00:37.425813] [DEBUG] [LOCAL ] MSDL: Trimmed 56274 records to 38655 (keeping 200 days of data) [2025-10-21T20:00:37.661796] [DEBUG] [LOCAL ] MSDL: Primary data saved (38655 records). [2025-10-21T20:00:37.661922] [INFO ] [MAIN ] MSDL: Full history saved. [2025-10-21T20:00:37.662503] [INFO ] [MAIN ] Update Progress: 1405/2366 symbols completed. MSDL took 28.0s. Estimated remaining: 2h 3m 30s. Rate: 7.8 symbols/min [2025-10-21T20:00:37.761559] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-10-21T20:00:37.858390] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:00:37.860297] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T20:00:37.860489] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-10-21T20:00:37.863431] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-10-21T20:00:37.868968] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-10-21T20:00:37.869432] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-21T20:00:37.878258] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-21T20:00:37.879238] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T20:00:37.878884] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-10-21T20:00:38.250931] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:00:38.550982] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-10-21T20:00:38.911941] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T20:00:39.351025] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-10-21T20:00:39.729836] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T20:00:40.151028] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-10-21T20:00:40.628543] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-21T20:00:40.912284] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T20:00:40.951017] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-10-21T20:00:41.751024] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-10-21T20:00:42.551101] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-10-21T20:00:42.581281] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T20:00:42.657931] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T20:00:43.351020] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-10-21T20:00:43.647807] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T20:00:43.843491] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T20:00:44.151012] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-10-21T20:00:44.951060] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-10-21T20:00:45.200071] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T20:00:45.751030] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-10-21T20:00:46.469168] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T20:00:46.551036] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-10-21T20:00:46.658288] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T20:00:46.990907] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-21T20:00:47.351026] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-10-21T20:00:48.151022] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-10-21T20:00:48.236912] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T20:00:48.951021] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-10-21T20:00:49.071488] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T20:00:49.751044] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-10-21T20:00:49.779450] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T20:00:50.551021] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-10-21T20:00:50.890903] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T20:00:51.351054] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-10-21T20:00:51.810265] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-21T20:00:52.151031] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-10-21T20:00:52.570660] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T20:00:52.951058] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-10-21T20:00:53.248027] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T20:00:53.751026] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-10-21T20:00:54.516998] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T20:00:54.550988] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-10-21T20:00:54.894004] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T20:00:55.351029] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-10. [2025-10-21T20:00:56.150995] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-10-21T20:00:56.244372] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T20:00:56.468013] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T20:00:56.471858] [INFO ] [REMOTE ] MSGS: Full fetch complete (23774 records). [2025-10-21T20:00:56.471985] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-10-21T20:00:56.864002] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-10-21T20:00:56.864096] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-10-21T20:00:56.864714] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-10-21T20:00:56.864812] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-10-21T20:00:56.865572] [DEBUG] [LOCAL ] MSGS: Trimmed 23774 records to 17296 (keeping 200 days of data) [2025-10-21T20:00:56.951741] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-10-21T20:00:56.978086] [DEBUG] [LOCAL ] MSGS: Primary data saved (17296 records). [2025-10-21T20:00:56.979271] [INFO ] [MAIN ] MSGS: Full history saved. [2025-10-21T20:00:56.979357] [INFO ] [MAIN ] Update Progress: 1406/2366 symbols completed. MSGS took 30.0s. Estimated remaining: 2h 3m 30s. Rate: 7.8 symbols/min [2025-10-21T20:00:57.154364] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:00:57.189319] [DEBUG] [LOCAL ] MSM: Loaded 35537 existing records from primary storage. [2025-10-21T20:00:57.202939] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T20:00:57.202353] [INFO ] [MAIN ] MSM: Loaded 35537 existing records. [2025-10-21T20:00:57.393442] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:00:57.393692] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-10-21T20:00:57.393763] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-10-21T20:00:57.393973] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-10-21T20:00:57.394031] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-10-21T20:00:57.756340] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-10-21T20:00:57.762088] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:00:58.551065] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-10. [2025-10-21T20:00:58.585051] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T20:00:58.986058] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T20:00:59.350986] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-10. [2025-10-21T20:00:59.786252] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T20:00:59.790013] [INFO ] [REMOTE ] MSIF: Full fetch complete (19149 records). [2025-10-21T20:00:59.790089] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-10-21T20:00:59.974349] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-21T20:00:59.974747] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:00:59.974819] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:00:59.974889] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-10-21T20:00:59.974958] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-10-21T20:00:59.975031] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-10-21T20:00:59.975099] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-10-21T20:00:59.975166] [INFO ] [MAIN ] Update Progress: 1407/2366 symbols completed. MSIF took 22.3s. Estimated remaining: 2h 3m 19s. Rate: 7.8 symbols/min [2025-10-21T20:01:00.157785] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-10-21T20:01:00.160633] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:00.208949] [DEBUG] [LOCAL ] MT: Loaded 50451 existing records from primary storage. [2025-10-21T20:01:00.209301] [INFO ] [MAIN ] MT: Loaded 50451 existing records. [2025-10-21T20:01:00.386074] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:01:00.386293] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-10-21T20:01:00.386341] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-10-21T20:01:00.386844] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-10-21T20:01:00.386900] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-10-21T20:01:00.752117] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:01:00.951022] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-10-21T20:01:00.981865] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T20:01:00.987497] [INFO ] [REMOTE ] MSGE: Full fetch complete (40059 records). [2025-10-21T20:01:00.987599] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-10-21T20:01:01.365217] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-10-21T20:01:01.365297] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-10-21T20:01:01.366113] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-10-21T20:01:01.366175] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-10-21T20:01:01.367101] [DEBUG] [LOCAL ] MSGE: Trimmed 40059 records to 26990 (keeping 200 days of data) [2025-10-21T20:01:01.518715] [DEBUG] [LOCAL ] MSGE: Primary data saved (26990 records). [2025-10-21T20:01:01.518867] [INFO ] [MAIN ] MSGE: Full history saved. [2025-10-21T20:01:01.518964] [INFO ] [MAIN ] Update Progress: 1408/2366 symbols completed. MSGE took 42.1s. Estimated remaining: 2h 3m 7s. Rate: 7.8 symbols/min [2025-10-21T20:01:01.708956] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:01.755186] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-10. [2025-10-21T20:01:01.757416] [DEBUG] [LOCAL ] MTB: Loaded 46699 existing records from primary storage. [2025-10-21T20:01:01.757872] [INFO ] [MAIN ] MTB: Loaded 46699 existing records. [2025-10-21T20:01:01.941461] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:01:01.941695] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-10-21T20:01:01.941753] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-10-21T20:01:01.941964] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-10-21T20:01:01.942019] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-10-21T20:01:02.296397] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:01:02.551065] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-10-21T20:01:02.891339] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-21T20:01:03.144747] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-21T20:01:03.351047] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-10-21T20:01:03.551431] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T20:01:03.558075] [INFO ] [REMOTE ] MSI: Full fetch complete (58092 records). [2025-10-21T20:01:03.558214] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-10-21T20:01:03.996970] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-10-21T20:01:03.997193] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-10-21T20:01:03.998309] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-10-21T20:01:03.998428] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-10-21T20:01:04.000090] [DEBUG] [LOCAL ] MSI: Trimmed 58092 records to 39735 (keeping 200 days of data) [2025-10-21T20:01:04.122709] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T20:01:04.152842] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-10-21T20:01:04.295453] [DEBUG] [LOCAL ] MSI: Primary data saved (39735 records). [2025-10-21T20:01:04.295606] [INFO ] [MAIN ] MSI: Full history saved. [2025-10-21T20:01:04.295774] [INFO ] [MAIN ] Update Progress: 1409/2366 symbols completed. MSI took 34.7s. Estimated remaining: 2h 2m 56s. Rate: 7.8 symbols/min [2025-10-21T20:01:04.466620] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:04.482374] [DEBUG] [LOCAL ] MTD: Loaded 15324 existing records from primary storage. [2025-10-21T20:01:04.482807] [INFO ] [MAIN ] MTD: Loaded 15324 existing records. [2025-10-21T20:01:04.660752] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:01:04.661050] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-10-21T20:01:04.661124] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-10-21T20:01:04.661428] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-10-21T20:01:04.661491] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-10-21T20:01:04.808849] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T20:01:04.956206] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-10-21T20:01:05.066753] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:01:05.751033] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-10-21T20:01:05.898204] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T20:01:06.475283] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T20:01:06.492373] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T20:01:06.551002] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-10-21T20:01:07.351034] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-10-21T20:01:07.514907] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T20:01:08.151044] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-10-21T20:01:08.951072] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-10-21T20:01:09.254780] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T20:01:09.750987] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-10-21T20:01:09.807259] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T20:01:09.847340] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-21T20:01:10.551075] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-10-21T20:01:11.351035] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-10-21T20:01:11.698472] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T20:01:11.813904] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T20:01:12.151075] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-10-21T20:01:12.797011] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T20:01:12.951030] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-10-21T20:01:13.751079] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-10-21T20:01:13.986504] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T20:01:14.213436] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T20:01:14.551062] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-10-21T20:01:14.680146] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T20:01:15.351069] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-10-21T20:01:15.928693] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T20:01:16.151021] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-10-21T20:01:16.704397] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T20:01:16.951021] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-10-21T20:01:17.369582] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T20:01:17.751053] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-10-21T20:01:18.551103] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-10-21T20:01:18.840200] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T20:01:19.089727] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T20:01:19.351129] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-10-21T20:01:20.151024] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-10-21T20:01:20.295897] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T20:01:20.387791] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T20:01:20.951041] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-10-21T20:01:21.633494] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T20:01:21.751026] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-10. [2025-10-21T20:01:22.387172] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T20:01:22.551080] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-10-21T20:01:23.246218] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T20:01:23.252737] [INFO ] [REMOTE ] MSM: Full fetch complete (51954 records). [2025-10-21T20:01:23.252895] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-10-21T20:01:23.353339] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-10-21T20:01:23.651827] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T20:01:23.675791] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-10-21T20:01:23.676583] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-10-21T20:01:23.677866] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-10-21T20:01:23.677939] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-10-21T20:01:23.679450] [DEBUG] [LOCAL ] MSM: Trimmed 51954 records to 35438 (keeping 200 days of data) [2025-10-21T20:01:23.903394] [DEBUG] [LOCAL ] MSM: Primary data saved (35438 records). [2025-10-21T20:01:23.903590] [INFO ] [MAIN ] MSM: Full history saved. [2025-10-21T20:01:23.904121] [INFO ] [MAIN ] Update Progress: 1410/2366 symbols completed. MSM took 26.9s. Estimated remaining: 2h 2m 57s. Rate: 7.8 symbols/min [2025-10-21T20:01:24.077313] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:24.131491] [DEBUG] [LOCAL ] MTDR: Loaded 51765 existing records from primary storage. [2025-10-21T20:01:24.131877] [INFO ] [MAIN ] MTDR: Loaded 51765 existing records. [2025-10-21T20:01:24.162529] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-10-21T20:01:24.320580] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:01:24.320865] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-10-21T20:01:24.320915] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-10-21T20:01:24.321174] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-10-21T20:01:24.321232] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-10-21T20:01:24.685093] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:01:24.951051] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-10-21T20:01:25.181396] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T20:01:25.224962] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T20:01:25.751061] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-10-21T20:01:26.551035] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-10-21T20:01:26.668678] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T20:01:26.764434] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T20:01:27.351069] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-10-21T20:01:28.122582] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T20:01:28.151014] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-10-21T20:01:28.951097] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-10-21T20:01:29.019910] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T20:01:29.695440] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T20:01:29.751087] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-10-21T20:01:30.557429] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-10-21T20:01:30.589810] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T20:01:31.351125] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-10. [2025-10-21T20:01:31.610744] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T20:01:32.151075] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-10-21T20:01:32.315704] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T20:01:32.951133] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-10-21T20:01:33.335753] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T20:01:33.343745] [INFO ] [REMOTE ] MT: Full fetch complete (73776 records). [2025-10-21T20:01:33.343878] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-10-21T20:01:33.750623] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-10-21T20:01:33.750839] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-10-21T20:01:33.752099] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-10-21T20:01:33.752202] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-10-21T20:01:33.752263] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-10. [2025-10-21T20:01:33.755026] [DEBUG] [LOCAL ] MT: Trimmed 73776 records to 50424 (keeping 200 days of data) [2025-10-21T20:01:33.885017] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T20:01:34.095268] [DEBUG] [LOCAL ] MT: Primary data saved (50424 records). [2025-10-21T20:01:34.095408] [INFO ] [MAIN ] MT: Full history saved. [2025-10-21T20:01:34.096186] [INFO ] [MAIN ] Update Progress: 1411/2366 symbols completed. MT took 34.1s. Estimated remaining: 2h 2m 51s. Rate: 7.8 symbols/min [2025-10-21T20:01:34.272188] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:34.358444] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T20:01:34.356539] [DEBUG] [LOCAL ] MTG: Loaded 51055 existing records from primary storage. [2025-10-21T20:01:34.369431] [INFO ] [MAIN ] MTG: Loaded 51055 existing records. [2025-10-21T20:01:34.554671] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-10-21T20:01:34.554547] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:01:34.554986] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-10-21T20:01:34.555939] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-10-21T20:01:34.556169] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-10-21T20:01:34.556225] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-10-21T20:01:34.919722] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:01:34.941855] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T20:01:34.945070] [INFO ] [REMOTE ] MTD: Full fetch complete (21446 records). [2025-10-21T20:01:34.945201] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-10-21T20:01:35.358353] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-10-21T20:01:35.372335] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-10-21T20:01:35.372494] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-10-21T20:01:35.373850] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-10-21T20:01:35.374074] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-10-21T20:01:35.375019] [DEBUG] [LOCAL ] MTD: Trimmed 21446 records to 15275 (keeping 200 days of data) [2025-10-21T20:01:35.490964] [DEBUG] [LOCAL ] MTD: Primary data saved (15275 records). [2025-10-21T20:01:35.491195] [INFO ] [MAIN ] MTD: Full history saved. [2025-10-21T20:01:35.491302] [INFO ] [MAIN ] Update Progress: 1412/2366 symbols completed. MTD took 31.2s. Estimated remaining: 2h 2m 39s. Rate: 7.8 symbols/min [2025-10-21T20:01:35.676896] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:35.727100] [DEBUG] [LOCAL ] MTH: Loaded 43889 existing records from primary storage. [2025-10-21T20:01:35.727528] [INFO ] [MAIN ] MTH: Loaded 43889 existing records. [2025-10-21T20:01:35.919177] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:01:35.919400] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-10-21T20:01:35.919468] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-10-21T20:01:35.919713] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-10-21T20:01:35.919778] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-10-21T20:01:36.158957] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-10-21T20:01:36.292301] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:01:36.388270] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T20:01:36.609626] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-21T20:01:36.951104] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-10-21T20:01:37.687690] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T20:01:37.751029] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-10-21T20:01:38.556748] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-10. [2025-10-21T20:01:38.586927] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T20:01:39.351042] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-10-21T20:01:39.435275] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T20:01:40.151097] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-10-21T20:01:40.519588] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T20:01:40.527716] [INFO ] [REMOTE ] MTB: Full fetch complete (68331 records). [2025-10-21T20:01:40.527941] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-10-21T20:01:40.953501] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-10-21T20:01:40.999013] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-10-21T20:01:40.999351] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-10-21T20:01:41.001736] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-10-21T20:01:41.002146] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-10-21T20:01:41.033461] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T20:01:41.042612] [DEBUG] [LOCAL ] MTB: Trimmed 68331 records to 46648 (keeping 200 days of data) [2025-10-21T20:01:41.421200] [DEBUG] [LOCAL ] MTB: Primary data saved (46648 records). [2025-10-21T20:01:41.421416] [INFO ] [MAIN ] MTB: Full history saved. [2025-10-21T20:01:41.421537] [INFO ] [MAIN ] Update Progress: 1413/2366 symbols completed. MTB took 39.9s. Estimated remaining: 2h 2m 30s. Rate: 7.8 symbols/min [2025-10-21T20:01:41.618720] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:41.665553] [DEBUG] [LOCAL ] MTN: Loaded 39520 existing records from primary storage. [2025-10-21T20:01:41.665981] [INFO ] [MAIN ] MTN: Loaded 39520 existing records. [2025-10-21T20:01:41.762353] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-10-21T20:01:41.865364] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:01:41.865746] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-10-21T20:01:41.865823] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-10-21T20:01:41.866133] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-10-21T20:01:41.866192] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-10-21T20:01:42.237425] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:01:42.382487] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-21T20:01:42.551029] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-10-21T20:01:43.013515] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-21T20:01:43.351001] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-10-21T20:01:43.504735] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T20:01:44.151096] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-10-21T20:01:44.346247] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T20:01:44.951063] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-10-21T20:01:45.086926] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T20:01:45.601193] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T20:01:45.751011] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-10-21T20:01:46.551089] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-10-21T20:01:46.689533] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T20:01:47.351094] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-10-21T20:01:47.407427] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T20:01:48.064302] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T20:01:48.151109] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-10-21T20:01:48.873729] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T20:01:48.951039] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-10-21T20:01:49.647015] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T20:01:49.751032] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-10-21T20:01:50.305324] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T20:01:50.551099] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-10-21T20:01:51.351028] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-10-21T20:01:51.441310] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T20:01:52.151067] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-10-21T20:01:52.229110] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T20:01:52.705713] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T20:01:52.951038] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-10-21T20:01:53.647018] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T20:01:53.751041] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-10-21T20:01:54.432400] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T20:01:54.551023] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-10-21T20:01:55.285955] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T20:01:55.351005] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-10. [2025-10-21T20:01:56.151033] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-10. [2025-10-21T20:01:56.291864] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:01:56.951088] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-10-21T20:01:57.011943] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T20:01:57.022265] [INFO ] [REMOTE ] MTH: Full fetch complete (64176 records). [2025-10-21T20:01:57.022437] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-10-21T20:01:57.435099] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-10-21T20:01:57.435180] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-10-21T20:01:57.436157] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-10-21T20:01:57.436220] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-10-21T20:01:57.437508] [DEBUG] [LOCAL ] MTH: Trimmed 64176 records to 43836 (keeping 200 days of data) [2025-10-21T20:01:57.703229] [DEBUG] [LOCAL ] MTH: Primary data saved (43836 records). [2025-10-21T20:01:57.703358] [INFO ] [MAIN ] MTH: Full history saved. [2025-10-21T20:01:57.703435] [INFO ] [MAIN ] Update Progress: 1414/2366 symbols completed. MTH took 22.2s. Estimated remaining: 2h 2m 28s. Rate: 7.8 symbols/min [2025-10-21T20:01:57.758152] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-10-21T20:01:57.878962] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:57.879145] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-10-21T20:01:57.879283] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-10-21T20:01:57.879415] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-10-21T20:01:57.879491] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-21T20:01:57.879662] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-21T20:01:57.879755] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-10-21T20:01:58.017390] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T20:01:58.102123] [INFO ] [REMOTE ] MTDR: Full fetch complete (74307 records). [2025-10-21T20:01:58.119782] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-10-21T20:01:58.426036] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:01:58.554341] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-10-21T20:01:58.694195] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T20:01:58.755831] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-10-21T20:01:58.755909] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-10-21T20:01:58.756967] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-10-21T20:01:58.757032] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-10-21T20:01:58.758452] [DEBUG] [LOCAL ] MTDR: Trimmed 74307 records to 51762 (keeping 200 days of data) [2025-10-21T20:01:59.075508] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T20:01:59.090274] [DEBUG] [LOCAL ] MTDR: Primary data saved (51762 records). [2025-10-21T20:01:59.090380] [INFO ] [MAIN ] MTDR: Full history saved. [2025-10-21T20:01:59.090731] [INFO ] [MAIN ] Update Progress: 1415/2366 symbols completed. MTDR took 35.2s. Estimated remaining: 2h 2m 16s. Rate: 7.8 symbols/min [2025-10-21T20:01:59.278957] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:01:59.279142] [DEBUG] [LOCAL ] MTRN: No existing data file found in primary storage. [2025-10-21T20:01:59.279179] [WARN ] [MAIN ] MTRN: No existing data found, performing full refresh instead. [2025-10-21T20:01:59.279289] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-10-21T20:01:59.279330] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-10-21T20:01:59.279369] [DEBUG] [LOCAL ] MTRN: No primary data file found to delete. [2025-10-21T20:01:59.279400] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-10-21T20:01:59.351931] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-10-21T20:01:59.723807] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T20:01:59.780979] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:02:00.151041] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-10-21T20:02:00.951066] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-10. [2025-10-21T20:02:01.741273] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T20:02:01.758014] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-10-21T20:02:01.782096] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-21T20:02:02.552250] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T20:02:02.552103] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-10-21T20:02:03.351124] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-10-21T20:02:03.551509] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T20:02:03.887880] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-21T20:02:03.896498] [INFO ] [REMOTE ] MTG: Full fetch complete (74255 records). [2025-10-21T20:02:03.896701] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-10-21T20:02:04.156203] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-10-21T20:02:04.331124] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-10-21T20:02:04.331203] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-10-21T20:02:04.332268] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-10-21T20:02:04.332330] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-10-21T20:02:04.333711] [DEBUG] [LOCAL ] MTG: Trimmed 74255 records to 51078 (keeping 200 days of data) [2025-10-21T20:02:04.635073] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T20:02:04.648704] [DEBUG] [LOCAL ] MTG: Primary data saved (51078 records). [2025-10-21T20:02:04.648870] [INFO ] [MAIN ] MTG: Full history saved. [2025-10-21T20:02:04.649739] [INFO ] [MAIN ] Update Progress: 1416/2366 symbols completed. MTG took 30.6s. Estimated remaining: 2h 2m 7s. Rate: 7.8 symbols/min [2025-10-21T20:02:04.822090] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:02:04.854073] [DEBUG] [LOCAL ] MTUS: Loaded 27547 existing records from primary storage. [2025-10-21T20:02:04.854374] [INFO ] [MAIN ] MTUS: Loaded 27547 existing records. [2025-10-21T20:02:04.953156] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-10-21T20:02:05.066089] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:02:05.067076] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-10-21T20:02:05.067630] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-10-21T20:02:05.070067] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T20:02:05.070181] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-10-21T20:02:05.070613] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-10-21T20:02:05.369677] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-21T20:02:05.445936] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:02:05.751063] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-10-21T20:02:06.551026] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-10-21T20:02:07.044863] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T20:02:07.279513] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T20:02:07.351120] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-10-21T20:02:08.151066] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-10-21T20:02:08.216781] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T20:02:08.951003] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-10-21T20:02:09.321270] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T20:02:09.751053] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-10-21T20:02:10.463316] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T20:02:10.551016] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-10-21T20:02:11.054241] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T20:02:11.351042] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-10-21T20:02:11.803411] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T20:02:12.159869] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-10-21T20:02:12.165015] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T20:02:12.523323] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-21T20:02:12.951050] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-10-21T20:02:13.751103] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-10-21T20:02:13.951255] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T20:02:14.113977] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-21T20:02:14.551048] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-10-21T20:02:15.351109] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-10. [2025-10-21T20:02:15.820030] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T20:02:15.820768] [INFO ] [REMOTE ] MTR: Full fetch complete (2361 records). [2025-10-21T20:02:15.820833] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-10-21T20:02:15.998940] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T20:02:15.999152] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:02:15.999361] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:02:15.999439] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-10-21T20:02:15.999585] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-10-21T20:02:15.999637] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-10-21T20:02:15.999731] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-10-21T20:02:15.999791] [INFO ] [MAIN ] Update Progress: 1417/2366 symbols completed. MTR took 18.3s. Estimated remaining: 2h 2m 1s. Rate: 7.8 symbols/min [2025-10-21T20:02:16.171888] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-10-21T20:02:16.174742] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:02:16.199246] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T20:02:16.230887] [DEBUG] [LOCAL ] MTW: Loaded 26563 existing records from primary storage. [2025-10-21T20:02:16.231142] [INFO ] [MAIN ] MTW: Loaded 26563 existing records. [2025-10-21T20:02:16.408289] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:02:16.408526] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-10-21T20:02:16.408587] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-10-21T20:02:16.408792] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-10-21T20:02:16.408847] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-10-21T20:02:16.768121] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:02:16.951038] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-10-21T20:02:17.209309] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T20:02:17.751090] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-10-21T20:02:18.472332] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T20:02:18.551037] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-10-21T20:02:18.821086] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T20:02:19.351062] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-10-21T20:02:19.837436] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T20:02:20.151030] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-10. [2025-10-21T20:02:20.588961] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T20:02:20.950997] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-10-21T20:02:21.751013] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-10-21T20:02:21.918982] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T20:02:21.926102] [INFO ] [REMOTE ] MTN: Full fetch complete (56835 records). [2025-10-21T20:02:21.926234] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-10-21T20:02:22.074496] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T20:02:22.347060] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-10-21T20:02:22.347139] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-10-21T20:02:22.348088] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-10-21T20:02:22.348153] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-10-21T20:02:22.349300] [DEBUG] [LOCAL ] MTN: Trimmed 56835 records to 39441 (keeping 200 days of data) [2025-10-21T20:02:22.566997] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-10-21T20:02:22.606404] [DEBUG] [LOCAL ] MTN: Primary data saved (39441 records). [2025-10-21T20:02:22.606586] [INFO ] [MAIN ] MTN: Full history saved. [2025-10-21T20:02:22.606714] [INFO ] [MAIN ] Update Progress: 1418/2366 symbols completed. MTN took 41.2s. Estimated remaining: 2h 1m 53s. Rate: 7.8 symbols/min [2025-10-21T20:02:22.797288] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:02:22.819901] [DEBUG] [LOCAL ] MTX: Loaded 22705 existing records from primary storage. [2025-10-21T20:02:22.820153] [INFO ] [MAIN ] MTX: Loaded 22705 existing records. [2025-10-21T20:02:23.004128] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:02:23.004367] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-10-21T20:02:23.004417] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-10-21T20:02:23.004618] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-10-21T20:02:23.004702] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-10-21T20:02:23.334758] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T20:02:23.367491] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-10-21T20:02:23.412184] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:02:23.777014] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T20:02:24.151075] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-10-21T20:02:24.508015] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T20:02:24.951061] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-10-21T20:02:25.388105] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T20:02:25.751074] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-10-21T20:02:26.148411] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T20:02:26.551085] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-10-21T20:02:26.861672] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T20:02:27.304151] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T20:02:27.351015] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-10-21T20:02:28.151028] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-10-21T20:02:28.401628] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T20:02:28.951077] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-10-21T20:02:29.445546] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T20:02:29.750995] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-10-21T20:02:30.178103] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T20:02:30.540204] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T20:02:30.550996] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-10-21T20:02:31.351004] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-10-21T20:02:31.648695] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T20:02:32.151008] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-10-21T20:02:32.234576] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T20:02:32.951002] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-10-21T20:02:33.021032] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T20:02:33.750985] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-10-21T20:02:34.159802] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T20:02:34.551027] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-10-21T20:02:35.068453] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T20:02:35.351083] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-10-21T20:02:35.862243] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T20:02:36.151011] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-10-21T20:02:36.465601] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T20:02:36.950978] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-10-21T20:02:37.178992] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T20:02:37.751031] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-10-21T20:02:38.014781] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T20:02:38.551090] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-10. [2025-10-21T20:02:38.741029] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T20:02:39.350996] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-10-21T20:02:39.737924] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T20:02:39.742364] [INFO ] [REMOTE ] MTUS: Full fetch complete (41148 records). [2025-10-21T20:02:39.742450] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-10-21T20:02:40.113206] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-10-21T20:02:40.113278] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-10-21T20:02:40.114063] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-10-21T20:02:40.114123] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-10-21T20:02:40.115014] [DEBUG] [LOCAL ] MTUS: Trimmed 41148 records to 27534 (keeping 200 days of data) [2025-10-21T20:02:40.162463] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-10. [2025-10-21T20:02:40.270599] [DEBUG] [LOCAL ] MTUS: Primary data saved (27534 records). [2025-10-21T20:02:40.270751] [INFO ] [MAIN ] MTUS: Full history saved. [2025-10-21T20:02:40.270835] [INFO ] [MAIN ] Update Progress: 1419/2366 symbols completed. MTUS took 35.6s. Estimated remaining: 2h 1m 52s. Rate: 7.8 symbols/min [2025-10-21T20:02:40.440784] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:02:40.480715] [DEBUG] [LOCAL ] MTZ: Loaded 42828 existing records from primary storage. [2025-10-21T20:02:40.480987] [INFO ] [MAIN ] MTZ: Loaded 42828 existing records. [2025-10-21T20:02:40.673778] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:02:40.675143] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T20:02:40.675224] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-10-21T20:02:40.680869] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-10-21T20:02:40.681559] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-10-21T20:02:40.681616] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-10-21T20:02:40.957045] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-10-21T20:02:41.032952] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:02:41.414806] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T20:02:41.419413] [INFO ] [REMOTE ] MTRN: Full fetch complete (24077 records). [2025-10-21T20:02:41.419501] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-10-21T20:02:41.753674] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-10-21T20:02:41.796106] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-10-21T20:02:41.796180] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-10-21T20:02:41.796702] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-10-21T20:02:41.796764] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-10-21T20:02:41.797454] [DEBUG] [LOCAL ] MTRN: Trimmed 24077 records to 18253 (keeping 200 days of data) [2025-10-21T20:02:41.914205] [DEBUG] [LOCAL ] MTRN: Primary data saved (18253 records). [2025-10-21T20:02:41.914328] [INFO ] [MAIN ] MTRN: Full history saved. [2025-10-21T20:02:41.914395] [INFO ] [MAIN ] Update Progress: 1420/2366 symbols completed. MTRN took 42.8s. Estimated remaining: 2h 1m 40s. Rate: 7.8 symbols/min [2025-10-21T20:02:42.088069] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:02:42.104758] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T20:02:42.123288] [DEBUG] [LOCAL ] MUA: Loaded 11500 existing records from primary storage. [2025-10-21T20:02:42.123505] [INFO ] [MAIN ] MUA: Loaded 11500 existing records. [2025-10-21T20:02:42.307386] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:02:42.307570] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-10-21T20:02:42.307615] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-10-21T20:02:42.307810] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-10-21T20:02:42.307864] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-10-21T20:02:42.556351] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-10-21T20:02:42.672887] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:02:43.351052] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-10-21T20:02:43.433637] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T20:02:43.696761] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T20:02:44.151044] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-10-21T20:02:44.316968] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T20:02:44.951030] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-10. [2025-10-21T20:02:45.205206] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T20:02:45.751034] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-10-21T20:02:46.132373] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T20:02:46.136632] [INFO ] [REMOTE ] MTW: Full fetch complete (38139 records). [2025-10-21T20:02:46.136756] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-10-21T20:02:46.545338] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-10-21T20:02:46.545442] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-10-21T20:02:46.546361] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-10-21T20:02:46.551666] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-10-21T20:02:46.551821] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-10-21T20:02:46.558521] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T20:02:46.562789] [DEBUG] [LOCAL ] MTW: Trimmed 38139 records to 26484 (keeping 200 days of data) [2025-10-21T20:02:46.715803] [DEBUG] [LOCAL ] MTW: Primary data saved (26484 records). [2025-10-21T20:02:46.715928] [INFO ] [MAIN ] MTW: Full history saved. [2025-10-21T20:02:46.716003] [INFO ] [MAIN ] Update Progress: 1421/2366 symbols completed. MTW took 30.7s. Estimated remaining: 2h 1m 30s. Rate: 7.8 symbols/min [2025-10-21T20:02:46.893354] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:02:46.913934] [DEBUG] [LOCAL ] MUC: Loaded 20776 existing records from primary storage. [2025-10-21T20:02:46.914187] [INFO ] [MAIN ] MUC: Loaded 20776 existing records. [2025-10-21T20:02:47.099807] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:02:47.100043] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-10-21T20:02:47.100090] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-10-21T20:02:47.100269] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-10-21T20:02:47.100307] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-10-21T20:02:47.361682] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-10. [2025-10-21T20:02:47.483068] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:02:48.151003] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-10-21T20:02:48.254858] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T20:02:48.502225] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T20:02:48.505500] [INFO ] [REMOTE ] MTX: Full fetch complete (31383 records). [2025-10-21T20:02:48.505583] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-10-21T20:02:48.876166] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-10-21T20:02:48.876234] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-10-21T20:02:48.876878] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-10-21T20:02:48.876938] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-10-21T20:02:48.877634] [DEBUG] [LOCAL ] MTX: Trimmed 31383 records to 22671 (keeping 200 days of data) [2025-10-21T20:02:48.962949] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-10-21T20:02:49.012686] [DEBUG] [LOCAL ] MTX: Primary data saved (22671 records). [2025-10-21T20:02:49.012808] [INFO ] [MAIN ] MTX: Full history saved. [2025-10-21T20:02:49.012882] [INFO ] [MAIN ] Update Progress: 1422/2366 symbols completed. MTX took 26.4s. Estimated remaining: 2h 1m 19s. Rate: 7.8 symbols/min [2025-10-21T20:02:49.184687] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:02:49.202173] [DEBUG] [LOCAL ] MUE: Loaded 12237 existing records from primary storage. [2025-10-21T20:02:49.202565] [INFO ] [MAIN ] MUE: Loaded 12237 existing records. [2025-10-21T20:02:49.404429] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T20:02:49.403871] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:02:49.409707] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-10-21T20:02:49.409775] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-10-21T20:02:49.410000] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-10-21T20:02:49.410071] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-10-21T20:02:49.752837] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-10-21T20:02:49.784154] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:02:49.883022] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T20:02:50.551074] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-10-21T20:02:50.754344] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T20:02:51.353921] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-10-21T20:02:51.357437] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T20:02:52.150994] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-10-21T20:02:52.384538] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T20:02:52.901470] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T20:02:52.951039] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-10-21T20:02:53.751031] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-10-21T20:02:54.506762] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T20:02:54.551009] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-10-21T20:02:54.643273] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T20:02:55.313321] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T20:02:55.350982] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-10-21T20:02:56.151000] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-10-21T20:02:56.276759] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T20:02:56.951031] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-10-21T20:02:57.198920] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-21T20:02:57.731505] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T20:02:57.750989] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-10-21T20:02:58.551082] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-10-21T20:02:58.623994] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T20:02:59.351044] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-10-21T20:03:00.144929] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T20:03:00.145945] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T20:03:00.154760] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-10-21T20:03:00.951079] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-10-21T20:03:01.751147] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-10-21T20:03:02.121315] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T20:03:02.383170] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-21T20:03:02.551042] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-10-21T20:03:03.351014] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-10. [2025-10-21T20:03:03.467373] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T20:03:03.498835] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T20:03:04.151044] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-10-21T20:03:04.221514] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T20:03:04.223996] [INFO ] [REMOTE ] MUA: Full fetch complete (18358 records). [2025-10-21T20:03:04.224096] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-10-21T20:03:04.635373] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-10-21T20:03:04.635488] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-10-21T20:03:04.636162] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-10-21T20:03:04.636244] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-10-21T20:03:04.637555] [DEBUG] [LOCAL ] MUA: Trimmed 18358 records to 11519 (keeping 200 days of data) [2025-10-21T20:03:04.722585] [DEBUG] [LOCAL ] MUA: Primary data saved (11519 records). [2025-10-21T20:03:04.722840] [INFO ] [MAIN ] MUA: Full history saved. [2025-10-21T20:03:04.722968] [INFO ] [MAIN ] Update Progress: 1423/2366 symbols completed. MUA took 22.8s. Estimated remaining: 2h 1m 17s. Rate: 7.8 symbols/min [2025-10-21T20:03:04.906320] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:04.962083] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-10-21T20:03:04.968027] [DEBUG] [LOCAL ] MUFG: Loaded 52417 existing records from primary storage. [2025-10-21T20:03:04.968687] [INFO ] [MAIN ] MUFG: Loaded 52417 existing records. [2025-10-21T20:03:05.217609] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T20:03:05.223393] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:03:05.229479] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-10-21T20:03:05.229544] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-10-21T20:03:05.229963] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-10-21T20:03:05.230023] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-10-21T20:03:05.591280] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:05.751042] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-10-21T20:03:05.939378] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T20:03:06.551033] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-10-21T20:03:07.305107] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T20:03:07.350998] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-10-21T20:03:08.151018] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-10-21T20:03:08.240629] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T20:03:08.951032] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-10-21T20:03:09.024518] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T20:03:09.089675] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T20:03:09.751063] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-10-21T20:03:09.814032] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T20:03:10.429787] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T20:03:10.551020] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-10-21T20:03:11.351032] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-10-21T20:03:12.156102] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-10-21T20:03:12.173333] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T20:03:12.936578] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T20:03:12.950977] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-10-21T20:03:13.059413] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T20:03:13.751077] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-10-21T20:03:14.227185] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T20:03:14.551002] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-10-21T20:03:14.635356] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T20:03:15.350998] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-10. [2025-10-21T20:03:16.151001] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-10. [2025-10-21T20:03:16.316833] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T20:03:16.951072] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-10-21T20:03:17.243206] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T20:03:17.250350] [INFO ] [REMOTE ] MTZ: Full fetch complete (63761 records). [2025-10-21T20:03:17.250502] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-10-21T20:03:17.477414] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T20:03:17.545455] [INFO ] [REMOTE ] MUC: Full fetch complete (29516 records). [2025-10-21T20:03:17.562873] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-10-21T20:03:17.755217] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-10-21T20:03:17.871830] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-21T20:03:17.867981] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-10-21T20:03:17.920702] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-10-21T20:03:17.922566] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-10-21T20:03:17.947679] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-10-21T20:03:18.030764] [DEBUG] [LOCAL ] MTZ: Trimmed 63761 records to 42780 (keeping 200 days of data) [2025-10-21T20:03:18.196147] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-10-21T20:03:18.197033] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-10-21T20:03:18.198943] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-10-21T20:03:18.200038] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-10-21T20:03:18.208488] [DEBUG] [LOCAL ] MUC: Trimmed 29516 records to 20743 (keeping 200 days of data) [2025-10-21T20:03:18.463342] [DEBUG] [LOCAL ] MUC: Primary data saved (20743 records). [2025-10-21T20:03:18.468524] [INFO ] [MAIN ] MUC: Full history saved. [2025-10-21T20:03:18.472680] [INFO ] [MAIN ] Update Progress: 1424/2366 symbols completed. MUC took 31.8s. Estimated remaining: 2h 1m 13s. Rate: 7.8 symbols/min [2025-10-21T20:03:18.556103] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-10-21T20:03:18.571689] [DEBUG] [LOCAL ] MTZ: Primary data saved (42780 records). [2025-10-21T20:03:18.577703] [INFO ] [MAIN ] MTZ: Full history saved. [2025-10-21T20:03:18.600176] [INFO ] [MAIN ] Update Progress: 1425/2366 symbols completed. MTZ took 38.3s. Estimated remaining: 2h 1m 0s. Rate: 7.8 symbols/min [2025-10-21T20:03:18.774887] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:18.854769] [DEBUG] [LOCAL ] MUJ: Loaded 13886 existing records from primary storage. [2025-10-21T20:03:18.854458] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:18.855295] [INFO ] [MAIN ] MUJ: Loaded 13886 existing records. [2025-10-21T20:03:19.034953] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:03:19.035326] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-10-21T20:03:19.035388] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-10-21T20:03:19.035549] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-10-21T20:03:19.035587] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-10-21T20:03:19.307959] [DEBUG] [LOCAL ] MUR: Loaded 52913 existing records from primary storage. [2025-10-21T20:03:19.336301] [INFO ] [MAIN ] MUR: Loaded 52913 existing records. [2025-10-21T20:03:19.563934] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:19.570924] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T20:03:19.584369] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-10-21T20:03:19.629435] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:03:19.630769] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-10-21T20:03:19.630829] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-10-21T20:03:19.631157] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-10-21T20:03:19.631213] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-10-21T20:03:20.016092] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:20.046075] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T20:03:20.151005] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-10. [2025-10-21T20:03:20.617299] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T20:03:20.951086] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-10-21T20:03:21.051827] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T20:03:21.056140] [INFO ] [REMOTE ] MUE: Full fetch complete (15972 records). [2025-10-21T20:03:21.056341] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-10-21T20:03:21.613850] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-10-21T20:03:21.613977] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-10-21T20:03:21.614768] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-10-21T20:03:21.614854] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-10-21T20:03:21.615896] [DEBUG] [LOCAL ] MUE: Trimmed 15972 records to 12251 (keeping 200 days of data) [2025-10-21T20:03:21.735111] [DEBUG] [LOCAL ] MUE: Primary data saved (12251 records). [2025-10-21T20:03:21.735330] [INFO ] [MAIN ] MUE: Full history saved. [2025-10-21T20:03:21.735460] [INFO ] [MAIN ] Update Progress: 1426/2366 symbols completed. MUE took 32.7s. Estimated remaining: 2h 0m 50s. Rate: 7.8 symbols/min [2025-10-21T20:03:21.756238] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-10-21T20:03:21.957485] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:21.982419] [DEBUG] [LOCAL ] MUSA: Loaded 24721 existing records from primary storage. [2025-10-21T20:03:21.982719] [INFO ] [MAIN ] MUSA: Loaded 24721 existing records. [2025-10-21T20:03:22.172999] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:03:22.173248] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-10-21T20:03:22.173297] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-10-21T20:03:22.173479] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-10-21T20:03:22.173517] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-10-21T20:03:22.530938] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:22.550986] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-10-21T20:03:22.604943] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T20:03:22.877511] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T20:03:23.351005] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-10-21T20:03:23.663517] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T20:03:24.151027] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-10-21T20:03:24.951006] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-10-21T20:03:25.049816] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T20:03:25.330946] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T20:03:25.407953] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T20:03:25.751032] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-10-21T20:03:26.551030] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-10-21T20:03:27.351001] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-10-21T20:03:27.411040] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T20:03:27.500016] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T20:03:28.151012] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-10-21T20:03:28.470990] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T20:03:28.951069] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-10-21T20:03:29.751039] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-10-21T20:03:29.872889] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T20:03:29.939928] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-21T20:03:30.551012] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-10-21T20:03:31.175773] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T20:03:31.351045] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-10-21T20:03:32.151090] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-10-21T20:03:32.447725] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T20:03:32.936237] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T20:03:32.950969] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-10-21T20:03:33.224785] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T20:03:33.751052] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-10-21T20:03:33.929681] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T20:03:34.551072] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-10-21T20:03:35.351064] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-10-21T20:03:35.515001] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T20:03:36.151010] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-10-21T20:03:36.262434] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T20:03:36.359992] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T20:03:36.951029] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-10-21T20:03:37.111582] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T20:03:37.751084] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-10-21T20:03:38.551005] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-10-21T20:03:38.662267] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T20:03:38.748366] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T20:03:39.351026] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-10-21T20:03:39.927215] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T20:03:40.151041] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-10-21T20:03:40.241497] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T20:03:40.951092] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-10-21T20:03:41.017310] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T20:03:41.750999] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-10. [2025-10-21T20:03:42.115984] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T20:03:42.551000] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-10-21T20:03:42.658545] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T20:03:42.661959] [INFO ] [REMOTE ] MUJ: Full fetch complete (19548 records). [2025-10-21T20:03:42.662122] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-10-21T20:03:43.027424] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-10-21T20:03:43.027508] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-10-21T20:03:43.028085] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-10-21T20:03:43.028150] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-10-21T20:03:43.028771] [DEBUG] [LOCAL ] MUJ: Trimmed 19548 records to 13883 (keeping 200 days of data) [2025-10-21T20:03:43.116298] [DEBUG] [LOCAL ] MUJ: Primary data saved (13883 records). [2025-10-21T20:03:43.116470] [INFO ] [MAIN ] MUJ: Full history saved. [2025-10-21T20:03:43.116556] [INFO ] [MAIN ] Update Progress: 1427/2366 symbols completed. MUJ took 24.6s. Estimated remaining: 2h 0m 51s. Rate: 7.8 symbols/min [2025-10-21T20:03:43.284745] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:43.284948] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-10-21T20:03:43.285004] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-10-21T20:03:43.285113] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-10-21T20:03:43.285168] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-21T20:03:43.285258] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-21T20:03:43.285301] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-10-21T20:03:43.360443] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-10-21T20:03:43.689461] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:44.151035] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-10-21T20:03:44.384589] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T20:03:44.447714] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:03:44.448051] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-10-21T20:03:44.448148] [FATAL] [REMOTE ] MUSE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:03:44.448218] [FATAL] [MAIN ] MUSE: Failed to fetch primary data. [2025-10-21T20:03:44.448282] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:03:44.448354] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-10-21T20:03:44.448417] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-10-21T20:03:44.448452] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-10-21T20:03:44.448489] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-10-21T20:03:44.448533] [INFO ] [MAIN ] Update Progress: 1428/2366 symbols completed. MUSE took 1.3s. Estimated remaining: 2h 0m 39s. Rate: 7.8 symbols/min [2025-10-21T20:03:44.634849] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:44.636194] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T20:03:44.683841] [DEBUG] [LOCAL ] MUX: Loaded 43712 existing records from primary storage. [2025-10-21T20:03:44.684142] [INFO ] [MAIN ] MUX: Loaded 43712 existing records. [2025-10-21T20:03:44.855587] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:03:44.855809] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-10-21T20:03:44.855857] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-10-21T20:03:44.856097] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-10-21T20:03:44.856134] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-10-21T20:03:44.953019] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-10. [2025-10-21T20:03:45.208880] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:45.751009] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-10-21T20:03:46.551053] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-10-21T20:03:46.995225] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T20:03:47.003491] [INFO ] [REMOTE ] MUFG: Full fetch complete (75861 records). [2025-10-21T20:03:47.003638] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-10-21T20:03:47.344378] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T20:03:47.354797] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-10-21T20:03:47.440022] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-10-21T20:03:47.440122] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-10-21T20:03:47.441294] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-10-21T20:03:47.441358] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-10-21T20:03:47.442887] [DEBUG] [LOCAL ] MUFG: Trimmed 75861 records to 52435 (keeping 200 days of data) [2025-10-21T20:03:47.753906] [DEBUG] [LOCAL ] MUFG: Primary data saved (52435 records). [2025-10-21T20:03:47.754047] [INFO ] [MAIN ] MUFG: Full history saved. [2025-10-21T20:03:47.754464] [INFO ] [MAIN ] Update Progress: 1429/2366 symbols completed. MUFG took 43.0s. Estimated remaining: 2h 0m 28s. Rate: 7.8 symbols/min [2025-10-21T20:03:47.924344] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:47.940278] [DEBUG] [LOCAL ] MVF: Loaded 12674 existing records from primary storage. [2025-10-21T20:03:47.940508] [INFO ] [MAIN ] MVF: Loaded 12674 existing records. [2025-10-21T20:03:48.123960] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:03:48.124224] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-10-21T20:03:48.124303] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-10-21T20:03:48.124627] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-10-21T20:03:48.124720] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-10-21T20:03:48.157178] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-10-21T20:03:48.492420] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:48.524781] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T20:03:48.616810] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T20:03:48.951022] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-10-21T20:03:49.726935] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T20:03:49.751000] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-10-21T20:03:50.551082] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-10-21T20:03:50.657270] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T20:03:51.283772] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T20:03:51.351241] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-10. [2025-10-21T20:03:51.357780] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T20:03:52.151028] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-10-21T20:03:52.408493] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T20:03:52.412374] [INFO ] [REMOTE ] MUSA: Full fetch complete (35566 records). [2025-10-21T20:03:52.412482] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-10-21T20:03:52.783487] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-10-21T20:03:52.783573] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-10-21T20:03:52.784298] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-10-21T20:03:52.784360] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-10-21T20:03:52.785202] [DEBUG] [LOCAL ] MUSA: Trimmed 35566 records to 24642 (keeping 200 days of data) [2025-10-21T20:03:52.935713] [DEBUG] [LOCAL ] MUSA: Primary data saved (24642 records). [2025-10-21T20:03:52.935839] [INFO ] [MAIN ] MUSA: Full history saved. [2025-10-21T20:03:52.935916] [INFO ] [MAIN ] Update Progress: 1430/2366 symbols completed. MUSA took 31.2s. Estimated remaining: 2h 0m 19s. Rate: 7.8 symbols/min [2025-10-21T20:03:52.956390] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-10. [2025-10-21T20:03:53.109112] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:53.119462] [DEBUG] [LOCAL ] MVO: Loaded 8946 existing records from primary storage. [2025-10-21T20:03:53.119700] [INFO ] [MAIN ] MVO: Loaded 8946 existing records. [2025-10-21T20:03:53.315582] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:03:53.315867] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-10-21T20:03:53.315919] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-10-21T20:03:53.316079] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-10-21T20:03:53.316135] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-10-21T20:03:53.686937] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:53.750423] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T20:03:53.758901] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-10-21T20:03:54.551140] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-10-21T20:03:54.817767] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T20:03:54.963622] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T20:03:54.972552] [INFO ] [REMOTE ] MUR: Full fetch complete (76795 records). [2025-10-21T20:03:54.972705] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-10-21T20:03:55.142258] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T20:03:55.352764] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-10-21T20:03:55.393968] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-10-21T20:03:55.394045] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-10-21T20:03:55.395211] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-10-21T20:03:55.395274] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-10-21T20:03:55.396714] [DEBUG] [LOCAL ] MUR: Trimmed 76795 records to 52868 (keeping 200 days of data) [2025-10-21T20:03:55.714366] [DEBUG] [LOCAL ] MUR: Primary data saved (52868 records). [2025-10-21T20:03:55.714509] [INFO ] [MAIN ] MUR: Full history saved. [2025-10-21T20:03:55.715091] [INFO ] [MAIN ] Update Progress: 1431/2366 symbols completed. MUR took 37.1s. Estimated remaining: 2h 0m 8s. Rate: 7.8 symbols/min [2025-10-21T20:03:55.911956] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:03:55.924637] [DEBUG] [LOCAL ] MVT: Loaded 9962 existing records from primary storage. [2025-10-21T20:03:55.924879] [INFO ] [MAIN ] MVT: Loaded 9962 existing records. [2025-10-21T20:03:56.105609] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:03:56.105819] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-10-21T20:03:56.105866] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-10-21T20:03:56.106037] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-10-21T20:03:56.106094] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-10-21T20:03:56.160945] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-10-21T20:03:56.413298] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T20:03:56.487114] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:03:56.951127] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-10-21T20:03:57.685551] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T20:03:57.751040] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-10-21T20:03:57.771119] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T20:03:58.551052] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-10-21T20:03:58.756107] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T20:03:59.351075] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-10-21T20:03:59.369546] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T20:04:00.073525] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T20:04:00.151037] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-10-21T20:04:00.951048] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-10-21T20:04:01.322377] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T20:04:01.751092] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-10-21T20:04:02.551041] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-10-21T20:04:02.969019] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T20:04:03.161753] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T20:04:03.351003] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-10-21T20:04:03.366994] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T20:04:04.151075] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-10-21T20:04:04.763702] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T20:04:04.951011] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-10-21T20:04:04.991745] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T20:04:05.690332] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T20:04:05.750976] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-10-21T20:04:06.551031] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-10-21T20:04:07.298880] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T20:04:07.351106] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-10-21T20:04:07.355060] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T20:04:08.151028] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-10-21T20:04:08.171002] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T20:04:08.734425] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T20:04:08.951030] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-10-21T20:04:09.751041] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-10-21T20:04:10.302688] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T20:04:10.551024] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-10-21T20:04:10.803374] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T20:04:11.154734] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-21T20:04:11.351085] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-10-21T20:04:12.151013] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-10. [2025-10-21T20:04:12.241028] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-21T20:04:12.951026] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-10-21T20:04:13.724102] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T20:04:13.750975] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-10-21T20:04:13.887162] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T20:04:13.895171] [INFO ] [REMOTE ] MUX: Full fetch complete (61396 records). [2025-10-21T20:04:13.895280] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-10-21T20:04:14.329100] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-10-21T20:04:14.329399] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-10-21T20:04:14.330801] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-10-21T20:04:14.330871] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-10-21T20:04:14.333522] [DEBUG] [LOCAL ] MUX: Trimmed 61396 records to 43793 (keeping 200 days of data) [2025-10-21T20:04:14.457271] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T20:04:14.560906] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-10-21T20:04:14.671276] [DEBUG] [LOCAL ] MUX: Primary data saved (43793 records). [2025-10-21T20:04:14.671484] [INFO ] [MAIN ] MUX: Full history saved. [2025-10-21T20:04:14.671619] [INFO ] [MAIN ] Update Progress: 1432/2366 symbols completed. MUX took 30.2s. Estimated remaining: 2h 0m 8s. Rate: 7.8 symbols/min [2025-10-21T20:04:14.921197] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:04:14.989191] [DEBUG] [LOCAL ] MWA: Loaded 45836 existing records from primary storage. [2025-10-21T20:04:14.989713] [INFO ] [MAIN ] MWA: Loaded 45836 existing records. [2025-10-21T20:04:15.259015] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:04:15.259296] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-10-21T20:04:15.259369] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-10-21T20:04:15.259689] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-10-21T20:04:15.259764] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-10-21T20:04:15.354430] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-10-21T20:04:15.617548] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T20:04:15.764906] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:04:16.110578] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T20:04:16.151056] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-10-21T20:04:16.951091] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-10-21T20:04:17.662406] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T20:04:17.751066] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-10. [2025-10-21T20:04:17.813923] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T20:04:18.551045] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-10-21T20:04:18.740601] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T20:04:18.743662] [INFO ] [REMOTE ] MVF: Full fetch complete (18433 records). [2025-10-21T20:04:18.743741] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-10-21T20:04:19.147383] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-10-21T20:04:19.147482] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-10-21T20:04:19.148033] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-10-21T20:04:19.148095] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-10-21T20:04:19.148929] [DEBUG] [LOCAL ] MVF: Trimmed 18433 records to 12684 (keeping 200 days of data) [2025-10-21T20:04:19.225623] [DEBUG] [LOCAL ] MVF: Primary data saved (12684 records). [2025-10-21T20:04:19.225799] [INFO ] [MAIN ] MVF: Full history saved. [2025-10-21T20:04:19.225882] [INFO ] [MAIN ] Update Progress: 1433/2366 symbols completed. MVF took 31.5s. Estimated remaining: 1h 59m 58s. Rate: 7.8 symbols/min [2025-10-21T20:04:19.356262] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-10-21T20:04:19.446413] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:04:19.446587] [DEBUG] [LOCAL ] MX: No existing data file found in primary storage. [2025-10-21T20:04:19.446623] [WARN ] [MAIN ] MX: No existing data found, performing full refresh instead. [2025-10-21T20:04:19.446760] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-10-21T20:04:19.446801] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-10-21T20:04:19.446841] [DEBUG] [LOCAL ] MX: No primary data file found to delete. [2025-10-21T20:04:19.446878] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-10-21T20:04:19.833370] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:04:20.002525] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T20:04:20.043968] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T20:04:20.151043] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-10-21T20:04:20.951072] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-10-21T20:04:20.980591] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T20:04:21.751040] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-10-21T20:04:22.551015] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-10. [2025-10-21T20:04:22.673027] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T20:04:22.746115] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T20:04:23.186640] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T20:04:23.188611] [INFO ] [REMOTE ] MVT: Full fetch complete (13739 records). [2025-10-21T20:04:23.188731] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-10-21T20:04:23.356126] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-10-21T20:04:23.608435] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-10-21T20:04:23.608515] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-10-21T20:04:23.608845] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-10-21T20:04:23.608906] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-10-21T20:04:23.609382] [DEBUG] [LOCAL ] MVT: Trimmed 13739 records to 9911 (keeping 200 days of data) [2025-10-21T20:04:23.673887] [DEBUG] [LOCAL ] MVT: Primary data saved (9911 records). [2025-10-21T20:04:23.674026] [INFO ] [MAIN ] MVT: Full history saved. [2025-10-21T20:04:23.674104] [INFO ] [MAIN ] Update Progress: 1434/2366 symbols completed. MVT took 28.0s. Estimated remaining: 1h 59m 48s. Rate: 7.8 symbols/min [2025-10-21T20:04:23.841251] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:04:23.841443] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-10-21T20:04:23.841481] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-10-21T20:04:23.841593] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-10-21T20:04:23.841634] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-21T20:04:23.841718] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-21T20:04:23.841758] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-10-21T20:04:24.165104] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-10-21T20:04:24.206008] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:04:24.933982] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T20:04:24.950974] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-10. [2025-10-21T20:04:25.050299] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T20:04:25.751122] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-10-21T20:04:25.796107] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T20:04:25.798318] [INFO ] [REMOTE ] MVO: Full fetch complete (14601 records). [2025-10-21T20:04:25.798392] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-10-21T20:04:26.182630] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-21T20:04:26.194184] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-10-21T20:04:26.194273] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-10-21T20:04:26.194682] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-10-21T20:04:26.194743] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-10-21T20:04:26.195331] [DEBUG] [LOCAL ] MVO: Trimmed 14601 records to 8969 (keeping 200 days of data) [2025-10-21T20:04:26.250289] [DEBUG] [LOCAL ] MVO: Primary data saved (8969 records). [2025-10-21T20:04:26.250432] [INFO ] [MAIN ] MVO: Full history saved. [2025-10-21T20:04:26.250511] [INFO ] [MAIN ] Update Progress: 1435/2366 symbols completed. MVO took 33.3s. Estimated remaining: 1h 59m 37s. Rate: 7.8 symbols/min [2025-10-21T20:04:26.418117] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:04:26.426463] [DEBUG] [LOCAL ] MXF: Loaded 5568 existing records from primary storage. [2025-10-21T20:04:26.426706] [INFO ] [MAIN ] MXF: Loaded 5568 existing records. [2025-10-21T20:04:26.562452] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-10-21T20:04:26.602259] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:04:26.602431] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-10-21T20:04:26.602478] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-10-21T20:04:26.602613] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-10-21T20:04:26.602674] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-10-21T20:04:26.948097] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:04:27.111847] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-21T20:04:27.351074] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-10-21T20:04:28.151079] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-10-21T20:04:28.338845] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T20:04:28.446070] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-21T20:04:28.951042] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-10-21T20:04:29.750998] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-10-21T20:04:29.986420] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T20:04:30.537506] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T20:04:30.550969] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-10-21T20:04:31.318049] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T20:04:31.351038] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-10-21T20:04:32.151021] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-10-21T20:04:32.943938] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T20:04:32.953225] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-10-21T20:04:33.301138] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T20:04:33.751023] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-10-21T20:04:33.795517] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T20:04:34.550993] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-10-21T20:04:34.677260] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T20:04:35.008703] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T20:04:35.351018] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-10-21T20:04:36.064212] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-21T20:04:36.151015] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-10-21T20:04:36.484759] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-21T20:04:36.950989] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-10-21T20:04:37.290744] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-21T20:04:37.751014] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-10-21T20:04:38.324912] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T20:04:38.551047] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-10-21T20:04:38.987198] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T20:04:39.351018] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-10-21T20:04:40.151019] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-10-21T20:04:40.616254] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T20:04:40.819351] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T20:04:40.950992] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-10-21T20:04:41.751013] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-10-21T20:04:42.489821] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T20:04:42.551003] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-10-21T20:04:42.855018] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T20:04:43.351062] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-10-21T20:04:43.959021] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T20:04:44.077218] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T20:04:44.151065] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-10-21T20:04:44.849223] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T20:04:44.951062] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-10-21T20:04:45.451416] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-21T20:04:45.751029] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-10. [2025-10-21T20:04:46.361013] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-21T20:04:46.361871] [INFO ] [REMOTE ] MXE: Full fetch complete (2583 records). [2025-10-21T20:04:46.361936] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-10-21T20:04:46.558342] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T20:04:46.558418] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-10-21T20:04:46.559085] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:04:46.559944] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:04:46.560019] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-10-21T20:04:46.560088] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-10-21T20:04:46.560187] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-10-21T20:04:46.560252] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-10-21T20:04:46.560348] [INFO ] [MAIN ] Update Progress: 1436/2366 symbols completed. MXE took 22.9s. Estimated remaining: 1h 59m 37s. Rate: 7.8 symbols/min [2025-10-21T20:04:46.746389] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:04:46.762328] [DEBUG] [LOCAL ] MYD: Loaded 13274 existing records from primary storage. [2025-10-21T20:04:46.762636] [INFO ] [MAIN ] MYD: Loaded 13274 existing records. [2025-10-21T20:04:46.973478] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:04:46.973737] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-10-21T20:04:46.973801] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-10-21T20:04:46.974005] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-10-21T20:04:46.974060] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-10-21T20:04:47.328996] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:04:47.350986] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-10-21T20:04:47.597176] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T20:04:48.151026] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-10-21T20:04:48.170548] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T20:04:48.623672] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T20:04:48.951011] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-10. [2025-10-21T20:04:49.589397] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T20:04:49.590839] [INFO ] [REMOTE ] MXF: Full fetch complete (9780 records). [2025-10-21T20:04:49.590908] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-10-21T20:04:49.756204] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-10-21T20:04:49.980739] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-10-21T20:04:49.980833] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-10-21T20:04:49.981125] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-10-21T20:04:49.981177] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-10-21T20:04:49.981705] [DEBUG] [LOCAL ] MXF: Trimmed 9780 records to 5492 (keeping 200 days of data) [2025-10-21T20:04:50.016769] [DEBUG] [LOCAL ] MXF: Primary data saved (5492 records). [2025-10-21T20:04:50.016913] [INFO ] [MAIN ] MXF: Full history saved. [2025-10-21T20:04:50.017010] [INFO ] [MAIN ] Update Progress: 1437/2366 symbols completed. MXF took 23.8s. Estimated remaining: 1h 59m 27s. Rate: 7.8 symbols/min [2025-10-21T20:04:50.551024] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-10-21T20:04:50.988445] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T20:04:51.351007] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-10-21T20:04:51.614853] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T20:04:52.151058] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-10-21T20:04:52.318269] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T20:04:52.951039] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-10-21T20:04:53.316250] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T20:04:53.751091] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-10-21T20:04:54.106486] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T20:04:54.437327] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-21T20:04:54.551051] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-10. [2025-10-21T20:04:55.351031] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-10. [2025-10-21T20:04:55.654822] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T20:04:55.658283] [INFO ] [REMOTE ] MX: Full fetch complete (31461 records). [2025-10-21T20:04:55.658370] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-10-21T20:04:56.047374] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-10-21T20:04:56.047454] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-10-21T20:04:56.048198] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-10-21T20:04:56.048261] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-10-21T20:04:56.049092] [DEBUG] [LOCAL ] MX: Trimmed 31461 records to 22280 (keeping 200 days of data) [2025-10-21T20:04:56.153708] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-10-21T20:04:56.174003] [DEBUG] [LOCAL ] MX: Primary data saved (22280 records). [2025-10-21T20:04:56.174257] [INFO ] [MAIN ] MX: Full history saved. [2025-10-21T20:04:56.174403] [INFO ] [MAIN ] Update Progress: 1438/2366 symbols completed. MX took 36.9s. Estimated remaining: 1h 59m 18s. Rate: 7.8 symbols/min [2025-10-21T20:04:56.953763] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T20:04:56.961680] [INFO ] [REMOTE ] MWA: Full fetch complete (68134 records). [2025-10-21T20:04:56.961826] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-10-21T20:04:57.331266] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T20:04:57.364931] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-10-21T20:04:57.382340] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-10-21T20:04:57.382423] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-10-21T20:04:57.383475] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-10-21T20:04:57.383639] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-10-21T20:04:57.385054] [DEBUG] [LOCAL ] MWA: Trimmed 68134 records to 45796 (keeping 200 days of data) [2025-10-21T20:04:57.666466] [DEBUG] [LOCAL ] MWA: Primary data saved (45796 records). [2025-10-21T20:04:57.666794] [INFO ] [MAIN ] MWA: Full history saved. [2025-10-21T20:04:57.668024] [INFO ] [MAIN ] Update Progress: 1439/2366 symbols completed. MWA took 43.0s. Estimated remaining: 1h 59m 6s. Rate: 7.8 symbols/min [2025-10-21T20:04:58.049623] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-21T20:04:58.053273] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-10-21T20:04:58.858714] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T20:04:58.861947] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-10-21T20:04:59.638869] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T20:04:59.642397] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-10-21T20:05:00.426629] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T20:05:00.429476] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-10-21T20:05:02.070505] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T20:05:02.076248] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-10. [2025-10-21T20:05:03.247445] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T20:05:03.251551] [INFO ] [REMOTE ] MYD: Full fetch complete (20071 records). [2025-10-21T20:05:03.251700] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-10-21T20:05:03.627013] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-10-21T20:05:03.627097] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-10-21T20:05:03.627539] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-10-21T20:05:03.627599] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-10-21T20:05:03.628364] [DEBUG] [LOCAL ] MYD: Trimmed 20071 records to 13209 (keeping 200 days of data) [2025-10-21T20:05:03.707379] [DEBUG] [LOCAL ] MYD: Primary data saved (13209 records). [2025-10-21T20:05:03.707517] [INFO ] [MAIN ] MYD: Full history saved. [2025-10-21T20:05:03.707593] [INFO ] [MAIN ] Update Progress: 1440/2366 symbols completed. MYD took 17.1s. Estimated remaining: 1h 58m 58s. Rate: 7.8 symbols/min [2025-10-21T20:05:04.398692] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:04.424803] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:04.380862] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:04.461234] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:04.473610] [DEBUG] [LOCAL ] MYN: Loaded 9964 existing records from primary storage. [2025-10-21T20:05:04.473939] [INFO ] [MAIN ] MYN: Loaded 9964 existing records. [2025-10-21T20:05:04.619837] [DEBUG] [LOCAL ] MYI: Loaded 18937 existing records from primary storage. [2025-10-21T20:05:04.647437] [INFO ] [MAIN ] MYI: Loaded 18937 existing records. [2025-10-21T20:05:04.642132] [DEBUG] [LOCAL ] MYE: Loaded 24224 existing records from primary storage. [2025-10-21T20:05:04.717098] [INFO ] [MAIN ] MYE: Loaded 24224 existing records. [2025-10-21T20:05:04.701547] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:04.779248] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-10-21T20:05:04.801846] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-10-21T20:05:04.856913] [DEBUG] [LOCAL ] NABL: Loaded 39071 existing records from primary storage. [2025-10-21T20:05:04.862243] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-10-21T20:05:04.908153] [INFO ] [MAIN ] NABL: Loaded 39071 existing records. [2025-10-21T20:05:04.925751] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-10-21T20:05:05.180522] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:05.271192] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-10-21T20:05:05.261034] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:05.307548] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-10-21T20:05:05.313014] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-10-21T20:05:05.324199] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-10-21T20:05:05.390115] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-10-21T20:05:05.384092] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-10-21T20:05:05.433211] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-10-21T20:05:05.455806] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:05.455977] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-10-21T20:05:05.481721] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-10-21T20:05:05.646674] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-10-21T20:05:05.695872] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-10-21T20:05:05.770014] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-10-21T20:05:06.465781] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:06.533978] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-10-21T20:05:06.757354] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:06.801122] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-10-21T20:05:06.805395] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:06.829498] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-10-21T20:05:06.869207] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:06.869518] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-10-21T20:05:07.457257] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T20:05:07.460357] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-10-21T20:05:07.618105] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T20:05:07.623810] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-10-21T20:05:07.812321] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T20:05:07.823084] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-10-21T20:05:07.960306] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T20:05:07.968433] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-10-21T20:05:08.327501] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T20:05:08.332566] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-10-21T20:05:08.752461] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T20:05:08.913569] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T20:05:08.951059] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-10-21T20:05:09.042125] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T20:05:09.107110] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T20:05:09.751102] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-10-21T20:05:10.010441] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T20:05:10.509966] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T20:05:10.551070] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-10-21T20:05:11.351077] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-10-21T20:05:11.816018] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T20:05:12.151032] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-10-21T20:05:12.510156] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T20:05:12.951047] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-10-21T20:05:13.759678] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-10-21T20:05:13.765115] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T20:05:13.895199] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T20:05:14.551046] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-10-21T20:05:14.887822] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T20:05:15.288792] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T20:05:15.351042] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-10-21T20:05:16.151039] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-10-21T20:05:16.715454] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T20:05:16.916103] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T20:05:16.951013] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-10-21T20:05:17.751075] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-10-21T20:05:18.476689] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T20:05:18.551043] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-10-21T20:05:18.749143] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T20:05:19.351077] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-10-21T20:05:19.886884] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T20:05:20.134099] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T20:05:20.150981] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-10-21T20:05:20.862929] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T20:05:20.951059] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-10-21T20:05:21.702223] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T20:05:21.751023] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-10-21T20:05:22.551044] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-10. [2025-10-21T20:05:22.847254] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T20:05:23.351051] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-10-21T20:05:23.396963] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T20:05:23.399762] [INFO ] [REMOTE ] MYN: Full fetch complete (14983 records). [2025-10-21T20:05:23.399887] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-10-21T20:05:23.775070] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-10-21T20:05:23.775157] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-10-21T20:05:23.775512] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-10-21T20:05:23.775551] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-10-21T20:05:23.776051] [DEBUG] [LOCAL ] MYN: Trimmed 14983 records to 9986 (keeping 200 days of data) [2025-10-21T20:05:23.836943] [DEBUG] [LOCAL ] MYN: Primary data saved (9986 records). [2025-10-21T20:05:23.837073] [INFO ] [MAIN ] MYN: Full history saved. [2025-10-21T20:05:23.837154] [INFO ] [MAIN ] Update Progress: 1441/2366 symbols completed. MYN took 20.1s. Estimated remaining: 1h 58m 58s. Rate: 7.8 symbols/min [2025-10-21T20:05:24.044017] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:24.070292] [DEBUG] [LOCAL ] NAC: Loaded 24479 existing records from primary storage. [2025-10-21T20:05:24.070548] [INFO ] [MAIN ] NAC: Loaded 24479 existing records. [2025-10-21T20:05:24.160538] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-10-21T20:05:24.251791] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:24.251992] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-10-21T20:05:24.252042] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-10-21T20:05:24.252293] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-10-21T20:05:24.252351] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-10-21T20:05:24.446124] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T20:05:24.631605] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:24.951068] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-10-21T20:05:25.379899] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T20:05:25.751051] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-10-21T20:05:26.014354] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T20:05:26.551124] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-10-21T20:05:27.160492] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T20:05:27.351074] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-10-21T20:05:27.584029] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T20:05:28.151083] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-10-21T20:05:28.368997] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T20:05:28.951039] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-10-21T20:05:29.162226] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T20:05:29.751026] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-10-21T20:05:30.227491] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T20:05:30.551068] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-10-21T20:05:30.893262] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T20:05:31.350996] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-10-21T20:05:31.606395] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T20:05:32.151035] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-10-21T20:05:32.626266] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T20:05:32.951089] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-10-21T20:05:33.470746] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T20:05:33.751016] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-10-21T20:05:34.038526] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T20:05:34.551001] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-10. [2025-10-21T20:05:34.797167] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T20:05:35.351035] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-10-21T20:05:35.750938] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T20:05:35.754723] [INFO ] [REMOTE ] MYI: Full fetch complete (28655 records). [2025-10-21T20:05:35.754830] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-10-21T20:05:36.135859] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-10-21T20:05:36.135945] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-10-21T20:05:36.136579] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-10-21T20:05:36.136698] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-10-21T20:05:36.137486] [DEBUG] [LOCAL ] MYI: Trimmed 28655 records to 19113 (keeping 200 days of data) [2025-10-21T20:05:36.190230] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-10-21T20:05:36.260852] [DEBUG] [LOCAL ] MYI: Primary data saved (19113 records). [2025-10-21T20:05:36.261090] [INFO ] [MAIN ] MYI: Full history saved. [2025-10-21T20:05:36.261269] [INFO ] [MAIN ] Update Progress: 1442/2366 symbols completed. MYI took 32.6s. Estimated remaining: 1h 58m 53s. Rate: 7.8 symbols/min [2025-10-21T20:05:36.437410] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:36.452869] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T20:05:36.490459] [DEBUG] [LOCAL ] NAD: Loaded 33743 existing records from primary storage. [2025-10-21T20:05:36.490756] [INFO ] [MAIN ] NAD: Loaded 33743 existing records. [2025-10-21T20:05:36.674284] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:36.674514] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-10-21T20:05:36.674560] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-10-21T20:05:36.674783] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-10-21T20:05:36.674843] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-10-21T20:05:36.951622] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-10. [2025-10-21T20:05:37.037529] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:37.062712] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T20:05:37.751076] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-10-21T20:05:38.304780] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T20:05:38.311004] [INFO ] [REMOTE ] NABL: Full fetch complete (56975 records). [2025-10-21T20:05:38.311146] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-10-21T20:05:38.553826] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-10. [2025-10-21T20:05:38.708458] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-10-21T20:05:38.708619] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-10-21T20:05:38.709730] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-10-21T20:05:38.709795] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-10-21T20:05:38.711012] [DEBUG] [LOCAL ] NABL: Trimmed 56975 records to 39022 (keeping 200 days of data) [2025-10-21T20:05:38.932770] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T20:05:38.953011] [DEBUG] [LOCAL ] NABL: Primary data saved (39022 records). [2025-10-21T20:05:38.953502] [INFO ] [MAIN ] NABL: Full history saved. [2025-10-21T20:05:38.953595] [INFO ] [MAIN ] Update Progress: 1443/2366 symbols completed. NABL took 35.2s. Estimated remaining: 1h 58m 42s. Rate: 7.8 symbols/min [2025-10-21T20:05:39.125044] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:39.134278] [DEBUG] [LOCAL ] NAN: Loaded 8464 existing records from primary storage. [2025-10-21T20:05:39.134478] [INFO ] [MAIN ] NAN: Loaded 8464 existing records. [2025-10-21T20:05:39.316181] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:39.316451] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-10-21T20:05:39.316522] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-10-21T20:05:39.316743] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-10-21T20:05:39.316798] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-10-21T20:05:39.359004] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-10-21T20:05:39.687723] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:39.945780] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T20:05:39.949842] [INFO ] [REMOTE ] MYE: Full fetch complete (35986 records). [2025-10-21T20:05:39.949960] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-10-21T20:05:40.156384] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-10-21T20:05:40.334911] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-10-21T20:05:40.334996] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-10-21T20:05:40.335832] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-10-21T20:05:40.335893] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-10-21T20:05:40.336633] [DEBUG] [LOCAL ] MYE: Trimmed 35986 records to 24090 (keeping 200 days of data) [2025-10-21T20:05:40.485182] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T20:05:40.532291] [DEBUG] [LOCAL ] MYE: Primary data saved (24090 records). [2025-10-21T20:05:40.532421] [INFO ] [MAIN ] MYE: Full history saved. [2025-10-21T20:05:40.532499] [INFO ] [MAIN ] Update Progress: 1444/2366 symbols completed. MYE took 36.8s. Estimated remaining: 1h 58m 31s. Rate: 7.8 symbols/min [2025-10-21T20:05:40.712317] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:40.757317] [DEBUG] [LOCAL ] NAT: Loaded 49239 existing records from primary storage. [2025-10-21T20:05:40.757637] [INFO ] [MAIN ] NAT: Loaded 49239 existing records. [2025-10-21T20:05:40.945146] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:40.945351] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-10-21T20:05:40.945410] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-10-21T20:05:40.945623] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-10-21T20:05:40.945700] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-10-21T20:05:40.957331] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-10-21T20:05:41.331173] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:41.352293] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T20:05:41.751024] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-10-21T20:05:42.317548] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T20:05:42.551019] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-10. [2025-10-21T20:05:42.727065] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T20:05:43.351028] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-10-21T20:05:43.794478] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T20:05:43.798407] [INFO ] [REMOTE ] NAC: Full fetch complete (35386 records). [2025-10-21T20:05:43.798500] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-10-21T20:05:44.157110] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-10-21T20:05:44.158192] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-10-21T20:05:44.158943] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-10-21T20:05:44.159746] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-10-21T20:05:44.159845] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-10-21T20:05:44.160776] [DEBUG] [LOCAL ] NAC: Trimmed 35386 records to 24420 (keeping 200 days of data) [2025-10-21T20:05:44.306350] [DEBUG] [LOCAL ] NAC: Primary data saved (24420 records). [2025-10-21T20:05:44.306481] [INFO ] [MAIN ] NAC: Full history saved. [2025-10-21T20:05:44.306559] [INFO ] [MAIN ] Update Progress: 1445/2366 symbols completed. NAC took 20.5s. Estimated remaining: 1h 58m 20s. Rate: 7.8 symbols/min [2025-10-21T20:05:44.469582] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:05:44.503628] [DEBUG] [LOCAL ] NATL: Loaded 32454 existing records from primary storage. [2025-10-21T20:05:44.503970] [INFO ] [MAIN ] NATL: Loaded 32454 existing records. [2025-10-21T20:05:44.674831] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:05:44.675043] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-10-21T20:05:44.675101] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-10-21T20:05:44.675301] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-10-21T20:05:44.675355] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-10-21T20:05:44.957844] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-10-21T20:05:45.071481] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:05:45.073609] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T20:05:45.279171] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T20:05:45.751019] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-10-21T20:05:46.358283] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T20:05:46.551028] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-10-21T20:05:46.992567] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T20:05:47.351015] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-10-21T20:05:48.152851] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-10-21T20:05:48.156226] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T20:05:48.403890] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T20:05:48.951039] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-10-21T20:05:48.975043] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T20:05:49.751044] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-10-21T20:05:50.550996] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-10-21T20:05:50.634266] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T20:05:50.826764] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T20:05:51.351036] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-10-21T20:05:51.928909] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T20:05:52.151049] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-10-21T20:05:52.950990] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-10-21T20:05:53.068674] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T20:05:53.105581] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T20:05:53.751039] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-10-21T20:05:54.418800] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T20:05:54.509768] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T20:05:54.550982] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-10-21T20:05:55.351017] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-10-21T20:05:55.911580] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T20:05:56.151067] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-10-21T20:05:56.327821] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T20:05:56.772026] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T20:05:56.951006] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-10-21T20:05:57.698425] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T20:05:57.751009] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-10-21T20:05:58.528810] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T20:05:58.551014] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-10-21T20:05:59.351038] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-10-21T20:05:59.655162] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T20:06:00.151052] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-10-21T20:06:00.632822] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T20:06:00.951034] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-10-21T20:06:01.629110] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T20:06:01.751063] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-10-21T20:06:02.550991] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-10-21T20:06:02.952101] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T20:06:03.351052] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-10-21T20:06:03.887063] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T20:06:04.075171] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T20:06:04.159688] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-10-21T20:06:04.177722] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-21T20:06:04.951058] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-10-21T20:06:05.657096] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T20:06:05.750988] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-10-21T20:06:06.305368] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T20:06:06.551036] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-10-21T20:06:07.085069] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T20:06:07.351050] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-10. [2025-10-21T20:06:07.891260] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T20:06:07.951513] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T20:06:07.953291] [INFO ] [REMOTE ] NAN: Full fetch complete (13498 records). [2025-10-21T20:06:07.953365] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-10-21T20:06:08.160889] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-10-21T20:06:08.320605] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-10-21T20:06:08.320726] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-10-21T20:06:08.321090] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-10-21T20:06:08.321132] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-10-21T20:06:08.321741] [DEBUG] [LOCAL ] NAN: Trimmed 13498 records to 8463 (keeping 200 days of data) [2025-10-21T20:06:08.373439] [DEBUG] [LOCAL ] NAN: Primary data saved (8463 records). [2025-10-21T20:06:08.373567] [INFO ] [MAIN ] NAN: Full history saved. [2025-10-21T20:06:08.373668] [INFO ] [MAIN ] Update Progress: 1446/2366 symbols completed. NAN took 29.4s. Estimated remaining: 1h 58m 23s. Rate: 7.8 symbols/min [2025-10-21T20:06:08.546270] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:08.551367] [DEBUG] [LOCAL ] NAZ: Loaded 2677 existing records from primary storage. [2025-10-21T20:06:08.551552] [INFO ] [MAIN ] NAZ: Loaded 2677 existing records. [2025-10-21T20:06:08.740526] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:06:08.740769] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-10-21T20:06:08.740820] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-10-21T20:06:08.740956] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-10-21T20:06:08.740993] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-10-21T20:06:08.960573] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-10. [2025-10-21T20:06:09.122001] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:06:09.751055] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-10-21T20:06:09.902454] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T20:06:10.325259] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T20:06:10.419130] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T20:06:10.424368] [INFO ] [REMOTE ] NAD: Full fetch complete (48673 records). [2025-10-21T20:06:10.424511] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-10-21T20:06:10.556255] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-10-21T20:06:10.858813] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-10-21T20:06:10.858899] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-10-21T20:06:10.859866] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-10-21T20:06:10.859930] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-10-21T20:06:10.861049] [DEBUG] [LOCAL ] NAD: Trimmed 48673 records to 33724 (keeping 200 days of data) [2025-10-21T20:06:11.080510] [DEBUG] [LOCAL ] NAD: Primary data saved (33724 records). [2025-10-21T20:06:11.080716] [INFO ] [MAIN ] NAD: Full history saved. [2025-10-21T20:06:11.081348] [INFO ] [MAIN ] Update Progress: 1447/2366 symbols completed. NAD took 34.8s. Estimated remaining: 1h 58m 12s. Rate: 7.8 symbols/min [2025-10-21T20:06:11.272833] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:11.285272] [DEBUG] [LOCAL ] NBB: Loaded 9040 existing records from primary storage. [2025-10-21T20:06:11.285496] [INFO ] [MAIN ] NBB: Loaded 9040 existing records. [2025-10-21T20:06:11.356864] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-10. [2025-10-21T20:06:11.501482] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:06:11.501744] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-10-21T20:06:11.501800] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-10-21T20:06:11.501959] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-10-21T20:06:11.501997] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-10-21T20:06:11.876569] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:06:12.151106] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-10-21T20:06:12.370077] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T20:06:12.720741] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T20:06:12.739952] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T20:06:12.744635] [INFO ] [REMOTE ] NATL: Full fetch complete (44988 records). [2025-10-21T20:06:12.744774] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-10-21T20:06:12.956739] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-10-21T20:06:13.113391] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-10-21T20:06:13.113469] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-10-21T20:06:13.114308] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-10-21T20:06:13.114369] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-10-21T20:06:13.115322] [DEBUG] [LOCAL ] NATL: Trimmed 44988 records to 32251 (keeping 200 days of data) [2025-10-21T20:06:13.300847] [DEBUG] [LOCAL ] NATL: Primary data saved (32251 records). [2025-10-21T20:06:13.300992] [INFO ] [MAIN ] NATL: Full history saved. [2025-10-21T20:06:13.301069] [INFO ] [MAIN ] Update Progress: 1448/2366 symbols completed. NATL took 29.0s. Estimated remaining: 1h 58m 1s. Rate: 7.8 symbols/min [2025-10-21T20:06:13.466311] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:13.489352] [DEBUG] [LOCAL ] NBHC: Loaded 23824 existing records from primary storage. [2025-10-21T20:06:13.489589] [INFO ] [MAIN ] NBHC: Loaded 23824 existing records. [2025-10-21T20:06:13.676226] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:06:13.676440] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-10-21T20:06:13.676493] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-10-21T20:06:13.676687] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-10-21T20:06:13.676751] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-10-21T20:06:13.755148] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-10-21T20:06:13.900846] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T20:06:14.101353] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:06:14.374002] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T20:06:14.551038] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-10-21T20:06:15.351066] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-10-21T20:06:16.090614] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T20:06:16.151045] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-10-21T20:06:16.235331] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T20:06:16.626235] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T20:06:16.951045] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-10-21T20:06:17.751093] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-10-21T20:06:18.214910] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T20:06:18.551074] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-10-21T20:06:18.640367] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T20:06:19.071584] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T20:06:19.351108] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-10-21T20:06:20.137011] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T20:06:20.150983] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-10-21T20:06:20.938692] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T20:06:20.950981] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-10-21T20:06:21.691461] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T20:06:21.751069] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-10. [2025-10-21T20:06:22.551071] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-10-21T20:06:23.211418] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T20:06:23.351008] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-10-21T20:06:23.679704] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T20:06:23.687572] [INFO ] [REMOTE ] NAT: Full fetch complete (72239 records). [2025-10-21T20:06:23.687728] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-10-21T20:06:24.047421] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T20:06:24.103472] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-10-21T20:06:24.103554] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-10-21T20:06:24.104595] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-10-21T20:06:24.104684] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-10-21T20:06:24.106068] [DEBUG] [LOCAL ] NAT: Trimmed 72239 records to 49231 (keeping 200 days of data) [2025-10-21T20:06:24.153372] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-10-21T20:06:24.391154] [DEBUG] [LOCAL ] NAT: Primary data saved (49231 records). [2025-10-21T20:06:24.391295] [INFO ] [MAIN ] NAT: Full history saved. [2025-10-21T20:06:24.391375] [INFO ] [MAIN ] Update Progress: 1449/2366 symbols completed. NAT took 43.9s. Estimated remaining: 1h 57m 55s. Rate: 7.8 symbols/min [2025-10-21T20:06:24.559994] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:24.592538] [DEBUG] [LOCAL ] NBR: Loaded 34623 existing records from primary storage. [2025-10-21T20:06:24.592835] [INFO ] [MAIN ] NBR: Loaded 34623 existing records. [2025-10-21T20:06:24.772353] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T20:06:24.778147] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:06:24.780250] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-10-21T20:06:24.780311] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-10-21T20:06:24.780514] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-10-21T20:06:24.780574] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-10-21T20:06:24.956433] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-10-21T20:06:25.152204] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:06:25.751005] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-10-21T20:06:26.157927] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T20:06:26.353488] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T20:06:26.551083] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-10-21T20:06:27.080052] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T20:06:27.351061] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-10-21T20:06:28.136934] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T20:06:28.150991] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-10-21T20:06:28.919281] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T20:06:28.951068] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-10. [2025-10-21T20:06:29.751089] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-10-21T20:06:29.840637] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T20:06:29.843032] [INFO ] [REMOTE ] NBB: Full fetch complete (13158 records). [2025-10-21T20:06:29.843315] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-10-21T20:06:30.223164] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-10-21T20:06:30.223242] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-10-21T20:06:30.223540] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-10-21T20:06:30.223578] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-10-21T20:06:30.224037] [DEBUG] [LOCAL ] NBB: Trimmed 13158 records to 9040 (keeping 200 days of data) [2025-10-21T20:06:30.277941] [DEBUG] [LOCAL ] NBB: Primary data saved (9040 records). [2025-10-21T20:06:30.278072] [INFO ] [MAIN ] NBB: Full history saved. [2025-10-21T20:06:30.278154] [INFO ] [MAIN ] Update Progress: 1450/2366 symbols completed. NBB took 19.2s. Estimated remaining: 1h 57m 47s. Rate: 7.8 symbols/min [2025-10-21T20:06:30.448285] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:30.470756] [DEBUG] [LOCAL ] NBXG: Loaded 21838 existing records from primary storage. [2025-10-21T20:06:30.471053] [INFO ] [MAIN ] NBXG: Loaded 21838 existing records. [2025-10-21T20:06:30.557900] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-10-21T20:06:30.660707] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:06:30.660980] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-10-21T20:06:30.661063] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-10-21T20:06:30.661362] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-10-21T20:06:30.661415] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-10-21T20:06:30.801720] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T20:06:31.040853] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:06:31.351089] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-10-21T20:06:31.557254] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T20:06:32.151055] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-10-21T20:06:32.386819] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T20:06:32.951024] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-10. [2025-10-21T20:06:33.093036] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T20:06:33.569716] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T20:06:33.570703] [INFO ] [REMOTE ] NAZ: Full fetch complete (4097 records). [2025-10-21T20:06:33.570770] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-10-21T20:06:33.756281] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-10-21T20:06:33.936243] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-10-21T20:06:33.936318] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-10-21T20:06:33.936446] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-10-21T20:06:33.936483] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-10-21T20:06:33.936854] [DEBUG] [LOCAL ] NAZ: Trimmed 4097 records to 2684 (keeping 200 days of data) [2025-10-21T20:06:33.952994] [DEBUG] [LOCAL ] NAZ: Primary data saved (2684 records). [2025-10-21T20:06:33.953069] [INFO ] [MAIN ] NAZ: Full history saved. [2025-10-21T20:06:33.953141] [INFO ] [MAIN ] Update Progress: 1451/2366 symbols completed. NAZ took 25.6s. Estimated remaining: 1h 57m 36s. Rate: 7.8 symbols/min [2025-10-21T20:06:34.119456] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:34.122895] [DEBUG] [LOCAL ] NC: Loaded 2000 existing records from primary storage. [2025-10-21T20:06:34.123051] [INFO ] [MAIN ] NC: Loaded 2000 existing records. [2025-10-21T20:06:34.296966] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:06:34.297186] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-10-21T20:06:34.297233] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-10-21T20:06:34.297388] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-10-21T20:06:34.297443] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-10-21T20:06:34.556216] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-10-21T20:06:34.666916] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:06:35.301823] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T20:06:35.351030] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-10-21T20:06:35.931956] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T20:06:36.151011] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-10-21T20:06:36.672730] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T20:06:36.692689] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T20:06:36.951013] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-10-21T20:06:37.402854] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T20:06:37.751005] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-10-21T20:06:38.220227] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-21T20:06:38.551072] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-10-21T20:06:38.964148] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-21T20:06:39.351018] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-10-21T20:06:40.151028] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-10-21T20:06:40.576974] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T20:06:40.620939] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T20:06:40.951028] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-10-21T20:06:41.751039] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-10-21T20:06:41.973280] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T20:06:42.551080] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-10-21T20:06:43.154713] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T20:06:43.351062] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-10-21T20:06:43.567542] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T20:06:44.150996] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-10-21T20:06:44.400363] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T20:06:44.951013] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-10-21T20:06:45.164072] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T20:06:45.533923] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T20:06:45.751027] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-10-21T20:06:46.551027] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-10-21T20:06:47.035896] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T20:06:47.225137] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T20:06:47.351002] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-10-21T20:06:48.151029] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-10-21T20:06:48.574341] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T20:06:48.718554] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T20:06:48.951022] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-10-21T20:06:49.475476] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T20:06:49.751031] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-10-21T20:06:50.551002] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-10-21T20:06:51.001993] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T20:06:51.351058] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-10. [2025-10-21T20:06:51.951905] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T20:06:51.952840] [INFO ] [REMOTE ] NC: Full fetch complete (2769 records). [2025-10-21T20:06:51.952906] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-10-21T20:06:52.128977] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T20:06:52.152789] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-10-21T20:06:52.400977] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-10-21T20:06:52.401066] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-10-21T20:06:52.401197] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-10-21T20:06:52.401237] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-10-21T20:06:52.401613] [DEBUG] [LOCAL ] NC: Trimmed 2769 records to 2007 (keeping 200 days of data) [2025-10-21T20:06:52.415370] [DEBUG] [LOCAL ] NC: Primary data saved (2007 records). [2025-10-21T20:06:52.415521] [INFO ] [MAIN ] NC: Full history saved. [2025-10-21T20:06:52.415612] [INFO ] [MAIN ] Update Progress: 1452/2366 symbols completed. NC took 18.5s. Estimated remaining: 1h 57m 35s. Rate: 7.8 symbols/min [2025-10-21T20:06:52.607493] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:52.617606] [DEBUG] [LOCAL ] NCA: Loaded 9920 existing records from primary storage. [2025-10-21T20:06:52.617858] [INFO ] [MAIN ] NCA: Loaded 9920 existing records. [2025-10-21T20:06:52.799585] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:06:52.799854] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-10-21T20:06:52.799903] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-10-21T20:06:52.800110] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-10-21T20:06:52.800166] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-10-21T20:06:52.959430] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-10-21T20:06:53.172969] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:06:53.221195] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T20:06:53.751054] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-10-21T20:06:53.830021] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T20:06:54.551038] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-10-21T20:06:54.878477] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T20:06:55.328408] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T20:06:55.350995] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-10-21T20:06:56.151013] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-10. [2025-10-21T20:06:56.226255] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T20:06:56.951089] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-10-21T20:06:57.536319] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T20:06:57.543757] [INFO ] [REMOTE ] NBHC: Full fetch complete (33249 records). [2025-10-21T20:06:57.543886] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-10-21T20:06:57.748622] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T20:06:57.760747] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-10. [2025-10-21T20:06:57.944342] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-10-21T20:06:57.944427] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-10-21T20:06:57.945122] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-10-21T20:06:57.945184] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-10-21T20:06:57.946116] [DEBUG] [LOCAL ] NBHC: Trimmed 33249 records to 23749 (keeping 200 days of data) [2025-10-21T20:06:58.087499] [DEBUG] [LOCAL ] NBHC: Primary data saved (23749 records). [2025-10-21T20:06:58.087630] [INFO ] [MAIN ] NBHC: Full history saved. [2025-10-21T20:06:58.087761] [INFO ] [MAIN ] Update Progress: 1453/2366 symbols completed. NBHC took 44.8s. Estimated remaining: 1h 57m 26s. Rate: 7.8 symbols/min [2025-10-21T20:06:58.253226] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:58.273608] [DEBUG] [LOCAL ] NCDL: Loaded 21728 existing records from primary storage. [2025-10-21T20:06:58.273886] [INFO ] [MAIN ] NCDL: Loaded 21728 existing records. [2025-10-21T20:06:58.450459] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:06:58.450780] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-10-21T20:06:58.450841] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-10-21T20:06:58.451218] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-10-21T20:06:58.451274] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-10-21T20:06:58.556166] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-10-21T20:06:58.813405] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:06:59.112140] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T20:06:59.117178] [INFO ] [REMOTE ] NBR: Full fetch complete (49029 records). [2025-10-21T20:06:59.117306] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-10-21T20:06:59.266431] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-21T20:06:59.358596] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-10-21T20:06:59.551560] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-10-21T20:06:59.551671] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-10-21T20:06:59.552561] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-10-21T20:06:59.552605] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-10-21T20:06:59.553782] [DEBUG] [LOCAL ] NBR: Trimmed 49029 records to 34506 (keeping 200 days of data) [2025-10-21T20:06:59.752915] [DEBUG] [LOCAL ] NBR: Primary data saved (34506 records). [2025-10-21T20:06:59.753085] [INFO ] [MAIN ] NBR: Full history saved. [2025-10-21T20:06:59.753173] [INFO ] [MAIN ] Update Progress: 1454/2366 symbols completed. NBR took 35.4s. Estimated remaining: 1h 57m 15s. Rate: 7.8 symbols/min [2025-10-21T20:06:59.921048] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:06:59.971973] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-10-21T20:06:59.972326] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-10-21T20:07:00.149728] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:07:00.149957] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-10-21T20:07:00.150004] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-10-21T20:07:00.150246] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-10-21T20:07:00.150300] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-10-21T20:07:00.161313] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-10-21T20:07:00.275373] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T20:07:00.522370] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:07:00.951112] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-10-21T20:07:01.751054] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-10-21T20:07:01.851426] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T20:07:02.414712] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T20:07:02.551046] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-10-21T20:07:03.351017] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-10-21T20:07:03.618350] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T20:07:03.814755] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T20:07:04.107920] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T20:07:04.150998] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-10-21T20:07:04.950992] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-10-21T20:07:04.989110] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T20:07:05.751011] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-10-21T20:07:06.551087] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-10-21T20:07:06.915701] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T20:07:06.955060] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T20:07:07.351015] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-10-21T20:07:07.640904] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T20:07:08.139292] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T20:07:08.150978] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-10-21T20:07:08.935461] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T20:07:08.950975] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-10. [2025-10-21T20:07:09.728559] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T20:07:09.730079] [INFO ] [REMOTE ] NCA: Full fetch complete (14292 records). [2025-10-21T20:07:09.730148] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-10-21T20:07:09.760244] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-10-21T20:07:10.104863] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-10-21T20:07:10.104989] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-10-21T20:07:10.105311] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-10-21T20:07:10.105977] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-10-21T20:07:10.106514] [DEBUG] [LOCAL ] NCA: Trimmed 14292 records to 9809 (keeping 200 days of data) [2025-10-21T20:07:10.165001] [DEBUG] [LOCAL ] NCA: Primary data saved (9809 records). [2025-10-21T20:07:10.165145] [INFO ] [MAIN ] NCA: Full history saved. [2025-10-21T20:07:10.165225] [INFO ] [MAIN ] Update Progress: 1455/2366 symbols completed. NCA took 17.7s. Estimated remaining: 1h 57m 9s. Rate: 7.8 symbols/min [2025-10-21T20:07:10.334848] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:07:10.349690] [DEBUG] [LOCAL ] NCV: Loaded 13877 existing records from primary storage. [2025-10-21T20:07:10.349892] [INFO ] [MAIN ] NCV: Loaded 13877 existing records. [2025-10-21T20:07:10.530909] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:07:10.531152] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-10-21T20:07:10.531198] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-10-21T20:07:10.531385] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-10-21T20:07:10.531441] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-10-21T20:07:10.556156] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-10-21T20:07:11.069689] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:07:11.351091] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-10-21T20:07:11.744810] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-21T20:07:11.966041] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T20:07:12.151000] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-10-21T20:07:12.387712] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T20:07:12.951039] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-10-21T20:07:13.751072] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-10-21T20:07:14.147419] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T20:07:14.446110] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-21T20:07:14.551047] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-10-21T20:07:14.768259] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T20:07:15.351083] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-10-21T20:07:15.964116] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T20:07:16.151031] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-10-21T20:07:16.672426] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T20:07:16.889012] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T20:07:16.951038] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-10-21T20:07:17.751084] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-10. [2025-10-21T20:07:17.811590] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T20:07:18.551055] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-10-21T20:07:18.835110] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T20:07:18.838971] [INFO ] [REMOTE ] NBXG: Full fetch complete (32492 records). [2025-10-21T20:07:18.839051] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-10-21T20:07:19.221851] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-10-21T20:07:19.221968] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-10-21T20:07:19.223239] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-10-21T20:07:19.223336] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-10-21T20:07:19.224517] [DEBUG] [LOCAL ] NBXG: Trimmed 32492 records to 21795 (keeping 200 days of data) [2025-10-21T20:07:19.353050] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-10-21T20:07:19.368793] [DEBUG] [LOCAL ] NBXG: Primary data saved (21795 records). [2025-10-21T20:07:19.368955] [INFO ] [MAIN ] NBXG: Full history saved. [2025-10-21T20:07:19.369053] [INFO ] [MAIN ] Update Progress: 1456/2366 symbols completed. NBXG took 49.1s. Estimated remaining: 1h 57m 2s. Rate: 7.8 symbols/min [2025-10-21T20:07:19.553198] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:07:19.569164] [DEBUG] [LOCAL ] NCZ: Loaded 12277 existing records from primary storage. [2025-10-21T20:07:19.569483] [INFO ] [MAIN ] NCZ: Loaded 12277 existing records. [2025-10-21T20:07:19.753366] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:07:19.753679] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-10-21T20:07:19.753744] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-10-21T20:07:19.753991] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-10-21T20:07:19.754049] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-10-21T20:07:20.146495] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:07:20.150999] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-10-21T20:07:20.490116] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T20:07:20.865518] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-21T20:07:20.951063] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-10-21T20:07:21.321052] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T20:07:21.751073] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-10-21T20:07:21.904863] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T20:07:22.551097] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-10-21T20:07:23.351027] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-10-21T20:07:23.733512] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T20:07:23.988310] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T20:07:24.030706] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-21T20:07:24.151035] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-10-21T20:07:24.951003] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-10-21T20:07:25.034752] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T20:07:25.751021] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-10-21T20:07:25.953827] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T20:07:26.551488] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-10-21T20:07:26.553367] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-21T20:07:27.351055] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-10-21T20:07:28.151017] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-10-21T20:07:28.265949] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T20:07:28.829044] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-21T20:07:28.951015] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-10-21T20:07:29.054905] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T20:07:29.751081] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-10-21T20:07:30.551084] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-10-21T20:07:30.685718] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T20:07:30.776485] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T20:07:31.342349] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T20:07:31.350966] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-10-21T20:07:32.151058] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-10-21T20:07:32.384429] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T20:07:32.951031] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-10. [2025-10-21T20:07:33.751041] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-10-21T20:07:34.133981] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-21T20:07:34.160799] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T20:07:34.165777] [INFO ] [REMOTE ] NCDL: Full fetch complete (32893 records). [2025-10-21T20:07:34.165931] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-10-21T20:07:34.554519] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-10. [2025-10-21T20:07:34.587830] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-10-21T20:07:34.588284] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-10-21T20:07:34.589067] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-10-21T20:07:34.589155] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-10-21T20:07:34.603276] [DEBUG] [LOCAL ] NCDL: Trimmed 32893 records to 21701 (keeping 200 days of data) [2025-10-21T20:07:34.603063] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T20:07:34.740044] [DEBUG] [LOCAL ] NCDL: Primary data saved (21701 records). [2025-10-21T20:07:34.740178] [INFO ] [MAIN ] NCDL: Full history saved. [2025-10-21T20:07:34.740258] [INFO ] [MAIN ] Update Progress: 1457/2366 symbols completed. NCDL took 36.7s. Estimated remaining: 1h 56m 59s. Rate: 7.8 symbols/min [2025-10-21T20:07:34.910011] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:07:34.926897] [DEBUG] [LOCAL ] NDMO: Loaded 16985 existing records from primary storage. [2025-10-21T20:07:34.927127] [INFO ] [MAIN ] NDMO: Loaded 16985 existing records. [2025-10-21T20:07:35.106153] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:07:35.106442] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-10-21T20:07:35.106534] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-10-21T20:07:35.106925] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-10-21T20:07:35.106995] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-10-21T20:07:35.360771] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-10-21T20:07:35.493918] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:07:35.517556] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T20:07:35.526235] [INFO ] [REMOTE ] NCLH: Full fetch complete (77933 records). [2025-10-21T20:07:35.526386] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-10-21T20:07:35.923920] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-10-21T20:07:35.924068] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-10-21T20:07:35.925351] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-10-21T20:07:35.925436] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-10-21T20:07:35.927009] [DEBUG] [LOCAL ] NCLH: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-21T20:07:36.153741] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-10-21T20:07:36.166033] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T20:07:36.269289] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-10-21T20:07:36.269436] [INFO ] [MAIN ] NCLH: Full history saved. [2025-10-21T20:07:36.269515] [INFO ] [MAIN ] Update Progress: 1458/2366 symbols completed. NCLH took 36.5s. Estimated remaining: 1h 56m 48s. Rate: 7.8 symbols/min [2025-10-21T20:07:36.439238] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:07:36.486547] [DEBUG] [LOCAL ] NE: Loaded 52353 existing records from primary storage. [2025-10-21T20:07:36.486861] [INFO ] [MAIN ] NE: Loaded 52353 existing records. [2025-10-21T20:07:36.664300] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:07:36.664515] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-10-21T20:07:36.664564] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-10-21T20:07:36.664772] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-10-21T20:07:36.664829] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-10-21T20:07:36.956110] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-10-21T20:07:37.029933] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:07:37.057617] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T20:07:37.751054] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-10-21T20:07:37.878202] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T20:07:38.310574] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T20:07:38.551023] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-10-21T20:07:39.333302] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T20:07:39.350993] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-10-21T20:07:40.143770] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T20:07:40.150971] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-10. [2025-10-21T20:07:40.951038] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-10-21T20:07:41.279686] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T20:07:41.282841] [INFO ] [REMOTE ] NCZ: Full fetch complete (21022 records). [2025-10-21T20:07:41.282910] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-10-21T20:07:41.645569] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-10-21T20:07:41.645674] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-10-21T20:07:41.646150] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-10-21T20:07:41.646190] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-10-21T20:07:41.646783] [DEBUG] [LOCAL ] NCZ: Trimmed 21022 records to 12305 (keeping 200 days of data) [2025-10-21T20:07:41.719743] [DEBUG] [LOCAL ] NCZ: Primary data saved (12305 records). [2025-10-21T20:07:41.719872] [INFO ] [MAIN ] NCZ: Full history saved. [2025-10-21T20:07:41.719946] [INFO ] [MAIN ] Update Progress: 1459/2366 symbols completed. NCZ took 22.4s. Estimated remaining: 1h 56m 38s. Rate: 7.8 symbols/min [2025-10-21T20:07:41.751215] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-10-21T20:07:41.895388] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:07:41.917994] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T20:07:41.946251] [DEBUG] [LOCAL ] NEA: Loaded 35207 existing records from primary storage. [2025-10-21T20:07:41.946519] [INFO ] [MAIN ] NEA: Loaded 35207 existing records. [2025-10-21T20:07:42.118886] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:07:42.119122] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-10-21T20:07:42.119190] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-10-21T20:07:42.119391] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-10-21T20:07:42.119429] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-10-21T20:07:42.465443] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:07:42.550980] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-10-21T20:07:43.342278] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T20:07:43.352017] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-10-21T20:07:43.927221] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T20:07:44.151020] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-10-21T20:07:44.205004] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T20:07:44.951078] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-10-21T20:07:45.593843] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T20:07:45.751018] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-10-21T20:07:45.893246] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T20:07:46.551037] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-10. [2025-10-21T20:07:47.351067] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-10-21T20:07:47.526001] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T20:07:47.680013] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T20:07:47.683107] [INFO ] [REMOTE ] NCV: Full fetch complete (22394 records). [2025-10-21T20:07:47.683179] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-10-21T20:07:48.039779] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-10-21T20:07:48.039853] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-10-21T20:07:48.040278] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-10-21T20:07:48.040315] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-10-21T20:07:48.040901] [DEBUG] [LOCAL ] NCV: Trimmed 22394 records to 13917 (keeping 200 days of data) [2025-10-21T20:07:48.122860] [DEBUG] [LOCAL ] NCV: Primary data saved (13917 records). [2025-10-21T20:07:48.122989] [INFO ] [MAIN ] NCV: Full history saved. [2025-10-21T20:07:48.123066] [INFO ] [MAIN ] Update Progress: 1460/2366 symbols completed. NCV took 38.0s. Estimated remaining: 1h 56m 30s. Rate: 7.8 symbols/min [2025-10-21T20:07:48.154553] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-10-21T20:07:48.292868] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:07:48.344296] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-21T20:07:48.344608] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-10-21T20:07:48.526033] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:07:48.526390] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-10-21T20:07:48.526471] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-10-21T20:07:48.526695] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-10-21T20:07:48.526751] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-10-21T20:07:48.802773] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T20:07:48.905906] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:07:48.950984] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-10-21T20:07:49.751009] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-10-21T20:07:50.028288] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T20:07:50.551027] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-10-21T20:07:50.822722] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T20:07:50.851830] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T20:07:51.351063] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-10-21T20:07:52.151064] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-10-21T20:07:52.250595] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T20:07:52.568079] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T20:07:52.951098] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-10-21T20:07:53.751032] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-10-21T20:07:53.810858] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T20:07:54.201699] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T20:07:54.551030] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-10-21T20:07:55.167751] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T20:07:55.351101] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-10-21T20:07:56.151101] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-10-21T20:07:56.336154] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T20:07:56.702834] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T20:07:56.951076] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-10-21T20:07:57.751096] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-10-21T20:07:58.035492] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T20:07:58.310203] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T20:07:58.551060] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-10-21T20:07:59.256720] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T20:07:59.351013] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-10-21T20:08:00.151550] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-10-21T20:08:00.720880] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-21T20:08:00.951095] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-10-21T20:08:01.507200] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T20:08:01.751085] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-10-21T20:08:02.426015] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T20:08:02.551147] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-10-21T20:08:03.351107] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-10-21T20:08:03.854475] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T20:08:04.151140] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-10-21T20:08:04.318007] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-21T20:08:04.623472] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (4.47 seconds). [2025-10-21T20:08:04.951134] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-10-21T20:08:05.101556] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T20:08:05.536131] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T20:08:05.558252] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T20:08:05.751115] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-10-21T20:08:06.551078] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-10-21T20:08:07.351042] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-10. [2025-10-21T20:08:07.672813] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T20:08:07.778037] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T20:08:08.151052] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-10. [2025-10-21T20:08:08.951113] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-10-21T20:08:09.250933] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T20:08:09.259072] [INFO ] [REMOTE ] NE: Full fetch complete (75726 records). [2025-10-21T20:08:09.259206] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-10-21T20:08:09.628461] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T20:08:09.686869] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-10-21T20:08:09.687076] [INFO ] [REMOTE ] NEA: Full fetch complete (50900 records). [2025-10-21T20:08:09.686993] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-10-21T20:08:09.687197] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-10-21T20:08:09.688667] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-10-21T20:08:09.694307] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-10-21T20:08:09.771776] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-10-21T20:08:09.796347] [DEBUG] [LOCAL ] NE: Trimmed 75726 records to 52323 (keeping 200 days of data) [2025-10-21T20:08:09.821237] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T20:08:10.242835] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-10-21T20:08:10.242994] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-10-21T20:08:10.244555] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-10-21T20:08:10.244715] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-10-21T20:08:10.336965] [DEBUG] [LOCAL ] NEA: Trimmed 50900 records to 35149 (keeping 200 days of data) [2025-10-21T20:08:10.551228] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-10. [2025-10-21T20:08:10.551141] [DEBUG] [LOCAL ] NE: Primary data saved (52323 records). [2025-10-21T20:08:10.553710] [INFO ] [MAIN ] NE: Full history saved. [2025-10-21T20:08:10.554028] [INFO ] [MAIN ] Update Progress: 1461/2366 symbols completed. NE took 34.3s. Estimated remaining: 1h 56m 31s. Rate: 7.8 symbols/min [2025-10-21T20:08:10.827775] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:08:10.837050] [DEBUG] [LOCAL ] NEA: Primary data saved (35149 records). [2025-10-21T20:08:10.837519] [INFO ] [MAIN ] NEA: Full history saved. [2025-10-21T20:08:10.837954] [INFO ] [MAIN ] Update Progress: 1462/2366 symbols completed. NEA took 29.1s. Estimated remaining: 1h 56m 19s. Rate: 7.8 symbols/min [2025-10-21T20:08:11.015074] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:08:11.052414] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-21T20:08:11.052929] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-10-21T20:08:11.270180] [DEBUG] [LOCAL ] NET: Loaded 52843 existing records from primary storage. [2025-10-21T20:08:11.269037] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:08:11.270395] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-10-21T20:08:11.270632] [INFO ] [MAIN ] NET: Loaded 52843 existing records. [2025-10-21T20:08:11.270552] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-10-21T20:08:11.325533] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-10-21T20:08:11.341427] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-10-21T20:08:11.585227] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:08:11.616850] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-10-21T20:08:11.638615] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-10-21T20:08:11.645861] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-10-21T20:08:11.646001] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-10-21T20:08:11.682885] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T20:08:11.765884] [INFO ] [REMOTE ] NDMO: Full fetch complete (23314 records). [2025-10-21T20:08:11.801210] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-10-21T20:08:12.156878] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:08:12.183177] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-10-21T20:08:12.477197] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:08:12.492399] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-10-21T20:08:12.632451] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-10-21T20:08:12.632588] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-10-21T20:08:12.633166] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-10-21T20:08:12.633243] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-10-21T20:08:12.634234] [DEBUG] [LOCAL ] NDMO: Trimmed 23314 records to 16942 (keeping 200 days of data) [2025-10-21T20:08:12.667157] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-21T20:08:12.779064] [DEBUG] [LOCAL ] NDMO: Primary data saved (16942 records). [2025-10-21T20:08:12.779207] [INFO ] [MAIN ] NDMO: Full history saved. [2025-10-21T20:08:12.779285] [INFO ] [MAIN ] Update Progress: 1463/2366 symbols completed. NDMO took 38.0s. Estimated remaining: 1h 56m 8s. Rate: 7.8 symbols/min [2025-10-21T20:08:12.948694] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:08:12.951016] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-10-21T20:08:12.960042] [DEBUG] [LOCAL ] NEU: Loaded 8633 existing records from primary storage. [2025-10-21T20:08:12.960241] [INFO ] [MAIN ] NEU: Loaded 8633 existing records. [2025-10-21T20:08:13.141979] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:08:13.142255] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-10-21T20:08:13.142306] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-10-21T20:08:13.142467] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-10-21T20:08:13.142537] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-10-21T20:08:13.495621] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:08:13.751031] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-10-21T20:08:14.340072] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T20:08:14.550979] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-10-21T20:08:14.601971] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-21T20:08:14.627041] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T20:08:15.066024] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-21T20:08:15.351045] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-10-21T20:08:16.024722] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-21T20:08:16.151070] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-10-21T20:08:16.612137] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T20:08:16.811331] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T20:08:16.951115] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-10-21T20:08:17.751015] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-10-21T20:08:18.551077] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-10-21T20:08:19.123945] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-21T20:08:19.351032] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-10-21T20:08:19.940164] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-21T20:08:19.969572] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T20:08:20.151039] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-10-21T20:08:20.856304] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-21T20:08:20.950990] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-10-21T20:08:21.571032] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-21T20:08:21.751284] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-10-21T20:08:22.428614] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-21T20:08:22.551072] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-10-21T20:08:23.351061] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-10. [2025-10-21T20:08:23.592794] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T20:08:23.662775] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T20:08:24.151053] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-10-21T20:08:24.207133] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T20:08:24.215599] [INFO ] [REMOTE ] NEE: Full fetch complete (77887 records). [2025-10-21T20:08:24.215771] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-10-21T20:08:24.614212] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-10-21T20:08:24.614298] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-10-21T20:08:24.615441] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-10-21T20:08:24.615504] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-10-21T20:08:24.616974] [DEBUG] [LOCAL ] NEE: Trimmed 77887 records to 53707 (keeping 200 days of data) [2025-10-21T20:08:24.946680] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T20:08:24.951362] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-10-21T20:08:24.981689] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-10-21T20:08:24.981866] [INFO ] [MAIN ] NEE: Full history saved. [2025-10-21T20:08:24.982594] [INFO ] [MAIN ] Update Progress: 1464/2366 symbols completed. NEE took 36.9s. Estimated remaining: 1h 56m 3s. Rate: 7.8 symbols/min [2025-10-21T20:08:25.165338] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:08:25.173968] [DEBUG] [LOCAL ] NEXA: Loaded 5494 existing records from primary storage. [2025-10-21T20:08:25.174185] [INFO ] [MAIN ] NEXA: Loaded 5494 existing records. [2025-10-21T20:08:25.352118] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:08:25.352323] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-10-21T20:08:25.352372] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-10-21T20:08:25.352567] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-10-21T20:08:25.352622] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-10-21T20:08:25.701083] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:08:25.751026] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-10-21T20:08:26.529906] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T20:08:26.551010] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-10-21T20:08:27.242232] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T20:08:27.259874] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T20:08:27.351041] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-10-21T20:08:28.007268] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-21T20:08:28.151060] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-10-21T20:08:28.710628] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T20:08:28.951067] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-10. [2025-10-21T20:08:29.751006] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-10-21T20:08:29.759255] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T20:08:29.761550] [INFO ] [REMOTE ] NEU: Full fetch complete (10819 records). [2025-10-21T20:08:29.761704] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-10-21T20:08:30.124255] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-10-21T20:08:30.124339] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-10-21T20:08:30.124600] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-10-21T20:08:30.124666] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-10-21T20:08:30.125119] [DEBUG] [LOCAL ] NEU: Trimmed 10819 records to 8639 (keeping 200 days of data) [2025-10-21T20:08:30.177422] [DEBUG] [LOCAL ] NEU: Primary data saved (8639 records). [2025-10-21T20:08:30.177529] [INFO ] [MAIN ] NEU: Full history saved. [2025-10-21T20:08:30.177603] [INFO ] [MAIN ] Update Progress: 1465/2366 symbols completed. NEU took 17.4s. Estimated remaining: 1h 55m 53s. Rate: 7.8 symbols/min [2025-10-21T20:08:30.343176] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:08:30.348999] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T20:08:30.384218] [DEBUG] [LOCAL ] NFG: Loaded 38404 existing records from primary storage. [2025-10-21T20:08:30.384493] [INFO ] [MAIN ] NFG: Loaded 38404 existing records. [2025-10-21T20:08:30.559079] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:08:30.556160] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-10-21T20:08:30.559343] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-10-21T20:08:30.559415] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-10-21T20:08:30.560341] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-10-21T20:08:30.560397] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-10-21T20:08:30.918491] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:08:31.117242] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T20:08:31.351012] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-10-21T20:08:32.151032] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-10-21T20:08:32.721256] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T20:08:32.951032] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-10-21T20:08:33.368463] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T20:08:33.751036] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-10-21T20:08:34.470443] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T20:08:34.551004] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-10-21T20:08:35.351022] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-10-21T20:08:36.032069] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-21T20:08:36.065556] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T20:08:36.151004] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-10-21T20:08:36.951067] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-10-21T20:08:37.099806] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T20:08:37.325022] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-21T20:08:37.752033] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-10-21T20:08:37.754617] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T20:08:38.551073] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-10-21T20:08:39.002602] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T20:08:39.351039] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-10-21T20:08:39.727560] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T20:08:40.151136] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-10-21T20:08:40.651517] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-21T20:08:40.951112] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-10-21T20:08:41.614149] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-21T20:08:41.727419] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T20:08:41.751018] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-10. [2025-10-21T20:08:42.551029] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-10-21T20:08:42.731132] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T20:08:42.733779] [INFO ] [REMOTE ] NEXA: Full fetch complete (7977 records). [2025-10-21T20:08:42.733845] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-10-21T20:08:43.085146] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-10-21T20:08:43.085220] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-10-21T20:08:43.085409] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-10-21T20:08:43.085466] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-10-21T20:08:43.085878] [DEBUG] [LOCAL ] NEXA: Trimmed 7977 records to 5576 (keeping 200 days of data) [2025-10-21T20:08:43.116073] [DEBUG] [LOCAL ] NEXA: Primary data saved (5576 records). [2025-10-21T20:08:43.116151] [INFO ] [MAIN ] NEXA: Full history saved. [2025-10-21T20:08:43.116220] [INFO ] [MAIN ] Update Progress: 1466/2366 symbols completed. NEXA took 18.1s. Estimated remaining: 1h 55m 49s. Rate: 7.8 symbols/min [2025-10-21T20:08:43.294178] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:08:43.314662] [DEBUG] [LOCAL ] NFJ: Loaded 20008 existing records from primary storage. [2025-10-21T20:08:43.314899] [INFO ] [MAIN ] NFJ: Loaded 20008 existing records. [2025-10-21T20:08:43.356996] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-10-21T20:08:43.493203] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:08:43.493400] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-10-21T20:08:43.493446] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-10-21T20:08:43.493601] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-10-21T20:08:43.493638] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-10-21T20:08:43.849846] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:08:44.151028] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-10-21T20:08:44.779292] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T20:08:44.951020] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-10-21T20:08:45.668556] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T20:08:45.750984] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-10-21T20:08:46.031503] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T20:08:46.551000] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-10-21T20:08:46.615967] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-10-21T20:08:47.274147] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T20:08:47.351065] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-10-21T20:08:48.151063] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-10-21T20:08:48.547986] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T20:08:48.587528] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T20:08:48.951073] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-10-21T20:08:49.751133] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-10-21T20:08:49.930066] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T20:08:50.167991] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T20:08:50.551049] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-10. [2025-10-21T20:08:51.351029] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-10-21T20:08:51.428208] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T20:08:51.436535] [INFO ] [REMOTE ] NEM: Full fetch complete (77887 records). [2025-10-21T20:08:51.436707] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-10-21T20:08:51.862666] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-10-21T20:08:51.862788] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-10-21T20:08:51.864089] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-10-21T20:08:51.864245] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-10-21T20:08:51.892850] [DEBUG] [LOCAL ] NEM: Trimmed 77887 records to 53708 (keeping 200 days of data) [2025-10-21T20:08:51.893869] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-21T20:08:52.158206] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-10-21T20:08:52.159167] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T20:08:52.297230] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-10-21T20:08:52.297410] [INFO ] [MAIN ] NEM: Full history saved. [2025-10-21T20:08:52.297502] [INFO ] [MAIN ] Update Progress: 1467/2366 symbols completed. NEM took 41.7s. Estimated remaining: 1h 55m 42s. Rate: 7.8 symbols/min [2025-10-21T20:08:52.474891] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:08:52.516279] [DEBUG] [LOCAL ] NGG: Loaded 46845 existing records from primary storage. [2025-10-21T20:08:52.516578] [INFO ] [MAIN ] NGG: Loaded 46845 existing records. [2025-10-21T20:08:52.697743] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:08:52.698033] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-10-21T20:08:52.698080] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-10-21T20:08:52.698303] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-10-21T20:08:52.698358] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-10-21T20:08:52.956179] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-10-21T20:08:53.060944] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:08:53.753277] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-10. [2025-10-21T20:08:53.756258] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T20:08:53.805584] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T20:08:54.551105] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-10-21T20:08:55.351048] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-10-21T20:08:55.929902] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T20:08:55.940779] [INFO ] [REMOTE ] NET: Full fetch complete (76888 records). [2025-10-21T20:08:55.940943] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-10-21T20:08:56.138724] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T20:08:56.151960] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-10-21T20:08:56.379576] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-10-21T20:08:56.379692] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-10-21T20:08:56.380799] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-10-21T20:08:56.380865] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-10-21T20:08:56.382389] [DEBUG] [LOCAL ] NET: Trimmed 76888 records to 52821 (keeping 200 days of data) [2025-10-21T20:08:56.704856] [DEBUG] [LOCAL ] NET: Primary data saved (52821 records). [2025-10-21T20:08:56.704997] [INFO ] [MAIN ] NET: Full history saved. [2025-10-21T20:08:56.705859] [INFO ] [MAIN ] Update Progress: 1468/2366 symbols completed. NET took 45.9s. Estimated remaining: 1h 55m 32s. Rate: 7.8 symbols/min [2025-10-21T20:08:56.879939] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:08:56.912055] [DEBUG] [LOCAL ] NGL: Loaded 29965 existing records from primary storage. [2025-10-21T20:08:56.912455] [INFO ] [MAIN ] NGL: Loaded 29965 existing records. [2025-10-21T20:08:56.961911] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-10-21T20:08:57.106532] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:08:57.106782] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-10-21T20:08:57.106832] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-10-21T20:08:57.107041] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-10-21T20:08:57.107126] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-10-21T20:08:57.446286] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T20:08:57.560473] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T20:08:57.559420] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:08:57.751090] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-10-21T20:08:58.207128] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-21T20:08:58.551094] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-10. [2025-10-21T20:08:58.865117] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T20:08:59.351083] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-10-21T20:09:00.151022] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-10-21T20:09:00.223203] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T20:09:00.230531] [INFO ] [REMOTE ] NFG: Full fetch complete (57275 records). [2025-10-21T20:09:00.230717] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-10-21T20:09:00.620014] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T20:09:00.672336] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-10-21T20:09:00.672446] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-10-21T20:09:00.673470] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-10-21T20:09:00.673599] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-10-21T20:09:00.676084] [DEBUG] [LOCAL ] NFG: Trimmed 57275 records to 38359 (keeping 200 days of data) [2025-10-21T20:09:00.916256] [DEBUG] [LOCAL ] NFG: Primary data saved (38359 records). [2025-10-21T20:09:00.916416] [INFO ] [MAIN ] NFG: Full history saved. [2025-10-21T20:09:00.916526] [INFO ] [MAIN ] Update Progress: 1469/2366 symbols completed. NFG took 30.7s. Estimated remaining: 1h 55m 23s. Rate: 7.8 symbols/min [2025-10-21T20:09:00.956118] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-10-21T20:09:01.101344] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:09:01.114120] [DEBUG] [LOCAL ] NGS: Loaded 11109 existing records from primary storage. [2025-10-21T20:09:01.114339] [INFO ] [MAIN ] NGS: Loaded 11109 existing records. [2025-10-21T20:09:01.302394] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:09:01.302630] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-10-21T20:09:01.302713] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-10-21T20:09:01.303052] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-10-21T20:09:01.303111] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-10-21T20:09:01.578719] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T20:09:01.683928] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:09:01.751070] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-10-21T20:09:02.233815] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T20:09:02.551065] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-10-21T20:09:02.944754] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T20:09:03.351080] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-10-21T20:09:04.126171] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T20:09:04.151038] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-10-21T20:09:04.308055] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T20:09:04.951056] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-10-21T20:09:05.028639] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T20:09:05.751033] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-10-21T20:09:06.132335] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T20:09:06.551065] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-10-21T20:09:07.351078] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-10-21T20:09:07.522234] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T20:09:07.674351] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T20:09:08.151085] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-10-21T20:09:08.290016] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T20:09:08.951054] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-10-21T20:09:09.724529] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T20:09:09.751044] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-10-21T20:09:10.140989] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T20:09:10.282983] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-21T20:09:10.551058] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-10-21T20:09:11.350999] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-10-21T20:09:11.585607] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T20:09:12.151107] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-10-21T20:09:12.439368] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T20:09:12.951091] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-10-21T20:09:13.751010] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-10-21T20:09:13.761266] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T20:09:13.793918] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T20:09:14.551024] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-10-21T20:09:15.130823] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T20:09:15.351010] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-10-21T20:09:15.412370] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T20:09:16.151080] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-10-21T20:09:16.866301] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T20:09:16.950996] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-10-21T20:09:17.247540] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T20:09:17.751021] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-10. [2025-10-21T20:09:17.857755] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T20:09:18.551061] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-10-21T20:09:18.856838] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T20:09:18.860390] [INFO ] [REMOTE ] NFJ: Full fetch complete (29635 records). [2025-10-21T20:09:18.860463] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-10-21T20:09:19.232156] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-10-21T20:09:19.232257] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-10-21T20:09:19.232917] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-10-21T20:09:19.232978] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-10-21T20:09:19.233749] [DEBUG] [LOCAL ] NFJ: Trimmed 29635 records to 19899 (keeping 200 days of data) [2025-10-21T20:09:19.355198] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-10-21T20:09:19.356410] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T20:09:19.371025] [DEBUG] [LOCAL ] NFJ: Primary data saved (19899 records). [2025-10-21T20:09:19.371154] [INFO ] [MAIN ] NFJ: Full history saved. [2025-10-21T20:09:19.371232] [INFO ] [MAIN ] Update Progress: 1470/2366 symbols completed. NFJ took 36.3s. Estimated remaining: 1h 55m 21s. Rate: 7.8 symbols/min [2025-10-21T20:09:19.537069] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:09:19.558705] [DEBUG] [LOCAL ] NGVC: Loaded 22829 existing records from primary storage. [2025-10-21T20:09:19.558932] [INFO ] [MAIN ] NGVC: Loaded 22829 existing records. [2025-10-21T20:09:19.732752] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:09:19.732944] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-10-21T20:09:19.732990] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-10-21T20:09:19.733193] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-10-21T20:09:19.733247] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-10-21T20:09:20.093509] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:09:20.150983] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-10-21T20:09:20.750163] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T20:09:20.951016] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-10-21T20:09:21.138012] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T20:09:21.751023] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-10-21T20:09:22.417593] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T20:09:22.551051] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-10. [2025-10-21T20:09:22.922180] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T20:09:23.351026] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-10-21T20:09:23.882925] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T20:09:23.886846] [INFO ] [REMOTE ] NGL: Full fetch complete (41646 records). [2025-10-21T20:09:23.886935] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-10-21T20:09:24.152125] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-10-21T20:09:24.285670] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-10-21T20:09:24.285797] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-10-21T20:09:24.287154] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-10-21T20:09:24.287222] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-10-21T20:09:24.288859] [DEBUG] [LOCAL ] NGL: Trimmed 41646 records to 30056 (keeping 200 days of data) [2025-10-21T20:09:24.459228] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T20:09:24.502820] [DEBUG] [LOCAL ] NGL: Primary data saved (30056 records). [2025-10-21T20:09:24.502952] [INFO ] [MAIN ] NGL: Full history saved. [2025-10-21T20:09:24.503538] [INFO ] [MAIN ] Update Progress: 1471/2366 symbols completed. NGL took 27.8s. Estimated remaining: 1h 55m 12s. Rate: 7.8 symbols/min [2025-10-21T20:09:24.669239] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:09:24.691724] [DEBUG] [LOCAL ] NGVT: Loaded 24042 existing records from primary storage. [2025-10-21T20:09:24.691978] [INFO ] [MAIN ] NGVT: Loaded 24042 existing records. [2025-10-21T20:09:24.864310] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:09:24.864516] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-10-21T20:09:24.864563] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-10-21T20:09:24.864798] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-10-21T20:09:24.864854] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-10-21T20:09:24.960357] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-10. [2025-10-21T20:09:25.212541] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:09:25.751070] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-10-21T20:09:25.836438] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T20:09:25.937033] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T20:09:25.938899] [INFO ] [REMOTE ] NGS: Full fetch complete (16729 records). [2025-10-21T20:09:25.939065] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-10-21T20:09:26.297788] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-10-21T20:09:26.297898] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-10-21T20:09:26.298315] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-10-21T20:09:26.298357] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-10-21T20:09:26.298917] [DEBUG] [LOCAL ] NGS: Trimmed 16729 records to 11017 (keeping 200 days of data) [2025-10-21T20:09:26.364950] [DEBUG] [LOCAL ] NGS: Primary data saved (11017 records). [2025-10-21T20:09:26.365082] [INFO ] [MAIN ] NGS: Full history saved. [2025-10-21T20:09:26.365176] [INFO ] [MAIN ] Update Progress: 1472/2366 symbols completed. NGS took 25.4s. Estimated remaining: 1h 55m 1s. Rate: 7.8 symbols/min [2025-10-21T20:09:26.532898] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:09:26.554066] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-10-21T20:09:26.554526] [DEBUG] [LOCAL ] NHI: Loaded 22020 existing records from primary storage. [2025-10-21T20:09:26.555507] [INFO ] [MAIN ] NHI: Loaded 22020 existing records. [2025-10-21T20:09:26.749461] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:09:26.749765] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-10-21T20:09:26.749815] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-10-21T20:09:26.750027] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-10-21T20:09:26.750083] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-10-21T20:09:27.084178] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T20:09:27.126705] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:09:27.351009] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-10-21T20:09:28.150997] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-10-21T20:09:28.203758] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T20:09:28.419257] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T20:09:28.951045] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-10-21T20:09:29.305129] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T20:09:29.751006] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-10-21T20:09:29.993085] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T20:09:30.551081] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-10-21T20:09:31.351009] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-10-21T20:09:31.472780] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T20:09:31.594696] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T20:09:32.142810] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T20:09:32.150981] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-10-21T20:09:32.951017] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-10-21T20:09:33.410829] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T20:09:33.664165] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-21T20:09:33.750986] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-10-21T20:09:34.551049] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-10. [2025-10-21T20:09:34.692208] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T20:09:35.351076] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-10-21T20:09:36.151017] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-10-21T20:09:36.436431] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T20:09:36.444186] [INFO ] [REMOTE ] NGG: Full fetch complete (66662 records). [2025-10-21T20:09:36.444410] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-10-21T20:09:36.565262] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T20:09:36.876414] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-10-21T20:09:36.876504] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-10-21T20:09:36.877533] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-10-21T20:09:36.877596] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-10-21T20:09:36.878880] [DEBUG] [LOCAL ] NGG: Trimmed 66662 records to 46801 (keeping 200 days of data) [2025-10-21T20:09:36.965875] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-10-21T20:09:37.159446] [DEBUG] [LOCAL ] NGG: Primary data saved (46801 records). [2025-10-21T20:09:37.159577] [INFO ] [MAIN ] NGG: Full history saved. [2025-10-21T20:09:37.159675] [INFO ] [MAIN ] Update Progress: 1473/2366 symbols completed. NGG took 44.9s. Estimated remaining: 1h 54m 55s. Rate: 7.8 symbols/min [2025-10-21T20:09:37.334881] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:09:37.347055] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T20:09:37.399081] [DEBUG] [LOCAL ] NI: Loaded 53410 existing records from primary storage. [2025-10-21T20:09:37.399392] [INFO ] [MAIN ] NI: Loaded 53410 existing records. [2025-10-21T20:09:37.570963] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:09:37.571157] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-10-21T20:09:37.571225] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-10-21T20:09:37.571438] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-10-21T20:09:37.571492] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-10-21T20:09:37.757145] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-10-21T20:09:37.938527] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:09:37.953418] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T20:09:38.551062] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-10-21T20:09:38.975262] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T20:09:39.351084] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-10-21T20:09:40.151081] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-10-21T20:09:40.307463] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T20:09:40.458366] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T20:09:40.951028] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-10-21T20:09:41.281167] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T20:09:41.751368] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-10-21T20:09:42.551104] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-10-21T20:09:42.567553] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T20:09:42.816994] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T20:09:43.351054] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-10-21T20:09:43.635422] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T20:09:44.151062] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-10-21T20:09:44.450914] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T20:09:44.951135] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-10. [2025-10-21T20:09:45.012756] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T20:09:45.751054] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-10-21T20:09:45.885456] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T20:09:45.889193] [INFO ] [REMOTE ] NGVC: Full fetch complete (31068 records). [2025-10-21T20:09:45.889273] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-10-21T20:09:46.259161] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-10-21T20:09:46.259242] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-10-21T20:09:46.260347] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-10-21T20:09:46.260412] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-10-21T20:09:46.261232] [DEBUG] [LOCAL ] NGVC: Trimmed 31068 records to 22809 (keeping 200 days of data) [2025-10-21T20:09:46.397044] [DEBUG] [LOCAL ] NGVC: Primary data saved (22809 records). [2025-10-21T20:09:46.397172] [INFO ] [MAIN ] NGVC: Full history saved. [2025-10-21T20:09:46.397248] [INFO ] [MAIN ] Update Progress: 1474/2366 symbols completed. NGVC took 27.0s. Estimated remaining: 1h 54m 48s. Rate: 7.8 symbols/min [2025-10-21T20:09:46.565359] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-10-21T20:09:46.572579] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:09:46.583201] [DEBUG] [LOCAL ] NIC: Loaded 8898 existing records from primary storage. [2025-10-21T20:09:46.583400] [INFO ] [MAIN ] NIC: Loaded 8898 existing records. [2025-10-21T20:09:46.759538] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:09:46.759779] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-10-21T20:09:46.759831] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-10-21T20:09:46.759990] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-10-21T20:09:46.760028] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-10-21T20:09:47.123404] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:09:47.284685] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T20:09:47.351056] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-10-21T20:09:47.859030] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T20:09:47.869442] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T20:09:48.151165] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-10-21T20:09:48.951060] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-10-21T20:09:49.751020] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-10-21T20:09:49.845546] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T20:09:50.083337] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T20:09:50.551086] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-10-21T20:09:50.799458] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T20:09:51.350994] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-10-21T20:09:51.647185] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T20:09:52.151050] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-10. [2025-10-21T20:09:52.951055] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-10-21T20:09:53.165766] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T20:09:53.426389] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T20:09:53.430041] [INFO ] [REMOTE ] NGVT: Full fetch complete (34386 records). [2025-10-21T20:09:53.430123] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-10-21T20:09:53.758353] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-10-21T20:09:53.807405] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-10-21T20:09:53.807496] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-10-21T20:09:53.808355] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-10-21T20:09:53.808422] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-10-21T20:09:53.809409] [DEBUG] [LOCAL ] NGVT: Trimmed 34386 records to 23894 (keeping 200 days of data) [2025-10-21T20:09:53.946388] [DEBUG] [LOCAL ] NGVT: Primary data saved (23894 records). [2025-10-21T20:09:53.946511] [INFO ] [MAIN ] NGVT: Full history saved. [2025-10-21T20:09:53.946588] [INFO ] [MAIN ] Update Progress: 1475/2366 symbols completed. NGVT took 29.4s. Estimated remaining: 1h 54m 40s. Rate: 7.8 symbols/min [2025-10-21T20:09:54.080321] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T20:09:54.134156] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:09:54.146521] [DEBUG] [LOCAL ] NIE: Loaded 11838 existing records from primary storage. [2025-10-21T20:09:54.146739] [INFO ] [MAIN ] NIE: Loaded 11838 existing records. [2025-10-21T20:09:54.336721] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:09:54.336961] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-10-21T20:09:54.337010] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-10-21T20:09:54.337157] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-10-21T20:09:54.337197] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-10-21T20:09:54.556829] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-10-21T20:09:54.693092] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:09:55.199690] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T20:09:55.351051] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-10. [2025-10-21T20:09:55.490588] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T20:09:56.151040] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-10-21T20:09:56.517639] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T20:09:56.521269] [INFO ] [REMOTE ] NHI: Full fetch complete (31219 records). [2025-10-21T20:09:56.521354] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-10-21T20:09:56.885601] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-10-21T20:09:56.885704] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-10-21T20:09:56.886321] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-10-21T20:09:56.886359] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-10-21T20:09:56.887064] [DEBUG] [LOCAL ] NHI: Trimmed 31219 records to 21970 (keeping 200 days of data) [2025-10-21T20:09:56.973702] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-10-21T20:09:57.020259] [DEBUG] [LOCAL ] NHI: Primary data saved (21970 records). [2025-10-21T20:09:57.020378] [INFO ] [MAIN ] NHI: Full history saved. [2025-10-21T20:09:57.020448] [INFO ] [MAIN ] Update Progress: 1476/2366 symbols completed. NHI took 30.7s. Estimated remaining: 1h 54m 30s. Rate: 7.8 symbols/min [2025-10-21T20:09:57.189773] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:09:57.195339] [DEBUG] [LOCAL ] NIM: Loaded 3520 existing records from primary storage. [2025-10-21T20:09:57.195485] [INFO ] [MAIN ] NIM: Loaded 3520 existing records. [2025-10-21T20:09:57.374816] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:09:57.375006] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-10-21T20:09:57.375060] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-10-21T20:09:57.375185] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-10-21T20:09:57.375221] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-10-21T20:09:57.734982] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:09:57.750984] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-10-21T20:09:57.799550] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T20:09:57.969163] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T20:09:58.401841] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T20:09:58.551049] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-10-21T20:09:59.336961] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T20:09:59.350977] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-10-21T20:09:59.984463] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T20:10:00.151033] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-10-21T20:10:00.951005] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-10-21T20:10:01.179858] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T20:10:01.751076] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-10-21T20:10:02.067080] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T20:10:02.551057] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-10-21T20:10:03.335926] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T20:10:03.350988] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-10-21T20:10:04.049886] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-21T20:10:04.151039] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-10-21T20:10:04.162817] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T20:10:04.951127] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-10-21T20:10:05.751042] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-10-21T20:10:05.950196] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T20:10:06.097280] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T20:10:06.510557] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T20:10:06.551022] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-10. [2025-10-21T20:10:07.351093] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-10-21T20:10:07.475753] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T20:10:07.484138] [INFO ] [REMOTE ] NI: Full fetch complete (77508 records). [2025-10-21T20:10:07.484276] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-10-21T20:10:07.823959] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-21T20:10:07.922396] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-10-21T20:10:07.922492] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-10-21T20:10:07.924004] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-10-21T20:10:07.924086] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-10-21T20:10:07.925726] [DEBUG] [LOCAL ] NI: Trimmed 77508 records to 53409 (keeping 200 days of data) [2025-10-21T20:10:08.156358] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-10-21T20:10:08.359275] [DEBUG] [LOCAL ] NI: Primary data saved (53409 records). [2025-10-21T20:10:08.359468] [INFO ] [MAIN ] NI: Full history saved. [2025-10-21T20:10:08.359574] [INFO ] [MAIN ] Update Progress: 1477/2366 symbols completed. NI took 31.2s. Estimated remaining: 1h 54m 24s. Rate: 7.8 symbols/min [2025-10-21T20:10:08.950999] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-10-21T20:10:09.035413] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T20:10:09.713742] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T20:10:09.751058] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-10-21T20:10:10.528578] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-21T20:10:10.551010] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-10-21T20:10:11.351046] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-10-21T20:10:11.486912] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T20:10:11.971408] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-21T20:10:12.151013] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-10-21T20:10:12.951020] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-10-21T20:10:12.970705] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T20:10:13.370247] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-21T20:10:13.751080] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-10-21T20:10:14.333405] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T20:10:14.551032] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-10-21T20:10:15.015979] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-21T20:10:15.351047] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-10-21T20:10:16.151034] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-10-21T20:10:16.197751] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T20:10:16.689908] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-21T20:10:16.951039] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-10-21T20:10:17.747530] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T20:10:17.751077] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-10-21T20:10:18.461141] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T20:10:18.551004] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-10. [2025-10-21T20:10:19.099268] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T20:10:19.100323] [INFO ] [REMOTE ] NIM: Full fetch complete (6194 records). [2025-10-21T20:10:19.100391] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-10-21T20:10:19.356465] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-10. [2025-10-21T20:10:19.460961] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-10-21T20:10:19.461037] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-10-21T20:10:19.461217] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-10-21T20:10:19.461255] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-10-21T20:10:19.461673] [DEBUG] [LOCAL ] NIM: Trimmed 6194 records to 3540 (keeping 200 days of data) [2025-10-21T20:10:19.482349] [DEBUG] [LOCAL ] NIM: Primary data saved (3540 records). [2025-10-21T20:10:19.482461] [INFO ] [MAIN ] NIM: Full history saved. [2025-10-21T20:10:19.482536] [INFO ] [MAIN ] Update Progress: 1478/2366 symbols completed. NIM took 22.5s. Estimated remaining: 1h 54m 19s. Rate: 7.8 symbols/min [2025-10-21T20:10:20.151029] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-10-21T20:10:20.436430] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T20:10:20.439252] [INFO ] [REMOTE ] NIE: Full fetch complete (16840 records). [2025-10-21T20:10:20.439322] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-10-21T20:10:20.745022] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T20:10:20.836816] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-10-21T20:10:20.836939] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-10-21T20:10:20.837391] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-10-21T20:10:20.837432] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-10-21T20:10:20.838197] [DEBUG] [LOCAL ] NIE: Trimmed 16840 records to 11830 (keeping 200 days of data) [2025-10-21T20:10:20.910273] [DEBUG] [LOCAL ] NIE: Primary data saved (11830 records). [2025-10-21T20:10:20.910410] [INFO ] [MAIN ] NIE: Full history saved. [2025-10-21T20:10:20.910490] [INFO ] [MAIN ] Update Progress: 1479/2366 symbols completed. NIE took 27.0s. Estimated remaining: 1h 54m 7s. Rate: 7.8 symbols/min [2025-10-21T20:10:20.951083] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-10. [2025-10-21T20:10:21.938941] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T20:10:21.940921] [INFO ] [REMOTE ] NIC: Full fetch complete (12505 records). [2025-10-21T20:10:21.940990] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-10-21T20:10:22.292491] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-10-21T20:10:22.292566] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-10-21T20:10:22.292823] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-10-21T20:10:22.292884] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-10-21T20:10:22.293310] [DEBUG] [LOCAL ] NIC: Trimmed 12505 records to 8865 (keeping 200 days of data) [2025-10-21T20:10:22.347596] [DEBUG] [LOCAL ] NIC: Primary data saved (8865 records). [2025-10-21T20:10:22.347758] [INFO ] [MAIN ] NIC: Full history saved. [2025-10-21T20:10:22.347856] [INFO ] [MAIN ] Update Progress: 1480/2366 symbols completed. NIC took 36.0s. Estimated remaining: 1h 53m 56s. Rate: 7.8 symbols/min [2025-10-21T20:10:22.980245] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:23.028348] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:23.032680] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:23.050504] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-10-21T20:10:23.050112] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:23.051007] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-10-21T20:10:23.051333] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-10-21T20:10:23.051625] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-21T20:10:23.051724] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-21T20:10:23.051768] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-10-21T20:10:23.376077] [DEBUG] [LOCAL ] NINE: Loaded 28597 existing records from primary storage. [2025-10-21T20:10:23.397999] [INFO ] [MAIN ] NINE: Loaded 28597 existing records. [2025-10-21T20:10:23.377095] [DEBUG] [LOCAL ] NJR: Loaded 38008 existing records from primary storage. [2025-10-21T20:10:23.442894] [INFO ] [MAIN ] NJR: Loaded 38008 existing records. [2025-10-21T20:10:23.444130] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-21T20:10:23.634689] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-10-21T20:10:23.795786] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:10:23.872451] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-10-21T20:10:23.990077] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:10:24.028990] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:10:24.032811] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-10-21T20:10:24.033156] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-10-21T20:10:24.043981] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-10-21T20:10:24.044039] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-10-21T20:10:24.049435] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-10-21T20:10:24.049583] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-10-21T20:10:24.166412] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-10-21T20:10:24.166571] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-10-21T20:10:24.153157] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:10:24.202275] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-10-21T20:10:24.230021] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-10-21T20:10:24.250954] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:10:24.266632] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-10-21T20:10:24.287707] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-10-21T20:10:24.287875] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-10-21T20:10:24.293079] [FATAL] [REMOTE ] NIQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:10:24.395305] [FATAL] [MAIN ] NIQ: Failed to fetch primary data. [2025-10-21T20:10:24.435523] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:10:24.485507] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-10-21T20:10:24.531837] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-10-21T20:10:24.558103] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-10-21T20:10:24.602762] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-10-21T20:10:24.633026] [INFO ] [MAIN ] Update Progress: 1481/2366 symbols completed. NIQ took 2.3s. Estimated remaining: 1h 53m 45s. Rate: 7.8 symbols/min [2025-10-21T20:10:25.247781] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:10:25.320635] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-10-21T20:10:25.327095] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:25.365764] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-10-21T20:10:25.419315] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:10:25.419426] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-10-21T20:10:25.425561] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-10-21T20:10:25.431083] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-10-21T20:10:25.463934] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-21T20:10:25.493138] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-21T20:10:25.502294] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-10-21T20:10:25.562843] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:10:25.583348] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-10-21T20:10:25.931958] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:10:25.932307] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-10-21T20:10:26.913984] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T20:10:26.922069] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-10-21T20:10:27.007058] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T20:10:27.015986] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-10-21T20:10:27.908052] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-21T20:10:27.918497] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-10-21T20:10:28.293738] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T20:10:28.300928] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-10-21T20:10:28.355998] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T20:10:28.501989] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-21T20:10:28.951030] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-10-21T20:10:29.750996] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-10-21T20:10:29.832932] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T20:10:30.214181] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T20:10:30.315196] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-21T20:10:30.551056] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-10-21T20:10:31.351036] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-10-21T20:10:32.151013] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-10-21T20:10:32.197570] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-21T20:10:32.924460] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T20:10:32.950984] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-10-21T20:10:33.099520] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-21T20:10:33.499960] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-21T20:10:33.751013] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-10-21T20:10:34.402422] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T20:10:34.550981] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-10-21T20:10:35.351152] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-10-21T20:10:35.932923] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T20:10:36.030936] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-21T20:10:36.150999] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-10-21T20:10:36.744176] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T20:10:36.951005] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-10-21T20:10:37.751083] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-10-21T20:10:38.551099] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-10-21T20:10:38.666416] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-21T20:10:39.253190] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T20:10:39.350994] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-10-21T20:10:39.421460] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-21T20:10:40.151048] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-10-21T20:10:40.365356] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T20:10:40.841237] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T20:10:40.950998] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-10-21T20:10:41.751087] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-10-21T20:10:42.356446] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T20:10:42.473182] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-10-21T20:10:42.551032] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-10-21T20:10:43.351058] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-10-21T20:10:44.041905] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T20:10:44.151080] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-10-21T20:10:44.513165] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-21T20:10:44.951037] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-10. [2025-10-21T20:10:45.306387] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T20:10:45.751025] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-10-21T20:10:45.930328] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-21T20:10:46.039808] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T20:10:46.045951] [INFO ] [REMOTE ] NJR: Full fetch complete (54860 records). [2025-10-21T20:10:46.046106] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-10-21T20:10:46.434590] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-10-21T20:10:46.434731] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-10-21T20:10:46.435736] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-10-21T20:10:46.435798] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-10-21T20:10:46.436997] [DEBUG] [LOCAL ] NJR: Trimmed 54860 records to 37972 (keeping 200 days of data) [2025-10-21T20:10:46.557347] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-10-21T20:10:46.669227] [DEBUG] [LOCAL ] NJR: Primary data saved (37972 records). [2025-10-21T20:10:46.669373] [INFO ] [MAIN ] NJR: Full history saved. [2025-10-21T20:10:46.670276] [INFO ] [MAIN ] Update Progress: 1482/2366 symbols completed. NJR took 24.3s. Estimated remaining: 1h 53m 45s. Rate: 7.8 symbols/min [2025-10-21T20:10:46.838816] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:46.854187] [DEBUG] [LOCAL ] NKX: Loaded 13697 existing records from primary storage. [2025-10-21T20:10:46.854413] [INFO ] [MAIN ] NKX: Loaded 13697 existing records. [2025-10-21T20:10:47.034672] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:10:47.034922] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-10-21T20:10:47.034976] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-21T20:10:47.035157] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-10-21T20:10:47.035210] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-10-21T20:10:47.357998] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-10-21T20:10:47.381359] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:10:48.151099] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-10-21T20:10:48.325161] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-10-21T20:10:48.527031] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T20:10:48.950997] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-10-21T20:10:49.023993] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T20:10:49.173992] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-21T20:10:49.751044] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-10-21T20:10:50.531925] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T20:10:50.551070] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-10-21T20:10:51.236260] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-21T20:10:51.351092] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-10-21T20:10:52.151040] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-10. [2025-10-21T20:10:52.291769] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T20:10:52.951007] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-10-21T20:10:53.138829] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-21T20:10:53.460562] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T20:10:53.465737] [INFO ] [REMOTE ] NINE: Full fetch complete (43330 records). [2025-10-21T20:10:53.465844] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-10-21T20:10:53.756395] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-10-21T20:10:53.864349] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-10-21T20:10:53.864434] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-10-21T20:10:53.865306] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-10-21T20:10:53.865372] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-10-21T20:10:53.866269] [DEBUG] [LOCAL ] NINE: Trimmed 43330 records to 28646 (keeping 200 days of data) [2025-10-21T20:10:54.033065] [DEBUG] [LOCAL ] NINE: Primary data saved (28646 records). [2025-10-21T20:10:54.033201] [INFO ] [MAIN ] NINE: Full history saved. [2025-10-21T20:10:54.033280] [INFO ] [MAIN ] Update Progress: 1483/2366 symbols completed. NINE took 31.7s. Estimated remaining: 1h 53m 37s. Rate: 7.8 symbols/min [2025-10-21T20:10:54.214152] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:54.214370] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-10-21T20:10:54.214425] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-10-21T20:10:54.214560] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-10-21T20:10:54.214610] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-21T20:10:54.214696] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-21T20:10:54.214755] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-10-21T20:10:54.562528] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-10. [2025-10-21T20:10:54.565601] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:10:54.680808] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T20:10:55.351000] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-10-21T20:10:55.605724] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-21T20:10:55.836133] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-21T20:10:56.151022] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-10-21T20:10:56.791848] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T20:10:56.951004] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-10-21T20:10:57.273101] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-21T20:10:57.281548] [INFO ] [REMOTE ] NIO: Full fetch complete (77982 records). [2025-10-21T20:10:57.281714] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-10-21T20:10:57.585699] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T20:10:57.685925] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-10-21T20:10:57.686008] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-10-21T20:10:57.687138] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-10-21T20:10:57.687200] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-10-21T20:10:57.688809] [DEBUG] [LOCAL ] NIO: Trimmed 77982 records to 53802 (keeping 200 days of data) [2025-10-21T20:10:57.776732] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-10-21T20:10:58.004685] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-10-21T20:10:58.004835] [INFO ] [MAIN ] NIO: Full history saved. [2025-10-21T20:10:58.004914] [INFO ] [MAIN ] Update Progress: 1484/2366 symbols completed. NIO took 35.7s. Estimated remaining: 1h 53m 28s. Rate: 7.8 symbols/min [2025-10-21T20:10:58.170067] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:58.182457] [DEBUG] [LOCAL ] NLOP: Loaded 11699 existing records from primary storage. [2025-10-21T20:10:58.182682] [INFO ] [MAIN ] NLOP: Loaded 11699 existing records. [2025-10-21T20:10:58.372925] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:10:58.373129] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-10-21T20:10:58.373175] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-10-21T20:10:58.373328] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-10-21T20:10:58.373365] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-10-21T20:10:58.557186] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-10-21T20:10:58.720231] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:10:59.226997] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-21T20:10:59.351060] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-10-21T20:10:59.454804] [DEBUG] [REMOTE ] NKX: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-21T20:10:59.455094] [WARN ] [REMOTE ] NKX: No data returned for month 2025-06 [2025-10-21T20:10:59.455180] [FATAL] [REMOTE ] NKX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:10:59.455262] [FATAL] [MAIN ] NKX: Failed to fetch primary data. [2025-10-21T20:10:59.455323] [WARN ] [MAIN ] NKX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:10:59.455394] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-10-21T20:10:59.455458] [DEBUG] [LOCAL ] NKX: No primary data file found to delete. [2025-10-21T20:10:59.455500] [INFO ] [LOCAL ] NKX: Starting deletion of derivative data. [2025-10-21T20:10:59.455697] [DEBUG] [LOCAL ] NKX: Deleted derivative data file. [2025-10-21T20:10:59.455790] [INFO ] [MAIN ] Update Progress: 1485/2366 symbols completed. NKX took 12.8s. Estimated remaining: 1h 53m 16s. Rate: 7.8 symbols/min [2025-10-21T20:10:59.639141] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:10:59.691277] [DEBUG] [LOCAL ] NLY: Loaded 53564 existing records from primary storage. [2025-10-21T20:10:59.691573] [INFO ] [MAIN ] NLY: Loaded 53564 existing records. [2025-10-21T20:10:59.882623] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:10:59.882853] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-10-21T20:10:59.882937] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-10-21T20:10:59.883189] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-10-21T20:10:59.883246] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-10-21T20:11:00.158397] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-10-21T20:11:00.265459] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:11:00.295618] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-21T20:11:00.951123] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-10-21T20:11:01.061703] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T20:11:01.751085] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-10-21T20:11:02.357271] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T20:11:02.551082] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-10-21T20:11:02.935275] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T20:11:03.351028] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-10-21T20:11:04.151052] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-10-21T20:11:04.356543] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-21T20:11:04.951006] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-10. [2025-10-21T20:11:04.976177] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T20:11:05.160697] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T20:11:05.751067] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-10-21T20:11:05.811798] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T20:11:05.820505] [INFO ] [REMOTE ] NKE: Full fetch complete (77217 records). [2025-10-21T20:11:05.820724] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-10-21T20:11:06.028689] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T20:11:06.029563] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:11:06.029639] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:11:06.029733] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-10-21T20:11:06.029804] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-10-21T20:11:06.029840] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-10-21T20:11:06.029879] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-10-21T20:11:06.029944] [INFO ] [MAIN ] Update Progress: 1486/2366 symbols completed. NKE took 41.4s. Estimated remaining: 1h 53m 8s. Rate: 7.8 symbols/min [2025-10-21T20:11:06.207011] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:11:06.272122] [DEBUG] [LOCAL ] NMAI: Loaded 12634 existing records from primary storage. [2025-10-21T20:11:06.272361] [INFO ] [MAIN ] NMAI: Loaded 12634 existing records. [2025-10-21T20:11:06.471152] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:11:06.472255] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-21T20:11:06.475379] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-10-21T20:11:06.475729] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-10-21T20:11:06.475930] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-10-21T20:11:06.475987] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-10-21T20:11:06.556119] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-10-21T20:11:06.839668] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:11:07.351070] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-10-21T20:11:07.470688] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T20:11:08.151028] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-10-21T20:11:08.878520] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T20:11:08.951056] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-10-21T20:11:09.235328] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T20:11:09.751072] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-10-21T20:11:09.823941] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T20:11:10.551035] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-10-21T20:11:11.188939] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-21T20:11:11.350996] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-10-21T20:11:11.694475] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T20:11:12.142358] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T20:11:12.150991] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-10-21T20:11:12.951010] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-10-21T20:11:13.721345] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T20:11:13.751002] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-10-21T20:11:14.185086] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T20:11:14.551041] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-10-21T20:11:14.560010] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T20:11:15.351121] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-10-21T20:11:16.014881] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T20:11:16.151053] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-10-21T20:11:16.636993] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-21T20:11:16.732209] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T20:11:16.951053] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-10-21T20:11:17.607365] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T20:11:17.751018] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-10-21T20:11:18.551025] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-10-21T20:11:18.675589] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-21T20:11:19.351074] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-10-21T20:11:20.151110] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-10-21T20:11:20.323239] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T20:11:20.526096] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T20:11:20.889115] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T20:11:20.951048] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-10-21T20:11:21.748493] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T20:11:21.752012] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-10-21T20:11:22.551036] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-10-21T20:11:22.560695] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T20:11:23.351088] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-10-21T20:11:24.151017] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-10. [2025-10-21T20:11:24.365684] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T20:11:24.523076] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-21T20:11:24.910098] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T20:11:24.911366] [INFO ] [REMOTE ] NL: Full fetch complete (6907 records). [2025-10-21T20:11:24.911451] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-10-21T20:11:24.956128] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-10-21T20:11:25.100507] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T20:11:25.100756] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:11:25.100824] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:11:25.100893] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-10-21T20:11:25.100957] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-10-21T20:11:25.100993] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-10-21T20:11:25.101032] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-10-21T20:11:25.101089] [INFO ] [MAIN ] Update Progress: 1487/2366 symbols completed. NL took 31.1s. Estimated remaining: 1h 53m 7s. Rate: 7.8 symbols/min [2025-10-21T20:11:25.271514] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:11:25.271715] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-10-21T20:11:25.271762] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-10-21T20:11:25.271867] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-10-21T20:11:25.271908] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-21T20:11:25.271948] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-21T20:11:25.271979] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-10-21T20:11:25.632597] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:11:25.751041] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-10. [2025-10-21T20:11:26.551043] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-10-21T20:11:26.725003] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T20:11:26.727132] [INFO ] [REMOTE ] NLOP: Full fetch complete (17706 records). [2025-10-21T20:11:26.727200] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-10-21T20:11:27.138960] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-10-21T20:11:27.139099] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-10-21T20:11:27.139529] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-10-21T20:11:27.139793] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-10-21T20:11:27.142429] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T20:11:27.142704] [DEBUG] [LOCAL ] NLOP: Trimmed 17706 records to 11626 (keeping 200 days of data) [2025-10-21T20:11:27.224839] [DEBUG] [LOCAL ] NLOP: Primary data saved (11626 records). [2025-10-21T20:11:27.224976] [INFO ] [MAIN ] NLOP: Full history saved. [2025-10-21T20:11:27.225054] [INFO ] [MAIN ] Update Progress: 1488/2366 symbols completed. NLOP took 29.2s. Estimated remaining: 1h 52m 56s. Rate: 7.8 symbols/min [2025-10-21T20:11:27.354974] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-10-21T20:11:27.402826] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:11:27.421409] [DEBUG] [LOCAL ] NMCO: Loaded 16596 existing records from primary storage. [2025-10-21T20:11:27.421765] [INFO ] [MAIN ] NMCO: Loaded 16596 existing records. [2025-10-21T20:11:27.550236] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T20:11:27.617277] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:11:27.617483] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-10-21T20:11:27.617551] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-10-21T20:11:27.617816] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-10-21T20:11:27.617874] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-10-21T20:11:28.009717] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:11:28.151025] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-10-21T20:11:28.951023] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-10-21T20:11:29.102695] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T20:11:29.164230] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:11:29.164744] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-10-21T20:11:29.164848] [FATAL] [REMOTE ] NMAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:11:29.164895] [FATAL] [MAIN ] NMAX: Failed to fetch primary data. [2025-10-21T20:11:29.164928] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:11:29.165000] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-10-21T20:11:29.165073] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-10-21T20:11:29.165110] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-10-21T20:11:29.165148] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-10-21T20:11:29.165202] [INFO ] [MAIN ] Update Progress: 1489/2366 symbols completed. NMAX took 4.1s. Estimated remaining: 1h 52m 45s. Rate: 7.8 symbols/min [2025-10-21T20:11:29.344224] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:11:29.360297] [DEBUG] [LOCAL ] NMG: Loaded 11574 existing records from primary storage. [2025-10-21T20:11:29.360609] [INFO ] [MAIN ] NMG: Loaded 11574 existing records. [2025-10-21T20:11:29.519118] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-21T20:11:29.603767] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:11:29.604086] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-10-21T20:11:29.604136] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-10-21T20:11:29.604329] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-10-21T20:11:29.604366] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-10-21T20:11:29.757900] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-10. [2025-10-21T20:11:30.031173] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:11:30.551065] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-10-21T20:11:31.351011] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-10-21T20:11:31.520128] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T20:11:31.936855] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T20:11:31.951380] [INFO ] [REMOTE ] NLY: Full fetch complete (77697 records). [2025-10-21T20:11:31.951621] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-10-21T20:11:32.096811] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T20:11:32.157543] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-10-21T20:11:32.416974] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-10-21T20:11:32.417051] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-10-21T20:11:32.418212] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-10-21T20:11:32.418273] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-10-21T20:11:32.421143] [DEBUG] [LOCAL ] NLY: Trimmed 77697 records to 53564 (keeping 200 days of data) [2025-10-21T20:11:32.753408] [DEBUG] [LOCAL ] NLY: Primary data saved (53564 records). [2025-10-21T20:11:32.753568] [INFO ] [MAIN ] NLY: Full history saved. [2025-10-21T20:11:32.754306] [INFO ] [MAIN ] Update Progress: 1490/2366 symbols completed. NLY took 33.3s. Estimated remaining: 1h 52m 34s. Rate: 7.8 symbols/min [2025-10-21T20:11:32.931090] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T20:11:32.934378] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:11:32.944204] [DEBUG] [LOCAL ] NMI: Loaded 4049 existing records from primary storage. [2025-10-21T20:11:32.944475] [INFO ] [MAIN ] NMI: Loaded 4049 existing records. [2025-10-21T20:11:32.956265] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-10-21T20:11:33.124930] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:11:33.125171] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-10-21T20:11:33.125231] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-10-21T20:11:33.125388] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-10-21T20:11:33.125444] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-10-21T20:11:33.493813] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:11:33.751017] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-10-21T20:11:33.936320] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T20:11:34.437955] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-21T20:11:34.551010] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-10-21T20:11:35.350995] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-10-21T20:11:35.428053] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T20:11:36.123403] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T20:11:36.150999] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-10-21T20:11:36.836812] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T20:11:36.951013] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-10. [2025-10-21T20:11:37.751030] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-10-21T20:11:37.847156] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T20:11:37.849673] [INFO ] [REMOTE ] NMAI: Full fetch complete (19507 records). [2025-10-21T20:11:37.849751] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-10-21T20:11:38.231900] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-10-21T20:11:38.231996] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-10-21T20:11:38.232494] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-10-21T20:11:38.232557] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-10-21T20:11:38.233525] [DEBUG] [LOCAL ] NMAI: Trimmed 19507 records to 12611 (keeping 200 days of data) [2025-10-21T20:11:38.294572] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T20:11:38.320504] [DEBUG] [LOCAL ] NMAI: Primary data saved (12611 records). [2025-10-21T20:11:38.320676] [INFO ] [MAIN ] NMAI: Full history saved. [2025-10-21T20:11:38.320777] [INFO ] [MAIN ] Update Progress: 1491/2366 symbols completed. NMAI took 32.3s. Estimated remaining: 1h 52m 25s. Rate: 7.8 symbols/min [2025-10-21T20:11:38.487506] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:11:38.502563] [DEBUG] [LOCAL ] NMM: Loaded 14378 existing records from primary storage. [2025-10-21T20:11:38.502816] [INFO ] [MAIN ] NMM: Loaded 14378 existing records. [2025-10-21T20:11:38.556369] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-10-21T20:11:38.680023] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:11:38.680272] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-10-21T20:11:38.680322] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-10-21T20:11:38.680512] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-10-21T20:11:38.680566] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-10-21T20:11:39.032694] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:11:39.351087] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-10-21T20:11:39.547914] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T20:11:39.909497] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T20:11:40.151025] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-10-21T20:11:40.944111] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T20:11:40.950993] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-10-21T20:11:41.751064] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-10-21T20:11:41.768606] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T20:11:42.551010] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-10-21T20:11:42.765000] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T20:11:43.110249] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T20:11:43.351092] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-10. [2025-10-21T20:11:44.151070] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-10-21T20:11:44.950996] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-10-21T20:11:45.217596] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T20:11:45.224144] [INFO ] [REMOTE ] NMG: Full fetch complete (15954 records). [2025-10-21T20:11:45.224304] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-10-21T20:11:45.467128] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:11:45.636159] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-10-21T20:11:45.636239] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-10-21T20:11:45.636614] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-10-21T20:11:45.636680] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-10-21T20:11:45.637249] [DEBUG] [LOCAL ] NMG: Trimmed 15954 records to 11780 (keeping 200 days of data) [2025-10-21T20:11:45.703815] [DEBUG] [LOCAL ] NMG: Primary data saved (11780 records). [2025-10-21T20:11:45.703949] [INFO ] [MAIN ] NMG: Full history saved. [2025-10-21T20:11:45.704027] [INFO ] [MAIN ] Update Progress: 1492/2366 symbols completed. NMG took 16.5s. Estimated remaining: 1h 52m 18s. Rate: 7.8 symbols/min [2025-10-21T20:11:45.751375] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-10-21T20:11:45.880855] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:11:45.898026] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T20:11:45.925122] [DEBUG] [LOCAL ] NMR: Loaded 35622 existing records from primary storage. [2025-10-21T20:11:45.925406] [INFO ] [MAIN ] NMR: Loaded 35622 existing records. [2025-10-21T20:11:46.101810] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:11:46.101987] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-10-21T20:11:46.102035] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-10-21T20:11:46.102216] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-10-21T20:11:46.102272] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-10-21T20:11:46.411532] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T20:11:46.478029] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:11:46.551077] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-10-21T20:11:47.351081] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-10-21T20:11:47.841025] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T20:11:47.868984] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:11:48.151045] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-10-21T20:11:48.951001] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-10-21T20:11:49.098543] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T20:11:49.751051] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-10-21T20:11:50.089756] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T20:11:50.551048] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-10-21T20:11:50.611502] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T20:11:51.350995] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-10-21T20:11:51.478570] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T20:11:52.150996] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-10-21T20:11:52.704637] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T20:11:52.951022] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-10-21T20:11:53.097534] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T20:11:53.751093] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-10-21T20:11:54.038820] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T20:11:54.551152] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-10-21T20:11:55.354021] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-10-21T20:11:55.359333] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T20:11:55.870092] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T20:11:56.151044] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-10-21T20:11:56.421115] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T20:11:56.751341] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T20:11:56.951069] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-10-21T20:11:57.751038] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-10-21T20:11:57.930268] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T20:11:58.551043] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-10. [2025-10-21T20:11:59.203921] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T20:11:59.351053] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-10-21T20:11:59.468806] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T20:11:59.472170] [INFO ] [REMOTE ] NMCO: Full fetch complete (22865 records). [2025-10-21T20:11:59.472282] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-10-21T20:11:59.886677] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-10-21T20:11:59.886768] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-10-21T20:11:59.887263] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-10-21T20:11:59.887302] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-10-21T20:11:59.888038] [DEBUG] [LOCAL ] NMCO: Trimmed 22865 records to 16621 (keeping 200 days of data) [2025-10-21T20:11:59.988550] [DEBUG] [LOCAL ] NMCO: Primary data saved (16621 records). [2025-10-21T20:11:59.988725] [INFO ] [MAIN ] NMCO: Full history saved. [2025-10-21T20:11:59.988814] [INFO ] [MAIN ] Update Progress: 1493/2366 symbols completed. NMCO took 32.8s. Estimated remaining: 1h 52m 14s. Rate: 7.8 symbols/min [2025-10-21T20:12:00.161867] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:12:00.158135] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-10-21T20:12:00.167980] [DEBUG] [LOCAL ] NMS: Loaded 2879 existing records from primary storage. [2025-10-21T20:12:00.168159] [INFO ] [MAIN ] NMS: Loaded 2879 existing records. [2025-10-21T20:12:00.346018] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:12:00.346227] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-10-21T20:12:00.346297] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-10-21T20:12:00.346468] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-10-21T20:12:00.346523] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-10-21T20:12:00.706061] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T20:12:00.727894] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:12:00.951076] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-10-21T20:12:00.997342] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T20:12:01.546857] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-21T20:12:01.751041] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-10-21T20:12:02.358028] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T20:12:02.551069] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-10-21T20:12:03.351080] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-10-21T20:12:03.746458] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T20:12:04.151089] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-10-21T20:12:04.176048] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T20:12:04.730389] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T20:12:04.951042] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-10-21T20:12:05.670188] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T20:12:05.751032] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-10-21T20:12:06.202634] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-21T20:12:06.551067] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-10-21T20:12:07.255415] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T20:12:07.351030] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-10-21T20:12:08.151037] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-10-21T20:12:08.457840] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T20:12:08.951086] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-10-21T20:12:09.439319] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T20:12:09.444351] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T20:12:09.751064] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-10-21T20:12:10.551020] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-10-21T20:12:10.674866] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T20:12:11.351073] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-10-21T20:12:11.710478] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T20:12:11.895073] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-21T20:12:12.151066] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-10. [2025-10-21T20:12:12.951059] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-10-21T20:12:13.541935] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T20:12:13.620204] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T20:12:13.626529] [INFO ] [REMOTE ] NMR: Full fetch complete (51249 records). [2025-10-21T20:12:13.626680] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-10-21T20:12:13.756128] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-10. [2025-10-21T20:12:14.017051] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-10-21T20:12:14.017140] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-10-21T20:12:14.018096] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-10-21T20:12:14.018170] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-10-21T20:12:14.019347] [DEBUG] [LOCAL ] NMR: Trimmed 51249 records to 35555 (keeping 200 days of data) [2025-10-21T20:12:14.217333] [DEBUG] [LOCAL ] NMR: Primary data saved (35555 records). [2025-10-21T20:12:14.217470] [INFO ] [MAIN ] NMR: Full history saved. [2025-10-21T20:12:14.217549] [INFO ] [MAIN ] Update Progress: 1494/2366 symbols completed. NMR took 28.5s. Estimated remaining: 1h 52m 10s. Rate: 7.8 symbols/min [2025-10-21T20:12:14.395998] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:12:14.401562] [DEBUG] [LOCAL ] NMT: Loaded 2818 existing records from primary storage. [2025-10-21T20:12:14.401786] [INFO ] [MAIN ] NMT: Loaded 2818 existing records. [2025-10-21T20:12:14.515076] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T20:12:14.526069] [INFO ] [REMOTE ] NMI: Full fetch complete (5681 records). [2025-10-21T20:12:14.562373] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-10-21T20:12:14.546878] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-10-21T20:12:14.616367] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:12:14.670536] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-10-21T20:12:14.679598] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-10-21T20:12:14.697496] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-10-21T20:12:14.717856] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-10-21T20:12:15.248081] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T20:12:15.368664] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:12:15.363143] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-10-21T20:12:15.368911] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-10-21T20:12:15.369259] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-10-21T20:12:15.370171] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-10-21T20:12:15.370229] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-10-21T20:12:15.370580] [DEBUG] [LOCAL ] NMI: Trimmed 5681 records to 4051 (keeping 200 days of data) [2025-10-21T20:12:15.395345] [DEBUG] [LOCAL ] NMI: Primary data saved (4051 records). [2025-10-21T20:12:15.395425] [INFO ] [MAIN ] NMI: Full history saved. [2025-10-21T20:12:15.395495] [INFO ] [MAIN ] Update Progress: 1495/2366 symbols completed. NMI took 42.6s. Estimated remaining: 1h 51m 58s. Rate: 7.8 symbols/min [2025-10-21T20:12:15.562406] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:12:15.581732] [DEBUG] [LOCAL ] NMZ: Loaded 21584 existing records from primary storage. [2025-10-21T20:12:15.581979] [INFO ] [MAIN ] NMZ: Loaded 21584 existing records. [2025-10-21T20:12:15.760709] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:12:15.760899] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-10-21T20:12:15.760945] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-10-21T20:12:15.761117] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-10-21T20:12:15.761155] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-10-21T20:12:15.986246] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T20:12:16.122821] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:12:16.150986] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-10-21T20:12:16.951014] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-10-21T20:12:17.293953] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T20:12:17.466262] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T20:12:17.751058] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-10-21T20:12:18.551072] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-10-21T20:12:18.760739] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T20:12:19.037192] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T20:12:19.351083] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-10. [2025-10-21T20:12:20.151005] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-10-21T20:12:20.284055] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T20:12:20.287389] [INFO ] [REMOTE ] NMM: Full fetch complete (21530 records). [2025-10-21T20:12:20.287570] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-10-21T20:12:20.668968] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-10-21T20:12:20.669065] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-10-21T20:12:20.669521] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-10-21T20:12:20.669562] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-10-21T20:12:20.670134] [DEBUG] [LOCAL ] NMM: Trimmed 21530 records to 14252 (keeping 200 days of data) [2025-10-21T20:12:20.755771] [DEBUG] [LOCAL ] NMM: Primary data saved (14252 records). [2025-10-21T20:12:20.755888] [INFO ] [MAIN ] NMM: Full history saved. [2025-10-21T20:12:20.755960] [INFO ] [MAIN ] Update Progress: 1496/2366 symbols completed. NMM took 42.4s. Estimated remaining: 1h 51m 49s. Rate: 7.8 symbols/min [2025-10-21T20:12:20.924033] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:12:20.936301] [DEBUG] [LOCAL ] NNI: Loaded 10532 existing records from primary storage. [2025-10-21T20:12:20.936506] [INFO ] [MAIN ] NNI: Loaded 10532 existing records. [2025-10-21T20:12:20.956533] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-10-21T20:12:21.118020] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:12:21.118458] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-10-21T20:12:21.118628] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-10-21T20:12:21.123988] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-10-21T20:12:21.130385] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-10-21T20:12:21.176733] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T20:12:21.514911] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:12:21.629509] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-21T20:12:21.751015] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-10-21T20:12:22.389169] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-21T20:12:22.550999] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-10-21T20:12:23.016135] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T20:12:23.351016] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-10. [2025-10-21T20:12:23.971752] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T20:12:23.972755] [INFO ] [REMOTE ] NMS: Full fetch complete (4065 records). [2025-10-21T20:12:23.972821] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-10-21T20:12:24.156213] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-10-21T20:12:24.337901] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-10-21T20:12:24.337975] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-10-21T20:12:24.338124] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-10-21T20:12:24.338162] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-10-21T20:12:24.338498] [DEBUG] [LOCAL ] NMS: Trimmed 4065 records to 2903 (keeping 200 days of data) [2025-10-21T20:12:24.355753] [DEBUG] [LOCAL ] NMS: Primary data saved (2903 records). [2025-10-21T20:12:24.355819] [INFO ] [MAIN ] NMS: Full history saved. [2025-10-21T20:12:24.355888] [INFO ] [MAIN ] Update Progress: 1497/2366 symbols completed. NMS took 24.4s. Estimated remaining: 1h 51m 39s. Rate: 7.8 symbols/min [2025-10-21T20:12:24.521820] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:12:24.566324] [DEBUG] [LOCAL ] NNN: Loaded 48230 existing records from primary storage. [2025-10-21T20:12:24.566621] [INFO ] [MAIN ] NNN: Loaded 48230 existing records. [2025-10-21T20:12:24.741975] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T20:12:24.747250] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:12:24.748862] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-10-21T20:12:24.748920] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-10-21T20:12:24.749110] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-10-21T20:12:24.749168] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-10-21T20:12:24.956138] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-10-21T20:12:25.099203] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:12:25.732494] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T20:12:25.750997] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-10-21T20:12:26.324293] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T20:12:26.551021] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-10-21T20:12:27.182360] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T20:12:27.351046] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-10-21T20:12:28.015625] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T20:12:28.151032] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-10-21T20:12:28.907066] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T20:12:28.951023] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-10-21T20:12:29.751050] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-10-21T20:12:30.551003] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-10-21T20:12:30.845064] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T20:12:31.020068] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-21T20:12:31.208783] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T20:12:31.351023] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-10-21T20:12:32.133422] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T20:12:32.151041] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-10-21T20:12:32.951020] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-10-21T20:12:32.968429] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T20:12:33.751047] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-10-21T20:12:33.938032] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T20:12:34.386857] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-21T20:12:34.551053] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-10-21T20:12:35.351038] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-10-21T20:12:36.112462] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T20:12:36.150982] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-10-21T20:12:36.319802] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T20:12:36.951005] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-10-21T20:12:37.564803] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T20:12:37.751037] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-10-21T20:12:38.012700] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T20:12:38.550987] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-10-21T20:12:38.792611] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T20:12:39.351033] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-10-21T20:12:39.900852] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T20:12:40.106029] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T20:12:40.150993] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-10-21T20:12:40.951058] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-10-21T20:12:41.271841] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T20:12:41.499948] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T20:12:41.751041] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-10. [2025-10-21T20:12:42.315536] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T20:12:42.316595] [INFO ] [REMOTE ] NMT: Full fetch complete (3880 records). [2025-10-21T20:12:42.316702] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-10-21T20:12:42.556282] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-10-21T20:12:42.701893] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-10-21T20:12:42.701967] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-10-21T20:12:42.702096] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-10-21T20:12:42.702133] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-10-21T20:12:42.702468] [DEBUG] [LOCAL ] NMT: Trimmed 3880 records to 2817 (keeping 200 days of data) [2025-10-21T20:12:42.719456] [DEBUG] [LOCAL ] NMT: Primary data saved (2817 records). [2025-10-21T20:12:42.719517] [INFO ] [MAIN ] NMT: Full history saved. [2025-10-21T20:12:42.719584] [INFO ] [MAIN ] Update Progress: 1498/2366 symbols completed. NMT took 28.5s. Estimated remaining: 1h 51m 38s. Rate: 7.8 symbols/min [2025-10-21T20:12:42.886118] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:12:42.894145] [DEBUG] [LOCAL ] NNY: Loaded 5657 existing records from primary storage. [2025-10-21T20:12:42.894343] [INFO ] [MAIN ] NNY: Loaded 5657 existing records. [2025-10-21T20:12:43.070306] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:12:43.070471] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-10-21T20:12:43.070518] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-10-21T20:12:43.070677] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-10-21T20:12:43.070735] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-10-21T20:12:43.356238] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-10-21T20:12:43.425470] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:12:44.151011] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-10-21T20:12:44.204371] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T20:12:44.411744] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T20:12:44.951051] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-10-21T20:12:44.969071] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T20:12:45.751050] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-10-21T20:12:46.013041] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T20:12:46.459285] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-21T20:12:46.551054] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-10-21T20:12:47.191022] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T20:12:47.351306] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-10-21T20:12:48.086994] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T20:12:48.151088] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-10. [2025-10-21T20:12:48.951097] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-10-21T20:12:49.086477] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T20:12:49.088456] [INFO ] [REMOTE ] NNI: Full fetch complete (13126 records). [2025-10-21T20:12:49.088532] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-10-21T20:12:49.450666] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-10-21T20:12:49.450756] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-10-21T20:12:49.451051] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-10-21T20:12:49.451096] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-10-21T20:12:49.451581] [DEBUG] [LOCAL ] NNI: Trimmed 13126 records to 10538 (keeping 200 days of data) [2025-10-21T20:12:49.517231] [DEBUG] [LOCAL ] NNI: Primary data saved (10538 records). [2025-10-21T20:12:49.517382] [INFO ] [MAIN ] NNI: Full history saved. [2025-10-21T20:12:49.517467] [INFO ] [MAIN ] Update Progress: 1499/2366 symbols completed. NNI took 28.8s. Estimated remaining: 1h 51m 29s. Rate: 7.8 symbols/min [2025-10-21T20:12:49.604479] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T20:12:49.708154] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:12:49.724946] [DEBUG] [LOCAL ] NOA: Loaded 15970 existing records from primary storage. [2025-10-21T20:12:49.725177] [INFO ] [MAIN ] NOA: Loaded 15970 existing records. [2025-10-21T20:12:49.756125] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-10-21T20:12:49.904803] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:12:49.905063] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-10-21T20:12:49.905132] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-10-21T20:12:49.905345] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-10-21T20:12:49.905412] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-10-21T20:12:50.257387] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:12:50.501685] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T20:12:50.551082] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-10-21T20:12:51.135941] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T20:12:51.351053] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-10-21T20:12:52.151083] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-10-21T20:12:52.181984] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T20:12:52.759270] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T20:12:52.951073] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-10-21T20:12:53.666713] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T20:12:53.751049] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-10-21T20:12:54.353501] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T20:12:54.551093] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-10. [2025-10-21T20:12:55.351056] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-10-21T20:12:55.661229] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T20:12:55.664520] [INFO ] [REMOTE ] NMZ: Full fetch complete (31094 records). [2025-10-21T20:12:55.664593] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-10-21T20:12:55.997868] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T20:12:56.065905] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-10-21T20:12:56.065981] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-10-21T20:12:56.066587] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-10-21T20:12:56.066678] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-10-21T20:12:56.067361] [DEBUG] [LOCAL ] NMZ: Trimmed 31094 records to 21449 (keeping 200 days of data) [2025-10-21T20:12:56.151669] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-10-21T20:12:56.198471] [DEBUG] [LOCAL ] NMZ: Primary data saved (21449 records). [2025-10-21T20:12:56.198600] [INFO ] [MAIN ] NMZ: Full history saved. [2025-10-21T20:12:56.198727] [INFO ] [MAIN ] Update Progress: 1500/2366 symbols completed. NMZ took 40.8s. Estimated remaining: 1h 51m 21s. Rate: 7.8 symbols/min [2025-10-21T20:12:56.368441] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:12:56.387838] [DEBUG] [LOCAL ] NOAH: Loaded 20177 existing records from primary storage. [2025-10-21T20:12:56.388042] [INFO ] [MAIN ] NOAH: Loaded 20177 existing records. [2025-10-21T20:12:56.564074] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:12:56.564369] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-10-21T20:12:56.564426] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-10-21T20:12:56.564590] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-10-21T20:12:56.564628] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-10-21T20:12:56.927214] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:12:56.951031] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-10-21T20:12:57.738126] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T20:12:57.754571] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-10-21T20:12:57.757393] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T20:12:58.380237] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T20:12:58.551046] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-10-21T20:12:59.351019] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-10-21T20:13:00.151023] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-10-21T20:13:00.282174] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T20:13:00.446788] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T20:13:00.951059] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-10-21T20:13:01.321775] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T20:13:01.750993] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-10-21T20:13:02.559773] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-10-21T20:13:02.577942] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T20:13:02.859079] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-21T20:13:03.351063] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-10. [2025-10-21T20:13:03.711947] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T20:13:04.111310] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T20:13:04.112782] [INFO ] [REMOTE ] NNY: Full fetch complete (8333 records). [2025-10-21T20:13:04.112850] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-10-21T20:13:04.156292] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-10-21T20:13:04.471127] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-10-21T20:13:04.471203] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-10-21T20:13:04.471425] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-10-21T20:13:04.471491] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-10-21T20:13:04.471899] [DEBUG] [LOCAL ] NNY: Trimmed 8333 records to 5694 (keeping 200 days of data) [2025-10-21T20:13:04.503622] [DEBUG] [LOCAL ] NNY: Primary data saved (5694 records). [2025-10-21T20:13:04.503735] [INFO ] [MAIN ] NNY: Full history saved. [2025-10-21T20:13:04.503813] [INFO ] [MAIN ] Update Progress: 1501/2366 symbols completed. NNY took 21.8s. Estimated remaining: 1h 51m 14s. Rate: 7.8 symbols/min [2025-10-21T20:13:04.671280] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:13:04.709151] [DEBUG] [LOCAL ] NOC: Loaded 41627 existing records from primary storage. [2025-10-21T20:13:04.709419] [INFO ] [MAIN ] NOC: Loaded 41627 existing records. [2025-10-21T20:13:04.889986] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:13:04.890179] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-10-21T20:13:04.890225] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-10-21T20:13:04.890421] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-10-21T20:13:04.890477] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-10-21T20:13:04.964437] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-10-21T20:13:05.221523] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T20:13:05.263364] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:13:05.751034] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-10-21T20:13:06.541707] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T20:13:06.550968] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-10-21T20:13:06.789155] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T20:13:07.078014] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T20:13:07.351076] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-10-21T20:13:08.151021] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-10. [2025-10-21T20:13:08.951012] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-10-21T20:13:09.045181] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T20:13:09.751018] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-10-21T20:13:09.841795] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T20:13:09.849136] [INFO ] [REMOTE ] NNN: Full fetch complete (70291 records). [2025-10-21T20:13:09.849252] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-10-21T20:13:10.247903] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-10-21T20:13:10.248080] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-10-21T20:13:10.249428] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-10-21T20:13:10.249524] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-10-21T20:13:10.268049] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T20:13:10.267284] [DEBUG] [LOCAL ] NNN: Trimmed 70291 records to 48194 (keeping 200 days of data) [2025-10-21T20:13:10.551396] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-10-21T20:13:10.567796] [DEBUG] [LOCAL ] NNN: Primary data saved (48194 records). [2025-10-21T20:13:10.567889] [INFO ] [MAIN ] NNN: Full history saved. [2025-10-21T20:13:10.568945] [INFO ] [MAIN ] Update Progress: 1502/2366 symbols completed. NNN took 46.2s. Estimated remaining: 1h 51m 5s. Rate: 7.8 symbols/min [2025-10-21T20:13:10.741938] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:13:10.797043] [DEBUG] [LOCAL ] NOG: Loaded 51365 existing records from primary storage. [2025-10-21T20:13:10.797337] [INFO ] [MAIN ] NOG: Loaded 51365 existing records. [2025-10-21T20:13:10.979137] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:13:10.979514] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-10-21T20:13:10.979710] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-10-21T20:13:10.991863] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-10-21T20:13:10.992257] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T20:13:10.992316] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-10-21T20:13:11.361931] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:13:11.357059] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-10-21T20:13:11.386174] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T20:13:12.151021] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-10-21T20:13:12.951062] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-10-21T20:13:13.055071] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T20:13:13.750994] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-10-21T20:13:13.872306] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T20:13:13.901247] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T20:13:14.551059] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-10. [2025-10-21T20:13:14.591607] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T20:13:15.351091] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-10-21T20:13:15.592858] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T20:13:15.595900] [INFO ] [REMOTE ] NOA: Full fetch complete (22554 records). [2025-10-21T20:13:15.596000] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-10-21T20:13:15.965096] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-10-21T20:13:15.965171] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-10-21T20:13:15.965629] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-10-21T20:13:15.965702] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-10-21T20:13:15.966274] [DEBUG] [LOCAL ] NOA: Trimmed 22554 records to 15834 (keeping 200 days of data) [2025-10-21T20:13:16.059700] [DEBUG] [LOCAL ] NOA: Primary data saved (15834 records). [2025-10-21T20:13:16.059830] [INFO ] [MAIN ] NOA: Full history saved. [2025-10-21T20:13:16.059904] [INFO ] [MAIN ] Update Progress: 1503/2366 symbols completed. NOA took 26.5s. Estimated remaining: 1h 50m 56s. Rate: 7.8 symbols/min [2025-10-21T20:13:16.153393] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-10-21T20:13:16.236821] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:13:16.285858] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-21T20:13:16.286148] [INFO ] [MAIN ] NOK: Loaded 53622 existing records. [2025-10-21T20:13:16.470584] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T20:13:16.483265] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:13:16.489134] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-10-21T20:13:16.489199] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-10-21T20:13:16.489795] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-10-21T20:13:16.489852] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-10-21T20:13:16.869848] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:13:16.951034] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-10-21T20:13:17.751531] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-10-21T20:13:17.756547] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T20:13:18.551013] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-10-21T20:13:18.667664] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T20:13:18.697305] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T20:13:19.351060] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-10-21T20:13:20.151040] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-10-21T20:13:20.417909] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T20:13:20.483030] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T20:13:20.951046] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-10-21T20:13:21.739166] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T20:13:21.751785] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-10. [2025-10-21T20:13:22.551015] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-10-21T20:13:22.829931] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T20:13:22.831068] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T20:13:22.845230] [INFO ] [REMOTE ] NOAH: Full fetch complete (27332 records). [2025-10-21T20:13:22.845386] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-10-21T20:13:23.228932] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-10-21T20:13:23.229257] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-10-21T20:13:23.230001] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-10-21T20:13:23.230063] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-10-21T20:13:23.230781] [DEBUG] [LOCAL ] NOAH: Trimmed 27332 records to 20006 (keeping 200 days of data) [2025-10-21T20:13:23.346770] [DEBUG] [LOCAL ] NOAH: Primary data saved (20006 records). [2025-10-21T20:13:23.346896] [INFO ] [MAIN ] NOAH: Full history saved. [2025-10-21T20:13:23.346972] [INFO ] [MAIN ] Update Progress: 1504/2366 symbols completed. NOAH took 27.1s. Estimated remaining: 1h 50m 48s. Rate: 7.8 symbols/min [2025-10-21T20:13:23.358034] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-10-21T20:13:23.519310] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:13:23.519529] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-10-21T20:13:23.519572] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-10-21T20:13:23.519703] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-10-21T20:13:23.519754] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-21T20:13:23.519795] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-21T20:13:23.519831] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-10-21T20:13:23.883058] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:13:24.151029] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-10-21T20:13:24.585789] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-21T20:13:24.951105] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-10-21T20:13:25.138487] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T20:13:25.307633] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-21T20:13:25.751103] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-10-21T20:13:25.946262] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T20:13:26.099175] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-21T20:13:26.551030] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-10-21T20:13:27.351038] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-10-21T20:13:28.151023] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-10-21T20:13:28.653172] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-21T20:13:28.687628] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-21T20:13:28.950984] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-10-21T20:13:29.140684] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T20:13:29.751026] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-10-21T20:13:30.154766] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-21T20:13:30.551069] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-10-21T20:13:31.043280] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T20:13:31.351027] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-10-21T20:13:32.151069] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-10-21T20:13:32.406043] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T20:13:32.950994] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-10-21T20:13:33.205215] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-21T20:13:33.315281] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T20:13:33.384341] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T20:13:33.751080] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-10-21T20:13:34.551041] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-10-21T20:13:35.351089] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-10-21T20:13:35.478206] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T20:13:36.024369] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T20:13:36.151019] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-10. [2025-10-21T20:13:36.885805] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T20:13:36.951035] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-10-21T20:13:37.751021] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-10-21T20:13:37.957866] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T20:13:37.964478] [INFO ] [REMOTE ] NOC: Full fetch complete (61943 records). [2025-10-21T20:13:37.964629] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-10-21T20:13:38.380623] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-10-21T20:13:38.380762] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-10-21T20:13:38.381797] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-10-21T20:13:38.381878] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-10-21T20:13:38.383264] [DEBUG] [LOCAL ] NOC: Trimmed 61943 records to 41646 (keeping 200 days of data) [2025-10-21T20:13:38.563776] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-10-21T20:13:38.649196] [DEBUG] [LOCAL ] NOC: Primary data saved (41646 records). [2025-10-21T20:13:38.649330] [INFO ] [MAIN ] NOC: Full history saved. [2025-10-21T20:13:38.649430] [INFO ] [MAIN ] Update Progress: 1505/2366 symbols completed. NOC took 34.1s. Estimated remaining: 1h 50m 45s. Rate: 7.8 symbols/min [2025-10-21T20:13:38.851092] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:13:38.895146] [DEBUG] [LOCAL ] NOMD: Loaded 43107 existing records from primary storage. [2025-10-21T20:13:38.895454] [INFO ] [MAIN ] NOMD: Loaded 43107 existing records. [2025-10-21T20:13:38.953295] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-21T20:13:39.106567] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:13:39.107105] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-10-21T20:13:39.107425] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-10-21T20:13:39.107793] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-10-21T20:13:39.107898] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-10-21T20:13:39.310956] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-21T20:13:39.357216] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-10-21T20:13:39.534337] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T20:13:39.599682] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:13:39.842186] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T20:13:40.151027] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-10-21T20:13:40.951024] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-10-21T20:13:41.643559] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T20:13:41.751000] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-10-21T20:13:42.551083] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-10-21T20:13:42.610519] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T20:13:42.997110] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-21T20:13:43.353359] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-10-21T20:13:43.356838] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T20:13:44.151005] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-10-21T20:13:44.951016] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-10-21T20:13:45.384054] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T20:13:45.751008] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-10. [2025-10-21T20:13:45.833529] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T20:13:46.407444] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T20:13:46.551041] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-10-21T20:13:47.351027] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-10-21T20:13:47.641858] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-21T20:13:47.891568] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T20:13:47.919620] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T20:13:47.918722] [INFO ] [REMOTE ] NOK: Full fetch complete (77774 records). [2025-10-21T20:13:47.927337] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-10-21T20:13:48.156599] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-10. [2025-10-21T20:13:48.315546] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-10-21T20:13:48.315625] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-10-21T20:13:48.316746] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-10-21T20:13:48.316808] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-10-21T20:13:48.318259] [DEBUG] [LOCAL ] NOK: Trimmed 77774 records to 53622 (keeping 200 days of data) [2025-10-21T20:13:48.621407] [DEBUG] [LOCAL ] NOK: Primary data saved (53622 records). [2025-10-21T20:13:48.621539] [INFO ] [MAIN ] NOK: Full history saved. [2025-10-21T20:13:48.622276] [INFO ] [MAIN ] Update Progress: 1506/2366 symbols completed. NOK took 32.6s. Estimated remaining: 1h 50m 38s. Rate: 7.8 symbols/min [2025-10-21T20:13:48.698484] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-21T20:13:48.724787] [INFO ] [REMOTE ] NOM: Full fetch complete (1537 records). [2025-10-21T20:13:48.725139] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-10-21T20:13:48.915211] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:13:48.957414] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-10. [2025-10-21T20:13:49.005720] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-21T20:13:49.006084] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:13:49.006149] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:13:49.006191] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-10-21T20:13:49.006244] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-10-21T20:13:49.006279] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-10-21T20:13:49.006319] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-10-21T20:13:49.006374] [INFO ] [MAIN ] Update Progress: 1507/2366 symbols completed. NOM took 25.7s. Estimated remaining: 1h 50m 26s. Rate: 7.8 symbols/min [2025-10-21T20:13:49.208270] [DEBUG] [LOCAL ] NOTE: Loaded 39914 existing records from primary storage. [2025-10-21T20:13:49.227058] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:13:49.227264] [INFO ] [MAIN ] NOTE: Loaded 39914 existing records. [2025-10-21T20:13:49.450823] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:13:49.451071] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-10-21T20:13:49.451120] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-10-21T20:13:49.451318] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-10-21T20:13:49.451374] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-10-21T20:13:49.609560] [DEBUG] [LOCAL ] NOV: Loaded 53173 existing records from primary storage. [2025-10-21T20:13:49.690689] [INFO ] [MAIN ] NOV: Loaded 53173 existing records. [2025-10-21T20:13:49.762415] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-10-21T20:13:50.007959] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:13:50.029770] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:13:50.030135] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-10-21T20:13:50.030183] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-10-21T20:13:50.030413] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-10-21T20:13:50.030484] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-10-21T20:13:50.422168] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:13:50.550980] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-10-21T20:13:51.028235] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T20:13:51.036440] [INFO ] [REMOTE ] NOG: Full fetch complete (74305 records). [2025-10-21T20:13:51.036571] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-10-21T20:13:51.360042] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-10-21T20:13:51.470395] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T20:13:51.503377] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-10-21T20:13:51.503811] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-10-21T20:13:51.504948] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-10-21T20:13:51.505013] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-10-21T20:13:51.506818] [DEBUG] [LOCAL ] NOG: Trimmed 74305 records to 51364 (keeping 200 days of data) [2025-10-21T20:13:51.840416] [DEBUG] [LOCAL ] NOG: Primary data saved (51364 records). [2025-10-21T20:13:51.840565] [INFO ] [MAIN ] NOG: Full history saved. [2025-10-21T20:13:51.841428] [INFO ] [MAIN ] Update Progress: 1508/2366 symbols completed. NOG took 41.3s. Estimated remaining: 1h 50m 16s. Rate: 7.8 symbols/min [2025-10-21T20:13:52.008223] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:13:52.056091] [DEBUG] [LOCAL ] NOW: Loaded 47924 existing records from primary storage. [2025-10-21T20:13:52.056389] [INFO ] [MAIN ] NOW: Loaded 47924 existing records. [2025-10-21T20:13:52.157430] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-10-21T20:13:52.241090] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:13:52.241372] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-10-21T20:13:52.241457] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-10-21T20:13:52.241698] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-10-21T20:13:52.241753] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-10-21T20:13:52.626991] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:13:52.632790] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-21T20:13:52.951028] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-10-21T20:13:53.290870] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T20:13:53.751043] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-10-21T20:13:53.801569] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T20:13:54.550994] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-10-21T20:13:54.653084] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T20:13:55.351073] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-10-21T20:13:55.892038] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T20:13:56.151048] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-10-21T20:13:56.199949] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T20:13:56.951126] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-10-21T20:13:57.256451] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T20:13:57.751025] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-10-21T20:13:58.263777] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T20:13:58.345422] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T20:13:58.551115] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-10-21T20:13:59.351075] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-10-21T20:13:59.437297] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T20:14:00.151085] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-10-21T20:14:00.734175] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-21T20:14:00.951019] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-10-21T20:14:01.131434] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T20:14:01.751030] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-10-21T20:14:01.944343] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T20:14:02.551087] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-10-21T20:14:02.741740] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T20:14:03.279443] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T20:14:03.350984] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-10-21T20:14:04.150995] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-10-21T20:14:04.220493] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T20:14:04.951073] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-10-21T20:14:05.204141] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T20:14:05.751072] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-10. [2025-10-21T20:14:05.981794] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T20:14:06.551036] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-10-21T20:14:07.261547] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-21T20:14:07.295564] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T20:14:07.303593] [INFO ] [REMOTE ] NOMD: Full fetch complete (60669 records). [2025-10-21T20:14:07.303753] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-10-21T20:14:07.363389] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-10-21T20:14:07.723334] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-10-21T20:14:07.723415] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-10-21T20:14:07.724465] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-10-21T20:14:07.724531] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-10-21T20:14:07.725857] [DEBUG] [LOCAL ] NOMD: Trimmed 60669 records to 43178 (keeping 200 days of data) [2025-10-21T20:14:07.979295] [DEBUG] [LOCAL ] NOMD: Primary data saved (43178 records). [2025-10-21T20:14:07.979416] [INFO ] [MAIN ] NOMD: Full history saved. [2025-10-21T20:14:07.979511] [INFO ] [MAIN ] Update Progress: 1509/2366 symbols completed. NOMD took 29.3s. Estimated remaining: 1h 50m 13s. Rate: 7.8 symbols/min [2025-10-21T20:14:08.145197] [INFO ] [MAIN ] NP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:14:08.145392] [DEBUG] [LOCAL ] NP: No existing data file found in primary storage. [2025-10-21T20:14:08.145439] [WARN ] [MAIN ] NP: No existing data found, performing full refresh instead. [2025-10-21T20:14:08.145548] [INFO ] [MAIN ] NP: Wiping existing primary data before full refresh. [2025-10-21T20:14:08.145603] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-21T20:14:08.145712] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-21T20:14:08.145767] [INFO ] [MAIN ] NP: Starting full primary refresh. [2025-10-21T20:14:08.176018] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-10-21T20:14:08.514324] [INFO ] [REMOTE ] NP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:14:08.534178] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T20:14:08.951047] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-10-21T20:14:09.189860] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T20:14:09.751077] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-10-21T20:14:10.157331] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T20:14:10.551031] [INFO ] [REMOTE ] NP: Fetching primary data for 2025-01. [2025-10-21T20:14:10.675256] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T20:14:10.751736] [DEBUG] [REMOTE ] NP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:14:10.752065] [WARN ] [REMOTE ] NP: No data returned for month 2025-01 [2025-10-21T20:14:10.752156] [FATAL] [REMOTE ] NP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:14:10.752201] [FATAL] [MAIN ] NP: Failed to fetch primary data. [2025-10-21T20:14:10.752233] [WARN ] [MAIN ] NP: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:14:10.752297] [INFO ] [LOCAL ] NP: Starting deletion of primary data. [2025-10-21T20:14:10.752357] [DEBUG] [LOCAL ] NP: No primary data file found to delete. [2025-10-21T20:14:10.752391] [INFO ] [LOCAL ] NP: Starting deletion of derivative data. [2025-10-21T20:14:10.752429] [DEBUG] [LOCAL ] NP: No derivative data file found to delete. [2025-10-21T20:14:10.752473] [INFO ] [MAIN ] Update Progress: 1510/2366 symbols completed. NP took 2.8s. Estimated remaining: 1h 50m 2s. Rate: 7.8 symbols/min [2025-10-21T20:14:10.921271] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:14:10.921398] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-10-21T20:14:10.921434] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-10-21T20:14:10.921535] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-10-21T20:14:10.921574] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-21T20:14:10.921613] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-21T20:14:10.921665] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-10-21T20:14:11.267862] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:14:11.350998] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-10-21T20:14:11.611357] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T20:14:12.151023] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-10-21T20:14:12.371940] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:14:12.372254] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-10-21T20:14:12.372344] [FATAL] [REMOTE ] NPB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:14:12.372422] [FATAL] [MAIN ] NPB: Failed to fetch primary data. [2025-10-21T20:14:12.372497] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:14:12.372595] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-10-21T20:14:12.372710] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-10-21T20:14:12.372775] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-10-21T20:14:12.372833] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-10-21T20:14:12.372892] [INFO ] [MAIN ] Update Progress: 1511/2366 symbols completed. NPB took 1.6s. Estimated remaining: 1h 49m 51s. Rate: 7.8 symbols/min [2025-10-21T20:14:12.539894] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:14:12.557122] [DEBUG] [LOCAL ] NPCT: Loaded 16647 existing records from primary storage. [2025-10-21T20:14:12.557342] [INFO ] [MAIN ] NPCT: Loaded 16647 existing records. [2025-10-21T20:14:12.736204] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:14:12.736442] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-10-21T20:14:12.736525] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-10-21T20:14:12.736826] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-10-21T20:14:12.736901] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-10-21T20:14:12.956158] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-10-21T20:14:13.127519] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:14:13.159778] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T20:14:13.751044] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-10-21T20:14:14.551032] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-10-21T20:14:14.675611] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T20:14:14.915092] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T20:14:15.351085] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-10-21T20:14:16.151015] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-10-21T20:14:16.229076] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T20:14:16.391706] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T20:14:16.951045] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-10-21T20:14:17.751068] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-10-21T20:14:18.260905] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T20:14:18.387854] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T20:14:18.550984] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-10-21T20:14:18.677615] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T20:14:19.351034] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-10. [2025-10-21T20:14:20.151042] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-10-21T20:14:20.843881] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T20:14:20.865315] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T20:14:20.869459] [INFO ] [REMOTE ] NOTE: Full fetch complete (61247 records). [2025-10-21T20:14:20.869563] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-10-21T20:14:20.959735] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-10-21T20:14:21.253789] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-10-21T20:14:21.253865] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-10-21T20:14:21.254831] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-10-21T20:14:21.254892] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-10-21T20:14:21.255997] [DEBUG] [LOCAL ] NOTE: Trimmed 61247 records to 39700 (keeping 200 days of data) [2025-10-21T20:14:21.480927] [DEBUG] [LOCAL ] NOTE: Primary data saved (39700 records). [2025-10-21T20:14:21.481082] [INFO ] [MAIN ] NOTE: Full history saved. [2025-10-21T20:14:21.481195] [INFO ] [MAIN ] Update Progress: 1512/2366 symbols completed. NOTE took 32.9s. Estimated remaining: 1h 49m 44s. Rate: 7.8 symbols/min [2025-10-21T20:14:21.669074] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:14:21.680321] [DEBUG] [LOCAL ] NPFD: Loaded 10026 existing records from primary storage. [2025-10-21T20:14:21.680516] [INFO ] [MAIN ] NPFD: Loaded 10026 existing records. [2025-10-21T20:14:21.755484] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-10-21T20:14:21.865030] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:14:21.865340] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-10-21T20:14:21.865391] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-10-21T20:14:21.865618] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-10-21T20:14:21.865714] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-10-21T20:14:22.270936] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:14:22.294371] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T20:14:22.307103] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T20:14:22.551021] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-10-21T20:14:23.351026] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-10-21T20:14:23.573107] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T20:14:24.156246] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-10. [2025-10-21T20:14:24.179767] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T20:14:24.401425] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T20:14:24.951051] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-10. [2025-10-21T20:14:25.094336] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T20:14:25.101604] [INFO ] [REMOTE ] NOW: Full fetch complete (70762 records). [2025-10-21T20:14:25.101760] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-10-21T20:14:25.498442] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-10-21T20:14:25.498525] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-10-21T20:14:25.499705] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-10-21T20:14:25.499771] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-10-21T20:14:25.501174] [DEBUG] [LOCAL ] NOW: Trimmed 70762 records to 47904 (keeping 200 days of data) [2025-10-21T20:14:25.753199] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-10-21T20:14:25.811407] [DEBUG] [LOCAL ] NOW: Primary data saved (47904 records). [2025-10-21T20:14:25.811552] [INFO ] [MAIN ] NOW: Full history saved. [2025-10-21T20:14:25.812403] [INFO ] [MAIN ] Update Progress: 1513/2366 symbols completed. NOW took 34.0s. Estimated remaining: 1h 49m 35s. Rate: 7.8 symbols/min [2025-10-21T20:14:25.978760] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:14:25.990010] [DEBUG] [LOCAL ] NPK: Loaded 8500 existing records from primary storage. [2025-10-21T20:14:25.990247] [INFO ] [MAIN ] NPK: Loaded 8500 existing records. [2025-10-21T20:14:26.193846] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:14:26.194083] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-10-21T20:14:26.194130] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-10-21T20:14:26.194286] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-10-21T20:14:26.194323] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-10-21T20:14:26.568357] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-10-21T20:14:26.573553] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:14:26.782368] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T20:14:26.854709] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T20:14:26.869276] [INFO ] [REMOTE ] NOV: Full fetch complete (77168 records). [2025-10-21T20:14:26.869810] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-10-21T20:14:27.309639] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-10-21T20:14:27.309823] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-10-21T20:14:27.311618] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-10-21T20:14:27.311725] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-10-21T20:14:27.314193] [DEBUG] [LOCAL ] NOV: Trimmed 77168 records to 53168 (keeping 200 days of data) [2025-10-21T20:14:27.374485] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-10-21T20:14:27.426562] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T20:14:27.682471] [DEBUG] [LOCAL ] NOV: Primary data saved (53168 records). [2025-10-21T20:14:27.682729] [INFO ] [MAIN ] NOV: Full history saved. [2025-10-21T20:14:27.683414] [INFO ] [MAIN ] Update Progress: 1514/2366 symbols completed. NOV took 38.7s. Estimated remaining: 1h 49m 24s. Rate: 7.8 symbols/min [2025-10-21T20:14:27.867492] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:14:27.912716] [DEBUG] [LOCAL ] NPKI: Loaded 40492 existing records from primary storage. [2025-10-21T20:14:27.913102] [INFO ] [MAIN ] NPKI: Loaded 40492 existing records. [2025-10-21T20:14:28.109519] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T20:14:28.113539] [WARN ] [MAIN ] NPKI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:14:28.116249] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-10-21T20:14:28.116314] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-10-21T20:14:28.116616] [DEBUG] [LOCAL ] NPKI: Deleted primary data file. [2025-10-21T20:14:28.116711] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-10-21T20:14:28.156337] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-10-21T20:14:28.486870] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:14:28.951067] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-10-21T20:14:29.482770] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T20:14:29.587921] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T20:14:29.751049] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-10-21T20:14:30.493190] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T20:14:30.551027] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-10-21T20:14:31.289976] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T20:14:31.351068] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-10-21T20:14:32.151088] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-10-21T20:14:32.658827] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T20:14:32.904156] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T20:14:32.951037] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-10-21T20:14:33.619639] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-21T20:14:33.751064] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-10-21T20:14:34.551099] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-10-21T20:14:34.644904] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T20:14:35.337150] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T20:14:35.350976] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-10-21T20:14:36.044713] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T20:14:36.151083] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-10-21T20:14:36.951049] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-10-21T20:14:37.517636] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T20:14:37.747991] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T20:14:37.750973] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-10-21T20:14:38.347606] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T20:14:38.550999] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-10-21T20:14:39.195983] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T20:14:39.351048] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-10-21T20:14:40.150989] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-10-21T20:14:40.388981] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T20:14:40.951012] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-10. [2025-10-21T20:14:41.600243] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T20:14:41.642338] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T20:14:41.645038] [INFO ] [REMOTE ] NPCT: Full fetch complete (24423 records). [2025-10-21T20:14:41.645116] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-10-21T20:14:41.752718] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-10-21T20:14:42.036325] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-10-21T20:14:42.036409] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-10-21T20:14:42.037073] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-10-21T20:14:42.037136] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-10-21T20:14:42.037801] [DEBUG] [LOCAL ] NPCT: Trimmed 24423 records to 16499 (keeping 200 days of data) [2025-10-21T20:14:42.139625] [DEBUG] [LOCAL ] NPCT: Primary data saved (16499 records). [2025-10-21T20:14:42.139801] [INFO ] [MAIN ] NPCT: Full history saved. [2025-10-21T20:14:42.139899] [INFO ] [MAIN ] Update Progress: 1515/2366 symbols completed. NPCT took 29.8s. Estimated remaining: 1h 49m 20s. Rate: 7.8 symbols/min [2025-10-21T20:14:42.313620] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:14:42.329722] [DEBUG] [LOCAL ] NPO: Loaded 13626 existing records from primary storage. [2025-10-21T20:14:42.329965] [INFO ] [MAIN ] NPO: Loaded 13626 existing records. [2025-10-21T20:14:42.509209] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:14:42.509448] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-10-21T20:14:42.509495] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-10-21T20:14:42.509688] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-10-21T20:14:42.509744] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-10-21T20:14:42.555503] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-10-21T20:14:42.615299] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T20:14:42.879707] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:14:43.351076] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-10-21T20:14:44.146595] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T20:14:44.150969] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-10-21T20:14:44.220405] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T20:14:44.951028] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-10-21T20:14:45.077373] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T20:14:45.751049] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-10-21T20:14:45.781176] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T20:14:46.551014] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-10-21T20:14:46.718920] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T20:14:47.351094] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-10-21T20:14:48.065509] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T20:14:48.154543] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-10-21T20:14:48.155523] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T20:14:48.951063] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-10. [2025-10-21T20:14:49.145177] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T20:14:49.751093] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-10-21T20:14:50.174586] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T20:14:50.176909] [INFO ] [REMOTE ] NPFD: Full fetch complete (14591 records). [2025-10-21T20:14:50.176977] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-10-21T20:14:50.544289] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-10-21T20:14:50.544381] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-10-21T20:14:50.544784] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-10-21T20:14:50.544844] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-10-21T20:14:50.545320] [DEBUG] [LOCAL ] NPFD: Trimmed 14591 records to 10016 (keeping 200 days of data) [2025-10-21T20:14:50.570729] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-10-21T20:14:50.612978] [DEBUG] [LOCAL ] NPFD: Primary data saved (10016 records). [2025-10-21T20:14:50.613082] [INFO ] [MAIN ] NPFD: Full history saved. [2025-10-21T20:14:50.613160] [INFO ] [MAIN ] Update Progress: 1516/2366 symbols completed. NPFD took 29.1s. Estimated remaining: 1h 49m 12s. Rate: 7.8 symbols/min [2025-10-21T20:14:50.723962] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T20:14:50.793870] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:14:50.801480] [DEBUG] [LOCAL ] NPV: Loaded 5369 existing records from primary storage. [2025-10-21T20:14:50.801734] [INFO ] [MAIN ] NPV: Loaded 5369 existing records. [2025-10-21T20:14:50.977021] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:14:50.977268] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-10-21T20:14:50.977316] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-10-21T20:14:50.977476] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-10-21T20:14:50.977515] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-10-21T20:14:51.354503] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:14:51.354579] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-10-21T20:14:51.583728] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T20:14:51.979470] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T20:14:52.151094] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-10-21T20:14:52.951048] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-10-21T20:14:53.631248] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T20:14:53.750988] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-10. [2025-10-21T20:14:53.974510] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T20:14:54.551026] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-10-21T20:14:54.621015] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T20:14:54.623015] [INFO ] [REMOTE ] NPK: Full fetch complete (11127 records). [2025-10-21T20:14:54.623082] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-10-21T20:14:54.974967] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-10-21T20:14:54.975044] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-10-21T20:14:54.975337] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-10-21T20:14:54.975383] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-10-21T20:14:54.975842] [DEBUG] [LOCAL ] NPK: Trimmed 11127 records to 8461 (keeping 200 days of data) [2025-10-21T20:14:55.042289] [DEBUG] [LOCAL ] NPK: Primary data saved (8461 records). [2025-10-21T20:14:55.042449] [INFO ] [MAIN ] NPK: Full history saved. [2025-10-21T20:14:55.042552] [INFO ] [MAIN ] Update Progress: 1517/2366 symbols completed. NPK took 29.2s. Estimated remaining: 1h 49m 3s. Rate: 7.8 symbols/min [2025-10-21T20:14:55.136017] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T20:14:55.351026] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-10-21T20:14:56.151031] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-10-21T20:14:56.906173] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T20:14:56.950986] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-10-21T20:14:57.019798] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T20:14:57.751072] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-10-21T20:14:58.319749] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T20:14:58.384867] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T20:14:58.551028] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-10-21T20:14:59.351046] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-10-21T20:14:59.943964] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T20:15:00.069794] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-21T20:15:00.151069] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-10. [2025-10-21T20:15:00.951064] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-10-21T20:15:01.655852] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T20:15:01.751060] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-10-21T20:15:01.899520] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T20:15:01.906270] [INFO ] [REMOTE ] NPKI: Full fetch complete (56292 records). [2025-10-21T20:15:01.906441] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-10-21T20:15:02.312353] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-10-21T20:15:02.312450] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-10-21T20:15:02.313556] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-10-21T20:15:02.313624] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-10-21T20:15:02.314934] [DEBUG] [LOCAL ] NPKI: Trimmed 56292 records to 40462 (keeping 200 days of data) [2025-10-21T20:15:02.551779] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-10-21T20:15:02.557809] [DEBUG] [LOCAL ] NPKI: Primary data saved (40462 records). [2025-10-21T20:15:02.558216] [INFO ] [MAIN ] NPKI: Full history saved. [2025-10-21T20:15:02.560283] [INFO ] [MAIN ] Update Progress: 1518/2366 symbols completed. NPKI took 34.9s. Estimated remaining: 1h 48m 55s. Rate: 7.8 symbols/min [2025-10-21T20:15:02.762947] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T20:15:03.231808] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T20:15:03.351084] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-10-21T20:15:04.151128] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-10-21T20:15:04.226781] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T20:15:04.858882] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-21T20:15:04.951053] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-10-21T20:15:05.564346] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T20:15:05.751063] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-10. [2025-10-21T20:15:06.551028] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-10-21T20:15:07.006499] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T20:15:07.010264] [INFO ] [REMOTE ] NPO: Full fetch complete (18844 records). [2025-10-21T20:15:07.010344] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-10-21T20:15:07.227438] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-21T20:15:07.353506] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-10-21T20:15:07.379917] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-10-21T20:15:07.379975] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-10-21T20:15:07.380382] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-10-21T20:15:07.380420] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-10-21T20:15:07.380972] [DEBUG] [LOCAL ] NPO: Trimmed 18844 records to 13573 (keeping 200 days of data) [2025-10-21T20:15:07.463806] [DEBUG] [LOCAL ] NPO: Primary data saved (13573 records). [2025-10-21T20:15:07.463925] [INFO ] [MAIN ] NPO: Full history saved. [2025-10-21T20:15:07.464003] [INFO ] [MAIN ] Update Progress: 1519/2366 symbols completed. NPO took 25.3s. Estimated remaining: 1h 48m 46s. Rate: 7.8 symbols/min [2025-10-21T20:15:08.076691] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T20:15:08.151142] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-10-21T20:15:08.867747] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T20:15:08.951017] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-10. [2025-10-21T20:15:09.725150] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T20:15:09.727329] [INFO ] [REMOTE ] NPV: Full fetch complete (7177 records). [2025-10-21T20:15:09.727415] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-10-21T20:15:10.095305] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-10-21T20:15:10.095380] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-10-21T20:15:10.095565] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-10-21T20:15:10.095602] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-10-21T20:15:10.096000] [DEBUG] [LOCAL ] NPV: Trimmed 7177 records to 5390 (keeping 200 days of data) [2025-10-21T20:15:10.128179] [DEBUG] [LOCAL ] NPV: Primary data saved (5390 records). [2025-10-21T20:15:10.128300] [INFO ] [MAIN ] NPV: Full history saved. [2025-10-21T20:15:10.128375] [INFO ] [MAIN ] Update Progress: 1520/2366 symbols completed. NPV took 19.5s. Estimated remaining: 1h 48m 35s. Rate: 7.8 symbols/min [2025-10-21T20:15:10.714037] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:15:10.700410] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:15:10.749849] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:15:10.822471] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:15:10.832248] [DEBUG] [LOCAL ] NQP: Loaded 9208 existing records from primary storage. [2025-10-21T20:15:10.832685] [DEBUG] [LOCAL ] NREF: Loaded 7833 existing records from primary storage. [2025-10-21T20:15:10.833113] [INFO ] [MAIN ] NQP: Loaded 9208 existing records. [2025-10-21T20:15:10.833367] [INFO ] [MAIN ] NREF: Loaded 7833 existing records. [2025-10-21T20:15:11.068170] [DEBUG] [LOCAL ] NRDY: Loaded 32396 existing records from primary storage. [2025-10-21T20:15:11.137411] [INFO ] [MAIN ] NRDY: Loaded 32396 existing records. [2025-10-21T20:15:11.255451] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:15:11.287307] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-10-21T20:15:11.307212] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:15:11.308309] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-10-21T20:15:11.307325] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-10-21T20:15:11.313775] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-10-21T20:15:11.342351] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-10-21T20:15:11.342494] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-10-21T20:15:11.358013] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-10-21T20:15:11.331956] [DEBUG] [LOCAL ] NPWR: Loaded 43398 existing records from primary storage. [2025-10-21T20:15:11.367569] [INFO ] [MAIN ] NPWR: Loaded 43398 existing records. [2025-10-21T20:15:11.367474] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-10-21T20:15:11.734666] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:15:11.815109] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-10-21T20:15:11.843860] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-10-21T20:15:11.876715] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:15:11.919357] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-10-21T20:15:11.926740] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-10-21T20:15:11.937868] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-10-21T20:15:11.943035] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-10-21T20:15:11.988437] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-10-21T20:15:11.995265] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-10-21T20:15:12.582220] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:15:12.701501] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-10-21T20:15:12.809152] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:15:12.864279] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-10-21T20:15:13.116214] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:15:13.132861] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-10-21T20:15:13.136702] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:15:13.137872] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-10-21T20:15:13.601314] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T20:15:13.603187] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-10-21T20:15:13.678370] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-21T20:15:13.751051] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-10-21T20:15:14.266615] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T20:15:14.533375] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T20:15:14.542283] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T20:15:14.550981] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-10-21T20:15:14.743400] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T20:15:15.351061] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-10-21T20:15:15.854305] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T20:15:16.151040] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-10-21T20:15:16.803247] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T20:15:16.883274] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T20:15:16.951061] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-10-21T20:15:17.751021] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-10-21T20:15:18.447183] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T20:15:18.551048] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-10-21T20:15:18.685241] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T20:15:19.351030] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-10-21T20:15:20.052032] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T20:15:20.081485] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T20:15:20.150996] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-10-21T20:15:20.950998] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-10-21T20:15:20.979045] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T20:15:21.751022] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-10-21T20:15:22.270247] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T20:15:22.500230] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T20:15:22.551057] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-10-21T20:15:23.351014] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-10-21T20:15:23.394228] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T20:15:24.151028] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-10-21T20:15:24.847454] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T20:15:24.950997] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-10-21T20:15:25.014151] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T20:15:25.751061] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-10-21T20:15:26.520685] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T20:15:26.548482] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T20:15:26.557278] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-10-21T20:15:27.351054] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-10-21T20:15:27.361825] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T20:15:28.140687] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T20:15:28.150977] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-10-21T20:15:28.912513] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T20:15:28.951040] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-10-21T20:15:29.628876] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T20:15:29.751083] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-10-21T20:15:30.551071] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-10-21T20:15:31.326107] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T20:15:31.353692] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-10-21T20:15:31.359308] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T20:15:32.151087] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-10. [2025-10-21T20:15:32.183936] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T20:15:32.878583] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T20:15:32.881232] [INFO ] [REMOTE ] NREF: Full fetch complete (10861 records). [2025-10-21T20:15:32.881310] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-10-21T20:15:32.956161] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-10-21T20:15:33.266782] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-10-21T20:15:33.266863] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-10-21T20:15:33.267124] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-10-21T20:15:33.267162] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-10-21T20:15:33.267577] [DEBUG] [LOCAL ] NREF: Trimmed 10861 records to 7839 (keeping 200 days of data) [2025-10-21T20:15:33.313515] [DEBUG] [LOCAL ] NREF: Primary data saved (7839 records). [2025-10-21T20:15:33.313664] [INFO ] [MAIN ] NREF: Full history saved. [2025-10-21T20:15:33.313765] [INFO ] [MAIN ] Update Progress: 1521/2366 symbols completed. NREF took 23.2s. Estimated remaining: 1h 48m 36s. Rate: 7.8 symbols/min [2025-10-21T20:15:33.480129] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:15:33.480312] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-10-21T20:15:33.480349] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-10-21T20:15:33.480461] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-10-21T20:15:33.480517] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-10-21T20:15:33.480591] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-10-21T20:15:33.480637] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-10-21T20:15:33.756120] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-10. [2025-10-21T20:15:33.840810] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:15:34.550993] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-10-21T20:15:34.604123] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T20:15:34.605825] [INFO ] [REMOTE ] NQP: Full fetch complete (12768 records). [2025-10-21T20:15:34.605907] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-10-21T20:15:35.044036] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T20:15:35.061619] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-10-21T20:15:35.061770] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-10-21T20:15:35.062531] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-10-21T20:15:35.062775] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-10-21T20:15:35.063697] [DEBUG] [LOCAL ] NQP: Trimmed 12768 records to 9224 (keeping 200 days of data) [2025-10-21T20:15:35.123217] [DEBUG] [LOCAL ] NQP: Primary data saved (9224 records). [2025-10-21T20:15:35.123352] [INFO ] [MAIN ] NQP: Full history saved. [2025-10-21T20:15:35.123431] [INFO ] [MAIN ] Update Progress: 1522/2366 symbols completed. NQP took 25.0s. Estimated remaining: 1h 48m 25s. Rate: 7.8 symbols/min [2025-10-21T20:15:35.293520] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:15:35.293734] [DEBUG] [LOCAL ] NRGV: No existing data file found in primary storage. [2025-10-21T20:15:35.293780] [WARN ] [MAIN ] NRGV: No existing data found, performing full refresh instead. [2025-10-21T20:15:35.293928] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-10-21T20:15:35.294022] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-10-21T20:15:35.294087] [DEBUG] [LOCAL ] NRGV: No primary data file found to delete. [2025-10-21T20:15:35.294120] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-10-21T20:15:35.359245] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-10-21T20:15:35.656179] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:15:36.151018] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-10-21T20:15:36.350873] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T20:15:36.819403] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T20:15:36.951042] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-10-21T20:15:37.684402] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T20:15:37.751034] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-10-21T20:15:38.551036] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-10-21T20:15:38.750286] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T20:15:39.279405] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T20:15:39.351024] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-10-21T20:15:39.602191] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T20:15:40.151024] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-10-21T20:15:40.640843] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T20:15:40.951054] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-10-21T20:15:41.698546] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T20:15:41.751072] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-10-21T20:15:42.275805] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T20:15:42.551031] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-10-21T20:15:43.305424] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T20:15:43.351005] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-10. [2025-10-21T20:15:43.809143] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-21T20:15:44.151033] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-10-21T20:15:44.951018] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-10-21T20:15:45.059563] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T20:15:45.071893] [INFO ] [REMOTE ] NPWR: Full fetch complete (60618 records). [2025-10-21T20:15:45.072117] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-10-21T20:15:45.696197] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-10-21T20:15:45.696391] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-10-21T20:15:45.697807] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-10-21T20:15:45.697876] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-10-21T20:15:45.701144] [DEBUG] [LOCAL ] NPWR: Trimmed 60618 records to 43381 (keeping 200 days of data) [2025-10-21T20:15:45.769356] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-10-21T20:15:46.118727] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T20:15:46.141223] [DEBUG] [LOCAL ] NPWR: Primary data saved (43381 records). [2025-10-21T20:15:46.142569] [INFO ] [MAIN ] NPWR: Full history saved. [2025-10-21T20:15:46.142727] [INFO ] [MAIN ] Update Progress: 1523/2366 symbols completed. NPWR took 36.0s. Estimated remaining: 1h 48m 19s. Rate: 7.8 symbols/min [2025-10-21T20:15:46.338026] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:15:46.356145] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T20:15:46.382688] [DEBUG] [LOCAL ] NRK: Loaded 20401 existing records from primary storage. [2025-10-21T20:15:46.382974] [INFO ] [MAIN ] NRK: Loaded 20401 existing records. [2025-10-21T20:15:46.554121] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-10-21T20:15:46.576947] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:15:46.577225] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-10-21T20:15:46.577467] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-10-21T20:15:46.577751] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-10-21T20:15:46.577810] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-10-21T20:15:46.980686] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:15:47.350986] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-10. [2025-10-21T20:15:47.875313] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-21T20:15:48.151044] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-10-21T20:15:48.535846] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T20:15:48.856837] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T20:15:48.862462] [INFO ] [REMOTE ] NRDY: Full fetch complete (50135 records). [2025-10-21T20:15:48.862611] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-10-21T20:15:48.956127] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-10-21T20:15:49.190124] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T20:15:49.286870] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-10-21T20:15:49.286958] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-10-21T20:15:49.288040] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-10-21T20:15:49.288111] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-10-21T20:15:49.289524] [DEBUG] [LOCAL ] NRDY: Trimmed 50135 records to 32274 (keeping 200 days of data) [2025-10-21T20:15:49.467177] [DEBUG] [LOCAL ] NRDY: Primary data saved (32274 records). [2025-10-21T20:15:49.467301] [INFO ] [MAIN ] NRDY: Full history saved. [2025-10-21T20:15:49.467375] [INFO ] [MAIN ] Update Progress: 1524/2366 symbols completed. NRDY took 39.3s. Estimated remaining: 1h 48m 9s. Rate: 7.8 symbols/min [2025-10-21T20:15:49.636961] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:15:49.642562] [DEBUG] [LOCAL ] NRP: Loaded 4208 existing records from primary storage. [2025-10-21T20:15:49.642765] [INFO ] [MAIN ] NRP: Loaded 4208 existing records. [2025-10-21T20:15:49.756227] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-10-21T20:15:49.826507] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:15:49.826739] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-10-21T20:15:49.826794] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-10-21T20:15:49.826931] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-10-21T20:15:49.826969] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-10-21T20:15:50.188485] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:15:50.551076] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-10-21T20:15:50.610384] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T20:15:51.351079] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-10-21T20:15:51.468012] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T20:15:51.815930] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T20:15:52.151018] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-10-21T20:15:52.818394] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T20:15:52.951095] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-10-21T20:15:53.150808] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T20:15:53.751127] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-10-21T20:15:54.551215] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-10-21T20:15:54.750174] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T20:15:54.826826] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T20:15:55.351080] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-10-21T20:15:56.040419] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T20:15:56.150992] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-10-21T20:15:56.430879] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T20:15:56.951015] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-10-21T20:15:57.706058] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T20:15:57.724634] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T20:15:57.751000] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-10-21T20:15:58.551004] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-10-21T20:15:58.992141] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T20:15:59.213918] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-21T20:15:59.351046] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-10-21T20:15:59.964371] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T20:16:00.151055] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-10-21T20:16:00.951100] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-10-21T20:16:01.660970] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T20:16:01.751037] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-10-21T20:16:02.551062] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-10-21T20:16:02.640406] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T20:16:02.987201] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T20:16:03.351072] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-10-21T20:16:04.151076] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-10-21T20:16:04.550434] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T20:16:04.772978] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-21T20:16:04.951078] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-10. [2025-10-21T20:16:04.951914] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T20:16:05.751045] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-10-21T20:16:06.551045] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-10. [2025-10-21T20:16:06.928352] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T20:16:06.936387] [INFO ] [REMOTE ] NRGV: Full fetch complete (62484 records). [2025-10-21T20:16:06.936517] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-10-21T20:16:07.359739] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-10-21T20:16:07.364107] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-10-21T20:16:07.364204] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-10-21T20:16:07.365354] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-10-21T20:16:07.365539] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-10-21T20:16:07.366981] [DEBUG] [LOCAL ] NRGV: Trimmed 62484 records to 43875 (keeping 200 days of data) [2025-10-21T20:16:07.620752] [DEBUG] [LOCAL ] NRGV: Primary data saved (43875 records). [2025-10-21T20:16:07.620889] [INFO ] [MAIN ] NRGV: Full history saved. [2025-10-21T20:16:07.620961] [INFO ] [MAIN ] Update Progress: 1525/2366 symbols completed. NRGV took 32.5s. Estimated remaining: 1h 48m 7s. Rate: 7.8 symbols/min [2025-10-21T20:16:07.725970] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T20:16:07.767165] [INFO ] [REMOTE ] NRK: Full fetch complete (27522 records). [2025-10-21T20:16:07.812176] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:07.812496] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-10-21T20:16:07.927444] [DEBUG] [LOCAL ] NRT: Loaded 4894 existing records from primary storage. [2025-10-21T20:16:07.955183] [INFO ] [MAIN ] NRT: Loaded 4894 existing records. [2025-10-21T20:16:08.292585] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T20:16:08.352944] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-10-21T20:16:08.430782] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:16:08.450696] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-21T20:16:08.473709] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-10-21T20:16:08.474397] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-10-21T20:16:08.474703] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-10-21T20:16:08.474624] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-10-21T20:16:08.475473] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-10-21T20:16:08.475417] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-10-21T20:16:08.476054] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-10-21T20:16:08.476005] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-10-21T20:16:08.577923] [DEBUG] [LOCAL ] NRK: Trimmed 27522 records to 20410 (keeping 200 days of data) [2025-10-21T20:16:08.964382] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:08.965503] [DEBUG] [LOCAL ] NRK: Primary data saved (20410 records). [2025-10-21T20:16:08.965626] [INFO ] [MAIN ] NRK: Full history saved. [2025-10-21T20:16:08.965767] [INFO ] [MAIN ] Update Progress: 1526/2366 symbols completed. NRK took 22.8s. Estimated remaining: 1h 47m 56s. Rate: 7.8 symbols/min [2025-10-21T20:16:08.956182] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-10-21T20:16:09.147427] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:09.152632] [DEBUG] [LOCAL ] NRUC: Loaded 3117 existing records from primary storage. [2025-10-21T20:16:09.152859] [INFO ] [MAIN ] NRUC: Loaded 3117 existing records. [2025-10-21T20:16:09.275358] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T20:16:09.355526] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:16:09.355761] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-10-21T20:16:09.355817] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-10-21T20:16:09.355951] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-10-21T20:16:09.355989] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-10-21T20:16:09.708010] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:09.751033] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-10-21T20:16:10.551024] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-10-21T20:16:10.741169] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T20:16:11.106670] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T20:16:11.290132] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T20:16:11.351056] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-10-21T20:16:12.034823] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-21T20:16:12.151060] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-10-21T20:16:12.910488] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T20:16:12.951039] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-10. [2025-10-21T20:16:13.751061] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-10-21T20:16:14.457286] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-21T20:16:14.551084] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-10-21T20:16:14.974459] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-21T20:16:14.982968] [INFO ] [REMOTE ] NRG: Full fetch complete (76808 records). [2025-10-21T20:16:14.983176] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-10-21T20:16:15.286964] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T20:16:15.358301] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-10-21T20:16:15.407876] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-10-21T20:16:15.407950] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-10-21T20:16:15.409078] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-10-21T20:16:15.409140] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-10-21T20:16:15.410479] [DEBUG] [LOCAL ] NRG: Trimmed 76808 records to 52818 (keeping 200 days of data) [2025-10-21T20:16:15.729811] [DEBUG] [LOCAL ] NRG: Primary data saved (52818 records). [2025-10-21T20:16:15.729940] [INFO ] [MAIN ] NRG: Full history saved. [2025-10-21T20:16:15.730008] [INFO ] [MAIN ] Update Progress: 1527/2366 symbols completed. NRG took 42.4s. Estimated remaining: 1h 47m 48s. Rate: 7.8 symbols/min [2025-10-21T20:16:15.898510] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:15.898721] [DEBUG] [LOCAL ] NSA: No existing data file found in primary storage. [2025-10-21T20:16:15.898776] [WARN ] [MAIN ] NSA: No existing data found, performing full refresh instead. [2025-10-21T20:16:15.898909] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-10-21T20:16:15.898961] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-10-21T20:16:15.899002] [DEBUG] [LOCAL ] NSA: No primary data file found to delete. [2025-10-21T20:16:15.899034] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-10-21T20:16:16.153806] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-10-21T20:16:16.216463] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T20:16:16.271286] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:16.950990] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-10. [2025-10-21T20:16:16.991430] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T20:16:17.751060] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-10-21T20:16:17.793975] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T20:16:17.795186] [INFO ] [REMOTE ] NRP: Full fetch complete (6297 records). [2025-10-21T20:16:17.795252] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-10-21T20:16:18.151579] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-10-21T20:16:18.151693] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-10-21T20:16:18.151905] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-10-21T20:16:18.151955] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-10-21T20:16:18.152341] [DEBUG] [LOCAL ] NRP: Trimmed 6297 records to 4194 (keeping 200 days of data) [2025-10-21T20:16:18.178774] [DEBUG] [LOCAL ] NRP: Primary data saved (4194 records). [2025-10-21T20:16:18.178846] [INFO ] [MAIN ] NRP: Full history saved. [2025-10-21T20:16:18.178916] [INFO ] [MAIN ] Update Progress: 1528/2366 symbols completed. NRP took 28.7s. Estimated remaining: 1h 47m 37s. Rate: 7.8 symbols/min [2025-10-21T20:16:18.357741] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:18.357917] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-10-21T20:16:18.357954] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-10-21T20:16:18.358066] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-10-21T20:16:18.358109] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-10-21T20:16:18.358151] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-10-21T20:16:18.358184] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-10-21T20:16:18.439272] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-21T20:16:18.556418] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-10-21T20:16:18.730870] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:19.351060] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-10-21T20:16:19.369011] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T20:16:19.992726] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T20:16:20.151019] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-10-21T20:16:20.926674] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T20:16:20.950999] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-10-21T20:16:21.751039] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-10-21T20:16:21.785795] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T20:16:22.469460] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T20:16:22.551023] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-10-21T20:16:23.351043] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-10-21T20:16:24.151040] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-10-21T20:16:24.174551] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T20:16:24.485476] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T20:16:24.951056] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-10-21T20:16:25.751015] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-10-21T20:16:25.787203] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T20:16:25.851838] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T20:16:26.551060] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-10-21T20:16:27.351111] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-10-21T20:16:27.365619] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T20:16:27.577117] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T20:16:28.151080] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-10-21T20:16:28.730805] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-21T20:16:28.954766] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-10-21T20:16:28.959183] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T20:16:29.751038] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-10-21T20:16:30.551069] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-10. [2025-10-21T20:16:30.986481] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T20:16:31.259422] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T20:16:31.260942] [INFO ] [REMOTE ] NRT: Full fetch complete (7772 records). [2025-10-21T20:16:31.261480] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-10-21T20:16:31.356131] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-10-21T20:16:31.644956] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T20:16:31.676306] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-10-21T20:16:31.677021] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-10-21T20:16:31.677338] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-10-21T20:16:31.677910] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-10-21T20:16:31.678789] [DEBUG] [LOCAL ] NRT: Trimmed 7772 records to 4885 (keeping 200 days of data) [2025-10-21T20:16:31.707234] [DEBUG] [LOCAL ] NRT: Primary data saved (4885 records). [2025-10-21T20:16:31.707594] [INFO ] [MAIN ] NRT: Full history saved. [2025-10-21T20:16:31.707733] [INFO ] [MAIN ] Update Progress: 1529/2366 symbols completed. NRT took 24.1s. Estimated remaining: 1h 47m 33s. Rate: 7.8 symbols/min [2025-10-21T20:16:31.881526] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:31.881741] [DEBUG] [LOCAL ] NSP: No existing data file found in primary storage. [2025-10-21T20:16:31.881787] [WARN ] [MAIN ] NSP: No existing data found, performing full refresh instead. [2025-10-21T20:16:31.881900] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-10-21T20:16:31.881940] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-10-21T20:16:31.881979] [DEBUG] [LOCAL ] NSP: No primary data file found to delete. [2025-10-21T20:16:31.882009] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-10-21T20:16:32.153863] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-10-21T20:16:32.170129] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T20:16:32.259280] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:32.951074] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-10-21T20:16:33.732929] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T20:16:33.750992] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-10-21T20:16:34.204802] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T20:16:34.354271] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-21T20:16:34.551041] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-10-21T20:16:35.351030] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-10. [2025-10-21T20:16:35.927418] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T20:16:35.928810] [INFO ] [REMOTE ] NRUC: Full fetch complete (5025 records). [2025-10-21T20:16:35.928880] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-10-21T20:16:36.163796] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-10-21T20:16:36.199235] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T20:16:36.352704] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-10-21T20:16:36.352818] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-10-21T20:16:36.353079] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-10-21T20:16:36.353126] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-10-21T20:16:36.353537] [DEBUG] [LOCAL ] NRUC: Trimmed 5025 records to 3108 (keeping 200 days of data) [2025-10-21T20:16:36.373168] [DEBUG] [LOCAL ] NRUC: Primary data saved (3108 records). [2025-10-21T20:16:36.373281] [INFO ] [MAIN ] NRUC: Full history saved. [2025-10-21T20:16:36.373377] [INFO ] [MAIN ] Update Progress: 1530/2366 symbols completed. NRUC took 27.4s. Estimated remaining: 1h 47m 23s. Rate: 7.8 symbols/min [2025-10-21T20:16:36.557060] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:36.580798] [DEBUG] [LOCAL ] NTB: Loaded 20386 existing records from primary storage. [2025-10-21T20:16:36.581211] [INFO ] [MAIN ] NTB: Loaded 20386 existing records. [2025-10-21T20:16:36.768841] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:16:36.769144] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-10-21T20:16:36.769200] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-10-21T20:16:36.769422] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-10-21T20:16:36.769463] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-10-21T20:16:36.954960] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-10-21T20:16:37.139888] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:37.751073] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-10-21T20:16:37.975942] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T20:16:38.551101] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-10-21T20:16:38.840508] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T20:16:39.216076] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-21T20:16:39.351001] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-10-21T20:16:40.151009] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-10-21T20:16:40.306864] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T20:16:40.899913] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T20:16:40.950992] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-10-21T20:16:41.751032] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-10-21T20:16:41.813004] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T20:16:42.550996] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-10-21T20:16:42.633056] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T20:16:43.350990] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-10-21T20:16:43.604999] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T20:16:43.739358] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T20:16:44.151065] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-10-21T20:16:44.946995] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T20:16:44.954370] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-10-21T20:16:45.267351] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T20:16:45.751039] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-10-21T20:16:46.551000] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-10-21T20:16:46.828707] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T20:16:47.195294] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T20:16:47.351037] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-10-21T20:16:48.151061] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-10-21T20:16:48.328597] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T20:16:48.882235] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T20:16:48.950986] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-10-21T20:16:49.751015] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-10-21T20:16:50.049777] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T20:16:50.498593] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T20:16:50.551030] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-10-21T20:16:51.351066] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-10-21T20:16:51.488883] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:16:52.151065] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-10-21T20:16:52.329376] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T20:16:52.951023] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-10-21T20:16:53.148611] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T20:16:53.340539] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-21T20:16:53.751146] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-10. [2025-10-21T20:16:54.551019] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-10. [2025-10-21T20:16:54.800345] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T20:16:55.183205] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T20:16:55.189314] [INFO ] [REMOTE ] NSP: Full fetch complete (50204 records). [2025-10-21T20:16:55.189429] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-10-21T20:16:55.363719] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-10-21T20:16:55.597453] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-10-21T20:16:55.597534] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-10-21T20:16:55.598543] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-10-21T20:16:55.598612] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-10-21T20:16:55.599682] [DEBUG] [LOCAL ] NSP: Trimmed 50204 records to 35740 (keeping 200 days of data) [2025-10-21T20:16:55.818213] [DEBUG] [LOCAL ] NSP: Primary data saved (35740 records). [2025-10-21T20:16:55.818348] [INFO ] [MAIN ] NSP: Full history saved. [2025-10-21T20:16:55.818423] [INFO ] [MAIN ] Update Progress: 1531/2366 symbols completed. NSP took 24.1s. Estimated remaining: 1h 47m 22s. Rate: 7.8 symbols/min [2025-10-21T20:16:55.993314] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:55.993466] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-10-21T20:16:55.993503] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-10-21T20:16:55.993615] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-10-21T20:16:55.993686] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-21T20:16:55.993747] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-21T20:16:55.993780] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-10-21T20:16:56.174058] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-10. [2025-10-21T20:16:56.387680] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:56.391255] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T20:16:56.398622] [INFO ] [REMOTE ] NSC: Full fetch complete (70908 records). [2025-10-21T20:16:56.398783] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-10-21T20:16:56.795915] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-10-21T20:16:56.796061] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-10-21T20:16:56.797157] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-10-21T20:16:56.811356] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-10-21T20:16:56.812763] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T20:16:56.820049] [DEBUG] [LOCAL ] NSC: Trimmed 70908 records to 48688 (keeping 200 days of data) [2025-10-21T20:16:56.999709] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-10-21T20:16:57.125128] [DEBUG] [LOCAL ] NSC: Primary data saved (48688 records). [2025-10-21T20:16:57.125260] [INFO ] [MAIN ] NSC: Full history saved. [2025-10-21T20:16:57.125326] [INFO ] [MAIN ] Update Progress: 1532/2366 symbols completed. NSC took 38.9s. Estimated remaining: 1h 47m 11s. Rate: 7.8 symbols/min [2025-10-21T20:16:57.300417] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:57.300605] [DEBUG] [LOCAL ] NTR: No existing data file found in primary storage. [2025-10-21T20:16:57.300682] [WARN ] [MAIN ] NTR: No existing data found, performing full refresh instead. [2025-10-21T20:16:57.300799] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-10-21T20:16:57.300840] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-10-21T20:16:57.300911] [DEBUG] [LOCAL ] NTR: No primary data file found to delete. [2025-10-21T20:16:57.300942] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-10-21T20:16:57.676295] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:57.750991] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-10-21T20:16:57.869973] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T20:16:57.877868] [INFO ] [REMOTE ] NSA: Full fetch complete (62711 records). [2025-10-21T20:16:57.878052] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-10-21T20:16:58.276676] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-10-21T20:16:58.276812] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-10-21T20:16:58.278890] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-10-21T20:16:58.278989] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-10-21T20:16:58.280820] [DEBUG] [LOCAL ] NSA: Trimmed 62711 records to 45119 (keeping 200 days of data) [2025-10-21T20:16:58.399259] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T20:16:58.552698] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-10-21T20:16:58.597488] [DEBUG] [LOCAL ] NSA: Primary data saved (45119 records). [2025-10-21T20:16:58.597625] [INFO ] [MAIN ] NSA: Full history saved. [2025-10-21T20:16:58.597766] [INFO ] [MAIN ] Update Progress: 1533/2366 symbols completed. NSA took 42.9s. Estimated remaining: 1h 46m 60s. Rate: 7.8 symbols/min [2025-10-21T20:16:58.773343] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:16:58.813543] [DEBUG] [LOCAL ] NTST: Loaded 44149 existing records from primary storage. [2025-10-21T20:16:58.813853] [INFO ] [MAIN ] NTST: Loaded 44149 existing records. [2025-10-21T20:16:58.990581] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:16:58.990803] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-10-21T20:16:58.990886] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-10-21T20:16:58.991309] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-10-21T20:16:58.991364] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-10-21T20:16:59.347863] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:16:59.350985] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-10-21T20:16:59.383911] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T20:16:59.385294] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T20:17:00.151103] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-10-21T20:17:00.951011] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-10-21T20:17:01.194226] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T20:17:01.580994] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T20:17:01.751068] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-10-21T20:17:02.423111] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-21T20:17:02.551005] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-10-21T20:17:03.065070] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T20:17:03.122298] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-21T20:17:03.351026] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-10-21T20:17:03.459112] [DEBUG] [REMOTE ] NTEST: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T20:17:03.459456] [WARN ] [REMOTE ] NTEST: No data returned for month 2025-04 [2025-10-21T20:17:03.459546] [FATAL] [REMOTE ] NTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:17:03.459619] [FATAL] [MAIN ] NTEST: Failed to fetch primary data. [2025-10-21T20:17:03.459702] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:17:03.459775] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-10-21T20:17:03.459836] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-10-21T20:17:03.459871] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-10-21T20:17:03.459908] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-10-21T20:17:03.459952] [INFO ] [MAIN ] Update Progress: 1534/2366 symbols completed. NTEST took 7.6s. Estimated remaining: 1h 46m 51s. Rate: 7.8 symbols/min [2025-10-21T20:17:03.637252] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:17:03.637365] [DEBUG] [LOCAL ] NU: No existing data file found in primary storage. [2025-10-21T20:17:03.637401] [WARN ] [MAIN ] NU: No existing data found, performing full refresh instead. [2025-10-21T20:17:03.637504] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-10-21T20:17:03.637544] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-10-21T20:17:03.637583] [DEBUG] [LOCAL ] NU: No primary data file found to delete. [2025-10-21T20:17:03.637615] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-10-21T20:17:03.984512] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:17:04.151030] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-10-21T20:17:04.951074] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-10-21T20:17:05.751096] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-10-21T20:17:06.206733] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T20:17:06.551042] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-10-21T20:17:06.634609] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-21T20:17:07.350997] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-10-21T20:17:07.710160] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-21T20:17:08.138423] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T20:17:08.150981] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-10-21T20:17:08.453568] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T20:17:08.951068] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-10-21T20:17:09.751011] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-10-21T20:17:10.546066] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-21T20:17:10.555628] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-10-21T20:17:10.991578] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T20:17:11.015047] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T20:17:11.351090] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-10-21T20:17:12.151074] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-10. [2025-10-21T20:17:12.299850] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T20:17:12.950998] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-10-21T20:17:13.258322] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T20:17:13.262298] [INFO ] [REMOTE ] NTB: Full fetch complete (30736 records). [2025-10-21T20:17:13.262466] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-10-21T20:17:13.719228] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-10-21T20:17:13.719310] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-10-21T20:17:13.720158] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-10-21T20:17:13.720341] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-10-21T20:17:13.723037] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-21T20:17:13.736856] [DEBUG] [LOCAL ] NTB: Trimmed 30736 records to 20289 (keeping 200 days of data) [2025-10-21T20:17:13.787538] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-10-21T20:17:13.859808] [DEBUG] [LOCAL ] NTB: Primary data saved (20289 records). [2025-10-21T20:17:13.859926] [INFO ] [MAIN ] NTB: Full history saved. [2025-10-21T20:17:13.860001] [INFO ] [MAIN ] Update Progress: 1535/2366 symbols completed. NTB took 37.5s. Estimated remaining: 1h 46m 44s. Rate: 7.8 symbols/min [2025-10-21T20:17:14.052741] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:17:14.052928] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-10-21T20:17:14.052966] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-10-21T20:17:14.053073] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-10-21T20:17:14.053114] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-21T20:17:14.053154] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-21T20:17:14.053185] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-10-21T20:17:14.422941] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:17:14.551025] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-10-21T20:17:14.862755] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T20:17:15.351009] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-10-21T20:17:16.151018] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-10-21T20:17:16.333010] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-21T20:17:16.418214] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T20:17:16.951027] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-10-21T20:17:17.315392] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T20:17:17.751069] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-10-21T20:17:17.845411] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T20:17:18.551087] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-10-21T20:17:19.195256] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-21T20:17:19.350983] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-10-21T20:17:19.554535] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T20:17:20.156190] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-10-21T20:17:20.171926] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T20:17:20.951020] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-10-21T20:17:21.474828] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-21T20:17:21.750987] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-10-21T20:17:22.331052] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T20:17:22.551027] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-10-21T20:17:22.708422] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T20:17:23.351103] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-10-21T20:17:24.151028] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-10-21T20:17:24.267166] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-21T20:17:24.499321] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T20:17:24.683446] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T20:17:24.951023] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-10-21T20:17:25.751058] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-10-21T20:17:26.320590] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-21T20:17:26.551127] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-10-21T20:17:27.034391] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-21T20:17:27.351061] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-10-21T20:17:27.453594] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T20:17:28.151068] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-10. [2025-10-21T20:17:28.409241] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T20:17:28.951099] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-10-21T20:17:29.536637] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-21T20:17:29.751023] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-10. [2025-10-21T20:17:29.890583] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T20:17:29.898009] [INFO ] [REMOTE ] NTST: Full fetch complete (61834 records). [2025-10-21T20:17:29.898135] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-10-21T20:17:30.276244] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-10-21T20:17:30.276320] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-10-21T20:17:30.277300] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-10-21T20:17:30.277361] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-10-21T20:17:30.278556] [DEBUG] [LOCAL ] NTST: Trimmed 61834 records to 44086 (keeping 200 days of data) [2025-10-21T20:17:30.546981] [DEBUG] [LOCAL ] NTST: Primary data saved (44086 records). [2025-10-21T20:17:30.547368] [INFO ] [MAIN ] NTST: Full history saved. [2025-10-21T20:17:30.548211] [INFO ] [MAIN ] Update Progress: 1536/2366 symbols completed. NTST took 32.0s. Estimated remaining: 1h 46m 41s. Rate: 7.8 symbols/min [2025-10-21T20:17:30.580027] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-10. [2025-10-21T20:17:30.719623] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:17:30.719846] [DEBUG] [LOCAL ] NUS: No existing data file found in primary storage. [2025-10-21T20:17:30.719913] [WARN ] [MAIN ] NUS: No existing data found, performing full refresh instead. [2025-10-21T20:17:30.720073] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-10-21T20:17:30.720115] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-10-21T20:17:30.720154] [DEBUG] [LOCAL ] NUS: No primary data file found to delete. [2025-10-21T20:17:30.720185] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-10-21T20:17:31.082772] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:17:31.163113] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T20:17:31.351001] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-10-21T20:17:31.672943] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T20:17:31.681402] [INFO ] [REMOTE ] NTR: Full fetch complete (76516 records). [2025-10-21T20:17:31.681527] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-10-21T20:17:32.094868] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-10-21T20:17:32.094945] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-10-21T20:17:32.096150] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-10-21T20:17:32.096213] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-10-21T20:17:32.097586] [DEBUG] [LOCAL ] NTR: Trimmed 76516 records to 52637 (keeping 200 days of data) [2025-10-21T20:17:32.158703] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-10-21T20:17:32.420260] [DEBUG] [LOCAL ] NTR: Primary data saved (52637 records). [2025-10-21T20:17:32.420426] [INFO ] [MAIN ] NTR: Full history saved. [2025-10-21T20:17:32.420504] [INFO ] [MAIN ] Update Progress: 1537/2366 symbols completed. NTR took 35.3s. Estimated remaining: 1h 46m 31s. Rate: 7.8 symbols/min [2025-10-21T20:17:32.600119] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:17:32.620932] [DEBUG] [LOCAL ] NUV: Loaded 23604 existing records from primary storage. [2025-10-21T20:17:32.621171] [INFO ] [MAIN ] NUV: Loaded 23604 existing records. [2025-10-21T20:17:32.808743] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:17:32.809095] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-10-21T20:17:32.809316] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-10-21T20:17:32.809729] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-10-21T20:17:32.809790] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-10-21T20:17:33.181588] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:17:33.182252] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-10-21T20:17:33.227771] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T20:17:33.236680] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-21T20:17:33.246672] [INFO ] [REMOTE ] NU: Full fetch complete (77925 records). [2025-10-21T20:17:33.246797] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-10-21T20:17:33.642757] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-10-21T20:17:33.642852] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-10-21T20:17:33.643982] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-10-21T20:17:33.644054] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-10-21T20:17:33.645524] [DEBUG] [LOCAL ] NU: Trimmed 77925 records to 53746 (keeping 200 days of data) [2025-10-21T20:17:33.754188] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-10-21T20:17:33.982815] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-10-21T20:17:33.982938] [INFO ] [MAIN ] NU: Full history saved. [2025-10-21T20:17:33.983018] [INFO ] [MAIN ] Update Progress: 1538/2366 symbols completed. NU took 30.5s. Estimated remaining: 1h 46m 20s. Rate: 7.8 symbols/min [2025-10-21T20:17:34.151936] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:17:34.152086] [DEBUG] [LOCAL ] NUVB: No existing data file found in primary storage. [2025-10-21T20:17:34.152121] [WARN ] [MAIN ] NUVB: No existing data found, performing full refresh instead. [2025-10-21T20:17:34.152230] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-10-21T20:17:34.152269] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-10-21T20:17:34.152308] [DEBUG] [LOCAL ] NUVB: No primary data file found to delete. [2025-10-21T20:17:34.152339] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-10-21T20:17:34.501904] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:17:34.533149] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:17:34.556360] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-10-21T20:17:34.570500] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-21T20:17:35.351111] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-10-21T20:17:35.433896] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T20:17:35.894738] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T20:17:36.151050] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-10-21T20:17:36.951013] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-10-21T20:17:37.530213] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T20:17:37.757247] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-10-21T20:17:37.761898] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T20:17:38.537794] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T20:17:38.550982] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-10-21T20:17:39.011554] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T20:17:39.351073] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-10-21T20:17:40.130381] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T20:17:40.151030] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-10-21T20:17:40.609210] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-21T20:17:40.951025] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-10-21T20:17:41.556180] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T20:17:41.751070] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-10-21T20:17:42.551042] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-10-21T20:17:43.102285] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T20:17:43.300520] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T20:17:43.350998] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-10-21T20:17:43.996011] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T20:17:44.151030] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-10-21T20:17:44.823749] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T20:17:44.951016] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-10-21T20:17:45.751028] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-10-21T20:17:45.955840] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T20:17:46.551055] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-10-21T20:17:46.641096] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T20:17:47.081021] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T20:17:47.351067] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-10-21T20:17:48.151115] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-10-21T20:17:48.497173] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T20:17:48.726265] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-21T20:17:48.951011] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-10-21T20:17:49.751009] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-10-21T20:17:49.962437] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T20:17:50.200758] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T20:17:50.551040] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-10-21T20:17:51.351020] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-10-21T20:17:51.576838] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T20:17:52.146561] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T20:17:52.153962] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-10-21T20:17:52.951069] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-10. [2025-10-21T20:17:53.415143] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T20:17:53.751012] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-10-21T20:17:53.779864] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T20:17:54.484446] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T20:17:54.489814] [INFO ] [REMOTE ] NUS: Full fetch complete (53403 records). [2025-10-21T20:17:54.489937] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-10-21T20:17:54.556247] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-10-21T20:17:54.865309] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-10-21T20:17:54.865441] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-10-21T20:17:54.866550] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-10-21T20:17:54.866612] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-10-21T20:17:54.867666] [DEBUG] [LOCAL ] NUS: Trimmed 53403 records to 36101 (keeping 200 days of data) [2025-10-21T20:17:55.082141] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T20:17:55.108187] [DEBUG] [LOCAL ] NUS: Primary data saved (36101 records). [2025-10-21T20:17:55.108296] [INFO ] [MAIN ] NUS: Full history saved. [2025-10-21T20:17:55.108362] [INFO ] [MAIN ] Update Progress: 1539/2366 symbols completed. NUS took 24.6s. Estimated remaining: 1h 46m 19s. Rate: 7.8 symbols/min [2025-10-21T20:17:55.272298] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:17:55.280548] [DEBUG] [LOCAL ] NUW: Loaded 6681 existing records from primary storage. [2025-10-21T20:17:55.280722] [INFO ] [MAIN ] NUW: Loaded 6681 existing records. [2025-10-21T20:17:55.356175] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-10-21T20:17:55.458101] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:17:55.458318] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-10-21T20:17:55.458367] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-10-21T20:17:55.458547] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-10-21T20:17:55.458602] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-10-21T20:17:55.805489] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:17:56.151107] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-10-21T20:17:56.554004] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T20:17:56.707041] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T20:17:56.951023] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-10. [2025-10-21T20:17:57.060925] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T20:17:57.751080] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-10-21T20:17:58.236401] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T20:17:58.240946] [INFO ] [REMOTE ] NUV: Full fetch complete (33794 records). [2025-10-21T20:17:58.241020] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-10-21T20:17:58.561124] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-10. [2025-10-21T20:17:58.611692] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-10-21T20:17:58.611803] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-10-21T20:17:58.612511] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-10-21T20:17:58.612700] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-10-21T20:17:58.613461] [DEBUG] [LOCAL ] NUV: Trimmed 33794 records to 23448 (keeping 200 days of data) [2025-10-21T20:17:58.705890] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T20:17:58.763521] [DEBUG] [LOCAL ] NUV: Primary data saved (23448 records). [2025-10-21T20:17:58.763677] [INFO ] [MAIN ] NUV: Full history saved. [2025-10-21T20:17:58.763773] [INFO ] [MAIN ] Update Progress: 1540/2366 symbols completed. NUV took 26.3s. Estimated remaining: 1h 46m 9s. Rate: 7.8 symbols/min [2025-10-21T20:17:58.928443] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:17:58.957422] [DEBUG] [LOCAL ] NVG: Loaded 27492 existing records from primary storage. [2025-10-21T20:17:58.957718] [INFO ] [MAIN ] NVG: Loaded 27492 existing records. [2025-10-21T20:17:59.132202] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:17:59.132401] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-10-21T20:17:59.132448] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-10-21T20:17:59.132630] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-10-21T20:17:59.132717] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-10-21T20:17:59.362966] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-10-21T20:17:59.492471] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:18:00.151027] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-10-21T20:18:00.701558] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-21T20:18:00.709784] [INFO ] [REMOTE ] NUE: Full fetch complete (74803 records). [2025-10-21T20:18:00.709932] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-10-21T20:18:00.913998] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T20:18:00.914789] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:18:00.914870] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:18:00.914975] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-10-21T20:18:00.915085] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-10-21T20:18:00.915147] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-10-21T20:18:00.915193] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-10-21T20:18:00.915258] [INFO ] [MAIN ] Update Progress: 1541/2366 symbols completed. NUE took 47.1s. Estimated remaining: 1h 45m 58s. Rate: 7.8 symbols/min [2025-10-21T20:18:00.958753] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-10-21T20:18:01.094113] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:18:01.124577] [DEBUG] [LOCAL ] NVGS: Loaded 30187 existing records from primary storage. [2025-10-21T20:18:01.124870] [INFO ] [MAIN ] NVGS: Loaded 30187 existing records. [2025-10-21T20:18:01.305115] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:18:01.305340] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-10-21T20:18:01.305387] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-10-21T20:18:01.305631] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-10-21T20:18:01.305736] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-10-21T20:18:01.672976] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:18:01.735591] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-21T20:18:01.750982] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-10-21T20:18:01.793227] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T20:18:02.005677] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-21T20:18:02.551084] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-10-21T20:18:03.109023] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T20:18:03.191270] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-21T20:18:03.351042] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-10-21T20:18:04.151057] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-10-21T20:18:04.284487] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T20:18:04.951072] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-10-21T20:18:05.751011] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-10-21T20:18:05.901183] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T20:18:06.124085] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T20:18:06.551084] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-10-21T20:18:07.134823] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T20:18:07.351049] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-10-21T20:18:08.151006] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-10-21T20:18:08.254460] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T20:18:08.772709] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T20:18:08.951024] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-10-21T20:18:09.536857] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T20:18:09.751043] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-10-21T20:18:10.252147] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T20:18:10.551029] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-10. [2025-10-21T20:18:11.355224] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-10-21T20:18:11.361842] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T20:18:12.089890] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T20:18:12.150985] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-10-21T20:18:12.716180] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-21T20:18:12.724589] [INFO ] [REMOTE ] NUVB: Full fetch complete (73433 records). [2025-10-21T20:18:12.724764] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-10-21T20:18:12.956156] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-10-21T20:18:13.012817] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T20:18:13.130797] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-10-21T20:18:13.130889] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-10-21T20:18:13.131988] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-10-21T20:18:13.132051] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-10-21T20:18:13.133391] [DEBUG] [LOCAL ] NUVB: Trimmed 73433 records to 51709 (keeping 200 days of data) [2025-10-21T20:18:13.442139] [DEBUG] [LOCAL ] NUVB: Primary data saved (51709 records). [2025-10-21T20:18:13.442319] [INFO ] [MAIN ] NUVB: Full history saved. [2025-10-21T20:18:13.442408] [INFO ] [MAIN ] Update Progress: 1542/2366 symbols completed. NUVB took 39.5s. Estimated remaining: 1h 45m 53s. Rate: 7.8 symbols/min [2025-10-21T20:18:13.620435] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:18:13.671924] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-21T20:18:13.672276] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-10-21T20:18:13.756321] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-10-21T20:18:13.858015] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:18:13.858252] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-10-21T20:18:13.858303] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-10-21T20:18:13.858522] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-10-21T20:18:13.858580] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-10-21T20:18:14.226529] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:18:14.412456] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T20:18:14.551028] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-10. [2025-10-21T20:18:15.186080] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T20:18:15.187197] [INFO ] [REMOTE ] NUW: Full fetch complete (10739 records). [2025-10-21T20:18:15.187284] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-10-21T20:18:15.354425] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-10-21T20:18:15.379952] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T20:18:15.571590] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-10-21T20:18:15.571689] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-10-21T20:18:15.571960] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-10-21T20:18:15.571999] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-10-21T20:18:15.572402] [DEBUG] [LOCAL ] NUW: Trimmed 10739 records to 6674 (keeping 200 days of data) [2025-10-21T20:18:15.611522] [DEBUG] [LOCAL ] NUW: Primary data saved (6674 records). [2025-10-21T20:18:15.611618] [INFO ] [MAIN ] NUW: Full history saved. [2025-10-21T20:18:15.611722] [INFO ] [MAIN ] Update Progress: 1543/2366 symbols completed. NUW took 20.5s. Estimated remaining: 1h 45m 43s. Rate: 7.8 symbols/min [2025-10-21T20:18:15.777096] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:18:15.777247] [DEBUG] [LOCAL ] NVR: No existing data file found in primary storage. [2025-10-21T20:18:15.777282] [WARN ] [MAIN ] NVR: No existing data found, performing full refresh instead. [2025-10-21T20:18:15.777388] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-10-21T20:18:15.777428] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-10-21T20:18:15.777468] [DEBUG] [LOCAL ] NVR: No primary data file found to delete. [2025-10-21T20:18:15.777498] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-10-21T20:18:16.127598] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:18:16.150977] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-10-21T20:18:16.951030] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-10-21T20:18:17.468090] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:18:17.741777] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-21T20:18:17.752594] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-10-21T20:18:18.368843] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T20:18:18.551027] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-10-21T20:18:19.357042] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-10-21T20:18:19.361398] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T20:18:19.500577] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T20:18:20.151078] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-10-21T20:18:20.951017] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-10-21T20:18:21.399341] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T20:18:21.751020] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-10-21T20:18:21.980841] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-21T20:18:22.378893] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T20:18:22.551053] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-10-21T20:18:23.269189] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T20:18:23.351040] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-10-21T20:18:24.151043] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-10-21T20:18:24.737323] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T20:18:24.951071] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-10-21T20:18:25.049602] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-21T20:18:25.641509] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T20:18:25.751103] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-10-21T20:18:25.858037] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T20:18:26.551052] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-10-21T20:18:27.351033] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-10. [2025-10-21T20:18:27.409192] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T20:18:27.727896] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T20:18:28.151011] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-10-21T20:18:28.655511] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T20:18:28.659813] [INFO ] [REMOTE ] NVG: Full fetch complete (39546 records). [2025-10-21T20:18:28.659898] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-10-21T20:18:28.956205] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-10-21T20:18:29.032345] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-10-21T20:18:29.032415] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-10-21T20:18:29.033355] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-10-21T20:18:29.033431] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-10-21T20:18:29.034232] [DEBUG] [LOCAL ] NVG: Trimmed 39546 records to 27482 (keeping 200 days of data) [2025-10-21T20:18:29.196860] [DEBUG] [LOCAL ] NVG: Primary data saved (27482 records). [2025-10-21T20:18:29.197003] [INFO ] [MAIN ] NVG: Full history saved. [2025-10-21T20:18:29.197087] [INFO ] [MAIN ] Update Progress: 1544/2366 symbols completed. NVG took 30.4s. Estimated remaining: 1h 45m 38s. Rate: 7.8 symbols/min [2025-10-21T20:18:29.365374] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:18:29.365576] [DEBUG] [LOCAL ] NVRI: No existing data file found in primary storage. [2025-10-21T20:18:29.365631] [WARN ] [MAIN ] NVRI: No existing data found, performing full refresh instead. [2025-10-21T20:18:29.365758] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-10-21T20:18:29.365799] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-10-21T20:18:29.365839] [DEBUG] [LOCAL ] NVRI: No primary data file found to delete. [2025-10-21T20:18:29.365870] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-10-21T20:18:29.714267] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:18:29.751025] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-10-21T20:18:30.551067] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-10-21T20:18:30.716069] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T20:18:30.794555] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T20:18:30.981954] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-10-21T20:18:31.351032] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-10-21T20:18:31.919236] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-21T20:18:32.151049] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-10-21T20:18:32.836728] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T20:18:32.951006] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-10-21T20:18:33.751031] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-10-21T20:18:34.373798] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T20:18:34.551022] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-10-21T20:18:35.136463] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-10-21T20:18:35.350993] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-10-21T20:18:35.514320] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T20:18:35.755352] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T20:18:36.133252] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T20:18:36.150973] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-10-21T20:18:36.951021] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-10. [2025-10-21T20:18:37.251350] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T20:18:37.751041] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-10. [2025-10-21T20:18:38.240172] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T20:18:38.244991] [INFO ] [REMOTE ] NVGS: Full fetch complete (41959 records). [2025-10-21T20:18:38.245118] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-10-21T20:18:38.556225] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-10-21T20:18:38.679967] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-10-21T20:18:38.680076] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-10-21T20:18:38.681255] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-10-21T20:18:38.681331] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-10-21T20:18:38.682381] [DEBUG] [LOCAL ] NVGS: Trimmed 41959 records to 30102 (keeping 200 days of data) [2025-10-21T20:18:38.878844] [DEBUG] [LOCAL ] NVGS: Primary data saved (30102 records). [2025-10-21T20:18:38.879024] [INFO ] [MAIN ] NVGS: Full history saved. [2025-10-21T20:18:38.879121] [INFO ] [MAIN ] Update Progress: 1545/2366 symbols completed. NVGS took 38.0s. Estimated remaining: 1h 45m 31s. Rate: 7.8 symbols/min [2025-10-21T20:18:39.039330] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T20:18:39.073279] [INFO ] [REMOTE ] NVR: Full fetch complete (29221 records). [2025-10-21T20:18:39.094207] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:18:39.094317] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-10-21T20:18:39.359566] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-10-21T20:18:39.456880] [DEBUG] [LOCAL ] NVS: Loaded 51400 existing records from primary storage. [2025-10-21T20:18:39.475172] [INFO ] [MAIN ] NVS: Loaded 51400 existing records. [2025-10-21T20:18:39.582704] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-10-21T20:18:39.593296] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-10-21T20:18:39.601792] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-10-21T20:18:39.604372] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-10-21T20:18:39.644012] [DEBUG] [LOCAL ] NVR: Trimmed 29221 records to 18543 (keeping 200 days of data) [2025-10-21T20:18:39.685326] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:18:39.740013] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-10-21T20:18:39.764560] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-10-21T20:18:39.765953] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-10-21T20:18:39.766258] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-10-21T20:18:39.986939] [DEBUG] [LOCAL ] NVR: Primary data saved (18543 records). [2025-10-21T20:18:40.022544] [INFO ] [MAIN ] NVR: Full history saved. [2025-10-21T20:18:40.054414] [INFO ] [MAIN ] Update Progress: 1546/2366 symbols completed. NVR took 24.4s. Estimated remaining: 1h 45m 20s. Rate: 7.8 symbols/min [2025-10-21T20:18:40.303406] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:18:40.303771] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-10-21T20:18:40.361368] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:18:40.361522] [DEBUG] [LOCAL ] NVST: No existing data file found in primary storage. [2025-10-21T20:18:40.361560] [WARN ] [MAIN ] NVST: No existing data found, performing full refresh instead. [2025-10-21T20:18:40.361692] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-10-21T20:18:40.361747] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-10-21T20:18:40.361790] [DEBUG] [LOCAL ] NVST: No primary data file found to delete. [2025-10-21T20:18:40.361824] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-10-21T20:18:40.747951] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:18:40.951081] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-10-21T20:18:41.106944] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T20:18:41.354924] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-10-21T20:18:41.751388] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-10-21T20:18:41.910598] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T20:18:42.551117] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-10-21T20:18:42.937343] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T20:18:43.331392] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T20:18:43.351007] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-10-21T20:18:44.151014] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-10-21T20:18:44.214360] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T20:18:44.951029] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-10-21T20:18:44.979506] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T20:18:45.751066] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-10-21T20:18:46.551057] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-10-21T20:18:47.126801] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-21T20:18:47.183241] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (3.03 seconds). [2025-10-21T20:18:47.235483] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T20:18:47.351029] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-10-21T20:18:48.151070] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-10-21T20:18:48.601225] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T20:18:48.843503] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T20:18:48.951043] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-10-21T20:18:49.751037] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-10-21T20:18:50.551059] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-10-21T20:18:50.703074] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T20:18:50.842171] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-21T20:18:51.224189] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T20:18:51.351080] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-10-21T20:18:52.151016] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-10-21T20:18:52.649811] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T20:18:52.792868] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T20:18:52.951035] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-10-21T20:18:53.751056] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-10-21T20:18:54.550988] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-10-21T20:18:54.635324] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T20:18:54.803050] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-10-21T20:18:55.351096] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-10-21T20:18:55.655201] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T20:18:56.151037] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-10-21T20:18:56.529124] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T20:18:56.951032] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-10-21T20:18:57.751031] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-10. [2025-10-21T20:18:57.990830] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T20:18:58.109616] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-21T20:18:58.551028] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-10. [2025-10-21T20:18:59.004004] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T20:18:59.314245] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T20:18:59.322094] [INFO ] [REMOTE ] NVRI: Full fetch complete (56133 records). [2025-10-21T20:18:59.322341] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-10-21T20:18:59.356203] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-10-21T20:18:59.725272] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-10-21T20:18:59.725380] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-10-21T20:18:59.726893] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-10-21T20:18:59.726958] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-10-21T20:18:59.728705] [DEBUG] [LOCAL ] NVRI: Trimmed 56133 records to 39040 (keeping 200 days of data) [2025-10-21T20:18:59.969580] [DEBUG] [LOCAL ] NVRI: Primary data saved (39040 records). [2025-10-21T20:18:59.969837] [INFO ] [MAIN ] NVRI: Full history saved. [2025-10-21T20:18:59.969939] [INFO ] [MAIN ] Update Progress: 1547/2366 symbols completed. NVRI took 30.8s. Estimated remaining: 1h 45m 19s. Rate: 7.8 symbols/min [2025-10-21T20:19:00.155387] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-10-21T20:19:00.157302] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:00.158829] [DEBUG] [LOCAL ] NVT: No existing data file found in primary storage. [2025-10-21T20:19:00.158902] [WARN ] [MAIN ] NVT: No existing data found, performing full refresh instead. [2025-10-21T20:19:00.159077] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-10-21T20:19:00.159149] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-10-21T20:19:00.159241] [DEBUG] [LOCAL ] NVT: No primary data file found to delete. [2025-10-21T20:19:00.159313] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-10-21T20:19:00.551853] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:00.951043] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-10-21T20:19:01.668078] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-10 (3.12 seconds). [2025-10-21T20:19:01.678283] [INFO ] [REMOTE ] NVO: Full fetch complete (77964 records). [2025-10-21T20:19:01.678552] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-10-21T20:19:02.226578] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-10-21T20:19:02.243814] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-10-21T20:19:02.250274] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-10-21T20:19:02.250404] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-10-21T20:19:02.256157] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-21T20:19:02.269759] [DEBUG] [LOCAL ] NVO: Trimmed 77964 records to 53784 (keeping 200 days of data) [2025-10-21T20:19:02.270925] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-10-21T20:19:02.409024] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-21T20:19:02.557630] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-10-21T20:19:02.693662] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-10-21T20:19:02.693887] [INFO ] [MAIN ] NVO: Full history saved. [2025-10-21T20:19:02.694752] [INFO ] [MAIN ] Update Progress: 1548/2366 symbols completed. NVO took 49.3s. Estimated remaining: 1h 45m 9s. Rate: 7.8 symbols/min [2025-10-21T20:19:02.890555] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:02.890844] [DEBUG] [LOCAL ] NWG: No existing data file found in primary storage. [2025-10-21T20:19:02.890930] [WARN ] [MAIN ] NWG: No existing data found, performing full refresh instead. [2025-10-21T20:19:02.891193] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-10-21T20:19:02.891284] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-10-21T20:19:02.891371] [DEBUG] [LOCAL ] NWG: No primary data file found to delete. [2025-10-21T20:19:02.891453] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-10-21T20:19:03.321610] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:03.326473] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-21T20:19:03.351044] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-10-21T20:19:04.143163] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T20:19:04.154072] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-10-21T20:19:04.283300] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-21T20:19:04.951011] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-10. [2025-10-21T20:19:05.145009] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T20:19:05.635086] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T20:19:05.751036] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-10-21T20:19:06.551034] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-10-21T20:19:06.620326] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T20:19:06.629330] [INFO ] [REMOTE ] NVST: Full fetch complete (74432 records). [2025-10-21T20:19:06.629512] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-10-21T20:19:07.046333] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-10-21T20:19:07.046445] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-10-21T20:19:07.048092] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-10-21T20:19:07.048202] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-10-21T20:19:07.050177] [DEBUG] [LOCAL ] NVST: Trimmed 74432 records to 51463 (keeping 200 days of data) [2025-10-21T20:19:07.355935] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-10-21T20:19:07.396332] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T20:19:07.428050] [DEBUG] [LOCAL ] NVST: Primary data saved (51463 records). [2025-10-21T20:19:07.428268] [INFO ] [MAIN ] NVST: Full history saved. [2025-10-21T20:19:07.428364] [INFO ] [MAIN ] Update Progress: 1549/2366 symbols completed. NVST took 27.4s. Estimated remaining: 1h 44m 59s. Rate: 7.8 symbols/min [2025-10-21T20:19:07.627532] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:07.627904] [DEBUG] [LOCAL ] NWN: No existing data file found in primary storage. [2025-10-21T20:19:07.627956] [WARN ] [MAIN ] NWN: No existing data found, performing full refresh instead. [2025-10-21T20:19:07.628099] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-10-21T20:19:07.628141] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-10-21T20:19:07.628181] [DEBUG] [LOCAL ] NWN: No primary data file found to delete. [2025-10-21T20:19:07.628213] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-10-21T20:19:07.996777] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:08.116176] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T20:19:08.151003] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-10-21T20:19:08.951004] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-10-21T20:19:09.507826] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T20:19:09.601982] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-21T20:19:09.751110] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-10. [2025-10-21T20:19:10.551032] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-10-21T20:19:10.921120] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T20:19:11.351084] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-10-21T20:19:11.722365] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T20:19:11.731574] [INFO ] [REMOTE ] NVS: Full fetch complete (74998 records). [2025-10-21T20:19:11.731783] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-10-21T20:19:12.146175] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-10-21T20:19:12.146285] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-10-21T20:19:12.148339] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-10-21T20:19:12.148413] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-10-21T20:19:12.150382] [DEBUG] [LOCAL ] NVS: Trimmed 74998 records to 51339 (keeping 200 days of data) [2025-10-21T20:19:12.151250] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-10-21T20:19:12.504212] [DEBUG] [LOCAL ] NVS: Primary data saved (51339 records). [2025-10-21T20:19:12.504602] [INFO ] [MAIN ] NVS: Full history saved. [2025-10-21T20:19:12.505891] [INFO ] [MAIN ] Update Progress: 1550/2366 symbols completed. NVS took 33.6s. Estimated remaining: 1h 44m 50s. Rate: 7.8 symbols/min [2025-10-21T20:19:12.642820] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T20:19:12.758511] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:12.758865] [DEBUG] [LOCAL ] NX: No existing data file found in primary storage. [2025-10-21T20:19:12.758919] [WARN ] [MAIN ] NX: No existing data found, performing full refresh instead. [2025-10-21T20:19:12.759095] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-10-21T20:19:12.759138] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-10-21T20:19:12.759179] [DEBUG] [LOCAL ] NX: No primary data file found to delete. [2025-10-21T20:19:12.759212] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-10-21T20:19:12.952964] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-10-21T20:19:13.165490] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:13.414462] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T20:19:13.485921] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T20:19:13.751079] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-10-21T20:19:14.551019] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-10-21T20:19:14.961318] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T20:19:15.075966] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:19:15.351057] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-10-21T20:19:16.151057] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-10-21T20:19:16.317709] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T20:19:16.874033] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T20:19:16.951021] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-10-21T20:19:17.751026] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-10-21T20:19:17.853240] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T20:19:18.551057] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-10-21T20:19:18.861083] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T20:19:19.351025] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-10-21T20:19:19.624484] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T20:19:19.900969] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T20:19:20.151068] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-10-21T20:19:20.951033] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-10-21T20:19:21.408002] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T20:19:21.624358] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T20:19:21.751076] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-10-21T20:19:22.205568] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T20:19:22.551093] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-10-21T20:19:23.351057] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-10-21T20:19:23.662099] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T20:19:24.063918] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T20:19:24.151119] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-10-21T20:19:24.951042] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-10-21T20:19:25.309004] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T20:19:25.751065] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-10-21T20:19:25.991475] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:19:26.508711] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T20:19:26.551042] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-10-21T20:19:27.194450] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T20:19:27.351103] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-10. [2025-10-21T20:19:27.976227] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T20:19:28.151123] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-10-21T20:19:28.951059] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-10-21T20:19:29.155295] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T20:19:29.164065] [INFO ] [REMOTE ] NWG: Full fetch complete (74067 records). [2025-10-21T20:19:29.164253] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-10-21T20:19:29.589097] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-10-21T20:19:29.589213] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-10-21T20:19:29.591210] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-10-21T20:19:29.591280] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-10-21T20:19:29.593217] [DEBUG] [LOCAL ] NWG: Trimmed 74067 records to 51412 (keeping 200 days of data) [2025-10-21T20:19:29.719462] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T20:19:29.752090] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-10-21T20:19:29.970880] [DEBUG] [LOCAL ] NWG: Primary data saved (51412 records). [2025-10-21T20:19:29.971089] [INFO ] [MAIN ] NWG: Full history saved. [2025-10-21T20:19:29.971180] [INFO ] [MAIN ] Update Progress: 1551/2366 symbols completed. NWG took 27.3s. Estimated remaining: 1h 44m 48s. Rate: 7.8 symbols/min [2025-10-21T20:19:30.158231] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:30.164968] [DEBUG] [LOCAL ] NXC: Loaded 4121 existing records from primary storage. [2025-10-21T20:19:30.165282] [INFO ] [MAIN ] NXC: Loaded 4121 existing records. [2025-10-21T20:19:30.349911] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:19:30.350222] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-10-21T20:19:30.350273] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-10-21T20:19:30.350555] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-10-21T20:19:30.350614] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-10-21T20:19:30.576533] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-10-21T20:19:30.741457] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:31.086537] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-21T20:19:31.190562] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T20:19:31.351065] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-10-21T20:19:31.851137] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T20:19:32.151079] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-10-21T20:19:32.776079] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T20:19:32.888019] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T20:19:32.951048] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-10-21T20:19:33.720748] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T20:19:33.751103] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-10-21T20:19:34.551109] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-10-21T20:19:35.220405] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-21T20:19:35.361371] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-10-21T20:19:35.394439] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T20:19:36.151128] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-10. [2025-10-21T20:19:36.691880] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T20:19:36.951030] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-10. [2025-10-21T20:19:37.751069] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-10-21T20:19:38.065349] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T20:19:38.074742] [INFO ] [REMOTE ] NVT: Full fetch complete (74876 records). [2025-10-21T20:19:38.074963] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-10-21T20:19:38.497995] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-10-21T20:19:38.498229] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-10-21T20:19:38.500324] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-10-21T20:19:38.516144] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-10-21T20:19:38.518730] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T20:19:38.525889] [INFO ] [REMOTE ] NX: Full fetch complete (48199 records). [2025-10-21T20:19:38.526093] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-10-21T20:19:38.526368] [DEBUG] [LOCAL ] NVT: Trimmed 74876 records to 51413 (keeping 200 days of data) [2025-10-21T20:19:38.562705] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-10-21T20:19:39.226122] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-10-21T20:19:39.227951] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-10-21T20:19:39.240553] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-10-21T20:19:39.254595] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-10-21T20:19:39.287882] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T20:19:39.326626] [DEBUG] [LOCAL ] NX: Trimmed 48199 records to 33386 (keeping 200 days of data) [2025-10-21T20:19:39.349140] [DEBUG] [LOCAL ] NVT: Primary data saved (51413 records). [2025-10-21T20:19:39.349352] [INFO ] [MAIN ] NVT: Full history saved. [2025-10-21T20:19:39.349443] [INFO ] [MAIN ] Update Progress: 1552/2366 symbols completed. NVT took 39.4s. Estimated remaining: 1h 44m 41s. Rate: 7.8 symbols/min [2025-10-21T20:19:39.415536] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-10. [2025-10-21T20:19:39.572961] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T20:19:39.689415] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:39.694456] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-10-21T20:19:39.694507] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-10-21T20:19:39.694637] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-10-21T20:19:39.694722] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-21T20:19:39.694771] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-21T20:19:39.694810] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-10-21T20:19:39.887309] [DEBUG] [LOCAL ] NX: Primary data saved (33386 records). [2025-10-21T20:19:39.893570] [INFO ] [MAIN ] NX: Full history saved. [2025-10-21T20:19:39.898878] [INFO ] [MAIN ] Update Progress: 1553/2366 symbols completed. NX took 27.4s. Estimated remaining: 1h 44m 29s. Rate: 7.8 symbols/min [2025-10-21T20:19:40.164267] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-10-21T20:19:40.240434] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:40.354915] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:40.361088] [DEBUG] [LOCAL ] NXDT: Loaded 14961 existing records from primary storage. [2025-10-21T20:19:40.361272] [INFO ] [MAIN ] NXDT: Loaded 14961 existing records. [2025-10-21T20:19:40.540841] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:19:40.541122] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-10-21T20:19:40.541204] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-10-21T20:19:40.541436] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-10-21T20:19:40.541492] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-10-21T20:19:40.935859] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T20:19:40.944811] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T20:19:40.935006] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:40.948607] [INFO ] [REMOTE ] NWN: Full fetch complete (37316 records). [2025-10-21T20:19:40.949057] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-10-21T20:19:40.956152] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-10-21T20:19:41.349833] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-10-21T20:19:41.349957] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-10-21T20:19:41.351271] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-10-21T20:19:41.351338] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-10-21T20:19:41.353075] [DEBUG] [LOCAL ] NWN: Trimmed 37316 records to 26539 (keeping 200 days of data) [2025-10-21T20:19:41.355309] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:19:41.422113] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-10-21T20:19:41.423182] [FATAL] [REMOTE ] NXDR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:19:41.457882] [FATAL] [MAIN ] NXDR: Failed to fetch primary data. [2025-10-21T20:19:41.466676] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:19:41.475130] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-10-21T20:19:41.475247] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-10-21T20:19:41.481083] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-10-21T20:19:41.482829] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-10-21T20:19:41.484466] [INFO ] [MAIN ] Update Progress: 1554/2366 symbols completed. NXDR took 2.1s. Estimated remaining: 1h 44m 18s. Rate: 7.8 symbols/min [2025-10-21T20:19:41.690256] [DEBUG] [LOCAL ] NWN: Primary data saved (26539 records). [2025-10-21T20:19:41.701045] [INFO ] [MAIN ] NWN: Full history saved. [2025-10-21T20:19:41.720971] [INFO ] [MAIN ] Update Progress: 1555/2366 symbols completed. NWN took 34.3s. Estimated remaining: 1h 44m 7s. Rate: 7.8 symbols/min [2025-10-21T20:19:41.756428] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-10-21T20:19:41.837773] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:41.861592] [DEBUG] [LOCAL ] NXE: No existing data file found in primary storage. [2025-10-21T20:19:41.870747] [WARN ] [MAIN ] NXE: No existing data found, performing full refresh instead. [2025-10-21T20:19:41.874206] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-10-21T20:19:41.874567] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-10-21T20:19:41.885195] [DEBUG] [LOCAL ] NXE: No primary data file found to delete. [2025-10-21T20:19:41.885288] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-10-21T20:19:42.046426] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:42.237049] [DEBUG] [LOCAL ] NXG: Loaded 10497 existing records from primary storage. [2025-10-21T20:19:42.253499] [INFO ] [MAIN ] NXG: Loaded 10497 existing records. [2025-10-21T20:19:42.512746] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:42.547233] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:19:42.547475] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-10-21T20:19:42.547526] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-10-21T20:19:42.547797] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-10-21T20:19:42.547855] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-10-21T20:19:42.559101] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-10-21T20:19:42.924731] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:42.985386] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T20:19:43.307836] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T20:19:43.351180] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-10-21T20:19:44.106134] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T20:19:44.151005] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-10-21T20:19:44.951051] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-10-21T20:19:45.092278] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T20:19:45.710111] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T20:19:45.751066] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-10-21T20:19:46.551080] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-10-21T20:19:47.351063] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-10-21T20:19:47.677785] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T20:19:47.730541] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T20:19:48.151024] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-10-21T20:19:48.251226] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T20:19:48.951091] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-10-21T20:19:49.649292] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T20:19:49.751012] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-10. [2025-10-21T20:19:50.019163] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T20:19:50.458423] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T20:19:50.459423] [INFO ] [REMOTE ] NXC: Full fetch complete (5608 records). [2025-10-21T20:19:50.459491] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-10-21T20:19:50.556515] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-10-21T20:19:50.820535] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-10-21T20:19:50.820663] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-10-21T20:19:50.820861] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-10-21T20:19:50.820902] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-10-21T20:19:50.821292] [DEBUG] [LOCAL ] NXC: Trimmed 5608 records to 4031 (keeping 200 days of data) [2025-10-21T20:19:50.845894] [DEBUG] [LOCAL ] NXC: Primary data saved (4031 records). [2025-10-21T20:19:50.846005] [INFO ] [MAIN ] NXC: Full history saved. [2025-10-21T20:19:50.846085] [INFO ] [MAIN ] Update Progress: 1556/2366 symbols completed. NXC took 20.9s. Estimated remaining: 1h 43m 60s. Rate: 7.8 symbols/min [2025-10-21T20:19:51.015725] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:19:51.032010] [DEBUG] [LOCAL ] NXJ: Loaded 14894 existing records from primary storage. [2025-10-21T20:19:51.032242] [INFO ] [MAIN ] NXJ: Loaded 14894 existing records. [2025-10-21T20:19:51.210386] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:19:51.210605] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-10-21T20:19:51.210696] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-10-21T20:19:51.210907] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-10-21T20:19:51.210961] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-10-21T20:19:51.358081] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-10-21T20:19:51.527240] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T20:19:51.593745] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:19:52.151039] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-10-21T20:19:52.796217] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T20:19:52.951014] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-10-21T20:19:53.750986] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-10-21T20:19:53.930761] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T20:19:54.276477] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-21T20:19:54.551036] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-10-21T20:19:55.135603] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T20:19:55.351055] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-10-21T20:19:55.491817] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T20:19:56.151050] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-10-21T20:19:56.420211] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T20:19:56.951057] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-10-21T20:19:57.060774] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T20:19:57.751090] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-10-21T20:19:58.551104] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-10-21T20:19:58.645568] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T20:19:58.899735] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T20:19:59.351002] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-10-21T20:19:59.417698] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T20:20:00.151031] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-10-21T20:20:00.391803] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T20:20:00.951036] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-10-21T20:20:01.751086] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-10-21T20:20:02.551106] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-10-21T20:20:02.869242] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-21T20:20:02.941908] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T20:20:03.351079] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-10-21T20:20:03.695369] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T20:20:04.151022] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-10-21T20:20:04.672888] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T20:20:04.856674] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-21T20:20:04.950996] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-10-21T20:20:05.108960] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-21T20:20:05.751037] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-10-21T20:20:06.551045] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-10-21T20:20:06.866118] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T20:20:06.961849] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-21T20:20:07.351036] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-10-21T20:20:07.542562] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T20:20:08.151020] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-10-21T20:20:08.558418] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T20:20:08.951007] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-10-21T20:20:09.325800] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T20:20:09.751067] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-10-21T20:20:10.098800] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-21T20:20:10.551043] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-10-21T20:20:11.351053] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-10-21T20:20:11.741559] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T20:20:11.951159] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-21T20:20:12.151076] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-10-21T20:20:12.351552] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T20:20:12.951016] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-10. [2025-10-21T20:20:13.180189] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T20:20:13.751085] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-10-21T20:20:14.015609] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T20:20:14.017925] [INFO ] [REMOTE ] NXJ: Full fetch complete (20270 records). [2025-10-21T20:20:14.018005] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-10-21T20:20:14.383733] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-10-21T20:20:14.383817] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-10-21T20:20:14.384293] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-10-21T20:20:14.384354] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-10-21T20:20:14.384989] [DEBUG] [LOCAL ] NXJ: Trimmed 20270 records to 14817 (keeping 200 days of data) [2025-10-21T20:20:14.474202] [DEBUG] [LOCAL ] NXJ: Primary data saved (14817 records). [2025-10-21T20:20:14.474335] [INFO ] [MAIN ] NXJ: Full history saved. [2025-10-21T20:20:14.474410] [INFO ] [MAIN ] Update Progress: 1557/2366 symbols completed. NXJ took 23.6s. Estimated remaining: 1h 44m 0s. Rate: 7.8 symbols/min [2025-10-21T20:20:14.551024] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-10. [2025-10-21T20:20:15.351015] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-10. [2025-10-21T20:20:15.752793] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T20:20:15.779981] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T20:20:15.782457] [INFO ] [REMOTE ] NXDT: Full fetch complete (24188 records). [2025-10-21T20:20:15.782535] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-10-21T20:20:16.149450] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T20:20:16.183030] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-10-21T20:20:16.189742] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-10-21T20:20:16.189991] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-10-21T20:20:16.190088] [INFO ] [REMOTE ] NXG: Full fetch complete (14688 records). [2025-10-21T20:20:16.190683] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-10-21T20:20:16.190809] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-10-21T20:20:16.190899] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-10-21T20:20:16.236324] [DEBUG] [LOCAL ] NXDT: Trimmed 24188 records to 14863 (keeping 200 days of data) [2025-10-21T20:20:16.455988] [DEBUG] [LOCAL ] NXDT: Primary data saved (14863 records). [2025-10-21T20:20:16.507505] [INFO ] [MAIN ] NXDT: Full history saved. [2025-10-21T20:20:16.539680] [INFO ] [MAIN ] Update Progress: 1558/2366 symbols completed. NXDT took 36.6s. Estimated remaining: 1h 43m 50s. Rate: 7.8 symbols/min [2025-10-21T20:20:16.644984] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-10-21T20:20:16.645057] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-10-21T20:20:16.645366] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-10-21T20:20:16.645405] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-10-21T20:20:16.645914] [DEBUG] [LOCAL ] NXG: Trimmed 14688 records to 10499 (keeping 200 days of data) [2025-10-21T20:20:16.707891] [DEBUG] [LOCAL ] NXG: Primary data saved (10499 records). [2025-10-21T20:20:16.708018] [INFO ] [MAIN ] NXG: Full history saved. [2025-10-21T20:20:16.708097] [INFO ] [MAIN ] Update Progress: 1559/2366 symbols completed. NXG took 35.0s. Estimated remaining: 1h 43m 38s. Rate: 7.8 symbols/min [2025-10-21T20:20:18.262067] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-21T20:20:18.273532] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-10. [2025-10-21T20:20:20.421051] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-21T20:20:20.430348] [INFO ] [REMOTE ] NXE: Full fetch complete (76943 records). [2025-10-21T20:20:20.430563] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-10-21T20:20:20.822923] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-10-21T20:20:20.823009] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-10-21T20:20:20.824099] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-10-21T20:20:20.824162] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-10-21T20:20:20.825530] [DEBUG] [LOCAL ] NXE: Trimmed 76943 records to 53062 (keeping 200 days of data) [2025-10-21T20:20:21.120430] [DEBUG] [LOCAL ] NXE: Primary data saved (53062 records). [2025-10-21T20:20:21.120562] [INFO ] [MAIN ] NXE: Full history saved. [2025-10-21T20:20:21.120632] [INFO ] [MAIN ] Update Progress: 1560/2366 symbols completed. NXE took 39.6s. Estimated remaining: 1h 43m 29s. Rate: 7.8 symbols/min [2025-10-21T20:20:21.850440] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:20:21.825878] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:20:21.860274] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:20:21.869487] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-10-21T20:20:21.888054] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-10-21T20:20:21.887857] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:20:21.888247] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-10-21T20:20:21.888664] [DEBUG] [LOCAL ] NXRT: No existing data file found in primary storage. [2025-10-21T20:20:21.888763] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-21T20:20:21.888956] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-21T20:20:21.889001] [WARN ] [MAIN ] NXRT: No existing data found, performing full refresh instead. [2025-10-21T20:20:21.889151] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-10-21T20:20:21.901343] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-10-21T20:20:21.930573] [DEBUG] [LOCAL ] NXN: Loaded 2284 existing records from primary storage. [2025-10-21T20:20:21.930384] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-10-21T20:20:21.949566] [DEBUG] [LOCAL ] NXRT: No primary data file found to delete. [2025-10-21T20:20:21.961977] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-10-21T20:20:21.958612] [INFO ] [MAIN ] NXN: Loaded 2284 existing records. [2025-10-21T20:20:22.124388] [DEBUG] [LOCAL ] NXP: Loaded 12235 existing records from primary storage. [2025-10-21T20:20:22.151385] [INFO ] [MAIN ] NXP: Loaded 12235 existing records. [2025-10-21T20:20:22.545768] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:20:22.668903] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-10-21T20:20:22.842252] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-10-21T20:20:22.822719] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:20:22.935033] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:20:22.932002] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-10-21T20:20:22.930964] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-10-21T20:20:22.957058] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-10-21T20:20:22.957139] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-10-21T20:20:22.957235] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-10-21T20:20:22.996160] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-10-21T20:20:23.023764] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-10-21T20:20:23.259859] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:20:23.270676] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-10-21T20:20:23.680138] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-21T20:20:23.687070] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-10-21T20:20:23.829934] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:20:23.860981] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-10-21T20:20:23.888764] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:20:23.889108] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-10-21T20:20:24.289073] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T20:20:24.290490] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-10-21T20:20:24.371771] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T20:20:24.374965] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-10-21T20:20:24.494839] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T20:20:24.496461] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-10-21T20:20:24.860931] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-21T20:20:24.863374] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-10-21T20:20:24.908264] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T20:20:24.951045] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-10-21T20:20:25.263392] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T20:20:25.510228] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T20:20:25.611610] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T20:20:25.750987] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-10-21T20:20:25.829796] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T20:20:26.551026] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-10-21T20:20:27.113594] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T20:20:27.167857] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-21T20:20:27.351026] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-10-21T20:20:27.927175] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T20:20:28.151052] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-10-21T20:20:28.951084] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-10-21T20:20:29.415008] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T20:20:29.751116] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-10-21T20:20:29.830782] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T20:20:30.551011] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-10-21T20:20:30.928432] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T20:20:31.351029] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-10-21T20:20:31.770921] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T20:20:32.150998] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-10-21T20:20:32.636968] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T20:20:32.766253] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T20:20:32.951060] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-10-21T20:20:33.751053] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-10-21T20:20:34.169100] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T20:20:34.551079] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-10-21T20:20:34.607719] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T20:20:35.040406] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T20:20:35.351024] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-10-21T20:20:35.788992] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T20:20:36.151049] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-10-21T20:20:36.951034] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-10-21T20:20:37.094497] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T20:20:37.751101] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-10-21T20:20:38.272323] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T20:20:38.272191] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T20:20:38.551055] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-10-21T20:20:39.250093] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T20:20:39.351043] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-10-21T20:20:39.990923] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T20:20:40.151118] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-10. [2025-10-21T20:20:40.683690] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-21T20:20:40.684542] [INFO ] [REMOTE ] NYC: Full fetch complete (1854 records). [2025-10-21T20:20:40.684610] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-10-21T20:20:40.871193] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-21T20:20:40.871373] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:20:40.871488] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:20:40.871556] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-10-21T20:20:40.871617] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-10-21T20:20:40.871681] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-10-21T20:20:40.871742] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-10-21T20:20:40.871797] [INFO ] [MAIN ] Update Progress: 1561/2366 symbols completed. NYC took 19.7s. Estimated remaining: 1h 43m 27s. Rate: 7.8 symbols/min [2025-10-21T20:20:40.956283] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-10-21T20:20:41.039559] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:20:41.039744] [DEBUG] [LOCAL ] NYT: No existing data file found in primary storage. [2025-10-21T20:20:41.039788] [WARN ] [MAIN ] NYT: No existing data found, performing full refresh instead. [2025-10-21T20:20:41.039898] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-10-21T20:20:41.039937] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-10-21T20:20:41.039975] [DEBUG] [LOCAL ] NYT: No primary data file found to delete. [2025-10-21T20:20:41.040005] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-10-21T20:20:41.399812] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:20:41.751066] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-10-21T20:20:42.223559] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T20:20:42.551017] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-10. [2025-10-21T20:20:42.668180] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T20:20:43.351071] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-10-21T20:20:43.683590] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T20:20:43.687037] [INFO ] [REMOTE ] NXRT: Full fetch complete (26037 records). [2025-10-21T20:20:43.687143] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-10-21T20:20:44.046576] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-10-21T20:20:44.046675] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-10-21T20:20:44.047220] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-10-21T20:20:44.047259] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-10-21T20:20:44.050206] [DEBUG] [LOCAL ] NXRT: Trimmed 26037 records to 18938 (keeping 200 days of data) [2025-10-21T20:20:44.153841] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-10-21T20:20:44.167976] [DEBUG] [LOCAL ] NXRT: Primary data saved (18938 records). [2025-10-21T20:20:44.169440] [INFO ] [MAIN ] NXRT: Full history saved. [2025-10-21T20:20:44.169542] [INFO ] [MAIN ] Update Progress: 1562/2366 symbols completed. NXRT took 23.0s. Estimated remaining: 1h 43m 17s. Rate: 7.8 symbols/min [2025-10-21T20:20:44.353737] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:20:44.383443] [DEBUG] [LOCAL ] NZF: Loaded 28787 existing records from primary storage. [2025-10-21T20:20:44.383722] [INFO ] [MAIN ] NZF: Loaded 28787 existing records. [2025-10-21T20:20:44.560968] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:20:44.561335] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-10-21T20:20:44.561512] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-10-21T20:20:44.571917] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-10-21T20:20:44.572073] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-10-21T20:20:44.607428] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T20:20:44.886128] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-21T20:20:44.961861] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-10-21T20:20:44.967797] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:20:45.750992] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-10-21T20:20:45.955310] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T20:20:46.551066] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-10-21T20:20:47.320332] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T20:20:47.350997] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-10-21T20:20:48.151102] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-10-21T20:20:48.294160] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T20:20:48.621292] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T20:20:48.938825] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T20:20:48.950972] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-10-21T20:20:49.540306] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T20:20:49.751034] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-10-21T20:20:50.551026] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-10-21T20:20:51.243631] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T20:20:51.293019] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T20:20:51.350998] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-10-21T20:20:52.151031] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-10. [2025-10-21T20:20:52.838444] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T20:20:52.839567] [INFO ] [REMOTE ] NXN: Full fetch complete (3435 records). [2025-10-21T20:20:52.839690] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-10-21T20:20:52.956389] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-10. [2025-10-21T20:20:53.257705] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-10-21T20:20:53.257838] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-10-21T20:20:53.258201] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-10-21T20:20:53.258307] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-10-21T20:20:53.258865] [DEBUG] [LOCAL ] NXN: Trimmed 3435 records to 2287 (keeping 200 days of data) [2025-10-21T20:20:53.274538] [DEBUG] [LOCAL ] NXN: Primary data saved (2287 records). [2025-10-21T20:20:53.274726] [INFO ] [MAIN ] NXN: Full history saved. [2025-10-21T20:20:53.274839] [INFO ] [MAIN ] Update Progress: 1563/2366 symbols completed. NXN took 32.2s. Estimated remaining: 1h 43m 10s. Rate: 7.8 symbols/min [2025-10-21T20:20:53.398178] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T20:20:53.523527] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:20:53.523769] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-10-21T20:20:53.523816] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-10-21T20:20:53.523932] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-10-21T20:20:53.523976] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-21T20:20:53.524018] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-21T20:20:53.524052] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-10-21T20:20:53.756371] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-10-21T20:20:53.944227] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:20:54.105857] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T20:20:54.108814] [INFO ] [REMOTE ] NXP: Full fetch complete (16915 records). [2025-10-21T20:20:54.108895] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-10-21T20:20:54.495824] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-10-21T20:20:54.495910] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-10-21T20:20:54.496317] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-10-21T20:20:54.496355] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-10-21T20:20:54.496927] [DEBUG] [LOCAL ] NXP: Trimmed 16915 records to 12283 (keeping 200 days of data) [2025-10-21T20:20:54.561051] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-10-21T20:20:54.573267] [DEBUG] [LOCAL ] NXP: Primary data saved (12283 records). [2025-10-21T20:20:54.574436] [INFO ] [MAIN ] NXP: Full history saved. [2025-10-21T20:20:54.574544] [INFO ] [MAIN ] Update Progress: 1564/2366 symbols completed. NXP took 33.5s. Estimated remaining: 1h 42m 59s. Rate: 7.8 symbols/min [2025-10-21T20:20:54.745392] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:20:54.797919] [DEBUG] [LOCAL ] OBDC: Loaded 51730 existing records from primary storage. [2025-10-21T20:20:54.798231] [INFO ] [MAIN ] OBDC: Loaded 51730 existing records. [2025-10-21T20:20:54.993984] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:20:54.994217] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-10-21T20:20:54.994268] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-10-21T20:20:54.994534] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-10-21T20:20:54.994592] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-10-21T20:20:55.340484] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:20:55.350978] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-10-21T20:20:55.787701] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T20:20:55.835614] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-21T20:20:56.151029] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-10-21T20:20:56.951024] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-10-21T20:20:57.349417] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T20:20:57.751148] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-10-21T20:20:57.987046] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T20:20:58.551030] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-10-21T20:20:58.943034] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T20:20:59.195370] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-21T20:20:59.350993] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-10-21T20:21:00.151032] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-10-21T20:21:00.528147] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-21T20:21:00.951089] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-10-21T20:21:01.361433] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T20:21:01.532440] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T20:21:01.751085] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-10-21T20:21:02.551030] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-10-21T20:21:02.933383] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T20:21:03.351005] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-10-21T20:21:03.551088] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T20:21:04.151053] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-10-21T20:21:04.951003] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-10-21T20:21:04.999612] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T20:21:05.140570] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-21T20:21:05.751062] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-10-21T20:21:06.215432] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T20:21:06.551128] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-10-21T20:21:06.854760] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T20:21:07.351028] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-10-21T20:21:07.950530] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T20:21:08.139810] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-21T20:21:08.150985] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-10-21T20:21:08.951047] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-10-21T20:21:09.480186] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T20:21:09.751018] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-10-21T20:21:10.471861] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T20:21:10.550982] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-10. [2025-10-21T20:21:10.845509] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-10-21T20:21:11.268422] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T20:21:11.351005] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-10-21T20:21:11.817493] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T20:21:11.821996] [INFO ] [REMOTE ] NZF: Full fetch complete (42139 records). [2025-10-21T20:21:11.822085] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-10-21T20:21:12.159999] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-10-21T20:21:12.208813] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-10-21T20:21:12.208894] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-10-21T20:21:12.209719] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-10-21T20:21:12.209783] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-10-21T20:21:12.210760] [DEBUG] [LOCAL ] NZF: Trimmed 42139 records to 28757 (keeping 200 days of data) [2025-10-21T20:21:12.380951] [DEBUG] [LOCAL ] NZF: Primary data saved (28757 records). [2025-10-21T20:21:12.381073] [INFO ] [MAIN ] NZF: Full history saved. [2025-10-21T20:21:12.381670] [INFO ] [MAIN ] Update Progress: 1565/2366 symbols completed. NZF took 28.2s. Estimated remaining: 1h 42m 57s. Rate: 7.8 symbols/min [2025-10-21T20:21:12.564473] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:21:12.583343] [DEBUG] [LOCAL ] OBK: Loaded 16500 existing records from primary storage. [2025-10-21T20:21:12.583570] [INFO ] [MAIN ] OBK: Loaded 16500 existing records. [2025-10-21T20:21:12.775625] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:21:12.775846] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-10-21T20:21:12.775896] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-10-21T20:21:12.776062] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-10-21T20:21:12.776101] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-10-21T20:21:12.958295] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-10-21T20:21:13.149797] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:21:13.181364] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T20:21:13.751039] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-10-21T20:21:13.830090] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T20:21:14.551064] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-10-21T20:21:15.351052] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-10-21T20:21:15.710507] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-21T20:21:15.741101] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T20:21:15.795565] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T20:21:16.151108] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-10. [2025-10-21T20:21:16.951099] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-10-21T20:21:17.426094] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-21T20:21:17.751080] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-10-21T20:21:17.940722] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T20:21:17.948445] [INFO ] [REMOTE ] NYT: Full fetch complete (72189 records). [2025-10-21T20:21:17.948615] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-10-21T20:21:18.350760] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-10-21T20:21:18.350907] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-10-21T20:21:18.352349] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-10-21T20:21:18.352430] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-10-21T20:21:18.354192] [DEBUG] [LOCAL ] NYT: Trimmed 72189 records to 49485 (keeping 200 days of data) [2025-10-21T20:21:18.563004] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-10-21T20:21:18.658063] [DEBUG] [LOCAL ] NYT: Primary data saved (49485 records). [2025-10-21T20:21:18.658190] [INFO ] [MAIN ] NYT: Full history saved. [2025-10-21T20:21:18.658259] [INFO ] [MAIN ] Update Progress: 1566/2366 symbols completed. NYT took 37.8s. Estimated remaining: 1h 42m 48s. Rate: 7.8 symbols/min [2025-10-21T20:21:18.830517] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:21:18.830697] [DEBUG] [LOCAL ] OC: No existing data file found in primary storage. [2025-10-21T20:21:18.830749] [WARN ] [MAIN ] OC: No existing data found, performing full refresh instead. [2025-10-21T20:21:18.830868] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-10-21T20:21:18.830935] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-10-21T20:21:18.830994] [DEBUG] [LOCAL ] OC: No primary data file found to delete. [2025-10-21T20:21:18.831037] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-10-21T20:21:18.977546] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T20:21:19.234214] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:21:19.351007] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-10-21T20:21:19.535705] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-21T20:21:20.151059] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-10-21T20:21:20.550255] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-21T20:21:20.592831] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T20:21:20.951028] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-10. [2025-10-21T20:21:21.751056] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-10-21T20:21:22.551047] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-10-21T20:21:22.927123] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T20:21:23.018055] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-21T20:21:23.085586] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-21T20:21:23.093848] [INFO ] [REMOTE ] OBDC: Full fetch complete (75387 records). [2025-10-21T20:21:23.093978] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-10-21T20:21:23.356262] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-10-21T20:21:23.484417] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-10-21T20:21:23.484486] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-10-21T20:21:23.485574] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-10-21T20:21:23.485661] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-10-21T20:21:23.487166] [DEBUG] [LOCAL ] OBDC: Trimmed 75387 records to 51730 (keeping 200 days of data) [2025-10-21T20:21:23.800706] [DEBUG] [LOCAL ] OBDC: Primary data saved (51730 records). [2025-10-21T20:21:23.800886] [INFO ] [MAIN ] OBDC: Full history saved. [2025-10-21T20:21:23.801825] [INFO ] [MAIN ] Update Progress: 1567/2366 symbols completed. OBDC took 29.2s. Estimated remaining: 1h 42m 39s. Rate: 7.8 symbols/min [2025-10-21T20:21:23.974302] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:21:23.984588] [DEBUG] [LOCAL ] OCFT: Loaded 7276 existing records from primary storage. [2025-10-21T20:21:23.984831] [INFO ] [MAIN ] OCFT: Loaded 7276 existing records. [2025-10-21T20:21:24.166200] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-10-21T20:21:24.166141] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:21:24.167180] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-10-21T20:21:24.167253] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-10-21T20:21:24.167529] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-10-21T20:21:24.167585] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-10-21T20:21:24.355111] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T20:21:24.565387] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:21:24.951036] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-10-21T20:21:25.347254] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T20:21:25.654093] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T20:21:25.750989] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-10-21T20:21:26.079319] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-10-21T20:21:26.550996] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-10-21T20:21:26.755068] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T20:21:27.351075] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-10-21T20:21:28.151008] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-10-21T20:21:28.327324] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T20:21:28.601229] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T20:21:28.951009] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-10-21T20:21:29.362131] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T20:21:29.751113] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-10-21T20:21:30.471075] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T20:21:30.551065] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-10-21T20:21:31.351000] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-10-21T20:21:31.513366] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-21T20:21:31.530191] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-21T20:21:32.151061] [INFO ] [REMOTE ] O: Fetching primary data for 2025-10. [2025-10-21T20:21:32.497196] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T20:21:32.951036] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-10-21T20:21:33.751069] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-10-21T20:21:34.551009] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-10-21T20:21:34.749456] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T20:21:34.767734] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T20:21:34.830852] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-21T20:21:34.840359] [INFO ] [REMOTE ] O: Full fetch complete (77572 records). [2025-10-21T20:21:34.840489] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-10-21T20:21:35.038447] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T20:21:35.039322] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:21:35.039401] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:21:35.039492] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-10-21T20:21:35.039582] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-10-21T20:21:35.039665] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-10-21T20:21:35.039735] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-10-21T20:21:35.039799] [INFO ] [MAIN ] Update Progress: 1568/2366 symbols completed. O took 41.8s. Estimated remaining: 1h 42m 33s. Rate: 7.8 symbols/min [2025-10-21T20:21:35.214525] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:21:35.225017] [DEBUG] [LOCAL ] ODC: Loaded 8628 existing records from primary storage. [2025-10-21T20:21:35.225242] [INFO ] [MAIN ] ODC: Loaded 8628 existing records. [2025-10-21T20:21:35.356162] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-10-21T20:21:35.413427] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:21:35.413693] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-10-21T20:21:35.413750] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-10-21T20:21:35.413895] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-10-21T20:21:35.413933] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-10-21T20:21:35.540636] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T20:21:35.787358] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:21:36.151058] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-10-21T20:21:36.951021] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-10-21T20:21:36.982843] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T20:21:37.417889] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T20:21:37.751001] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-10-21T20:21:37.905554] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T20:21:38.506744] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T20:21:38.551092] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-10-21T20:21:39.351102] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-10. [2025-10-21T20:21:40.151095] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-10-21T20:21:40.446734] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T20:21:40.641579] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T20:21:40.644682] [INFO ] [REMOTE ] OBK: Full fetch complete (23917 records). [2025-10-21T20:21:40.644778] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-10-21T20:21:40.956330] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-10-21T20:21:41.054972] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T20:21:41.074334] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-10-21T20:21:41.074457] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-10-21T20:21:41.075561] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-10-21T20:21:41.075630] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-10-21T20:21:41.076951] [DEBUG] [LOCAL ] OBK: Trimmed 23917 records to 16436 (keeping 200 days of data) [2025-10-21T20:21:41.183693] [DEBUG] [LOCAL ] OBK: Primary data saved (16436 records). [2025-10-21T20:21:41.183909] [INFO ] [MAIN ] OBK: Full history saved. [2025-10-21T20:21:41.184026] [INFO ] [MAIN ] Update Progress: 1569/2366 symbols completed. OBK took 28.8s. Estimated remaining: 1h 42m 25s. Rate: 7.8 symbols/min [2025-10-21T20:21:41.370299] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:21:41.370532] [DEBUG] [LOCAL ] ODV: No existing data file found in primary storage. [2025-10-21T20:21:41.370569] [WARN ] [MAIN ] ODV: No existing data found, performing full refresh instead. [2025-10-21T20:21:41.370721] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-10-21T20:21:41.370772] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-10-21T20:21:41.370814] [DEBUG] [LOCAL ] ODV: No primary data file found to delete. [2025-10-21T20:21:41.370847] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-10-21T20:21:41.748858] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:21:41.750982] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-10-21T20:21:41.922307] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T20:21:42.551029] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-10-21T20:21:42.825476] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T20:21:43.351077] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-10-21T20:21:43.467450] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T20:21:44.151048] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-10-21T20:21:44.951032] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-10-21T20:21:45.085134] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T20:21:45.102397] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T20:21:45.737128] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T20:21:45.751057] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-10-21T20:21:46.551091] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-10-21T20:21:47.351107] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-10-21T20:21:47.567817] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T20:21:47.614104] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T20:21:48.151008] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-10-21T20:21:48.310393] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-21T20:21:48.951002] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-10-21T20:21:49.264876] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T20:21:49.429972] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T20:21:49.751049] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-10. [2025-10-21T20:21:50.433489] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-21T20:21:50.434691] [INFO ] [REMOTE ] OCFT: Full fetch complete (11641 records). [2025-10-21T20:21:50.434770] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-10-21T20:21:50.556715] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-10-21T20:21:50.868227] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-10-21T20:21:50.868369] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-10-21T20:21:50.868780] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-10-21T20:21:50.868845] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-10-21T20:21:50.869310] [DEBUG] [LOCAL ] OCFT: Trimmed 11641 records to 7172 (keeping 200 days of data) [2025-10-21T20:21:50.912016] [DEBUG] [LOCAL ] OCFT: Primary data saved (7172 records). [2025-10-21T20:21:50.912185] [INFO ] [MAIN ] OCFT: Full history saved. [2025-10-21T20:21:50.912284] [INFO ] [MAIN ] Update Progress: 1570/2366 symbols completed. OCFT took 27.1s. Estimated remaining: 1h 42m 18s. Rate: 7.8 symbols/min [2025-10-21T20:21:51.114443] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:21:51.156054] [DEBUG] [LOCAL ] OEC: Loaded 37290 existing records from primary storage. [2025-10-21T20:21:51.156341] [INFO ] [MAIN ] OEC: Loaded 37290 existing records. [2025-10-21T20:21:51.338926] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:21:51.339143] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-10-21T20:21:51.339189] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-10-21T20:21:51.339435] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-10-21T20:21:51.339491] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-10-21T20:21:51.359479] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-10-21T20:21:51.627107] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T20:21:51.707253] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:21:52.151032] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-10-21T20:21:52.951053] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-10-21T20:21:53.177826] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T20:21:53.750980] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-10-21T20:21:53.780946] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T20:21:53.839738] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-21T20:21:54.551043] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-10-21T20:21:55.351001] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-10-21T20:21:55.418580] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T20:21:55.476919] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T20:21:56.151033] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-10-21T20:21:56.818576] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T20:21:56.833024] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T20:21:56.951025] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-10. [2025-10-21T20:21:57.751024] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-10. [2025-10-21T20:21:58.551276] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-10-21T20:21:58.668142] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T20:21:58.670233] [INFO ] [REMOTE ] ODC: Full fetch complete (11438 records). [2025-10-21T20:21:58.670303] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-10-21T20:21:59.008130] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-21T20:21:59.050767] [INFO ] [REMOTE ] OC: Full fetch complete (64823 records). [2025-10-21T20:21:59.074006] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-10-21T20:21:59.074128] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-10-21T20:21:59.074286] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-10-21T20:21:59.074581] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-10-21T20:21:59.074726] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-10-21T20:21:59.120028] [DEBUG] [LOCAL ] ODC: Trimmed 11438 records to 8680 (keeping 200 days of data) [2025-10-21T20:21:59.306783] [DEBUG] [LOCAL ] ODC: Primary data saved (8680 records). [2025-10-21T20:21:59.314496] [INFO ] [MAIN ] ODC: Full history saved. [2025-10-21T20:21:59.336496] [INFO ] [MAIN ] Update Progress: 1571/2366 symbols completed. ODC took 24.3s. Estimated remaining: 1h 42m 11s. Rate: 7.8 symbols/min [2025-10-21T20:21:59.362081] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-10-21T20:21:59.714731] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-10-21T20:21:59.714843] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-10-21T20:21:59.716167] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-10-21T20:21:59.716246] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-10-21T20:21:59.747262] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:21:59.757207] [DEBUG] [LOCAL ] OFG: No existing data file found in primary storage. [2025-10-21T20:21:59.757408] [WARN ] [MAIN ] OFG: No existing data found, performing full refresh instead. [2025-10-21T20:21:59.758477] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T20:21:59.758677] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-10-21T20:21:59.760143] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-10-21T20:21:59.763212] [DEBUG] [LOCAL ] OFG: No primary data file found to delete. [2025-10-21T20:21:59.763783] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-10-21T20:21:59.763690] [DEBUG] [LOCAL ] OC: Trimmed 64823 records to 44951 (keeping 200 days of data) [2025-10-21T20:22:00.173239] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-10-21T20:22:00.418121] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:22:00.422368] [DEBUG] [LOCAL ] OC: Primary data saved (44951 records). [2025-10-21T20:22:00.422857] [INFO ] [MAIN ] OC: Full history saved. [2025-10-21T20:22:00.422950] [INFO ] [MAIN ] Update Progress: 1572/2366 symbols completed. OC took 41.8s. Estimated remaining: 1h 41m 60s. Rate: 7.8 symbols/min [2025-10-21T20:22:00.591479] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:22:00.591663] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-10-21T20:22:00.591719] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-10-21T20:22:00.591824] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-10-21T20:22:00.591864] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-10-21T20:22:00.591905] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-10-21T20:22:00.591936] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-10-21T20:22:00.958184] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-10-21T20:22:00.963917] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:22:01.290073] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T20:22:01.521183] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T20:22:01.751042] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-10-21T20:22:02.446505] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T20:22:02.551051] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-10-21T20:22:03.301929] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T20:22:03.351035] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-10-21T20:22:04.151055] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-10-21T20:22:04.344170] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T20:22:04.951002] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-10-21T20:22:05.048892] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T20:22:05.750993] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-10-21T20:22:05.932857] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T20:22:06.551037] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-10-21T20:22:06.602502] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T20:22:07.282401] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T20:22:07.351033] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-10-21T20:22:08.151029] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-10-21T20:22:08.197733] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T20:22:08.833227] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T20:22:08.951020] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-10-21T20:22:09.751049] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-10-21T20:22:09.814537] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T20:22:10.551031] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-10-21T20:22:10.667993] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T20:22:11.351037] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-10. [2025-10-21T20:22:11.544409] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T20:22:11.612458] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T20:22:12.151032] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-10-21T20:22:12.951035] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-10-21T20:22:13.140257] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T20:22:13.147481] [INFO ] [REMOTE ] ODV: Full fetch complete (35896 records). [2025-10-21T20:22:13.147590] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-10-21T20:22:13.559852] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T20:22:13.601314] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-10-21T20:22:13.601399] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-10-21T20:22:13.602207] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-10-21T20:22:13.602269] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-10-21T20:22:13.603146] [DEBUG] [LOCAL ] ODV: Trimmed 35896 records to 29925 (keeping 200 days of data) [2025-10-21T20:22:13.760430] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-10-21T20:22:13.779224] [DEBUG] [LOCAL ] ODV: Primary data saved (29925 records). [2025-10-21T20:22:13.779358] [INFO ] [MAIN ] ODV: Full history saved. [2025-10-21T20:22:13.779430] [INFO ] [MAIN ] Update Progress: 1573/2366 symbols completed. ODV took 32.6s. Estimated remaining: 1h 41m 55s. Rate: 7.8 symbols/min [2025-10-21T20:22:13.948465] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:22:13.948629] [DEBUG] [LOCAL ] OGN: No existing data file found in primary storage. [2025-10-21T20:22:13.948697] [WARN ] [MAIN ] OGN: No existing data found, performing full refresh instead. [2025-10-21T20:22:13.948812] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-10-21T20:22:13.948852] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-10-21T20:22:13.948914] [DEBUG] [LOCAL ] OGN: No primary data file found to delete. [2025-10-21T20:22:13.948948] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-10-21T20:22:14.332203] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:22:14.530624] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T20:22:14.551021] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-10-21T20:22:14.981764] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T20:22:15.351071] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-10-21T20:22:15.883496] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T20:22:16.151090] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-10-21T20:22:16.951001] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-10-21T20:22:17.219848] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T20:22:17.691824] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T20:22:17.750978] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-10. [2025-10-21T20:22:18.551047] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-10-21T20:22:18.767198] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T20:22:19.312564] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T20:22:19.318535] [INFO ] [REMOTE ] OEC: Full fetch complete (53494 records). [2025-10-21T20:22:19.318633] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-10-21T20:22:19.361171] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-10-21T20:22:19.707879] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-10-21T20:22:19.708027] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-10-21T20:22:19.709188] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-10-21T20:22:19.709368] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-10-21T20:22:19.710556] [DEBUG] [LOCAL ] OEC: Trimmed 53494 records to 37212 (keeping 200 days of data) [2025-10-21T20:22:19.831994] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T20:22:19.948563] [DEBUG] [LOCAL ] OEC: Primary data saved (37212 records). [2025-10-21T20:22:19.948728] [INFO ] [MAIN ] OEC: Full history saved. [2025-10-21T20:22:19.949374] [INFO ] [MAIN ] Update Progress: 1574/2366 symbols completed. OEC took 29.0s. Estimated remaining: 1h 41m 47s. Rate: 7.8 symbols/min [2025-10-21T20:22:20.116190] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:22:20.116326] [DEBUG] [LOCAL ] OGS: No existing data file found in primary storage. [2025-10-21T20:22:20.116364] [WARN ] [MAIN ] OGS: No existing data found, performing full refresh instead. [2025-10-21T20:22:20.116466] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-10-21T20:22:20.116542] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-10-21T20:22:20.116608] [DEBUG] [LOCAL ] OGS: No primary data file found to delete. [2025-10-21T20:22:20.116662] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-10-21T20:22:20.158727] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-10-21T20:22:20.472218] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:22:20.950997] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-10-21T20:22:21.269431] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T20:22:21.408078] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T20:22:21.751075] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-10-21T20:22:22.380482] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T20:22:22.551073] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-10-21T20:22:23.351018] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-10-21T20:22:23.603505] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T20:22:23.863971] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T20:22:24.151020] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-10-21T20:22:24.951046] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-10. [2025-10-21T20:22:25.543123] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-21T20:22:25.757983] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-10-21T20:22:25.776950] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T20:22:26.055703] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T20:22:26.059278] [INFO ] [REMOTE ] OFG: Full fetch complete (33694 records). [2025-10-21T20:22:26.059382] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-10-21T20:22:26.445095] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-10-21T20:22:26.445180] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-10-21T20:22:26.445951] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-10-21T20:22:26.446013] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-10-21T20:22:26.446979] [DEBUG] [LOCAL ] OFG: Trimmed 33694 records to 20625 (keeping 200 days of data) [2025-10-21T20:22:26.551703] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-10-21T20:22:26.574667] [DEBUG] [LOCAL ] OFG: Primary data saved (20625 records). [2025-10-21T20:22:26.574798] [INFO ] [MAIN ] OFG: Full history saved. [2025-10-21T20:22:26.574870] [INFO ] [MAIN ] Update Progress: 1575/2366 symbols completed. OFG took 27.2s. Estimated remaining: 1h 41m 38s. Rate: 7.8 symbols/min [2025-10-21T20:22:26.748980] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:22:26.749275] [DEBUG] [LOCAL ] OHI: No existing data file found in primary storage. [2025-10-21T20:22:26.749331] [WARN ] [MAIN ] OHI: No existing data found, performing full refresh instead. [2025-10-21T20:22:26.749466] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-10-21T20:22:26.749515] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-10-21T20:22:26.749557] [DEBUG] [LOCAL ] OHI: No primary data file found to delete. [2025-10-21T20:22:26.749590] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-10-21T20:22:27.118691] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:22:27.137731] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T20:22:27.351067] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-10-21T20:22:28.151092] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-10-21T20:22:28.574282] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T20:22:28.852482] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T20:22:28.951021] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-10-21T20:22:29.751936] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-10-21T20:22:29.755978] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T20:22:30.551012] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-10-21T20:22:30.584292] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T20:22:31.351083] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-10-21T20:22:31.853164] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T20:22:31.897573] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T20:22:32.151101] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-10-21T20:22:32.587926] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T20:22:32.951014] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-10-21T20:22:33.751014] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-10-21T20:22:34.133021] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T20:22:34.551056] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-10-21T20:22:34.606055] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T20:22:35.351009] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-10-21T20:22:35.576836] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T20:22:36.026014] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T20:22:36.151032] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-10-21T20:22:36.951010] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-10. [2025-10-21T20:22:37.162449] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T20:22:37.722270] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T20:22:37.751000] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-10-21T20:22:38.551171] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-10-21T20:22:38.648906] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T20:22:38.656231] [INFO ] [REMOTE ] OGE: Full fetch complete (66773 records). [2025-10-21T20:22:38.656366] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-10-21T20:22:39.094726] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-10-21T20:22:39.095130] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-10-21T20:22:39.096708] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-10-21T20:22:39.096911] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-10-21T20:22:39.118263] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T20:22:39.125526] [DEBUG] [LOCAL ] OGE: Trimmed 66773 records to 45791 (keeping 200 days of data) [2025-10-21T20:22:39.354977] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-10-21T20:22:39.418831] [DEBUG] [LOCAL ] OGE: Primary data saved (45791 records). [2025-10-21T20:22:39.418951] [INFO ] [MAIN ] OGE: Full history saved. [2025-10-21T20:22:39.419017] [INFO ] [MAIN ] Update Progress: 1576/2366 symbols completed. OGE took 39.0s. Estimated remaining: 1h 41m 33s. Rate: 7.8 symbols/min [2025-10-21T20:22:39.591062] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:22:39.591220] [DEBUG] [LOCAL ] OI: No existing data file found in primary storage. [2025-10-21T20:22:39.591255] [WARN ] [MAIN ] OI: No existing data found, performing full refresh instead. [2025-10-21T20:22:39.591359] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-10-21T20:22:39.591399] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-10-21T20:22:39.591438] [DEBUG] [LOCAL ] OI: No primary data file found to delete. [2025-10-21T20:22:39.591469] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-10-21T20:22:39.961471] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:22:40.150992] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-10-21T20:22:40.457399] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T20:22:40.766608] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T20:22:40.951017] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-10-21T20:22:41.750994] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-10-21T20:22:42.116936] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T20:22:42.551006] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-10-21T20:22:42.799803] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T20:22:43.351031] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-10. [2025-10-21T20:22:43.392243] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T20:22:44.060880] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T20:22:44.151027] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-10-21T20:22:44.709058] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T20:22:44.713597] [INFO ] [REMOTE ] OGS: Full fetch complete (47822 records). [2025-10-21T20:22:44.713760] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-10-21T20:22:44.957329] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-10. [2025-10-21T20:22:45.116780] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-10-21T20:22:45.116877] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-10-21T20:22:45.117812] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-10-21T20:22:45.117875] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-10-21T20:22:45.118986] [DEBUG] [LOCAL ] OGS: Trimmed 47822 records to 34004 (keeping 200 days of data) [2025-10-21T20:22:45.329014] [DEBUG] [LOCAL ] OGS: Primary data saved (34004 records). [2025-10-21T20:22:45.329152] [INFO ] [MAIN ] OGS: Full history saved. [2025-10-21T20:22:45.329223] [INFO ] [MAIN ] Update Progress: 1577/2366 symbols completed. OGS took 25.4s. Estimated remaining: 1h 41m 24s. Rate: 7.8 symbols/min [2025-10-21T20:22:45.497824] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:22:45.511892] [DEBUG] [LOCAL ] OIA: Loaded 13084 existing records from primary storage. [2025-10-21T20:22:45.512122] [INFO ] [MAIN ] OIA: Loaded 13084 existing records. [2025-10-21T20:22:45.688604] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:22:45.688847] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-10-21T20:22:45.688895] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-10-21T20:22:45.689054] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-10-21T20:22:45.689091] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-10-21T20:22:45.752155] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-10-21T20:22:46.077693] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:22:46.142423] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T20:22:46.551001] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-10-21T20:22:46.815703] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T20:22:46.825234] [INFO ] [REMOTE ] OGN: Full fetch complete (76924 records). [2025-10-21T20:22:46.825493] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-10-21T20:22:47.259501] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-10-21T20:22:47.259613] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-10-21T20:22:47.261331] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-10-21T20:22:47.261402] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-10-21T20:22:47.263388] [DEBUG] [LOCAL ] OGN: Trimmed 76924 records to 53103 (keeping 200 days of data) [2025-10-21T20:22:47.357797] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-10-21T20:22:47.635483] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T20:22:47.663252] [DEBUG] [LOCAL ] OGN: Primary data saved (53103 records). [2025-10-21T20:22:47.663387] [INFO ] [MAIN ] OGN: Full history saved. [2025-10-21T20:22:47.663458] [INFO ] [MAIN ] Update Progress: 1578/2366 symbols completed. OGN took 33.9s. Estimated remaining: 1h 41m 14s. Rate: 7.8 symbols/min [2025-10-21T20:22:47.830313] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:22:47.830501] [DEBUG] [LOCAL ] OII: No existing data file found in primary storage. [2025-10-21T20:22:47.830543] [WARN ] [MAIN ] OII: No existing data found, performing full refresh instead. [2025-10-21T20:22:47.830692] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-10-21T20:22:47.830751] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-10-21T20:22:47.830795] [DEBUG] [LOCAL ] OII: No primary data file found to delete. [2025-10-21T20:22:47.830831] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-10-21T20:22:48.155197] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-10-21T20:22:48.197513] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:22:48.414142] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T20:22:48.443113] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T20:22:48.951073] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-10-21T20:22:49.750993] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-10-21T20:22:50.172840] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T20:22:50.551059] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-10-21T20:22:50.833603] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T20:22:51.067787] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:22:51.351021] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-10-21T20:22:52.151108] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-10-21T20:22:52.219584] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T20:22:52.951045] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-10-21T20:22:53.751090] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-10-21T20:23:05.161832] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (11.41 seconds). [2025-10-21T20:23:05.171125] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-10-21T20:23:06.623061] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (14.47 seconds). [2025-10-21T20:23:06.628118] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-10-21T20:23:06.815853] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (13.86 seconds). [2025-10-21T20:23:06.827273] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-10-21T20:23:06.874085] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-21T20:23:06.887268] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-10-21T20:23:06.957044] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (15.61 seconds). [2025-10-21T20:23:06.965250] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-10-21T20:23:07.865408] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T20:23:07.871244] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-10-21T20:23:08.778558] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T20:23:08.789469] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-10-21T20:23:08.921931] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-21T20:23:08.934120] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-10-21T20:23:08.964301] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T20:23:08.974888] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-10-21T20:23:09.302927] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T20:23:09.306509] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-10-21T20:23:10.550043] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T20:23:10.553426] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-10-21T20:23:10.689583] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T20:23:10.700206] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-10. [2025-10-21T20:23:10.864570] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T20:23:10.875598] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-10-21T20:23:11.011296] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T20:23:11.021196] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-10-21T20:23:11.599689] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T20:23:11.604087] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-10-21T20:23:12.169990] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T20:23:12.178408] [INFO ] [REMOTE ] OI: Full fetch complete (68206 records). [2025-10-21T20:23:12.178592] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-10-21T20:23:12.606127] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-10-21T20:23:12.606349] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-10-21T20:23:12.607746] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-10-21T20:23:12.607894] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-10-21T20:23:12.609436] [DEBUG] [LOCAL ] OI: Trimmed 68206 records to 47059 (keeping 200 days of data) [2025-10-21T20:23:12.854148] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T20:23:12.897698] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-10-21T20:23:12.904062] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T20:23:12.914210] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-10-21T20:23:12.966837] [DEBUG] [LOCAL ] OI: Primary data saved (47059 records). [2025-10-21T20:23:12.966966] [INFO ] [MAIN ] OI: Full history saved. [2025-10-21T20:23:12.967036] [INFO ] [MAIN ] Update Progress: 1579/2366 symbols completed. OI took 33.5s. Estimated remaining: 1h 41m 15s. Rate: 7.8 symbols/min [2025-10-21T20:23:13.172875] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:13.169800] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-21T20:23:13.184507] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-10. [2025-10-21T20:23:13.220193] [DEBUG] [LOCAL ] OIS: Loaded 39917 existing records from primary storage. [2025-10-21T20:23:13.220476] [INFO ] [MAIN ] OIS: Loaded 39917 existing records. [2025-10-21T20:23:13.398482] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:23:13.398754] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-10-21T20:23:13.398807] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-10-21T20:23:13.399010] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-10-21T20:23:13.399064] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-10-21T20:23:13.746799] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:13.747116] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-10-21T20:23:14.158965] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-21T20:23:14.163830] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-10-21T20:23:14.318818] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T20:23:14.327426] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-10-21T20:23:15.078556] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T20:23:15.096409] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T20:23:15.096007] [INFO ] [REMOTE ] OHI: Full fetch complete (75313 records). [2025-10-21T20:23:15.096565] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-10-21T20:23:15.100615] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-10. [2025-10-21T20:23:15.407057] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T20:23:15.438984] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-10-21T20:23:15.537145] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-10-21T20:23:15.537234] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-10-21T20:23:15.538476] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-10-21T20:23:15.538543] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-10-21T20:23:15.540008] [DEBUG] [LOCAL ] OHI: Trimmed 75313 records to 51895 (keeping 200 days of data) [2025-10-21T20:23:15.888899] [DEBUG] [LOCAL ] OHI: Primary data saved (51895 records). [2025-10-21T20:23:15.890382] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T20:23:15.889398] [INFO ] [MAIN ] OHI: Full history saved. [2025-10-21T20:23:15.899700] [INFO ] [MAIN ] Update Progress: 1580/2366 symbols completed. OHI took 49.3s. Estimated remaining: 1h 41m 5s. Rate: 7.8 symbols/min [2025-10-21T20:23:15.967787] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-10-21T20:23:16.077983] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:16.078170] [DEBUG] [LOCAL ] OKE: No existing data file found in primary storage. [2025-10-21T20:23:16.078207] [WARN ] [MAIN ] OKE: No existing data found, performing full refresh instead. [2025-10-21T20:23:16.078316] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-10-21T20:23:16.078356] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-10-21T20:23:16.078395] [DEBUG] [LOCAL ] OKE: No primary data file found to delete. [2025-10-21T20:23:16.078425] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-10-21T20:23:16.372534] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T20:23:16.408088] [INFO ] [REMOTE ] OIA: Full fetch complete (20195 records). [2025-10-21T20:23:16.408261] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-10-21T20:23:16.557924] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:16.560775] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-10-21T20:23:16.826588] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-10-21T20:23:16.826684] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-10-21T20:23:16.827178] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-10-21T20:23:16.827219] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-10-21T20:23:16.827805] [DEBUG] [LOCAL ] OIA: Trimmed 20195 records to 13046 (keeping 200 days of data) [2025-10-21T20:23:16.905028] [DEBUG] [LOCAL ] OIA: Primary data saved (13046 records). [2025-10-21T20:23:16.905192] [INFO ] [MAIN ] OIA: Full history saved. [2025-10-21T20:23:16.905287] [INFO ] [MAIN ] Update Progress: 1581/2366 symbols completed. OIA took 31.6s. Estimated remaining: 1h 40m 54s. Rate: 7.8 symbols/min [2025-10-21T20:23:17.079727] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:17.136196] [DEBUG] [LOCAL ] OKLO: Loaded 53819 existing records from primary storage. [2025-10-21T20:23:17.136501] [INFO ] [MAIN ] OKLO: Loaded 53819 existing records. [2025-10-21T20:23:17.280353] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T20:23:17.332892] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-10-21T20:23:17.360358] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:23:17.360633] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-10-21T20:23:17.360728] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-21T20:23:17.361178] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-10-21T20:23:17.361235] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-10-21T20:23:17.805284] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:17.805747] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-10-21T20:23:17.831179] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T20:23:17.840900] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-10-21T20:23:18.558006] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T20:23:18.569867] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-10-21T20:23:19.099129] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T20:23:19.108368] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-10-21T20:23:19.518716] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T20:23:19.527102] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-10. [2025-10-21T20:23:20.369095] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T20:23:20.381022] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-10-21T20:23:20.664207] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-10-21T20:23:20.679094] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-10-21T20:23:20.698942] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T20:23:20.706267] [INFO ] [REMOTE ] OII: Full fetch complete (61592 records). [2025-10-21T20:23:20.706410] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-10-21T20:23:21.166418] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-10-21T20:23:21.166812] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-10-21T20:23:21.168674] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-10-21T20:23:21.172133] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-10-21T20:23:21.171995] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T20:23:21.185273] [DEBUG] [LOCAL ] OII: Trimmed 61592 records to 41827 (keeping 200 days of data) [2025-10-21T20:23:21.185132] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-10-21T20:23:21.431264] [DEBUG] [LOCAL ] OII: Primary data saved (41827 records). [2025-10-21T20:23:21.431380] [INFO ] [MAIN ] OII: Full history saved. [2025-10-21T20:23:21.431448] [INFO ] [MAIN ] Update Progress: 1582/2366 symbols completed. OII took 33.8s. Estimated remaining: 1h 40m 45s. Rate: 7.8 symbols/min [2025-10-21T20:23:21.602785] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:21.602938] [DEBUG] [LOCAL ] OLN: No existing data file found in primary storage. [2025-10-21T20:23:21.602975] [WARN ] [MAIN ] OLN: No existing data found, performing full refresh instead. [2025-10-21T20:23:21.603083] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-10-21T20:23:21.603124] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-10-21T20:23:21.603167] [DEBUG] [LOCAL ] OLN: No primary data file found to delete. [2025-10-21T20:23:21.603199] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-10-21T20:23:21.967261] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:21.967522] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-10-21T20:23:22.695219] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-21T20:23:22.706169] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-10-21T20:23:22.911551] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T20:23:23.351057] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-10-21T20:23:23.392302] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T20:23:23.431837] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-10-21T20:23:24.151022] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-10-21T20:23:24.925878] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T20:23:24.950996] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-10-21T20:23:25.015310] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T20:23:25.751032] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-10-21T20:23:26.518806] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T20:23:26.551057] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-10-21T20:23:27.044695] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-21T20:23:27.351046] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-10-21T20:23:27.439890] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T20:23:28.150999] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-10-21T20:23:28.257972] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T20:23:28.951013] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-10-21T20:23:29.030999] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T20:23:29.751035] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-10-21T20:23:29.904723] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T20:23:30.551010] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-10-21T20:23:31.351077] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-10-21T20:23:31.766778] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-21T20:23:31.849483] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T20:23:32.114227] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T20:23:32.150993] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-10-21T20:23:32.951026] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-10-21T20:23:33.228208] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T20:23:33.451293] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T20:23:33.751006] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-10. [2025-10-21T20:23:34.551057] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-10-21T20:23:35.201242] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T20:23:35.207203] [INFO ] [REMOTE ] OIS: Full fetch complete (57255 records). [2025-10-21T20:23:35.207333] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-10-21T20:23:35.361215] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-10-21T20:23:35.610036] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-10-21T20:23:35.610252] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-10-21T20:23:35.611322] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-10-21T20:23:35.611383] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-10-21T20:23:35.612592] [DEBUG] [LOCAL ] OIS: Trimmed 57255 records to 39895 (keeping 200 days of data) [2025-10-21T20:23:35.843059] [DEBUG] [LOCAL ] OIS: Primary data saved (39895 records). [2025-10-21T20:23:35.843199] [INFO ] [MAIN ] OIS: Full history saved. [2025-10-21T20:23:35.843279] [INFO ] [MAIN ] Update Progress: 1583/2366 symbols completed. OIS took 22.9s. Estimated remaining: 1h 40m 40s. Rate: 7.8 symbols/min [2025-10-21T20:23:36.031448] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:36.082135] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-10-21T20:23:36.098761] [DEBUG] [LOCAL ] OLP: Loaded 10116 existing records from primary storage. [2025-10-21T20:23:36.098998] [INFO ] [MAIN ] OLP: Loaded 10116 existing records. [2025-10-21T20:23:36.161937] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-10-21T20:23:36.281898] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:23:36.282117] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-10-21T20:23:36.282162] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-10-21T20:23:36.282320] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-10-21T20:23:36.282356] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-10-21T20:23:36.651830] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:36.688240] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-21T20:23:36.951032] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-10-21T20:23:37.427528] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T20:23:37.751065] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-10-21T20:23:37.967211] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T20:23:38.551096] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-10-21T20:23:38.765697] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-10-21T20:23:39.351002] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-10-21T20:23:39.503418] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T20:23:39.575892] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T20:23:40.151084] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-10-21T20:23:40.951068] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-10-21T20:23:41.293024] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T20:23:41.751088] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-10-21T20:23:42.338071] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.99 seconds). [2025-10-21T20:23:42.551027] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-10-21T20:23:42.753257] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-21T20:23:43.006439] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T20:23:43.351076] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-10-21T20:23:44.151069] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-10. [2025-10-21T20:23:44.951015] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-10-21T20:23:45.285455] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T20:23:45.372713] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-10-21T20:23:45.751003] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-10-21T20:23:45.867162] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T20:23:46.304977] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-21T20:23:46.314581] [INFO ] [REMOTE ] OKE: Full fetch complete (77673 records). [2025-10-21T20:23:46.314766] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-10-21T20:23:46.556300] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-10-21T20:23:46.718224] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-10-21T20:23:46.718332] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-10-21T20:23:46.719524] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-10-21T20:23:46.719589] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-10-21T20:23:46.721119] [DEBUG] [LOCAL ] OKE: Trimmed 77673 records to 53576 (keeping 200 days of data) [2025-10-21T20:23:47.071445] [DEBUG] [LOCAL ] OKE: Primary data saved (53576 records). [2025-10-21T20:23:47.071624] [INFO ] [MAIN ] OKE: Full history saved. [2025-10-21T20:23:47.071747] [INFO ] [MAIN ] Update Progress: 1584/2366 symbols completed. OKE took 31.2s. Estimated remaining: 1h 40m 34s. Rate: 7.8 symbols/min [2025-10-21T20:23:47.262180] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:47.262352] [DEBUG] [LOCAL ] OMC: No existing data file found in primary storage. [2025-10-21T20:23:47.262389] [WARN ] [MAIN ] OMC: No existing data found, performing full refresh instead. [2025-10-21T20:23:47.262502] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-10-21T20:23:47.262543] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-10-21T20:23:47.262584] [DEBUG] [LOCAL ] OMC: No primary data file found to delete. [2025-10-21T20:23:47.262615] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-10-21T20:23:47.365865] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-10-21T20:23:47.662295] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:47.699051] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T20:23:47.717051] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T20:23:48.151023] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-10-21T20:23:48.951020] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-10-21T20:23:49.751009] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-10-21T20:23:50.080360] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T20:23:50.204689] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-21T20:23:50.551015] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-10-21T20:23:50.801131] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T20:23:50.831357] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T20:23:51.351031] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-10-21T20:23:52.151053] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-10. [2025-10-21T20:23:52.428354] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T20:23:52.430126] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T20:23:52.951013] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-10. [2025-10-21T20:23:53.186222] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T20:23:53.194265] [INFO ] [REMOTE ] OKLO: Full fetch complete (77609 records). [2025-10-21T20:23:53.194413] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-10-21T20:23:53.195268] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T20:23:53.195361] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:23:53.195403] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:23:53.195439] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-10-21T20:23:53.195497] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-10-21T20:23:53.195531] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-10-21T20:23:53.195757] [DEBUG] [LOCAL ] OKLO: Deleted derivative data file. [2025-10-21T20:23:53.196767] [INFO ] [MAIN ] Update Progress: 1585/2366 symbols completed. OKLO took 36.3s. Estimated remaining: 1h 40m 26s. Rate: 7.8 symbols/min [2025-10-21T20:23:53.365211] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:53.414042] [DEBUG] [LOCAL ] OMF: Loaded 46485 existing records from primary storage. [2025-10-21T20:23:53.414368] [INFO ] [MAIN ] OMF: Loaded 46485 existing records. [2025-10-21T20:23:53.589974] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:23:53.590159] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-10-21T20:23:53.590204] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-10-21T20:23:53.590403] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-10-21T20:23:53.590458] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-10-21T20:23:53.762016] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-10-21T20:23:53.951119] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:54.551039] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-10-21T20:23:54.794468] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T20:23:54.802541] [INFO ] [REMOTE ] OLN: Full fetch complete (74770 records). [2025-10-21T20:23:54.802684] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-10-21T20:23:54.914082] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T20:23:55.207981] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-10-21T20:23:55.208058] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-10-21T20:23:55.209142] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-10-21T20:23:55.209204] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-10-21T20:23:55.210548] [DEBUG] [LOCAL ] OLN: Trimmed 74770 records to 52011 (keeping 200 days of data) [2025-10-21T20:23:55.383447] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-10. [2025-10-21T20:23:55.521438] [DEBUG] [LOCAL ] OLN: Primary data saved (52011 records). [2025-10-21T20:23:55.521573] [INFO ] [MAIN ] OLN: Full history saved. [2025-10-21T20:23:55.521675] [INFO ] [MAIN ] Update Progress: 1586/2366 symbols completed. OLN took 34.1s. Estimated remaining: 1h 40m 15s. Rate: 7.8 symbols/min [2025-10-21T20:23:55.690218] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:55.690390] [DEBUG] [LOCAL ] OMI: No existing data file found in primary storage. [2025-10-21T20:23:55.690426] [WARN ] [MAIN ] OMI: No existing data found, performing full refresh instead. [2025-10-21T20:23:55.690533] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-10-21T20:23:55.690572] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-10-21T20:23:55.690611] [DEBUG] [LOCAL ] OMI: No primary data file found to delete. [2025-10-21T20:23:55.690661] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-10-21T20:23:56.047974] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:56.150982] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-10-21T20:23:56.423037] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T20:23:56.425673] [INFO ] [REMOTE ] OLP: Full fetch complete (14283 records). [2025-10-21T20:23:56.425801] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-10-21T20:23:56.803776] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-10-21T20:23:56.803891] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-10-21T20:23:56.804291] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-10-21T20:23:56.804506] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-10-21T20:23:56.805286] [DEBUG] [LOCAL ] OLP: Trimmed 14283 records to 10120 (keeping 200 days of data) [2025-10-21T20:23:56.867955] [DEBUG] [LOCAL ] OLP: Primary data saved (10120 records). [2025-10-21T20:23:56.868107] [INFO ] [MAIN ] OLP: Full history saved. [2025-10-21T20:23:56.868224] [INFO ] [MAIN ] Update Progress: 1587/2366 symbols completed. OLP took 21.0s. Estimated remaining: 1h 40m 5s. Rate: 7.8 symbols/min [2025-10-21T20:23:56.959768] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-10-21T20:23:57.056501] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-21T20:23:57.073228] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:23:57.092690] [DEBUG] [LOCAL ] ONIT: Loaded 7641 existing records from primary storage. [2025-10-21T20:23:57.092897] [INFO ] [MAIN ] ONIT: Loaded 7641 existing records. [2025-10-21T20:23:57.273289] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:23:57.273636] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-10-21T20:23:57.273785] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-10-21T20:23:57.274037] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-10-21T20:23:57.274092] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-10-21T20:23:57.475147] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:23:57.662902] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:23:57.751001] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-10-21T20:23:58.550998] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-10-21T20:23:58.748866] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T20:23:59.351082] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-10-21T20:23:59.761038] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T20:24:00.151037] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-10-21T20:24:00.196163] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T20:24:00.356856] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T20:24:00.951047] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-10-21T20:24:01.751044] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-10-21T20:24:02.144144] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T20:24:02.227546] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-21T20:24:02.551023] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-10-21T20:24:02.654457] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T20:24:03.351075] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-10-21T20:24:04.151020] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-10-21T20:24:04.247602] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T20:24:04.796576] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T20:24:04.951004] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-10-21T20:24:05.029513] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T20:24:05.751027] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-10-21T20:24:06.143848] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T20:24:06.551023] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-10-21T20:24:07.351008] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-10-21T20:24:07.672190] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T20:24:08.151017] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-10-21T20:24:08.458455] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T20:24:08.951016] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-10-21T20:24:09.040460] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T20:24:09.751003] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-10-21T20:24:09.825781] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T20:24:10.551044] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-10-21T20:24:10.958590] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T20:24:11.037928] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T20:24:11.351062] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-10-21T20:24:11.404522] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T20:24:12.151051] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-10-21T20:24:12.918623] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T20:24:12.950979] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-10-21T20:24:13.751000] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-10-21T20:24:14.037963] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T20:24:14.285280] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T20:24:14.551045] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-10-21T20:24:14.755432] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T20:24:15.351046] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-10-21T20:24:16.151008] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-10-21T20:24:16.530248] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T20:24:16.951054] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-10-21T20:24:17.257060] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T20:24:17.750998] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-10-21T20:24:17.847808] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T20:24:17.952331] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T20:24:18.551089] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-10. [2025-10-21T20:24:19.351075] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-10. [2025-10-21T20:24:19.453609] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T20:24:20.151059] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-10-21T20:24:20.191989] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T20:24:20.204631] [INFO ] [REMOTE ] OMC: Full fetch complete (77259 records). [2025-10-21T20:24:20.204854] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-10-21T20:24:20.625762] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-10-21T20:24:20.625839] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-10-21T20:24:20.626939] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-10-21T20:24:20.627000] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-10-21T20:24:20.628451] [DEBUG] [LOCAL ] OMC: Trimmed 77259 records to 53292 (keeping 200 days of data) [2025-10-21T20:24:20.951847] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-10-21T20:24:20.976836] [DEBUG] [LOCAL ] OMC: Primary data saved (53292 records). [2025-10-21T20:24:20.977003] [INFO ] [MAIN ] OMC: Full history saved. [2025-10-21T20:24:20.977121] [INFO ] [MAIN ] Update Progress: 1588/2366 symbols completed. OMC took 33.9s. Estimated remaining: 1h 40m 5s. Rate: 7.8 symbols/min [2025-10-21T20:24:21.159785] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:24:21.228536] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T20:24:21.237043] [INFO ] [REMOTE ] OMI: Full fetch complete (65640 records). [2025-10-21T20:24:21.237494] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-10-21T20:24:21.421488] [DEBUG] [LOCAL ] ONL: Loaded 29214 existing records from primary storage. [2025-10-21T20:24:21.438588] [INFO ] [MAIN ] ONL: Loaded 29214 existing records. [2025-10-21T20:24:21.854228] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:24:21.858118] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-10-21T20:24:21.858300] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-10-21T20:24:21.858374] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-10-21T20:24:21.858625] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-10-21T20:24:21.858507] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-10-21T20:24:21.859971] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-10-21T20:24:21.860143] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-10-21T20:24:21.860220] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-10-21T20:24:21.966825] [DEBUG] [LOCAL ] OMI: Trimmed 65640 records to 46212 (keeping 200 days of data) [2025-10-21T20:24:22.186548] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T20:24:22.270040] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-10-21T20:24:22.461438] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:24:22.469751] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-21T20:24:22.539725] [DEBUG] [LOCAL ] OMI: Primary data saved (46212 records). [2025-10-21T20:24:22.539855] [INFO ] [MAIN ] OMI: Full history saved. [2025-10-21T20:24:22.539924] [INFO ] [MAIN ] Update Progress: 1589/2366 symbols completed. OMI took 27.0s. Estimated remaining: 1h 39m 54s. Rate: 7.8 symbols/min [2025-10-21T20:24:22.560398] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-10-21T20:24:22.709227] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:24:22.709383] [DEBUG] [LOCAL ] ONON: No existing data file found in primary storage. [2025-10-21T20:24:22.709421] [WARN ] [MAIN ] ONON: No existing data found, performing full refresh instead. [2025-10-21T20:24:22.709529] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-10-21T20:24:22.709593] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-10-21T20:24:22.709698] [DEBUG] [LOCAL ] ONON: No primary data file found to delete. [2025-10-21T20:24:22.709757] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-10-21T20:24:23.066727] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:24:23.351098] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-10-21T20:24:23.379174] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T20:24:24.151013] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-10. [2025-10-21T20:24:24.277983] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T20:24:24.718467] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T20:24:24.950989] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-10-21T20:24:25.074199] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T20:24:25.075561] [INFO ] [REMOTE ] ONIT: Full fetch complete (11037 records). [2025-10-21T20:24:25.075627] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-10-21T20:24:25.424605] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-10-21T20:24:25.424704] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-10-21T20:24:25.424937] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-10-21T20:24:25.424973] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-10-21T20:24:25.425370] [DEBUG] [LOCAL ] ONIT: Trimmed 11037 records to 7582 (keeping 200 days of data) [2025-10-21T20:24:25.467362] [DEBUG] [LOCAL ] ONIT: Primary data saved (7582 records). [2025-10-21T20:24:25.467449] [INFO ] [MAIN ] ONIT: Full history saved. [2025-10-21T20:24:25.467518] [INFO ] [MAIN ] Update Progress: 1590/2366 symbols completed. ONIT took 28.6s. Estimated remaining: 1h 39m 44s. Rate: 7.8 symbols/min [2025-10-21T20:24:25.632987] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:24:25.653899] [DEBUG] [LOCAL ] ONTF: Loaded 22672 existing records from primary storage. [2025-10-21T20:24:25.654151] [INFO ] [MAIN ] ONTF: Loaded 22672 existing records. [2025-10-21T20:24:25.752942] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-10-21T20:24:25.834034] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:24:25.834246] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-10-21T20:24:25.834310] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-10-21T20:24:25.834493] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-10-21T20:24:25.834548] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-10-21T20:24:26.182952] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:24:26.200774] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T20:24:26.551044] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-10-21T20:24:27.351060] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-10-21T20:24:27.581378] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T20:24:28.151014] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-10. [2025-10-21T20:24:28.689950] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T20:24:28.951050] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-10-21T20:24:29.007557] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T20:24:29.751047] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-10-21T20:24:30.060366] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T20:24:30.068817] [INFO ] [REMOTE ] OMF: Full fetch complete (67783 records). [2025-10-21T20:24:30.068964] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-10-21T20:24:30.446694] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-10-21T20:24:30.446782] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-10-21T20:24:30.447887] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-10-21T20:24:30.447949] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-10-21T20:24:30.449255] [DEBUG] [LOCAL ] OMF: Trimmed 67783 records to 46466 (keeping 200 days of data) [2025-10-21T20:24:30.553340] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-10-21T20:24:30.731421] [DEBUG] [LOCAL ] OMF: Primary data saved (46466 records). [2025-10-21T20:24:30.731599] [INFO ] [MAIN ] OMF: Full history saved. [2025-10-21T20:24:30.732536] [INFO ] [MAIN ] Update Progress: 1591/2366 symbols completed. OMF took 37.5s. Estimated remaining: 1h 39m 35s. Rate: 7.8 symbols/min [2025-10-21T20:24:30.901172] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:24:30.901413] [DEBUG] [LOCAL ] ONTO: No existing data file found in primary storage. [2025-10-21T20:24:30.901458] [WARN ] [MAIN ] ONTO: No existing data found, performing full refresh instead. [2025-10-21T20:24:30.901539] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-10-21T20:24:30.901573] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-10-21T20:24:30.901611] [DEBUG] [LOCAL ] ONTO: No primary data file found to delete. [2025-10-21T20:24:30.901663] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-10-21T20:24:31.270716] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:24:31.302360] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-21T20:24:31.325016] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-21T20:24:31.359383] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-10-21T20:24:31.365095] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T20:24:32.151028] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-10-21T20:24:32.499558] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T20:24:32.951049] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-10-21T20:24:33.616105] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T20:24:33.751044] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-10-21T20:24:34.551071] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-10-21T20:24:34.671734] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T20:24:35.350194] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T20:24:35.361107] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-10-21T20:24:35.796894] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T20:24:36.151058] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-10-21T20:24:36.951007] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-10-21T20:24:37.159686] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T20:24:37.443518] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T20:24:37.751045] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-10-21T20:24:38.551087] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-10-21T20:24:39.205226] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-21T20:24:39.351019] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-10-21T20:24:39.481857] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T20:24:39.880565] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T20:24:40.151085] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-10-21T20:24:40.951098] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-10-21T20:24:41.702678] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-10-21T20:24:41.751008] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-10-21T20:24:41.923458] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T20:24:42.388459] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T20:24:42.551103] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-10-21T20:24:42.986877] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T20:24:43.351033] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-10-21T20:24:44.150988] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-10-21T20:24:44.571903] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T20:24:44.598810] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T20:24:44.951080] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-10-21T20:24:45.751033] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-10-21T20:24:46.144680] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T20:24:46.235886] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T20:24:46.551030] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-10-21T20:24:46.941595] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T20:24:47.351132] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-10-21T20:24:48.151033] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-10. [2025-10-21T20:24:48.700928] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T20:24:48.739996] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T20:24:48.950999] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-10-21T20:24:49.326339] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T20:24:49.330221] [INFO ] [REMOTE ] ONL: Full fetch complete (42605 records). [2025-10-21T20:24:49.330301] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-10-21T20:24:49.695844] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-10-21T20:24:49.695919] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-10-21T20:24:49.696768] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-10-21T20:24:49.696863] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-10-21T20:24:49.697784] [DEBUG] [LOCAL ] ONL: Trimmed 42605 records to 29123 (keeping 200 days of data) [2025-10-21T20:24:49.753061] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-10-21T20:24:49.864503] [DEBUG] [LOCAL ] ONL: Primary data saved (29123 records). [2025-10-21T20:24:49.864626] [INFO ] [MAIN ] ONL: Full history saved. [2025-10-21T20:24:49.864736] [INFO ] [MAIN ] Update Progress: 1592/2366 symbols completed. ONL took 28.9s. Estimated remaining: 1h 39m 33s. Rate: 7.8 symbols/min [2025-10-21T20:24:50.038739] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:24:50.057593] [DEBUG] [LOCAL ] OOMA: Loaded 18427 existing records from primary storage. [2025-10-21T20:24:50.057887] [INFO ] [MAIN ] OOMA: Loaded 18427 existing records. [2025-10-21T20:24:50.232366] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:24:50.232617] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-10-21T20:24:50.232718] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-10-21T20:24:50.232965] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-10-21T20:24:50.233025] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-10-21T20:24:50.558720] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-10-21T20:24:50.583266] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:24:51.053711] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T20:24:51.149453] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T20:24:51.351041] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-10. [2025-10-21T20:24:52.150990] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-10-21T20:24:52.379718] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T20:24:52.426491] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T20:24:52.430136] [INFO ] [REMOTE ] ONTF: Full fetch complete (31542 records). [2025-10-21T20:24:52.430207] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-10-21T20:24:52.790214] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-10-21T20:24:52.790289] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-10-21T20:24:52.790929] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-10-21T20:24:52.790989] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-10-21T20:24:52.791715] [DEBUG] [LOCAL ] ONTF: Trimmed 31542 records to 22574 (keeping 200 days of data) [2025-10-21T20:24:52.911594] [DEBUG] [LOCAL ] ONTF: Primary data saved (22574 records). [2025-10-21T20:24:52.911737] [INFO ] [MAIN ] ONTF: Full history saved. [2025-10-21T20:24:52.911818] [INFO ] [MAIN ] Update Progress: 1593/2366 symbols completed. ONTF took 27.4s. Estimated remaining: 1h 39m 23s. Rate: 7.8 symbols/min [2025-10-21T20:24:52.956198] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-10-21T20:24:53.088798] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:24:53.115010] [DEBUG] [LOCAL ] OPAD: Loaded 25848 existing records from primary storage. [2025-10-21T20:24:53.115318] [INFO ] [MAIN ] OPAD: Loaded 25848 existing records. [2025-10-21T20:24:53.303680] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:24:53.304876] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T20:24:53.305039] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-10-21T20:24:53.308581] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-10-21T20:24:53.308872] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-10-21T20:24:53.308930] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-10-21T20:24:53.663919] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:24:53.751011] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-10-21T20:24:54.550984] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-10-21T20:24:54.895161] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T20:24:55.271913] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T20:24:55.351053] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-10-21T20:24:56.111735] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T20:24:56.135847] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T20:24:56.150995] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-10-21T20:24:56.951070] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-10-21T20:24:57.362776] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T20:24:57.751031] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-10-21T20:24:58.551020] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-10-21T20:24:58.883623] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T20:24:59.064173] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-21T20:24:59.323816] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T20:24:59.350977] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-10-21T20:25:00.151056] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-10-21T20:25:00.186275] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-21T20:25:00.951041] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-10-21T20:25:01.283762] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T20:25:01.751032] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-10-21T20:25:01.917922] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T20:25:02.551021] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-10-21T20:25:03.323743] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T20:25:03.351015] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-10-21T20:25:03.603152] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T20:25:04.151032] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-10-21T20:25:04.618460] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T20:25:04.951011] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-10. [2025-10-21T20:25:05.048305] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T20:25:05.751018] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-10-21T20:25:06.551021] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-10-21T20:25:07.160227] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-21T20:25:07.168612] [INFO ] [REMOTE ] ONON: Full fetch complete (77769 records). [2025-10-21T20:25:07.168763] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-10-21T20:25:07.372683] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-10-21T20:25:07.575929] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T20:25:07.600697] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-10-21T20:25:07.601083] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-10-21T20:25:07.602226] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-10-21T20:25:07.602292] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-10-21T20:25:07.603597] [DEBUG] [LOCAL ] ONON: Trimmed 77769 records to 53614 (keeping 200 days of data) [2025-10-21T20:25:07.912865] [DEBUG] [LOCAL ] ONON: Primary data saved (53614 records). [2025-10-21T20:25:07.912997] [INFO ] [MAIN ] ONON: Full history saved. [2025-10-21T20:25:07.913066] [INFO ] [MAIN ] Update Progress: 1594/2366 symbols completed. ONON took 45.4s. Estimated remaining: 1h 39m 19s. Rate: 7.8 symbols/min [2025-10-21T20:25:08.086471] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:25:08.129792] [DEBUG] [LOCAL ] OPFI: Loaded 46172 existing records from primary storage. [2025-10-21T20:25:08.130096] [INFO ] [MAIN ] OPFI: Loaded 46172 existing records. [2025-10-21T20:25:08.161067] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-10-21T20:25:08.311373] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:25:08.311639] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-10-21T20:25:08.311725] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-10-21T20:25:08.311927] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-10-21T20:25:08.311984] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-10-21T20:25:08.677966] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:25:08.691674] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T20:25:08.726944] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T20:25:08.951048] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-10-21T20:25:09.751054] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-10-21T20:25:10.241608] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T20:25:10.270860] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-21T20:25:10.551080] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-10-21T20:25:11.351086] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-10. [2025-10-21T20:25:11.962764] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-21T20:25:12.151063] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-10-21T20:25:12.951057] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-10-21T20:25:12.985375] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-10-21T20:25:13.470792] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-21T20:25:13.478176] [INFO ] [REMOTE ] ONTO: Full fetch complete (67281 records). [2025-10-21T20:25:13.478288] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-10-21T20:25:13.761356] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-10. [2025-10-21T20:25:13.896105] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-10-21T20:25:13.896184] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-10-21T20:25:13.897203] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-10-21T20:25:13.897265] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-10-21T20:25:13.898469] [DEBUG] [LOCAL ] ONTO: Trimmed 67281 records to 47225 (keeping 200 days of data) [2025-10-21T20:25:14.090541] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T20:25:14.197256] [DEBUG] [LOCAL ] ONTO: Primary data saved (47225 records). [2025-10-21T20:25:14.197389] [INFO ] [MAIN ] ONTO: Full history saved. [2025-10-21T20:25:14.197459] [INFO ] [MAIN ] Update Progress: 1595/2366 symbols completed. ONTO took 43.5s. Estimated remaining: 1h 39m 11s. Rate: 7.8 symbols/min [2025-10-21T20:25:14.371723] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:25:14.385908] [DEBUG] [LOCAL ] OPP: Loaded 12377 existing records from primary storage. [2025-10-21T20:25:14.386149] [INFO ] [MAIN ] OPP: Loaded 12377 existing records. [2025-10-21T20:25:14.576025] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-10. [2025-10-21T20:25:14.592932] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:25:14.594125] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-10-21T20:25:14.594349] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-10-21T20:25:14.594706] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-10-21T20:25:14.604107] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-10-21T20:25:14.704063] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-21T20:25:14.981385] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:25:15.351054] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-10-21T20:25:15.652392] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T20:25:15.655450] [INFO ] [REMOTE ] OOMA: Full fetch complete (25794 records). [2025-10-21T20:25:15.655562] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-10-21T20:25:16.059004] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-10-21T20:25:16.060765] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-21T20:25:16.060867] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-10-21T20:25:16.063872] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-10-21T20:25:16.068417] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-10-21T20:25:16.069555] [INFO ] [REMOTE ] OPAD: Full fetch complete (28677 records). [2025-10-21T20:25:16.069778] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-10-21T20:25:16.070110] [DEBUG] [LOCAL ] OOMA: Trimmed 25794 records to 18367 (keeping 200 days of data) [2025-10-21T20:25:16.167008] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-10-21T20:25:16.259881] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T20:25:16.352319] [DEBUG] [LOCAL ] OOMA: Primary data saved (18367 records). [2025-10-21T20:25:16.368675] [INFO ] [MAIN ] OOMA: Full history saved. [2025-10-21T20:25:16.377868] [INFO ] [MAIN ] Update Progress: 1596/2366 symbols completed. OOMA took 26.5s. Estimated remaining: 1h 39m 0s. Rate: 7.8 symbols/min [2025-10-21T20:25:16.737911] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:25:16.738173] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-10-21T20:25:16.738072] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-10-21T20:25:16.738471] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-10-21T20:25:16.739111] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-10-21T20:25:16.739204] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-10-21T20:25:16.739446] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-10-21T20:25:16.739553] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-10-21T20:25:16.739750] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-21T20:25:16.739815] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-21T20:25:16.739880] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-10-21T20:25:16.818343] [DEBUG] [LOCAL ] OPAD: Trimmed 28677 records to 26134 (keeping 200 days of data) [2025-10-21T20:25:16.954140] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-10-21T20:25:17.174810] [DEBUG] [LOCAL ] OPAD: Primary data saved (26134 records). [2025-10-21T20:25:17.180515] [INFO ] [MAIN ] OPAD: Full history saved. [2025-10-21T20:25:17.185706] [INFO ] [MAIN ] Update Progress: 1597/2366 symbols completed. OPAD took 24.3s. Estimated remaining: 1h 38m 49s. Rate: 7.8 symbols/min [2025-10-21T20:25:17.249545] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:25:17.751081] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-10-21T20:25:17.983704] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T20:25:18.276522] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-21T20:25:18.298882] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T20:25:18.551020] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-10-21T20:25:19.351037] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-10-21T20:25:20.151095] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-10-21T20:25:20.263123] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T20:25:20.336580] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T20:25:20.850421] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T20:25:20.951089] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-10-21T20:25:21.751069] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-10-21T20:25:21.899460] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T20:25:22.517963] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T20:25:22.551036] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-10-21T20:25:23.351069] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-10-21T20:25:23.558011] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T20:25:24.151083] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-10-21T20:25:24.951097] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-10-21T20:25:24.999489] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T20:25:25.234116] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T20:25:25.751036] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-10-21T20:25:26.150397] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T20:25:26.551016] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-10-21T20:25:26.742035] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T20:25:27.305716] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T20:25:27.351044] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-10-21T20:25:28.151096] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-10-21T20:25:28.492444] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T20:25:28.951107] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-10-21T20:25:29.055404] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T20:25:29.751058] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-10-21T20:25:29.810469] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T20:25:30.551052] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-10-21T20:25:30.563722] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T20:25:31.351067] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-10-21T20:25:31.393223] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T20:25:32.151026] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-10. [2025-10-21T20:25:32.866632] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T20:25:32.869770] [INFO ] [REMOTE ] OPP: Full fetch complete (17407 records). [2025-10-21T20:25:32.869846] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-10-21T20:25:32.965207] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-10-21T20:25:33.239968] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-10-21T20:25:33.240118] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-10-21T20:25:33.240491] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-10-21T20:25:33.240557] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-10-21T20:25:33.241411] [DEBUG] [LOCAL ] OPP: Trimmed 17407 records to 12372 (keeping 200 days of data) [2025-10-21T20:25:33.317427] [DEBUG] [LOCAL ] OPP: Primary data saved (12372 records). [2025-10-21T20:25:33.317717] [INFO ] [MAIN ] OPP: Full history saved. [2025-10-21T20:25:33.317811] [INFO ] [MAIN ] Update Progress: 1598/2366 symbols completed. OPP took 19.1s. Estimated remaining: 1h 38m 45s. Rate: 7.8 symbols/min [2025-10-21T20:25:33.344098] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-21T20:25:33.751053] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-10-21T20:25:33.913563] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T20:25:34.551199] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-10. [2025-10-21T20:25:35.345849] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T20:25:35.347402] [INFO ] [REMOTE ] OPY: Full fetch complete (10185 records). [2025-10-21T20:25:35.347468] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-10-21T20:25:35.543160] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T20:25:35.543550] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:25:35.543739] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:25:35.543819] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-10-21T20:25:35.543918] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-10-21T20:25:35.544046] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-10-21T20:25:35.544200] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-10-21T20:25:35.544297] [INFO ] [MAIN ] Update Progress: 1599/2366 symbols completed. OPY took 19.1s. Estimated remaining: 1h 38m 35s. Rate: 7.8 symbols/min [2025-10-21T20:25:35.577177] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T20:25:35.587777] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-10-21T20:25:37.569083] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T20:25:37.580573] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-10-21T20:25:39.365881] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T20:25:39.376146] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-10. [2025-10-21T20:25:41.202734] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T20:25:41.209484] [INFO ] [REMOTE ] OPFI: Full fetch complete (68686 records). [2025-10-21T20:25:41.209587] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-10-21T20:25:41.591939] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-10-21T20:25:41.592061] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-10-21T20:25:41.593080] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-10-21T20:25:41.593142] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-10-21T20:25:41.594375] [DEBUG] [LOCAL ] OPFI: Trimmed 68686 records to 46049 (keeping 200 days of data) [2025-10-21T20:25:41.859679] [DEBUG] [LOCAL ] OPFI: Primary data saved (46049 records). [2025-10-21T20:25:41.859805] [INFO ] [MAIN ] OPFI: Full history saved. [2025-10-21T20:25:41.860381] [INFO ] [MAIN ] Update Progress: 1600/2366 symbols completed. OPFI took 33.9s. Estimated remaining: 1h 38m 27s. Rate: 7.8 symbols/min [2025-10-21T20:25:42.394810] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:25:42.429102] [DEBUG] [LOCAL ] ORC: No existing data file found in primary storage. [2025-10-21T20:25:42.456180] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:25:42.487291] [DEBUG] [LOCAL ] ORA: No existing data file found in primary storage. [2025-10-21T20:25:42.448174] [WARN ] [MAIN ] ORC: No existing data found, performing full refresh instead. [2025-10-21T20:25:42.524417] [WARN ] [MAIN ] ORA: No existing data found, performing full refresh instead. [2025-10-21T20:25:42.538586] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-10-21T20:25:42.557251] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:25:42.558125] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:25:42.558385] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-10-21T20:25:42.558834] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-10-21T20:25:42.558945] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-10-21T20:25:42.559037] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-10-21T20:25:42.558584] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-10-21T20:25:42.559567] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-10-21T20:25:42.559514] [DEBUG] [LOCAL ] ORA: No primary data file found to delete. [2025-10-21T20:25:42.559743] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-21T20:25:42.559693] [DEBUG] [LOCAL ] ORC: No primary data file found to delete. [2025-10-21T20:25:42.559924] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-10-21T20:25:42.559992] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-21T20:25:42.560183] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-10-21T20:25:42.560133] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-10-21T20:25:43.400009] [DEBUG] [LOCAL ] OR: Loaded 46804 existing records from primary storage. [2025-10-21T20:25:43.575199] [INFO ] [MAIN ] OR: Loaded 46804 existing records. [2025-10-21T20:25:43.609000] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:25:43.641953] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:25:43.656500] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-10-21T20:25:43.667137] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-10-21T20:25:43.862911] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:25:43.883074] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-10-21T20:25:43.882823] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:25:43.883456] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-10-21T20:25:43.884296] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-10-21T20:25:43.884548] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-10-21T20:25:43.884604] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-10-21T20:25:44.230426] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:25:44.230790] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-10-21T20:25:45.596536] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T20:25:45.605595] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-10-21T20:25:45.883235] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T20:25:45.893547] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-10-21T20:25:45.917792] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T20:25:45.926502] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-10-21T20:25:46.486797] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-10-21T20:25:46.497335] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-10-21T20:25:46.740047] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T20:25:46.746822] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-10-21T20:25:47.540900] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T20:25:47.549297] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-10-21T20:25:47.848144] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-21T20:25:47.857892] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-10-21T20:25:48.393574] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T20:25:48.401271] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-10-21T20:25:48.951878] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-21T20:25:48.962671] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-10-21T20:25:48.988765] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T20:25:48.998776] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-10-21T20:25:49.629011] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-21T20:25:49.636312] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-10-21T20:25:49.852458] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T20:25:49.862866] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-10-21T20:25:51.005454] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T20:25:51.015802] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-10-21T20:25:51.189413] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T20:25:51.351039] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-10-21T20:25:51.608897] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-21T20:25:52.151015] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-10-21T20:25:52.541275] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-21T20:25:52.785682] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T20:25:52.814503] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T20:25:52.951034] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-10-21T20:25:53.751142] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-10-21T20:25:54.551039] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-10-21T20:25:54.638455] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T20:25:54.755295] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-21T20:25:55.351070] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-10-21T20:25:55.995637] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-21T20:25:56.150992] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-10-21T20:25:56.302016] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T20:25:56.954181] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-10-21T20:25:56.956528] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T20:25:57.751044] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-10-21T20:25:58.251718] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-21T20:25:58.551060] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-10-21T20:25:58.800214] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T20:25:59.175135] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T20:25:59.351079] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-10-21T20:26:00.151083] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-10-21T20:26:00.883186] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T20:26:00.951059] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-10. [2025-10-21T20:26:01.483506] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T20:26:01.543261] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T20:26:01.750999] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-10-21T20:26:02.168006] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T20:26:02.174062] [INFO ] [REMOTE ] ORA: Full fetch complete (49025 records). [2025-10-21T20:26:02.174205] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-10-21T20:26:02.551372] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-10-21T20:26:02.551494] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-10-21T20:26:02.551180] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-10-21T20:26:02.552442] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-10-21T20:26:02.552556] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-10-21T20:26:02.554207] [DEBUG] [LOCAL ] ORA: Trimmed 49025 records to 33184 (keeping 200 days of data) [2025-10-21T20:26:02.755407] [DEBUG] [LOCAL ] ORA: Primary data saved (33184 records). [2025-10-21T20:26:02.755529] [INFO ] [MAIN ] ORA: Full history saved. [2025-10-21T20:26:02.755596] [INFO ] [MAIN ] Update Progress: 1601/2366 symbols completed. ORA took 20.9s. Estimated remaining: 1h 38m 25s. Rate: 7.8 symbols/min [2025-10-21T20:26:02.925300] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:26:02.925455] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-10-21T20:26:02.925492] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-10-21T20:26:02.925599] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-10-21T20:26:02.925638] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-21T20:26:02.925726] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-21T20:26:02.925761] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-10-21T20:26:03.276195] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:26:03.351004] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-10-21T20:26:04.151060] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-10-21T20:26:04.460399] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-21T20:26:04.621901] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-21T20:26:04.951096] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-10-21T20:26:05.159532] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T20:26:05.751029] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-10-21T20:26:06.431984] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-21T20:26:06.550997] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-10-21T20:26:07.350986] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-10. [2025-10-21T20:26:07.494937] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T20:26:07.618198] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-21T20:26:08.151005] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-10-21T20:26:08.429702] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T20:26:08.950993] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-10. [2025-10-21T20:26:09.334490] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T20:26:09.342698] [INFO ] [REMOTE ] OR: Full fetch complete (66775 records). [2025-10-21T20:26:09.342822] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-10-21T20:26:09.718772] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-10-21T20:26:09.718949] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-10-21T20:26:09.720105] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-10-21T20:26:09.720183] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-10-21T20:26:09.721519] [DEBUG] [LOCAL ] OR: Trimmed 66775 records to 46840 (keeping 200 days of data) [2025-10-21T20:26:09.773099] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-10-21T20:26:10.026608] [DEBUG] [LOCAL ] OR: Primary data saved (46840 records). [2025-10-21T20:26:10.026782] [INFO ] [MAIN ] OR: Full history saved. [2025-10-21T20:26:10.026877] [INFO ] [MAIN ] Update Progress: 1602/2366 symbols completed. OR took 28.2s. Estimated remaining: 1h 38m 17s. Rate: 7.8 symbols/min [2025-10-21T20:26:10.197119] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:26:10.226187] [DEBUG] [LOCAL ] ORN: Loaded 30941 existing records from primary storage. [2025-10-21T20:26:10.226442] [INFO ] [MAIN ] ORN: Loaded 30941 existing records. [2025-10-21T20:26:10.399494] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:26:10.399776] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-10-21T20:26:10.399840] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-10-21T20:26:10.400142] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-10-21T20:26:10.400201] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-10-21T20:26:10.782742] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:26:10.783204] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-10-21T20:26:10.999592] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-21T20:26:11.143320] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-21T20:26:11.152555] [INFO ] [REMOTE ] ORC: Full fetch complete (75574 records). [2025-10-21T20:26:11.152741] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-10-21T20:26:11.356374] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-10-21T20:26:11.540803] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-10-21T20:26:11.540883] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-10-21T20:26:11.541979] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-10-21T20:26:11.542044] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-10-21T20:26:11.543477] [DEBUG] [LOCAL ] ORC: Trimmed 75574 records to 52485 (keeping 200 days of data) [2025-10-21T20:26:11.877802] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-21T20:26:11.905438] [DEBUG] [LOCAL ] ORC: Primary data saved (52485 records). [2025-10-21T20:26:11.905568] [INFO ] [MAIN ] ORC: Full history saved. [2025-10-21T20:26:11.905667] [INFO ] [MAIN ] Update Progress: 1603/2366 symbols completed. ORC took 30.0s. Estimated remaining: 1h 38m 7s. Rate: 7.8 symbols/min [2025-10-21T20:26:12.101159] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:26:12.101336] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-10-21T20:26:12.101389] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-10-21T20:26:12.101515] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-10-21T20:26:12.101569] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-10-21T20:26:12.101614] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-10-21T20:26:12.101672] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-10-21T20:26:12.162288] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-10-21T20:26:12.432818] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T20:26:12.511149] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:26:12.951023] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-10-21T20:26:13.751070] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-10-21T20:26:13.982990] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-21T20:26:14.075238] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T20:26:14.554780] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-10-21T20:26:14.559729] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T20:26:14.771360] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T20:26:15.351072] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-10-21T20:26:16.156612] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-10-21T20:26:16.169078] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T20:26:16.951040] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-10. [2025-10-21T20:26:17.216563] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T20:26:17.672065] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T20:26:17.751021] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-10-21T20:26:17.860185] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T20:26:17.868328] [INFO ] [REMOTE ] ORCL: Full fetch complete (77213 records). [2025-10-21T20:26:17.868483] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-10-21T20:26:17.869252] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T20:26:17.869352] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:26:17.869394] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:26:17.869433] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-10-21T20:26:17.869490] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-10-21T20:26:17.869524] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-10-21T20:26:17.869564] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-10-21T20:26:17.869617] [INFO ] [MAIN ] Update Progress: 1604/2366 symbols completed. ORCL took 36.0s. Estimated remaining: 1h 37m 58s. Rate: 7.8 symbols/min [2025-10-21T20:26:18.039496] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:26:18.039696] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-10-21T20:26:18.039746] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-10-21T20:26:18.039854] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-10-21T20:26:18.039894] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-21T20:26:18.039933] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-21T20:26:18.039964] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-10-21T20:26:18.391588] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:26:18.551054] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-10-21T20:26:19.351006] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-10-21T20:26:19.455309] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T20:26:20.019836] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T20:26:20.151089] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-10-21T20:26:20.951013] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-10-21T20:26:21.244737] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T20:26:21.751043] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-10-21T20:26:22.042553] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T20:26:22.402237] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T20:26:22.551038] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-10-21T20:26:23.343947] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T20:26:23.352571] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-10-21T20:26:24.104462] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T20:26:24.151045] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-10-21T20:26:24.951021] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-10-21T20:26:25.474219] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-21T20:26:25.533835] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T20:26:25.751074] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-10-21T20:26:26.424583] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T20:26:26.551120] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-10-21T20:26:27.350997] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-10-21T20:26:27.427494] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T20:26:28.131727] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T20:26:28.151081] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-10-21T20:26:28.951025] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-10-21T20:26:29.132135] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T20:26:29.751047] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-10. [2025-10-21T20:26:29.866186] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T20:26:30.551072] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-10-21T20:26:31.011969] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T20:26:31.350994] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-10-21T20:26:31.613132] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T20:26:31.622688] [INFO ] [REMOTE ] ORI: Full fetch complete (70489 records). [2025-10-21T20:26:31.622897] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-10-21T20:26:31.824480] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T20:26:31.825369] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:26:31.825524] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:26:31.825709] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-10-21T20:26:31.825790] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-10-21T20:26:31.825828] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-10-21T20:26:31.825866] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-10-21T20:26:31.825921] [INFO ] [MAIN ] Update Progress: 1605/2366 symbols completed. ORI took 29.1s. Estimated remaining: 1h 37m 54s. Rate: 7.8 symbols/min [2025-10-21T20:26:31.997134] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:26:31.997489] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-10-21T20:26:31.997559] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-10-21T20:26:31.997851] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-10-21T20:26:31.998082] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-21T20:26:31.998227] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-21T20:26:31.998299] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-10-21T20:26:32.158179] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-10-21T20:26:32.170728] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-21T20:26:32.404381] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:26:32.684692] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T20:26:32.951039] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-10-21T20:26:33.751071] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-10-21T20:26:34.551047] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-10-21T20:26:34.761526] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-21T20:26:34.801276] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T20:26:34.863406] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:26:34.863824] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-10-21T20:26:34.863924] [FATAL] [REMOTE ] OTF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:26:34.864020] [FATAL] [MAIN ] OTF: Failed to fetch primary data. [2025-10-21T20:26:34.864103] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:26:34.864191] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-10-21T20:26:34.864279] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-10-21T20:26:34.864333] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-10-21T20:26:34.864395] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-10-21T20:26:34.864461] [INFO ] [MAIN ] Update Progress: 1606/2366 symbols completed. OTF took 3.0s. Estimated remaining: 1h 37m 44s. Rate: 7.8 symbols/min [2025-10-21T20:26:35.057018] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:26:35.057250] [DEBUG] [LOCAL ] OTIS: No existing data file found in primary storage. [2025-10-21T20:26:35.057303] [WARN ] [MAIN ] OTIS: No existing data found, performing full refresh instead. [2025-10-21T20:26:35.057410] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-10-21T20:26:35.057450] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-10-21T20:26:35.057491] [DEBUG] [LOCAL ] OTIS: No primary data file found to delete. [2025-10-21T20:26:35.057521] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-10-21T20:26:35.355022] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-10-21T20:26:35.460127] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:26:35.462010] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T20:26:36.151076] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-10-21T20:26:36.951030] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-10-21T20:26:37.751109] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-10. [2025-10-21T20:26:38.066122] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T20:26:38.158910] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-21T20:26:38.551014] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-10-21T20:26:38.660902] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T20:26:38.756892] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T20:26:38.761354] [INFO ] [REMOTE ] ORN: Full fetch complete (45551 records). [2025-10-21T20:26:38.761442] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-10-21T20:26:39.133514] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-10-21T20:26:39.133592] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-10-21T20:26:39.134443] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-10-21T20:26:39.134535] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-10-21T20:26:39.135515] [DEBUG] [LOCAL ] ORN: Trimmed 45551 records to 30771 (keeping 200 days of data) [2025-10-21T20:26:39.302836] [DEBUG] [LOCAL ] ORN: Primary data saved (30771 records). [2025-10-21T20:26:39.302967] [INFO ] [MAIN ] ORN: Full history saved. [2025-10-21T20:26:39.303045] [INFO ] [MAIN ] Update Progress: 1607/2366 symbols completed. ORN took 29.3s. Estimated remaining: 1h 37m 34s. Rate: 7.8 symbols/min [2025-10-21T20:26:39.356784] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-10-21T20:26:39.471194] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:26:39.471334] [DEBUG] [LOCAL ] OUT: No existing data file found in primary storage. [2025-10-21T20:26:39.471369] [WARN ] [MAIN ] OUT: No existing data found, performing full refresh instead. [2025-10-21T20:26:39.471476] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-10-21T20:26:39.471515] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-10-21T20:26:39.471554] [DEBUG] [LOCAL ] OUT: No primary data file found to delete. [2025-10-21T20:26:39.471585] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-10-21T20:26:39.831451] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:26:40.150994] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-10-21T20:26:40.347397] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T20:26:40.951002] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-10-21T20:26:41.100409] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T20:26:41.751049] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-10. [2025-10-21T20:26:41.828374] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T20:26:42.551044] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-10-21T20:26:42.858117] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T20:26:43.351049] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-10-21T20:26:43.445633] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T20:26:43.452579] [INFO ] [REMOTE ] OSK: Full fetch complete (61278 records). [2025-10-21T20:26:43.452745] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-10-21T20:26:43.641685] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T20:26:43.642324] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:26:43.642395] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:26:43.642469] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-10-21T20:26:43.642534] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-10-21T20:26:43.642570] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-10-21T20:26:43.642608] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-10-21T20:26:43.642688] [INFO ] [MAIN ] Update Progress: 1608/2366 symbols completed. OSK took 25.8s. Estimated remaining: 1h 37m 25s. Rate: 7.8 symbols/min [2025-10-21T20:26:43.814600] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:26:43.814862] [DEBUG] [LOCAL ] OVV: No existing data file found in primary storage. [2025-10-21T20:26:43.814923] [WARN ] [MAIN ] OVV: No existing data found, performing full refresh instead. [2025-10-21T20:26:43.815066] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-10-21T20:26:43.815125] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-10-21T20:26:43.815173] [DEBUG] [LOCAL ] OVV: No primary data file found to delete. [2025-10-21T20:26:43.815225] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-10-21T20:26:44.159693] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-10-21T20:26:44.191566] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:26:44.228126] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T20:26:44.951035] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-10-21T20:26:45.288522] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T20:26:45.751079] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-10-21T20:26:46.551018] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-10-21T20:26:46.847934] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T20:26:47.198538] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.04 seconds). [2025-10-21T20:26:47.351037] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-10-21T20:26:47.792094] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-21T20:26:48.151076] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-10-21T20:26:48.362356] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T20:26:48.951074] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-10-21T20:26:49.751063] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-10-21T20:26:50.038110] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T20:26:50.088835] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-21T20:26:50.551068] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-10-21T20:26:50.891710] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T20:26:51.351010] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-10-21T20:26:51.546595] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T20:26:52.150990] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-10-21T20:26:52.506663] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T20:26:52.951035] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-10-21T20:26:53.751065] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-10-21T20:26:53.943417] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T20:26:53.993802] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-21T20:26:54.551039] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-10-21T20:26:54.967569] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T20:26:55.165851] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T20:26:55.351000] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-10-21T20:26:55.942223] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T20:26:56.151013] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-10-21T20:26:56.951011] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-10. [2025-10-21T20:26:57.358156] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T20:26:57.751014] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-10-21T20:26:58.003509] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T20:26:58.551015] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-10-21T20:26:59.350994] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-10. [2025-10-21T20:26:59.688104] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T20:26:59.720588] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-21T20:26:59.728953] [INFO ] [REMOTE ] OSCR: Full fetch complete (77747 records). [2025-10-21T20:26:59.729088] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-10-21T20:27:00.154001] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-10-21T20:27:00.183503] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-10-21T20:27:00.183672] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-10-21T20:27:00.184981] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-10-21T20:27:00.185141] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-10-21T20:27:00.186597] [DEBUG] [LOCAL ] OSCR: Trimmed 77747 records to 53769 (keeping 200 days of data) [2025-10-21T20:27:00.427237] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T20:27:00.567022] [DEBUG] [LOCAL ] OSCR: Primary data saved (53769 records). [2025-10-21T20:27:00.567155] [INFO ] [MAIN ] OSCR: Full history saved. [2025-10-21T20:27:00.567227] [INFO ] [MAIN ] Update Progress: 1609/2366 symbols completed. OSCR took 48.7s. Estimated remaining: 1h 37m 22s. Rate: 7.8 symbols/min [2025-10-21T20:27:00.735241] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:27:00.735470] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-10-21T20:27:00.735512] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-10-21T20:27:00.735621] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-10-21T20:27:00.735694] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-10-21T20:27:00.735749] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-10-21T20:27:00.735782] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-10-21T20:27:00.969435] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-10-21T20:27:01.085167] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:27:01.315906] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T20:27:01.323985] [INFO ] [REMOTE ] OTIS: Full fetch complete (76388 records). [2025-10-21T20:27:01.324111] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-10-21T20:27:01.715404] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-10-21T20:27:01.715481] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-10-21T20:27:01.716564] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-10-21T20:27:01.716625] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-10-21T20:27:01.718009] [DEBUG] [LOCAL ] OTIS: Trimmed 76388 records to 52718 (keeping 200 days of data) [2025-10-21T20:27:01.773110] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-10-21T20:27:02.051497] [DEBUG] [LOCAL ] OTIS: Primary data saved (52718 records). [2025-10-21T20:27:02.051784] [INFO ] [MAIN ] OTIS: Full history saved. [2025-10-21T20:27:02.051923] [INFO ] [MAIN ] Update Progress: 1610/2366 symbols completed. OTIS took 27.2s. Estimated remaining: 1h 37m 11s. Rate: 7.8 symbols/min [2025-10-21T20:27:02.229639] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:27:02.239979] [DEBUG] [LOCAL ] OWLT: Loaded 9504 existing records from primary storage. [2025-10-21T20:27:02.240190] [INFO ] [MAIN ] OWLT: Loaded 9504 existing records. [2025-10-21T20:27:02.375126] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-21T20:27:02.465735] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:27:02.465978] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-10-21T20:27:02.466026] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-10-21T20:27:02.466210] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-10-21T20:27:02.466268] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-10-21T20:27:02.556138] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-10-21T20:27:02.819806] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:27:02.901315] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T20:27:03.351046] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-10. [2025-10-21T20:27:03.847103] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T20:27:04.151024] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-10-21T20:27:04.461237] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T20:27:04.951094] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-10-21T20:27:05.099778] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T20:27:05.107040] [INFO ] [REMOTE ] OUT: Full fetch complete (69139 records). [2025-10-21T20:27:05.107177] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-10-21T20:27:05.525099] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-10-21T20:27:05.525188] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-10-21T20:27:05.526234] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-10-21T20:27:05.526296] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-10-21T20:27:05.527710] [DEBUG] [LOCAL ] OUT: Trimmed 69139 records to 47722 (keeping 200 days of data) [2025-10-21T20:27:05.764046] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-10-21T20:27:05.846454] [DEBUG] [LOCAL ] OUT: Primary data saved (47722 records). [2025-10-21T20:27:05.846613] [INFO ] [MAIN ] OUT: Full history saved. [2025-10-21T20:27:05.846893] [INFO ] [MAIN ] Update Progress: 1611/2366 symbols completed. OUT took 26.5s. Estimated remaining: 1h 37m 2s. Rate: 7.8 symbols/min [2025-10-21T20:27:05.848735] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T20:27:06.024423] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:27:06.024585] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-10-21T20:27:06.024627] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-10-21T20:27:06.024752] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-10-21T20:27:06.024792] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-10-21T20:27:06.024832] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-10-21T20:27:06.024863] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-10-21T20:27:06.373622] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:27:06.378021] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-21T20:27:06.533850] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T20:27:06.550979] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-10-21T20:27:07.351006] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-10-21T20:27:07.920256] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T20:27:08.042787] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T20:27:08.151039] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-10-21T20:27:08.950997] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-10-21T20:27:09.038097] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T20:27:09.751078] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-10-21T20:27:10.349433] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T20:27:10.506979] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T20:27:10.551019] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-10-21T20:27:11.245354] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T20:27:11.351061] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-10-21T20:27:12.151028] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-10-21T20:27:12.951021] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-10-21T20:27:13.316756] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T20:27:13.756101] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-10-21T20:27:13.765694] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T20:27:13.940386] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T20:27:14.551014] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-10-21T20:27:15.351007] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-10-21T20:27:15.841434] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T20:27:16.151063] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-10-21T20:27:16.415502] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T20:27:16.567709] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T20:27:16.951071] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-10-21T20:27:17.751007] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-10-21T20:27:17.830241] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T20:27:18.553215] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-10. [2025-10-21T20:27:18.557965] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T20:27:19.351037] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-10-21T20:27:19.687906] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T20:27:20.072773] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T20:27:20.081167] [INFO ] [REMOTE ] OVV: Full fetch complete (77484 records). [2025-10-21T20:27:20.081326] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-10-21T20:27:20.157230] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-10-21T20:27:20.483748] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-10-21T20:27:20.483829] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-10-21T20:27:20.484952] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-10-21T20:27:20.485020] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-10-21T20:27:20.486467] [DEBUG] [LOCAL ] OVV: Trimmed 77484 records to 53467 (keeping 200 days of data) [2025-10-21T20:27:20.805955] [DEBUG] [LOCAL ] OVV: Primary data saved (53467 records). [2025-10-21T20:27:20.806088] [INFO ] [MAIN ] OVV: Full history saved. [2025-10-21T20:27:20.806157] [INFO ] [MAIN ] Update Progress: 1612/2366 symbols completed. OVV took 37.2s. Estimated remaining: 1h 36m 57s. Rate: 7.8 symbols/min [2025-10-21T20:27:20.976462] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-10-21T20:27:20.976373] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:27:20.977876] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-10-21T20:27:20.977971] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-10-21T20:27:20.978120] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-10-21T20:27:20.984570] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-21T20:27:20.995310] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-21T20:27:20.995696] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-10-21T20:27:21.030344] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T20:27:21.392257] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:27:21.751031] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-10-21T20:27:21.950887] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T20:27:22.203625] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T20:27:22.551030] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-10-21T20:27:23.350999] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-10-21T20:27:24.151033] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-10-21T20:27:24.275302] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T20:27:24.280910] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T20:27:24.465686] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-21T20:27:24.951081] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-10-21T20:27:25.751008] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-10-21T20:27:26.143110] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T20:27:26.551072] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-10-21T20:27:27.344461] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T20:27:27.351741] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-10. [2025-10-21T20:27:27.448548] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-10-21T20:27:28.151121] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-10-21T20:27:28.267476] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T20:27:28.270163] [INFO ] [REMOTE ] OWLT: Full fetch complete (12174 records). [2025-10-21T20:27:28.270241] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-10-21T20:27:28.650669] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-10-21T20:27:28.650821] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-10-21T20:27:28.651202] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-10-21T20:27:28.651321] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-10-21T20:27:28.661983] [DEBUG] [LOCAL ] OWLT: Trimmed 12174 records to 9535 (keeping 200 days of data) [2025-10-21T20:27:28.682322] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T20:27:28.746812] [DEBUG] [LOCAL ] OWLT: Primary data saved (9535 records). [2025-10-21T20:27:28.746947] [INFO ] [MAIN ] OWLT: Full history saved. [2025-10-21T20:27:28.747024] [INFO ] [MAIN ] Update Progress: 1613/2366 symbols completed. OWLT took 26.7s. Estimated remaining: 1h 36m 50s. Rate: 7.8 symbols/min [2025-10-21T20:27:28.925089] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:27:28.925295] [DEBUG] [LOCAL ] PAAS: No existing data file found in primary storage. [2025-10-21T20:27:28.925361] [WARN ] [MAIN ] PAAS: No existing data found, performing full refresh instead. [2025-10-21T20:27:28.925505] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-10-21T20:27:28.925577] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-10-21T20:27:28.925624] [DEBUG] [LOCAL ] PAAS: No primary data file found to delete. [2025-10-21T20:27:28.925689] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-10-21T20:27:28.957535] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-10-21T20:27:29.285928] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:27:29.602615] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T20:27:29.751061] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-10-21T20:27:30.551088] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-10-21T20:27:30.988354] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T20:27:31.295477] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T20:27:31.350998] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-10. [2025-10-21T20:27:32.151032] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-10. [2025-10-21T20:27:32.712470] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T20:27:32.717696] [INFO ] [REMOTE ] OXM: Full fetch complete (46333 records). [2025-10-21T20:27:32.717788] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-10-21T20:27:32.961512] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-10-21T20:27:33.160007] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-10-21T20:27:33.160102] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-10-21T20:27:33.161141] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-10-21T20:27:33.161221] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-10-21T20:27:33.162407] [DEBUG] [LOCAL ] OXM: Trimmed 46333 records to 33200 (keeping 200 days of data) [2025-10-21T20:27:33.286148] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-21T20:27:33.400713] [DEBUG] [LOCAL ] OXM: Primary data saved (33200 records). [2025-10-21T20:27:33.400840] [INFO ] [MAIN ] OXM: Full history saved. [2025-10-21T20:27:33.400907] [INFO ] [MAIN ] Update Progress: 1614/2366 symbols completed. OXM took 27.6s. Estimated remaining: 1h 36m 40s. Rate: 7.8 symbols/min [2025-10-21T20:27:33.566731] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:27:33.580074] [DEBUG] [LOCAL ] PAC: Loaded 11741 existing records from primary storage. [2025-10-21T20:27:33.580298] [INFO ] [MAIN ] PAC: Loaded 11741 existing records. [2025-10-21T20:27:33.758756] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:27:33.754029] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-10-21T20:27:33.759012] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-10-21T20:27:33.759782] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-10-21T20:27:33.759951] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-10-21T20:27:33.759990] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-10-21T20:27:34.113700] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:27:34.167361] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-21T20:27:34.175436] [INFO ] [REMOTE ] OWL: Full fetch complete (77711 records). [2025-10-21T20:27:34.175547] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-10-21T20:27:34.557017] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-10-21T20:27:34.556385] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-10-21T20:27:34.557133] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-10-21T20:27:34.558305] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-10-21T20:27:34.559105] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-10-21T20:27:34.560615] [DEBUG] [LOCAL ] OWL: Trimmed 77711 records to 53557 (keeping 200 days of data) [2025-10-21T20:27:34.877936] [DEBUG] [LOCAL ] OWL: Primary data saved (53557 records). [2025-10-21T20:27:34.878055] [INFO ] [MAIN ] OWL: Full history saved. [2025-10-21T20:27:34.878123] [INFO ] [MAIN ] Update Progress: 1615/2366 symbols completed. OWL took 34.3s. Estimated remaining: 1h 36m 30s. Rate: 7.8 symbols/min [2025-10-21T20:27:35.050413] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:27:35.078802] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-21T20:27:35.113380] [DEBUG] [LOCAL ] PACK: Loaded 32000 existing records from primary storage. [2025-10-21T20:27:35.113630] [INFO ] [MAIN ] PACK: Loaded 32000 existing records. [2025-10-21T20:27:35.285205] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:27:35.285395] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-10-21T20:27:35.285440] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-10-21T20:27:35.285610] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-10-21T20:27:35.285676] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-10-21T20:27:35.356518] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-10-21T20:27:35.647908] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:27:35.655048] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T20:27:36.151008] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-10-21T20:27:36.514139] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-21T20:27:36.950995] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-10-21T20:27:37.359414] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-21T20:27:37.489252] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T20:27:37.751017] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-10-21T20:27:38.551002] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-10-21T20:27:38.712025] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T20:27:39.351056] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-10-21T20:27:39.669801] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-10-21T20:27:40.151054] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-10-21T20:27:40.337522] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T20:27:40.776415] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-21T20:27:40.951022] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-10-21T20:27:41.439996] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T20:27:41.751073] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-10-21T20:27:42.551155] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-10-21T20:27:42.882416] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T20:27:43.133326] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T20:27:43.351028] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-10-21T20:27:44.151071] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-10-21T20:27:44.951091] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-10-21T20:27:45.086953] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-21T20:27:45.254442] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T20:27:45.499560] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T20:27:45.751017] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-10-21T20:27:46.551038] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-10-21T20:27:46.658831] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T20:27:46.798709] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T20:27:47.351082] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-10-21T20:27:48.150995] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-10-21T20:27:48.359486] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T20:27:48.950997] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-10-21T20:27:49.463364] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-21T20:27:49.751018] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-10-21T20:27:49.828519] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T20:27:50.291496] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-21T20:27:50.551014] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-10-21T20:27:51.154032] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T20:27:51.207918] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-21T20:27:51.351068] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-10-21T20:27:52.151034] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-10-21T20:27:52.951095] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-10. [2025-10-21T20:27:53.751013] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-10-21T20:27:53.906068] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-21T20:27:53.939387] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T20:27:53.941766] [INFO ] [REMOTE ] PAC: Full fetch complete (16808 records). [2025-10-21T20:27:53.941843] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-10-21T20:27:54.330683] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-10-21T20:27:54.330871] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-10-21T20:27:54.331249] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-10-21T20:27:54.331353] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-10-21T20:27:54.332052] [DEBUG] [LOCAL ] PAC: Trimmed 16808 records to 11632 (keeping 200 days of data) [2025-10-21T20:27:54.426302] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-21T20:27:54.436306] [DEBUG] [LOCAL ] PAC: Primary data saved (11632 records). [2025-10-21T20:27:54.449142] [INFO ] [MAIN ] PAC: Full history saved. [2025-10-21T20:27:54.449274] [INFO ] [MAIN ] Update Progress: 1616/2366 symbols completed. PAC took 21.0s. Estimated remaining: 1h 36m 28s. Rate: 7.8 symbols/min [2025-10-21T20:27:54.556171] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-10-21T20:27:54.619330] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:27:54.652487] [DEBUG] [LOCAL ] PACS: Loaded 34736 existing records from primary storage. [2025-10-21T20:27:54.652786] [INFO ] [MAIN ] PACS: Loaded 34736 existing records. [2025-10-21T20:27:54.831226] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:27:54.832257] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-10-21T20:27:54.832315] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-10-21T20:27:54.833000] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-10-21T20:27:54.833058] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-10-21T20:27:55.185160] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:27:55.308542] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T20:27:55.350999] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-10-21T20:27:56.151061] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-10-21T20:27:56.934406] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T20:27:56.950980] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-10-21T20:27:57.303796] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-21T20:27:57.420042] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T20:27:57.751058] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-10-21T20:27:58.448799] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T20:27:58.551025] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-10-21T20:27:59.351034] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-10. [2025-10-21T20:28:00.040466] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T20:28:00.111066] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T20:28:00.151002] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-10-21T20:28:00.228546] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T20:28:00.236348] [INFO ] [REMOTE ] OXY: Full fetch complete (77195 records). [2025-10-21T20:28:00.236488] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-10-21T20:28:00.237181] [FATAL] [VALIDATOR ] OXY: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T20:28:00.237266] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:28:00.237309] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:28:00.237346] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-10-21T20:28:00.237404] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-10-21T20:28:00.237439] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-10-21T20:28:00.237524] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-10-21T20:28:00.237585] [INFO ] [MAIN ] Update Progress: 1617/2366 symbols completed. OXY took 39.4s. Estimated remaining: 1h 36m 19s. Rate: 7.8 symbols/min [2025-10-21T20:28:00.404503] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:00.404712] [DEBUG] [LOCAL ] PAG: No existing data file found in primary storage. [2025-10-21T20:28:00.404761] [WARN ] [MAIN ] PAG: No existing data found, performing full refresh instead. [2025-10-21T20:28:00.404869] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-10-21T20:28:00.404909] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-10-21T20:28:00.404950] [DEBUG] [LOCAL ] PAG: No primary data file found to delete. [2025-10-21T20:28:00.404980] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-10-21T20:28:00.760254] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:00.951029] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-10-21T20:28:01.751048] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-10-21T20:28:02.396759] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T20:28:02.459346] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-21T20:28:02.550998] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-10-21T20:28:03.249631] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T20:28:03.351051] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-10-21T20:28:04.151069] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-10-21T20:28:04.262103] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T20:28:04.668937] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:28:04.951064] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-10. [2025-10-21T20:28:05.597945] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T20:28:05.751052] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-10-21T20:28:06.551023] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-10-21T20:28:07.026013] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T20:28:07.182938] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-21T20:28:07.192243] [INFO ] [REMOTE ] PAAS: Full fetch complete (77645 records). [2025-10-21T20:28:07.192383] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-10-21T20:28:07.354352] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-10-21T20:28:07.610968] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-10-21T20:28:07.611046] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-10-21T20:28:07.612208] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-10-21T20:28:07.612271] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-10-21T20:28:07.613639] [DEBUG] [LOCAL ] PAAS: Trimmed 77645 records to 53625 (keeping 200 days of data) [2025-10-21T20:28:07.958833] [DEBUG] [LOCAL ] PAAS: Primary data saved (53625 records). [2025-10-21T20:28:07.958984] [INFO ] [MAIN ] PAAS: Full history saved. [2025-10-21T20:28:07.959108] [INFO ] [MAIN ] Update Progress: 1618/2366 symbols completed. PAAS took 39.2s. Estimated remaining: 1h 36m 11s. Rate: 7.8 symbols/min [2025-10-21T20:28:08.145029] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:08.145301] [DEBUG] [LOCAL ] PAGS: No existing data file found in primary storage. [2025-10-21T20:28:08.145420] [WARN ] [MAIN ] PAGS: No existing data found, performing full refresh instead. [2025-10-21T20:28:08.145609] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-10-21T20:28:08.145697] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-10-21T20:28:08.145823] [DEBUG] [LOCAL ] PAGS: No primary data file found to delete. [2025-10-21T20:28:08.145880] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-10-21T20:28:08.166588] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-10-21T20:28:08.275287] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T20:28:08.525913] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:08.768897] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-21T20:28:08.951050] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-10. [2025-10-21T20:28:09.755928] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-10-21T20:28:09.762095] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T20:28:10.457506] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T20:28:10.464276] [INFO ] [REMOTE ] PACK: Full fetch complete (45262 records). [2025-10-21T20:28:10.464433] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-10-21T20:28:10.557109] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-10-21T20:28:10.841508] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-10-21T20:28:10.841589] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-10-21T20:28:10.842422] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-10-21T20:28:10.842487] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-10-21T20:28:10.843393] [DEBUG] [LOCAL ] PACK: Trimmed 45262 records to 31920 (keeping 200 days of data) [2025-10-21T20:28:11.015674] [DEBUG] [LOCAL ] PACK: Primary data saved (31920 records). [2025-10-21T20:28:11.015802] [INFO ] [MAIN ] PACK: Full history saved. [2025-10-21T20:28:11.016451] [INFO ] [MAIN ] Update Progress: 1619/2366 symbols completed. PACK took 36.1s. Estimated remaining: 1h 36m 1s. Rate: 7.8 symbols/min [2025-10-21T20:28:11.187132] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:11.193211] [DEBUG] [LOCAL ] PAI: Loaded 2814 existing records from primary storage. [2025-10-21T20:28:11.193384] [INFO ] [MAIN ] PAI: Loaded 2814 existing records. [2025-10-21T20:28:11.367385] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-10-21T20:28:11.372282] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:28:11.373307] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-10-21T20:28:11.373368] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-10-21T20:28:11.373529] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-10-21T20:28:11.373584] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-10-21T20:28:11.743558] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:11.771575] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-21T20:28:12.132338] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T20:28:12.150981] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-10-21T20:28:12.959151] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-10-21T20:28:12.965033] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T20:28:13.511093] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T20:28:13.751043] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-10-21T20:28:14.551068] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-10-21T20:28:14.930691] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T20:28:15.292742] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T20:28:15.351035] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-10-21T20:28:15.402611] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T20:28:15.980521] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-21T20:28:16.151075] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-10-21T20:28:16.951032] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-10-21T20:28:17.558927] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T20:28:17.750993] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-10-21T20:28:18.045695] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T20:28:18.345485] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T20:28:18.551039] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-10-21T20:28:19.242180] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T20:28:19.351156] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-10-21T20:28:20.151010] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-10. [2025-10-21T20:28:20.520885] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T20:28:20.951074] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-10-21T20:28:21.728489] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T20:28:21.734264] [INFO ] [REMOTE ] PACS: Full fetch complete (50448 records). [2025-10-21T20:28:21.734343] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-10-21T20:28:21.756825] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-10-21T20:28:22.105419] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-10-21T20:28:22.105494] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-10-21T20:28:22.106329] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-10-21T20:28:22.106389] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-10-21T20:28:22.107368] [DEBUG] [LOCAL ] PACS: Trimmed 50448 records to 34755 (keeping 200 days of data) [2025-10-21T20:28:22.303780] [DEBUG] [LOCAL ] PACS: Primary data saved (34755 records). [2025-10-21T20:28:22.303926] [INFO ] [MAIN ] PACS: Full history saved. [2025-10-21T20:28:22.304034] [INFO ] [MAIN ] Update Progress: 1620/2366 symbols completed. PACS took 27.9s. Estimated remaining: 1h 35m 55s. Rate: 7.8 symbols/min [2025-10-21T20:28:22.470832] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:22.470968] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-10-21T20:28:22.471020] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-10-21T20:28:22.471120] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-10-21T20:28:22.471161] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-21T20:28:22.471200] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-21T20:28:22.471238] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-10-21T20:28:22.567173] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-10-21T20:28:22.824577] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:22.903937] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T20:28:23.013903] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T20:28:23.085276] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T20:28:23.350995] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-10-21T20:28:23.943245] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T20:28:24.151125] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-10-21T20:28:24.739746] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T20:28:24.951055] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-10-21T20:28:25.675420] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T20:28:25.751034] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-10-21T20:28:26.551116] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-10-21T20:28:26.998322] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T20:28:27.351088] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-10-21T20:28:28.151062] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-10-21T20:28:28.487008] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:28:28.487323] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-10-21T20:28:28.487421] [FATAL] [REMOTE ] PAII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:28:28.487474] [FATAL] [MAIN ] PAII: Failed to fetch primary data. [2025-10-21T20:28:28.487507] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:28:28.487553] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-10-21T20:28:28.487621] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-10-21T20:28:28.487727] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-10-21T20:28:28.487794] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-10-21T20:28:28.487856] [INFO ] [MAIN ] Update Progress: 1621/2366 symbols completed. PAII took 6.2s. Estimated remaining: 1h 35m 47s. Rate: 7.8 symbols/min [2025-10-21T20:28:28.698801] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:28.679107] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T20:28:28.724816] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T20:28:28.752689] [DEBUG] [LOCAL ] PAM: Loaded 28940 existing records from primary storage. [2025-10-21T20:28:28.752951] [INFO ] [MAIN ] PAM: Loaded 28940 existing records. [2025-10-21T20:28:28.927773] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:28:28.927977] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-10-21T20:28:28.928074] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-10-21T20:28:28.928326] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-10-21T20:28:28.928382] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-10-21T20:28:28.956977] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-10-21T20:28:29.282872] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:29.751017] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-10-21T20:28:30.551108] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-10-21T20:28:31.004924] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T20:28:31.296000] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T20:28:31.350985] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-10-21T20:28:31.739220] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T20:28:32.151049] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-10. [2025-10-21T20:28:32.859097] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T20:28:32.950874] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T20:28:32.951049] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-10. [2025-10-21T20:28:32.955866] [INFO ] [REMOTE ] PAG: Full fetch complete (30791 records). [2025-10-21T20:28:32.955960] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-10-21T20:28:33.327410] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-10-21T20:28:33.327490] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-10-21T20:28:33.328245] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-10-21T20:28:33.328308] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-10-21T20:28:33.329123] [DEBUG] [LOCAL ] PAG: Trimmed 30791 records to 21325 (keeping 200 days of data) [2025-10-21T20:28:33.464879] [DEBUG] [LOCAL ] PAG: Primary data saved (21325 records). [2025-10-21T20:28:33.465005] [INFO ] [MAIN ] PAG: Full history saved. [2025-10-21T20:28:33.465073] [INFO ] [MAIN ] Update Progress: 1622/2366 symbols completed. PAG took 33.2s. Estimated remaining: 1h 35m 38s. Rate: 7.8 symbols/min [2025-10-21T20:28:33.659960] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:33.664032] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T20:28:33.665193] [INFO ] [REMOTE ] PAI: Full fetch complete (4113 records). [2025-10-21T20:28:33.665363] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-10-21T20:28:33.762475] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-10-21T20:28:33.967042] [DEBUG] [LOCAL ] PAR: Loaded 34290 existing records from primary storage. [2025-10-21T20:28:33.978055] [INFO ] [MAIN ] PAR: Loaded 34290 existing records. [2025-10-21T20:28:34.145106] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-10-21T20:28:34.150739] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-10-21T20:28:34.156022] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-10-21T20:28:34.161217] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-10-21T20:28:34.171949] [DEBUG] [LOCAL ] PAI: Trimmed 4113 records to 2836 (keeping 200 days of data) [2025-10-21T20:28:34.220830] [DEBUG] [LOCAL ] PAI: Primary data saved (2836 records). [2025-10-21T20:28:34.238682] [INFO ] [MAIN ] PAI: Full history saved. [2025-10-21T20:28:34.240831] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:28:34.240989] [INFO ] [MAIN ] Update Progress: 1623/2366 symbols completed. PAI took 23.2s. Estimated remaining: 1h 35m 27s. Rate: 7.8 symbols/min [2025-10-21T20:28:34.272412] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-10-21T20:28:34.286725] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-10-21T20:28:34.312849] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-10-21T20:28:34.323825] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-10-21T20:28:34.537460] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:34.542722] [DEBUG] [LOCAL ] PARR: No existing data file found in primary storage. [2025-10-21T20:28:34.557688] [WARN ] [MAIN ] PARR: No existing data found, performing full refresh instead. [2025-10-21T20:28:34.557902] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-10-21T20:28:34.557792] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-10-21T20:28:34.559517] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-10-21T20:28:34.570108] [DEBUG] [LOCAL ] PARR: No primary data file found to delete. [2025-10-21T20:28:34.597338] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-10-21T20:28:34.998754] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:35.177891] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:35.193271] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T20:28:35.351061] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-10-21T20:28:36.150992] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-10-21T20:28:36.791019] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T20:28:36.947780] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T20:28:36.956451] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-10-21T20:28:37.631572] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-21T20:28:37.751007] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-10-21T20:28:38.123248] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T20:28:38.551052] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-10-21T20:28:38.965215] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T20:28:39.351041] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-10-21T20:28:39.982984] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-21T20:28:40.151061] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-10-21T20:28:40.563699] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T20:28:40.951029] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-10-21T20:28:41.504777] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T20:28:41.751039] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-10-21T20:28:42.406917] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T20:28:42.551041] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-10-21T20:28:43.350995] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-10-21T20:28:43.610780] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T20:28:44.087239] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T20:28:44.151094] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-10-21T20:28:44.544490] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T20:28:44.951080] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-10-21T20:28:45.563530] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-21T20:28:45.751087] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-10-21T20:28:46.551111] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-10-21T20:28:46.753062] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T20:28:47.246762] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T20:28:47.351091] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-10-21T20:28:48.150998] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-10-21T20:28:48.204811] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T20:28:48.699372] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T20:28:48.951022] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-10. [2025-10-21T20:28:49.751039] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-10-21T20:28:49.954379] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T20:28:50.551054] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-10-21T20:28:50.786736] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T20:28:50.795036] [INFO ] [REMOTE ] PAGS: Full fetch complete (76506 records). [2025-10-21T20:28:50.795153] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-10-21T20:28:51.199413] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-10-21T20:28:51.199530] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-10-21T20:28:51.200789] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-10-21T20:28:51.200853] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-10-21T20:28:51.202290] [DEBUG] [LOCAL ] PAGS: Trimmed 76506 records to 52807 (keeping 200 days of data) [2025-10-21T20:28:51.370475] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-10-21T20:28:51.518764] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T20:28:51.549599] [DEBUG] [LOCAL ] PAGS: Primary data saved (52807 records). [2025-10-21T20:28:51.549754] [INFO ] [MAIN ] PAGS: Full history saved. [2025-10-21T20:28:51.549829] [INFO ] [MAIN ] Update Progress: 1624/2366 symbols completed. PAGS took 43.6s. Estimated remaining: 1h 35m 24s. Rate: 7.8 symbols/min [2025-10-21T20:28:51.723939] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:51.724187] [DEBUG] [LOCAL ] PATH: No existing data file found in primary storage. [2025-10-21T20:28:51.724299] [WARN ] [MAIN ] PATH: No existing data found, performing full refresh instead. [2025-10-21T20:28:51.724415] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-10-21T20:28:51.724457] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-10-21T20:28:51.724497] [DEBUG] [LOCAL ] PATH: No primary data file found to delete. [2025-10-21T20:28:51.724753] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-10-21T20:28:52.051845] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T20:28:52.110764] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:52.150983] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-10-21T20:28:52.951009] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-10. [2025-10-21T20:28:53.150458] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T20:28:53.751029] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-10-21T20:28:54.429957] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T20:28:54.435587] [INFO ] [REMOTE ] PAM: Full fetch complete (42432 records). [2025-10-21T20:28:54.435825] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-10-21T20:28:54.553826] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-10-21T20:28:54.817201] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-10-21T20:28:54.864942] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-10-21T20:28:54.865014] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-10-21T20:28:54.865762] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-10-21T20:28:54.865822] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-10-21T20:28:54.866621] [DEBUG] [LOCAL ] PAM: Trimmed 42432 records to 29042 (keeping 200 days of data) [2025-10-21T20:28:55.033812] [DEBUG] [LOCAL ] PAM: Primary data saved (29042 records). [2025-10-21T20:28:55.034075] [INFO ] [MAIN ] PAM: Full history saved. [2025-10-21T20:28:55.034186] [INFO ] [MAIN ] Update Progress: 1625/2366 symbols completed. PAM took 26.5s. Estimated remaining: 1h 35m 14s. Rate: 7.8 symbols/min [2025-10-21T20:28:55.239374] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T20:28:55.241134] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:28:55.272547] [DEBUG] [LOCAL ] PAXS: Loaded 21022 existing records from primary storage. [2025-10-21T20:28:55.272855] [INFO ] [MAIN ] PAXS: Loaded 21022 existing records. [2025-10-21T20:28:55.356149] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-10-21T20:28:55.491837] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:28:55.492078] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-10-21T20:28:55.492125] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-10-21T20:28:55.492313] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-10-21T20:28:55.492368] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-10-21T20:28:55.843997] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:28:56.151076] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-10-21T20:28:56.345472] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T20:28:56.950993] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-10-21T20:28:57.287233] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T20:28:57.369292] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T20:28:57.751041] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-10-21T20:28:58.549605] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T20:28:58.554669] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-10-21T20:28:58.894546] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-21T20:28:59.351061] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-10-21T20:29:00.151050] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-10-21T20:29:00.292450] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:29:00.951099] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-10-21T20:29:01.751061] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-10-21T20:29:01.890528] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T20:29:02.048938] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-21T20:29:02.098282] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T20:29:02.551066] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-10-21T20:29:03.351004] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-10. [2025-10-21T20:29:03.641004] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T20:29:04.151137] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-10. [2025-10-21T20:29:04.885668] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-21T20:29:04.951002] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-10-21T20:29:04.985853] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T20:29:04.996028] [INFO ] [REMOTE ] PAR: Full fetch complete (49175 records). [2025-10-21T20:29:04.996184] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-10-21T20:29:05.369019] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-10-21T20:29:05.369094] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-10-21T20:29:05.369991] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-10-21T20:29:05.370050] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-10-21T20:29:05.371065] [DEBUG] [LOCAL ] PAR: Trimmed 49175 records to 34301 (keeping 200 days of data) [2025-10-21T20:29:05.575479] [DEBUG] [LOCAL ] PAR: Primary data saved (34301 records). [2025-10-21T20:29:05.575662] [INFO ] [MAIN ] PAR: Full history saved. [2025-10-21T20:29:05.576376] [INFO ] [MAIN ] Update Progress: 1626/2366 symbols completed. PAR took 32.1s. Estimated remaining: 1h 35m 8s. Rate: 7.8 symbols/min [2025-10-21T20:29:05.734878] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T20:29:05.752796] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-10-21T20:29:05.772260] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:29:05.773368] [INFO ] [REMOTE ] PARR: Full fetch complete (69027 records). [2025-10-21T20:29:05.773440] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-10-21T20:29:06.099465] [DEBUG] [LOCAL ] PAY: Loaded 38632 existing records from primary storage. [2025-10-21T20:29:06.110470] [INFO ] [MAIN ] PAY: Loaded 38632 existing records. [2025-10-21T20:29:06.354164] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-10-21T20:29:06.363119] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-10-21T20:29:06.379869] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-10-21T20:29:06.385565] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-10-21T20:29:06.385492] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:29:06.385852] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-10-21T20:29:06.385906] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-10-21T20:29:06.386243] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-10-21T20:29:06.386349] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-10-21T20:29:06.464544] [DEBUG] [LOCAL ] PARR: Trimmed 69027 records to 47969 (keeping 200 days of data) [2025-10-21T20:29:06.972020] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:29:06.985904] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-10-21T20:29:07.066738] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T20:29:07.069035] [DEBUG] [LOCAL ] PARR: Primary data saved (47969 records). [2025-10-21T20:29:07.074594] [INFO ] [MAIN ] PARR: Full history saved. [2025-10-21T20:29:07.075051] [INFO ] [MAIN ] Update Progress: 1627/2366 symbols completed. PARR took 32.8s. Estimated remaining: 1h 34m 57s. Rate: 7.8 symbols/min [2025-10-21T20:29:07.246189] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:29:07.246444] [DEBUG] [LOCAL ] PAYC: No existing data file found in primary storage. [2025-10-21T20:29:07.246541] [WARN ] [MAIN ] PAYC: No existing data found, performing full refresh instead. [2025-10-21T20:29:07.246799] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-10-21T20:29:07.246907] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-10-21T20:29:07.247052] [DEBUG] [LOCAL ] PAYC: No primary data file found to delete. [2025-10-21T20:29:07.247118] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-10-21T20:29:07.358170] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-10-21T20:29:07.569087] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-21T20:29:07.656112] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:29:08.090166] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T20:29:08.150999] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-10-21T20:29:08.684922] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T20:29:08.951014] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-10-21T20:29:09.471877] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T20:29:09.751039] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-10-21T20:29:10.120250] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T20:29:10.551021] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-10-21T20:29:11.276190] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T20:29:11.351033] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-10-21T20:29:12.151058] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-10-21T20:29:12.851179] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-21T20:29:12.950983] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-10-21T20:29:13.023306] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T20:29:13.089215] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-21T20:29:13.751037] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-10-21T20:29:14.551067] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-10-21T20:29:15.199723] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-21T20:29:15.267487] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T20:29:15.351080] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-10-21T20:29:15.400815] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T20:29:16.151038] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-10-21T20:29:16.951018] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-10-21T20:29:17.177272] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T20:29:17.751054] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-10-21T20:29:18.190743] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T20:29:18.557293] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-10-21T20:29:18.573028] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T20:29:18.914559] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T20:29:19.351058] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-10-21T20:29:20.151049] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-10-21T20:29:20.951006] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-10. [2025-10-21T20:29:21.010405] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T20:29:21.205382] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-21T20:29:21.431131] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T20:29:21.751043] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-10. [2025-10-21T20:29:22.004718] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T20:29:22.008119] [INFO ] [REMOTE ] PAXS: Full fetch complete (29566 records). [2025-10-21T20:29:22.008213] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-10-21T20:29:22.423833] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-10-21T20:29:22.423946] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-10-21T20:29:22.424747] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-10-21T20:29:22.424816] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-10-21T20:29:22.425707] [DEBUG] [LOCAL ] PAXS: Trimmed 29566 records to 21037 (keeping 200 days of data) [2025-10-21T20:29:22.551349] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-10-21T20:29:22.562348] [DEBUG] [LOCAL ] PAXS: Primary data saved (21037 records). [2025-10-21T20:29:22.562445] [INFO ] [MAIN ] PAXS: Full history saved. [2025-10-21T20:29:22.562526] [INFO ] [MAIN ] Update Progress: 1628/2366 symbols completed. PAXS took 27.5s. Estimated remaining: 1h 34m 53s. Rate: 7.8 symbols/min [2025-10-21T20:29:22.749114] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:29:22.749320] [DEBUG] [LOCAL ] PB: No existing data file found in primary storage. [2025-10-21T20:29:22.749363] [WARN ] [MAIN ] PB: No existing data found, performing full refresh instead. [2025-10-21T20:29:22.749486] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-10-21T20:29:22.749540] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-10-21T20:29:22.749584] [DEBUG] [LOCAL ] PB: No primary data file found to delete. [2025-10-21T20:29:22.749617] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-10-21T20:29:23.151194] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:29:23.351011] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-10-21T20:29:24.115454] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T20:29:24.151001] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-10-21T20:29:24.524295] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-10 (2.77 seconds). [2025-10-21T20:29:24.532992] [INFO ] [REMOTE ] PATH: Full fetch complete (77851 records). [2025-10-21T20:29:24.533161] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-10-21T20:29:24.952407] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-10-21T20:29:24.956300] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-10-21T20:29:24.956475] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-10-21T20:29:24.957943] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-10-21T20:29:24.958182] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-10-21T20:29:24.960591] [DEBUG] [LOCAL ] PATH: Trimmed 77851 records to 53680 (keeping 200 days of data) [2025-10-21T20:29:25.084741] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T20:29:25.323460] [DEBUG] [LOCAL ] PATH: Primary data saved (53680 records). [2025-10-21T20:29:25.323607] [INFO ] [MAIN ] PATH: Full history saved. [2025-10-21T20:29:25.323726] [INFO ] [MAIN ] Update Progress: 1629/2366 symbols completed. PATH took 33.8s. Estimated remaining: 1h 34m 43s. Rate: 7.8 symbols/min [2025-10-21T20:29:25.494284] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:29:25.538513] [DEBUG] [LOCAL ] PBA: Loaded 49232 existing records from primary storage. [2025-10-21T20:29:25.538836] [INFO ] [MAIN ] PBA: Loaded 49232 existing records. [2025-10-21T20:29:25.707465] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T20:29:25.752147] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-10-21T20:29:25.755771] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:29:25.756834] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-10-21T20:29:25.756895] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-10-21T20:29:25.757087] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-10-21T20:29:25.757127] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-10-21T20:29:26.124094] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:29:26.551036] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-10-21T20:29:26.767559] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T20:29:27.351006] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-10-21T20:29:27.508980] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T20:29:28.151074] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-10-21T20:29:28.180030] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T20:29:28.951088] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-10-21T20:29:28.978690] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T20:29:29.751093] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-10-21T20:29:29.914498] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T20:29:30.551088] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-10-21T20:29:30.669318] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T20:29:31.091000] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T20:29:31.351103] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-10. [2025-10-21T20:29:32.151037] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-10-21T20:29:32.369409] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T20:29:32.951098] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-10-21T20:29:33.065941] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T20:29:33.074171] [INFO ] [REMOTE ] PAYC: Full fetch complete (53251 records). [2025-10-21T20:29:33.074349] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-10-21T20:29:33.499479] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-10-21T20:29:33.499554] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-10-21T20:29:33.500507] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-10-21T20:29:33.500568] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-10-21T20:29:33.501608] [DEBUG] [LOCAL ] PAYC: Trimmed 53251 records to 36168 (keeping 200 days of data) [2025-10-21T20:29:33.729172] [DEBUG] [LOCAL ] PAYC: Primary data saved (36168 records). [2025-10-21T20:29:33.729390] [INFO ] [MAIN ] PAYC: Full history saved. [2025-10-21T20:29:33.736278] [INFO ] [MAIN ] Update Progress: 1630/2366 symbols completed. PAYC took 26.7s. Estimated remaining: 1h 34m 36s. Rate: 7.8 symbols/min [2025-10-21T20:29:33.759913] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-10-21T20:29:33.786981] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T20:29:33.928778] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:29:33.928995] [DEBUG] [LOCAL ] PBF: No existing data file found in primary storage. [2025-10-21T20:29:33.929049] [WARN ] [MAIN ] PBF: No existing data found, performing full refresh instead. [2025-10-21T20:29:33.929162] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-10-21T20:29:33.929202] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-10-21T20:29:33.929243] [DEBUG] [LOCAL ] PBF: No primary data file found to delete. [2025-10-21T20:29:33.929273] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-10-21T20:29:34.297227] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:29:34.381219] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T20:29:34.551063] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-10-21T20:29:35.257301] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T20:29:35.351002] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-10-21T20:29:36.150995] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-10-21T20:29:36.493613] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T20:29:36.951159] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-10-21T20:29:37.180898] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T20:29:37.461675] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T20:29:37.751062] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-10-21T20:29:38.551030] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-10-21T20:29:38.765328] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T20:29:39.351007] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-10-21T20:29:39.425865] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T20:29:40.150997] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-10-21T20:29:40.322945] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T20:29:40.951012] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-10-21T20:29:41.179005] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T20:29:41.316107] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T20:29:41.751021] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-10-21T20:29:42.551057] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-10-21T20:29:42.658762] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T20:29:43.351021] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-10-21T20:29:43.511286] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T20:29:44.141906] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T20:29:44.151196] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-10. [2025-10-21T20:29:44.951127] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-10-21T20:29:45.176861] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T20:29:45.747236] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T20:29:45.752961] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-10-21T20:29:45.754774] [INFO ] [REMOTE ] PAY: Full fetch complete (54220 records). [2025-10-21T20:29:45.754859] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-10-21T20:29:46.143568] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-10-21T20:29:46.143675] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-10-21T20:29:46.144607] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-10-21T20:29:46.144676] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-10-21T20:29:46.145800] [DEBUG] [LOCAL ] PAY: Trimmed 54220 records to 38642 (keeping 200 days of data) [2025-10-21T20:29:46.366568] [DEBUG] [LOCAL ] PAY: Primary data saved (38642 records). [2025-10-21T20:29:46.366826] [INFO ] [MAIN ] PAY: Full history saved. [2025-10-21T20:29:46.366914] [INFO ] [MAIN ] Update Progress: 1631/2366 symbols completed. PAY took 40.8s. Estimated remaining: 1h 34m 30s. Rate: 7.8 symbols/min [2025-10-21T20:29:46.538847] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:29:46.539140] [DEBUG] [LOCAL ] PBH: No existing data file found in primary storage. [2025-10-21T20:29:46.539206] [WARN ] [MAIN ] PBH: No existing data found, performing full refresh instead. [2025-10-21T20:29:46.539361] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-10-21T20:29:46.539453] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-10-21T20:29:46.539700] [DEBUG] [LOCAL ] PBH: No primary data file found to delete. [2025-10-21T20:29:46.539882] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-10-21T20:29:46.570108] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-10-21T20:29:46.750055] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T20:29:46.943506] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:29:47.350999] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-10-21T20:29:47.498743] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T20:29:48.151121] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-10-21T20:29:48.748131] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-21T20:29:48.951055] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-10-21T20:29:49.028738] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T20:29:49.751044] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-10-21T20:29:49.951746] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T20:29:50.550994] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-10. [2025-10-21T20:29:50.779219] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T20:29:51.125403] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T20:29:51.351013] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-10-21T20:29:52.150996] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-10-21T20:29:52.186302] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T20:29:52.193287] [INFO ] [REMOTE ] PB: Full fetch complete (59782 records). [2025-10-21T20:29:52.193382] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-10-21T20:29:52.599486] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-10-21T20:29:52.600028] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-10-21T20:29:52.600546] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T20:29:52.601579] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-10-21T20:29:52.607293] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-10-21T20:29:52.608679] [DEBUG] [LOCAL ] PB: Trimmed 59782 records to 42332 (keeping 200 days of data) [2025-10-21T20:29:52.860631] [DEBUG] [LOCAL ] PB: Primary data saved (42332 records). [2025-10-21T20:29:52.860773] [INFO ] [MAIN ] PB: Full history saved. [2025-10-21T20:29:52.860839] [INFO ] [MAIN ] Update Progress: 1632/2366 symbols completed. PB took 30.3s. Estimated remaining: 1h 34m 22s. Rate: 7.8 symbols/min [2025-10-21T20:29:52.957825] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-10-21T20:29:53.029192] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:29:53.029304] [DEBUG] [LOCAL ] PBI: No existing data file found in primary storage. [2025-10-21T20:29:53.029340] [WARN ] [MAIN ] PBI: No existing data found, performing full refresh instead. [2025-10-21T20:29:53.029441] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-10-21T20:29:53.029482] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-21T20:29:53.029522] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-21T20:29:53.029557] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-10-21T20:29:53.372512] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:29:53.751073] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-10-21T20:29:53.965927] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T20:29:54.550994] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-10-21T20:29:55.087416] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-21T20:29:55.351009] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-10-21T20:29:55.624380] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T20:29:56.151003] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-10-21T20:29:56.170494] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T20:29:56.950991] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-10-21T20:29:57.095404] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:29:57.588848] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T20:29:57.751046] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-10-21T20:29:58.405402] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T20:29:58.551112] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-10-21T20:29:59.285185] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T20:29:59.350980] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-10-21T20:30:00.151001] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-10-21T20:30:00.330109] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T20:30:00.951054] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-10. [2025-10-21T20:30:01.219430] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T20:30:01.751072] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-10-21T20:30:02.001031] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T20:30:02.536857] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T20:30:02.545501] [INFO ] [REMOTE ] PBF: Full fetch complete (76723 records). [2025-10-21T20:30:02.545717] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-10-21T20:30:02.558443] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-10. [2025-10-21T20:30:02.963918] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-10-21T20:30:02.964007] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-10-21T20:30:02.965137] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-10-21T20:30:02.965209] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-10-21T20:30:02.966721] [DEBUG] [LOCAL ] PBF: Trimmed 76723 records to 53110 (keeping 200 days of data) [2025-10-21T20:30:03.287418] [DEBUG] [LOCAL ] PBF: Primary data saved (53110 records). [2025-10-21T20:30:03.287559] [INFO ] [MAIN ] PBF: Full history saved. [2025-10-21T20:30:03.287688] [INFO ] [MAIN ] Update Progress: 1633/2366 symbols completed. PBF took 29.5s. Estimated remaining: 1h 34m 15s. Rate: 7.8 symbols/min [2025-10-21T20:30:03.359707] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-10-21T20:30:03.467439] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:30:03.519896] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-21T20:30:03.520173] [INFO ] [MAIN ] PBR: Loaded 53713 existing records. [2025-10-21T20:30:03.698132] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:30:03.698425] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-10-21T20:30:03.698472] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-10-21T20:30:03.698996] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-10-21T20:30:03.699051] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-10-21T20:30:04.087736] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:30:04.082482] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-21T20:30:04.150984] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-10-21T20:30:04.197305] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T20:30:04.205079] [INFO ] [REMOTE ] PBA: Full fetch complete (71660 records). [2025-10-21T20:30:04.205208] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-10-21T20:30:04.595215] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-10-21T20:30:04.595299] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-10-21T20:30:04.596383] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-10-21T20:30:04.596445] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-10-21T20:30:04.597965] [DEBUG] [LOCAL ] PBA: Trimmed 71660 records to 49217 (keeping 200 days of data) [2025-10-21T20:30:04.802733] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T20:30:04.921794] [DEBUG] [LOCAL ] PBA: Primary data saved (49217 records). [2025-10-21T20:30:04.921929] [INFO ] [MAIN ] PBA: Full history saved. [2025-10-21T20:30:04.922955] [INFO ] [MAIN ] Update Progress: 1634/2366 symbols completed. PBA took 39.6s. Estimated remaining: 1h 34m 5s. Rate: 7.8 symbols/min [2025-10-21T20:30:04.956163] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-10-21T20:30:05.094319] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:30:05.113717] [DEBUG] [LOCAL ] PBT: Loaded 17542 existing records from primary storage. [2025-10-21T20:30:05.114000] [INFO ] [MAIN ] PBT: Loaded 17542 existing records. [2025-10-21T20:30:05.295196] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:30:05.295451] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-10-21T20:30:05.295505] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-10-21T20:30:05.295793] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-10-21T20:30:05.295850] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-10-21T20:30:05.716876] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:30:05.750988] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-10-21T20:30:05.897365] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T20:30:06.551011] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-10-21T20:30:06.577752] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T20:30:07.131712] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T20:30:07.351055] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-10-21T20:30:08.151052] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-10-21T20:30:08.568922] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T20:30:08.951089] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-10-21T20:30:09.052074] [DEBUG] [REMOTE ] PBI: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-21T20:30:09.052451] [WARN ] [REMOTE ] PBI: No data returned for month 2025-08 [2025-10-21T20:30:09.052564] [FATAL] [REMOTE ] PBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:30:09.052662] [FATAL] [MAIN ] PBI: Failed to fetch primary data. [2025-10-21T20:30:09.052731] [WARN ] [MAIN ] PBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:30:09.052833] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-10-21T20:30:09.052941] [DEBUG] [LOCAL ] PBI: No primary data file found to delete. [2025-10-21T20:30:09.053022] [INFO ] [LOCAL ] PBI: Starting deletion of derivative data. [2025-10-21T20:30:09.053112] [DEBUG] [LOCAL ] PBI: No derivative data file found to delete. [2025-10-21T20:30:09.053187] [INFO ] [MAIN ] Update Progress: 1635/2366 symbols completed. PBI took 16.2s. Estimated remaining: 1h 33m 56s. Rate: 7.8 symbols/min [2025-10-21T20:30:09.264568] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:30:09.275258] [DEBUG] [LOCAL ] PCF: Loaded 9084 existing records from primary storage. [2025-10-21T20:30:09.275463] [INFO ] [MAIN ] PCF: Loaded 9084 existing records. [2025-10-21T20:30:09.451605] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:30:09.451941] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-10-21T20:30:09.452081] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-10-21T20:30:09.452256] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-10-21T20:30:09.452294] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-10-21T20:30:09.766831] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-10-21T20:30:09.830287] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:30:09.860904] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-21T20:30:09.890853] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:30:10.551072] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-10-21T20:30:10.977494] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T20:30:11.351044] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-10-21T20:30:11.513824] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T20:30:12.151090] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-10-21T20:30:12.680763] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T20:30:12.951102] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-10-21T20:30:13.066167] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T20:30:13.751028] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-10-21T20:30:14.548571] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T20:30:14.550900] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-10-21T20:30:15.219734] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-21T20:30:15.351022] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-10-21T20:30:15.413496] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T20:30:16.151060] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-10-21T20:30:16.951121] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-10-21T20:30:17.751008] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-10-21T20:30:17.790754] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T20:30:17.844725] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-10-21T20:30:18.076007] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T20:30:18.551033] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-10-21T20:30:18.654806] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T20:30:19.351089] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-10-21T20:30:20.151074] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-10-21T20:30:20.350952] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T20:30:20.613671] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T20:30:20.951021] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-10-21T20:30:21.296010] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T20:30:21.680354] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-21T20:30:21.750977] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-10-21T20:30:22.551051] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-10. [2025-10-21T20:30:22.574519] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T20:30:23.351113] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-10-21T20:30:24.043596] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T20:30:24.051127] [INFO ] [REMOTE ] PBH: Full fetch complete (44696 records). [2025-10-21T20:30:24.051245] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-10-21T20:30:24.153749] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-10-21T20:30:24.439198] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-10-21T20:30:24.439300] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-10-21T20:30:24.440222] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-10-21T20:30:24.440284] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-10-21T20:30:24.441206] [DEBUG] [LOCAL ] PBH: Trimmed 44696 records to 32532 (keeping 200 days of data) [2025-10-21T20:30:24.628607] [DEBUG] [LOCAL ] PBH: Primary data saved (32532 records). [2025-10-21T20:30:24.628782] [INFO ] [MAIN ] PBH: Full history saved. [2025-10-21T20:30:24.628858] [INFO ] [MAIN ] Update Progress: 1636/2366 symbols completed. PBH took 38.3s. Estimated remaining: 1h 33m 51s. Rate: 7.8 symbols/min [2025-10-21T20:30:24.800108] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:30:24.800297] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-10-21T20:30:24.800336] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-10-21T20:30:24.800446] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-10-21T20:30:24.800489] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-10-21T20:30:24.800531] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-10-21T20:30:24.800564] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-10-21T20:30:24.955160] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-10-21T20:30:25.167140] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:30:25.370077] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T20:30:25.640537] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T20:30:25.751041] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-10-21T20:30:26.020236] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T20:30:26.551092] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-10-21T20:30:27.351105] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-10-21T20:30:27.708633] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T20:30:28.109056] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-21T20:30:28.151004] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-10-21T20:30:28.951048] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-10. [2025-10-21T20:30:29.389221] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-21T20:30:29.432669] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T20:30:29.751026] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-10-21T20:30:29.758629] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T20:30:29.760858] [INFO ] [REMOTE ] PCF: Full fetch complete (13436 records). [2025-10-21T20:30:29.760929] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-10-21T20:30:30.121571] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-10-21T20:30:30.121666] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-10-21T20:30:30.121979] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-10-21T20:30:30.122018] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-10-21T20:30:30.122462] [DEBUG] [LOCAL ] PCF: Trimmed 13436 records to 9109 (keeping 200 days of data) [2025-10-21T20:30:30.177179] [DEBUG] [LOCAL ] PCF: Primary data saved (9109 records). [2025-10-21T20:30:30.177331] [INFO ] [MAIN ] PCF: Full history saved. [2025-10-21T20:30:30.177436] [INFO ] [MAIN ] Update Progress: 1637/2366 symbols completed. PCF took 21.1s. Estimated remaining: 1h 33m 43s. Rate: 7.8 symbols/min [2025-10-21T20:30:30.551072] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-10-21T20:30:31.351042] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-10-21T20:30:31.632892] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T20:30:32.150992] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-10-21T20:30:32.458483] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T20:30:32.898231] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-21T20:30:32.951058] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-10-21T20:30:33.751088] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-10. [2025-10-21T20:30:34.254664] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-21T20:30:34.551015] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-10-21T20:30:34.757993] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T20:30:34.760960] [INFO ] [REMOTE ] PBT: Full fetch complete (24522 records). [2025-10-21T20:30:34.761038] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-10-21T20:30:35.138225] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-10-21T20:30:35.138392] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-10-21T20:30:35.139107] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-10-21T20:30:35.139221] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-10-21T20:30:35.156522] [DEBUG] [LOCAL ] PBT: Trimmed 24522 records to 17447 (keeping 200 days of data) [2025-10-21T20:30:35.180000] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-21T20:30:35.293917] [DEBUG] [LOCAL ] PBT: Primary data saved (17447 records). [2025-10-21T20:30:35.294050] [INFO ] [MAIN ] PBT: Full history saved. [2025-10-21T20:30:35.294172] [INFO ] [MAIN ] Update Progress: 1638/2366 symbols completed. PBT took 30.4s. Estimated remaining: 1h 33m 34s. Rate: 7.8 symbols/min [2025-10-21T20:30:35.351054] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-10-21T20:30:36.607026] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T20:30:36.621384] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-10-21T20:30:37.588233] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T20:30:37.600115] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-10. [2025-10-21T20:30:39.553909] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-21T20:30:39.565485] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-10-21T20:30:39.957395] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-21T20:30:39.966615] [INFO ] [REMOTE ] PBR: Full fetch complete (77882 records). [2025-10-21T20:30:39.966817] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-10-21T20:30:40.400171] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-10-21T20:30:40.400305] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-10-21T20:30:40.401490] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-10-21T20:30:40.401554] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-10-21T20:30:40.403120] [DEBUG] [LOCAL ] PBR: Trimmed 77882 records to 53713 (keeping 200 days of data) [2025-10-21T20:30:40.722306] [DEBUG] [LOCAL ] PBR: Primary data saved (53713 records). [2025-10-21T20:30:40.722450] [INFO ] [MAIN ] PBR: Full history saved. [2025-10-21T20:30:40.723018] [INFO ] [MAIN ] Update Progress: 1639/2366 symbols completed. PBR took 37.4s. Estimated remaining: 1h 33m 25s. Rate: 7.8 symbols/min [2025-10-21T20:30:41.501844] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T20:30:41.513761] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-10-21T20:30:43.669358] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T20:30:43.681191] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-10-21T20:30:45.743003] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-21T20:30:45.754341] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-10-21T20:30:47.949540] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T20:30:47.960914] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-10. [2025-10-21T20:30:50.018426] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-21T20:30:50.026822] [INFO ] [REMOTE ] PCG: Full fetch complete (77898 records). [2025-10-21T20:30:50.026950] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-10-21T20:30:50.416254] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-10-21T20:30:50.416337] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-10-21T20:30:50.417505] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-10-21T20:30:50.417567] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-10-21T20:30:50.419030] [DEBUG] [LOCAL ] PCG: Trimmed 77898 records to 53719 (keeping 200 days of data) [2025-10-21T20:30:50.745599] [DEBUG] [LOCAL ] PCG: Primary data saved (53719 records). [2025-10-21T20:30:50.745767] [INFO ] [MAIN ] PCG: Full history saved. [2025-10-21T20:30:50.745844] [INFO ] [MAIN ] Update Progress: 1640/2366 symbols completed. PCG took 26.1s. Estimated remaining: 1h 33m 18s. Rate: 7.8 symbols/min [2025-10-21T20:30:51.368209] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:30:51.454616] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:30:51.467916] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:30:51.476412] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:30:51.487591] [DEBUG] [LOCAL ] PCM: Loaded 6851 existing records from primary storage. [2025-10-21T20:30:51.488025] [INFO ] [MAIN ] PCM: Loaded 6851 existing records. [2025-10-21T20:30:51.571160] [DEBUG] [LOCAL ] PCQ: Loaded 12261 existing records from primary storage. [2025-10-21T20:30:51.590117] [INFO ] [MAIN ] PCQ: Loaded 12261 existing records. [2025-10-21T20:30:51.748805] [DEBUG] [LOCAL ] PCN: Loaded 25417 existing records from primary storage. [2025-10-21T20:30:51.843773] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:30:51.840271] [INFO ] [MAIN ] PCN: Loaded 25417 existing records. [2025-10-21T20:30:51.863070] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-10-21T20:30:51.920821] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:30:51.938235] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-10-21T20:30:51.958786] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-10-21T20:30:51.953439] [DEBUG] [LOCAL ] PCOR: Loaded 47617 existing records from primary storage. [2025-10-21T20:30:51.938044] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-10-21T20:30:51.992217] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-10-21T20:30:51.992389] [INFO ] [MAIN ] PCOR: Loaded 47617 existing records. [2025-10-21T20:30:51.997708] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-10-21T20:30:51.997769] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-10-21T20:30:52.110126] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-10-21T20:30:52.430873] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:30:52.527705] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-10-21T20:30:52.647875] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-10-21T20:30:52.700039] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:30:52.757857] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-10-21T20:30:52.786904] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-10-21T20:30:52.787024] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-10-21T20:30:52.792342] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-10-21T20:30:52.848471] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-10-21T20:30:52.906405] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-10-21T20:30:53.187327] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:30:53.286169] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-10-21T20:30:53.299968] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:30:53.307913] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-10-21T20:30:53.755303] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:30:53.779402] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-10-21T20:30:53.808770] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:30:53.809255] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-10-21T20:30:54.285029] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T20:30:54.287778] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-10-21T20:30:54.448073] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T20:30:54.450790] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-10-21T20:30:54.854842] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T20:30:54.859778] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-10-21T20:30:55.111679] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T20:30:55.113845] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-10-21T20:30:55.531834] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T20:30:55.540811] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-10-21T20:30:55.573773] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T20:30:55.576180] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-10-21T20:30:55.868892] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T20:30:55.870911] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-10-21T20:30:56.054059] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T20:30:56.058734] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-10-21T20:30:56.508075] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T20:30:56.511243] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-10-21T20:30:56.798755] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T20:30:56.801461] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-10-21T20:30:57.208234] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T20:30:57.213067] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-10-21T20:30:57.296044] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T20:30:57.305434] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-10-21T20:30:57.341280] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T20:30:57.345352] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-10-21T20:30:57.575737] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T20:30:57.577824] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-10-21T20:30:58.296454] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T20:30:58.299495] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-10-21T20:30:58.456458] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T20:30:58.458585] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-10-21T20:30:58.647296] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T20:30:58.653453] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-10-21T20:30:59.211759] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T20:30:59.212786] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T20:30:59.217962] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-10-21T20:30:59.221138] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T20:30:59.350986] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-10-21T20:30:59.760237] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T20:31:00.137367] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T20:31:00.150988] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-10-21T20:31:00.951011] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-10-21T20:31:01.248808] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T20:31:01.442671] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T20:31:01.751097] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-10-21T20:31:01.833520] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T20:31:02.551053] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-10-21T20:31:02.893251] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T20:31:03.351050] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-10-21T20:31:03.879484] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T20:31:04.151002] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-10-21T20:31:04.369766] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T20:31:04.951064] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-10-21T20:31:05.258334] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T20:31:05.751085] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-10. [2025-10-21T20:31:06.551038] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-10. [2025-10-21T20:31:06.567430] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T20:31:06.569129] [INFO ] [REMOTE ] PCM: Full fetch complete (10468 records). [2025-10-21T20:31:06.569198] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-10-21T20:31:06.886102] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T20:31:06.986613] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-10-21T20:31:06.986751] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-10-21T20:31:06.987188] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-10-21T20:31:06.987263] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-10-21T20:31:06.988015] [DEBUG] [LOCAL ] PCM: Trimmed 10468 records to 6878 (keeping 200 days of data) [2025-10-21T20:31:07.031936] [DEBUG] [LOCAL ] PCM: Primary data saved (6878 records). [2025-10-21T20:31:07.032079] [INFO ] [MAIN ] PCM: Full history saved. [2025-10-21T20:31:07.032157] [INFO ] [MAIN ] Update Progress: 1641/2366 symbols completed. PCM took 16.3s. Estimated remaining: 1h 33m 15s. Rate: 7.8 symbols/min [2025-10-21T20:31:07.207960] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:31:07.253245] [DEBUG] [LOCAL ] PD: Loaded 48336 existing records from primary storage. [2025-10-21T20:31:07.253551] [INFO ] [MAIN ] PD: Loaded 48336 existing records. [2025-10-21T20:31:07.352066] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-10-21T20:31:07.448216] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:31:07.448563] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-10-21T20:31:07.448621] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-10-21T20:31:07.448853] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-10-21T20:31:07.448901] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-10-21T20:31:07.529673] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T20:31:07.559101] [INFO ] [REMOTE ] PCQ: Full fetch complete (16892 records). [2025-10-21T20:31:07.575526] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-10-21T20:31:08.135744] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:31:08.156229] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-10-21T20:31:08.233945] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-10-21T20:31:08.234034] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-10-21T20:31:08.234542] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-10-21T20:31:08.234604] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-10-21T20:31:08.235318] [DEBUG] [LOCAL ] PCQ: Trimmed 16892 records to 12158 (keeping 200 days of data) [2025-10-21T20:31:08.311079] [DEBUG] [LOCAL ] PCQ: Primary data saved (12158 records). [2025-10-21T20:31:08.311235] [INFO ] [MAIN ] PCQ: Full history saved. [2025-10-21T20:31:08.311369] [INFO ] [MAIN ] Update Progress: 1642/2366 symbols completed. PCQ took 17.6s. Estimated remaining: 1h 33m 4s. Rate: 7.8 symbols/min [2025-10-21T20:31:08.480077] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:31:08.480252] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-10-21T20:31:08.480289] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-10-21T20:31:08.480400] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-10-21T20:31:08.480440] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-21T20:31:08.480479] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-21T20:31:08.480509] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-10-21T20:31:08.804770] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T20:31:08.876776] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:31:08.951045] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-10-21T20:31:09.378437] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-21T20:31:09.751047] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-10-21T20:31:09.959962] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T20:31:10.551033] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-10-21T20:31:11.108894] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T20:31:11.297517] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T20:31:11.350999] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-10-21T20:31:12.151054] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-10-21T20:31:12.950997] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-10-21T20:31:13.241349] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T20:31:13.428737] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-21T20:31:13.751084] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-10-21T20:31:14.232829] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T20:31:14.266738] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T20:31:14.551038] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-10-21T20:31:15.055870] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T20:31:15.351019] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-10-21T20:31:15.758411] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-21T20:31:16.151010] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-10. [2025-10-21T20:31:16.951038] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-10-21T20:31:17.364013] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-21T20:31:17.530801] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T20:31:17.535524] [INFO ] [REMOTE ] PCN: Full fetch complete (34845 records). [2025-10-21T20:31:17.535606] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-10-21T20:31:17.756260] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-10-21T20:31:17.903411] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-10-21T20:31:17.903511] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-10-21T20:31:17.904264] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-10-21T20:31:17.904328] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-10-21T20:31:17.905202] [DEBUG] [LOCAL ] PCN: Trimmed 34845 records to 25456 (keeping 200 days of data) [2025-10-21T20:31:18.064382] [DEBUG] [LOCAL ] PCN: Primary data saved (25456 records). [2025-10-21T20:31:18.064592] [INFO ] [MAIN ] PCN: Full history saved. [2025-10-21T20:31:18.064742] [INFO ] [MAIN ] Update Progress: 1643/2366 symbols completed. PCN took 27.3s. Estimated remaining: 1h 32m 57s. Rate: 7.8 symbols/min [2025-10-21T20:31:18.255574] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:31:18.309069] [DEBUG] [LOCAL ] PDI: Loaded 50190 existing records from primary storage. [2025-10-21T20:31:18.309393] [INFO ] [MAIN ] PDI: Loaded 50190 existing records. [2025-10-21T20:31:18.483678] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:31:18.483879] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-10-21T20:31:18.483928] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-10-21T20:31:18.484107] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-10-21T20:31:18.484144] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-10-21T20:31:18.557293] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-10-21T20:31:18.844048] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:31:19.351065] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-10-21T20:31:19.728472] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T20:31:19.799986] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T20:31:20.151103] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-10-21T20:31:20.929324] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-21T20:31:20.950984] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-10-21T20:31:21.751008] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-10-21T20:31:22.170196] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T20:31:22.551030] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-10-21T20:31:22.601237] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T20:31:23.036975] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-21T20:31:23.351040] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-10-21T20:31:23.746710] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T20:31:24.151029] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-10. [2025-10-21T20:31:24.951088] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-10-21T20:31:25.104227] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T20:31:25.387039] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-21T20:31:25.751068] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-10. [2025-10-21T20:31:25.870854] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T20:31:25.878099] [INFO ] [REMOTE ] PCOR: Full fetch complete (69346 records). [2025-10-21T20:31:25.878230] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-10-21T20:31:26.156036] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-21T20:31:26.168515] [INFO ] [REMOTE ] PDCC: Full fetch complete (1378 records). [2025-10-21T20:31:26.173763] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-10-21T20:31:26.464822] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-10-21T20:31:26.468413] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-10-21T20:31:26.469568] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-10-21T20:31:26.494039] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-10-21T20:31:26.500258] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-21T20:31:26.500495] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:31:26.500690] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:31:26.500853] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-10-21T20:31:26.500968] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-10-21T20:31:26.501108] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-10-21T20:31:26.501325] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-10-21T20:31:26.501399] [INFO ] [MAIN ] Update Progress: 1644/2366 symbols completed. PDCC took 18.2s. Estimated remaining: 1h 32m 50s. Rate: 7.8 symbols/min [2025-10-21T20:31:26.501501] [DEBUG] [LOCAL ] PCOR: Trimmed 69346 records to 47534 (keeping 200 days of data) [2025-10-21T20:31:26.551000] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-10-21T20:31:26.848958] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:31:27.027532] [DEBUG] [LOCAL ] PDM: Loaded 39915 existing records from primary storage. [2025-10-21T20:31:27.040011] [DEBUG] [LOCAL ] PCOR: Primary data saved (47534 records). [2025-10-21T20:31:27.039942] [INFO ] [MAIN ] PDM: Loaded 39915 existing records. [2025-10-21T20:31:27.040160] [INFO ] [MAIN ] PCOR: Full history saved. [2025-10-21T20:31:27.106079] [INFO ] [MAIN ] Update Progress: 1645/2366 symbols completed. PCOR took 36.4s. Estimated remaining: 1h 32m 39s. Rate: 7.8 symbols/min [2025-10-21T20:31:27.344264] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:31:27.373738] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-10-21T20:31:27.359974] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-10-21T20:31:27.373966] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-10-21T20:31:27.403802] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-10-21T20:31:27.405738] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-10-21T20:31:27.407197] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:31:27.705342] [DEBUG] [LOCAL ] PDO: Loaded 31542 existing records from primary storage. [2025-10-21T20:31:27.732261] [INFO ] [MAIN ] PDO: Loaded 31542 existing records. [2025-10-21T20:31:27.938631] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:31:28.000795] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:31:28.001015] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-10-21T20:31:28.001062] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-10-21T20:31:28.001250] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-10-21T20:31:28.001288] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-10-21T20:31:28.156157] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-10-21T20:31:28.362518] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:31:28.432520] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T20:31:28.951050] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-10-21T20:31:29.294359] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T20:31:29.751022] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-10-21T20:31:29.852724] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T20:31:30.556107] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-10-21T20:31:30.569815] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T20:31:31.351026] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-10-21T20:31:31.546501] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T20:31:32.151228] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-10-21T20:31:32.659465] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-21T20:31:32.952173] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-10-21T20:31:32.956342] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T20:31:33.620577] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T20:31:33.751005] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-10-21T20:31:34.551028] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-10-21T20:31:35.053633] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T20:31:35.356231] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-10-21T20:31:35.369720] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T20:31:36.151011] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-10-21T20:31:36.638630] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T20:31:36.951005] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-10-21T20:31:37.381476] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T20:31:37.756106] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-10-21T20:31:37.770934] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T20:31:38.534613] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T20:31:38.550986] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-10. [2025-10-21T20:31:39.351817] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-10-21T20:31:39.354949] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T20:31:40.151037] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-10-21T20:31:40.339889] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T20:31:40.347765] [INFO ] [REMOTE ] PD: Full fetch complete (68265 records). [2025-10-21T20:31:40.347916] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-10-21T20:31:40.744056] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-10-21T20:31:40.744130] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-10-21T20:31:40.745174] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-10-21T20:31:40.745235] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-10-21T20:31:40.746467] [DEBUG] [LOCAL ] PD: Trimmed 68265 records to 48330 (keeping 200 days of data) [2025-10-21T20:31:40.950989] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-10-21T20:31:41.024937] [DEBUG] [LOCAL ] PD: Primary data saved (48330 records). [2025-10-21T20:31:41.025058] [INFO ] [MAIN ] PD: Full history saved. [2025-10-21T20:31:41.025131] [INFO ] [MAIN ] Update Progress: 1646/2366 symbols completed. PD took 34.0s. Estimated remaining: 1h 32m 34s. Rate: 7.8 symbols/min [2025-10-21T20:31:41.225015] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:31:41.227110] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T20:31:41.250754] [DEBUG] [LOCAL ] PDS: Loaded 16958 existing records from primary storage. [2025-10-21T20:31:41.250973] [INFO ] [MAIN ] PDS: Loaded 16958 existing records. [2025-10-21T20:31:41.427749] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:31:41.427967] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-10-21T20:31:41.428014] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-10-21T20:31:41.428182] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-10-21T20:31:41.428220] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-10-21T20:31:41.754048] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-10-21T20:31:41.790954] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:31:42.076113] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T20:31:42.359039] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T20:31:42.551003] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-10-21T20:31:43.351037] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-10-21T20:31:43.485715] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T20:31:43.625593] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-21T20:31:44.151078] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-10-21T20:31:44.951005] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-10-21T20:31:45.380510] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T20:31:45.756092] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-10-21T20:31:45.769309] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T20:31:45.965217] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T20:31:46.551019] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-10-21T20:31:47.351053] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-10-21T20:31:47.544881] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T20:31:47.582991] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T20:31:48.151031] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-10-21T20:31:48.549844] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T20:31:48.951015] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-10-21T20:31:49.469023] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T20:31:49.751023] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-10-21T20:31:49.837752] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-21T20:31:50.551100] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-10-21T20:31:51.351024] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-10-21T20:31:51.752997] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T20:31:52.013115] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T20:31:52.151052] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-10. [2025-10-21T20:31:52.424300] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T20:31:52.951083] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-10-21T20:31:53.751082] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-10-21T20:31:54.186828] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T20:31:54.194921] [INFO ] [REMOTE ] PDI: Full fetch complete (73140 records). [2025-10-21T20:31:54.195068] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-10-21T20:31:54.555926] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-10-21T20:31:54.623035] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T20:31:54.648131] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-10-21T20:31:54.648344] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-10-21T20:31:54.649623] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-10-21T20:31:54.650120] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-10-21T20:31:54.651550] [DEBUG] [LOCAL ] PDI: Trimmed 73140 records to 50192 (keeping 200 days of data) [2025-10-21T20:31:54.968012] [DEBUG] [LOCAL ] PDI: Primary data saved (50192 records). [2025-10-21T20:31:54.968146] [INFO ] [MAIN ] PDI: Full history saved. [2025-10-21T20:31:54.968975] [INFO ] [MAIN ] Update Progress: 1647/2366 symbols completed. PDI took 36.9s. Estimated remaining: 1h 32m 29s. Rate: 7.8 symbols/min [2025-10-21T20:31:55.148427] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:31:55.167395] [DEBUG] [LOCAL ] PDT: Loaded 17512 existing records from primary storage. [2025-10-21T20:31:55.167680] [INFO ] [MAIN ] PDT: Loaded 17512 existing records. [2025-10-21T20:31:55.355738] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-10. [2025-10-21T20:31:55.392512] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:31:55.394464] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T20:31:55.394541] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-10-21T20:31:55.397451] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-10-21T20:31:55.403533] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-10-21T20:31:55.403612] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-10-21T20:31:55.791298] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:31:55.804803] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T20:31:56.151086] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-10-21T20:31:56.784059] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T20:31:56.789818] [INFO ] [REMOTE ] PDO: Full fetch complete (46982 records). [2025-10-21T20:31:56.789948] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-10-21T20:31:56.960168] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-10-21T20:31:57.196861] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-10-21T20:31:57.196942] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-10-21T20:31:57.197898] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-10-21T20:31:57.197959] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-10-21T20:31:57.198985] [DEBUG] [LOCAL ] PDO: Trimmed 46982 records to 31531 (keeping 200 days of data) [2025-10-21T20:31:57.385432] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T20:31:57.411410] [DEBUG] [LOCAL ] PDO: Primary data saved (31531 records). [2025-10-21T20:31:57.411591] [INFO ] [MAIN ] PDO: Full history saved. [2025-10-21T20:31:57.411734] [INFO ] [MAIN ] Update Progress: 1648/2366 symbols completed. PDO took 30.3s. Estimated remaining: 1h 32m 19s. Rate: 7.8 symbols/min [2025-10-21T20:31:57.588352] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:31:57.605435] [DEBUG] [LOCAL ] PDX: Loaded 14168 existing records from primary storage. [2025-10-21T20:31:57.605732] [INFO ] [MAIN ] PDX: Loaded 14168 existing records. [2025-10-21T20:31:57.756123] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-10-21T20:31:57.820695] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:31:57.820906] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-10-21T20:31:57.820954] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-10-21T20:31:57.821132] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-10-21T20:31:57.821189] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-10-21T20:31:58.266313] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:31:58.307170] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T20:31:58.551082] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-10-21T20:31:59.351009] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-10-21T20:31:59.443510] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T20:31:59.964406] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T20:32:00.151033] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-10-21T20:32:00.599376] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T20:32:00.951095] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-10. [2025-10-21T20:32:01.210867] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T20:32:01.751046] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-10-21T20:32:02.551091] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-10-21T20:32:02.689906] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T20:32:02.696156] [INFO ] [REMOTE ] PDM: Full fetch complete (57333 records). [2025-10-21T20:32:02.696292] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-10-21T20:32:03.091057] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-10-21T20:32:03.091137] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-10-21T20:32:03.092142] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-10-21T20:32:03.092204] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-10-21T20:32:03.093332] [DEBUG] [LOCAL ] PDM: Trimmed 57333 records to 39841 (keeping 200 days of data) [2025-10-21T20:32:03.202210] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T20:32:03.326519] [DEBUG] [LOCAL ] PDM: Primary data saved (39841 records). [2025-10-21T20:32:03.326670] [INFO ] [MAIN ] PDM: Full history saved. [2025-10-21T20:32:03.327331] [INFO ] [MAIN ] Update Progress: 1649/2366 symbols completed. PDM took 36.8s. Estimated remaining: 1h 32m 10s. Rate: 7.8 symbols/min [2025-10-21T20:32:03.352253] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-10-21T20:32:03.507937] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:03.508252] [DEBUG] [LOCAL ] PEB: No existing data file found in primary storage. [2025-10-21T20:32:03.508303] [WARN ] [MAIN ] PEB: No existing data found, performing full refresh instead. [2025-10-21T20:32:03.508442] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-10-21T20:32:03.508485] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-10-21T20:32:03.508582] [DEBUG] [LOCAL ] PEB: No primary data file found to delete. [2025-10-21T20:32:03.508633] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-10-21T20:32:03.871482] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:03.866605] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T20:32:04.150997] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-10-21T20:32:04.435358] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T20:32:04.951023] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-10-21T20:32:05.361613] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T20:32:05.751085] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-10-21T20:32:06.171083] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T20:32:06.550995] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-10-21T20:32:06.907161] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T20:32:07.351040] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-10-21T20:32:07.677015] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T20:32:08.122570] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T20:32:08.150984] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-10-21T20:32:08.951070] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-10-21T20:32:09.277288] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T20:32:09.751054] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-10-21T20:32:10.053918] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T20:32:10.551005] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-10-21T20:32:10.859685] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T20:32:11.351035] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-10. [2025-10-21T20:32:12.151062] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-10-21T20:32:12.301395] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T20:32:12.335715] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T20:32:12.338615] [INFO ] [REMOTE ] PDS: Full fetch complete (25658 records). [2025-10-21T20:32:12.338724] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-10-21T20:32:12.708094] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-10-21T20:32:12.708215] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-10-21T20:32:12.708576] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-10-21T20:32:12.708616] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-10-21T20:32:12.709206] [DEBUG] [LOCAL ] PDS: Trimmed 25658 records to 16771 (keeping 200 days of data) [2025-10-21T20:32:12.802968] [DEBUG] [LOCAL ] PDS: Primary data saved (16771 records). [2025-10-21T20:32:12.803095] [INFO ] [MAIN ] PDS: Full history saved. [2025-10-21T20:32:12.803176] [INFO ] [MAIN ] Update Progress: 1650/2366 symbols completed. PDS took 31.8s. Estimated remaining: 1h 32m 4s. Rate: 7.8 symbols/min [2025-10-21T20:32:12.951514] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-10-21T20:32:12.973767] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:12.974618] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-10-21T20:32:12.974692] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-10-21T20:32:12.974817] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-10-21T20:32:12.974860] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-10-21T20:32:12.974899] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-10-21T20:32:12.974930] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-10-21T20:32:13.315351] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T20:32:13.347886] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:13.751032] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-10-21T20:32:14.551109] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-10-21T20:32:14.786368] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T20:32:14.909746] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T20:32:15.351046] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-10-21T20:32:15.604090] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T20:32:16.151040] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-10-21T20:32:16.951049] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-10-21T20:32:17.237916] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T20:32:17.305297] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T20:32:17.548565] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T20:32:17.751109] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-10-21T20:32:18.551022] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-10-21T20:32:18.754534] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T20:32:19.351036] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-10. [2025-10-21T20:32:20.151053] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-10-21T20:32:20.481138] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T20:32:20.485079] [INFO ] [REMOTE ] PDT: Full fetch complete (25126 records). [2025-10-21T20:32:20.485187] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-10-21T20:32:20.683621] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-21T20:32:20.907691] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-10-21T20:32:20.907789] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-10-21T20:32:20.908326] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-10-21T20:32:20.908374] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-10-21T20:32:20.909154] [DEBUG] [LOCAL ] PDT: Trimmed 25126 records to 17479 (keeping 200 days of data) [2025-10-21T20:32:20.955102] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-10. [2025-10-21T20:32:21.019168] [DEBUG] [LOCAL ] PDT: Primary data saved (17479 records). [2025-10-21T20:32:21.019398] [INFO ] [MAIN ] PDT: Full history saved. [2025-10-21T20:32:21.019485] [INFO ] [MAIN ] Update Progress: 1651/2366 symbols completed. PDT took 26.1s. Estimated remaining: 1h 31m 56s. Rate: 7.8 symbols/min [2025-10-21T20:32:21.186234] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:21.186444] [DEBUG] [LOCAL ] PEN: No existing data file found in primary storage. [2025-10-21T20:32:21.186481] [WARN ] [MAIN ] PEN: No existing data found, performing full refresh instead. [2025-10-21T20:32:21.186624] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-10-21T20:32:21.186711] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-10-21T20:32:21.186762] [DEBUG] [LOCAL ] PEN: No primary data file found to delete. [2025-10-21T20:32:21.186843] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-10-21T20:32:21.553208] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:21.751062] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-10-21T20:32:21.982146] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T20:32:22.047930] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-21T20:32:22.050346] [INFO ] [REMOTE ] PDX: Full fetch complete (23730 records). [2025-10-21T20:32:22.050413] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-10-21T20:32:22.416689] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-10-21T20:32:22.416776] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-10-21T20:32:22.417339] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-10-21T20:32:22.417400] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-10-21T20:32:22.418050] [DEBUG] [LOCAL ] PDX: Trimmed 23730 records to 14225 (keeping 200 days of data) [2025-10-21T20:32:22.508185] [DEBUG] [LOCAL ] PDX: Primary data saved (14225 records). [2025-10-21T20:32:22.508279] [INFO ] [MAIN ] PDX: Full history saved. [2025-10-21T20:32:22.508352] [INFO ] [MAIN ] Update Progress: 1652/2366 symbols completed. PDX took 25.1s. Estimated remaining: 1h 31m 46s. Rate: 7.8 symbols/min [2025-10-21T20:32:22.562036] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-10-21T20:32:22.676600] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:22.689047] [DEBUG] [LOCAL ] PEO: Loaded 11179 existing records from primary storage. [2025-10-21T20:32:22.689258] [INFO ] [MAIN ] PEO: Loaded 11179 existing records. [2025-10-21T20:32:22.870825] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:32:22.871034] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-10-21T20:32:22.871082] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-10-21T20:32:22.871320] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-10-21T20:32:22.871376] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-10-21T20:32:23.228694] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:23.351019] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-10-21T20:32:23.524535] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T20:32:24.151036] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-10-21T20:32:24.453871] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T20:32:24.506711] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T20:32:24.951029] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-10-21T20:32:25.751049] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-10-21T20:32:25.909741] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T20:32:26.370039] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T20:32:26.551028] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-10-21T20:32:26.617249] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T20:32:27.351030] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-10-21T20:32:27.912598] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T20:32:28.151072] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-10-21T20:32:28.951049] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-10-21T20:32:29.067125] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T20:32:29.440784] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T20:32:29.751047] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-10-21T20:32:30.463231] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T20:32:30.551034] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-10-21T20:32:31.351075] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-10-21T20:32:31.765364] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T20:32:32.040982] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T20:32:32.151045] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-10-21T20:32:32.244195] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T20:32:32.951050] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-10-21T20:32:32.997365] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T20:32:33.751076] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-10-21T20:32:34.550999] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-10-21T20:32:34.770526] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T20:32:35.146393] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T20:32:35.351008] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-10-21T20:32:36.150995] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-10-21T20:32:36.295137] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T20:32:36.359200] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T20:32:36.951052] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-10-21T20:32:37.556991] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T20:32:37.751022] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-10-21T20:32:38.550992] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-10-21T20:32:38.723899] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T20:32:38.873397] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T20:32:39.351036] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-10-21T20:32:39.782104] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T20:32:40.151045] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-10-21T20:32:40.284749] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T20:32:40.951018] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-10-21T20:32:41.751034] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-10-21T20:32:41.921758] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T20:32:42.277958] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-21T20:32:42.551077] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-10-21T20:32:43.351008] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-10-21T20:32:43.580740] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T20:32:44.041432] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T20:32:44.151019] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-10-21T20:32:44.951087] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-10. [2025-10-21T20:32:45.267054] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T20:32:45.611093] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T20:32:45.751114] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-10-21T20:32:46.551052] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-10. [2025-10-21T20:32:46.835838] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T20:32:46.843954] [INFO ] [REMOTE ] PEB: Full fetch complete (73189 records). [2025-10-21T20:32:46.844087] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-10-21T20:32:47.239877] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T20:32:47.268659] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-10-21T20:32:47.269083] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-10-21T20:32:47.270259] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-10-21T20:32:47.270321] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-10-21T20:32:47.271666] [DEBUG] [LOCAL ] PEB: Trimmed 73189 records to 50735 (keeping 200 days of data) [2025-10-21T20:32:47.356773] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-10. [2025-10-21T20:32:47.565521] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T20:32:47.569408] [INFO ] [REMOTE ] PEO: Full fetch complete (16278 records). [2025-10-21T20:32:47.581417] [DEBUG] [LOCAL ] PEB: Primary data saved (50735 records). [2025-10-21T20:32:47.573816] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-10-21T20:32:47.581513] [INFO ] [MAIN ] PEB: Full history saved. [2025-10-21T20:32:47.581923] [INFO ] [MAIN ] Update Progress: 1653/2366 symbols completed. PEB took 44.3s. Estimated remaining: 1h 31m 45s. Rate: 7.8 symbols/min [2025-10-21T20:32:47.914038] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:48.085021] [DEBUG] [LOCAL ] PERF: Loaded 14457 existing records from primary storage. [2025-10-21T20:32:48.115042] [INFO ] [MAIN ] PERF: Loaded 14457 existing records. [2025-10-21T20:32:48.215632] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-10-21T20:32:48.175066] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-10-21T20:32:48.220973] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-10-21T20:32:48.226586] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-10-21T20:32:48.232206] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-10-21T20:32:48.244996] [DEBUG] [LOCAL ] PEO: Trimmed 16278 records to 11168 (keeping 200 days of data) [2025-10-21T20:32:48.379518] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:32:48.384905] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-10-21T20:32:48.385015] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-10-21T20:32:48.385630] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-10-21T20:32:48.386025] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-10-21T20:32:48.507071] [DEBUG] [LOCAL ] PEO: Primary data saved (11168 records). [2025-10-21T20:32:48.517437] [INFO ] [MAIN ] PEO: Full history saved. [2025-10-21T20:32:48.522734] [INFO ] [MAIN ] Update Progress: 1654/2366 symbols completed. PEO took 26.0s. Estimated remaining: 1h 31m 35s. Rate: 7.8 symbols/min [2025-10-21T20:32:48.905363] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T20:32:48.951894] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:48.958122] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:48.958529] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-10-21T20:32:48.958856] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-10-21T20:32:48.959736] [INFO ] [REMOTE ] PEN: Full fetch complete (44242 records). [2025-10-21T20:32:48.959923] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-10-21T20:32:48.959838] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-10-21T20:32:48.960266] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-10-21T20:32:48.992323] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-21T20:32:49.004368] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-21T20:32:49.027802] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-10-21T20:32:49.693242] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:49.741189] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-10-21T20:32:49.741289] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-10-21T20:32:49.742261] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-10-21T20:32:49.742325] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-10-21T20:32:49.743484] [DEBUG] [LOCAL ] PEN: Trimmed 44242 records to 29689 (keeping 200 days of data) [2025-10-21T20:32:49.793618] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-10-21T20:32:49.925684] [DEBUG] [LOCAL ] PEN: Primary data saved (29689 records). [2025-10-21T20:32:49.925959] [INFO ] [MAIN ] PEN: Full history saved. [2025-10-21T20:32:49.926066] [INFO ] [MAIN ] Update Progress: 1655/2366 symbols completed. PEN took 28.9s. Estimated remaining: 1h 31m 24s. Rate: 7.8 symbols/min [2025-10-21T20:32:50.103004] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:50.103295] [DEBUG] [LOCAL ] PFD: No existing data file found in primary storage. [2025-10-21T20:32:50.103361] [WARN ] [MAIN ] PFD: No existing data found, performing full refresh instead. [2025-10-21T20:32:50.103601] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-10-21T20:32:50.103696] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-10-21T20:32:50.103785] [DEBUG] [LOCAL ] PFD: No primary data file found to delete. [2025-10-21T20:32:50.103832] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-10-21T20:32:50.189412] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:32:50.205953] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-10-21T20:32:50.206148] [FATAL] [REMOTE ] PEW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:32:50.223050] [FATAL] [MAIN ] PEW: Failed to fetch primary data. [2025-10-21T20:32:50.254990] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:32:50.303483] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T20:32:50.303623] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-10-21T20:32:50.357828] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-10-21T20:32:50.367738] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T20:32:50.371717] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-10-21T20:32:50.386064] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-10-21T20:32:50.386353] [INFO ] [MAIN ] Update Progress: 1656/2366 symbols completed. PEW took 1.9s. Estimated remaining: 1h 31m 13s. Rate: 7.8 symbols/min [2025-10-21T20:32:50.551910] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-10-21T20:32:50.682841] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:50.707639] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:50.707825] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-10-21T20:32:50.707863] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-10-21T20:32:50.707972] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-10-21T20:32:50.708013] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-10-21T20:32:50.708053] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-10-21T20:32:50.708084] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-10-21T20:32:51.060609] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:51.351030] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-10-21T20:32:51.758330] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T20:32:52.151012] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-10-21T20:32:52.950989] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-10-21T20:32:53.170411] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T20:32:53.694168] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T20:32:53.751007] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-10-21T20:32:53.907489] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-21T20:32:54.551039] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-10-21T20:32:54.635500] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T20:32:55.351057] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-10. [2025-10-21T20:32:56.151017] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-10-21T20:32:56.954776] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-10-21T20:32:56.955480] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T20:32:57.085071] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T20:32:57.093499] [INFO ] [REMOTE ] PEG: Full fetch complete (76983 records). [2025-10-21T20:32:57.093632] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-10-21T20:32:57.394379] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.84 seconds). [2025-10-21T20:32:57.542666] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-10-21T20:32:57.542753] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-10-21T20:32:57.543876] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-10-21T20:32:57.543938] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-10-21T20:32:57.545381] [DEBUG] [LOCAL ] PEG: Trimmed 76983 records to 53139 (keeping 200 days of data) [2025-10-21T20:32:57.755806] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-10-21T20:32:57.764997] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T20:32:57.883307] [DEBUG] [LOCAL ] PEG: Primary data saved (53139 records). [2025-10-21T20:32:57.883441] [INFO ] [MAIN ] PEG: Full history saved. [2025-10-21T20:32:57.883514] [INFO ] [MAIN ] Update Progress: 1657/2366 symbols completed. PEG took 45.1s. Estimated remaining: 1h 31m 6s. Rate: 7.8 symbols/min [2025-10-21T20:32:58.054715] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:32:58.054896] [DEBUG] [LOCAL ] PFGC: No existing data file found in primary storage. [2025-10-21T20:32:58.054934] [WARN ] [MAIN ] PFGC: No existing data found, performing full refresh instead. [2025-10-21T20:32:58.055079] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-10-21T20:32:58.055139] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-10-21T20:32:58.055219] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-10-21T20:32:58.055288] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-10-21T20:32:58.415951] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:32:58.551045] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-10-21T20:32:59.351069] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-10-21T20:33:00.151068] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-10-21T20:33:00.211835] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T20:33:00.238105] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T20:33:00.529498] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-21T20:33:00.951108] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-10-21T20:33:00.971545] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T20:33:01.750999] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-10-21T20:33:01.770593] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T20:33:02.551022] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-10-21T20:33:03.048444] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T20:33:03.240492] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T20:33:03.351102] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-10-21T20:33:04.151066] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-10-21T20:33:04.849104] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T20:33:04.951035] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-10-21T20:33:05.114297] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T20:33:05.751051] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-10-21T20:33:06.551126] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-10-21T20:33:07.039098] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T20:33:07.351057] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-10-21T20:33:07.393335] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T20:33:07.650327] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-10-21T20:33:08.151023] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-10-21T20:33:08.367329] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T20:33:08.951062] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-10-21T20:33:09.751092] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-10-21T20:33:10.316882] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T20:33:10.396987] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T20:33:10.551078] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-10-21T20:33:11.073711] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-10-21T20:33:11.351039] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-10. [2025-10-21T20:33:12.150990] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-10-21T20:33:12.221084] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T20:33:12.223916] [INFO ] [REMOTE ] PERF: Full fetch complete (21721 records). [2025-10-21T20:33:12.223999] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-10-21T20:33:12.535248] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T20:33:12.624776] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-10-21T20:33:12.624847] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-10-21T20:33:12.625279] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-10-21T20:33:12.625320] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-10-21T20:33:12.625891] [DEBUG] [LOCAL ] PERF: Trimmed 21721 records to 14530 (keeping 200 days of data) [2025-10-21T20:33:12.706539] [DEBUG] [LOCAL ] PERF: Primary data saved (14530 records). [2025-10-21T20:33:12.706695] [INFO ] [MAIN ] PERF: Full history saved. [2025-10-21T20:33:12.706795] [INFO ] [MAIN ] Update Progress: 1658/2366 symbols completed. PERF took 25.1s. Estimated remaining: 1h 31m 1s. Rate: 7.8 symbols/min [2025-10-21T20:33:12.873741] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:33:12.882099] [DEBUG] [LOCAL ] PFH: Loaded 6502 existing records from primary storage. [2025-10-21T20:33:12.882252] [INFO ] [MAIN ] PFH: Loaded 6502 existing records. [2025-10-21T20:33:12.960900] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-10-21T20:33:12.987313] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T20:33:13.064897] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:33:13.065096] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-10-21T20:33:13.065144] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-10-21T20:33:13.065312] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-10-21T20:33:13.065367] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-10-21T20:33:13.410776] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:33:13.751028] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-10-21T20:33:14.551087] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-10-21T20:33:15.274289] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T20:33:15.351012] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-10-21T20:33:15.507510] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T20:33:15.772873] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.81 seconds). [2025-10-21T20:33:16.151008] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-10. [2025-10-21T20:33:16.162083] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T20:33:16.906563] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T20:33:16.907994] [INFO ] [REMOTE ] PFD: Full fetch complete (7454 records). [2025-10-21T20:33:16.908064] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-10-21T20:33:16.956116] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-10-21T20:33:17.273054] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-10-21T20:33:17.273154] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-10-21T20:33:17.273363] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-10-21T20:33:17.273401] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-10-21T20:33:17.273812] [DEBUG] [LOCAL ] PFD: Trimmed 7454 records to 5399 (keeping 200 days of data) [2025-10-21T20:33:17.306132] [DEBUG] [LOCAL ] PFD: Primary data saved (5399 records). [2025-10-21T20:33:17.306254] [INFO ] [MAIN ] PFD: Full history saved. [2025-10-21T20:33:17.306331] [INFO ] [MAIN ] Update Progress: 1659/2366 symbols completed. PFD took 27.4s. Estimated remaining: 1h 30m 52s. Rate: 7.8 symbols/min [2025-10-21T20:33:17.474877] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:33:17.492692] [DEBUG] [LOCAL ] PFL: Loaded 14544 existing records from primary storage. [2025-10-21T20:33:17.492953] [INFO ] [MAIN ] PFL: Loaded 14544 existing records. [2025-10-21T20:33:17.673514] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:33:17.673754] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-10-21T20:33:17.673806] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-10-21T20:33:17.673982] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-10-21T20:33:17.674058] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-10-21T20:33:17.753974] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-10-21T20:33:17.911202] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-21T20:33:18.058928] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:33:18.551028] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-10-21T20:33:19.351083] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-10-21T20:33:19.403167] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T20:33:19.436895] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T20:33:20.151014] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-10-21T20:33:20.377369] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T20:33:20.951033] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-10-21T20:33:21.045589] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T20:33:21.751076] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-10-21T20:33:22.551072] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-10-21T20:33:23.351034] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-10-21T20:33:23.629225] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T20:33:23.634927] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T20:33:23.974241] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-10-21T20:33:24.071342] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T20:33:24.151025] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-10-21T20:33:24.826739] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-21T20:33:24.951095] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-10-21T20:33:25.751042] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-10-21T20:33:25.949690] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T20:33:26.551022] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-10-21T20:33:27.351002] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-10-21T20:33:27.669449] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T20:33:28.151003] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-10-21T20:33:28.237606] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-21T20:33:28.950997] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-10-21T20:33:29.047553] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T20:33:29.096511] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T20:33:29.751043] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-10-21T20:33:29.782369] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T20:33:30.551079] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-10-21T20:33:31.351070] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-10-21T20:33:32.094353] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T20:33:32.150981] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-10. [2025-10-21T20:33:32.345764] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T20:33:32.425698] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-21T20:33:32.805252] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T20:33:32.806685] [INFO ] [REMOTE ] PFH: Full fetch complete (9659 records). [2025-10-21T20:33:32.806765] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-10-21T20:33:32.961345] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-10. [2025-10-21T20:33:33.214709] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-10-21T20:33:33.214823] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-10-21T20:33:33.215173] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-10-21T20:33:33.215216] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-10-21T20:33:33.215752] [DEBUG] [LOCAL ] PFH: Trimmed 9659 records to 6451 (keeping 200 days of data) [2025-10-21T20:33:33.257324] [DEBUG] [LOCAL ] PFH: Primary data saved (6451 records). [2025-10-21T20:33:33.257512] [INFO ] [MAIN ] PFH: Full history saved. [2025-10-21T20:33:33.257629] [INFO ] [MAIN ] Update Progress: 1660/2366 symbols completed. PFH took 20.6s. Estimated remaining: 1h 30m 48s. Rate: 7.8 symbols/min [2025-10-21T20:33:33.442169] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:33:33.492060] [DEBUG] [LOCAL ] PFLT: Loaded 44339 existing records from primary storage. [2025-10-21T20:33:33.492470] [INFO ] [MAIN ] PFLT: Loaded 44339 existing records. [2025-10-21T20:33:33.691140] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:33:33.691497] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-10-21T20:33:33.691580] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-10-21T20:33:33.692030] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-10-21T20:33:33.692091] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-10-21T20:33:33.757375] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-10-21T20:33:34.069839] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:33:34.551005] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-10-21T20:33:34.822003] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T20:33:35.351032] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-10. [2025-10-21T20:33:35.645197] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-21T20:33:35.653769] [INFO ] [REMOTE ] PFE: Full fetch complete (77993 records). [2025-10-21T20:33:35.653925] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-10-21T20:33:36.051190] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-10-21T20:33:36.051391] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-10-21T20:33:36.052609] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-10-21T20:33:36.052839] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-10-21T20:33:36.054601] [DEBUG] [LOCAL ] PFE: Trimmed 77993 records to 53813 (keeping 200 days of data) [2025-10-21T20:33:36.084823] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T20:33:36.155391] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-10-21T20:33:36.423043] [DEBUG] [LOCAL ] PFE: Primary data saved (53813 records). [2025-10-21T20:33:36.423182] [INFO ] [MAIN ] PFE: Full history saved. [2025-10-21T20:33:36.423262] [INFO ] [MAIN ] Update Progress: 1661/2366 symbols completed. PFE took 46.0s. Estimated remaining: 1h 30m 38s. Rate: 7.8 symbols/min [2025-10-21T20:33:36.595985] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:33:36.616752] [DEBUG] [LOCAL ] PFN: Loaded 22398 existing records from primary storage. [2025-10-21T20:33:36.616977] [INFO ] [MAIN ] PFN: Loaded 22398 existing records. [2025-10-21T20:33:36.792716] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:33:36.793056] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-10-21T20:33:36.793115] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-10-21T20:33:36.793315] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-10-21T20:33:36.793370] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-10-21T20:33:36.953690] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-10-21T20:33:37.180783] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:33:37.184997] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T20:33:37.192125] [INFO ] [REMOTE ] PFGC: Full fetch complete (67759 records). [2025-10-21T20:33:37.192247] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-10-21T20:33:37.308366] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T20:33:37.593346] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-10-21T20:33:37.593427] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-10-21T20:33:37.594683] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-10-21T20:33:37.594748] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-10-21T20:33:37.596101] [DEBUG] [LOCAL ] PFGC: Trimmed 67759 records to 46930 (keeping 200 days of data) [2025-10-21T20:33:37.761991] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-10-21T20:33:37.875474] [DEBUG] [LOCAL ] PFGC: Primary data saved (46930 records). [2025-10-21T20:33:37.875606] [INFO ] [MAIN ] PFGC: Full history saved. [2025-10-21T20:33:37.875699] [INFO ] [MAIN ] Update Progress: 1662/2366 symbols completed. PFGC took 40.0s. Estimated remaining: 1h 30m 28s. Rate: 7.8 symbols/min [2025-10-21T20:33:38.056172] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:33:38.063469] [DEBUG] [LOCAL ] PFO: Loaded 6099 existing records from primary storage. [2025-10-21T20:33:38.063710] [INFO ] [MAIN ] PFO: Loaded 6099 existing records. [2025-10-21T20:33:38.239569] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:33:38.239830] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-10-21T20:33:38.239883] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-10-21T20:33:38.240030] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-10-21T20:33:38.240067] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-10-21T20:33:38.552678] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-10-21T20:33:38.592442] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:33:38.779957] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T20:33:38.961083] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T20:33:39.351063] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-10-21T20:33:39.799410] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T20:33:40.151057] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-10-21T20:33:40.294982] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T20:33:40.950991] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-10-21T20:33:41.031591] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T20:33:41.751010] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-10-21T20:33:42.551123] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-10. [2025-10-21T20:33:42.850116] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T20:33:43.053956] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T20:33:43.309540] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T20:33:43.313086] [INFO ] [REMOTE ] PFL: Full fetch complete (20765 records). [2025-10-21T20:33:43.313177] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-10-21T20:33:43.356182] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-10-21T20:33:43.682325] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-10-21T20:33:43.682420] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-10-21T20:33:43.682888] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-10-21T20:33:43.682956] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-10-21T20:33:43.683534] [DEBUG] [LOCAL ] PFL: Trimmed 20765 records to 14565 (keeping 200 days of data) [2025-10-21T20:33:43.766838] [DEBUG] [LOCAL ] PFL: Primary data saved (14565 records). [2025-10-21T20:33:43.766962] [INFO ] [MAIN ] PFL: Full history saved. [2025-10-21T20:33:43.767081] [INFO ] [MAIN ] Update Progress: 1663/2366 symbols completed. PFL took 26.5s. Estimated remaining: 1h 30m 19s. Rate: 7.8 symbols/min [2025-10-21T20:33:43.935571] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:33:43.935768] [DEBUG] [LOCAL ] PFS: No existing data file found in primary storage. [2025-10-21T20:33:43.935810] [WARN ] [MAIN ] PFS: No existing data found, performing full refresh instead. [2025-10-21T20:33:43.935915] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-10-21T20:33:43.935955] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-10-21T20:33:43.935995] [DEBUG] [LOCAL ] PFS: No primary data file found to delete. [2025-10-21T20:33:43.936026] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-10-21T20:33:44.156775] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-10-21T20:33:44.292939] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:33:44.951106] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-10-21T20:33:45.275186] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T20:33:45.503398] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T20:33:45.751079] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-10-21T20:33:46.550987] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-10-21T20:33:46.717795] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T20:33:47.351047] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-10-21T20:33:47.690473] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T20:33:47.754015] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T20:33:48.151061] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-10-21T20:33:48.893326] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T20:33:48.950984] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-10-21T20:33:49.750984] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-10-21T20:33:50.011509] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T20:33:50.458077] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T20:33:50.550999] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-10-21T20:33:50.959874] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T20:33:51.351053] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-10-21T20:33:52.132289] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T20:33:52.151008] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-10-21T20:33:52.306501] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T20:33:52.951004] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-10-21T20:33:52.968748] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T20:33:53.751023] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-10-21T20:33:54.550990] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-10-21T20:33:54.673484] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T20:33:55.059059] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T20:33:55.351021] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-10-21T20:33:56.087505] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T20:33:56.151046] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-10-21T20:33:56.867571] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-21T20:33:56.951031] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-10-21T20:33:57.243326] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T20:33:57.697512] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T20:33:57.751027] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-10-21T20:33:58.551032] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-10-21T20:33:59.351034] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-10-21T20:33:59.558169] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T20:33:59.875742] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T20:34:00.109239] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T20:34:00.151009] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-10-21T20:34:00.951045] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-10-21T20:34:01.751054] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-10-21T20:34:01.856308] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T20:34:01.909408] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T20:34:02.551069] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-10-21T20:34:03.021379] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-21T20:34:03.351095] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-10-21T20:34:03.944727] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T20:34:04.151012] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-10-21T20:34:04.314327] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-21T20:34:04.951067] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-10-21T20:34:05.652712] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T20:34:05.751006] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-10-21T20:34:05.861742] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T20:34:06.551040] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-10. [2025-10-21T20:34:07.074932] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T20:34:07.351075] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-10. [2025-10-21T20:34:08.127076] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T20:34:08.134221] [INFO ] [REMOTE ] PFS: Full fetch complete (52211 records). [2025-10-21T20:34:08.134353] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-10-21T20:34:08.156128] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-10-21T20:34:08.523453] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-10-21T20:34:08.523530] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-10-21T20:34:08.524447] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-10-21T20:34:08.524511] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-10-21T20:34:08.525706] [DEBUG] [LOCAL ] PFS: Trimmed 52211 records to 35763 (keeping 200 days of data) [2025-10-21T20:34:08.735330] [DEBUG] [LOCAL ] PFS: Primary data saved (35763 records). [2025-10-21T20:34:08.735454] [INFO ] [MAIN ] PFS: Full history saved. [2025-10-21T20:34:08.735521] [INFO ] [MAIN ] Update Progress: 1664/2366 symbols completed. PFS took 25.0s. Estimated remaining: 1h 30m 19s. Rate: 7.8 symbols/min [2025-10-21T20:34:08.906093] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:34:08.936465] [DEBUG] [LOCAL ] PFSI: Loaded 29172 existing records from primary storage. [2025-10-21T20:34:08.936742] [INFO ] [MAIN ] PFSI: Loaded 29172 existing records. [2025-10-21T20:34:08.967903] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-10. [2025-10-21T20:34:09.116597] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:34:09.116949] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-10-21T20:34:09.117007] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-10-21T20:34:09.117192] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-10-21T20:34:09.117247] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-10-21T20:34:09.475015] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:34:09.496080] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-21T20:34:09.503860] [INFO ] [REMOTE ] PFLT: Full fetch complete (64404 records). [2025-10-21T20:34:09.504001] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-10-21T20:34:09.666448] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T20:34:09.752422] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-10-21T20:34:09.834001] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T20:34:09.874502] [INFO ] [REMOTE ] PFO: Full fetch complete (7847 records). [2025-10-21T20:34:09.908695] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-10-21T20:34:09.970777] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-10-21T20:34:09.991396] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-10-21T20:34:09.998066] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-10-21T20:34:09.998151] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-10-21T20:34:10.042213] [DEBUG] [LOCAL ] PFLT: Trimmed 64404 records to 44325 (keeping 200 days of data) [2025-10-21T20:34:10.438395] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-10-21T20:34:10.438481] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-10-21T20:34:10.438752] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-10-21T20:34:10.438818] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-10-21T20:34:10.499554] [DEBUG] [LOCAL ] PFO: Trimmed 7847 records to 6109 (keeping 200 days of data) [2025-10-21T20:34:10.554970] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-10. [2025-10-21T20:34:10.586882] [DEBUG] [LOCAL ] PFO: Primary data saved (6109 records). [2025-10-21T20:34:10.589706] [INFO ] [MAIN ] PFO: Full history saved. [2025-10-21T20:34:10.595162] [INFO ] [MAIN ] Update Progress: 1665/2366 symbols completed. PFO took 32.7s. Estimated remaining: 1h 30m 9s. Rate: 7.8 symbols/min [2025-10-21T20:34:10.740533] [DEBUG] [LOCAL ] PFLT: Primary data saved (44325 records). [2025-10-21T20:34:10.756006] [INFO ] [MAIN ] PFLT: Full history saved. [2025-10-21T20:34:10.775502] [INFO ] [MAIN ] Update Progress: 1666/2366 symbols completed. PFLT took 37.5s. Estimated remaining: 1h 29m 58s. Rate: 7.8 symbols/min [2025-10-21T20:34:10.875276] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:34:10.899006] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-10-21T20:34:10.901458] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-10-21T20:34:10.901603] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-10-21T20:34:10.901950] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-10-21T20:34:10.907390] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-10-21T20:34:10.912575] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-10-21T20:34:11.083712] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:34:11.172679] [DEBUG] [LOCAL ] PGP: Loaded 5690 existing records from primary storage. [2025-10-21T20:34:11.211717] [INFO ] [MAIN ] PGP: Loaded 5690 existing records. [2025-10-21T20:34:11.490516] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:34:11.518211] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-10-21T20:34:11.564882] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:34:11.565083] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-10-21T20:34:11.565131] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-10-21T20:34:11.565447] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-10-21T20:34:11.565504] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-10-21T20:34:11.928691] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T20:34:11.932140] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-21T20:34:11.969339] [INFO ] [REMOTE ] PFN: Full fetch complete (31372 records). [2025-10-21T20:34:11.994530] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-10-21T20:34:12.108761] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:34:12.156117] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-10-21T20:34:12.421529] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-10-21T20:34:12.421604] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-10-21T20:34:12.422228] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-10-21T20:34:12.422287] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-10-21T20:34:12.422979] [DEBUG] [LOCAL ] PFN: Trimmed 31372 records to 22317 (keeping 200 days of data) [2025-10-21T20:34:12.552248] [DEBUG] [LOCAL ] PFN: Primary data saved (22317 records). [2025-10-21T20:34:12.552367] [INFO ] [MAIN ] PFN: Full history saved. [2025-10-21T20:34:12.552443] [INFO ] [MAIN ] Update Progress: 1667/2366 symbols completed. PFN took 36.1s. Estimated remaining: 1h 29m 48s. Rate: 7.8 symbols/min [2025-10-21T20:34:12.725750] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:34:12.725912] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-10-21T20:34:12.725948] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-10-21T20:34:12.726063] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-10-21T20:34:12.726104] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-10-21T20:34:12.726154] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-10-21T20:34:12.726218] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-10-21T20:34:12.965375] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-10-21T20:34:13.097129] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:34:13.644945] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T20:34:13.751090] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-10-21T20:34:13.819391] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-21T20:34:13.990910] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T20:34:14.551080] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-10-21T20:34:15.111070] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T20:34:15.351050] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-10-21T20:34:16.151013] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-10-21T20:34:16.163831] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T20:34:16.539965] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T20:34:16.951021] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-10-21T20:34:17.751122] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-10-21T20:34:18.464083] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-21T20:34:18.551072] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-10-21T20:34:18.938403] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-21T20:34:19.083011] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T20:34:19.324824] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T20:34:19.351006] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-10-21T20:34:20.150987] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-10-21T20:34:20.225297] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T20:34:20.951026] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-10-21T20:34:21.751100] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-10-21T20:34:22.485836] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-21T20:34:22.551021] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-10-21T20:34:22.738362] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T20:34:23.009216] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T20:34:23.351018] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-10-21T20:34:24.151022] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-10-21T20:34:24.624394] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T20:34:24.948452] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-21T20:34:24.958566] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-10-21T20:34:25.751075] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-10-21T20:34:26.463244] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-21T20:34:26.550978] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-10-21T20:34:26.593935] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T20:34:27.351064] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-10-21T20:34:28.054910] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-21T20:34:28.150995] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-10-21T20:34:28.580610] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-21T20:34:28.837482] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T20:34:28.950995] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-10-21T20:34:29.751055] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-10-21T20:34:30.356449] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T20:34:30.386764] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-21T20:34:30.460086] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T20:34:30.550983] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-10. [2025-10-21T20:34:31.351076] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-10-21T20:34:31.891268] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T20:34:31.896205] [INFO ] [REMOTE ] PFSI: Full fetch complete (41590 records). [2025-10-21T20:34:31.896312] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-10-21T20:34:32.094006] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T20:34:32.158590] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-10-21T20:34:32.294569] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-10-21T20:34:32.294665] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-10-21T20:34:32.295511] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-10-21T20:34:32.295553] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-10-21T20:34:32.296485] [DEBUG] [LOCAL ] PFSI: Trimmed 41590 records to 29123 (keeping 200 days of data) [2025-10-21T20:34:32.478425] [DEBUG] [LOCAL ] PFSI: Primary data saved (29123 records). [2025-10-21T20:34:32.478514] [INFO ] [MAIN ] PFSI: Full history saved. [2025-10-21T20:34:32.478588] [INFO ] [MAIN ] Update Progress: 1668/2366 symbols completed. PFSI took 23.7s. Estimated remaining: 1h 29m 45s. Rate: 7.8 symbols/min [2025-10-21T20:34:32.644433] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:34:32.644604] [DEBUG] [LOCAL ] PGRE: No existing data file found in primary storage. [2025-10-21T20:34:32.644661] [WARN ] [MAIN ] PGRE: No existing data found, performing full refresh instead. [2025-10-21T20:34:32.644794] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-10-21T20:34:32.644834] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-10-21T20:34:32.644876] [DEBUG] [LOCAL ] PGRE: No primary data file found to delete. [2025-10-21T20:34:32.644907] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-10-21T20:34:32.961755] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-10-21T20:34:33.003283] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:34:33.741033] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T20:34:33.750987] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-10-21T20:34:34.325611] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T20:34:34.551008] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-10-21T20:34:34.626528] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T20:34:35.351093] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-10-21T20:34:36.151101] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-10-21T20:34:36.354297] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T20:34:36.935811] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T20:34:36.950974] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-10. [2025-10-21T20:34:37.277474] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T20:34:37.686595] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T20:34:37.688200] [INFO ] [REMOTE ] PGP: Full fetch complete (7945 records). [2025-10-21T20:34:37.688269] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-10-21T20:34:37.756186] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-10-21T20:34:38.071412] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-10-21T20:34:38.071493] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-10-21T20:34:38.071732] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-10-21T20:34:38.071793] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-10-21T20:34:38.072183] [DEBUG] [LOCAL ] PGP: Trimmed 7945 records to 5696 (keeping 200 days of data) [2025-10-21T20:34:38.104571] [DEBUG] [LOCAL ] PGP: Primary data saved (5696 records). [2025-10-21T20:34:38.104863] [INFO ] [MAIN ] PGP: Full history saved. [2025-10-21T20:34:38.104964] [INFO ] [MAIN ] Update Progress: 1669/2366 symbols completed. PGP took 27.3s. Estimated remaining: 1h 29m 36s. Rate: 7.8 symbols/min [2025-10-21T20:34:38.292581] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:34:38.300616] [DEBUG] [LOCAL ] PGZ: Loaded 5586 existing records from primary storage. [2025-10-21T20:34:38.300838] [INFO ] [MAIN ] PGZ: Loaded 5586 existing records. [2025-10-21T20:34:38.476522] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:34:38.476702] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-10-21T20:34:38.476759] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-10-21T20:34:38.476923] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-10-21T20:34:38.476980] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-10-21T20:34:38.556588] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-10-21T20:34:38.848828] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:34:39.264719] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T20:34:39.350993] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-10-21T20:34:40.151074] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-10-21T20:34:40.930792] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T20:34:40.950981] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-10-21T20:34:41.150331] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-21T20:34:41.264587] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T20:34:41.751020] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-10-21T20:34:42.544108] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T20:34:42.550969] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-10-21T20:34:42.735106] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T20:34:43.299269] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T20:34:43.351042] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-10-21T20:34:44.151061] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-10-21T20:34:44.927517] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T20:34:44.950980] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-10-21T20:34:45.718296] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T20:34:45.751000] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-10-21T20:34:45.894814] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-21T20:34:46.551071] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-10-21T20:34:47.295956] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T20:34:47.350987] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-10-21T20:34:48.151082] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-10-21T20:34:48.750801] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-21T20:34:48.835168] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T20:34:48.951008] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-10-21T20:34:49.088452] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T20:34:49.751029] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-10-21T20:34:50.551191] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-10. [2025-10-21T20:34:50.882269] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T20:34:51.351080] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-10-21T20:34:51.630697] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T20:34:52.103188] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T20:34:52.151091] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-10-21T20:34:52.755787] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-21T20:34:52.764221] [INFO ] [REMOTE ] PG: Full fetch complete (77928 records). [2025-10-21T20:34:52.764381] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-10-21T20:34:52.971984] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-10-21T20:34:53.032379] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T20:34:53.199813] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-10-21T20:34:53.199904] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-10-21T20:34:53.201044] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-10-21T20:34:53.201126] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-10-21T20:34:53.202471] [DEBUG] [LOCAL ] PG: Trimmed 77928 records to 53753 (keeping 200 days of data) [2025-10-21T20:34:53.529966] [DEBUG] [LOCAL ] PG: Primary data saved (53753 records). [2025-10-21T20:34:53.530092] [INFO ] [MAIN ] PG: Full history saved. [2025-10-21T20:34:53.530163] [INFO ] [MAIN ] Update Progress: 1670/2366 symbols completed. PG took 42.9s. Estimated remaining: 1h 29m 32s. Rate: 7.8 symbols/min [2025-10-21T20:34:53.704101] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:34:53.704295] [DEBUG] [LOCAL ] PH: No existing data file found in primary storage. [2025-10-21T20:34:53.704352] [WARN ] [MAIN ] PH: No existing data found, performing full refresh instead. [2025-10-21T20:34:53.704489] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-10-21T20:34:53.704548] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-10-21T20:34:53.704636] [DEBUG] [LOCAL ] PH: No primary data file found to delete. [2025-10-21T20:34:53.704858] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-10-21T20:34:53.758431] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-10. [2025-10-21T20:34:54.064021] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:34:54.551046] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-10-21T20:34:54.850897] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T20:34:55.351116] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-10-21T20:34:55.876191] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-21T20:34:55.885679] [INFO ] [REMOTE ] PGR: Full fetch complete (76766 records). [2025-10-21T20:34:55.885857] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-10-21T20:34:56.152281] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-10-21T20:34:56.363856] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-10-21T20:34:56.364022] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-10-21T20:34:56.365533] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-10-21T20:34:56.365628] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-10-21T20:34:56.367498] [DEBUG] [LOCAL ] PGR: Trimmed 76766 records to 52868 (keeping 200 days of data) [2025-10-21T20:34:56.540855] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T20:34:56.889588] [DEBUG] [LOCAL ] PGR: Primary data saved (52868 records). [2025-10-21T20:34:56.889776] [INFO ] [MAIN ] PGR: Full history saved. [2025-10-21T20:34:56.889882] [INFO ] [MAIN ] Update Progress: 1671/2366 symbols completed. PGR took 44.3s. Estimated remaining: 1h 29m 22s. Rate: 7.8 symbols/min [2025-10-21T20:34:56.956392] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-10-21T20:34:57.073846] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:34:57.117079] [DEBUG] [LOCAL ] PHG: Loaded 45631 existing records from primary storage. [2025-10-21T20:34:57.117485] [INFO ] [MAIN ] PHG: Loaded 45631 existing records. [2025-10-21T20:34:57.290191] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T20:34:57.325964] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:34:57.327230] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-10-21T20:34:57.343142] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-10-21T20:34:57.356544] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-10-21T20:34:57.357062] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-10-21T20:34:57.363531] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-21T20:34:57.721592] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:34:57.750990] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-10-21T20:34:58.551101] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-10-21T20:34:58.845148] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-21T20:34:59.038596] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T20:34:59.351026] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-10. [2025-10-21T20:34:59.477910] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T20:35:00.139494] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T20:35:00.140879] [INFO ] [REMOTE ] PGZ: Full fetch complete (8193 records). [2025-10-21T20:35:00.140949] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-10-21T20:35:00.156249] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-10-21T20:35:00.503573] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-10-21T20:35:00.503677] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-10-21T20:35:00.503885] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-10-21T20:35:00.503925] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-10-21T20:35:00.504340] [DEBUG] [LOCAL ] PGZ: Trimmed 8193 records to 5560 (keeping 200 days of data) [2025-10-21T20:35:00.536492] [DEBUG] [LOCAL ] PGZ: Primary data saved (5560 records). [2025-10-21T20:35:00.536577] [INFO ] [MAIN ] PGZ: Full history saved. [2025-10-21T20:35:00.536666] [INFO ] [MAIN ] Update Progress: 1672/2366 symbols completed. PGZ took 22.4s. Estimated remaining: 1h 29m 13s. Rate: 7.8 symbols/min [2025-10-21T20:35:00.729382] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:35:00.746073] [DEBUG] [LOCAL ] PHI: Loaded 15165 existing records from primary storage. [2025-10-21T20:35:00.746368] [INFO ] [MAIN ] PHI: Loaded 15165 existing records. [2025-10-21T20:35:00.942319] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:35:00.942566] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-10-21T20:35:00.942618] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-10-21T20:35:00.942847] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-10-21T20:35:00.942905] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-10-21T20:35:00.956319] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-10. [2025-10-21T20:35:01.326270] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:35:01.751086] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-10-21T20:35:02.551063] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-10-21T20:35:02.754168] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-10-21T20:35:02.771185] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T20:35:02.921404] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-21T20:35:02.928506] [INFO ] [REMOTE ] PGRE: Full fetch complete (64461 records). [2025-10-21T20:35:02.928694] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-10-21T20:35:03.336114] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-10-21T20:35:03.336205] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-10-21T20:35:03.337284] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-10-21T20:35:03.337373] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-10-21T20:35:03.338857] [DEBUG] [LOCAL ] PGRE: Trimmed 64461 records to 46973 (keeping 200 days of data) [2025-10-21T20:35:03.381822] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-10-21T20:35:03.605921] [DEBUG] [LOCAL ] PGRE: Primary data saved (46973 records). [2025-10-21T20:35:03.606056] [INFO ] [MAIN ] PGRE: Full history saved. [2025-10-21T20:35:03.606131] [INFO ] [MAIN ] Update Progress: 1673/2366 symbols completed. PGRE took 31.1s. Estimated remaining: 1h 29m 3s. Rate: 7.8 symbols/min [2025-10-21T20:35:03.784431] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:35:03.784628] [DEBUG] [LOCAL ] PHIN: No existing data file found in primary storage. [2025-10-21T20:35:03.784707] [WARN ] [MAIN ] PHIN: No existing data found, performing full refresh instead. [2025-10-21T20:35:03.784789] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-10-21T20:35:03.784828] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-10-21T20:35:03.784869] [DEBUG] [LOCAL ] PHIN: No primary data file found to delete. [2025-10-21T20:35:03.784901] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-10-21T20:35:04.156843] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-10-21T20:35:04.162730] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:35:04.339129] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T20:35:04.951015] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-10-21T20:35:05.004340] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T20:35:05.182630] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T20:35:05.751028] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-10-21T20:35:06.551018] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-10-21T20:35:07.081349] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-21T20:35:07.351068] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-10-21T20:35:07.673497] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T20:35:08.151022] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-10-21T20:35:08.269765] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T20:35:08.951006] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-10-21T20:35:09.083246] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T20:35:09.751059] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-10-21T20:35:10.060896] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T20:35:10.419088] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T20:35:10.551016] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-10-21T20:35:11.350996] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-10-21T20:35:11.442902] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T20:35:12.151012] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-10-21T20:35:12.273172] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T20:35:12.951029] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-10-21T20:35:13.176550] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T20:35:13.234257] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T20:35:13.751025] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-10-21T20:35:14.332590] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T20:35:14.551076] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-10-21T20:35:15.001748] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T20:35:15.351032] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-10-21T20:35:16.151012] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-10-21T20:35:16.287264] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:35:16.950989] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-10-21T20:35:17.363562] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T20:35:17.750990] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-10-21T20:35:17.888134] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T20:35:18.140702] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T20:35:18.484463] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T20:35:18.551011] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-10-21T20:35:19.263133] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T20:35:19.351009] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-10-21T20:35:20.150991] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-10. [2025-10-21T20:35:20.338816] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T20:35:20.951035] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-10-21T20:35:21.745273] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T20:35:21.750283] [INFO ] [REMOTE ] PH: Full fetch complete (55885 records). [2025-10-21T20:35:21.750380] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-10-21T20:35:21.761961] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-10-21T20:35:22.153042] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-10-21T20:35:22.153118] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-10-21T20:35:22.154083] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-10-21T20:35:22.154145] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-10-21T20:35:22.155198] [DEBUG] [LOCAL ] PH: Trimmed 55885 records to 36700 (keeping 200 days of data) [2025-10-21T20:35:22.386877] [DEBUG] [LOCAL ] PH: Primary data saved (36700 records). [2025-10-21T20:35:22.387052] [INFO ] [MAIN ] PH: Full history saved. [2025-10-21T20:35:22.387137] [INFO ] [MAIN ] Update Progress: 1674/2366 symbols completed. PH took 28.9s. Estimated remaining: 1h 29m 0s. Rate: 7.8 symbols/min [2025-10-21T20:35:22.563027] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-10-21T20:35:22.566331] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:35:22.594265] [DEBUG] [LOCAL ] PHK: Loaded 26939 existing records from primary storage. [2025-10-21T20:35:22.594547] [INFO ] [MAIN ] PHK: Loaded 26939 existing records. [2025-10-21T20:35:22.784685] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:35:22.785029] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-10-21T20:35:22.785104] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-10-21T20:35:22.785322] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-10-21T20:35:22.785460] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-10-21T20:35:22.922274] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T20:35:23.119510] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T20:35:23.225538] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:35:23.350993] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-10-21T20:35:24.027137] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T20:35:24.151006] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-10-21T20:35:24.951106] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-10-21T20:35:25.336697] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T20:35:25.511506] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T20:35:25.751043] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-10-21T20:35:26.200557] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-21T20:35:26.551045] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-10-21T20:35:27.351009] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-10-21T20:35:27.429208] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T20:35:28.007632] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T20:35:28.151001] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-10-21T20:35:28.950989] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-10-21T20:35:29.049175] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T20:35:29.756613] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-10. [2025-10-21T20:35:29.765285] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T20:35:30.336257] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T20:35:30.551053] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-10-21T20:35:31.351005] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-10-21T20:35:31.543053] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T20:35:31.549377] [INFO ] [REMOTE ] PHG: Full fetch complete (65718 records). [2025-10-21T20:35:31.549482] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-10-21T20:35:31.938954] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-10-21T20:35:31.939052] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-10-21T20:35:31.940097] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-10-21T20:35:31.940247] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-10-21T20:35:31.941673] [DEBUG] [LOCAL ] PHG: Trimmed 65718 records to 45554 (keeping 200 days of data) [2025-10-21T20:35:32.068137] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T20:35:32.176027] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-10-21T20:35:32.241975] [DEBUG] [LOCAL ] PHG: Primary data saved (45554 records). [2025-10-21T20:35:32.242097] [INFO ] [MAIN ] PHG: Full history saved. [2025-10-21T20:35:32.242886] [INFO ] [MAIN ] Update Progress: 1675/2366 symbols completed. PHG took 35.4s. Estimated remaining: 1h 28m 53s. Rate: 7.8 symbols/min [2025-10-21T20:35:32.411967] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:35:32.412135] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-10-21T20:35:32.412172] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-10-21T20:35:32.412276] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-10-21T20:35:32.412315] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-10-21T20:35:32.412354] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-10-21T20:35:32.412431] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-10-21T20:35:32.764461] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:35:32.858294] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-21T20:35:32.951009] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-10. [2025-10-21T20:35:33.280478] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T20:35:33.750988] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-10. [2025-10-21T20:35:34.285115] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T20:35:34.289903] [INFO ] [REMOTE ] PHIN: Full fetch complete (47438 records). [2025-10-21T20:35:34.289996] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-10-21T20:35:34.556217] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-10-21T20:35:34.663257] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-10-21T20:35:34.663330] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-10-21T20:35:34.664220] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-10-21T20:35:34.664280] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-10-21T20:35:34.665249] [DEBUG] [LOCAL ] PHIN: Trimmed 47438 records to 31536 (keeping 200 days of data) [2025-10-21T20:35:34.854634] [DEBUG] [LOCAL ] PHIN: Primary data saved (31536 records). [2025-10-21T20:35:34.854783] [INFO ] [MAIN ] PHIN: Full history saved. [2025-10-21T20:35:34.854853] [INFO ] [MAIN ] Update Progress: 1676/2366 symbols completed. PHIN took 31.2s. Estimated remaining: 1h 28m 44s. Rate: 7.8 symbols/min [2025-10-21T20:35:35.017295] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T20:35:35.034720] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:35:35.038116] [INFO ] [REMOTE ] PHI: Full fetch complete (21302 records). [2025-10-21T20:35:35.038191] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-10-21T20:35:35.351522] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-10-21T20:35:35.351442] [DEBUG] [LOCAL ] PHR: Loaded 37955 existing records from primary storage. [2025-10-21T20:35:35.368911] [INFO ] [MAIN ] PHR: Loaded 37955 existing records. [2025-10-21T20:35:35.494901] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-10-21T20:35:35.512918] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-10-21T20:35:35.531384] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-10-21T20:35:35.553728] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-10-21T20:35:35.579089] [DEBUG] [LOCAL ] PHI: Trimmed 21302 records to 15197 (keeping 200 days of data) [2025-10-21T20:35:35.686485] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:35:35.686919] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-10-21T20:35:35.694502] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-10-21T20:35:35.715748] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-10-21T20:35:35.719834] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-10-21T20:35:35.812848] [DEBUG] [LOCAL ] PHI: Primary data saved (15197 records). [2025-10-21T20:35:35.845407] [INFO ] [MAIN ] PHI: Full history saved. [2025-10-21T20:35:35.850802] [INFO ] [MAIN ] Update Progress: 1677/2366 symbols completed. PHI took 35.3s. Estimated remaining: 1h 28m 33s. Rate: 7.8 symbols/min [2025-10-21T20:35:35.905565] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T20:35:36.151397] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-10-21T20:35:36.172059] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:35:36.951049] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-10-21T20:35:37.487482] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T20:35:37.529096] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-21T20:35:37.751068] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-10-21T20:35:38.551267] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-10-21T20:35:38.638507] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T20:35:39.351014] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-10-21T20:35:39.656299] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T20:35:39.709600] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T20:35:40.151014] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-10-21T20:35:40.722816] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T20:35:40.951025] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-10-21T20:35:41.599820] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T20:35:41.750996] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-10. [2025-10-21T20:35:42.484733] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T20:35:42.550986] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-10-21T20:35:43.206139] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T20:35:43.211211] [INFO ] [REMOTE ] PHK: Full fetch complete (39462 records). [2025-10-21T20:35:43.211386] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-10-21T20:35:43.358217] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-10-21T20:35:43.585190] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-10-21T20:35:43.585266] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-10-21T20:35:43.586032] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-10-21T20:35:43.586092] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-10-21T20:35:43.586954] [DEBUG] [LOCAL ] PHK: Trimmed 39462 records to 26917 (keeping 200 days of data) [2025-10-21T20:35:43.739807] [DEBUG] [LOCAL ] PHK: Primary data saved (26917 records). [2025-10-21T20:35:43.739937] [INFO ] [MAIN ] PHK: Full history saved. [2025-10-21T20:35:43.740025] [INFO ] [MAIN ] Update Progress: 1678/2366 symbols completed. PHK took 21.4s. Estimated remaining: 1h 28m 25s. Rate: 7.8 symbols/min [2025-10-21T20:35:44.138700] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T20:35:44.150978] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-10-21T20:35:45.458354] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-21T20:35:45.468868] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-10-21T20:35:45.702414] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T20:35:45.750978] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-10-21T20:35:47.257573] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T20:35:47.265220] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-10-21T20:35:47.686535] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T20:35:47.697488] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-10-21T20:35:48.752929] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T20:35:48.760809] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-10-21T20:35:49.643748] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T20:35:49.656599] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-10-21T20:35:50.086458] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T20:35:50.095797] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-10-21T20:35:51.646728] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-21T20:35:51.660302] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-10-21T20:35:51.736962] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T20:35:51.746779] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-10. [2025-10-21T20:35:53.413531] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T20:35:53.420044] [INFO ] [REMOTE ] PHR: Full fetch complete (53423 records). [2025-10-21T20:35:53.420161] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-10-21T20:35:53.841635] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-10-21T20:35:53.841817] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-10-21T20:35:53.842801] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-10-21T20:35:53.842863] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-10-21T20:35:53.855338] [DEBUG] [LOCAL ] PHR: Trimmed 53423 records to 37942 (keeping 200 days of data) [2025-10-21T20:35:53.878319] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-21T20:35:53.978075] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-10-21T20:35:54.113732] [DEBUG] [LOCAL ] PHR: Primary data saved (37942 records). [2025-10-21T20:35:54.113875] [INFO ] [MAIN ] PHR: Full history saved. [2025-10-21T20:35:54.113956] [INFO ] [MAIN ] Update Progress: 1679/2366 symbols completed. PHR took 19.3s. Estimated remaining: 1h 28m 19s. Rate: 7.8 symbols/min [2025-10-21T20:35:55.942529] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T20:35:55.953461] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-10-21T20:35:57.872078] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T20:35:57.883205] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-10. [2025-10-21T20:35:59.917505] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T20:35:59.925687] [INFO ] [REMOTE ] PHM: Full fetch complete (75224 records). [2025-10-21T20:35:59.925827] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-10-21T20:36:00.338133] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-10-21T20:36:00.338277] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-10-21T20:36:00.339398] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-10-21T20:36:00.339459] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-10-21T20:36:00.340807] [DEBUG] [LOCAL ] PHM: Trimmed 75224 records to 51692 (keeping 200 days of data) [2025-10-21T20:36:00.652896] [DEBUG] [LOCAL ] PHM: Primary data saved (51692 records). [2025-10-21T20:36:00.653017] [INFO ] [MAIN ] PHM: Full history saved. [2025-10-21T20:36:00.653084] [INFO ] [MAIN ] Update Progress: 1680/2366 symbols completed. PHM took 28.4s. Estimated remaining: 1h 28m 11s. Rate: 7.8 symbols/min [2025-10-21T20:36:01.299801] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:01.281938] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:01.336172] [DEBUG] [LOCAL ] PINS: No existing data file found in primary storage. [2025-10-21T20:36:01.328772] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:01.341662] [WARN ] [MAIN ] PINS: No existing data found, performing full refresh instead. [2025-10-21T20:36:01.359690] [DEBUG] [LOCAL ] PII: No existing data file found in primary storage. [2025-10-21T20:36:01.359960] [WARN ] [MAIN ] PII: No existing data found, performing full refresh instead. [2025-10-21T20:36:01.359576] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:01.360206] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-10-21T20:36:01.360375] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-10-21T20:36:01.360486] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-10-21T20:36:01.360863] [DEBUG] [LOCAL ] PII: No primary data file found to delete. [2025-10-21T20:36:01.360967] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-10-21T20:36:01.362198] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-10-21T20:36:01.362332] [DEBUG] [LOCAL ] PINS: No primary data file found to delete. [2025-10-21T20:36:01.367622] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-10-21T20:36:01.424260] [DEBUG] [LOCAL ] PIM: Loaded 4832 existing records from primary storage. [2025-10-21T20:36:01.466864] [INFO ] [MAIN ] PIM: Loaded 4832 existing records. [2025-10-21T20:36:01.551607] [DEBUG] [LOCAL ] PINE: Loaded 14337 existing records from primary storage. [2025-10-21T20:36:01.628232] [INFO ] [MAIN ] PINE: Loaded 14337 existing records. [2025-10-21T20:36:02.247126] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:36:02.314791] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-10-21T20:36:02.365036] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-10-21T20:36:02.374046] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:36:02.430939] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-10-21T20:36:02.431179] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-10-21T20:36:02.431076] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-10-21T20:36:02.447704] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-10-21T20:36:02.506815] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:02.530304] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-10-21T20:36:02.549181] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-10-21T20:36:02.581393] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:02.615553] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-10-21T20:36:02.591723] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-10-21T20:36:03.238170] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:03.270596] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-10-21T20:36:03.290660] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:03.291881] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-10-21T20:36:04.325027] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T20:36:04.326333] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-10-21T20:36:04.578858] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T20:36:04.577731] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T20:36:04.583168] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-10-21T20:36:04.594812] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-10-21T20:36:04.771334] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-21T20:36:04.784573] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-10-21T20:36:04.787728] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-21T20:36:04.789122] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-10-21T20:36:05.648581] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T20:36:05.656706] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T20:36:05.656960] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-10-21T20:36:05.659766] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-10-21T20:36:06.409986] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T20:36:06.411532] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-10-21T20:36:06.442632] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T20:36:06.453711] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-10-21T20:36:06.738288] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T20:36:06.741682] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-10-21T20:36:06.833548] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T20:36:06.843537] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-10-21T20:36:07.001759] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T20:36:07.004414] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-10-21T20:36:07.822923] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T20:36:07.824459] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-10-21T20:36:07.916805] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T20:36:08.151062] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-10-21T20:36:08.274298] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T20:36:08.381404] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T20:36:08.798279] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T20:36:08.950988] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-10-21T20:36:09.184951] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T20:36:09.751070] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-10-21T20:36:10.550996] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-10-21T20:36:10.670197] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T20:36:10.913871] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T20:36:11.351027] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-10-21T20:36:12.151039] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-10-21T20:36:12.173090] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T20:36:12.787309] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-21T20:36:12.898264] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T20:36:12.951049] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-10-21T20:36:13.751007] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-10-21T20:36:13.940174] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T20:36:14.551041] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-10-21T20:36:15.355245] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-10-21T20:36:15.356119] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T20:36:15.775240] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T20:36:16.151029] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-10-21T20:36:16.305314] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T20:36:16.951094] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-10. [2025-10-21T20:36:17.691774] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T20:36:17.693112] [INFO ] [REMOTE ] PIM: Full fetch complete (6445 records). [2025-10-21T20:36:17.693202] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-10-21T20:36:17.758662] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-10-21T20:36:18.061052] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-10-21T20:36:18.061156] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-10-21T20:36:18.061442] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-10-21T20:36:18.061572] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-10-21T20:36:18.062197] [DEBUG] [LOCAL ] PIM: Trimmed 6445 records to 4874 (keeping 200 days of data) [2025-10-21T20:36:18.090628] [DEBUG] [LOCAL ] PIM: Primary data saved (4874 records). [2025-10-21T20:36:18.090746] [INFO ] [MAIN ] PIM: Full history saved. [2025-10-21T20:36:18.090854] [INFO ] [MAIN ] Update Progress: 1681/2366 symbols completed. PIM took 17.4s. Estimated remaining: 1h 28m 7s. Rate: 7.8 symbols/min [2025-10-21T20:36:18.237250] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-21T20:36:18.322322] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:18.322509] [DEBUG] [LOCAL ] PIPR: No existing data file found in primary storage. [2025-10-21T20:36:18.322551] [WARN ] [MAIN ] PIPR: No existing data found, performing full refresh instead. [2025-10-21T20:36:18.322695] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-10-21T20:36:18.322752] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-10-21T20:36:18.322798] [DEBUG] [LOCAL ] PIPR: No primary data file found to delete. [2025-10-21T20:36:18.322833] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-10-21T20:36:18.563393] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-10-21T20:36:18.681939] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:19.351032] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-10. [2025-10-21T20:36:20.151079] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-10-21T20:36:20.191148] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-21T20:36:20.210275] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T20:36:20.213383] [INFO ] [REMOTE ] PINE: Full fetch complete (20992 records). [2025-10-21T20:36:20.213455] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-10-21T20:36:20.593382] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-10-21T20:36:20.593508] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-10-21T20:36:20.594131] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-10-21T20:36:20.594246] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-10-21T20:36:20.595364] [DEBUG] [LOCAL ] PINE: Trimmed 20992 records to 14364 (keeping 200 days of data) [2025-10-21T20:36:20.688207] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T20:36:20.724510] [DEBUG] [LOCAL ] PINE: Primary data saved (14364 records). [2025-10-21T20:36:20.724691] [INFO ] [MAIN ] PINE: Full history saved. [2025-10-21T20:36:20.724809] [INFO ] [MAIN ] Update Progress: 1682/2366 symbols completed. PINE took 20.1s. Estimated remaining: 1h 27m 57s. Rate: 7.8 symbols/min [2025-10-21T20:36:20.900662] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:20.900832] [DEBUG] [LOCAL ] PJT: No existing data file found in primary storage. [2025-10-21T20:36:20.900868] [WARN ] [MAIN ] PJT: No existing data found, performing full refresh instead. [2025-10-21T20:36:20.900974] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-10-21T20:36:20.901014] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-10-21T20:36:20.901052] [DEBUG] [LOCAL ] PJT: No primary data file found to delete. [2025-10-21T20:36:20.901082] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-10-21T20:36:20.963291] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-10-21T20:36:21.215151] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T20:36:21.268466] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:21.751087] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-10-21T20:36:22.551068] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-10-21T20:36:22.788826] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T20:36:22.825082] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T20:36:23.351030] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-10-21T20:36:24.151002] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-10-21T20:36:24.482046] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T20:36:24.752255] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-21T20:36:24.951023] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-10-21T20:36:25.614495] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T20:36:25.751014] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-10-21T20:36:26.551019] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-10-21T20:36:26.876984] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T20:36:27.020304] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T20:36:27.351004] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-10-21T20:36:27.461612] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T20:36:28.151048] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-10. [2025-10-21T20:36:28.951035] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-10-21T20:36:29.742760] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T20:36:29.753767] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-10-21T20:36:30.023141] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T20:36:30.030416] [INFO ] [REMOTE ] PII: Full fetch complete (71260 records). [2025-10-21T20:36:30.030548] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-10-21T20:36:30.424549] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T20:36:30.452841] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-10-21T20:36:30.452942] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-10-21T20:36:30.454323] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-10-21T20:36:30.454403] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-10-21T20:36:30.455986] [DEBUG] [LOCAL ] PII: Trimmed 71260 records to 48742 (keeping 200 days of data) [2025-10-21T20:36:30.555423] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-10-21T20:36:30.696792] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T20:36:30.773124] [DEBUG] [LOCAL ] PII: Primary data saved (48742 records). [2025-10-21T20:36:30.773253] [INFO ] [MAIN ] PII: Full history saved. [2025-10-21T20:36:30.773322] [INFO ] [MAIN ] Update Progress: 1683/2366 symbols completed. PII took 30.1s. Estimated remaining: 1h 27m 50s. Rate: 7.8 symbols/min [2025-10-21T20:36:30.939109] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:30.939279] [DEBUG] [LOCAL ] PK: No existing data file found in primary storage. [2025-10-21T20:36:30.939315] [WARN ] [MAIN ] PK: No existing data found, performing full refresh instead. [2025-10-21T20:36:30.939425] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-10-21T20:36:30.939466] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-10-21T20:36:30.939505] [DEBUG] [LOCAL ] PK: No primary data file found to delete. [2025-10-21T20:36:30.939535] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-10-21T20:36:31.292561] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:31.351014] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-10-21T20:36:32.044757] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T20:36:32.151014] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-10-21T20:36:32.951053] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-10-21T20:36:33.352455] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T20:36:33.651490] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T20:36:33.751033] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-10-21T20:36:34.551036] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-10-21T20:36:35.115924] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-21T20:36:35.142288] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T20:36:35.351136] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-10. [2025-10-21T20:36:35.677072] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T20:36:36.151053] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-10-21T20:36:36.951081] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-10-21T20:36:37.714608] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-21T20:36:37.722917] [INFO ] [REMOTE ] PINS: Full fetch complete (77871 records). [2025-10-21T20:36:37.723039] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-10-21T20:36:37.760602] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-10-21T20:36:38.124383] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-10-21T20:36:38.124492] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-10-21T20:36:38.140474] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-10-21T20:36:38.147900] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-10-21T20:36:38.153114] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-21T20:36:38.163845] [DEBUG] [LOCAL ] PINS: Trimmed 77871 records to 53693 (keeping 200 days of data) [2025-10-21T20:36:38.273781] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T20:36:38.493738] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-10-21T20:36:38.493868] [INFO ] [MAIN ] PINS: Full history saved. [2025-10-21T20:36:38.493946] [INFO ] [MAIN ] Update Progress: 1684/2366 symbols completed. PINS took 37.8s. Estimated remaining: 1h 27m 43s. Rate: 7.8 symbols/min [2025-10-21T20:36:38.558333] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-10-21T20:36:38.670157] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:38.684795] [DEBUG] [LOCAL ] PKE: Loaded 14258 existing records from primary storage. [2025-10-21T20:36:38.685004] [INFO ] [MAIN ] PKE: Loaded 14258 existing records. [2025-10-21T20:36:38.864778] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:36:38.864999] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-10-21T20:36:38.865168] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-10-21T20:36:38.865436] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-10-21T20:36:38.865547] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-10-21T20:36:39.019817] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T20:36:39.256605] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:39.351004] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-10-21T20:36:40.150993] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-10-21T20:36:40.506002] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T20:36:40.579995] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T20:36:40.951031] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-10-21T20:36:41.294034] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T20:36:41.751046] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-10-21T20:36:42.550997] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-10-21T20:36:42.924105] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T20:36:42.948180] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-21T20:36:43.350995] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-10-21T20:36:43.635515] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T20:36:44.151122] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-10-21T20:36:44.951068] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-10-21T20:36:45.202183] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T20:36:45.322660] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T20:36:45.751023] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-10. [2025-10-21T20:36:45.870080] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T20:36:46.551036] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-10-21T20:36:46.896995] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T20:36:46.900464] [INFO ] [REMOTE ] PJT: Full fetch complete (32150 records). [2025-10-21T20:36:46.900545] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-10-21T20:36:47.261905] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-10-21T20:36:47.261980] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-10-21T20:36:47.262529] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-10-21T20:36:47.262567] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-10-21T20:36:47.263271] [DEBUG] [LOCAL ] PJT: Trimmed 32150 records to 21350 (keeping 200 days of data) [2025-10-21T20:36:47.351251] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-10-21T20:36:47.395486] [DEBUG] [LOCAL ] PJT: Primary data saved (21350 records). [2025-10-21T20:36:47.395593] [INFO ] [MAIN ] PJT: Full history saved. [2025-10-21T20:36:47.395679] [INFO ] [MAIN ] Update Progress: 1685/2366 symbols completed. PJT took 26.7s. Estimated remaining: 1h 27m 35s. Rate: 7.8 symbols/min [2025-10-21T20:36:47.560472] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:47.560622] [DEBUG] [LOCAL ] PKG: No existing data file found in primary storage. [2025-10-21T20:36:47.560688] [WARN ] [MAIN ] PKG: No existing data found, performing full refresh instead. [2025-10-21T20:36:47.560795] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-10-21T20:36:47.560856] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-10-21T20:36:47.560923] [DEBUG] [LOCAL ] PKG: No primary data file found to delete. [2025-10-21T20:36:47.560957] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-10-21T20:36:47.906441] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:48.150989] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-10-21T20:36:48.465860] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T20:36:48.466277] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T20:36:48.951023] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-10. [2025-10-21T20:36:49.750998] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-10-21T20:36:49.977069] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T20:36:49.980762] [INFO ] [REMOTE ] PIPR: Full fetch complete (21053 records). [2025-10-21T20:36:49.980971] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-10-21T20:36:50.354884] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-21T20:36:50.410363] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-10-21T20:36:50.410500] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-10-21T20:36:50.411146] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-10-21T20:36:50.411317] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-10-21T20:36:50.412135] [DEBUG] [LOCAL ] PIPR: Trimmed 21053 records to 15094 (keeping 200 days of data) [2025-10-21T20:36:50.484934] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-21T20:36:50.515632] [DEBUG] [LOCAL ] PIPR: Primary data saved (15094 records). [2025-10-21T20:36:50.515802] [INFO ] [MAIN ] PIPR: Full history saved. [2025-10-21T20:36:50.515878] [INFO ] [MAIN ] Update Progress: 1686/2366 symbols completed. PIPR took 32.4s. Estimated remaining: 1h 27m 26s. Rate: 7.8 symbols/min [2025-10-21T20:36:50.556123] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-10-21T20:36:50.694375] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:36:50.714466] [DEBUG] [LOCAL ] PKST: Loaded 18304 existing records from primary storage. [2025-10-21T20:36:50.714761] [INFO ] [MAIN ] PKST: Loaded 18304 existing records. [2025-10-21T20:36:50.890816] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:36:50.891022] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-10-21T20:36:50.891071] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-10-21T20:36:50.891274] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-10-21T20:36:50.891330] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-10-21T20:36:51.257982] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:36:51.351019] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-10-21T20:36:51.612625] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T20:36:52.151067] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-10-21T20:36:52.951009] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-10-21T20:36:53.022376] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T20:36:53.378182] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T20:36:53.751028] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-10-21T20:36:54.550997] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-10-21T20:36:54.640499] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T20:36:54.864256] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T20:36:55.351020] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-10-21T20:36:56.029369] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T20:36:56.151019] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-10-21T20:36:56.561514] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-21T20:36:56.951043] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-10-21T20:36:57.407561] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T20:36:57.751073] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-10-21T20:36:58.076244] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T20:36:58.551117] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-10-21T20:36:59.351063] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-10-21T20:36:59.691920] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T20:36:59.851086] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T20:37:00.151032] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-10-21T20:37:00.558479] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T20:37:00.951041] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-10-21T20:37:01.751006] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-10-21T20:37:01.925538] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T20:37:02.055467] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T20:37:02.551042] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-10-21T20:37:02.701778] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T20:37:03.351041] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-10-21T20:37:04.150989] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-10. [2025-10-21T20:37:04.420000] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T20:37:04.520462] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T20:37:04.951086] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-10. [2025-10-21T20:37:05.750998] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-10-21T20:37:06.088519] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T20:37:06.097336] [INFO ] [REMOTE ] PK: Full fetch complete (76534 records). [2025-10-21T20:37:06.097562] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-10-21T20:37:06.233152] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T20:37:06.282702] [INFO ] [REMOTE ] PKE: Full fetch complete (18364 records). [2025-10-21T20:37:06.303912] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-10-21T20:37:06.552603] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-10-21T20:37:06.758134] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-10-21T20:37:06.789366] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-21T20:37:06.772817] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-10-21T20:37:06.801121] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-10-21T20:37:06.827495] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-10-21T20:37:06.892308] [DEBUG] [LOCAL ] PK: Trimmed 76534 records to 52756 (keeping 200 days of data) [2025-10-21T20:37:07.019932] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-10-21T20:37:07.028887] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-10-21T20:37:07.029426] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-10-21T20:37:07.029505] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-10-21T20:37:07.090638] [DEBUG] [LOCAL ] PKE: Trimmed 18364 records to 14243 (keeping 200 days of data) [2025-10-21T20:37:07.341369] [DEBUG] [LOCAL ] PKE: Primary data saved (14243 records). [2025-10-21T20:37:07.349876] [INFO ] [MAIN ] PKE: Full history saved. [2025-10-21T20:37:07.367785] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-10-21T20:37:07.367721] [INFO ] [MAIN ] Update Progress: 1687/2366 symbols completed. PKE took 28.9s. Estimated remaining: 1h 27m 22s. Rate: 7.8 symbols/min [2025-10-21T20:37:07.409083] [DEBUG] [LOCAL ] PK: Primary data saved (52756 records). [2025-10-21T20:37:07.409312] [INFO ] [MAIN ] PK: Full history saved. [2025-10-21T20:37:07.433724] [INFO ] [MAIN ] Update Progress: 1688/2366 symbols completed. PK took 36.7s. Estimated remaining: 1h 27m 11s. Rate: 7.8 symbols/min [2025-10-21T20:37:07.741227] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:07.776562] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:07.776880] [DEBUG] [LOCAL ] PL: No existing data file found in primary storage. [2025-10-21T20:37:07.776929] [WARN ] [MAIN ] PL: No existing data found, performing full refresh instead. [2025-10-21T20:37:07.777175] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-10-21T20:37:07.777222] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-10-21T20:37:07.777266] [DEBUG] [LOCAL ] PL: No primary data file found to delete. [2025-10-21T20:37:07.777302] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-10-21T20:37:07.999254] [DEBUG] [LOCAL ] PKX: Loaded 22849 existing records from primary storage. [2025-10-21T20:37:08.062197] [INFO ] [MAIN ] PKX: Loaded 22849 existing records. [2025-10-21T20:37:08.289607] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:37:08.290256] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-10-21T20:37:08.373386] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:37:08.374165] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-10-21T20:37:08.374459] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-10-21T20:37:08.374967] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-10-21T20:37:08.375115] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-10-21T20:37:08.666535] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T20:37:08.680835] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-21T20:37:08.803855] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:37:08.951035] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-10-21T20:37:09.751051] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-10-21T20:37:10.466744] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-21T20:37:10.550989] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-10-21T20:37:10.583987] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T20:37:10.757060] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-21T20:37:11.351041] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-10-21T20:37:12.151037] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-10-21T20:37:12.814563] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-21T20:37:12.951058] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-10-21T20:37:13.133789] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T20:37:13.615439] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T20:37:13.751001] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-10-21T20:37:14.136256] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T20:37:14.551105] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-10-21T20:37:15.351007] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-10-21T20:37:15.428080] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T20:37:15.777235] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T20:37:16.151083] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-10-21T20:37:16.951124] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-10-21T20:37:17.574444] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T20:37:17.756160] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-10-21T20:37:17.767589] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T20:37:18.551004] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-10. [2025-10-21T20:37:18.615255] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T20:37:19.334525] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T20:37:19.337891] [INFO ] [REMOTE ] PKST: Full fetch complete (28920 records). [2025-10-21T20:37:19.337961] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-10-21T20:37:19.359299] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-10-21T20:37:19.723765] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-10-21T20:37:19.723863] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-10-21T20:37:19.724482] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-10-21T20:37:19.724522] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-10-21T20:37:19.725169] [DEBUG] [LOCAL ] PKST: Trimmed 28920 records to 18231 (keeping 200 days of data) [2025-10-21T20:37:19.833872] [DEBUG] [LOCAL ] PKST: Primary data saved (18231 records). [2025-10-21T20:37:19.834093] [INFO ] [MAIN ] PKST: Full history saved. [2025-10-21T20:37:19.834252] [INFO ] [MAIN ] Update Progress: 1689/2366 symbols completed. PKST took 29.3s. Estimated remaining: 1h 27m 5s. Rate: 7.8 symbols/min [2025-10-21T20:37:20.007484] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:20.007759] [DEBUG] [LOCAL ] PLD: No existing data file found in primary storage. [2025-10-21T20:37:20.007865] [WARN ] [MAIN ] PLD: No existing data found, performing full refresh instead. [2025-10-21T20:37:20.008050] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-10-21T20:37:20.008210] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-10-21T20:37:20.008331] [DEBUG] [LOCAL ] PLD: No primary data file found to delete. [2025-10-21T20:37:20.008397] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-10-21T20:37:20.150854] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-21T20:37:20.161205] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-10-21T20:37:20.407102] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:37:20.777438] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T20:37:20.951052] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-10-21T20:37:21.561438] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T20:37:21.751052] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-10-21T20:37:22.240767] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T20:37:22.551036] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-10-21T20:37:23.351043] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-10. [2025-10-21T20:37:23.856563] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-21T20:37:24.151038] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-10-21T20:37:24.609013] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T20:37:24.770528] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T20:37:24.776528] [INFO ] [REMOTE ] PKG: Full fetch complete (57595 records). [2025-10-21T20:37:24.776702] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-10-21T20:37:24.955232] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-10-21T20:37:25.160710] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-10-21T20:37:25.160793] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-10-21T20:37:25.161885] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-10-21T20:37:25.161947] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-10-21T20:37:25.163076] [DEBUG] [LOCAL ] PKG: Trimmed 57595 records to 38576 (keeping 200 days of data) [2025-10-21T20:37:25.398839] [DEBUG] [LOCAL ] PKG: Primary data saved (38576 records). [2025-10-21T20:37:25.398993] [INFO ] [MAIN ] PKG: Full history saved. [2025-10-21T20:37:25.399069] [INFO ] [MAIN ] Update Progress: 1690/2366 symbols completed. PKG took 38.0s. Estimated remaining: 1h 26m 57s. Rate: 7.8 symbols/min [2025-10-21T20:37:25.567078] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:25.567191] [DEBUG] [LOCAL ] PLNT: No existing data file found in primary storage. [2025-10-21T20:37:25.567228] [WARN ] [MAIN ] PLNT: No existing data found, performing full refresh instead. [2025-10-21T20:37:25.567365] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-10-21T20:37:25.567424] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-10-21T20:37:25.567469] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-10-21T20:37:25.567502] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-10-21T20:37:25.772347] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-10-21T20:37:25.925229] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:37:26.551049] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-10-21T20:37:26.592829] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-21T20:37:26.928433] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T20:37:27.249116] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T20:37:27.351039] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-10-21T20:37:28.151054] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-10-21T20:37:28.295012] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T20:37:28.566040] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-21T20:37:28.951061] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-10-21T20:37:29.751079] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-10-21T20:37:30.210000] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-21T20:37:30.551007] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-10-21T20:37:30.821081] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T20:37:30.953530] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T20:37:31.351045] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-10-21T20:37:32.151014] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-10. [2025-10-21T20:37:32.951012] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-10-21T20:37:33.093452] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T20:37:33.176027] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-21T20:37:33.442747] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T20:37:33.446217] [INFO ] [REMOTE ] PKX: Full fetch complete (36022 records). [2025-10-21T20:37:33.446299] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-10-21T20:37:33.756203] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-10-21T20:37:33.827684] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-10-21T20:37:33.827790] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-10-21T20:37:33.828541] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-10-21T20:37:33.828599] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-10-21T20:37:33.829390] [DEBUG] [LOCAL ] PKX: Trimmed 36022 records to 22782 (keeping 200 days of data) [2025-10-21T20:37:33.965389] [DEBUG] [LOCAL ] PKX: Primary data saved (22782 records). [2025-10-21T20:37:33.965521] [INFO ] [MAIN ] PKX: Full history saved. [2025-10-21T20:37:33.965601] [INFO ] [MAIN ] Update Progress: 1691/2366 symbols completed. PKX took 26.6s. Estimated remaining: 1h 26m 49s. Rate: 7.8 symbols/min [2025-10-21T20:37:34.136316] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:34.155519] [DEBUG] [LOCAL ] PLOW: Loaded 19918 existing records from primary storage. [2025-10-21T20:37:34.155767] [INFO ] [MAIN ] PLOW: Loaded 19918 existing records. [2025-10-21T20:37:34.332151] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:37:34.332371] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-10-21T20:37:34.332431] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-10-21T20:37:34.332608] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-10-21T20:37:34.332701] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-10-21T20:37:34.571332] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-10-21T20:37:34.690316] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:37:34.899184] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T20:37:35.351015] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-10-21T20:37:35.628206] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T20:37:36.151021] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-10-21T20:37:36.951054] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-10-21T20:37:37.030782] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-21T20:37:37.140902] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T20:37:37.751056] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-10-21T20:37:37.820477] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T20:37:38.030417] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T20:37:38.551048] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-10-21T20:37:39.351000] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-10-21T20:37:39.696347] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T20:37:39.742038] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T20:37:40.151026] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-10-21T20:37:40.951028] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-10-21T20:37:41.231040] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T20:37:41.751004] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-10-21T20:37:42.260499] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T20:37:42.283278] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T20:37:42.551021] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-10-21T20:37:43.351008] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-10-21T20:37:43.650877] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T20:37:44.150985] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-10-21T20:37:44.666346] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T20:37:44.702929] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-21T20:37:44.951032] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-10-21T20:37:45.751000] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-10-21T20:37:45.888049] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:37:46.550979] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-10-21T20:37:47.056810] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T20:37:47.104354] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T20:37:47.351073] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-10. [2025-10-21T20:37:48.156922] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-10-21T20:37:48.176494] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T20:37:48.951014] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-10. [2025-10-21T20:37:49.293272] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-21T20:37:49.301586] [INFO ] [REMOTE ] PLD: Full fetch complete (77512 records). [2025-10-21T20:37:49.301732] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-10-21T20:37:49.597443] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T20:37:49.743383] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-10-21T20:37:49.743563] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-10-21T20:37:49.745019] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-10-21T20:37:49.745103] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-10-21T20:37:49.752165] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-10-21T20:37:49.766576] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T20:37:49.774438] [DEBUG] [LOCAL ] PLD: Trimmed 77512 records to 53418 (keeping 200 days of data) [2025-10-21T20:37:49.775059] [INFO ] [REMOTE ] PLNT: Full fetch complete (70624 records). [2025-10-21T20:37:49.775349] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-10-21T20:37:50.471462] [DEBUG] [LOCAL ] PLD: Primary data saved (53418 records). [2025-10-21T20:37:50.490933] [INFO ] [MAIN ] PLD: Full history saved. [2025-10-21T20:37:50.495685] [INFO ] [MAIN ] Update Progress: 1692/2366 symbols completed. PLD took 30.7s. Estimated remaining: 1h 26m 45s. Rate: 7.8 symbols/min [2025-10-21T20:37:50.559797] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-10-21T20:37:50.612373] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-10-21T20:37:50.628059] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-10-21T20:37:50.630085] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-10-21T20:37:50.641550] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-10-21T20:37:50.692604] [DEBUG] [LOCAL ] PLNT: Trimmed 70624 records to 48051 (keeping 200 days of data) [2025-10-21T20:37:50.740513] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:50.991329] [DEBUG] [LOCAL ] PLYM: Loaded 34451 existing records from primary storage. [2025-10-21T20:37:50.996214] [INFO ] [MAIN ] PLYM: Loaded 34451 existing records. [2025-10-21T20:37:51.229612] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:37:51.235779] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-10-21T20:37:51.237441] [DEBUG] [LOCAL ] PLNT: Primary data saved (48051 records). [2025-10-21T20:37:51.237506] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-10-21T20:37:51.237704] [INFO ] [MAIN ] PLNT: Full history saved. [2025-10-21T20:37:51.237786] [INFO ] [MAIN ] Update Progress: 1693/2366 symbols completed. PLNT took 25.8s. Estimated remaining: 1h 26m 34s. Rate: 7.8 symbols/min [2025-10-21T20:37:51.237971] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-10-21T20:37:51.301855] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-10-21T20:37:51.572520] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:51.581026] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-10-21T20:37:51.581665] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-10-21T20:37:51.599076] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-10-21T20:37:51.624887] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-10-21T20:37:51.686877] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-10-21T20:37:51.717950] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-10-21T20:37:51.948895] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:37:51.966085] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-10-21T20:37:52.213917] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T20:37:52.257995] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-10-21T20:37:52.346240] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:37:52.432908] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-10-21T20:37:52.951087] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-10-21T20:37:53.582123] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T20:37:53.599765] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T20:37:53.751073] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-10-21T20:37:54.551020] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-10. [2025-10-21T20:37:54.787240] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T20:37:55.053906] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T20:37:55.351073] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-10-21T20:37:56.151034] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-10. [2025-10-21T20:37:56.759572] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T20:37:56.950997] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-10-21T20:37:57.084476] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-21T20:37:57.092960] [INFO ] [REMOTE ] PL: Full fetch complete (77120 records). [2025-10-21T20:37:57.093105] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-10-21T20:37:57.222338] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T20:37:57.264133] [INFO ] [REMOTE ] PLOW: Full fetch complete (28304 records). [2025-10-21T20:37:57.276689] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-10-21T20:37:57.754671] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-10-21T20:37:57.835772] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-10-21T20:37:57.836003] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-10-21T20:37:57.843188] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-10-21T20:37:57.853956] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-10-21T20:37:57.925615] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-10-21T20:37:57.925728] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-10-21T20:37:57.926004] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-10-21T20:37:57.926182] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-10-21T20:37:57.926136] [DEBUG] [LOCAL ] PL: Trimmed 77120 records to 53209 (keeping 200 days of data) [2025-10-21T20:37:57.927370] [DEBUG] [LOCAL ] PLOW: Trimmed 28304 records to 19800 (keeping 200 days of data) [2025-10-21T20:37:58.165982] [DEBUG] [LOCAL ] PLOW: Primary data saved (19800 records). [2025-10-21T20:37:58.166262] [INFO ] [MAIN ] PLOW: Full history saved. [2025-10-21T20:37:58.166353] [INFO ] [MAIN ] Update Progress: 1694/2366 symbols completed. PLOW took 24.2s. Estimated remaining: 1h 26m 26s. Rate: 7.8 symbols/min [2025-10-21T20:37:58.518163] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:58.543058] [DEBUG] [LOCAL ] PL: Primary data saved (53209 records). [2025-10-21T20:37:58.543170] [INFO ] [MAIN ] PL: Full history saved. [2025-10-21T20:37:58.543244] [INFO ] [MAIN ] Update Progress: 1695/2366 symbols completed. PL took 51.1s. Estimated remaining: 1h 26m 16s. Rate: 7.8 symbols/min [2025-10-21T20:37:58.724094] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:37:58.732242] [DEBUG] [LOCAL ] PML: Loaded 22073 existing records from primary storage. [2025-10-21T20:37:58.732494] [INFO ] [MAIN ] PML: Loaded 22073 existing records. [2025-10-21T20:37:58.892270] [DEBUG] [LOCAL ] PMM: Loaded 9961 existing records from primary storage. [2025-10-21T20:37:58.929072] [INFO ] [MAIN ] PMM: Loaded 9961 existing records. [2025-10-21T20:37:58.932291] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:37:58.977322] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-10-21T20:37:58.982552] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-10-21T20:37:58.999386] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-10-21T20:37:58.999471] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-10-21T20:37:59.302632] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:37:59.303050] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-10-21T20:37:59.303313] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-10-21T20:37:59.370804] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-10-21T20:37:59.381270] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-10-21T20:37:59.624627] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:37:59.625215] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-10-21T20:37:59.646764] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T20:37:59.642411] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-21T20:37:59.704473] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-10-21T20:37:59.924760] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:00.151057] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-10-21T20:38:00.951103] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-10-21T20:38:01.225464] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T20:38:01.337451] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T20:38:01.507367] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T20:38:01.751060] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-10-21T20:38:02.551038] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-10-21T20:38:02.830894] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T20:38:03.035795] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-21T20:38:03.351039] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-10-21T20:38:03.666955] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T20:38:04.151035] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-10-21T20:38:04.951041] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-10-21T20:38:05.202940] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T20:38:05.261718] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T20:38:05.751074] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-10-21T20:38:06.038154] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T20:38:06.551095] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-10-21T20:38:06.991341] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T20:38:07.351033] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-10-21T20:38:08.151079] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-10-21T20:38:08.795969] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T20:38:08.845164] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T20:38:08.951006] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-10-21T20:38:09.252878] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T20:38:09.751050] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-10-21T20:38:10.197073] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T20:38:10.551025] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-10-21T20:38:10.609568] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T20:38:11.351031] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-10-21T20:38:11.574094] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T20:38:12.151056] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-10-21T20:38:12.186811] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T20:38:12.951015] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-10-21T20:38:13.751008] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-10-21T20:38:13.799115] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T20:38:14.066068] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T20:38:14.551029] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-10-21T20:38:14.619254] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T20:38:15.351102] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-10-21T20:38:15.976894] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T20:38:16.151027] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-10-21T20:38:16.708142] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T20:38:16.951025] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-10-21T20:38:17.751134] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-10. [2025-10-21T20:38:17.889830] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T20:38:18.356059] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T20:38:18.551012] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-10-21T20:38:19.300234] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T20:38:19.306447] [INFO ] [REMOTE ] PLYM: Full fetch complete (47947 records). [2025-10-21T20:38:19.306562] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-10-21T20:38:19.361090] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-10-21T20:38:19.684143] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-10-21T20:38:19.684218] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-10-21T20:38:19.685099] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-10-21T20:38:19.685161] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-10-21T20:38:19.686131] [DEBUG] [LOCAL ] PLYM: Trimmed 47947 records to 34464 (keeping 200 days of data) [2025-10-21T20:38:19.897599] [DEBUG] [LOCAL ] PLYM: Primary data saved (34464 records). [2025-10-21T20:38:19.897788] [INFO ] [MAIN ] PLYM: Full history saved. [2025-10-21T20:38:19.897908] [INFO ] [MAIN ] Update Progress: 1696/2366 symbols completed. PLYM took 29.4s. Estimated remaining: 1h 26m 13s. Rate: 7.8 symbols/min [2025-10-21T20:38:20.075992] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:38:20.088003] [DEBUG] [LOCAL ] PMO: Loaded 9680 existing records from primary storage. [2025-10-21T20:38:20.088215] [INFO ] [MAIN ] PMO: Loaded 9680 existing records. [2025-10-21T20:38:20.159754] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-10-21T20:38:20.274154] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:38:20.274387] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-10-21T20:38:20.274441] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-10-21T20:38:20.274802] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-10-21T20:38:20.274859] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-10-21T20:38:20.393032] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T20:38:20.649722] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:20.677947] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-21T20:38:20.951021] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-10-21T20:38:21.383481] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T20:38:21.751144] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-10. [2025-10-21T20:38:22.407728] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T20:38:22.551015] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-10-21T20:38:22.671979] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T20:38:22.675991] [INFO ] [REMOTE ] PML: Full fetch complete (29838 records). [2025-10-21T20:38:22.676069] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-10-21T20:38:23.035222] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-10-21T20:38:23.035297] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-10-21T20:38:23.035907] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-10-21T20:38:23.035967] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-10-21T20:38:23.036603] [DEBUG] [LOCAL ] PML: Trimmed 29838 records to 21933 (keeping 200 days of data) [2025-10-21T20:38:23.162148] [DEBUG] [LOCAL ] PML: Primary data saved (21933 records). [2025-10-21T20:38:23.162354] [INFO ] [MAIN ] PML: Full history saved. [2025-10-21T20:38:23.162486] [INFO ] [MAIN ] Update Progress: 1697/2366 symbols completed. PML took 25.0s. Estimated remaining: 1h 26m 4s. Rate: 7.8 symbols/min [2025-10-21T20:38:23.260808] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T20:38:23.342471] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:38:23.342664] [DEBUG] [LOCAL ] PMT: No existing data file found in primary storage. [2025-10-21T20:38:23.342720] [WARN ] [MAIN ] PMT: No existing data found, performing full refresh instead. [2025-10-21T20:38:23.342839] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-10-21T20:38:23.342880] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-10-21T20:38:23.342919] [DEBUG] [LOCAL ] PMT: No primary data file found to delete. [2025-10-21T20:38:23.342950] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-10-21T20:38:23.356222] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-10-21T20:38:23.696954] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:24.151057] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-10-21T20:38:24.503439] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T20:38:24.950993] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-10-21T20:38:25.751110] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-10-21T20:38:26.193039] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T20:38:26.553263] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-10. [2025-10-21T20:38:26.559457] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-21T20:38:27.351098] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-10-21T20:38:27.544955] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T20:38:27.547234] [INFO ] [REMOTE ] PMM: Full fetch complete (17713 records). [2025-10-21T20:38:27.547317] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-10-21T20:38:27.670928] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T20:38:27.936821] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-10-21T20:38:27.936896] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-10-21T20:38:27.937258] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-10-21T20:38:27.937294] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-10-21T20:38:27.937829] [DEBUG] [LOCAL ] PMM: Trimmed 17713 records to 10018 (keeping 200 days of data) [2025-10-21T20:38:27.994228] [DEBUG] [LOCAL ] PMM: Primary data saved (10018 records). [2025-10-21T20:38:27.994333] [INFO ] [MAIN ] PMM: Full history saved. [2025-10-21T20:38:27.994410] [INFO ] [MAIN ] Update Progress: 1698/2366 symbols completed. PMM took 29.5s. Estimated remaining: 1h 25m 55s. Rate: 7.8 symbols/min [2025-10-21T20:38:28.160063] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-10-21T20:38:28.162598] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:38:28.163428] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-10-21T20:38:28.163471] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-10-21T20:38:28.163573] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-10-21T20:38:28.163613] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-21T20:38:28.163688] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-21T20:38:28.163738] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-10-21T20:38:28.527163] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:28.538169] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T20:38:28.951041] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-10-21T20:38:29.751152] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-10-21T20:38:29.871860] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T20:38:30.553670] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-10-21T20:38:30.560068] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-21T20:38:31.350987] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-10-21T20:38:31.441214] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T20:38:31.496816] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T20:38:31.921434] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-21T20:38:32.150994] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-10-21T20:38:32.950999] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-10-21T20:38:33.071715] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T20:38:33.468873] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T20:38:33.751029] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-10-21T20:38:34.214870] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-21T20:38:34.551066] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-10-21T20:38:35.351020] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-10-21T20:38:36.151004] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-10-21T20:38:36.209005] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T20:38:36.345998] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T20:38:36.673722] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-21T20:38:36.951027] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-10-21T20:38:37.751012] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-10-21T20:38:37.810600] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T20:38:38.134267] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T20:38:38.551078] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-10-21T20:38:39.039895] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T20:38:39.351014] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-10-21T20:38:39.890306] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T20:38:40.151050] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-10. [2025-10-21T20:38:40.951088] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-10-21T20:38:41.379128] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T20:38:41.750993] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-10-21T20:38:42.369935] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-21T20:38:42.378389] [INFO ] [REMOTE ] PM: Full fetch complete (77831 records). [2025-10-21T20:38:42.378519] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-10-21T20:38:42.564369] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-10-21T20:38:42.705605] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T20:38:42.805513] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-10-21T20:38:42.805594] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-10-21T20:38:42.806817] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-10-21T20:38:42.806881] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-10-21T20:38:42.808435] [DEBUG] [LOCAL ] PM: Trimmed 77831 records to 53674 (keeping 200 days of data) [2025-10-21T20:38:43.156130] [DEBUG] [LOCAL ] PM: Primary data saved (53674 records). [2025-10-21T20:38:43.156274] [INFO ] [MAIN ] PM: Full history saved. [2025-10-21T20:38:43.156348] [INFO ] [MAIN ] Update Progress: 1699/2366 symbols completed. PM took 51.9s. Estimated remaining: 1h 25m 50s. Rate: 7.8 symbols/min [2025-10-21T20:38:43.331417] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:38:43.331605] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-10-21T20:38:43.331670] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-10-21T20:38:43.331788] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-10-21T20:38:43.331832] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-21T20:38:43.331874] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-21T20:38:43.331908] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-10-21T20:38:43.357012] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-10. [2025-10-21T20:38:43.697351] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:44.151052] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-10-21T20:38:44.177128] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T20:38:44.178860] [INFO ] [REMOTE ] PMO: Full fetch complete (16161 records). [2025-10-21T20:38:44.178930] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-10-21T20:38:44.581333] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-10-21T20:38:44.581456] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-10-21T20:38:44.581861] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-10-21T20:38:44.582045] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-10-21T20:38:44.582890] [DEBUG] [LOCAL ] PMO: Trimmed 16161 records to 9593 (keeping 200 days of data) [2025-10-21T20:38:44.639940] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-21T20:38:44.654031] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T20:38:44.681682] [DEBUG] [LOCAL ] PMO: Primary data saved (9593 records). [2025-10-21T20:38:44.682135] [INFO ] [MAIN ] PMO: Full history saved. [2025-10-21T20:38:44.682229] [INFO ] [MAIN ] Update Progress: 1700/2366 symbols completed. PMO took 24.8s. Estimated remaining: 1h 25m 40s. Rate: 7.8 symbols/min [2025-10-21T20:38:44.847027] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:38:44.847186] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-10-21T20:38:44.847222] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-10-21T20:38:44.847327] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-10-21T20:38:44.847366] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-21T20:38:44.847405] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-21T20:38:44.847436] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-10-21T20:38:44.956203] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-10. [2025-10-21T20:38:45.224163] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:45.541185] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T20:38:45.542071] [INFO ] [REMOTE ] PMTU: Full fetch complete (1184 records). [2025-10-21T20:38:45.542144] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-10-21T20:38:45.756605] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-10-21T20:38:45.764454] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-21T20:38:45.765681] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:38:45.765758] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:38:45.765855] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-10-21T20:38:45.765958] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-10-21T20:38:45.766030] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-10-21T20:38:45.766090] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-10-21T20:38:45.766152] [INFO ] [MAIN ] Update Progress: 1701/2366 symbols completed. PMTU took 17.8s. Estimated remaining: 1h 25m 30s. Rate: 7.8 symbols/min [2025-10-21T20:38:45.974983] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:38:45.975175] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-10-21T20:38:45.975211] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-10-21T20:38:45.975326] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-10-21T20:38:45.975366] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-10-21T20:38:45.975405] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-10-21T20:38:45.975694] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-10-21T20:38:46.230394] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:38:46.264098] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-10-21T20:38:46.280836] [FATAL] [REMOTE ] PMTV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:38:46.291382] [FATAL] [MAIN ] PMTV: Failed to fetch primary data. [2025-10-21T20:38:46.291485] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:38:46.291577] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-10-21T20:38:46.297329] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-10-21T20:38:46.302520] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-10-21T20:38:46.312829] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-10-21T20:38:46.332206] [INFO ] [MAIN ] Update Progress: 1702/2366 symbols completed. PMTV took 3.2s. Estimated remaining: 1h 25m 19s. Rate: 7.8 symbols/min [2025-10-21T20:38:46.450841] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:46.538360] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:38:46.546878] [DEBUG] [LOCAL ] PNI: Loaded 6908 existing records from primary storage. [2025-10-21T20:38:46.547068] [INFO ] [MAIN ] PNI: Loaded 6908 existing records. [2025-10-21T20:38:46.557683] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-10-21T20:38:46.724856] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:38:46.725016] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-10-21T20:38:46.725063] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-10-21T20:38:46.725220] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-10-21T20:38:46.725285] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-10-21T20:38:47.072504] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:47.350976] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-10-21T20:38:48.151004] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-10-21T20:38:48.444056] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:38:48.444418] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-10-21T20:38:48.444507] [FATAL] [REMOTE ] PMTW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:38:48.444575] [FATAL] [MAIN ] PMTW: Failed to fetch primary data. [2025-10-21T20:38:48.444660] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:38:48.444739] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-10-21T20:38:48.444802] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-10-21T20:38:48.444838] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-10-21T20:38:48.444876] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-10-21T20:38:48.444920] [INFO ] [MAIN ] Update Progress: 1703/2366 symbols completed. PMTW took 3.8s. Estimated remaining: 1h 25m 9s. Rate: 7.8 symbols/min [2025-10-21T20:38:48.536235] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T20:38:48.660470] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-21T20:38:48.659041] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:38:48.700705] [DEBUG] [LOCAL ] PNNT: Loaded 33472 existing records from primary storage. [2025-10-21T20:38:48.700966] [INFO ] [MAIN ] PNNT: Loaded 33472 existing records. [2025-10-21T20:38:48.876441] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:38:48.876619] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-10-21T20:38:48.876704] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-10-21T20:38:48.876931] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-10-21T20:38:48.876995] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-10-21T20:38:48.956251] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-10-21T20:38:49.245842] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:38:49.751018] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-10-21T20:38:50.551070] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-10-21T20:38:50.669464] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T20:38:51.350993] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-10-21T20:38:51.389706] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T20:38:51.424842] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T20:38:52.151065] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-10-21T20:38:52.951000] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-10-21T20:38:52.993457] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T20:38:53.592573] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T20:38:53.597103] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T20:38:53.751032] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-10-21T20:38:54.551025] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-10-21T20:38:55.350992] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-10-21T20:38:55.373785] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T20:38:56.150992] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-10-21T20:38:56.301511] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T20:38:56.469371] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T20:38:56.951078] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-10-21T20:38:57.689034] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T20:38:57.751013] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-10-21T20:38:58.551013] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-10-21T20:38:58.687446] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T20:38:59.351001] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-10-21T20:38:59.438002] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T20:39:00.151035] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-10-21T20:39:00.351266] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T20:39:00.950991] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-10-21T20:39:01.397508] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T20:39:01.456417] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-21T20:39:01.529744] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T20:39:01.751037] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-10-21T20:39:02.493045] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-21T20:39:02.551045] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-10-21T20:39:03.351004] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-10-21T20:39:04.150995] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-10-21T20:39:04.559469] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T20:39:04.951062] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-10-21T20:39:04.988035] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T20:39:05.557393] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T20:39:05.598494] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T20:39:05.751030] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-10-21T20:39:06.551043] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-10-21T20:39:06.805458] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T20:39:07.351040] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-10-21T20:39:08.093569] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T20:39:08.150986] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-10-21T20:39:08.234744] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T20:39:08.951067] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-10-21T20:39:09.751047] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-10. [2025-10-21T20:39:09.783772] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T20:39:10.551048] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-10-21T20:39:10.595102] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T20:39:10.596749] [INFO ] [REMOTE ] PNI: Full fetch complete (9670 records). [2025-10-21T20:39:10.596836] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-10-21T20:39:10.788567] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:39:11.031503] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-10-21T20:39:11.031607] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-10-21T20:39:11.032157] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-10-21T20:39:11.032221] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-10-21T20:39:11.032729] [DEBUG] [LOCAL ] PNI: Trimmed 9670 records to 6905 (keeping 200 days of data) [2025-10-21T20:39:11.074600] [DEBUG] [LOCAL ] PNI: Primary data saved (6905 records). [2025-10-21T20:39:11.074837] [INFO ] [MAIN ] PNI: Full history saved. [2025-10-21T20:39:11.074949] [INFO ] [MAIN ] Update Progress: 1704/2366 symbols completed. PNI took 24.7s. Estimated remaining: 1h 25m 8s. Rate: 7.8 symbols/min [2025-10-21T20:39:11.248685] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:39:11.248950] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-10-21T20:39:11.248989] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-10-21T20:39:11.249116] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-10-21T20:39:11.249158] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-10-21T20:39:11.249199] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-10-21T20:39:11.249264] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-10-21T20:39:11.353382] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-10. [2025-10-21T20:39:11.624610] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:39:12.151034] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-10-21T20:39:12.742470] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T20:39:12.950994] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-10-21T20:39:13.076687] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T20:39:13.083744] [INFO ] [REMOTE ] PMT: Full fetch complete (58637 records). [2025-10-21T20:39:13.083842] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-10-21T20:39:13.480823] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-10-21T20:39:13.481082] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-10-21T20:39:13.482171] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-10-21T20:39:13.482384] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-10-21T20:39:13.483838] [DEBUG] [LOCAL ] PMT: Trimmed 58637 records to 40721 (keeping 200 days of data) [2025-10-21T20:39:13.627792] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T20:39:13.760183] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-10. [2025-10-21T20:39:13.768839] [DEBUG] [LOCAL ] PMT: Primary data saved (40721 records). [2025-10-21T20:39:13.768927] [INFO ] [MAIN ] PMT: Full history saved. [2025-10-21T20:39:13.768992] [INFO ] [MAIN ] Update Progress: 1705/2366 symbols completed. PMT took 50.6s. Estimated remaining: 1h 24m 58s. Rate: 7.8 symbols/min [2025-10-21T20:39:13.958131] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:39:13.958327] [DEBUG] [LOCAL ] PNW: No existing data file found in primary storage. [2025-10-21T20:39:13.958380] [WARN ] [MAIN ] PNW: No existing data found, performing full refresh instead. [2025-10-21T20:39:13.958503] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-10-21T20:39:13.958558] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-10-21T20:39:13.958632] [DEBUG] [LOCAL ] PNW: No primary data file found to delete. [2025-10-21T20:39:13.958734] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-10-21T20:39:14.307436] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:39:14.550988] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-10-21T20:39:14.777859] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T20:39:14.904552] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T20:39:14.910739] [INFO ] [REMOTE ] PNNT: Full fetch complete (47802 records). [2025-10-21T20:39:14.910887] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-10-21T20:39:15.309523] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-10-21T20:39:15.309600] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-10-21T20:39:15.310484] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-10-21T20:39:15.310546] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-10-21T20:39:15.311518] [DEBUG] [LOCAL ] PNNT: Trimmed 47802 records to 33432 (keeping 200 days of data) [2025-10-21T20:39:15.358086] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-10-21T20:39:15.504827] [DEBUG] [LOCAL ] PNNT: Primary data saved (33432 records). [2025-10-21T20:39:15.504951] [INFO ] [MAIN ] PNNT: Full history saved. [2025-10-21T20:39:15.505025] [INFO ] [MAIN ] Update Progress: 1706/2366 symbols completed. PNNT took 27.1s. Estimated remaining: 1h 24m 48s. Rate: 7.8 symbols/min [2025-10-21T20:39:15.673256] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:39:15.673380] [DEBUG] [LOCAL ] POR: No existing data file found in primary storage. [2025-10-21T20:39:15.673415] [WARN ] [MAIN ] POR: No existing data found, performing full refresh instead. [2025-10-21T20:39:15.673521] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-10-21T20:39:15.673561] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-10-21T20:39:15.673601] [DEBUG] [LOCAL ] POR: No primary data file found to delete. [2025-10-21T20:39:15.673633] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-10-21T20:39:16.023432] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:39:16.150989] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-10-21T20:39:16.642060] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-21T20:39:16.950994] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-10-21T20:39:17.360460] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T20:39:17.750999] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-10-21T20:39:17.935582] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T20:39:18.551037] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-10-21T20:39:19.002257] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-21T20:39:19.092192] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T20:39:19.350998] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-10-21T20:39:20.151069] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-10-21T20:39:20.681698] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-21T20:39:20.951010] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-10-21T20:39:21.082423] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T20:39:21.751079] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-10-21T20:39:21.999175] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T20:39:22.551057] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-10-21T20:39:22.890563] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T20:39:23.351068] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-10-21T20:39:23.603191] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T20:39:24.151005] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-10-21T20:39:24.453010] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T20:39:24.951097] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-10-21T20:39:24.982463] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T20:39:25.751037] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-10-21T20:39:26.152858] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T20:39:26.551052] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-10. [2025-10-21T20:39:26.754215] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T20:39:27.347844] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T20:39:27.356900] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-10-21T20:39:28.151044] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-10-21T20:39:28.441469] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T20:39:28.449602] [INFO ] [REMOTE ] PNC: Full fetch complete (75763 records). [2025-10-21T20:39:28.449771] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-10-21T20:39:28.847220] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-10-21T20:39:28.847587] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-10-21T20:39:28.849067] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-10-21T20:39:28.849148] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-10-21T20:39:28.875578] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T20:39:28.884804] [DEBUG] [LOCAL ] PNC: Trimmed 75763 records to 52077 (keeping 200 days of data) [2025-10-21T20:39:28.951404] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-10-21T20:39:29.221463] [DEBUG] [LOCAL ] PNC: Primary data saved (52077 records). [2025-10-21T20:39:29.221611] [INFO ] [MAIN ] PNC: Full history saved. [2025-10-21T20:39:29.221749] [INFO ] [MAIN ] Update Progress: 1707/2366 symbols completed. PNC took 43.5s. Estimated remaining: 1h 24m 43s. Rate: 7.8 symbols/min [2025-10-21T20:39:29.390077] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:39:29.390241] [DEBUG] [LOCAL ] POST: No existing data file found in primary storage. [2025-10-21T20:39:29.390277] [WARN ] [MAIN ] POST: No existing data found, performing full refresh instead. [2025-10-21T20:39:29.390388] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-10-21T20:39:29.390431] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-10-21T20:39:29.390472] [DEBUG] [LOCAL ] POST: No primary data file found to delete. [2025-10-21T20:39:29.390503] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-10-21T20:39:29.747706] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:39:29.751002] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-10-21T20:39:30.047174] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T20:39:30.550997] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-10-21T20:39:30.632962] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T20:39:31.063326] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T20:39:31.351060] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-10-21T20:39:32.151052] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-10-21T20:39:32.297021] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T20:39:32.950994] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-10-21T20:39:33.274400] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T20:39:33.751032] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-10-21T20:39:34.011944] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T20:39:34.551027] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-10-21T20:39:34.620775] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T20:39:35.351040] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-10-21T20:39:35.474086] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T20:39:36.151050] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-10-21T20:39:36.375946] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T20:39:36.947612] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T20:39:36.955280] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-10-21T20:39:37.751042] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-10-21T20:39:37.947141] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-21T20:39:38.551063] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-10-21T20:39:39.351032] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-10-21T20:39:39.446800] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-21T20:39:39.672982] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T20:39:40.151021] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-10. [2025-10-21T20:39:40.951019] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-10-21T20:39:41.113256] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-21T20:39:41.448119] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T20:39:41.750994] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-10-21T20:39:41.983857] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T20:39:41.991280] [INFO ] [REMOTE ] PNR: Full fetch complete (69720 records). [2025-10-21T20:39:41.991432] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-10-21T20:39:42.394137] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-10-21T20:39:42.394240] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-10-21T20:39:42.395441] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-10-21T20:39:42.395559] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-10-21T20:39:42.396913] [DEBUG] [LOCAL ] PNR: Trimmed 69720 records to 47493 (keeping 200 days of data) [2025-10-21T20:39:42.574879] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-10. [2025-10-21T20:39:42.694742] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T20:39:42.732182] [DEBUG] [LOCAL ] PNR: Primary data saved (47493 records). [2025-10-21T20:39:42.732709] [INFO ] [MAIN ] PNR: Full history saved. [2025-10-21T20:39:42.732801] [INFO ] [MAIN ] Update Progress: 1708/2366 symbols completed. PNR took 31.7s. Estimated remaining: 1h 24m 37s. Rate: 7.8 symbols/min [2025-10-21T20:39:42.905774] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:39:42.905940] [DEBUG] [LOCAL ] PPG: No existing data file found in primary storage. [2025-10-21T20:39:42.905978] [WARN ] [MAIN ] PPG: No existing data found, performing full refresh instead. [2025-10-21T20:39:42.906086] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-10-21T20:39:42.906129] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-10-21T20:39:42.906171] [DEBUG] [LOCAL ] PPG: No primary data file found to delete. [2025-10-21T20:39:42.906204] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-10-21T20:39:43.272718] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:39:43.296060] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T20:39:43.350989] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-10-21T20:39:44.151017] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-10-21T20:39:44.267279] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T20:39:44.274147] [INFO ] [REMOTE ] PNW: Full fetch complete (66032 records). [2025-10-21T20:39:44.274289] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-10-21T20:39:44.662157] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-10-21T20:39:44.662236] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-10-21T20:39:44.663287] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-10-21T20:39:44.663385] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-10-21T20:39:44.664614] [DEBUG] [LOCAL ] PNW: Trimmed 66032 records to 45576 (keeping 200 days of data) [2025-10-21T20:39:44.939138] [DEBUG] [LOCAL ] PNW: Primary data saved (45576 records). [2025-10-21T20:39:44.939279] [INFO ] [MAIN ] PNW: Full history saved. [2025-10-21T20:39:44.939350] [INFO ] [MAIN ] Update Progress: 1709/2366 symbols completed. PNW took 31.2s. Estimated remaining: 1h 24m 27s. Rate: 7.8 symbols/min [2025-10-21T20:39:44.964213] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-10. [2025-10-21T20:39:45.131353] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:39:45.131580] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-10-21T20:39:45.131735] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-10-21T20:39:45.131889] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-10-21T20:39:45.132025] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-10-21T20:39:45.132245] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-10-21T20:39:45.132341] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-10-21T20:39:45.526692] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-21T20:39:45.524351] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:39:45.640571] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T20:39:45.750989] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-10-21T20:39:46.550998] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-10-21T20:39:46.739106] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T20:39:46.746062] [INFO ] [REMOTE ] POR: Full fetch complete (68344 records). [2025-10-21T20:39:46.746157] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-10-21T20:39:47.144298] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-10-21T20:39:47.144376] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-10-21T20:39:47.145421] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-10-21T20:39:47.145482] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-10-21T20:39:47.146757] [DEBUG] [LOCAL ] POR: Trimmed 68344 records to 46776 (keeping 200 days of data) [2025-10-21T20:39:47.369566] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-10-21T20:39:47.444973] [DEBUG] [LOCAL ] POR: Primary data saved (46776 records). [2025-10-21T20:39:47.445097] [INFO ] [MAIN ] POR: Full history saved. [2025-10-21T20:39:47.445166] [INFO ] [MAIN ] Update Progress: 1710/2366 symbols completed. POR took 31.9s. Estimated remaining: 1h 24m 17s. Rate: 7.8 symbols/min [2025-10-21T20:39:47.622601] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:39:47.642139] [DEBUG] [LOCAL ] PPT: Loaded 19733 existing records from primary storage. [2025-10-21T20:39:47.642499] [INFO ] [MAIN ] PPT: Loaded 19733 existing records. [2025-10-21T20:39:47.827723] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:39:47.828072] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-10-21T20:39:47.828133] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-10-21T20:39:47.837100] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-10-21T20:39:47.852211] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-10-21T20:39:47.899020] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-21T20:39:48.152461] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-10-21T20:39:48.229037] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:39:48.505877] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-21T20:39:48.951076] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-10-21T20:39:49.142298] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T20:39:49.759875] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-10-21T20:39:49.781876] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T20:39:50.338554] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T20:39:50.551037] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-10-21T20:39:51.351094] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-10-21T20:39:51.416798] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T20:39:52.144256] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T20:39:52.153538] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-10-21T20:39:52.500762] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T20:39:52.951086] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-10-21T20:39:53.750995] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-10-21T20:39:53.853440] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T20:39:54.551074] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-10-21T20:39:55.004678] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T20:39:55.351002] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-10-21T20:39:55.812137] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-21T20:39:55.829763] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-21T20:39:56.151062] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-10. [2025-10-21T20:39:56.950997] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-10-21T20:39:57.361163] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T20:39:57.708873] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T20:39:57.714478] [INFO ] [REMOTE ] POST: Full fetch complete (55568 records). [2025-10-21T20:39:57.714612] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-10-21T20:39:57.773592] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-10-21T20:39:58.136738] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-10-21T20:39:58.142098] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-10-21T20:39:58.143818] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-10-21T20:39:58.143905] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-10-21T20:39:58.153071] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T20:39:58.158418] [DEBUG] [LOCAL ] POST: Trimmed 55568 records to 38568 (keeping 200 days of data) [2025-10-21T20:39:58.409997] [DEBUG] [LOCAL ] POST: Primary data saved (38568 records). [2025-10-21T20:39:58.410197] [INFO ] [MAIN ] POST: Full history saved. [2025-10-21T20:39:58.410286] [INFO ] [MAIN ] Update Progress: 1711/2366 symbols completed. POST took 29.2s. Estimated remaining: 1h 24m 11s. Rate: 7.8 symbols/min [2025-10-21T20:39:58.557716] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-10-21T20:39:58.593073] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:39:58.593346] [DEBUG] [LOCAL ] PR: No existing data file found in primary storage. [2025-10-21T20:39:58.593429] [WARN ] [MAIN ] PR: No existing data found, performing full refresh instead. [2025-10-21T20:39:58.593590] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-10-21T20:39:58.593634] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-10-21T20:39:58.593749] [DEBUG] [LOCAL ] PR: No primary data file found to delete. [2025-10-21T20:39:58.593790] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-10-21T20:39:58.964195] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:39:59.351042] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-10-21T20:39:59.743188] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-21T20:40:00.151111] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-10-21T20:40:00.563086] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T20:40:00.951040] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-10-21T20:40:01.361047] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T20:40:01.750990] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-10-21T20:40:02.085145] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-21T20:40:02.551118] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-10-21T20:40:02.771004] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T20:40:02.981168] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T20:40:03.351078] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-10-21T20:40:04.151089] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-10-21T20:40:04.427291] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T20:40:04.702950] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T20:40:04.951080] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-10-21T20:40:05.751011] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-10-21T20:40:06.002905] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T20:40:06.122325] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T20:40:06.551058] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-10-21T20:40:07.351051] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-10-21T20:40:07.661466] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T20:40:07.714981] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T20:40:08.151120] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-10-21T20:40:08.951039] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-10-21T20:40:09.387492] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T20:40:09.697719] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T20:40:09.750993] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-10-21T20:40:10.551094] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-10-21T20:40:11.091078] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-21T20:40:11.351028] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-10-21T20:40:11.592527] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:40:12.151059] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-10. [2025-10-21T20:40:12.201764] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T20:40:12.951011] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-10-21T20:40:13.274602] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T20:40:13.751026] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-10-21T20:40:14.026249] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T20:40:14.034020] [INFO ] [REMOTE ] PPG: Full fetch complete (73971 records). [2025-10-21T20:40:14.034133] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-10-21T20:40:14.434055] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-10-21T20:40:14.434135] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-10-21T20:40:14.435261] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-10-21T20:40:14.435337] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-10-21T20:40:14.436790] [DEBUG] [LOCAL ] PPG: Trimmed 73971 records to 50524 (keeping 200 days of data) [2025-10-21T20:40:14.556697] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-10. [2025-10-21T20:40:14.756228] [DEBUG] [LOCAL ] PPG: Primary data saved (50524 records). [2025-10-21T20:40:14.756374] [INFO ] [MAIN ] PPG: Full history saved. [2025-10-21T20:40:14.756451] [INFO ] [MAIN ] Update Progress: 1712/2366 symbols completed. PPG took 32.0s. Estimated remaining: 1h 24m 7s. Rate: 7.8 symbols/min [2025-10-21T20:40:14.947735] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:40:14.948608] [DEBUG] [LOCAL ] PRA: No existing data file found in primary storage. [2025-10-21T20:40:14.948687] [WARN ] [MAIN ] PRA: No existing data found, performing full refresh instead. [2025-10-21T20:40:14.948880] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-10-21T20:40:14.948935] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-10-21T20:40:14.948981] [DEBUG] [LOCAL ] PRA: No primary data file found to delete. [2025-10-21T20:40:14.949014] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-10-21T20:40:15.333945] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:40:15.362060] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-10-21T20:40:15.364795] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-21T20:40:15.699057] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T20:40:15.701815] [INFO ] [REMOTE ] PPT: Full fetch complete (28451 records). [2025-10-21T20:40:15.701893] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-10-21T20:40:16.079926] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-10-21T20:40:16.080000] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-10-21T20:40:16.080627] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-10-21T20:40:16.080703] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-10-21T20:40:16.081374] [DEBUG] [LOCAL ] PPT: Trimmed 28451 records to 19747 (keeping 200 days of data) [2025-10-21T20:40:16.160372] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-10-21T20:40:16.201547] [DEBUG] [LOCAL ] PPT: Primary data saved (19747 records). [2025-10-21T20:40:16.201841] [INFO ] [MAIN ] PPT: Full history saved. [2025-10-21T20:40:16.201965] [INFO ] [MAIN ] Update Progress: 1713/2366 symbols completed. PPT took 28.8s. Estimated remaining: 1h 23m 57s. Rate: 7.8 symbols/min [2025-10-21T20:40:16.375612] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:40:16.386494] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T20:40:16.393783] [DEBUG] [LOCAL ] PRCS: Loaded 2786 existing records from primary storage. [2025-10-21T20:40:16.393971] [INFO ] [MAIN ] PRCS: Loaded 2786 existing records. [2025-10-21T20:40:16.601360] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-21T20:40:16.605197] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:40:16.616370] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-10-21T20:40:16.616587] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-10-21T20:40:16.616820] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-10-21T20:40:16.617188] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-10-21T20:40:16.951951] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-10-21T20:40:16.991353] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:40:17.751032] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-10. [2025-10-21T20:40:18.231093] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-21T20:40:18.232119] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T20:40:18.551018] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-10-21T20:40:19.351016] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-10-21T20:40:19.511216] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T20:40:19.519575] [INFO ] [REMOTE ] PPL: Full fetch complete (77620 records). [2025-10-21T20:40:19.519771] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-10-21T20:40:19.926166] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-10-21T20:40:19.926241] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-10-21T20:40:19.927396] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-10-21T20:40:19.927460] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-10-21T20:40:19.928937] [DEBUG] [LOCAL ] PPL: Trimmed 77620 records to 53506 (keeping 200 days of data) [2025-10-21T20:40:20.160817] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-10-21T20:40:20.284003] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T20:40:20.300068] [DEBUG] [LOCAL ] PPL: Primary data saved (53506 records). [2025-10-21T20:40:20.300378] [INFO ] [MAIN ] PPL: Full history saved. [2025-10-21T20:40:20.300784] [INFO ] [MAIN ] Update Progress: 1714/2366 symbols completed. PPL took 35.4s. Estimated remaining: 1h 23m 47s. Rate: 7.8 symbols/min [2025-10-21T20:40:20.467752] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:40:20.467908] [DEBUG] [LOCAL ] PRG: No existing data file found in primary storage. [2025-10-21T20:40:20.467945] [WARN ] [MAIN ] PRG: No existing data found, performing full refresh instead. [2025-10-21T20:40:20.468050] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-10-21T20:40:20.468090] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-10-21T20:40:20.468128] [DEBUG] [LOCAL ] PRG: No primary data file found to delete. [2025-10-21T20:40:20.468159] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-10-21T20:40:20.821433] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:40:20.839740] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T20:40:20.950987] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-10-21T20:40:21.217087] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T20:40:21.751042] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-10-21T20:40:22.349565] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T20:40:22.551040] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-10-21T20:40:23.351049] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-10-21T20:40:23.880081] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T20:40:23.960055] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T20:40:24.151050] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-10-21T20:40:24.290118] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T20:40:24.951027] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-10-21T20:40:25.750990] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-10-21T20:40:26.256859] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-21T20:40:26.407762] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T20:40:26.551043] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-10. [2025-10-21T20:40:27.350987] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-10-21T20:40:27.441354] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T20:40:28.151050] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-10-21T20:40:28.466196] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T20:40:28.474716] [INFO ] [REMOTE ] PR: Full fetch complete (77763 records). [2025-10-21T20:40:28.474835] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-10-21T20:40:28.869676] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-10-21T20:40:28.869846] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-10-21T20:40:28.871010] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-10-21T20:40:28.871087] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-10-21T20:40:28.892024] [DEBUG] [LOCAL ] PR: Trimmed 77763 records to 53611 (keeping 200 days of data) [2025-10-21T20:40:28.891892] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T20:40:28.952241] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-10-21T20:40:29.226064] [DEBUG] [LOCAL ] PR: Primary data saved (53611 records). [2025-10-21T20:40:29.226985] [INFO ] [MAIN ] PR: Full history saved. [2025-10-21T20:40:29.227075] [INFO ] [MAIN ] Update Progress: 1715/2366 symbols completed. PR took 30.8s. Estimated remaining: 1h 23m 40s. Rate: 7.8 symbols/min [2025-10-21T20:40:29.395224] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:40:29.395383] [DEBUG] [LOCAL ] PRGO: No existing data file found in primary storage. [2025-10-21T20:40:29.395435] [WARN ] [MAIN ] PRGO: No existing data found, performing full refresh instead. [2025-10-21T20:40:29.395540] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-10-21T20:40:29.395581] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-10-21T20:40:29.395620] [DEBUG] [LOCAL ] PRGO: No primary data file found to delete. [2025-10-21T20:40:29.395679] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-10-21T20:40:29.634191] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T20:40:29.754053] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-10-21T20:40:29.758582] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:40:29.777944] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T20:40:30.544196] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T20:40:30.550967] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-10-21T20:40:31.052528] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-21T20:40:31.351056] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-10-21T20:40:31.921816] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T20:40:32.151022] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-10-21T20:40:32.951023] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-10-21T20:40:33.713500] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T20:40:33.750996] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-10-21T20:40:34.472412] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T20:40:34.550984] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-10-21T20:40:35.222172] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T20:40:35.351022] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-10-21T20:40:36.056566] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T20:40:36.151027] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-10-21T20:40:36.755169] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T20:40:36.951036] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-10-21T20:40:37.751078] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-10-21T20:40:37.937067] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T20:40:38.351110] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T20:40:38.353941] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T20:40:38.551046] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-10-21T20:40:39.351030] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-10-21T20:40:39.941269] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T20:40:40.151013] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-10-21T20:40:40.329073] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T20:40:40.951023] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-10-21T20:40:41.455265] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T20:40:41.697065] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T20:40:41.750980] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-10-21T20:40:42.551029] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-10. [2025-10-21T20:40:43.091994] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-21T20:40:43.092636] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T20:40:43.099706] [INFO ] [REMOTE ] PRCS: Full fetch complete (3901 records). [2025-10-21T20:40:43.100192] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-10-21T20:40:43.356129] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-10-21T20:40:43.462417] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-10-21T20:40:43.462488] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-10-21T20:40:43.462609] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-10-21T20:40:43.462670] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-10-21T20:40:43.463035] [DEBUG] [LOCAL ] PRCS: Trimmed 3901 records to 2800 (keeping 200 days of data) [2025-10-21T20:40:43.478728] [DEBUG] [LOCAL ] PRCS: Primary data saved (2800 records). [2025-10-21T20:40:43.478788] [INFO ] [MAIN ] PRCS: Full history saved. [2025-10-21T20:40:43.478856] [INFO ] [MAIN ] Update Progress: 1716/2366 symbols completed. PRCS took 27.3s. Estimated remaining: 1h 23m 35s. Rate: 7.8 symbols/min [2025-10-21T20:40:43.646158] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:40:43.653761] [DEBUG] [LOCAL ] PRH: Loaded 4740 existing records from primary storage. [2025-10-21T20:40:43.653994] [INFO ] [MAIN ] PRH: Loaded 4740 existing records. [2025-10-21T20:40:43.826175] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:40:43.826381] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-10-21T20:40:43.826452] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-10-21T20:40:43.826682] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-10-21T20:40:43.826739] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-10-21T20:40:44.164441] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-10-21T20:40:44.176867] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:40:44.712139] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T20:40:44.951028] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-10. [2025-10-21T20:40:45.751044] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-10. [2025-10-21T20:40:46.003977] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T20:40:46.305054] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T20:40:46.310402] [INFO ] [REMOTE ] PRA: Full fetch complete (45112 records). [2025-10-21T20:40:46.310492] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-10-21T20:40:46.562458] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-10-21T20:40:46.688557] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-10-21T20:40:46.688659] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-10-21T20:40:46.689547] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-10-21T20:40:46.689597] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-10-21T20:40:46.691489] [DEBUG] [LOCAL ] PRA: Trimmed 45112 records to 34582 (keeping 200 days of data) [2025-10-21T20:40:46.860502] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T20:40:46.896784] [INFO ] [REMOTE ] PRG: Full fetch complete (44380 records). [2025-10-21T20:40:46.896904] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-10-21T20:40:47.045193] [DEBUG] [LOCAL ] PRA: Primary data saved (34582 records). [2025-10-21T20:40:47.078537] [INFO ] [MAIN ] PRA: Full history saved. [2025-10-21T20:40:47.099988] [INFO ] [MAIN ] Update Progress: 1717/2366 symbols completed. PRA took 32.3s. Estimated remaining: 1h 23m 26s. Rate: 7.8 symbols/min [2025-10-21T20:40:47.295892] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-10-21T20:40:47.295966] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-10-21T20:40:47.296840] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-10-21T20:40:47.296901] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-10-21T20:40:47.297792] [DEBUG] [LOCAL ] PRG: Trimmed 44380 records to 29630 (keeping 200 days of data) [2025-10-21T20:40:47.357459] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-10-21T20:40:47.476370] [DEBUG] [LOCAL ] PRG: Primary data saved (29630 records). [2025-10-21T20:40:47.476504] [INFO ] [MAIN ] PRG: Full history saved. [2025-10-21T20:40:47.476574] [INFO ] [MAIN ] Update Progress: 1718/2366 symbols completed. PRG took 27.2s. Estimated remaining: 1h 23m 15s. Rate: 7.8 symbols/min [2025-10-21T20:40:48.303185] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T20:40:48.308309] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-10-21T20:40:48.558493] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T20:40:48.951125] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-10-21T20:40:49.197738] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T20:40:49.751128] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-10-21T20:40:50.417329] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-21T20:40:50.551032] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-10-21T20:40:50.877907] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T20:40:51.076234] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-21T20:40:51.351096] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-10-21T20:40:52.150996] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-10-21T20:40:52.308824] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T20:40:52.950991] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-10-21T20:40:53.669936] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T20:40:53.763795] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-10-21T20:40:53.766138] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T20:40:54.526366] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T20:40:54.551048] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-10-21T20:40:55.288296] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T20:40:55.351076] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-10-21T20:40:55.943146] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T20:40:56.151020] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-10. [2025-10-21T20:40:56.742627] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T20:40:56.743845] [INFO ] [REMOTE ] PRH: Full fetch complete (7459 records). [2025-10-21T20:40:56.743914] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-10-21T20:40:56.956316] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-10-21T20:40:57.106136] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-10-21T20:40:57.106209] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-10-21T20:40:57.106400] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-10-21T20:40:57.106489] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-10-21T20:40:57.106977] [DEBUG] [LOCAL ] PRH: Trimmed 7459 records to 4716 (keeping 200 days of data) [2025-10-21T20:40:57.135511] [DEBUG] [LOCAL ] PRH: Primary data saved (4716 records). [2025-10-21T20:40:57.135667] [INFO ] [MAIN ] PRH: Full history saved. [2025-10-21T20:40:57.135767] [INFO ] [MAIN ] Update Progress: 1719/2366 symbols completed. PRH took 13.7s. Estimated remaining: 1h 23m 8s. Rate: 7.8 symbols/min [2025-10-21T20:40:58.834982] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T20:40:58.846105] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-10-21T20:41:00.711898] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T20:41:00.721931] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-10-21T20:41:02.583503] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T20:41:02.594668] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-10. [2025-10-21T20:41:04.321836] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T20:41:04.329377] [INFO ] [REMOTE ] PRGO: Full fetch complete (68882 records). [2025-10-21T20:41:04.329478] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-10-21T20:41:04.704587] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-10-21T20:41:04.704686] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-10-21T20:41:04.705681] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-10-21T20:41:04.705742] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-10-21T20:41:04.706967] [DEBUG] [LOCAL ] PRGO: Trimmed 68882 records to 47142 (keeping 200 days of data) [2025-10-21T20:41:04.985139] [DEBUG] [LOCAL ] PRGO: Primary data saved (47142 records). [2025-10-21T20:41:04.985290] [INFO ] [MAIN ] PRGO: Full history saved. [2025-10-21T20:41:04.985379] [INFO ] [MAIN ] Update Progress: 1720/2366 symbols completed. PRGO took 35.8s. Estimated remaining: 1h 23m 1s. Rate: 7.8 symbols/min [2025-10-21T20:41:05.496408] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:05.581629] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:05.648479] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:05.670912] [DEBUG] [LOCAL ] PRLB: No existing data file found in primary storage. [2025-10-21T20:41:05.673534] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:05.673913] [DEBUG] [LOCAL ] PRI: No existing data file found in primary storage. [2025-10-21T20:41:05.673618] [WARN ] [MAIN ] PRLB: No existing data found, performing full refresh instead. [2025-10-21T20:41:05.674272] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-10-21T20:41:05.673956] [WARN ] [MAIN ] PRI: No existing data found, performing full refresh instead. [2025-10-21T20:41:05.674437] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-10-21T20:41:05.674527] [DEBUG] [LOCAL ] PRLB: No primary data file found to delete. [2025-10-21T20:41:05.674393] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-10-21T20:41:05.674704] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-10-21T20:41:05.674757] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-10-21T20:41:05.709479] [DEBUG] [LOCAL ] PRI: No primary data file found to delete. [2025-10-21T20:41:05.736878] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-10-21T20:41:06.110450] [DEBUG] [LOCAL ] PRKS: Loaded 42462 existing records from primary storage. [2025-10-21T20:41:06.189401] [DEBUG] [LOCAL ] PRIM: Loaded 44184 existing records from primary storage. [2025-10-21T20:41:06.223000] [INFO ] [MAIN ] PRIM: Loaded 44184 existing records. [2025-10-21T20:41:06.228325] [INFO ] [MAIN ] PRKS: Loaded 42462 existing records. [2025-10-21T20:41:06.554223] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:06.599257] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-10-21T20:41:06.761275] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:41:06.781128] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-10-21T20:41:06.786427] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-10-21T20:41:06.765309] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:06.791732] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-10-21T20:41:06.792028] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-10-21T20:41:06.792160] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-10-21T20:41:06.917157] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:41:06.946685] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-10-21T20:41:06.949296] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-10-21T20:41:06.965358] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-10-21T20:41:06.997887] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-10-21T20:41:07.396817] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:07.445415] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-10-21T20:41:07.579224] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:07.579495] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-10-21T20:41:07.973685] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T20:41:07.977960] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-10-21T20:41:08.005670] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T20:41:08.009143] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-10-21T20:41:09.047099] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T20:41:09.055468] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-10-21T20:41:09.069813] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T20:41:09.075234] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-10-21T20:41:09.187511] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T20:41:09.195902] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-10-21T20:41:09.272441] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-21T20:41:09.276065] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-10-21T20:41:10.402139] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T20:41:10.407022] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-10-21T20:41:10.429929] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T20:41:10.438429] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-10-21T20:41:10.449917] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T20:41:10.454266] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-10-21T20:41:10.953417] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T20:41:10.961836] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-10-21T20:41:11.690260] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T20:41:11.695943] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-10-21T20:41:11.771560] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-21T20:41:12.150990] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-10-21T20:41:12.247935] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T20:41:12.545183] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T20:41:12.772227] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T20:41:12.951043] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-10-21T20:41:13.039763] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T20:41:13.751075] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-10-21T20:41:14.551052] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-10-21T20:41:14.779637] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T20:41:15.350994] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-10-21T20:41:15.448501] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T20:41:15.819832] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T20:41:16.151026] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-10-21T20:41:16.951017] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-10-21T20:41:17.184793] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T20:41:17.317768] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T20:41:17.751035] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-10-21T20:41:18.106818] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T20:41:18.551040] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-10-21T20:41:19.351007] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-10-21T20:41:19.468534] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T20:41:19.528619] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T20:41:20.151020] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-10-21T20:41:20.951006] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-10-21T20:41:21.018953] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T20:41:21.421750] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T20:41:21.751076] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-10-21T20:41:22.550997] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-10-21T20:41:22.581176] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T20:41:22.897015] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T20:41:23.351044] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-10. [2025-10-21T20:41:23.409924] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T20:41:24.151046] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-10-21T20:41:24.433243] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T20:41:24.436368] [INFO ] [REMOTE ] PRLB: Full fetch complete (30319 records). [2025-10-21T20:41:24.436454] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-10-21T20:41:24.815243] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-10-21T20:41:24.815339] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-10-21T20:41:24.816062] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-10-21T20:41:24.816124] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-10-21T20:41:24.816977] [DEBUG] [LOCAL ] PRLB: Trimmed 30319 records to 20323 (keeping 200 days of data) [2025-10-21T20:41:24.946723] [DEBUG] [LOCAL ] PRLB: Primary data saved (20323 records). [2025-10-21T20:41:24.946884] [INFO ] [MAIN ] PRLB: Full history saved. [2025-10-21T20:41:24.946982] [INFO ] [MAIN ] Update Progress: 1721/2366 symbols completed. PRLB took 20.0s. Estimated remaining: 1h 22m 57s. Rate: 7.8 symbols/min [2025-10-21T20:41:24.958384] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-10-21T20:41:25.142816] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:25.185963] [DEBUG] [LOCAL ] PRM: Loaded 44358 existing records from primary storage. [2025-10-21T20:41:25.186288] [INFO ] [MAIN ] PRM: Loaded 44358 existing records. [2025-10-21T20:41:25.321681] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T20:41:25.415152] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:41:25.415419] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-10-21T20:41:25.415485] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-10-21T20:41:25.415852] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-10-21T20:41:25.415913] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-10-21T20:41:25.756186] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-10-21T20:41:25.817318] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:26.551072] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-10-21T20:41:26.899254] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T20:41:27.306855] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T20:41:27.351027] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-10-21T20:41:28.152593] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-10-21T20:41:28.158600] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T20:41:28.951053] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-10-21T20:41:29.151897] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T20:41:29.750998] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-10. [2025-10-21T20:41:29.784491] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T20:41:30.551030] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-10. [2025-10-21T20:41:30.586995] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T20:41:30.730708] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T20:41:30.734106] [INFO ] [REMOTE ] PRI: Full fetch complete (25636 records). [2025-10-21T20:41:30.734295] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-10-21T20:41:31.119349] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-10-21T20:41:31.119438] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-10-21T20:41:31.120063] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-10-21T20:41:31.120128] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-10-21T20:41:31.121007] [DEBUG] [LOCAL ] PRI: Trimmed 25636 records to 17836 (keeping 200 days of data) [2025-10-21T20:41:31.232339] [DEBUG] [LOCAL ] PRI: Primary data saved (17836 records). [2025-10-21T20:41:31.232490] [INFO ] [MAIN ] PRI: Full history saved. [2025-10-21T20:41:31.232562] [INFO ] [MAIN ] Update Progress: 1722/2366 symbols completed. PRI took 26.2s. Estimated remaining: 1h 22m 49s. Rate: 7.8 symbols/min [2025-10-21T20:41:31.356121] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-10-21T20:41:31.408940] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:31.462073] [DEBUG] [LOCAL ] PRMB: Loaded 53123 existing records from primary storage. [2025-10-21T20:41:31.462407] [INFO ] [MAIN ] PRMB: Loaded 53123 existing records. [2025-10-21T20:41:31.638371] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:41:31.638591] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-10-21T20:41:31.638639] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-10-21T20:41:31.638879] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-10-21T20:41:31.638919] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-10-21T20:41:31.996314] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:32.151731] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-10-21T20:41:32.153677] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T20:41:32.160731] [INFO ] [REMOTE ] PRIM: Full fetch complete (63729 records). [2025-10-21T20:41:32.160832] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-10-21T20:41:32.584424] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-10-21T20:41:32.584506] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-10-21T20:41:32.585829] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-10-21T20:41:32.585896] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-10-21T20:41:32.587311] [DEBUG] [LOCAL ] PRIM: Trimmed 63729 records to 44099 (keeping 200 days of data) [2025-10-21T20:41:32.874843] [DEBUG] [LOCAL ] PRIM: Primary data saved (44099 records). [2025-10-21T20:41:32.874970] [INFO ] [MAIN ] PRIM: Full history saved. [2025-10-21T20:41:32.875050] [INFO ] [MAIN ] Update Progress: 1723/2366 symbols completed. PRIM took 27.9s. Estimated remaining: 1h 22m 39s. Rate: 7.8 symbols/min [2025-10-21T20:41:32.955728] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-10-21T20:41:33.069745] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:33.109894] [DEBUG] [LOCAL ] PRO: Loaded 40179 existing records from primary storage. [2025-10-21T20:41:33.110198] [INFO ] [MAIN ] PRO: Loaded 40179 existing records. [2025-10-21T20:41:33.316714] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:41:33.318596] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T20:41:33.327080] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-10-21T20:41:33.327266] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-10-21T20:41:33.327858] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-10-21T20:41:33.327919] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-10-21T20:41:33.693421] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:33.751002] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-10-21T20:41:34.002820] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T20:41:34.551067] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-10-21T20:41:34.936625] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-21T20:41:35.159330] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T20:41:35.351027] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-10-21T20:41:36.156216] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-10-21T20:41:36.170384] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T20:41:36.830585] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T20:41:36.951040] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-10-21T20:41:37.751077] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-10-21T20:41:37.875589] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T20:41:37.979208] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T20:41:38.551041] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-10-21T20:41:39.351003] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-10-21T20:41:39.411874] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T20:41:40.113804] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T20:41:40.151016] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-10-21T20:41:40.951098] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-10-21T20:41:41.112446] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T20:41:41.249329] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T20:41:41.751058] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-10-21T20:41:42.456613] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T20:41:42.551038] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-10-21T20:41:43.351043] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-10. [2025-10-21T20:41:43.713126] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-21T20:41:43.885703] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T20:41:44.151008] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-10-21T20:41:44.895271] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T20:41:44.901893] [INFO ] [REMOTE ] PRKS: Full fetch complete (61612 records). [2025-10-21T20:41:44.902013] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-10-21T20:41:44.956244] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-10-21T20:41:45.292464] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-10-21T20:41:45.292577] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-10-21T20:41:45.293678] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-10-21T20:41:45.293748] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-10-21T20:41:45.295111] [DEBUG] [LOCAL ] PRKS: Trimmed 61612 records to 42343 (keeping 200 days of data) [2025-10-21T20:41:45.548727] [DEBUG] [LOCAL ] PRKS: Primary data saved (42343 records). [2025-10-21T20:41:45.548852] [INFO ] [MAIN ] PRKS: Full history saved. [2025-10-21T20:41:45.548931] [INFO ] [MAIN ] Update Progress: 1724/2366 symbols completed. PRKS took 40.6s. Estimated remaining: 1h 22m 33s. Rate: 7.8 symbols/min [2025-10-21T20:41:45.714901] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:45.715062] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-10-21T20:41:45.715098] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-10-21T20:41:45.715207] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-10-21T20:41:45.715248] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-10-21T20:41:45.715288] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-10-21T20:41:45.715320] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-10-21T20:41:45.760379] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-10-21T20:41:46.074589] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:46.106982] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T20:41:46.551003] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-10-21T20:41:46.805146] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T20:41:47.158623] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T20:41:47.350991] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-10-21T20:41:48.059413] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T20:41:48.150979] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-10-21T20:41:48.951086] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-10-21T20:41:49.082558] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T20:41:49.752363] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-10-21T20:41:49.755998] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T20:41:50.550996] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-10. [2025-10-21T20:41:50.902474] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T20:41:51.214014] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T20:41:51.351034] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-10-21T20:41:52.151094] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-10-21T20:41:52.153323] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T20:41:52.160907] [INFO ] [REMOTE ] PRM: Full fetch complete (64841 records). [2025-10-21T20:41:52.161008] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-10-21T20:41:52.547270] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-10-21T20:41:52.547347] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-10-21T20:41:52.548384] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-10-21T20:41:52.548445] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-10-21T20:41:52.549632] [DEBUG] [LOCAL ] PRM: Trimmed 64841 records to 44377 (keeping 200 days of data) [2025-10-21T20:41:52.797397] [DEBUG] [LOCAL ] PRM: Primary data saved (44377 records). [2025-10-21T20:41:52.797511] [INFO ] [MAIN ] PRM: Full history saved. [2025-10-21T20:41:52.797583] [INFO ] [MAIN ] Update Progress: 1725/2366 symbols completed. PRM took 27.9s. Estimated remaining: 1h 22m 25s. Rate: 7.8 symbols/min [2025-10-21T20:41:52.951170] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-10-21T20:41:52.973273] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:52.980109] [DEBUG] [LOCAL ] PRT: Loaded 5153 existing records from primary storage. [2025-10-21T20:41:52.980261] [INFO ] [MAIN ] PRT: Loaded 5153 existing records. [2025-10-21T20:41:53.159153] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:41:53.159559] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-10-21T20:41:53.159711] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-10-21T20:41:53.159951] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-10-21T20:41:53.160013] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-10-21T20:41:53.469130] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T20:41:53.584994] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:41:53.750986] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-10-21T20:41:53.957913] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T20:41:54.293777] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T20:41:54.551076] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-10-21T20:41:55.351067] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-10-21T20:41:55.489243] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:41:56.151066] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-10-21T20:41:56.333831] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T20:41:56.339315] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T20:41:56.951074] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-10. [2025-10-21T20:41:57.750994] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-10-21T20:41:57.838181] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T20:41:58.551072] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-10-21T20:41:58.772041] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T20:41:58.779238] [INFO ] [REMOTE ] PRO: Full fetch complete (53854 records). [2025-10-21T20:41:58.779344] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-10-21T20:41:59.183217] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-10-21T20:41:59.183839] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-10-21T20:41:59.185290] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-10-21T20:41:59.184315] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T20:41:59.190783] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-10-21T20:41:59.192314] [DEBUG] [LOCAL ] PRO: Trimmed 53854 records to 40193 (keeping 200 days of data) [2025-10-21T20:41:59.356531] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-10-21T20:41:59.426785] [DEBUG] [LOCAL ] PRO: Primary data saved (40193 records). [2025-10-21T20:41:59.426906] [INFO ] [MAIN ] PRO: Full history saved. [2025-10-21T20:41:59.427478] [INFO ] [MAIN ] Update Progress: 1726/2366 symbols completed. PRO took 26.6s. Estimated remaining: 1h 22m 17s. Rate: 7.8 symbols/min [2025-10-21T20:41:59.535107] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T20:41:59.604583] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:41:59.604788] [DEBUG] [LOCAL ] PRU: No existing data file found in primary storage. [2025-10-21T20:41:59.604831] [WARN ] [MAIN ] PRU: No existing data found, performing full refresh instead. [2025-10-21T20:41:59.604940] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-10-21T20:41:59.604981] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-10-21T20:41:59.605020] [DEBUG] [LOCAL ] PRU: No primary data file found to delete. [2025-10-21T20:41:59.605052] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-10-21T20:41:59.945383] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:42:00.150991] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-10-21T20:42:00.621588] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-21T20:42:00.951034] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-10-21T20:42:01.751020] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-10. [2025-10-21T20:42:02.120123] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T20:42:02.157890] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-21T20:42:02.551025] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-10-21T20:42:03.205841] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-21T20:42:03.351033] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-10-21T20:42:03.670586] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T20:42:03.678854] [INFO ] [REMOTE ] PRMB: Full fetch complete (76328 records). [2025-10-21T20:42:03.679007] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-10-21T20:42:04.096092] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-10-21T20:42:04.096419] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-10-21T20:42:04.097730] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-10-21T20:42:04.097946] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-10-21T20:42:04.099461] [DEBUG] [LOCAL ] PRMB: Trimmed 76328 records to 53109 (keeping 200 days of data) [2025-10-21T20:42:04.156002] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-10-21T20:42:04.442086] [DEBUG] [LOCAL ] PRMB: Primary data saved (53109 records). [2025-10-21T20:42:04.442238] [INFO ] [MAIN ] PRMB: Full history saved. [2025-10-21T20:42:04.443325] [INFO ] [MAIN ] Update Progress: 1727/2366 symbols completed. PRMB took 33.2s. Estimated remaining: 1h 22m 9s. Rate: 7.8 symbols/min [2025-10-21T20:42:04.641450] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:42:04.641685] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-10-21T20:42:04.641739] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-10-21T20:42:04.641906] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-10-21T20:42:04.641979] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-21T20:42:04.642075] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-21T20:42:04.642129] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-10-21T20:42:04.803477] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T20:42:04.957248] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-10-21T20:42:04.977785] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T20:42:05.049017] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:42:05.751092] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-10-21T20:42:06.359545] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T20:42:06.551072] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-10-21T20:42:07.351009] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-10-21T20:42:07.593123] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T20:42:07.852155] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T20:42:08.017478] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T20:42:08.151041] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-10-21T20:42:08.634698] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T20:42:08.951036] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-10-21T20:42:09.426892] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T20:42:09.751012] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-10-21T20:42:10.258457] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-21T20:42:10.551143] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-10-21T20:42:11.351071] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-10-21T20:42:11.710922] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T20:42:11.795907] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-21T20:42:12.151106] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-10-21T20:42:12.889982] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T20:42:12.951001] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-10-21T20:42:13.751053] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-10-21T20:42:14.220974] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-21T20:42:14.550993] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-10-21T20:42:14.881502] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T20:42:14.894078] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-21T20:42:15.351081] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-10. [2025-10-21T20:42:16.151164] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-10-21T20:42:16.546938] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T20:42:16.550512] [INFO ] [REMOTE ] PRSU: Full fetch complete (34407 records). [2025-10-21T20:42:16.550619] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-10-21T20:42:16.945481] [DEBUG] [VALIDATOR ] PRSU: All expected trading days are present. [2025-10-21T20:42:16.945552] [DEBUG] [VALIDATOR ] PRSU: Primary data validation passed. [2025-10-21T20:42:16.946226] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-10-21T20:42:16.946286] [DEBUG] [LOCAL ] PRSU: Saving primary data. [2025-10-21T20:42:16.947020] [DEBUG] [LOCAL ] PRSU: Trimmed 34407 records to 23232 (keeping 200 days of data) [2025-10-21T20:42:16.993845] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-10-21T20:42:17.034769] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T20:42:17.087262] [DEBUG] [LOCAL ] PRSU: Primary data saved (23232 records). [2025-10-21T20:42:17.087381] [INFO ] [MAIN ] PRSU: Full history saved. [2025-10-21T20:42:17.087448] [INFO ] [MAIN ] Update Progress: 1728/2366 symbols completed. PRSU took 31.5s. Estimated remaining: 1h 22m 3s. Rate: 7.8 symbols/min [2025-10-21T20:42:17.252727] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:42:17.252898] [DEBUG] [LOCAL ] PSA: No existing data file found in primary storage. [2025-10-21T20:42:17.252934] [WARN ] [MAIN ] PSA: No existing data found, performing full refresh instead. [2025-10-21T20:42:17.253042] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-10-21T20:42:17.253081] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-10-21T20:42:17.253121] [DEBUG] [LOCAL ] PSA: No primary data file found to delete. [2025-10-21T20:42:17.253151] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-10-21T20:42:17.532914] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-21T20:42:17.609947] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:42:17.750993] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-10-21T20:42:18.234023] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T20:42:18.551037] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-10-21T20:42:19.351045] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-10. [2025-10-21T20:42:19.769527] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-21T20:42:19.770275] [INFO ] [REMOTE ] PRVS: Full fetch complete (1236 records). [2025-10-21T20:42:19.770340] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-10-21T20:42:19.944820] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-21T20:42:19.945023] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:42:19.945091] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:42:19.945165] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-10-21T20:42:19.945229] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-10-21T20:42:19.945264] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-10-21T20:42:19.945301] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-10-21T20:42:19.945374] [INFO ] [MAIN ] Update Progress: 1729/2366 symbols completed. PRVS took 15.5s. Estimated remaining: 1h 21m 53s. Rate: 7.8 symbols/min [2025-10-21T20:42:20.118454] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:42:20.129830] [DEBUG] [LOCAL ] PSBD: Loaded 8153 existing records from primary storage. [2025-10-21T20:42:20.130052] [INFO ] [MAIN ] PSBD: Loaded 8153 existing records. [2025-10-21T20:42:20.161354] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-10-21T20:42:20.312807] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:42:20.313131] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-10-21T20:42:20.313197] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-10-21T20:42:20.313413] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-10-21T20:42:20.313469] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-10-21T20:42:20.678497] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:42:20.712453] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-21T20:42:20.951032] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-10-21T20:42:21.751038] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-10-21T20:42:21.879118] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T20:42:22.550996] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-10-21T20:42:22.790053] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T20:42:22.975883] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T20:42:23.067071] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-21T20:42:23.351096] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-10-21T20:42:24.151066] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-10-21T20:42:24.870777] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T20:42:24.929407] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T20:42:24.950996] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-10-21T20:42:25.751039] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-10-21T20:42:26.551053] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-10-21T20:42:26.598177] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T20:42:26.624728] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T20:42:27.332032] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T20:42:27.351001] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-10-21T20:42:28.151063] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-10-21T20:42:28.932147] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T20:42:28.950974] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-10-21T20:42:29.230761] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T20:42:29.751043] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-10-21T20:42:29.942129] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T20:42:30.551092] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-10-21T20:42:31.346379] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T20:42:31.350967] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-10-21T20:42:31.532838] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T20:42:32.151065] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-10-21T20:42:32.268365] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-21T20:42:32.951020] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-10-21T20:42:32.957676] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T20:42:33.751085] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-10. [2025-10-21T20:42:34.538755] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T20:42:34.540616] [INFO ] [REMOTE ] PRT: Full fetch complete (8591 records). [2025-10-21T20:42:34.540744] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-10-21T20:42:34.557832] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-10-21T20:42:35.052104] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-10-21T20:42:35.071797] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-10-21T20:42:35.075409] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-10-21T20:42:35.076345] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-10-21T20:42:35.078661] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-21T20:42:35.089836] [DEBUG] [LOCAL ] PRT: Trimmed 8591 records to 5138 (keeping 200 days of data) [2025-10-21T20:42:35.138706] [DEBUG] [LOCAL ] PRT: Primary data saved (5138 records). [2025-10-21T20:42:35.138876] [INFO ] [MAIN ] PRT: Full history saved. [2025-10-21T20:42:35.138979] [INFO ] [MAIN ] Update Progress: 1730/2366 symbols completed. PRT took 42.3s. Estimated remaining: 1h 21m 48s. Rate: 7.8 symbols/min [2025-10-21T20:42:35.330118] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:42:35.342865] [DEBUG] [LOCAL ] PSF: Loaded 7015 existing records from primary storage. [2025-10-21T20:42:35.343080] [INFO ] [MAIN ] PSF: Loaded 7015 existing records. [2025-10-21T20:42:35.356157] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-10-21T20:42:35.553055] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:42:35.553266] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-10-21T20:42:35.553314] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-10-21T20:42:35.553480] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-10-21T20:42:35.553536] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-10-21T20:42:35.913905] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:42:36.150998] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-10-21T20:42:36.337808] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T20:42:36.950991] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-10-21T20:42:36.967062] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T20:42:37.473496] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T20:42:37.750979] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-10-21T20:42:37.984847] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T20:42:38.551009] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-10-21T20:42:38.660585] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T20:42:39.351069] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-10-21T20:42:40.034633] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-21T20:42:40.150990] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-10-21T20:42:40.384461] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T20:42:40.951081] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-10. [2025-10-21T20:42:41.751004] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-10-21T20:42:41.861512] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T20:42:41.864589] [INFO ] [REMOTE ] PSBD: Full fetch complete (10874 records). [2025-10-21T20:42:41.864688] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-10-21T20:42:42.270702] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-10-21T20:42:42.270943] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-10-21T20:42:42.271272] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-10-21T20:42:42.271462] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-10-21T20:42:42.273621] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-21T20:42:42.283266] [DEBUG] [LOCAL ] PSBD: Trimmed 10874 records to 8213 (keeping 200 days of data) [2025-10-21T20:42:42.332978] [DEBUG] [LOCAL ] PSBD: Primary data saved (8213 records). [2025-10-21T20:42:42.333108] [INFO ] [MAIN ] PSBD: Full history saved. [2025-10-21T20:42:42.333184] [INFO ] [MAIN ] Update Progress: 1731/2366 symbols completed. PSBD took 22.4s. Estimated remaining: 1h 21m 40s. Rate: 7.8 symbols/min [2025-10-21T20:42:42.501693] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:42:42.530911] [DEBUG] [LOCAL ] PSFE: Loaded 29874 existing records from primary storage. [2025-10-21T20:42:42.531161] [INFO ] [MAIN ] PSFE: Loaded 29874 existing records. [2025-10-21T20:42:42.561982] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-10-21T20:42:42.711152] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:42:42.711336] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-10-21T20:42:42.711382] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-10-21T20:42:42.711572] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-10-21T20:42:42.711626] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-10-21T20:42:43.067878] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:42:43.351020] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-10-21T20:42:43.613515] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T20:42:43.891271] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T20:42:44.151016] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-10. [2025-10-21T20:42:44.620700] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T20:42:44.951040] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-10-21T20:42:45.751028] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-10-21T20:42:45.949382] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T20:42:45.957566] [INFO ] [REMOTE ] PRU: Full fetch complete (74553 records). [2025-10-21T20:42:45.957754] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-10-21T20:42:46.358454] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-10-21T20:42:46.358591] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-10-21T20:42:46.359857] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-10-21T20:42:46.359927] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-10-21T20:42:46.361504] [DEBUG] [LOCAL ] PRU: Trimmed 74553 records to 51187 (keeping 200 days of data) [2025-10-21T20:42:46.554593] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-10-21T20:42:46.584157] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T20:42:46.690785] [DEBUG] [LOCAL ] PRU: Primary data saved (51187 records). [2025-10-21T20:42:46.690993] [INFO ] [MAIN ] PRU: Full history saved. [2025-10-21T20:42:46.691096] [INFO ] [MAIN ] Update Progress: 1732/2366 symbols completed. PRU took 47.3s. Estimated remaining: 1h 21m 31s. Rate: 7.8 symbols/min [2025-10-21T20:42:46.887786] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:42:46.888724] [DEBUG] [LOCAL ] PSN: No existing data file found in primary storage. [2025-10-21T20:42:46.890496] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T20:42:46.890588] [WARN ] [MAIN ] PSN: No existing data found, performing full refresh instead. [2025-10-21T20:42:46.899123] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-10-21T20:42:46.899385] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-10-21T20:42:46.899767] [DEBUG] [LOCAL ] PSN: No primary data file found to delete. [2025-10-21T20:42:46.899982] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-10-21T20:42:47.248747] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:42:47.350977] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-10-21T20:42:47.959672] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T20:42:48.151075] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-10-21T20:42:48.951100] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-10-21T20:42:49.307997] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T20:42:49.593706] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T20:42:49.751068] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-10-21T20:42:49.769334] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T20:42:50.551049] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-10-21T20:42:51.351044] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-10-21T20:42:51.475135] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T20:42:51.568419] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T20:42:51.934472] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T20:42:52.151105] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-10. [2025-10-21T20:42:52.951106] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-10-21T20:42:53.760452] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-10-21T20:42:53.762801] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T20:42:53.769885] [INFO ] [REMOTE ] PSA: Full fetch complete (59669 records). [2025-10-21T20:42:53.770005] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-10-21T20:42:54.216455] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-10-21T20:42:54.216576] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-10-21T20:42:54.217815] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-10-21T20:42:54.217901] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-10-21T20:42:54.219513] [DEBUG] [LOCAL ] PSA: Trimmed 59669 records to 42179 (keeping 200 days of data) [2025-10-21T20:42:54.495828] [DEBUG] [LOCAL ] PSA: Primary data saved (42179 records). [2025-10-21T20:42:54.496074] [INFO ] [MAIN ] PSA: Full history saved. [2025-10-21T20:42:54.496272] [INFO ] [MAIN ] Update Progress: 1733/2366 symbols completed. PSA took 37.4s. Estimated remaining: 1h 21m 24s. Rate: 7.8 symbols/min [2025-10-21T20:42:54.559127] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-10-21T20:42:54.670168] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:42:54.691399] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T20:42:54.731059] [DEBUG] [LOCAL ] PSO: Loaded 36830 existing records from primary storage. [2025-10-21T20:42:54.731377] [INFO ] [MAIN ] PSO: Loaded 36830 existing records. [2025-10-21T20:42:54.903972] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:42:54.904176] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-10-21T20:42:54.904246] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-10-21T20:42:54.904477] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-10-21T20:42:54.904532] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-10-21T20:42:55.258089] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:42:55.351011] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-10-21T20:42:55.430617] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T20:42:55.733077] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T20:42:56.151049] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-10-21T20:42:56.950996] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-10-21T20:42:57.034291] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T20:42:57.751079] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-10-21T20:42:57.919163] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T20:42:58.426183] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T20:42:58.551052] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-10-21T20:42:59.235338] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T20:42:59.351042] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-10-21T20:43:00.081565] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T20:43:00.151013] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-10-21T20:43:00.951037] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-10-21T20:43:01.028506] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T20:43:01.708098] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T20:43:01.721478] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T20:43:01.751025] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-10-21T20:43:02.551056] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-10-21T20:43:02.841484] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T20:43:03.351061] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-10-21T20:43:04.151059] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-10-21T20:43:04.395113] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T20:43:04.728023] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-21T20:43:04.950986] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-10-21T20:43:05.102208] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T20:43:05.751036] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-10. [2025-10-21T20:43:06.551061] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-10-21T20:43:06.682518] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T20:43:06.752169] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T20:43:06.756422] [INFO ] [REMOTE ] PSFE: Full fetch complete (43010 records). [2025-10-21T20:43:06.756507] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-10-21T20:43:07.132977] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-10-21T20:43:07.133092] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-10-21T20:43:07.133943] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-10-21T20:43:07.134003] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-10-21T20:43:07.134904] [DEBUG] [LOCAL ] PSFE: Trimmed 43010 records to 29751 (keeping 200 days of data) [2025-10-21T20:43:07.306089] [DEBUG] [LOCAL ] PSFE: Primary data saved (29751 records). [2025-10-21T20:43:07.306224] [INFO ] [MAIN ] PSFE: Full history saved. [2025-10-21T20:43:07.306331] [INFO ] [MAIN ] Update Progress: 1734/2366 symbols completed. PSFE took 25.0s. Estimated remaining: 1h 21m 18s. Rate: 7.8 symbols/min [2025-10-21T20:43:07.360236] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-10. [2025-10-21T20:43:07.475678] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:43:07.509727] [DEBUG] [LOCAL ] PSQH: Loaded 35389 existing records from primary storage. [2025-10-21T20:43:07.509992] [INFO ] [MAIN ] PSQH: Loaded 35389 existing records. [2025-10-21T20:43:07.682250] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:43:07.682457] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-10-21T20:43:07.682502] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-10-21T20:43:07.682714] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-10-21T20:43:07.682769] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-10-21T20:43:08.034619] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:43:08.151006] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-10-21T20:43:08.166732] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T20:43:08.168423] [INFO ] [REMOTE ] PSF: Full fetch complete (9694 records). [2025-10-21T20:43:08.168506] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-10-21T20:43:08.299975] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T20:43:08.556633] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-10-21T20:43:08.556739] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-10-21T20:43:08.556961] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-10-21T20:43:08.556999] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-10-21T20:43:08.557404] [DEBUG] [LOCAL ] PSF: Trimmed 9694 records to 6992 (keeping 200 days of data) [2025-10-21T20:43:08.598217] [DEBUG] [LOCAL ] PSF: Primary data saved (6992 records). [2025-10-21T20:43:08.598304] [INFO ] [MAIN ] PSF: Full history saved. [2025-10-21T20:43:08.598380] [INFO ] [MAIN ] Update Progress: 1735/2366 symbols completed. PSF took 33.5s. Estimated remaining: 1h 21m 8s. Rate: 7.8 symbols/min [2025-10-21T20:43:08.763753] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:43:08.763915] [DEBUG] [LOCAL ] PSTG: No existing data file found in primary storage. [2025-10-21T20:43:08.763951] [WARN ] [MAIN ] PSTG: No existing data found, performing full refresh instead. [2025-10-21T20:43:08.764103] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-10-21T20:43:08.764151] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-10-21T20:43:08.764192] [DEBUG] [LOCAL ] PSTG: No primary data file found to delete. [2025-10-21T20:43:08.764222] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-10-21T20:43:08.958276] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-10-21T20:43:09.113215] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:43:09.722441] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T20:43:09.751036] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-10-21T20:43:10.551027] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-10-21T20:43:10.780244] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T20:43:11.351004] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-10-21T20:43:11.713408] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T20:43:12.150999] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-10-21T20:43:12.242359] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T20:43:12.956171] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-10-21T20:43:12.969488] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T20:43:13.751050] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-10-21T20:43:13.870205] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T20:43:14.551012] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-10-21T20:43:14.655163] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T20:43:15.351014] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-10-21T20:43:15.451486] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T20:43:16.151065] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-10-21T20:43:16.227764] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T20:43:16.874575] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T20:43:16.951021] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-10-21T20:43:17.751017] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-10-21T20:43:17.943538] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T20:43:18.350532] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T20:43:18.551029] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-10. [2025-10-21T20:43:19.326919] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T20:43:19.350978] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-10-21T20:43:20.137997] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T20:43:20.145301] [INFO ] [REMOTE ] PSN: Full fetch complete (66932 records). [2025-10-21T20:43:20.145456] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-10-21T20:43:20.157471] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-10-21T20:43:20.535879] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-10-21T20:43:20.535967] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-10-21T20:43:20.537029] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-10-21T20:43:20.537093] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-10-21T20:43:20.538424] [DEBUG] [LOCAL ] PSN: Trimmed 66932 records to 45263 (keeping 200 days of data) [2025-10-21T20:43:20.795746] [DEBUG] [LOCAL ] PSN: Primary data saved (45263 records). [2025-10-21T20:43:20.795881] [INFO ] [MAIN ] PSN: Full history saved. [2025-10-21T20:43:20.795953] [INFO ] [MAIN ] Update Progress: 1736/2366 symbols completed. PSN took 34.1s. Estimated remaining: 1h 21m 2s. Rate: 7.8 symbols/min [2025-10-21T20:43:20.964991] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:43:20.962519] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-10-21T20:43:20.988230] [DEBUG] [LOCAL ] PSTL: Loaded 20025 existing records from primary storage. [2025-10-21T20:43:20.988464] [INFO ] [MAIN ] PSTL: Loaded 20025 existing records. [2025-10-21T20:43:21.175751] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:43:21.176024] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-10-21T20:43:21.176178] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-10-21T20:43:21.176454] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-10-21T20:43:21.176581] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-10-21T20:43:21.521018] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-21T20:43:21.614047] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:43:21.637869] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T20:43:21.750996] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-10-21T20:43:22.235153] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T20:43:22.551073] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-10-21T20:43:23.294710] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T20:43:23.350996] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-10-21T20:43:23.654921] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-21T20:43:24.151056] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-10-21T20:43:24.951004] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-10-21T20:43:25.061839] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T20:43:25.747306] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T20:43:25.753414] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-10-21T20:43:26.030085] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T20:43:26.551023] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-10-21T20:43:27.291574] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T20:43:27.351201] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-10. [2025-10-21T20:43:28.151112] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-10-21T20:43:28.423405] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T20:43:28.921259] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T20:43:28.927409] [INFO ] [REMOTE ] PSO: Full fetch complete (52776 records). [2025-10-21T20:43:28.927517] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-10-21T20:43:28.958984] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-10-21T20:43:29.317720] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-10-21T20:43:29.317814] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-10-21T20:43:29.318951] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-10-21T20:43:29.319015] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-10-21T20:43:29.320150] [DEBUG] [LOCAL ] PSO: Trimmed 52776 records to 36731 (keeping 200 days of data) [2025-10-21T20:43:29.556892] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T20:43:29.589170] [DEBUG] [LOCAL ] PSO: Primary data saved (36731 records). [2025-10-21T20:43:29.589449] [INFO ] [MAIN ] PSO: Full history saved. [2025-10-21T20:43:29.589538] [INFO ] [MAIN ] Update Progress: 1737/2366 symbols completed. PSO took 35.1s. Estimated remaining: 1h 20m 54s. Rate: 7.8 symbols/min [2025-10-21T20:43:29.756358] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-10-21T20:43:29.760420] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:43:29.761439] [DEBUG] [LOCAL ] PSX: No existing data file found in primary storage. [2025-10-21T20:43:29.761487] [WARN ] [MAIN ] PSX: No existing data found, performing full refresh instead. [2025-10-21T20:43:29.761614] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-10-21T20:43:29.761693] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-10-21T20:43:29.761753] [DEBUG] [LOCAL ] PSX: No primary data file found to delete. [2025-10-21T20:43:29.761788] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-10-21T20:43:30.173514] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:43:30.551014] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-10-21T20:43:30.653186] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T20:43:31.178215] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T20:43:31.351098] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-10-21T20:43:32.151032] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-10-21T20:43:32.203394] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T20:43:32.257053] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T20:43:32.951068] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-10-21T20:43:33.751016] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-10-21T20:43:34.104705] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T20:43:34.276764] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T20:43:34.551028] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-10. [2025-10-21T20:43:35.350999] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-10-21T20:43:35.716414] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T20:43:36.029149] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T20:43:36.035402] [INFO ] [REMOTE ] PSQH: Full fetch complete (53301 records). [2025-10-21T20:43:36.035495] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-10-21T20:43:36.156103] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-10-21T20:43:36.413191] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-10-21T20:43:36.413264] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-10-21T20:43:36.414244] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-10-21T20:43:36.414306] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-10-21T20:43:36.415336] [DEBUG] [LOCAL ] PSQH: Trimmed 53301 records to 35346 (keeping 200 days of data) [2025-10-21T20:43:36.607116] [DEBUG] [LOCAL ] PSQH: Primary data saved (35346 records). [2025-10-21T20:43:36.607239] [INFO ] [MAIN ] PSQH: Full history saved. [2025-10-21T20:43:36.607315] [INFO ] [MAIN ] Update Progress: 1738/2366 symbols completed. PSQH took 29.3s. Estimated remaining: 1h 20m 46s. Rate: 7.8 symbols/min [2025-10-21T20:43:36.773219] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:43:36.790109] [DEBUG] [LOCAL ] PTA: Loaded 15320 existing records from primary storage. [2025-10-21T20:43:36.790322] [INFO ] [MAIN ] PTA: Loaded 15320 existing records. [2025-10-21T20:43:36.966704] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:43:36.966921] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-10-21T20:43:36.963863] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-10-21T20:43:36.966973] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-10-21T20:43:36.967989] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-10-21T20:43:36.968046] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-10-21T20:43:37.337924] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:43:37.370098] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T20:43:37.751060] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-10. [2025-10-21T20:43:38.215030] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T20:43:38.272446] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T20:43:38.551044] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-10-21T20:43:39.350990] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-10-21T20:43:39.645966] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T20:43:39.654055] [INFO ] [REMOTE ] PSTG: Full fetch complete (76695 records). [2025-10-21T20:43:39.654170] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-10-21T20:43:39.767114] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T20:43:40.060871] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-10-21T20:43:40.060947] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-10-21T20:43:40.062051] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-10-21T20:43:40.062112] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-10-21T20:43:40.063423] [DEBUG] [LOCAL ] PSTG: Trimmed 76695 records to 52836 (keeping 200 days of data) [2025-10-21T20:43:40.153410] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-10-21T20:43:40.378819] [DEBUG] [LOCAL ] PSTG: Primary data saved (52836 records). [2025-10-21T20:43:40.378942] [INFO ] [MAIN ] PSTG: Full history saved. [2025-10-21T20:43:40.379008] [INFO ] [MAIN ] Update Progress: 1739/2366 symbols completed. PSTG took 31.8s. Estimated remaining: 1h 20m 37s. Rate: 7.8 symbols/min [2025-10-21T20:43:40.557111] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:43:40.595896] [DEBUG] [LOCAL ] PTY: Loaded 37923 existing records from primary storage. [2025-10-21T20:43:40.596161] [INFO ] [MAIN ] PTY: Loaded 37923 existing records. [2025-10-21T20:43:40.728934] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T20:43:40.787976] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:43:40.788166] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-10-21T20:43:40.788219] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-10-21T20:43:40.788393] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-10-21T20:43:40.788430] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-10-21T20:43:40.957404] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-10-21T20:43:41.141523] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:43:41.751044] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-10-21T20:43:41.991494] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T20:43:42.040590] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-21T20:43:42.551075] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-10-21T20:43:43.351087] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-10-21T20:43:43.555777] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T20:43:43.683503] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T20:43:44.151026] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-10-21T20:43:44.951051] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-10-21T20:43:45.400597] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T20:43:45.441217] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T20:43:45.750997] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-10-21T20:43:45.953669] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T20:43:46.551027] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-10-21T20:43:47.023298] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T20:43:47.351098] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-10. [2025-10-21T20:43:48.151065] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-10-21T20:43:48.502217] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T20:43:48.506936] [INFO ] [REMOTE ] PSTL: Full fetch complete (29519 records). [2025-10-21T20:43:48.507264] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-10-21T20:43:48.704482] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-21T20:43:48.925240] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-10-21T20:43:48.925329] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-10-21T20:43:48.926000] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-10-21T20:43:48.926063] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-10-21T20:43:48.926923] [DEBUG] [LOCAL ] PSTL: Trimmed 29519 records to 19964 (keeping 200 days of data) [2025-10-21T20:43:48.976134] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-10-21T20:43:49.046861] [DEBUG] [LOCAL ] PSTL: Primary data saved (19964 records). [2025-10-21T20:43:49.046985] [INFO ] [MAIN ] PSTL: Full history saved. [2025-10-21T20:43:49.047063] [INFO ] [MAIN ] Update Progress: 1740/2366 symbols completed. PSTL took 28.3s. Estimated remaining: 1h 20m 30s. Rate: 7.8 symbols/min [2025-10-21T20:43:49.214403] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:43:49.257132] [DEBUG] [LOCAL ] PUK: Loaded 44463 existing records from primary storage. [2025-10-21T20:43:49.257419] [INFO ] [MAIN ] PUK: Loaded 44463 existing records. [2025-10-21T20:43:49.433663] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:43:49.433869] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-10-21T20:43:49.433922] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-10-21T20:43:49.434107] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-10-21T20:43:49.434147] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-10-21T20:43:49.784635] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:43:49.758286] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-10-21T20:43:49.904382] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T20:43:50.551005] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-10-21T20:43:50.867930] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T20:43:50.905616] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T20:43:51.350998] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-10-21T20:43:52.151028] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-10-21T20:43:52.389768] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T20:43:52.475100] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T20:43:52.951035] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-10-21T20:43:53.751076] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-10-21T20:43:54.200128] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T20:43:54.493028] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T20:43:54.551019] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-10-21T20:43:55.351006] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-10-21T20:43:55.403254] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T20:43:56.151039] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-10-21T20:43:56.918064] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-21T20:43:56.953354] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T20:43:56.951389] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-10-21T20:43:57.685628] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T20:43:57.751075] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-10-21T20:43:57.886209] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T20:43:58.551108] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-10-21T20:43:59.239295] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-21T20:43:59.351001] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-10-21T20:43:59.628302] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T20:44:00.151077] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-10-21T20:44:00.378797] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T20:44:00.951092] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-10-21T20:44:01.763508] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-10-21T20:44:01.766808] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T20:44:02.078564] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T20:44:02.551048] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-10-21T20:44:03.351093] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-10-21T20:44:03.691675] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T20:44:04.067097] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T20:44:04.150984] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-10-21T20:44:04.471728] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T20:44:04.951021] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-10. [2025-10-21T20:44:05.688940] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T20:44:05.750980] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-10. [2025-10-21T20:44:06.550990] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-10. [2025-10-21T20:44:07.017796] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T20:44:07.026701] [INFO ] [REMOTE ] PSX: Full fetch complete (77144 records). [2025-10-21T20:44:07.026840] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-10-21T20:44:07.359589] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-10-21T20:44:07.403984] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T20:44:07.458225] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-10-21T20:44:07.458399] [INFO ] [REMOTE ] PTY: Full fetch complete (54488 records). [2025-10-21T20:44:07.458470] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-10-21T20:44:07.458703] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-10-21T20:44:07.459859] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-10-21T20:44:07.460294] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-10-21T20:44:07.528236] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T20:44:07.580065] [INFO ] [REMOTE ] PTA: Full fetch complete (22760 records). [2025-10-21T20:44:07.580305] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-10-21T20:44:07.580712] [DEBUG] [LOCAL ] PSX: Trimmed 77144 records to 53132 (keeping 200 days of data) [2025-10-21T20:44:08.428171] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-10-21T20:44:08.428401] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-10-21T20:44:08.466977] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-10-21T20:44:08.483512] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-10-21T20:44:08.586235] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-10-21T20:44:08.591187] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-10-21T20:44:08.599415] [DEBUG] [LOCAL ] PSX: Primary data saved (53132 records). [2025-10-21T20:44:08.593913] [DEBUG] [LOCAL ] PTY: Trimmed 54488 records to 37954 (keeping 200 days of data) [2025-10-21T20:44:08.595913] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-10-21T20:44:08.600038] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-10-21T20:44:08.599682] [INFO ] [MAIN ] PSX: Full history saved. [2025-10-21T20:44:08.600769] [INFO ] [MAIN ] Update Progress: 1741/2366 symbols completed. PSX took 39.0s. Estimated remaining: 1h 20m 26s. Rate: 7.8 symbols/min [2025-10-21T20:44:08.622262] [DEBUG] [LOCAL ] PTA: Trimmed 22760 records to 15492 (keeping 200 days of data) [2025-10-21T20:44:08.963825] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:44:08.969804] [DEBUG] [LOCAL ] PUMP: No existing data file found in primary storage. [2025-10-21T20:44:08.976830] [WARN ] [MAIN ] PUMP: No existing data found, performing full refresh instead. [2025-10-21T20:44:09.027100] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-10-21T20:44:09.036073] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-10-21T20:44:09.059896] [DEBUG] [LOCAL ] PUMP: No primary data file found to delete. [2025-10-21T20:44:09.077662] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-10-21T20:44:09.141512] [DEBUG] [LOCAL ] PTA: Primary data saved (15492 records). [2025-10-21T20:44:09.173033] [DEBUG] [LOCAL ] PTY: Primary data saved (37954 records). [2025-10-21T20:44:09.173160] [INFO ] [MAIN ] PTA: Full history saved. [2025-10-21T20:44:09.188839] [INFO ] [MAIN ] Update Progress: 1742/2366 symbols completed. PTA took 32.6s. Estimated remaining: 1h 20m 16s. Rate: 7.8 symbols/min [2025-10-21T20:44:09.188739] [INFO ] [MAIN ] PTY: Full history saved. [2025-10-21T20:44:09.234337] [INFO ] [MAIN ] Update Progress: 1743/2366 symbols completed. PTY took 28.9s. Estimated remaining: 1h 20m 6s. Rate: 7.8 symbols/min [2025-10-21T20:44:09.742565] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-21T20:44:09.773102] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:44:09.850085] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:44:09.840581] [DEBUG] [LOCAL ] PVH: No existing data file found in primary storage. [2025-10-21T20:44:09.872635] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-10-21T20:44:09.872043] [WARN ] [MAIN ] PVH: No existing data found, performing full refresh instead. [2025-10-21T20:44:09.904062] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-10-21T20:44:09.930897] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:44:09.925280] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-10-21T20:44:09.931513] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-10-21T20:44:09.931600] [DEBUG] [LOCAL ] PVH: No primary data file found to delete. [2025-10-21T20:44:09.935593] [DEBUG] [LOCAL ] PVL: Loaded 4742 existing records from primary storage. [2025-10-21T20:44:09.936092] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-10-21T20:44:09.936292] [INFO ] [MAIN ] PVL: Loaded 4742 existing records. [2025-10-21T20:44:10.400534] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:44:10.401045] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-10-21T20:44:10.406460] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-10-21T20:44:10.427200] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-10-21T20:44:10.440054] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-10-21T20:44:10.578775] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:44:10.579074] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-10-21T20:44:10.829915] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:44:10.830216] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-10-21T20:44:11.619473] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T20:44:11.621303] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-10-21T20:44:11.692003] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T20:44:11.750460] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T20:44:12.123535] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T20:44:12.151447] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-10-21T20:44:12.153179] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T20:44:12.951081] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-10-21T20:44:13.751032] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-10-21T20:44:13.922428] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T20:44:13.946794] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T20:44:14.551041] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-10-21T20:44:15.351002] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-10-21T20:44:15.507979] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T20:44:16.151011] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-10-21T20:44:16.464963] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T20:44:16.784528] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T20:44:16.951023] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-10-21T20:44:17.751078] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-10-21T20:44:18.009499] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T20:44:18.551062] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-10-21T20:44:18.629616] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T20:44:19.042129] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-21T20:44:19.351047] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-10-21T20:44:19.386524] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T20:44:20.151130] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-10-21T20:44:20.951057] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-10-21T20:44:21.102049] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T20:44:21.666544] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T20:44:21.751067] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-10-21T20:44:21.988758] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:44:22.551026] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-10. [2025-10-21T20:44:23.351061] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-10-21T20:44:23.524954] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T20:44:23.946888] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T20:44:23.999184] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T20:44:24.006069] [INFO ] [REMOTE ] PUK: Full fetch complete (65308 records). [2025-10-21T20:44:24.006169] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-10-21T20:44:24.156135] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-10-21T20:44:24.394571] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-10-21T20:44:24.394705] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-10-21T20:44:24.395773] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-10-21T20:44:24.395836] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-10-21T20:44:24.397104] [DEBUG] [LOCAL ] PUK: Trimmed 65308 records to 44388 (keeping 200 days of data) [2025-10-21T20:44:24.657228] [DEBUG] [LOCAL ] PUK: Primary data saved (44388 records). [2025-10-21T20:44:24.657410] [INFO ] [MAIN ] PUK: Full history saved. [2025-10-21T20:44:24.658276] [INFO ] [MAIN ] Update Progress: 1744/2366 symbols completed. PUK took 35.6s. Estimated remaining: 1h 20m 1s. Rate: 7.8 symbols/min [2025-10-21T20:44:24.824553] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:44:24.824771] [DEBUG] [LOCAL ] PWR: No existing data file found in primary storage. [2025-10-21T20:44:24.824816] [WARN ] [MAIN ] PWR: No existing data found, performing full refresh instead. [2025-10-21T20:44:24.824922] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-10-21T20:44:24.824963] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-10-21T20:44:24.825003] [DEBUG] [LOCAL ] PWR: No primary data file found to delete. [2025-10-21T20:44:24.825035] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-10-21T20:44:24.956175] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-10-21T20:44:25.048925] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-21T20:44:25.201590] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:44:25.751042] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-10-21T20:44:26.551065] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-10-21T20:44:26.975016] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T20:44:27.351077] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-10-21T20:44:27.647510] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T20:44:28.151074] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-10-21T20:44:28.265946] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T20:44:28.867181] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T20:44:28.951045] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-10-21T20:44:29.317520] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-21T20:44:29.751103] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-10-21T20:44:30.550991] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-10-21T20:44:30.583302] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T20:44:31.351006] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-10-21T20:44:31.758130] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-21T20:44:32.110819] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T20:44:32.150985] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-10-21T20:44:32.951009] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-10-21T20:44:33.059066] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T20:44:33.751003] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-10-21T20:44:33.992378] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:44:34.551020] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-10. [2025-10-21T20:44:34.561467] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T20:44:34.939196] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T20:44:35.351033] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-10-21T20:44:36.151058] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-10-21T20:44:36.223902] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T20:44:36.230743] [INFO ] [REMOTE ] PVH: Full fetch complete (70905 records). [2025-10-21T20:44:36.230869] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-10-21T20:44:36.620011] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-10-21T20:44:36.620078] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-10-21T20:44:36.621270] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-10-21T20:44:36.621338] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-10-21T20:44:36.622781] [DEBUG] [LOCAL ] PVH: Trimmed 70905 records to 49613 (keeping 200 days of data) [2025-10-21T20:44:36.940261] [DEBUG] [LOCAL ] PVH: Primary data saved (49613 records). [2025-10-21T20:44:36.940429] [INFO ] [MAIN ] PVH: Full history saved. [2025-10-21T20:44:36.940541] [INFO ] [MAIN ] Update Progress: 1745/2366 symbols completed. PVH took 27.8s. Estimated remaining: 1h 19m 55s. Rate: 7.8 symbols/min [2025-10-21T20:44:36.968775] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-10. [2025-10-21T20:44:37.157789] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:44:37.206935] [DEBUG] [LOCAL ] PX: Loaded 34272 existing records from primary storage. [2025-10-21T20:44:37.207307] [INFO ] [MAIN ] PX: Loaded 34272 existing records. [2025-10-21T20:44:37.482685] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:44:37.483084] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-10-21T20:44:37.483255] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-10-21T20:44:37.483586] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-10-21T20:44:37.483693] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-10-21T20:44:37.723465] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-10-21T20:44:37.777861] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-10-21T20:44:37.793376] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T20:44:37.812697] [INFO ] [REMOTE ] PVL: Full fetch complete (7059 records). [2025-10-21T20:44:37.824892] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-10-21T20:44:38.276559] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:44:38.454263] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-10-21T20:44:38.454460] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-10-21T20:44:38.454790] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-10-21T20:44:38.455072] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-10-21T20:44:38.457701] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-21T20:44:38.458353] [DEBUG] [LOCAL ] PVL: Trimmed 7059 records to 4717 (keeping 200 days of data) [2025-10-21T20:44:38.496443] [DEBUG] [LOCAL ] PVL: Primary data saved (4717 records). [2025-10-21T20:44:38.496574] [INFO ] [MAIN ] PVL: Full history saved. [2025-10-21T20:44:38.496702] [INFO ] [MAIN ] Update Progress: 1746/2366 symbols completed. PVL took 29.3s. Estimated remaining: 1h 19m 45s. Rate: 7.8 symbols/min [2025-10-21T20:44:38.558782] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-10-21T20:44:38.699739] [INFO ] [MAIN ] PXED: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:44:38.699929] [DEBUG] [LOCAL ] PXED: No existing data file found in primary storage. [2025-10-21T20:44:38.699976] [WARN ] [MAIN ] PXED: No existing data found, performing full refresh instead. [2025-10-21T20:44:38.700088] [INFO ] [MAIN ] PXED: Wiping existing primary data before full refresh. [2025-10-21T20:44:38.700152] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-21T20:44:38.700211] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-21T20:44:38.700276] [INFO ] [MAIN ] PXED: Starting full primary refresh. [2025-10-21T20:44:39.069045] [INFO ] [REMOTE ] PXED: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:44:39.351040] [INFO ] [REMOTE ] PXED: Fetching primary data for 2025-01. [2025-10-21T20:44:39.690564] [DEBUG] [REMOTE ] PXED: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:44:39.705268] [WARN ] [REMOTE ] PXED: No data returned for month 2025-01 [2025-10-21T20:44:39.706861] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T20:44:39.706923] [FATAL] [REMOTE ] PXED: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:44:39.710691] [FATAL] [MAIN ] PXED: Failed to fetch primary data. [2025-10-21T20:44:39.716802] [WARN ] [MAIN ] PXED: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:44:39.717209] [INFO ] [LOCAL ] PXED: Starting deletion of primary data. [2025-10-21T20:44:39.717396] [DEBUG] [LOCAL ] PXED: No primary data file found to delete. [2025-10-21T20:44:39.717444] [INFO ] [LOCAL ] PXED: Starting deletion of derivative data. [2025-10-21T20:44:39.717856] [DEBUG] [LOCAL ] PXED: No derivative data file found to delete. [2025-10-21T20:44:39.717919] [INFO ] [MAIN ] Update Progress: 1747/2366 symbols completed. PXED took 1.2s. Estimated remaining: 1h 19m 35s. Rate: 7.8 symbols/min [2025-10-21T20:44:39.888254] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:44:39.888423] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-10-21T20:44:39.888464] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-10-21T20:44:39.888587] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-10-21T20:44:39.888637] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-21T20:44:39.888728] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-21T20:44:39.888764] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-10-21T20:44:40.156168] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-10-21T20:44:40.274975] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:44:40.503153] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T20:44:40.951047] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-10. [2025-10-21T20:44:41.710013] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T20:44:41.751042] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-10-21T20:44:42.550988] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-10-21T20:44:42.639463] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T20:44:42.647193] [INFO ] [REMOTE ] PUMP: Full fetch complete (71705 records). [2025-10-21T20:44:42.647323] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-10-21T20:44:43.031279] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-10-21T20:44:43.031364] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-10-21T20:44:43.032450] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-10-21T20:44:43.032516] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-10-21T20:44:43.033895] [DEBUG] [LOCAL ] PUMP: Trimmed 71705 records to 49434 (keeping 200 days of data) [2025-10-21T20:44:43.304860] [DEBUG] [LOCAL ] PUMP: Primary data saved (49434 records). [2025-10-21T20:44:43.304981] [INFO ] [MAIN ] PUMP: Full history saved. [2025-10-21T20:44:43.305062] [INFO ] [MAIN ] Update Progress: 1748/2366 symbols completed. PUMP took 34.7s. Estimated remaining: 1h 19m 26s. Rate: 7.8 symbols/min [2025-10-21T20:44:43.367981] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-10-21T20:44:43.475167] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:44:43.501488] [DEBUG] [LOCAL ] QD: Loaded 27590 existing records from primary storage. [2025-10-21T20:44:43.501747] [INFO ] [MAIN ] QD: Loaded 27590 existing records. [2025-10-21T20:44:43.680319] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:44:43.680610] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-10-21T20:44:43.680700] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-10-21T20:44:43.689694] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-10-21T20:44:43.702285] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-10-21T20:44:43.775208] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T20:44:44.080901] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:44:44.102476] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T20:44:44.150982] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-10-21T20:44:44.951061] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-10-21T20:44:45.667081] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T20:44:45.750983] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-10-21T20:44:45.859838] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-21T20:44:46.551079] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-10-21T20:44:47.029005] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-21T20:44:47.351060] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-10-21T20:44:47.385163] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T20:44:47.782845] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T20:44:48.151100] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-10-21T20:44:48.951067] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-10-21T20:44:49.751059] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-10-21T20:44:49.928486] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-10-21T20:44:50.013586] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T20:44:50.442685] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T20:44:50.550992] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-10-21T20:44:51.054155] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T20:44:51.351078] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-10-21T20:44:52.151094] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-10-21T20:44:52.255155] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T20:44:52.736031] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T20:44:52.951107] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-10-21T20:44:53.751074] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-10-21T20:44:54.551010] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-10-21T20:44:54.621930] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T20:44:55.017555] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-10-21T20:44:55.090849] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T20:44:55.351021] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-10-21T20:44:56.151019] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-10-21T20:44:56.455043] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T20:44:56.646533] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T20:44:56.951035] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-10-21T20:44:57.566077] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T20:44:57.751001] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-10. [2025-10-21T20:44:58.122816] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T20:44:58.551082] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-10-21T20:44:59.351062] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-10-21T20:44:59.623626] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T20:44:59.630525] [INFO ] [REMOTE ] PWR: Full fetch complete (69123 records). [2025-10-21T20:44:59.630676] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-10-21T20:45:00.044322] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-10-21T20:45:00.021217] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T20:45:00.050108] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-10-21T20:45:00.051678] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-10-21T20:45:00.051875] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-10-21T20:45:00.053302] [DEBUG] [LOCAL ] PWR: Trimmed 69123 records to 46503 (keeping 200 days of data) [2025-10-21T20:45:00.151219] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-10. [2025-10-21T20:45:00.358161] [DEBUG] [LOCAL ] PWR: Primary data saved (46503 records). [2025-10-21T20:45:00.358309] [INFO ] [MAIN ] PWR: Full history saved. [2025-10-21T20:45:00.358407] [INFO ] [MAIN ] Update Progress: 1749/2366 symbols completed. PWR took 35.7s. Estimated remaining: 1h 19m 21s. Rate: 7.8 symbols/min [2025-10-21T20:45:00.539757] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:45:00.583302] [DEBUG] [LOCAL ] QGEN: Loaded 49088 existing records from primary storage. [2025-10-21T20:45:00.583596] [INFO ] [MAIN ] QGEN: Loaded 49088 existing records. [2025-10-21T20:45:00.785799] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T20:45:00.792076] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:45:00.792314] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-10-21T20:45:00.792425] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-10-21T20:45:00.798785] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-10-21T20:45:00.798850] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-10-21T20:45:00.957147] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-10-21T20:45:01.203676] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:45:01.461196] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T20:45:01.465809] [INFO ] [REMOTE ] PX: Full fetch complete (49877 records). [2025-10-21T20:45:01.465943] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-10-21T20:45:01.756221] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-10-21T20:45:01.904078] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-10-21T20:45:01.904170] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-10-21T20:45:01.905126] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-10-21T20:45:01.905194] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-10-21T20:45:01.906437] [DEBUG] [LOCAL ] PX: Trimmed 49877 records to 34132 (keeping 200 days of data) [2025-10-21T20:45:02.164072] [DEBUG] [LOCAL ] PX: Primary data saved (34132 records). [2025-10-21T20:45:02.164237] [INFO ] [MAIN ] PX: Full history saved. [2025-10-21T20:45:02.164360] [INFO ] [MAIN ] Update Progress: 1750/2366 symbols completed. PX took 25.2s. Estimated remaining: 1h 19m 11s. Rate: 7.8 symbols/min [2025-10-21T20:45:02.351193] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:45:02.351364] [DEBUG] [LOCAL ] QS: No existing data file found in primary storage. [2025-10-21T20:45:02.351401] [WARN ] [MAIN ] QS: No existing data found, performing full refresh instead. [2025-10-21T20:45:02.351548] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-10-21T20:45:02.351612] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-10-21T20:45:02.351692] [DEBUG] [LOCAL ] QS: No primary data file found to delete. [2025-10-21T20:45:02.351742] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-10-21T20:45:02.556429] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-10-21T20:45:02.758379] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:45:03.351003] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-10-21T20:45:03.604365] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T20:45:03.968636] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-10-21T20:45:04.151010] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-10-21T20:45:04.203934] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T20:45:04.951088] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-10-21T20:45:05.751080] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-10-21T20:45:05.827743] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-21T20:45:05.989382] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T20:45:06.053410] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-21T20:45:06.551129] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-10-21T20:45:07.351015] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-10-21T20:45:08.151028] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-10. [2025-10-21T20:45:08.596980] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-21T20:45:08.697968] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-21T20:45:08.929342] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T20:45:08.950980] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-10-21T20:45:09.454882] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-21T20:45:09.459211] [INFO ] [REMOTE ] QD: Full fetch complete (40002 records). [2025-10-21T20:45:09.459300] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-10-21T20:45:09.756257] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-10-21T20:45:09.833590] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-10-21T20:45:09.833773] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-10-21T20:45:09.834591] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-10-21T20:45:09.834632] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-10-21T20:45:09.835614] [DEBUG] [LOCAL ] QD: Trimmed 40002 records to 27677 (keeping 200 days of data) [2025-10-21T20:45:09.984377] [DEBUG] [LOCAL ] QD: Primary data saved (27677 records). [2025-10-21T20:45:09.984502] [INFO ] [MAIN ] QD: Full history saved. [2025-10-21T20:45:09.984577] [INFO ] [MAIN ] Update Progress: 1751/2366 symbols completed. QD took 26.7s. Estimated remaining: 1h 19m 4s. Rate: 7.8 symbols/min [2025-10-21T20:45:10.151915] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:45:10.202232] [DEBUG] [LOCAL ] QSR: Loaded 52497 existing records from primary storage. [2025-10-21T20:45:10.202539] [INFO ] [MAIN ] QSR: Loaded 52497 existing records. [2025-10-21T20:45:10.378002] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:45:10.378224] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-10-21T20:45:10.378289] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-10-21T20:45:10.378470] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-10-21T20:45:10.378528] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-10-21T20:45:10.560691] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-10-21T20:45:10.736202] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:45:11.259771] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-21T20:45:11.351006] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-10-21T20:45:12.151011] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-10-21T20:45:12.310780] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-21T20:45:12.951022] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-10-21T20:45:13.206595] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-10-21T20:45:13.522221] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-21T20:45:13.751001] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-10-21T20:45:14.066105] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T20:45:14.551034] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-10-21T20:45:15.236155] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T20:45:15.351010] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-10-21T20:45:16.151008] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-10-21T20:45:16.323637] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T20:45:16.443307] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-21T20:45:16.951028] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-10-21T20:45:17.728498] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-21T20:45:17.750986] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-10-21T20:45:17.964534] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T20:45:18.551005] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-10-21T20:45:18.886999] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T20:45:19.351032] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-10-21T20:45:20.151155] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-10-21T20:45:20.181356] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-21T20:45:20.487855] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T20:45:20.951075] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-10-21T20:45:21.751060] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-10-21T20:45:22.284353] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T20:45:22.330062] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-10-21T20:45:22.551053] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-10-21T20:45:22.918191] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T20:45:23.351097] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-10-21T20:45:24.151088] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-10-21T20:45:24.395674] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:45:24.529408] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-10-21T20:45:24.951013] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-10. [2025-10-21T20:45:25.222542] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T20:45:25.751045] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-10-21T20:45:26.333049] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T20:45:26.340624] [INFO ] [REMOTE ] QGEN: Full fetch complete (70562 records). [2025-10-21T20:45:26.340842] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-10-21T20:45:26.557969] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-10-21T20:45:26.737807] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-10-21T20:45:26.737892] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-10-21T20:45:26.738976] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-10-21T20:45:26.739039] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-10-21T20:45:26.740476] [DEBUG] [LOCAL ] QGEN: Trimmed 70562 records to 49069 (keeping 200 days of data) [2025-10-21T20:45:27.035222] [DEBUG] [LOCAL ] QGEN: Primary data saved (49069 records). [2025-10-21T20:45:27.035476] [INFO ] [MAIN ] QGEN: Full history saved. [2025-10-21T20:45:27.036171] [INFO ] [MAIN ] Update Progress: 1752/2366 symbols completed. QGEN took 26.7s. Estimated remaining: 1h 18m 59s. Rate: 7.8 symbols/min [2025-10-21T20:45:27.244924] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:45:27.248150] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (3.10 seconds). [2025-10-21T20:45:27.293947] [DEBUG] [LOCAL ] QTWO: Loaded 39535 existing records from primary storage. [2025-10-21T20:45:27.294245] [INFO ] [MAIN ] QTWO: Loaded 39535 existing records. [2025-10-21T20:45:27.359949] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-10. [2025-10-21T20:45:27.473706] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:45:27.473905] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-10-21T20:45:27.473953] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-10-21T20:45:27.474214] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-10-21T20:45:27.474269] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-10-21T20:45:27.829284] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:45:27.913342] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-21T20:45:28.151001] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-10-21T20:45:28.189724] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T20:45:28.197922] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-10-21T20:45:28.198066] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-10-21T20:45:28.198914] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T20:45:28.198998] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:45:28.199063] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:45:28.199135] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-10-21T20:45:28.199198] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-10-21T20:45:28.199233] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-10-21T20:45:28.199270] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-10-21T20:45:28.199326] [INFO ] [MAIN ] Update Progress: 1753/2366 symbols completed. QBTS took 48.5s. Estimated remaining: 1h 18m 49s. Rate: 7.8 symbols/min [2025-10-21T20:45:28.381139] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:45:28.402830] [DEBUG] [LOCAL ] QUAD: Loaded 23177 existing records from primary storage. [2025-10-21T20:45:28.403075] [INFO ] [MAIN ] QUAD: Loaded 23177 existing records. [2025-10-21T20:45:28.594231] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:45:28.594585] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-10-21T20:45:28.594777] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-10-21T20:45:28.595190] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-10-21T20:45:28.595263] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-10-21T20:45:28.757934] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-21T20:45:28.962025] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-10-21T20:45:29.005920] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:45:29.384446] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T20:45:29.751040] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-10-21T20:45:30.551112] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-10-21T20:45:30.726752] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T20:45:31.239532] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T20:45:31.351035] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-10-21T20:45:32.151055] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-10-21T20:45:32.532481] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T20:45:32.951061] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-10-21T20:45:33.300683] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-10-21T20:45:33.751088] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-10. [2025-10-21T20:45:34.064480] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T20:45:34.121966] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T20:45:34.551070] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-10-21T20:45:35.351087] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-10-21T20:45:36.151049] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-10-21T20:45:36.479574] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T20:45:36.573717] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-21T20:45:36.582176] [INFO ] [REMOTE ] QS: Full fetch complete (77920 records). [2025-10-21T20:45:36.582345] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-10-21T20:45:36.971790] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-10. [2025-10-21T20:45:36.995176] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-10-21T20:45:36.995336] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-10-21T20:45:36.996600] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-10-21T20:45:36.996700] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-10-21T20:45:36.998713] [DEBUG] [LOCAL ] QS: Trimmed 77920 records to 53760 (keeping 200 days of data) [2025-10-21T20:45:37.106484] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T20:45:37.341776] [DEBUG] [LOCAL ] QS: Primary data saved (53760 records). [2025-10-21T20:45:37.341902] [INFO ] [MAIN ] QS: Full history saved. [2025-10-21T20:45:37.341971] [INFO ] [MAIN ] Update Progress: 1754/2366 symbols completed. QS took 35.2s. Estimated remaining: 1h 18m 42s. Rate: 7.8 symbols/min [2025-10-21T20:45:37.510376] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T20:45:37.527256] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:45:37.550759] [DEBUG] [LOCAL ] QVCC: Loaded 8741 existing records from primary storage. [2025-10-21T20:45:37.550978] [INFO ] [MAIN ] QVCC: Loaded 8741 existing records. [2025-10-21T20:45:37.731365] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:45:37.731563] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-10-21T20:45:37.731610] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-10-21T20:45:37.731807] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-10-21T20:45:37.731862] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-10-21T20:45:37.761858] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-10-21T20:45:38.081780] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:45:38.551062] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-10-21T20:45:38.904296] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T20:45:38.912433] [INFO ] [REMOTE ] QSR: Full fetch complete (76096 records). [2025-10-21T20:45:38.912555] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-10-21T20:45:39.315100] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T20:45:39.344843] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-10-21T20:45:39.344929] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-10-21T20:45:39.346058] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-10-21T20:45:39.346118] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-10-21T20:45:39.347361] [DEBUG] [LOCAL ] QSR: Trimmed 76096 records to 52480 (keeping 200 days of data) [2025-10-21T20:45:39.400326] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-10-21T20:45:39.677425] [DEBUG] [LOCAL ] QSR: Primary data saved (52480 records). [2025-10-21T20:45:39.677571] [INFO ] [MAIN ] QSR: Full history saved. [2025-10-21T20:45:39.677713] [INFO ] [MAIN ] Update Progress: 1755/2366 symbols completed. QSR took 29.7s. Estimated remaining: 1h 18m 32s. Rate: 7.8 symbols/min [2025-10-21T20:45:39.850464] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:45:39.856904] [DEBUG] [LOCAL ] QVCD: Loaded 4608 existing records from primary storage. [2025-10-21T20:45:39.857114] [INFO ] [MAIN ] QVCD: Loaded 4608 existing records. [2025-10-21T20:45:40.042897] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:45:40.043167] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-10-21T20:45:40.043303] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-10-21T20:45:40.043504] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-10-21T20:45:40.043551] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-10-21T20:45:40.153476] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-10-21T20:45:40.354250] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T20:45:40.388577] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T20:45:40.455200] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:45:40.951026] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-10-21T20:45:41.643968] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T20:45:41.751024] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-10-21T20:45:42.550998] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-10-21T20:45:42.615053] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T20:45:42.912621] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T20:45:43.247307] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T20:45:43.350981] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-10-21T20:45:44.151009] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-10-21T20:45:44.536793] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T20:45:44.932101] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T20:45:44.951005] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-10-21T20:45:45.557278] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T20:45:45.751038] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-10-21T20:45:46.444440] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-21T20:45:46.551027] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-10-21T20:45:47.351046] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-10-21T20:45:48.102556] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T20:45:48.150987] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-10-21T20:45:48.661151] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T20:45:48.951063] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-10-21T20:45:49.395557] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T20:45:49.638876] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T20:45:49.751008] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-10-21T20:45:50.551029] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-10-21T20:45:51.352069] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-10-21T20:45:51.355296] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-21T20:45:51.382012] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T20:45:52.151000] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-10-21T20:45:52.540230] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T20:45:52.951045] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-10. [2025-10-21T20:45:52.990216] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T20:45:53.750998] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-10-21T20:45:54.131578] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T20:45:54.135054] [INFO ] [REMOTE ] QUAD: Full fetch complete (33940 records). [2025-10-21T20:45:54.135137] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-10-21T20:45:54.512224] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-10-21T20:45:54.512309] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-10-21T20:45:54.512996] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-10-21T20:45:54.513059] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-10-21T20:45:54.513930] [DEBUG] [LOCAL ] QUAD: Trimmed 33940 records to 23058 (keeping 200 days of data) [2025-10-21T20:45:54.559976] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-10-21T20:45:54.607559] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T20:45:54.657556] [DEBUG] [LOCAL ] QUAD: Primary data saved (23058 records). [2025-10-21T20:45:54.657770] [INFO ] [MAIN ] QUAD: Full history saved. [2025-10-21T20:45:54.657871] [INFO ] [MAIN ] Update Progress: 1756/2366 symbols completed. QUAD took 26.5s. Estimated remaining: 1h 18m 27s. Rate: 7.8 symbols/min [2025-10-21T20:45:54.830198] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:45:54.830361] [DEBUG] [LOCAL ] QXO: No existing data file found in primary storage. [2025-10-21T20:45:54.830398] [WARN ] [MAIN ] QXO: No existing data found, performing full refresh instead. [2025-10-21T20:45:54.830508] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-10-21T20:45:54.830550] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-10-21T20:45:54.830591] [DEBUG] [LOCAL ] QXO: No primary data file found to delete. [2025-10-21T20:45:54.830624] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-10-21T20:45:55.218635] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:45:55.351045] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-10-21T20:45:55.489170] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T20:45:56.151079] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-10-21T20:45:56.951008] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-10-21T20:45:57.135374] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T20:45:57.711176] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T20:45:57.750988] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-10-21T20:45:57.997847] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T20:45:58.324391] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T20:45:58.551074] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-10-21T20:45:59.351035] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-10-21T20:46:00.147461] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T20:46:00.150975] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-10-21T20:46:00.247185] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T20:46:00.951003] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-10. [2025-10-21T20:46:01.062403] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T20:46:01.751076] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-10-21T20:46:02.354032] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T20:46:02.551028] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-10-21T20:46:02.765327] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T20:46:02.772356] [INFO ] [REMOTE ] QTWO: Full fetch complete (58157 records). [2025-10-21T20:46:02.772490] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-10-21T20:46:03.183454] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-10-21T20:46:03.183532] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-10-21T20:46:03.184531] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-10-21T20:46:03.184591] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-10-21T20:46:03.185672] [DEBUG] [LOCAL ] QTWO: Trimmed 58157 records to 39479 (keeping 200 days of data) [2025-10-21T20:46:03.355149] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-10-21T20:46:03.414165] [DEBUG] [LOCAL ] QTWO: Primary data saved (39479 records). [2025-10-21T20:46:03.414408] [INFO ] [MAIN ] QTWO: Full history saved. [2025-10-21T20:46:03.414970] [INFO ] [MAIN ] Update Progress: 1757/2366 symbols completed. QTWO took 36.4s. Estimated remaining: 1h 18m 20s. Rate: 7.8 symbols/min [2025-10-21T20:46:03.445173] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T20:46:04.022242] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-21T20:46:04.150991] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-10. [2025-10-21T20:46:04.951003] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-10-21T20:46:05.109391] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T20:46:05.111285] [INFO ] [REMOTE ] QVCC: Full fetch complete (11871 records). [2025-10-21T20:46:05.111353] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-10-21T20:46:05.471233] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-10-21T20:46:05.471328] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-10-21T20:46:05.471618] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-10-21T20:46:05.471686] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-10-21T20:46:05.472137] [DEBUG] [LOCAL ] QVCC: Trimmed 11871 records to 8725 (keeping 200 days of data) [2025-10-21T20:46:05.521263] [DEBUG] [LOCAL ] QVCC: Primary data saved (8725 records). [2025-10-21T20:46:05.521377] [INFO ] [MAIN ] QVCC: Full history saved. [2025-10-21T20:46:05.521454] [INFO ] [MAIN ] Update Progress: 1758/2366 symbols completed. QVCC took 28.2s. Estimated remaining: 1h 18m 10s. Rate: 7.8 symbols/min [2025-10-21T20:46:05.751039] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-10-21T20:46:06.400061] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T20:46:06.551058] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-10. [2025-10-21T20:46:06.871785] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T20:46:07.013552] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-21T20:46:07.014923] [INFO ] [REMOTE ] QVCD: Full fetch complete (6196 records). [2025-10-21T20:46:07.014990] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-10-21T20:46:07.359749] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-10-21T20:46:07.366859] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-10-21T20:46:07.366912] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-10-21T20:46:07.367118] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-10-21T20:46:07.367182] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-10-21T20:46:07.367775] [DEBUG] [LOCAL ] QVCD: Trimmed 6196 records to 4584 (keeping 200 days of data) [2025-10-21T20:46:07.396129] [DEBUG] [LOCAL ] QVCD: Primary data saved (4584 records). [2025-10-21T20:46:07.396268] [INFO ] [MAIN ] QVCD: Full history saved. [2025-10-21T20:46:07.396355] [INFO ] [MAIN ] Update Progress: 1759/2366 symbols completed. QVCD took 27.7s. Estimated remaining: 1h 18m 0s. Rate: 7.8 symbols/min [2025-10-21T20:46:09.290222] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T20:46:09.301323] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-10-21T20:46:11.397272] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-21T20:46:11.408413] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-10-21T20:46:13.472470] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-21T20:46:13.484172] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-10-21T20:46:15.674466] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-21T20:46:15.686045] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-10-21T20:46:17.754065] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-21T20:46:17.765373] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-10-21T20:46:19.966527] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T20:46:19.978322] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-10. [2025-10-21T20:46:22.063185] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-21T20:46:22.071354] [INFO ] [REMOTE ] QXO: Full fetch complete (76244 records). [2025-10-21T20:46:22.071475] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-10-21T20:46:22.473596] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-10-21T20:46:22.473757] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-10-21T20:46:22.474912] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-10-21T20:46:22.474975] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-10-21T20:46:22.476368] [DEBUG] [LOCAL ] QXO: Trimmed 76244 records to 53470 (keeping 200 days of data) [2025-10-21T20:46:22.814418] [DEBUG] [LOCAL ] QXO: Primary data saved (53470 records). [2025-10-21T20:46:22.814565] [INFO ] [MAIN ] QXO: Full history saved. [2025-10-21T20:46:22.814638] [INFO ] [MAIN ] Update Progress: 1760/2366 symbols completed. QXO took 28.2s. Estimated remaining: 1h 17m 55s. Rate: 7.8 symbols/min [2025-10-21T20:46:23.590368] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:46:23.607159] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:46:23.646773] [DEBUG] [LOCAL ] R: No existing data file found in primary storage. [2025-10-21T20:46:23.651064] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:46:23.677837] [WARN ] [MAIN ] R: No existing data found, performing full refresh instead. [2025-10-21T20:46:23.685581] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-10-21T20:46:23.706479] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-10-21T20:46:23.707611] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:46:23.708426] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-10-21T20:46:23.708505] [DEBUG] [LOCAL ] R: No primary data file found to delete. [2025-10-21T20:46:23.708593] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-10-21T20:46:23.708684] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-10-21T20:46:23.708849] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-10-21T20:46:23.722565] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-10-21T20:46:23.767850] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-10-21T20:46:23.793725] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-10-21T20:46:23.963890] [DEBUG] [LOCAL ] RA: Loaded 21865 existing records from primary storage. [2025-10-21T20:46:24.046180] [DEBUG] [LOCAL ] RACE: Loaded 32933 existing records from primary storage. [2025-10-21T20:46:24.042293] [INFO ] [MAIN ] RA: Loaded 21865 existing records. [2025-10-21T20:46:24.049910] [INFO ] [MAIN ] RACE: Loaded 32933 existing records. [2025-10-21T20:46:24.825708] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:46:24.833568] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:46:24.865634] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:46:24.874684] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-10-21T20:46:24.869208] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-10-21T20:46:24.877697] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-10-21T20:46:24.891968] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-10-21T20:46:24.892248] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-10-21T20:46:24.899279] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:46:24.899881] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-10-21T20:46:24.900050] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-10-21T20:46:24.899941] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-10-21T20:46:24.900912] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-10-21T20:46:24.900964] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-10-21T20:46:25.619179] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:46:25.638387] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-10-21T20:46:25.661860] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:46:25.662408] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-10-21T20:46:26.303367] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T20:46:26.309278] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-10-21T20:46:26.430218] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T20:46:26.437102] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-10-21T20:46:26.949623] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T20:46:26.956005] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-10-21T20:46:27.021552] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T20:46:27.026278] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-10-21T20:46:27.656393] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T20:46:27.662316] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-10-21T20:46:27.803570] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T20:46:27.810836] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-10-21T20:46:27.873411] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T20:46:27.878296] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-10-21T20:46:28.743151] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T20:46:28.750372] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-10-21T20:46:29.172027] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T20:46:29.177052] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-10-21T20:46:29.237329] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T20:46:29.245434] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-10-21T20:46:29.330217] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T20:46:29.338811] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-10-21T20:46:30.187531] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T20:46:30.196254] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-10-21T20:46:30.553105] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T20:46:30.560951] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-10-21T20:46:30.895220] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T20:46:30.903567] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-10-21T20:46:30.972971] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T20:46:30.981798] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-10-21T20:46:31.747430] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T20:46:31.752208] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-10-21T20:46:31.912757] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T20:46:31.921017] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-10-21T20:46:32.368756] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T20:46:32.375369] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-10-21T20:46:32.571740] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T20:46:32.580765] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-10-21T20:46:32.605707] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T20:46:32.611392] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-10-21T20:46:33.586804] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T20:46:33.593964] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-10-21T20:46:33.663006] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T20:46:33.668594] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-10-21T20:46:33.737227] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T20:46:33.750981] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-10-21T20:46:33.819322] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T20:46:34.551020] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-10-21T20:46:35.086896] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T20:46:35.190534] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T20:46:35.315542] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T20:46:35.351027] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-10-21T20:46:35.593782] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T20:46:36.151023] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-10-21T20:46:36.951000] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-10-21T20:46:37.112685] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T20:46:37.753478] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-10-21T20:46:37.756601] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T20:46:38.101585] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T20:46:38.551039] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-10-21T20:46:39.114403] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T20:46:39.351022] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-10. [2025-10-21T20:46:39.775040] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T20:46:40.151052] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-10-21T20:46:40.563997] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T20:46:40.567953] [INFO ] [REMOTE ] RA: Full fetch complete (31883 records). [2025-10-21T20:46:40.568045] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-10-21T20:46:40.944615] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-10-21T20:46:40.944720] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-10-21T20:46:40.945352] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-10-21T20:46:40.945391] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-10-21T20:46:40.946171] [DEBUG] [LOCAL ] RA: Trimmed 31883 records to 21936 (keeping 200 days of data) [2025-10-21T20:46:40.996406] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-10-21T20:46:41.083143] [DEBUG] [LOCAL ] RA: Primary data saved (21936 records). [2025-10-21T20:46:41.083574] [INFO ] [MAIN ] RA: Full history saved. [2025-10-21T20:46:41.083701] [INFO ] [MAIN ] Update Progress: 1761/2366 symbols completed. RA took 18.3s. Estimated remaining: 1h 17m 51s. Rate: 7.8 symbols/min [2025-10-21T20:46:41.256987] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:46:41.257575] [DEBUG] [LOCAL ] RBA: No existing data file found in primary storage. [2025-10-21T20:46:41.257678] [WARN ] [MAIN ] RBA: No existing data found, performing full refresh instead. [2025-10-21T20:46:41.257828] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-10-21T20:46:41.257870] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-10-21T20:46:41.257913] [DEBUG] [LOCAL ] RBA: No primary data file found to delete. [2025-10-21T20:46:41.257984] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-10-21T20:46:41.622920] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:46:41.733849] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T20:46:41.750976] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-10. [2025-10-21T20:46:42.035736] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T20:46:42.551020] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-10-21T20:46:43.350998] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-10-21T20:46:43.822593] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T20:46:43.830104] [INFO ] [REMOTE ] RACE: Full fetch complete (49354 records). [2025-10-21T20:46:43.830232] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-10-21T20:46:43.924239] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T20:46:44.151297] [INFO ] [REMOTE ] R: Fetching primary data for 2025-10. [2025-10-21T20:46:44.242327] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-10-21T20:46:44.242405] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-10-21T20:46:44.243437] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-10-21T20:46:44.243500] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-10-21T20:46:44.244521] [DEBUG] [LOCAL ] RACE: Trimmed 49354 records to 32941 (keeping 200 days of data) [2025-10-21T20:46:44.440275] [DEBUG] [LOCAL ] RACE: Primary data saved (32941 records). [2025-10-21T20:46:44.440401] [INFO ] [MAIN ] RACE: Full history saved. [2025-10-21T20:46:44.440483] [INFO ] [MAIN ] Update Progress: 1762/2366 symbols completed. RACE took 21.6s. Estimated remaining: 1h 17m 42s. Rate: 7.8 symbols/min [2025-10-21T20:46:44.618167] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:46:44.618378] [DEBUG] [LOCAL ] RBC: No existing data file found in primary storage. [2025-10-21T20:46:44.618425] [WARN ] [MAIN ] RBC: No existing data found, performing full refresh instead. [2025-10-21T20:46:44.618531] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-10-21T20:46:44.618592] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-10-21T20:46:44.618635] [DEBUG] [LOCAL ] RBC: No primary data file found to delete. [2025-10-21T20:46:44.618707] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-10-21T20:46:44.956752] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-10. [2025-10-21T20:46:44.987906] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:46:45.111166] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T20:46:45.641741] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T20:46:45.646037] [INFO ] [REMOTE ] R: Full fetch complete (42300 records). [2025-10-21T20:46:45.646125] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-10-21T20:46:45.756160] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-10-21T20:46:46.021174] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-10-21T20:46:46.021258] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-10-21T20:46:46.022116] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-10-21T20:46:46.022215] [DEBUG] [LOCAL ] R: Saving primary data. [2025-10-21T20:46:46.023220] [DEBUG] [LOCAL ] R: Trimmed 42300 records to 27949 (keeping 200 days of data) [2025-10-21T20:46:46.191513] [DEBUG] [LOCAL ] R: Primary data saved (27949 records). [2025-10-21T20:46:46.191632] [INFO ] [MAIN ] R: Full history saved. [2025-10-21T20:46:46.191741] [INFO ] [MAIN ] Update Progress: 1763/2366 symbols completed. R took 23.4s. Estimated remaining: 1h 17m 32s. Rate: 7.8 symbols/min [2025-10-21T20:46:46.358919] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:46:46.359151] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-10-21T20:46:46.359201] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-10-21T20:46:46.359306] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-10-21T20:46:46.359349] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-10-21T20:46:46.359391] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-10-21T20:46:46.359422] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-10-21T20:46:46.572761] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-10-21T20:46:46.724004] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:46:46.741146] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T20:46:46.747764] [INFO ] [REMOTE ] RAMP: Full fetch complete (54682 records). [2025-10-21T20:46:46.747876] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-10-21T20:46:46.946622] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T20:46:47.152138] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-10-21T20:46:47.152219] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-10-21T20:46:47.153342] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-10-21T20:46:47.153405] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-10-21T20:46:47.154514] [DEBUG] [LOCAL ] RAMP: Trimmed 54682 records to 37686 (keeping 200 days of data) [2025-10-21T20:46:47.353045] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-10-21T20:46:47.369245] [DEBUG] [LOCAL ] RAMP: Primary data saved (37686 records). [2025-10-21T20:46:47.370030] [INFO ] [MAIN ] RAMP: Full history saved. [2025-10-21T20:46:47.370111] [INFO ] [MAIN ] Update Progress: 1764/2366 symbols completed. RAMP took 24.5s. Estimated remaining: 1h 17m 22s. Rate: 7.8 symbols/min [2025-10-21T20:46:47.570285] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:46:47.578119] [DEBUG] [LOCAL ] RBOT: Loaded 6187 existing records from primary storage. [2025-10-21T20:46:47.578278] [INFO ] [MAIN ] RBOT: Loaded 6187 existing records. [2025-10-21T20:46:47.751634] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:46:47.751876] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-10-21T20:46:47.751923] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-10-21T20:46:47.752139] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-10-21T20:46:47.752196] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-10-21T20:46:48.108354] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:46:48.143708] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T20:46:48.151984] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-10-21T20:46:48.951102] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-10-21T20:46:49.294831] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T20:46:49.707815] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-21T20:46:49.750977] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-10-21T20:46:50.551083] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-10-21T20:46:50.799304] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T20:46:51.351048] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-10-21T20:46:51.462024] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T20:46:52.146382] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-21T20:46:52.156489] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-10-21T20:46:52.950993] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-10-21T20:46:53.302484] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T20:46:53.352318] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T20:46:53.751047] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-10-21T20:46:54.551038] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-10-21T20:46:55.110323] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-21T20:46:55.351083] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-10-21T20:46:55.706501] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-21T20:46:55.763271] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T20:46:56.151069] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-10-21T20:46:56.951017] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-10-21T20:46:57.007312] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T20:46:57.626591] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-21T20:46:57.751063] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-10-21T20:46:58.538117] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T20:46:58.550996] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-10-21T20:46:58.641344] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T20:46:59.351065] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-10-21T20:46:59.595092] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T20:47:00.132341] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T20:47:00.150981] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-10-21T20:47:00.809627] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-21T20:47:00.951070] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-10-21T20:47:01.751089] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-10-21T20:47:02.551036] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-10-21T20:47:03.163417] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T20:47:03.265387] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-21T20:47:03.351062] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-10-21T20:47:03.557295] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T20:47:04.151062] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-10-21T20:47:04.951091] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-10-21T20:47:05.695686] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-21T20:47:05.750981] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-10-21T20:47:05.942266] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T20:47:06.051725] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T20:47:06.551080] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-10-21T20:47:07.351023] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-10-21T20:47:08.093104] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T20:47:08.151001] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-10-21T20:47:08.570768] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-10-21T20:47:08.950999] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-10-21T20:47:09.253327] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T20:47:09.364227] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T20:47:09.751045] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-10. [2025-10-21T20:47:10.551007] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-10-21T20:47:11.351085] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-10-21T20:47:11.434401] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T20:47:11.442817] [INFO ] [REMOTE ] RBA: Full fetch complete (66569 records). [2025-10-21T20:47:11.442952] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-10-21T20:47:11.720982] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T20:47:11.896684] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-10-21T20:47:11.896921] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-10-21T20:47:11.898479] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-10-21T20:47:11.898922] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-10-21T20:47:11.900551] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.95 seconds). [2025-10-21T20:47:11.913574] [DEBUG] [LOCAL ] RBA: Trimmed 66569 records to 46100 (keeping 200 days of data) [2025-10-21T20:47:12.153069] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-10. [2025-10-21T20:47:12.204984] [DEBUG] [LOCAL ] RBA: Primary data saved (46100 records). [2025-10-21T20:47:12.205112] [INFO ] [MAIN ] RBA: Full history saved. [2025-10-21T20:47:12.210521] [INFO ] [MAIN ] Update Progress: 1765/2366 symbols completed. RBA took 31.1s. Estimated remaining: 1h 17m 21s. Rate: 7.8 symbols/min [2025-10-21T20:47:12.211313] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T20:47:12.382887] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:47:12.433984] [DEBUG] [LOCAL ] RBRK: Loaded 53169 existing records from primary storage. [2025-10-21T20:47:12.434290] [INFO ] [MAIN ] RBRK: Loaded 53169 existing records. [2025-10-21T20:47:12.612554] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:47:12.612804] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-10-21T20:47:12.612871] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-10-21T20:47:12.613162] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-10-21T20:47:12.613217] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-10-21T20:47:12.956097] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-10-21T20:47:12.959903] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:47:13.198852] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T20:47:13.202100] [INFO ] [REMOTE ] RBC: Full fetch complete (21805 records). [2025-10-21T20:47:13.202198] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-10-21T20:47:13.573604] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-10-21T20:47:13.573705] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-10-21T20:47:13.574197] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-10-21T20:47:13.574237] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-10-21T20:47:13.574822] [DEBUG] [LOCAL ] RBC: Trimmed 21805 records to 15293 (keeping 200 days of data) [2025-10-21T20:47:13.671767] [DEBUG] [LOCAL ] RBC: Primary data saved (15293 records). [2025-10-21T20:47:13.671883] [INFO ] [MAIN ] RBC: Full history saved. [2025-10-21T20:47:13.671955] [INFO ] [MAIN ] Update Progress: 1766/2366 symbols completed. RBC took 29.2s. Estimated remaining: 1h 17m 11s. Rate: 7.8 symbols/min [2025-10-21T20:47:13.760616] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-10-21T20:47:13.846023] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:47:13.846209] [DEBUG] [LOCAL ] RC: No existing data file found in primary storage. [2025-10-21T20:47:13.846246] [WARN ] [MAIN ] RC: No existing data found, performing full refresh instead. [2025-10-21T20:47:13.846358] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-10-21T20:47:13.846399] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-10-21T20:47:13.846438] [DEBUG] [LOCAL ] RC: No primary data file found to delete. [2025-10-21T20:47:13.846469] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-10-21T20:47:14.193391] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:47:14.551052] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-10-21T20:47:14.648404] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T20:47:15.351055] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-10-21T20:47:15.592766] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-10-21T20:47:16.151003] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-10-21T20:47:16.229284] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T20:47:16.618226] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T20:47:16.951046] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-10-21T20:47:17.705834] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T20:47:17.750984] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-10-21T20:47:18.551066] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-10. [2025-10-21T20:47:18.847301] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T20:47:19.351020] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-10-21T20:47:19.479303] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T20:47:20.151014] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-10-21T20:47:20.956197] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-10. [2025-10-21T20:47:20.970049] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-10-21T20:47:20.982143] [INFO ] [REMOTE ] RBLX: Full fetch complete (77886 records). [2025-10-21T20:47:20.982323] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-10-21T20:47:21.378928] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-10-21T20:47:21.379060] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-10-21T20:47:21.380239] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-10-21T20:47:21.380312] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-10-21T20:47:21.417874] [DEBUG] [LOCAL ] RBLX: Trimmed 77886 records to 53718 (keeping 200 days of data) [2025-10-21T20:47:21.419886] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-21T20:47:21.746204] [DEBUG] [LOCAL ] RBLX: Primary data saved (53718 records). [2025-10-21T20:47:21.746333] [INFO ] [MAIN ] RBLX: Full history saved. [2025-10-21T20:47:21.746404] [INFO ] [MAIN ] Update Progress: 1767/2366 symbols completed. RBLX took 35.6s. Estimated remaining: 1h 17m 3s. Rate: 7.8 symbols/min [2025-10-21T20:47:21.771149] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-10-21T20:47:21.920874] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:47:21.921191] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-10-21T20:47:21.921242] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-10-21T20:47:21.921358] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-10-21T20:47:21.921411] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-21T20:47:21.921454] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-21T20:47:21.921485] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-10-21T20:47:22.078163] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T20:47:22.107049] [INFO ] [REMOTE ] RBOT: Full fetch complete (9290 records). [2025-10-21T20:47:22.121565] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-10-21T20:47:22.520144] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:47:22.553511] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-10-21T20:47:22.556136] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-10-21T20:47:22.705714] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-10-21T20:47:22.705798] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-10-21T20:47:22.706041] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-10-21T20:47:22.706079] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-10-21T20:47:22.706508] [DEBUG] [LOCAL ] RBOT: Trimmed 9290 records to 6199 (keeping 200 days of data) [2025-10-21T20:47:22.740926] [DEBUG] [LOCAL ] RBOT: Primary data saved (6199 records). [2025-10-21T20:47:22.741046] [INFO ] [MAIN ] RBOT: Full history saved. [2025-10-21T20:47:22.741125] [INFO ] [MAIN ] Update Progress: 1768/2366 symbols completed. RBOT took 35.4s. Estimated remaining: 1h 16m 53s. Rate: 7.8 symbols/min [2025-10-21T20:47:22.907434] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:47:22.911984] [DEBUG] [LOCAL ] RCD: Loaded 3357 existing records from primary storage. [2025-10-21T20:47:22.912124] [INFO ] [MAIN ] RCD: Loaded 3357 existing records. [2025-10-21T20:47:23.085468] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:47:23.085679] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-10-21T20:47:23.085737] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-10-21T20:47:23.085906] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-10-21T20:47:23.085960] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-10-21T20:47:23.336792] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T20:47:23.359717] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-10-21T20:47:23.449534] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:47:23.823146] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T20:47:24.080138] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T20:47:24.150985] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-10-21T20:47:24.850671] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T20:47:24.951082] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-10-21T20:47:25.613016] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T20:47:25.750998] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-10-21T20:47:26.551015] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-10-21T20:47:27.329795] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T20:47:27.350984] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-10-21T20:47:27.955664] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-21T20:47:28.014073] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-21T20:47:28.151028] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-10-21T20:47:28.951081] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-10-21T20:47:29.648097] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T20:47:29.751048] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-10-21T20:47:30.259736] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T20:47:30.333765] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-21T20:47:30.551001] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-10-21T20:47:31.351014] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-10-21T20:47:31.831707] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-21T20:47:32.151044] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-10-21T20:47:32.548873] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T20:47:32.622046] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T20:47:32.950991] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-10-21T20:47:33.751074] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-10-21T20:47:34.321028] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T20:47:34.550984] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-10-21T20:47:34.826966] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T20:47:35.351065] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-10-21T20:47:36.151016] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-10-21T20:47:36.274612] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T20:47:36.786618] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-21T20:47:36.950982] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-10-21T20:47:37.554464] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T20:47:37.751004] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-10-21T20:47:38.551051] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-10-21T20:47:39.078824] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T20:47:39.179071] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-21T20:47:39.350989] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-10. [2025-10-21T20:47:39.608112] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T20:47:39.803605] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T20:47:39.804393] [INFO ] [REMOTE ] RCB: Full fetch complete (3720 records). [2025-10-21T20:47:39.804459] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-10-21T20:47:39.981625] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T20:47:39.981866] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:47:39.981953] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:47:39.982029] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-10-21T20:47:39.982094] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-10-21T20:47:39.982133] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-10-21T20:47:39.982174] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-10-21T20:47:39.982231] [INFO ] [MAIN ] Update Progress: 1769/2366 symbols completed. RCB took 18.2s. Estimated remaining: 1h 16m 49s. Rate: 7.8 symbols/min [2025-10-21T20:47:40.150956] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:47:40.151034] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-10-21T20:47:40.196508] [DEBUG] [LOCAL ] RCI: Loaded 48624 existing records from primary storage. [2025-10-21T20:47:40.196828] [INFO ] [MAIN ] RCI: Loaded 48624 existing records. [2025-10-21T20:47:40.367844] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:47:40.368049] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-10-21T20:47:40.368096] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-10-21T20:47:40.368288] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-10-21T20:47:40.368325] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-10-21T20:47:40.711078] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:47:40.951000] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-10-21T20:47:41.625391] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-21T20:47:41.750995] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-10-21T20:47:42.551012] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-10-21T20:47:42.669051] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-21T20:47:43.351020] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-10-21T20:47:43.631164] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T20:47:43.892332] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-21T20:47:44.138378] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T20:47:44.150995] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-10-21T20:47:44.862796] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-21T20:47:44.951027] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-10-21T20:47:45.751022] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-10-21T20:47:46.551040] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-10. [2025-10-21T20:47:46.862485] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T20:47:47.351022] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-10. [2025-10-21T20:47:47.426956] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T20:47:48.151029] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-10-21T20:47:48.681867] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-21T20:47:48.691004] [INFO ] [REMOTE ] RBRK: Full fetch complete (76703 records). [2025-10-21T20:47:48.691145] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-10-21T20:47:48.951183] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-10-21T20:47:49.086621] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-10-21T20:47:49.086735] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-10-21T20:47:49.087965] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-10-21T20:47:49.088028] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-10-21T20:47:49.089429] [DEBUG] [LOCAL ] RBRK: Trimmed 76703 records to 53163 (keeping 200 days of data) [2025-10-21T20:47:49.296138] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T20:47:49.347244] [INFO ] [REMOTE ] RC: Full fetch complete (71092 records). [2025-10-21T20:47:49.367934] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-10-21T20:47:49.560279] [DEBUG] [LOCAL ] RBRK: Primary data saved (53163 records). [2025-10-21T20:47:49.566175] [INFO ] [MAIN ] RBRK: Full history saved. [2025-10-21T20:47:49.572428] [INFO ] [MAIN ] Update Progress: 1770/2366 symbols completed. RBRK took 37.4s. Estimated remaining: 1h 16m 41s. Rate: 7.8 symbols/min [2025-10-21T20:47:49.714958] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T20:47:49.771503] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-10-21T20:47:49.953833] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:47:49.954498] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-10-21T20:47:49.959894] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-10-21T20:47:49.970527] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-10-21T20:47:49.975763] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-21T20:47:50.046490] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-21T20:47:50.049975] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-10-21T20:47:50.065669] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-10-21T20:47:50.075769] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-10-21T20:47:50.077210] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-10-21T20:47:50.082558] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-10-21T20:47:50.136889] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T20:47:50.192961] [DEBUG] [LOCAL ] RC: Trimmed 71092 records to 48888 (keeping 200 days of data) [2025-10-21T20:47:50.558768] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:47:50.552691] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-10-21T20:47:50.671607] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T20:47:50.750279] [DEBUG] [LOCAL ] RC: Primary data saved (48888 records). [2025-10-21T20:47:50.750415] [INFO ] [MAIN ] RC: Full history saved. [2025-10-21T20:47:50.750485] [INFO ] [MAIN ] Update Progress: 1771/2366 symbols completed. RC took 37.1s. Estimated remaining: 1h 16m 32s. Rate: 7.8 symbols/min [2025-10-21T20:47:50.914341] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:47:50.927838] [DEBUG] [LOCAL ] RCS: Loaded 12476 existing records from primary storage. [2025-10-21T20:47:50.928058] [INFO ] [MAIN ] RCS: Loaded 12476 existing records. [2025-10-21T20:47:51.100071] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:47:51.100265] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-10-21T20:47:51.100310] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-10-21T20:47:51.100482] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-10-21T20:47:51.100536] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-10-21T20:47:51.359062] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-10. [2025-10-21T20:47:51.445500] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:47:51.864424] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T20:47:51.865406] [INFO ] [REMOTE ] RCD: Full fetch complete (5911 records). [2025-10-21T20:47:51.865476] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-10-21T20:47:52.156188] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-10-21T20:47:52.255106] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-10-21T20:47:52.255188] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-10-21T20:47:52.255394] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-10-21T20:47:52.255431] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-10-21T20:47:52.255832] [DEBUG] [LOCAL ] RCD: Trimmed 5911 records to 3345 (keeping 200 days of data) [2025-10-21T20:47:52.275270] [DEBUG] [LOCAL ] RCD: Primary data saved (3345 records). [2025-10-21T20:47:52.275334] [INFO ] [MAIN ] RCD: Full history saved. [2025-10-21T20:47:52.275402] [INFO ] [MAIN ] Update Progress: 1772/2366 symbols completed. RCD took 29.5s. Estimated remaining: 1h 16m 22s. Rate: 7.8 symbols/min [2025-10-21T20:47:52.445758] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:47:52.446031] [DEBUG] [LOCAL ] RCUS: No existing data file found in primary storage. [2025-10-21T20:47:52.446169] [WARN ] [MAIN ] RCUS: No existing data found, performing full refresh instead. [2025-10-21T20:47:52.446408] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-10-21T20:47:52.446483] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-10-21T20:47:52.446594] [DEBUG] [LOCAL ] RCUS: No primary data file found to delete. [2025-10-21T20:47:52.446685] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-10-21T20:47:52.625199] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T20:47:52.841351] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:47:52.950983] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-10-21T20:47:53.409520] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T20:47:53.751050] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-10-21T20:47:54.501459] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T20:47:54.551023] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-10-21T20:47:55.351094] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-10-21T20:47:55.725002] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-21T20:47:56.103313] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T20:47:56.150989] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-10-21T20:47:56.951077] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-10-21T20:47:57.116478] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T20:47:57.750997] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-10-21T20:47:57.859165] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T20:47:58.551033] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-10-21T20:47:59.038305] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-21T20:47:59.351113] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-10-21T20:47:59.598733] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T20:47:59.815616] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T20:48:00.135005] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T20:48:00.151073] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-10-21T20:48:00.951025] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-10-21T20:48:01.750998] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-10-21T20:48:01.905595] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T20:48:02.500590] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-21T20:48:02.550979] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-10-21T20:48:03.351028] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-10-21T20:48:03.616738] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T20:48:04.151098] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-10-21T20:48:04.460547] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T20:48:04.678250] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T20:48:04.951002] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-10-21T20:48:05.289282] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T20:48:05.751101] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-10-21T20:48:06.536704] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T20:48:06.550976] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-10-21T20:48:06.711105] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T20:48:07.351067] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-10-21T20:48:08.151074] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-10-21T20:48:08.179564] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T20:48:08.231561] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T20:48:08.951035] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-10-21T20:48:09.751052] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-10-21T20:48:10.218575] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-21T20:48:10.551017] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-10-21T20:48:10.616864] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T20:48:10.662290] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T20:48:11.351017] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-10-21T20:48:12.151077] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-10-21T20:48:12.582482] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T20:48:12.903396] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T20:48:12.950980] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-10. [2025-10-21T20:48:13.751049] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-10-21T20:48:13.905503] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T20:48:14.320099] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T20:48:14.327189] [INFO ] [REMOTE ] RCUS: Full fetch complete (61089 records). [2025-10-21T20:48:14.327285] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-10-21T20:48:14.560692] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-10-21T20:48:14.709982] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-10-21T20:48:14.710166] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-10-21T20:48:14.711227] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-10-21T20:48:14.711428] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-10-21T20:48:14.719371] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-21T20:48:14.722944] [DEBUG] [LOCAL ] RCUS: Trimmed 61089 records to 42978 (keeping 200 days of data) [2025-10-21T20:48:14.956415] [DEBUG] [LOCAL ] RCUS: Primary data saved (42978 records). [2025-10-21T20:48:14.956539] [INFO ] [MAIN ] RCUS: Full history saved. [2025-10-21T20:48:14.956818] [INFO ] [MAIN ] Update Progress: 1773/2366 symbols completed. RCUS took 22.7s. Estimated remaining: 1h 16m 19s. Rate: 7.8 symbols/min [2025-10-21T20:48:15.122635] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:48:15.122829] [DEBUG] [LOCAL ] RDDT: No existing data file found in primary storage. [2025-10-21T20:48:15.122867] [WARN ] [MAIN ] RDDT: No existing data found, performing full refresh instead. [2025-10-21T20:48:15.122971] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-10-21T20:48:15.123010] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-10-21T20:48:15.123049] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-10-21T20:48:15.123080] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-10-21T20:48:15.357131] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-10-21T20:48:15.471694] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:48:16.151072] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-10-21T20:48:16.837994] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-21T20:48:16.950998] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-10-21T20:48:17.104208] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T20:48:17.239787] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T20:48:17.751074] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-10. [2025-10-21T20:48:18.551085] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-10. [2025-10-21T20:48:18.878161] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T20:48:18.881592] [INFO ] [REMOTE ] RCS: Full fetch complete (19290 records). [2025-10-21T20:48:18.881702] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-10-21T20:48:19.252021] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-10-21T20:48:19.252133] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-10-21T20:48:19.252823] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-10-21T20:48:19.262392] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-10-21T20:48:19.279884] [DEBUG] [LOCAL ] RCS: Trimmed 19290 records to 12511 (keeping 200 days of data) [2025-10-21T20:48:19.281880] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-21T20:48:19.351725] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-10-21T20:48:19.367454] [DEBUG] [LOCAL ] RCS: Primary data saved (12511 records). [2025-10-21T20:48:19.370687] [INFO ] [MAIN ] RCS: Full history saved. [2025-10-21T20:48:19.370926] [INFO ] [MAIN ] Update Progress: 1774/2366 symbols completed. RCS took 28.6s. Estimated remaining: 1h 16m 10s. Rate: 7.8 symbols/min [2025-10-21T20:48:19.538875] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:48:19.539060] [DEBUG] [LOCAL ] RDN: No existing data file found in primary storage. [2025-10-21T20:48:19.539096] [WARN ] [MAIN ] RDN: No existing data found, performing full refresh instead. [2025-10-21T20:48:19.539201] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-10-21T20:48:19.539241] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-10-21T20:48:19.539280] [DEBUG] [LOCAL ] RDN: No primary data file found to delete. [2025-10-21T20:48:19.539310] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-10-21T20:48:19.892145] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:48:20.150992] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-10-21T20:48:20.205773] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T20:48:20.213402] [INFO ] [REMOTE ] RCI: Full fetch complete (70689 records). [2025-10-21T20:48:20.213514] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-10-21T20:48:20.592225] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-10-21T20:48:20.592307] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-10-21T20:48:20.593397] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-10-21T20:48:20.593459] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-10-21T20:48:20.594816] [DEBUG] [LOCAL ] RCI: Trimmed 70689 records to 48595 (keeping 200 days of data) [2025-10-21T20:48:20.879284] [DEBUG] [LOCAL ] RCI: Primary data saved (48595 records). [2025-10-21T20:48:20.879404] [INFO ] [MAIN ] RCI: Full history saved. [2025-10-21T20:48:20.879942] [INFO ] [MAIN ] Update Progress: 1775/2366 symbols completed. RCI took 40.9s. Estimated remaining: 1h 16m 0s. Rate: 7.8 symbols/min [2025-10-21T20:48:20.956269] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-10-21T20:48:21.051341] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:48:21.051546] [DEBUG] [LOCAL ] RDW: No existing data file found in primary storage. [2025-10-21T20:48:21.051597] [WARN ] [MAIN ] RDW: No existing data found, performing full refresh instead. [2025-10-21T20:48:21.051722] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-10-21T20:48:21.051777] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-10-21T20:48:21.051818] [DEBUG] [LOCAL ] RDW: No primary data file found to delete. [2025-10-21T20:48:21.051866] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-10-21T20:48:21.407836] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:48:21.555745] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T20:48:21.751052] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-10. [2025-10-21T20:48:22.553561] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-10-21T20:48:22.553729] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T20:48:22.566075] [INFO ] [REMOTE ] RCL: Full fetch complete (75068 records). [2025-10-21T20:48:22.566257] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-10-21T20:48:22.567308] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T20:48:22.567843] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:48:22.567988] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:48:22.568060] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-10-21T20:48:22.568125] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-10-21T20:48:22.568161] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-10-21T20:48:22.568200] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-10-21T20:48:22.568264] [INFO ] [MAIN ] Update Progress: 1776/2366 symbols completed. RCL took 33.0s. Estimated remaining: 1h 15m 51s. Rate: 7.8 symbols/min [2025-10-21T20:48:22.748091] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:48:22.794049] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-10-21T20:48:22.818465] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T20:48:22.869138] [DEBUG] [LOCAL ] RDY: Loaded 46400 existing records from primary storage. [2025-10-21T20:48:22.869442] [INFO ] [MAIN ] RDY: Loaded 46400 existing records. [2025-10-21T20:48:23.043074] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:48:23.043281] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-10-21T20:48:23.043330] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-10-21T20:48:23.043581] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-10-21T20:48:23.043638] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-10-21T20:48:23.361981] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-10-21T20:48:23.403061] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:48:24.151019] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-10-21T20:48:24.688627] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T20:48:24.951027] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-10-21T20:48:25.751068] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-10-21T20:48:25.979757] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-10-21T20:48:26.062683] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T20:48:26.551103] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-10-21T20:48:26.617283] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T20:48:27.351027] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-10-21T20:48:27.819734] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-21T20:48:28.151000] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-10-21T20:48:28.362562] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T20:48:28.951056] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-10-21T20:48:29.160012] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T20:48:29.751104] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-10-21T20:48:30.306495] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-21T20:48:30.551094] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-10-21T20:48:30.704562] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T20:48:31.351029] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-10-21T20:48:32.151042] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-10-21T20:48:32.299323] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-21T20:48:32.337369] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T20:48:32.951001] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-10-21T20:48:33.202156] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T20:48:33.697331] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T20:48:33.751028] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-10-21T20:48:34.551026] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-10-21T20:48:35.165067] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-21T20:48:35.351028] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-10-21T20:48:35.496186] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T20:48:36.151039] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-10-21T20:48:36.951103] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-10-21T20:48:37.000244] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-21T20:48:37.176131] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T20:48:37.751091] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-10-21T20:48:37.890943] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T20:48:38.551081] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-10-21T20:48:39.072878] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-21T20:48:39.351032] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-10-21T20:48:39.488138] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T20:48:40.151026] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-10-21T20:48:40.243956] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T20:48:40.951084] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-10-21T20:48:41.751008] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-10-21T20:48:41.904831] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T20:48:42.047464] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-21T20:48:42.550994] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-10-21T20:48:42.603638] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T20:48:43.351036] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-10-21T20:48:44.151109] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-10-21T20:48:44.377402] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T20:48:44.417781] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-21T20:48:44.951019] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-10-21T20:48:45.003408] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T20:48:45.751036] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-10-21T20:48:46.551061] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-10. [2025-10-21T20:48:46.758518] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-21T20:48:47.299588] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-21T20:48:47.350987] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-10-21T20:48:47.410781] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T20:48:48.157209] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-10. [2025-10-21T20:48:48.162095] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T20:48:48.169257] [INFO ] [REMOTE ] RDN: Full fetch complete (65937 records). [2025-10-21T20:48:48.169424] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-10-21T20:48:48.561395] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-10-21T20:48:48.561471] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-10-21T20:48:48.562500] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-10-21T20:48:48.562562] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-10-21T20:48:48.563772] [DEBUG] [LOCAL ] RDN: Trimmed 65937 records to 44217 (keeping 200 days of data) [2025-10-21T20:48:48.820570] [DEBUG] [LOCAL ] RDN: Primary data saved (44217 records). [2025-10-21T20:48:48.820722] [INFO ] [MAIN ] RDN: Full history saved. [2025-10-21T20:48:48.820803] [INFO ] [MAIN ] Update Progress: 1777/2366 symbols completed. RDN took 29.4s. Estimated remaining: 1h 15m 49s. Rate: 7.8 symbols/min [2025-10-21T20:48:48.959412] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-10-21T20:48:48.992414] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:48:49.039111] [DEBUG] [LOCAL ] RELX: Loaded 48572 existing records from primary storage. [2025-10-21T20:48:49.039463] [INFO ] [MAIN ] RELX: Loaded 48572 existing records. [2025-10-21T20:48:49.226293] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:48:49.226579] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-10-21T20:48:49.226629] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-10-21T20:48:49.226946] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-10-21T20:48:49.227004] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-10-21T20:48:49.587822] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:48:49.751040] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-10-21T20:48:49.833851] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-21T20:48:49.939360] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T20:48:49.946478] [INFO ] [REMOTE ] RDY: Full fetch complete (68625 records). [2025-10-21T20:48:49.946592] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-10-21T20:48:50.338608] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-10-21T20:48:50.338722] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-10-21T20:48:50.339944] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-10-21T20:48:50.340015] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-10-21T20:48:50.341458] [DEBUG] [LOCAL ] RDY: Trimmed 68625 records to 46313 (keeping 200 days of data) [2025-10-21T20:48:50.551817] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-10. [2025-10-21T20:48:50.627705] [DEBUG] [LOCAL ] RDY: Primary data saved (46313 records). [2025-10-21T20:48:50.627847] [INFO ] [MAIN ] RDY: Full history saved. [2025-10-21T20:48:50.628898] [INFO ] [MAIN ] Update Progress: 1778/2366 symbols completed. RDY took 28.1s. Estimated remaining: 1h 15m 39s. Rate: 7.8 symbols/min [2025-10-21T20:48:50.807509] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:48:50.848255] [DEBUG] [LOCAL ] RERE: Loaded 41702 existing records from primary storage. [2025-10-21T20:48:50.848549] [INFO ] [MAIN ] RERE: Loaded 41702 existing records. [2025-10-21T20:48:51.035967] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:48:51.036198] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-10-21T20:48:51.036246] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-10-21T20:48:51.036537] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-10-21T20:48:51.036596] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-10-21T20:48:51.407941] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:48:51.408447] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-10-21T20:48:51.506428] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T20:48:51.647297] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-21T20:48:52.151104] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-10-21T20:48:52.919448] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T20:48:52.950977] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-10-21T20:48:53.080087] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-21T20:48:53.088246] [INFO ] [REMOTE ] RDW: Full fetch complete (75499 records). [2025-10-21T20:48:53.088367] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-10-21T20:48:53.479026] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-10-21T20:48:53.479102] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-10-21T20:48:53.480229] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-10-21T20:48:53.480292] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-10-21T20:48:53.481596] [DEBUG] [LOCAL ] RDW: Trimmed 75499 records to 52286 (keeping 200 days of data) [2025-10-21T20:48:53.762461] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-10-21T20:48:53.785561] [DEBUG] [LOCAL ] RDW: Primary data saved (52286 records). [2025-10-21T20:48:53.785776] [INFO ] [MAIN ] RDW: Full history saved. [2025-10-21T20:48:53.785852] [INFO ] [MAIN ] Update Progress: 1779/2366 symbols completed. RDW took 32.9s. Estimated remaining: 1h 15m 30s. Rate: 7.8 symbols/min [2025-10-21T20:48:53.987752] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:48:53.987983] [DEBUG] [LOCAL ] RES: No existing data file found in primary storage. [2025-10-21T20:48:53.988051] [WARN ] [MAIN ] RES: No existing data found, performing full refresh instead. [2025-10-21T20:48:53.988145] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-10-21T20:48:53.988183] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-10-21T20:48:53.988223] [DEBUG] [LOCAL ] RES: No primary data file found to delete. [2025-10-21T20:48:53.988253] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-10-21T20:48:54.357067] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:48:54.375894] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T20:48:54.550989] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-10-21T20:48:54.880469] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-21T20:48:55.351001] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-10-21T20:48:55.446131] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T20:48:56.073761] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T20:48:56.151081] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-10-21T20:48:56.885891] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T20:48:56.950984] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-10-21T20:48:57.751006] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-10-21T20:48:57.971523] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T20:48:58.204360] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T20:48:58.551039] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-10-21T20:48:59.351060] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-10-21T20:49:00.069876] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T20:49:00.151005] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-10-21T20:49:00.715571] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-21T20:49:00.951025] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-10. [2025-10-21T20:49:01.192153] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T20:49:01.586432] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T20:49:01.751064] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-10-21T20:49:02.551109] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-10-21T20:49:03.351034] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-10-21T20:49:03.617693] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T20:49:03.797523] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-10 (2.85 seconds). [2025-10-21T20:49:03.806138] [INFO ] [REMOTE ] RDDT: Full fetch complete (77929 records). [2025-10-21T20:49:03.806291] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-10-21T20:49:04.154074] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-10-21T20:49:04.199473] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-10-21T20:49:04.199629] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-10-21T20:49:04.200876] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-10-21T20:49:04.200993] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-10-21T20:49:04.202799] [DEBUG] [LOCAL ] RDDT: Trimmed 77929 records to 53772 (keeping 200 days of data) [2025-10-21T20:49:04.550569] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T20:49:04.564610] [DEBUG] [LOCAL ] RDDT: Primary data saved (53772 records). [2025-10-21T20:49:04.565183] [INFO ] [MAIN ] RDDT: Full history saved. [2025-10-21T20:49:04.574939] [INFO ] [MAIN ] Update Progress: 1780/2366 symbols completed. RDDT took 49.6s. Estimated remaining: 1h 15m 24s. Rate: 7.8 symbols/min [2025-10-21T20:49:04.743619] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:49:04.780571] [DEBUG] [LOCAL ] REVG: Loaded 40371 existing records from primary storage. [2025-10-21T20:49:04.780904] [INFO ] [MAIN ] REVG: Loaded 40371 existing records. [2025-10-21T20:49:04.953712] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-10-21T20:49:04.958823] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:49:04.960407] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-10-21T20:49:04.960621] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-10-21T20:49:04.960925] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-10-21T20:49:04.960978] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-10-21T20:49:05.182157] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T20:49:05.381885] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:49:05.750997] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-10-21T20:49:06.087718] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T20:49:06.551051] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-10-21T20:49:06.824961] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T20:49:07.350025] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T20:49:07.357921] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-10-21T20:49:08.151034] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-10-21T20:49:08.272496] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T20:49:08.836473] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T20:49:08.951011] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-10-21T20:49:09.751156] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-10. [2025-10-21T20:49:10.096437] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T20:49:10.551063] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-10-21T20:49:10.782912] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T20:49:11.351075] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-10-21T20:49:11.488155] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T20:49:11.494858] [INFO ] [REMOTE ] RERE: Full fetch complete (58037 records). [2025-10-21T20:49:11.495011] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-10-21T20:49:11.903623] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-10-21T20:49:11.903765] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-10-21T20:49:11.905387] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-10-21T20:49:11.905455] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-10-21T20:49:11.907493] [DEBUG] [LOCAL ] RERE: Trimmed 58037 records to 41775 (keeping 200 days of data) [2025-10-21T20:49:12.154400] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-10-21T20:49:12.164706] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T20:49:12.196612] [DEBUG] [LOCAL ] RERE: Primary data saved (41775 records). [2025-10-21T20:49:12.196774] [INFO ] [MAIN ] RERE: Full history saved. [2025-10-21T20:49:12.197495] [INFO ] [MAIN ] Update Progress: 1781/2366 symbols completed. RERE took 21.6s. Estimated remaining: 1h 15m 16s. Rate: 7.8 symbols/min [2025-10-21T20:49:12.369079] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:49:12.369237] [DEBUG] [LOCAL ] REX: No existing data file found in primary storage. [2025-10-21T20:49:12.369277] [WARN ] [MAIN ] REX: No existing data found, performing full refresh instead. [2025-10-21T20:49:12.369406] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-10-21T20:49:12.369463] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-10-21T20:49:12.369531] [DEBUG] [LOCAL ] REX: No primary data file found to delete. [2025-10-21T20:49:12.369565] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-10-21T20:49:12.722007] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:49:12.951036] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-10-21T20:49:13.067716] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T20:49:13.751013] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-10-21T20:49:14.160369] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-21T20:49:14.208870] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T20:49:14.551012] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-10-21T20:49:15.126866] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T20:49:15.351020] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-10-21T20:49:15.584412] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T20:49:16.151077] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-10-21T20:49:16.951061] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-10-21T20:49:17.084107] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T20:49:17.334422] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T20:49:17.751029] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-10-21T20:49:18.551080] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-10-21T20:49:18.825359] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T20:49:19.359437] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-10-21T20:49:19.362784] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T20:49:19.755405] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T20:49:20.151037] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-10-21T20:49:20.951079] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-10-21T20:49:21.162886] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T20:49:21.751096] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-10-21T20:49:21.982408] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T20:49:22.001540] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-21T20:49:22.551081] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-10. [2025-10-21T20:49:23.300500] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T20:49:23.350992] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-10-21T20:49:24.151045] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-10-21T20:49:24.327190] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T20:49:24.334752] [INFO ] [REMOTE ] RELX: Full fetch complete (68436 records). [2025-10-21T20:49:24.334851] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-10-21T20:49:24.716114] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-10-21T20:49:24.716185] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-10-21T20:49:24.717237] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-10-21T20:49:24.717298] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-10-21T20:49:24.718580] [DEBUG] [LOCAL ] RELX: Trimmed 68436 records to 48574 (keeping 200 days of data) [2025-10-21T20:49:24.952830] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-10-21T20:49:25.033095] [DEBUG] [LOCAL ] RELX: Primary data saved (48574 records). [2025-10-21T20:49:25.034634] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T20:49:25.033754] [INFO ] [MAIN ] RELX: Full history saved. [2025-10-21T20:49:25.034812] [INFO ] [MAIN ] Update Progress: 1782/2366 symbols completed. RELX took 36.2s. Estimated remaining: 1h 15m 10s. Rate: 7.8 symbols/min [2025-10-21T20:49:25.231556] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:49:25.231738] [DEBUG] [LOCAL ] REXR: No existing data file found in primary storage. [2025-10-21T20:49:25.231783] [WARN ] [MAIN ] REXR: No existing data found, performing full refresh instead. [2025-10-21T20:49:25.231893] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-10-21T20:49:25.231933] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-10-21T20:49:25.231973] [DEBUG] [LOCAL ] REXR: No primary data file found to delete. [2025-10-21T20:49:25.232003] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-10-21T20:49:25.591449] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:49:25.751018] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-10-21T20:49:25.758079] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T20:49:25.919549] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T20:49:26.551081] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-10-21T20:49:27.351066] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-10-21T20:49:27.513819] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T20:49:28.151051] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-10. [2025-10-21T20:49:28.382470] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T20:49:28.626325] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-21T20:49:28.951054] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-10-21T20:49:29.659812] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T20:49:29.666798] [INFO ] [REMOTE ] RES: Full fetch complete (68768 records). [2025-10-21T20:49:29.666953] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-10-21T20:49:29.760163] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-10-21T20:49:30.061424] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-10-21T20:49:30.061514] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-10-21T20:49:30.062661] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-10-21T20:49:30.062728] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-10-21T20:49:30.064128] [DEBUG] [LOCAL ] RES: Trimmed 68768 records to 46955 (keeping 200 days of data) [2025-10-21T20:49:30.333221] [DEBUG] [LOCAL ] RES: Primary data saved (46955 records). [2025-10-21T20:49:30.333357] [INFO ] [MAIN ] RES: Full history saved. [2025-10-21T20:49:30.333431] [INFO ] [MAIN ] Update Progress: 1783/2366 symbols completed. RES took 36.5s. Estimated remaining: 1h 15m 1s. Rate: 7.8 symbols/min [2025-10-21T20:49:30.508341] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:49:30.508535] [DEBUG] [LOCAL ] REZI: No existing data file found in primary storage. [2025-10-21T20:49:30.508586] [WARN ] [MAIN ] REZI: No existing data found, performing full refresh instead. [2025-10-21T20:49:30.508743] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-10-21T20:49:30.508830] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-10-21T20:49:30.508914] [DEBUG] [LOCAL ] REZI: No primary data file found to delete. [2025-10-21T20:49:30.508973] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-10-21T20:49:30.570004] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-10-21T20:49:30.793854] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T20:49:30.915829] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:49:30.940698] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-21T20:49:31.351106] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-10-21T20:49:32.151018] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-10. [2025-10-21T20:49:32.398326] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T20:49:32.687367] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T20:49:32.951036] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-10-21T20:49:33.340698] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T20:49:33.346880] [INFO ] [REMOTE ] REVG: Full fetch complete (57884 records). [2025-10-21T20:49:33.347028] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-10-21T20:49:33.743078] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-10-21T20:49:33.743209] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-10-21T20:49:33.745080] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-10-21T20:49:33.745226] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-10-21T20:49:33.746888] [DEBUG] [LOCAL ] REVG: Trimmed 57884 records to 40260 (keeping 200 days of data) [2025-10-21T20:49:33.801585] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-10-21T20:49:33.989848] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T20:49:34.029515] [DEBUG] [LOCAL ] REVG: Primary data saved (40260 records). [2025-10-21T20:49:34.029665] [INFO ] [MAIN ] REVG: Full history saved. [2025-10-21T20:49:34.030223] [INFO ] [MAIN ] Update Progress: 1784/2366 symbols completed. REVG took 29.5s. Estimated remaining: 1h 14m 52s. Rate: 7.8 symbols/min [2025-10-21T20:49:34.205129] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:49:34.205311] [DEBUG] [LOCAL ] RF: No existing data file found in primary storage. [2025-10-21T20:49:34.205348] [WARN ] [MAIN ] RF: No existing data found, performing full refresh instead. [2025-10-21T20:49:34.205455] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-10-21T20:49:34.205495] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-10-21T20:49:34.205534] [DEBUG] [LOCAL ] RF: No primary data file found to delete. [2025-10-21T20:49:34.205564] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-10-21T20:49:34.553896] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-10-21T20:49:34.566314] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:49:35.350996] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-10-21T20:49:35.652760] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T20:49:35.696193] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T20:49:36.151072] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-10. [2025-10-21T20:49:36.880959] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T20:49:36.950979] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-10-21T20:49:37.260983] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-21T20:49:37.264302] [INFO ] [REMOTE ] REX: Full fetch complete (21181 records). [2025-10-21T20:49:37.264372] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-10-21T20:49:37.630601] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-10-21T20:49:37.630705] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-10-21T20:49:37.631346] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-10-21T20:49:37.631408] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-10-21T20:49:37.632023] [DEBUG] [LOCAL ] REX: Trimmed 21181 records to 14379 (keeping 200 days of data) [2025-10-21T20:49:37.721196] [DEBUG] [LOCAL ] REX: Primary data saved (14379 records). [2025-10-21T20:49:37.721337] [INFO ] [MAIN ] REX: Full history saved. [2025-10-21T20:49:37.721410] [INFO ] [MAIN ] Update Progress: 1785/2366 symbols completed. REX took 25.5s. Estimated remaining: 1h 14m 43s. Rate: 7.8 symbols/min [2025-10-21T20:49:37.756261] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-10-21T20:49:37.899046] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:49:37.911687] [DEBUG] [LOCAL ] RFI: Loaded 10384 existing records from primary storage. [2025-10-21T20:49:37.911908] [INFO ] [MAIN ] RFI: Loaded 10384 existing records. [2025-10-21T20:49:38.089069] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:49:38.089310] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-10-21T20:49:38.089359] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-10-21T20:49:38.089544] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-10-21T20:49:38.089600] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-10-21T20:49:38.461053] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:49:38.498414] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T20:49:38.550980] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-10-21T20:49:39.351017] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-10-21T20:49:39.384146] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T20:49:40.151049] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-10-21T20:49:40.394470] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T20:49:40.685881] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T20:49:40.951017] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-10-21T20:49:41.751014] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-10-21T20:49:41.907383] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T20:49:42.551001] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-10-21T20:49:42.617520] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T20:49:43.351050] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-10-21T20:49:43.470241] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T20:49:43.659928] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T20:49:44.151071] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-10-21T20:49:44.894851] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T20:49:44.951037] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-10-21T20:49:45.085558] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T20:49:45.751075] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-10-21T20:49:46.550996] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-10-21T20:49:46.860452] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T20:49:47.203491] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T20:49:47.350997] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-10-21T20:49:47.384160] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T20:49:48.151020] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-10-21T20:49:48.951006] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-10-21T20:49:49.082802] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T20:49:49.254128] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T20:49:49.751024] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-10-21T20:49:50.551074] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-10-21T20:49:50.601728] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T20:49:50.760229] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T20:49:51.351039] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-10-21T20:49:52.151080] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-10-21T20:49:52.484135] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T20:49:52.951100] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-10-21T20:49:53.268849] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T20:49:53.751033] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-10-21T20:49:53.904162] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T20:49:54.551008] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-10-21T20:49:55.090343] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T20:49:55.350996] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-10-21T20:49:55.529601] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T20:49:55.587432] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:49:56.151080] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-10. [2025-10-21T20:49:56.951072] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-10-21T20:49:57.321859] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T20:49:57.702683] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T20:49:57.751037] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-10-21T20:49:57.904776] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T20:49:57.911888] [INFO ] [REMOTE ] REZI: Full fetch complete (66185 records). [2025-10-21T20:49:57.911994] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-10-21T20:49:58.296466] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-10-21T20:49:58.296553] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-10-21T20:49:58.297971] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-10-21T20:49:58.298040] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-10-21T20:49:58.299529] [DEBUG] [LOCAL ] REZI: Trimmed 66185 records to 47128 (keeping 200 days of data) [2025-10-21T20:49:58.551289] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-10. [2025-10-21T20:49:58.573555] [DEBUG] [LOCAL ] REZI: Primary data saved (47128 records). [2025-10-21T20:49:58.573735] [INFO ] [MAIN ] REZI: Full history saved. [2025-10-21T20:49:58.573820] [INFO ] [MAIN ] Update Progress: 1786/2366 symbols completed. REZI took 28.2s. Estimated remaining: 1h 14m 40s. Rate: 7.8 symbols/min [2025-10-21T20:49:58.754505] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T20:49:58.754219] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:49:58.769835] [DEBUG] [LOCAL ] RFL: Loaded 11457 existing records from primary storage. [2025-10-21T20:49:58.770045] [INFO ] [MAIN ] RFL: Loaded 11457 existing records. [2025-10-21T20:49:58.952450] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:49:58.952706] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-10-21T20:49:58.952765] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-10-21T20:49:58.952951] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-10-21T20:49:58.953006] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-10-21T20:49:59.307237] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:49:59.351074] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-10-21T20:50:00.027204] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T20:50:00.151046] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-10. [2025-10-21T20:50:00.433101] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T20:50:00.445634] [INFO ] [REMOTE ] REXR: Full fetch complete (75327 records). [2025-10-21T20:50:00.445800] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-10-21T20:50:00.834251] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-10-21T20:50:00.834355] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-10-21T20:50:00.835573] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-10-21T20:50:00.835672] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-10-21T20:50:00.834094] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-21T20:50:00.838265] [INFO ] [REMOTE ] RFI: Full fetch complete (15149 records). [2025-10-21T20:50:00.838473] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-10-21T20:50:00.883076] [DEBUG] [LOCAL ] REXR: Trimmed 75327 records to 52204 (keeping 200 days of data) [2025-10-21T20:50:00.991939] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-10-21T20:50:01.497932] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-10-21T20:50:01.503838] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-10-21T20:50:01.519522] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-10-21T20:50:01.519765] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-10-21T20:50:01.523734] [DEBUG] [LOCAL ] RFI: Trimmed 15149 records to 10308 (keeping 200 days of data) [2025-10-21T20:50:01.573482] [DEBUG] [LOCAL ] REXR: Primary data saved (52204 records). [2025-10-21T20:50:01.578869] [INFO ] [MAIN ] REXR: Full history saved. [2025-10-21T20:50:01.592497] [INFO ] [MAIN ] Update Progress: 1787/2366 symbols completed. REXR took 36.5s. Estimated remaining: 1h 14m 30s. Rate: 7.8 symbols/min [2025-10-21T20:50:01.782810] [DEBUG] [LOCAL ] RFI: Primary data saved (10308 records). [2025-10-21T20:50:01.785758] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-10-21T20:50:01.785975] [INFO ] [MAIN ] RFI: Full history saved. [2025-10-21T20:50:01.785633] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:01.787194] [INFO ] [MAIN ] Update Progress: 1788/2366 symbols completed. RFI took 24.1s. Estimated remaining: 1h 14m 20s. Rate: 7.8 symbols/min [2025-10-21T20:50:01.870782] [DEBUG] [LOCAL ] RFM: Loaded 4195 existing records from primary storage. [2025-10-21T20:50:01.897689] [INFO ] [MAIN ] RFM: Loaded 4195 existing records. [2025-10-21T20:50:02.084387] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:02.168901] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:50:02.172589] [DEBUG] [LOCAL ] RFMZ: Loaded 8876 existing records from primary storage. [2025-10-21T20:50:02.172821] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-10-21T20:50:02.172906] [INFO ] [MAIN ] RFMZ: Loaded 8876 existing records. [2025-10-21T20:50:02.173002] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-10-21T20:50:02.241608] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-10-21T20:50:02.270807] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-10-21T20:50:02.472048] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:50:02.493755] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-10-21T20:50:02.535238] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-10-21T20:50:02.523465] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T20:50:02.583313] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-10-21T20:50:02.594200] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-10-21T20:50:02.594428] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-10-21T20:50:02.947867] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:03.156501] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:03.188833] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-21T20:50:03.350981] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-10-21T20:50:03.439272] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T20:50:04.151045] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-10-21T20:50:04.284443] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T20:50:04.951102] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-10-21T20:50:05.751032] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-10-21T20:50:05.759518] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T20:50:06.050543] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T20:50:06.274343] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-21T20:50:06.551037] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-10-21T20:50:07.351045] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-10-21T20:50:07.367149] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-21T20:50:08.151034] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-10-21T20:50:08.950999] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-10-21T20:50:09.123095] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T20:50:09.382334] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T20:50:09.751036] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-10-21T20:50:09.798284] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T20:50:10.550992] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-10-21T20:50:10.700820] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T20:50:11.351044] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-10-21T20:50:11.537589] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T20:50:12.151113] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-10-21T20:50:12.951037] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-10-21T20:50:12.986792] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T20:50:13.241872] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T20:50:13.751045] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-10-21T20:50:14.199806] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T20:50:14.551064] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-10-21T20:50:14.840362] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T20:50:15.351088] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-10-21T20:50:15.883864] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T20:50:16.151048] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-10. [2025-10-21T20:50:16.212723] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T20:50:16.951008] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-10-21T20:50:17.531241] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T20:50:17.751048] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-10-21T20:50:18.072131] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T20:50:18.080327] [INFO ] [REMOTE ] RF: Full fetch complete (77796 records). [2025-10-21T20:50:18.080453] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-10-21T20:50:18.484196] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-10-21T20:50:18.484273] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-10-21T20:50:18.485397] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-10-21T20:50:18.485467] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-10-21T20:50:18.486854] [DEBUG] [LOCAL ] RF: Trimmed 77796 records to 53633 (keeping 200 days of data) [2025-10-21T20:50:18.573958] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-10-21T20:50:18.580259] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-21T20:50:18.819151] [DEBUG] [LOCAL ] RF: Primary data saved (53633 records). [2025-10-21T20:50:18.819294] [INFO ] [MAIN ] RF: Full history saved. [2025-10-21T20:50:18.819367] [INFO ] [MAIN ] Update Progress: 1789/2366 symbols completed. RF took 44.8s. Estimated remaining: 1h 14m 16s. Rate: 7.8 symbols/min [2025-10-21T20:50:18.984432] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:18.984586] [DEBUG] [LOCAL ] RGA: No existing data file found in primary storage. [2025-10-21T20:50:18.984622] [WARN ] [MAIN ] RGA: No existing data found, performing full refresh instead. [2025-10-21T20:50:18.984750] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-10-21T20:50:18.984792] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-10-21T20:50:18.984858] [DEBUG] [LOCAL ] RGA: No primary data file found to delete. [2025-10-21T20:50:18.984923] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-10-21T20:50:19.336150] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:19.351000] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-10-21T20:50:19.593891] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T20:50:20.151030] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-10-21T20:50:20.950989] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-10-21T20:50:20.981989] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T20:50:21.340630] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T20:50:21.751031] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-10-21T20:50:21.853476] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-21T20:50:22.551046] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-10-21T20:50:22.683748] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T20:50:23.351067] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-10. [2025-10-21T20:50:24.151024] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-10-21T20:50:24.191033] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T20:50:24.208111] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T20:50:24.210134] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12348 records). [2025-10-21T20:50:24.210203] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-10-21T20:50:24.566379] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-10-21T20:50:24.566457] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-10-21T20:50:24.566749] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-10-21T20:50:24.566809] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-10-21T20:50:24.567257] [DEBUG] [LOCAL ] RFMZ: Trimmed 12348 records to 8978 (keeping 200 days of data) [2025-10-21T20:50:24.626049] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8978 records). [2025-10-21T20:50:24.626295] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-10-21T20:50:24.626393] [INFO ] [MAIN ] Update Progress: 1790/2366 symbols completed. RFMZ took 22.8s. Estimated remaining: 1h 14m 7s. Rate: 7.8 symbols/min [2025-10-21T20:50:24.791383] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:24.791544] [DEBUG] [LOCAL ] RGR: No existing data file found in primary storage. [2025-10-21T20:50:24.791580] [WARN ] [MAIN ] RGR: No existing data found, performing full refresh instead. [2025-10-21T20:50:24.791763] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-10-21T20:50:24.791803] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-10-21T20:50:24.791843] [DEBUG] [LOCAL ] RGR: No primary data file found to delete. [2025-10-21T20:50:24.791873] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-10-21T20:50:24.959859] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-10-21T20:50:25.169016] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T20:50:25.198970] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:25.723546] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T20:50:25.750979] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-10-21T20:50:26.454638] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T20:50:26.550992] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-10-21T20:50:27.073719] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-21T20:50:27.351037] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-10-21T20:50:28.151035] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-10. [2025-10-21T20:50:28.951009] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-10-21T20:50:29.047568] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T20:50:29.091565] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T20:50:29.093414] [INFO ] [REMOTE ] RFL: Full fetch complete (13266 records). [2025-10-21T20:50:29.093484] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-10-21T20:50:29.447541] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-10-21T20:50:29.447634] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-10-21T20:50:29.447973] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-10-21T20:50:29.448015] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-10-21T20:50:29.448463] [DEBUG] [LOCAL ] RFL: Trimmed 13266 records to 11446 (keeping 200 days of data) [2025-10-21T20:50:29.514407] [DEBUG] [LOCAL ] RFL: Primary data saved (11446 records). [2025-10-21T20:50:29.514550] [INFO ] [MAIN ] RFL: Full history saved. [2025-10-21T20:50:29.514669] [INFO ] [MAIN ] Update Progress: 1791/2366 symbols completed. RFL took 30.9s. Estimated remaining: 1h 13m 59s. Rate: 7.8 symbols/min [2025-10-21T20:50:29.683898] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:29.689278] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T20:50:29.695193] [DEBUG] [LOCAL ] RGT: Loaded 2730 existing records from primary storage. [2025-10-21T20:50:29.695341] [INFO ] [MAIN ] RGT: Loaded 2730 existing records. [2025-10-21T20:50:29.756229] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-10-21T20:50:29.893601] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:50:29.893822] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-10-21T20:50:29.893866] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-10-21T20:50:29.894046] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-10-21T20:50:29.894101] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-10-21T20:50:30.243063] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:30.551035] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-10-21T20:50:31.066990] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T20:50:31.351033] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-10-21T20:50:32.031027] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T20:50:32.151030] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-10-21T20:50:32.218778] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T20:50:32.951081] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-10-21T20:50:33.380923] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T20:50:33.751041] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-10-21T20:50:34.533159] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T20:50:34.550977] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-10-21T20:50:34.555381] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T20:50:35.351013] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-10-21T20:50:35.896801] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T20:50:36.151068] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-10-21T20:50:36.206299] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T20:50:36.760978] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T20:50:36.951054] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-10-21T20:50:37.751093] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-10-21T20:50:38.460187] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T20:50:38.550979] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-10-21T20:50:38.997745] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T20:50:39.351044] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-10. [2025-10-21T20:50:39.928222] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T20:50:39.999569] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T20:50:40.000724] [INFO ] [REMOTE ] RFM: Full fetch complete (5692 records). [2025-10-21T20:50:40.000812] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-10-21T20:50:40.150985] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-10-21T20:50:40.354087] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-10-21T20:50:40.354160] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-10-21T20:50:40.354317] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-10-21T20:50:40.354354] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-10-21T20:50:40.354730] [DEBUG] [LOCAL ] RFM: Trimmed 5692 records to 4210 (keeping 200 days of data) [2025-10-21T20:50:40.379734] [DEBUG] [LOCAL ] RFM: Primary data saved (4210 records). [2025-10-21T20:50:40.379805] [INFO ] [MAIN ] RFM: Full history saved. [2025-10-21T20:50:40.379875] [INFO ] [MAIN ] Update Progress: 1792/2366 symbols completed. RFM took 38.8s. Estimated remaining: 1h 13m 52s. Rate: 7.8 symbols/min [2025-10-21T20:50:40.550016] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:40.550237] [DEBUG] [LOCAL ] RH: No existing data file found in primary storage. [2025-10-21T20:50:40.550286] [WARN ] [MAIN ] RH: No existing data found, performing full refresh instead. [2025-10-21T20:50:40.550399] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-10-21T20:50:40.550473] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-10-21T20:50:40.550544] [DEBUG] [LOCAL ] RH: No primary data file found to delete. [2025-10-21T20:50:40.550606] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-10-21T20:50:40.913593] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:40.950980] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-10-21T20:50:41.633117] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T20:50:41.750992] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-10. [2025-10-21T20:50:42.551029] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-10-21T20:50:42.687950] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T20:50:43.087556] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T20:50:43.092274] [INFO ] [REMOTE ] RGA: Full fetch complete (45033 records). [2025-10-21T20:50:43.092362] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-10-21T20:50:43.356780] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-10-21T20:50:43.477350] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-10-21T20:50:43.477424] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-10-21T20:50:43.478354] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-10-21T20:50:43.478418] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-10-21T20:50:43.479366] [DEBUG] [LOCAL ] RGA: Trimmed 45033 records to 29320 (keeping 200 days of data) [2025-10-21T20:50:43.655403] [DEBUG] [LOCAL ] RGA: Primary data saved (29320 records). [2025-10-21T20:50:43.655523] [INFO ] [MAIN ] RGA: Full history saved. [2025-10-21T20:50:43.655589] [INFO ] [MAIN ] Update Progress: 1793/2366 symbols completed. RGA took 24.8s. Estimated remaining: 1h 13m 43s. Rate: 7.8 symbols/min [2025-10-21T20:50:43.831464] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:43.831708] [DEBUG] [LOCAL ] RHI: No existing data file found in primary storage. [2025-10-21T20:50:43.831815] [WARN ] [MAIN ] RHI: No existing data found, performing full refresh instead. [2025-10-21T20:50:43.831947] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-10-21T20:50:43.831999] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-10-21T20:50:43.832047] [DEBUG] [LOCAL ] RHI: No primary data file found to delete. [2025-10-21T20:50:43.832080] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-10-21T20:50:44.110096] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T20:50:44.156087] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-10-21T20:50:44.220343] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:44.854134] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T20:50:44.951017] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-10-21T20:50:45.087503] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T20:50:45.751095] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-10-21T20:50:46.210759] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T20:50:46.551107] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-10-21T20:50:47.350996] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-10-21T20:50:47.401263] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T20:50:47.737046] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T20:50:48.151029] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-10-21T20:50:48.826738] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-21T20:50:48.950988] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-10-21T20:50:49.027945] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T20:50:49.751000] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-10-21T20:50:49.775343] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T20:50:50.551021] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-10-21T20:50:51.351011] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-10-21T20:50:51.586232] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T20:50:51.642001] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T20:50:52.080459] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T20:50:52.151054] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-10-21T20:50:52.951034] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-10-21T20:50:53.509868] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T20:50:53.751046] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-10-21T20:50:54.551014] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-10. [2025-10-21T20:50:55.186726] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-21T20:50:55.351046] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-10-21T20:50:55.591296] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T20:50:55.777676] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T20:50:55.781159] [INFO ] [REMOTE ] RGR: Full fetch complete (28795 records). [2025-10-21T20:50:55.781228] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-10-21T20:50:55.892226] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T20:50:56.156124] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-10-21T20:50:56.157106] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-10-21T20:50:56.157203] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-10-21T20:50:56.158581] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-10-21T20:50:56.158690] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-10-21T20:50:56.159624] [DEBUG] [LOCAL ] RGR: Trimmed 28795 records to 21070 (keeping 200 days of data) [2025-10-21T20:50:56.290814] [DEBUG] [LOCAL ] RGR: Primary data saved (21070 records). [2025-10-21T20:50:56.290934] [INFO ] [MAIN ] RGR: Full history saved. [2025-10-21T20:50:56.291000] [INFO ] [MAIN ] Update Progress: 1794/2366 symbols completed. RGR took 31.7s. Estimated remaining: 1h 13m 37s. Rate: 7.8 symbols/min [2025-10-21T20:50:56.466346] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:56.466507] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-10-21T20:50:56.466545] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-10-21T20:50:56.466700] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-10-21T20:50:56.466755] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-21T20:50:56.466798] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-21T20:50:56.466830] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-10-21T20:50:56.832152] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:56.951005] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-10-21T20:50:57.321203] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:50:57.321494] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-10-21T20:50:57.321582] [FATAL] [REMOTE ] RHLD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:50:57.321626] [FATAL] [MAIN ] RHLD: Failed to fetch primary data. [2025-10-21T20:50:57.321695] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:50:57.321743] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-10-21T20:50:57.321797] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-10-21T20:50:57.321832] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-10-21T20:50:57.321870] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-10-21T20:50:57.321913] [INFO ] [MAIN ] Update Progress: 1795/2366 symbols completed. RHLD took 1.0s. Estimated remaining: 1h 13m 27s. Rate: 7.8 symbols/min [2025-10-21T20:50:57.498321] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:50:57.498455] [DEBUG] [LOCAL ] RHP: No existing data file found in primary storage. [2025-10-21T20:50:57.498491] [WARN ] [MAIN ] RHP: No existing data found, performing full refresh instead. [2025-10-21T20:50:57.498595] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-10-21T20:50:57.498635] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-10-21T20:50:57.498739] [DEBUG] [LOCAL ] RHP: No primary data file found to delete. [2025-10-21T20:50:57.498778] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-10-21T20:50:57.751395] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-10-21T20:50:57.865606] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:50:58.037182] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T20:50:58.551026] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-10-21T20:50:59.351075] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-10-21T20:50:59.868755] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T20:51:00.151329] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-10-21T20:51:00.156094] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T20:51:00.951022] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-10-21T20:51:01.214515] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T20:51:01.569523] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T20:51:01.751048] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-10-21T20:51:02.299102] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-21T20:51:02.551048] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-10-21T20:51:03.232795] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T20:51:03.263554] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T20:51:03.351012] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-10-21T20:51:04.151016] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-10-21T20:51:04.951087] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-10. [2025-10-21T20:51:05.305900] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T20:51:05.626837] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-21T20:51:05.627983] [INFO ] [REMOTE ] RGT: Full fetch complete (3936 records). [2025-10-21T20:51:05.628071] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-10-21T20:51:05.756169] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-10-21T20:51:06.012908] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-10-21T20:51:06.013097] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-10-21T20:51:06.013261] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-10-21T20:51:06.013335] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-10-21T20:51:06.013887] [DEBUG] [LOCAL ] RGT: Trimmed 3936 records to 2719 (keeping 200 days of data) [2025-10-21T20:51:06.031048] [DEBUG] [LOCAL ] RGT: Primary data saved (2719 records). [2025-10-21T20:51:06.031192] [INFO ] [MAIN ] RGT: Full history saved. [2025-10-21T20:51:06.031318] [INFO ] [MAIN ] Update Progress: 1796/2366 symbols completed. RGT took 36.5s. Estimated remaining: 1h 13m 19s. Rate: 7.8 symbols/min [2025-10-21T20:51:06.204389] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-21T20:51:06.259456] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:51:06.259682] [DEBUG] [LOCAL ] RIG: No existing data file found in primary storage. [2025-10-21T20:51:06.259737] [WARN ] [MAIN ] RIG: No existing data found, performing full refresh instead. [2025-10-21T20:51:06.259851] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-10-21T20:51:06.259892] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-10-21T20:51:06.259933] [DEBUG] [LOCAL ] RIG: No primary data file found to delete. [2025-10-21T20:51:06.259985] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-10-21T20:51:06.556177] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-10-21T20:51:06.606375] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:51:07.351019] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-10-21T20:51:07.674423] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T20:51:08.151084] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-10-21T20:51:08.579264] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T20:51:08.951051] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-10-21T20:51:09.668851] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-21T20:51:09.750992] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-10-21T20:51:10.105488] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T20:51:10.516667] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T20:51:10.550991] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-10-21T20:51:11.351051] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-10. [2025-10-21T20:51:11.668361] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T20:51:12.151064] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-10-21T20:51:12.366960] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T20:51:12.951010] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-10-21T20:51:13.204224] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T20:51:13.211313] [INFO ] [REMOTE ] RH: Full fetch complete (66210 records). [2025-10-21T20:51:13.211445] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-10-21T20:51:13.595028] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-10-21T20:51:13.595117] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-10-21T20:51:13.596320] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-10-21T20:51:13.596386] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-10-21T20:51:13.597781] [DEBUG] [LOCAL ] RH: Trimmed 66210 records to 47171 (keeping 200 days of data) [2025-10-21T20:51:13.771404] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-10-21T20:51:13.895248] [DEBUG] [LOCAL ] RH: Primary data saved (47171 records). [2025-10-21T20:51:13.895637] [INFO ] [MAIN ] RH: Full history saved. [2025-10-21T20:51:13.895803] [INFO ] [MAIN ] Update Progress: 1797/2366 symbols completed. RH took 33.5s. Estimated remaining: 1h 13m 12s. Rate: 7.8 symbols/min [2025-10-21T20:51:14.002191] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T20:51:14.556154] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-10-21T20:51:14.567967] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T20:51:15.351055] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-10-21T20:51:15.616847] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T20:51:16.026095] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T20:51:16.151002] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-10-21T20:51:16.556120] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T20:51:16.951017] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-10-21T20:51:17.751002] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-10-21T20:51:17.913336] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T20:51:18.546692] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T20:51:18.554333] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-10. [2025-10-21T20:51:19.351169] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-10-21T20:51:19.941737] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-21T20:51:20.150999] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-10-21T20:51:20.274584] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T20:51:20.282379] [INFO ] [REMOTE ] RHI: Full fetch complete (70824 records). [2025-10-21T20:51:20.282579] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-10-21T20:51:20.684148] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-10-21T20:51:20.684246] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-10-21T20:51:20.685360] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-10-21T20:51:20.685485] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-10-21T20:51:20.687013] [DEBUG] [LOCAL ] RHI: Trimmed 70824 records to 49676 (keeping 200 days of data) [2025-10-21T20:51:20.818347] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T20:51:20.954367] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-10. [2025-10-21T20:51:21.016326] [DEBUG] [LOCAL ] RHI: Primary data saved (49676 records). [2025-10-21T20:51:21.016446] [INFO ] [MAIN ] RHI: Full history saved. [2025-10-21T20:51:21.016533] [INFO ] [MAIN ] Update Progress: 1798/2366 symbols completed. RHI took 37.4s. Estimated remaining: 1h 13m 4s. Rate: 7.8 symbols/min [2025-10-21T20:51:22.147579] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T20:51:22.158580] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-10-21T20:51:22.488491] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T20:51:22.495216] [INFO ] [REMOTE ] RHP: Full fetch complete (58314 records). [2025-10-21T20:51:22.495375] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-10-21T20:51:22.885695] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-10-21T20:51:22.885796] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-10-21T20:51:22.886791] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-10-21T20:51:22.886853] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-10-21T20:51:22.888131] [DEBUG] [LOCAL ] RHP: Trimmed 58314 records to 40408 (keeping 200 days of data) [2025-10-21T20:51:23.142948] [DEBUG] [LOCAL ] RHP: Primary data saved (40408 records). [2025-10-21T20:51:23.143099] [INFO ] [MAIN ] RHP: Full history saved. [2025-10-21T20:51:23.143197] [INFO ] [MAIN ] Update Progress: 1799/2366 symbols completed. RHP took 25.8s. Estimated remaining: 1h 12m 54s. Rate: 7.8 symbols/min [2025-10-21T20:51:24.256972] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-21T20:51:24.267948] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-10-21T20:51:26.367481] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T20:51:26.379226] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-10-21T20:51:28.480888] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T20:51:28.492551] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-10-21T20:51:30.394359] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T20:51:30.406006] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-10. [2025-10-21T20:51:32.563312] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-21T20:51:32.574709] [INFO ] [REMOTE ] RIG: Full fetch complete (77844 records). [2025-10-21T20:51:32.574895] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-10-21T20:51:32.956949] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-10-21T20:51:32.957026] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-10-21T20:51:32.958197] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-10-21T20:51:32.958261] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-10-21T20:51:32.959602] [DEBUG] [LOCAL ] RIG: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-21T20:51:33.255979] [DEBUG] [LOCAL ] RIG: Primary data saved (53675 records). [2025-10-21T20:51:33.256108] [INFO ] [MAIN ] RIG: Full history saved. [2025-10-21T20:51:33.256177] [INFO ] [MAIN ] Update Progress: 1800/2366 symbols completed. RIG took 27.2s. Estimated remaining: 1h 12m 47s. Rate: 7.8 symbols/min [2025-10-21T20:51:33.868871] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:51:33.960999] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:51:33.980048] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:51:33.980354] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-10-21T20:51:33.978950] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:51:33.980746] [DEBUG] [LOCAL ] RJF: No existing data file found in primary storage. [2025-10-21T20:51:33.980995] [WARN ] [MAIN ] RJF: No existing data found, performing full refresh instead. [2025-10-21T20:51:33.981299] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-10-21T20:51:33.981385] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-10-21T20:51:33.981484] [DEBUG] [LOCAL ] RJF: No primary data file found to delete. [2025-10-21T20:51:33.981550] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-10-21T20:51:33.981249] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-10-21T20:51:33.981855] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-10-21T20:51:33.987817] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-10-21T20:51:33.993834] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-10-21T20:51:34.028669] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-10-21T20:51:34.253678] [DEBUG] [LOCAL ] RIV: Loaded 12682 existing records from primary storage. [2025-10-21T20:51:34.296005] [INFO ] [MAIN ] RIV: Loaded 12682 existing records. [2025-10-21T20:51:34.676245] [DEBUG] [LOCAL ] RIO: Loaded 53402 existing records from primary storage. [2025-10-21T20:51:34.709944] [INFO ] [MAIN ] RIO: Loaded 53402 existing records. [2025-10-21T20:51:34.896866] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:51:35.002712] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:51:35.018901] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-10-21T20:51:35.018803] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-10-21T20:51:35.029686] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-10-21T20:51:35.070568] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:51:35.057312] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-10-21T20:51:35.076061] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-10-21T20:51:35.070738] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-10-21T20:51:35.184435] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:51:35.196864] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-10-21T20:51:35.217869] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-10-21T20:51:35.234325] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-10-21T20:51:35.234419] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-10-21T20:51:35.856492] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:51:35.875323] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-10-21T20:51:35.916636] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:51:35.917045] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-10-21T20:51:36.956907] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T20:51:36.968053] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-10-21T20:51:37.033550] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-21T20:51:37.043326] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-10-21T20:51:37.152816] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T20:51:37.156030] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-10-21T20:51:37.848410] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T20:51:37.859310] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-10-21T20:51:38.037239] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T20:51:38.040016] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-10-21T20:51:38.511337] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T20:51:38.521480] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-10-21T20:51:38.703492] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T20:51:38.714082] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-10-21T20:51:38.975685] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T20:51:38.979027] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-10-21T20:51:39.614503] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T20:51:39.624469] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-10-21T20:51:39.909390] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T20:51:39.912428] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-10-21T20:51:40.295887] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T20:51:40.307424] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-10-21T20:51:40.730126] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T20:51:40.740978] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-10-21T20:51:40.788841] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T20:51:40.790982] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-10-21T20:51:41.429557] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-21T20:51:41.431992] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-10-21T20:51:41.637325] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T20:51:41.648484] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-10-21T20:51:42.380240] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-21T20:51:42.383852] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-10-21T20:51:42.446423] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T20:51:42.457328] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-10-21T20:51:42.922477] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T20:51:42.933571] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-10-21T20:51:43.365486] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T20:51:43.368828] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-10-21T20:51:44.115682] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-21T20:51:44.150985] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-10-21T20:51:44.520747] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T20:51:44.609503] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T20:51:44.951007] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-10. [2025-10-21T20:51:45.030804] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-21T20:51:45.750993] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-10-21T20:51:45.948377] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T20:51:45.951171] [INFO ] [REMOTE ] RIV: Full fetch complete (17540 records). [2025-10-21T20:51:45.951244] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-10-21T20:51:46.324769] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-10-21T20:51:46.324917] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-10-21T20:51:46.325403] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-10-21T20:51:46.325479] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-10-21T20:51:46.326240] [DEBUG] [LOCAL ] RIV: Trimmed 17540 records to 12687 (keeping 200 days of data) [2025-10-21T20:51:46.411476] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-21T20:51:46.443946] [DEBUG] [LOCAL ] RIV: Primary data saved (12687 records). [2025-10-21T20:51:46.444056] [INFO ] [MAIN ] RIV: Full history saved. [2025-10-21T20:51:46.444128] [INFO ] [MAIN ] Update Progress: 1801/2366 symbols completed. RIV took 13.2s. Estimated remaining: 1h 12m 41s. Rate: 7.8 symbols/min [2025-10-21T20:51:46.556135] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-10-21T20:51:46.621901] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:51:46.622044] [DEBUG] [LOCAL ] RKT: No existing data file found in primary storage. [2025-10-21T20:51:46.622080] [WARN ] [MAIN ] RKT: No existing data found, performing full refresh instead. [2025-10-21T20:51:46.622187] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-10-21T20:51:46.622229] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-10-21T20:51:46.622273] [DEBUG] [LOCAL ] RKT: No primary data file found to delete. [2025-10-21T20:51:46.622306] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-10-21T20:51:46.969535] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:51:47.351048] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-10-21T20:51:47.583795] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T20:51:48.151000] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-10-21T20:51:48.381210] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T20:51:48.951050] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-10-21T20:51:49.403358] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-21T20:51:49.751103] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-10-21T20:51:50.257150] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T20:51:50.551059] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-10-21T20:51:51.138141] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-21T20:51:51.351032] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-10-21T20:51:51.583614] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T20:51:52.054438] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T20:51:52.151010] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-10-21T20:51:52.950993] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-10-21T20:51:53.387438] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T20:51:53.751024] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-10-21T20:51:54.401785] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-21T20:51:54.551022] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-10-21T20:51:55.340408] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-21T20:51:55.351501] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-10-21T20:51:55.916234] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-21T20:51:56.151037] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-10-21T20:51:56.951075] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-10. [2025-10-21T20:51:57.092092] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T20:51:57.307397] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-10-21T20:51:57.751014] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-10-21T20:51:57.906055] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T20:51:58.551099] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-10-21T20:51:59.134620] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-21T20:51:59.143852] [INFO ] [REMOTE ] RITM: Full fetch complete (76750 records). [2025-10-21T20:51:59.144024] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-10-21T20:51:59.358582] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-10-21T20:51:59.559852] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-10-21T20:51:59.560067] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-10-21T20:51:59.562264] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-10-21T20:51:59.562367] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-10-21T20:51:59.591806] [DEBUG] [LOCAL ] RITM: Trimmed 76750 records to 52948 (keeping 200 days of data) [2025-10-21T20:51:59.593443] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:51:59.961740] [DEBUG] [LOCAL ] RITM: Primary data saved (52948 records). [2025-10-21T20:51:59.961960] [INFO ] [MAIN ] RITM: Full history saved. [2025-10-21T20:51:59.962097] [INFO ] [MAIN ] Update Progress: 1802/2366 symbols completed. RITM took 26.7s. Estimated remaining: 1h 12m 35s. Rate: 7.8 symbols/min [2025-10-21T20:52:00.165567] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-10. [2025-10-21T20:52:00.173544] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:00.174168] [DEBUG] [LOCAL ] RL: No existing data file found in primary storage. [2025-10-21T20:52:00.175235] [WARN ] [MAIN ] RL: No existing data found, performing full refresh instead. [2025-10-21T20:52:00.175541] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-10-21T20:52:00.175679] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-10-21T20:52:00.175893] [DEBUG] [LOCAL ] RL: No primary data file found to delete. [2025-10-21T20:52:00.175961] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-10-21T20:52:00.605560] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T20:52:00.612240] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:00.951082] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-10-21T20:52:01.751002] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-10-21T20:52:01.976231] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-21T20:52:02.024405] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T20:52:02.031681] [INFO ] [REMOTE ] RJF: Full fetch complete (68819 records). [2025-10-21T20:52:02.031807] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-10-21T20:52:02.419106] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-10-21T20:52:02.419184] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-10-21T20:52:02.420235] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-10-21T20:52:02.420297] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-10-21T20:52:02.421543] [DEBUG] [LOCAL ] RJF: Trimmed 68819 records to 46561 (keeping 200 days of data) [2025-10-21T20:52:02.596514] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-10. [2025-10-21T20:52:02.706434] [DEBUG] [LOCAL ] RJF: Primary data saved (46561 records). [2025-10-21T20:52:02.706551] [INFO ] [MAIN ] RJF: Full history saved. [2025-10-21T20:52:02.706617] [INFO ] [MAIN ] Update Progress: 1803/2366 symbols completed. RJF took 29.4s. Estimated remaining: 1h 12m 26s. Rate: 7.8 symbols/min [2025-10-21T20:52:02.883611] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:02.883863] [DEBUG] [LOCAL ] RLI: No existing data file found in primary storage. [2025-10-21T20:52:02.883915] [WARN ] [MAIN ] RLI: No existing data found, performing full refresh instead. [2025-10-21T20:52:02.884024] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-10-21T20:52:02.884067] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-10-21T20:52:02.884109] [DEBUG] [LOCAL ] RLI: No primary data file found to delete. [2025-10-21T20:52:02.884141] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-10-21T20:52:03.275730] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:03.277578] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-21T20:52:03.351004] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-10-21T20:52:03.649631] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T20:52:04.151073] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-10-21T20:52:04.473308] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-21T20:52:04.483300] [INFO ] [REMOTE ] RIO: Full fetch complete (77512 records). [2025-10-21T20:52:04.483446] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-10-21T20:52:04.877000] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-10-21T20:52:04.877076] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-10-21T20:52:04.878225] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-10-21T20:52:04.878287] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-10-21T20:52:04.879710] [DEBUG] [LOCAL ] RIO: Trimmed 77512 records to 53402 (keeping 200 days of data) [2025-10-21T20:52:04.966075] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-10-21T20:52:05.202212] [DEBUG] [LOCAL ] RIO: Primary data saved (53402 records). [2025-10-21T20:52:05.202337] [INFO ] [MAIN ] RIO: Full history saved. [2025-10-21T20:52:05.202415] [INFO ] [MAIN ] Update Progress: 1804/2366 symbols completed. RIO took 31.9s. Estimated remaining: 1h 12m 17s. Rate: 7.8 symbols/min [2025-10-21T20:52:05.406603] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:05.410595] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T20:52:05.463550] [DEBUG] [LOCAL ] RLJ: Loaded 48004 existing records from primary storage. [2025-10-21T20:52:05.463900] [INFO ] [MAIN ] RLJ: Loaded 48004 existing records. [2025-10-21T20:52:05.644708] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:52:05.645050] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-10-21T20:52:05.645161] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-10-21T20:52:05.645455] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-10-21T20:52:05.645524] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-10-21T20:52:05.772398] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-10-21T20:52:05.852508] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T20:52:06.030143] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:06.551051] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-10-21T20:52:07.313904] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-21T20:52:07.351001] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-10-21T20:52:07.694182] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T20:52:08.151070] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-10-21T20:52:08.246954] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T20:52:08.951122] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-10-21T20:52:09.659599] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-21T20:52:09.746016] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T20:52:09.752637] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-10-21T20:52:10.551082] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-10-21T20:52:10.890793] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T20:52:11.351075] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-10-21T20:52:11.388846] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T20:52:12.107906] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T20:52:12.150990] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-10-21T20:52:12.952424] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-10-21T20:52:12.957020] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T20:52:13.751053] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-10-21T20:52:13.940234] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T20:52:14.551079] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-10-21T20:52:15.351097] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-10-21T20:52:15.412900] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T20:52:15.710105] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-21T20:52:16.151090] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-10-21T20:52:16.460959] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T20:52:16.951105] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-10. [2025-10-21T20:52:17.000310] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T20:52:17.751065] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-10-21T20:52:17.819312] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T20:52:18.551063] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-10-21T20:52:19.179156] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T20:52:19.302546] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-21T20:52:19.310944] [INFO ] [REMOTE ] RKT: Full fetch complete (77591 records). [2025-10-21T20:52:19.311074] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-10-21T20:52:19.356141] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-10-21T20:52:19.699764] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-10-21T20:52:19.699848] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-10-21T20:52:19.700984] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-10-21T20:52:19.701048] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-10-21T20:52:19.702445] [DEBUG] [LOCAL ] RKT: Trimmed 77591 records to 53729 (keeping 200 days of data) [2025-10-21T20:52:20.026134] [DEBUG] [LOCAL ] RKT: Primary data saved (53729 records). [2025-10-21T20:52:20.026317] [INFO ] [MAIN ] RKT: Full history saved. [2025-10-21T20:52:20.026500] [INFO ] [MAIN ] Update Progress: 1805/2366 symbols completed. RKT took 33.6s. Estimated remaining: 1h 12m 11s. Rate: 7.8 symbols/min [2025-10-21T20:52:20.151452] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-10-21T20:52:20.148912] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T20:52:20.230304] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:20.243335] [DEBUG] [LOCAL ] RLTY: Loaded 11193 existing records from primary storage. [2025-10-21T20:52:20.243563] [INFO ] [MAIN ] RLTY: Loaded 11193 existing records. [2025-10-21T20:52:20.433803] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:52:20.433994] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-10-21T20:52:20.434039] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-10-21T20:52:20.434213] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-10-21T20:52:20.434267] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-10-21T20:52:20.788087] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:20.951036] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-10-21T20:52:21.190282] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T20:52:21.751036] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-10-21T20:52:21.793110] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T20:52:21.941052] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T20:52:22.551043] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-10-21T20:52:23.350999] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-10-21T20:52:23.447285] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T20:52:24.151004] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-10-21T20:52:24.326439] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T20:52:24.950987] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-10-21T20:52:25.016540] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T20:52:25.586470] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T20:52:25.751070] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-10-21T20:52:26.053595] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T20:52:26.551051] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-10. [2025-10-21T20:52:27.351019] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-10-21T20:52:27.509475] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T20:52:28.103892] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T20:52:28.109274] [INFO ] [REMOTE ] RL: Full fetch complete (59370 records). [2025-10-21T20:52:28.109378] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-10-21T20:52:28.156159] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-10-21T20:52:28.509616] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-10-21T20:52:28.509734] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-10-21T20:52:28.510830] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-10-21T20:52:28.510932] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-10-21T20:52:28.518446] [DEBUG] [LOCAL ] RL: Trimmed 59370 records to 39575 (keeping 200 days of data) [2025-10-21T20:52:28.531146] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T20:52:28.780919] [DEBUG] [LOCAL ] RL: Primary data saved (39575 records). [2025-10-21T20:52:28.781058] [INFO ] [MAIN ] RL: Full history saved. [2025-10-21T20:52:28.781126] [INFO ] [MAIN ] Update Progress: 1806/2366 symbols completed. RL took 28.8s. Estimated remaining: 1h 12m 4s. Rate: 7.8 symbols/min [2025-10-21T20:52:28.947812] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:28.951033] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-10-21T20:52:28.990077] [DEBUG] [LOCAL ] RLX: Loaded 48187 existing records from primary storage. [2025-10-21T20:52:28.990365] [INFO ] [MAIN ] RLX: Loaded 48187 existing records. [2025-10-21T20:52:29.166690] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:52:29.167004] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-10-21T20:52:29.167056] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-10-21T20:52:29.167278] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-10-21T20:52:29.167333] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-10-21T20:52:29.514117] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:29.750986] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-10-21T20:52:29.976928] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T20:52:30.008990] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T20:52:30.551044] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-10. [2025-10-21T20:52:31.351040] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-10-21T20:52:31.470583] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T20:52:32.151032] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-10-21T20:52:32.348854] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T20:52:32.356541] [INFO ] [REMOTE ] RLJ: Full fetch complete (69402 records). [2025-10-21T20:52:32.356691] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-10-21T20:52:32.744219] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T20:52:32.772122] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-10-21T20:52:32.772487] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-10-21T20:52:32.773745] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-10-21T20:52:32.773828] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-10-21T20:52:32.775203] [DEBUG] [LOCAL ] RLJ: Trimmed 69402 records to 47968 (keeping 200 days of data) [2025-10-21T20:52:32.952284] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-10-21T20:52:33.055175] [DEBUG] [LOCAL ] RLJ: Primary data saved (47968 records). [2025-10-21T20:52:33.055362] [INFO ] [MAIN ] RLJ: Full history saved. [2025-10-21T20:52:33.055451] [INFO ] [MAIN ] Update Progress: 1807/2366 symbols completed. RLJ took 27.9s. Estimated remaining: 1h 11m 55s. Rate: 7.8 symbols/min [2025-10-21T20:52:33.224621] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:33.233748] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T20:52:33.244850] [DEBUG] [LOCAL ] RM: Loaded 7548 existing records from primary storage. [2025-10-21T20:52:33.245059] [INFO ] [MAIN ] RM: Loaded 7548 existing records. [2025-10-21T20:52:33.419206] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:52:33.419401] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-10-21T20:52:33.419450] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-10-21T20:52:33.419619] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-10-21T20:52:33.419705] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-10-21T20:52:33.771396] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:33.752354] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-10. [2025-10-21T20:52:34.551005] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-10-21T20:52:34.810748] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T20:52:35.350993] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-10-21T20:52:35.422959] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T20:52:35.429273] [INFO ] [REMOTE ] RLI: Full fetch complete (49341 records). [2025-10-21T20:52:35.429366] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-10-21T20:52:35.536737] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T20:52:35.811683] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-10-21T20:52:35.811770] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-10-21T20:52:35.812610] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-10-21T20:52:35.812673] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-10-21T20:52:35.813703] [DEBUG] [LOCAL ] RLI: Trimmed 49341 records to 34734 (keeping 200 days of data) [2025-10-21T20:52:36.024520] [DEBUG] [LOCAL ] RLI: Primary data saved (34734 records). [2025-10-21T20:52:36.024676] [INFO ] [MAIN ] RLI: Full history saved. [2025-10-21T20:52:36.024782] [INFO ] [MAIN ] Update Progress: 1808/2366 symbols completed. RLI took 33.3s. Estimated remaining: 1h 11m 46s. Rate: 7.8 symbols/min [2025-10-21T20:52:36.162703] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-10-21T20:52:36.205619] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:36.226452] [DEBUG] [LOCAL ] RMAX: Loaded 21719 existing records from primary storage. [2025-10-21T20:52:36.226782] [INFO ] [MAIN ] RMAX: Loaded 21719 existing records. [2025-10-21T20:52:36.399576] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:52:36.399817] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-10-21T20:52:36.399865] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-10-21T20:52:36.400110] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-10-21T20:52:36.400166] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-10-21T20:52:36.748120] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:36.950990] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-10-21T20:52:37.076119] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T20:52:37.227485] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T20:52:37.530149] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T20:52:37.751037] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-10-21T20:52:38.551039] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-10-21T20:52:38.729617] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T20:52:39.351020] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-10-21T20:52:40.151008] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-10-21T20:52:40.549568] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T20:52:40.581855] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T20:52:40.951038] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-10-21T20:52:41.062878] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T20:52:41.750996] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-10-21T20:52:42.052549] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T20:52:42.551048] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-10-21T20:52:42.750328] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-21T20:52:43.192515] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T20:52:43.351001] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-10-21T20:52:44.151068] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-10-21T20:52:44.291325] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T20:52:44.951086] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-10-21T20:52:45.075093] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T20:52:45.751023] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-10-21T20:52:46.179493] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T20:52:46.551056] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-10-21T20:52:47.351211] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-10. [2025-10-21T20:52:47.454839] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T20:52:47.566448] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T20:52:48.151039] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-10-21T20:52:48.204723] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T20:52:48.206854] [INFO ] [REMOTE ] RLTY: Full fetch complete (17252 records). [2025-10-21T20:52:48.206952] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-10-21T20:52:48.577105] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-10-21T20:52:48.577197] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-10-21T20:52:48.577571] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-10-21T20:52:48.577662] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-10-21T20:52:48.578166] [DEBUG] [LOCAL ] RLTY: Trimmed 17252 records to 11133 (keeping 200 days of data) [2025-10-21T20:52:48.645397] [DEBUG] [LOCAL ] RLTY: Primary data saved (11133 records). [2025-10-21T20:52:48.645522] [INFO ] [MAIN ] RLTY: Full history saved. [2025-10-21T20:52:48.645608] [INFO ] [MAIN ] Update Progress: 1809/2366 symbols completed. RLTY took 28.6s. Estimated remaining: 1h 11m 40s. Rate: 7.8 symbols/min [2025-10-21T20:52:48.848510] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:48.846978] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T20:52:48.848738] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-10-21T20:52:48.850923] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-10-21T20:52:48.851059] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-10-21T20:52:48.851126] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-10-21T20:52:48.851179] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-10-21T20:52:48.851213] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-10-21T20:52:48.956144] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-10-21T20:52:49.237503] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:49.749682] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T20:52:49.751556] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-10-21T20:52:50.551035] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-10-21T20:52:51.351008] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-10-21T20:52:51.489556] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T20:52:51.571296] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T20:52:52.151026] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-10-21T20:52:52.576612] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-21T20:52:52.951027] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-10-21T20:52:53.751013] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-10-21T20:52:53.902251] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T20:52:53.921948] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T20:52:54.551082] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-10-21T20:52:55.351001] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-10-21T20:52:55.501227] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T20:52:56.151058] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-10-21T20:52:56.211913] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T20:52:56.411334] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T20:52:56.951082] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-10. [2025-10-21T20:52:57.677889] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T20:52:57.679380] [INFO ] [REMOTE ] RM: Full fetch complete (11520 records). [2025-10-21T20:52:57.679494] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-10-21T20:52:57.754210] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-10-21T20:52:58.054327] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-10-21T20:52:58.054427] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-10-21T20:52:58.054768] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-10-21T20:52:58.054848] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-10-21T20:52:58.055482] [DEBUG] [LOCAL ] RM: Trimmed 11520 records to 7555 (keeping 200 days of data) [2025-10-21T20:52:58.116804] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-21T20:52:58.140334] [DEBUG] [LOCAL ] RM: Primary data saved (7555 records). [2025-10-21T20:52:58.140769] [INFO ] [MAIN ] RM: Full history saved. [2025-10-21T20:52:58.140851] [INFO ] [MAIN ] Update Progress: 1810/2366 symbols completed. RM took 25.1s. Estimated remaining: 1h 11m 33s. Rate: 7.8 symbols/min [2025-10-21T20:52:58.314952] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:52:58.322458] [DEBUG] [LOCAL ] RMI: Loaded 4709 existing records from primary storage. [2025-10-21T20:52:58.322689] [INFO ] [MAIN ] RMI: Loaded 4709 existing records. [2025-10-21T20:52:58.506713] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:52:58.506945] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-10-21T20:52:58.506995] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-10-21T20:52:58.507172] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-10-21T20:52:58.507228] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-10-21T20:52:58.563233] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-10-21T20:52:58.870512] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:52:58.919700] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T20:52:59.351015] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-10-21T20:53:00.151011] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-10-21T20:53:00.562071] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T20:53:00.635956] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T20:53:00.837521] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T20:53:00.950986] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-10-21T20:53:01.751038] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-10-21T20:53:02.289061] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T20:53:02.551056] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-10-21T20:53:03.192529] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T20:53:03.350990] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-10-21T20:53:03.546412] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T20:53:04.053012] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T20:53:04.151097] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-10. [2025-10-21T20:53:04.951086] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-10-21T20:53:05.751064] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-10-21T20:53:06.099460] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T20:53:06.107119] [INFO ] [REMOTE ] RLX: Full fetch complete (70158 records). [2025-10-21T20:53:06.107237] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-10-21T20:53:06.293346] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T20:53:06.513227] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-10-21T20:53:06.513337] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-10-21T20:53:06.514437] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-10-21T20:53:06.514499] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-10-21T20:53:06.515832] [DEBUG] [LOCAL ] RLX: Trimmed 70158 records to 48166 (keeping 200 days of data) [2025-10-21T20:53:06.562713] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-10. [2025-10-21T20:53:06.791163] [DEBUG] [LOCAL ] RLX: Primary data saved (48166 records). [2025-10-21T20:53:06.791295] [INFO ] [MAIN ] RLX: Full history saved. [2025-10-21T20:53:06.791682] [INFO ] [MAIN ] Update Progress: 1811/2366 symbols completed. RLX took 38.0s. Estimated remaining: 1h 11m 25s. Rate: 7.8 symbols/min [2025-10-21T20:53:06.975354] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:53:06.989564] [DEBUG] [LOCAL ] RMM: Loaded 10826 existing records from primary storage. [2025-10-21T20:53:06.989816] [INFO ] [MAIN ] RMM: Loaded 10826 existing records. [2025-10-21T20:53:07.200167] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:53:07.200429] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-10-21T20:53:07.200489] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-10-21T20:53:07.200681] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-10-21T20:53:07.200738] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-10-21T20:53:07.354615] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-10-21T20:53:07.565359] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:53:07.595440] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T20:53:07.831358] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T20:53:07.834638] [INFO ] [REMOTE ] RMAX: Full fetch complete (29941 records). [2025-10-21T20:53:07.834743] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-10-21T20:53:08.159453] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-10-21T20:53:08.209887] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-10-21T20:53:08.210052] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-10-21T20:53:08.210771] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-10-21T20:53:08.210834] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-10-21T20:53:08.211586] [DEBUG] [LOCAL ] RMAX: Trimmed 29941 records to 21668 (keeping 200 days of data) [2025-10-21T20:53:08.304716] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T20:53:08.341127] [DEBUG] [LOCAL ] RMAX: Primary data saved (21668 records). [2025-10-21T20:53:08.341279] [INFO ] [MAIN ] RMAX: Full history saved. [2025-10-21T20:53:08.341364] [INFO ] [MAIN ] Update Progress: 1812/2366 symbols completed. RMAX took 32.3s. Estimated remaining: 1h 11m 16s. Rate: 7.8 symbols/min [2025-10-21T20:53:08.506252] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:53:08.513208] [DEBUG] [LOCAL ] RMMZ: Loaded 4802 existing records from primary storage. [2025-10-21T20:53:08.513420] [INFO ] [MAIN ] RMMZ: Loaded 4802 existing records. [2025-10-21T20:53:08.684905] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:53:08.685142] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-10-21T20:53:08.685232] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-10-21T20:53:08.685408] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-10-21T20:53:08.685463] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-10-21T20:53:08.956272] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-10-21T20:53:09.084918] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:53:09.283336] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T20:53:09.727890] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T20:53:09.751061] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-10-21T20:53:10.551041] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-10-21T20:53:11.141158] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T20:53:11.351054] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-10-21T20:53:11.546017] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T20:53:12.151058] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-10-21T20:53:12.196826] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T20:53:12.852301] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T20:53:12.951001] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-10-21T20:53:13.751009] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-10-21T20:53:13.799510] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T20:53:14.551068] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-10-21T20:53:14.614359] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T20:53:15.351028] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-10-21T20:53:16.151045] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-10-21T20:53:16.187458] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T20:53:16.242377] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-21T20:53:16.901414] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T20:53:16.950986] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-10. [2025-10-21T20:53:17.582113] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T20:53:17.583296] [INFO ] [REMOTE ] RMI: Full fetch complete (6026 records). [2025-10-21T20:53:17.583363] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-10-21T20:53:17.754393] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-10-21T20:53:17.934885] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-10-21T20:53:17.934957] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-10-21T20:53:17.935116] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-10-21T20:53:17.935154] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-10-21T20:53:17.935509] [DEBUG] [LOCAL ] RMI: Trimmed 6026 records to 4731 (keeping 200 days of data) [2025-10-21T20:53:17.964036] [DEBUG] [LOCAL ] RMI: Primary data saved (4731 records). [2025-10-21T20:53:17.964116] [INFO ] [MAIN ] RMI: Full history saved. [2025-10-21T20:53:17.964186] [INFO ] [MAIN ] Update Progress: 1813/2366 symbols completed. RMI took 19.8s. Estimated remaining: 1h 11m 8s. Rate: 7.8 symbols/min [2025-10-21T20:53:18.133026] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:53:18.151043] [DEBUG] [LOCAL ] RMT: Loaded 17390 existing records from primary storage. [2025-10-21T20:53:18.151274] [INFO ] [MAIN ] RMT: Loaded 17390 existing records. [2025-10-21T20:53:18.324144] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:53:18.324341] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-10-21T20:53:18.324395] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-10-21T20:53:18.324595] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-10-21T20:53:18.324674] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-10-21T20:53:18.556351] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-10-21T20:53:18.673923] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:53:18.783818] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T20:53:19.351024] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-10-21T20:53:20.150988] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-10-21T20:53:20.267291] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T20:53:20.469050] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T20:53:20.951037] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-10-21T20:53:21.640112] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T20:53:21.662916] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-21T20:53:21.750995] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-10-21T20:53:22.550998] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-10-21T20:53:22.757226] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T20:53:23.124667] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T20:53:23.351014] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-10-21T20:53:24.010138] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T20:53:24.151053] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-10-21T20:53:24.951018] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-10-21T20:53:25.251951] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T20:53:25.412841] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-21T20:53:25.751054] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-10-21T20:53:26.551038] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-10-21T20:53:26.781131] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T20:53:27.351056] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-10-21T20:53:28.151069] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-10-21T20:53:28.261885] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T20:53:28.355275] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T20:53:28.951082] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-10-21T20:53:29.366033] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T20:53:29.751098] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-10-21T20:53:30.398948] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T20:53:30.487670] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T20:53:30.551043] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-10-21T20:53:31.351026] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-10-21T20:53:31.643566] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T20:53:31.844402] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T20:53:32.151055] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-10-21T20:53:32.951037] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-10-21T20:53:33.291786] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T20:53:33.723195] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T20:53:33.751025] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-10-21T20:53:34.509050] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T20:53:34.551001] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-10-21T20:53:35.274009] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T20:53:35.351018] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-10. [2025-10-21T20:53:36.151039] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-10-21T20:53:36.271222] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T20:53:36.273393] [INFO ] [REMOTE ] RMM: Full fetch complete (14825 records). [2025-10-21T20:53:36.273472] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-10-21T20:53:36.634928] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-10-21T20:53:36.635004] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-10-21T20:53:36.635318] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-10-21T20:53:36.635357] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-10-21T20:53:36.635855] [DEBUG] [LOCAL ] RMM: Trimmed 14825 records to 10888 (keeping 200 days of data) [2025-10-21T20:53:36.700722] [DEBUG] [LOCAL ] RMM: Primary data saved (10888 records). [2025-10-21T20:53:36.700849] [INFO ] [MAIN ] RMM: Full history saved. [2025-10-21T20:53:36.700931] [INFO ] [MAIN ] Update Progress: 1814/2366 symbols completed. RMM took 29.9s. Estimated remaining: 1h 11m 4s. Rate: 7.8 symbols/min [2025-10-21T20:53:36.880321] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T20:53:36.882715] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:53:36.928289] [DEBUG] [LOCAL ] RNG: Loaded 48033 existing records from primary storage. [2025-10-21T20:53:36.928624] [INFO ] [MAIN ] RNG: Loaded 48033 existing records. [2025-10-21T20:53:36.957172] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-10. [2025-10-21T20:53:37.108734] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:53:37.108964] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-10-21T20:53:37.109013] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-10-21T20:53:37.109218] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-10-21T20:53:37.109265] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-10-21T20:53:37.462699] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:53:37.751009] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-10-21T20:53:38.551048] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-10-21T20:53:38.694614] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T20:53:38.701248] [INFO ] [REMOTE ] RMD: Full fetch complete (61555 records). [2025-10-21T20:53:38.701365] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-10-21T20:53:39.084981] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-10-21T20:53:39.085089] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-10-21T20:53:39.086186] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-10-21T20:53:39.086251] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-10-21T20:53:39.087430] [DEBUG] [LOCAL ] RMD: Trimmed 61555 records to 41958 (keeping 200 days of data) [2025-10-21T20:53:39.342434] [DEBUG] [LOCAL ] RMD: Primary data saved (41958 records). [2025-10-21T20:53:39.342551] [INFO ] [MAIN ] RMD: Full history saved. [2025-10-21T20:53:39.342617] [INFO ] [MAIN ] Update Progress: 1815/2366 symbols completed. RMD took 50.7s. Estimated remaining: 1h 10m 55s. Rate: 7.8 symbols/min [2025-10-21T20:53:39.356449] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-10. [2025-10-21T20:53:39.520570] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:53:39.547484] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T20:53:39.572316] [DEBUG] [LOCAL ] RNGR: Loaded 20833 existing records from primary storage. [2025-10-21T20:53:39.572566] [INFO ] [MAIN ] RNGR: Loaded 20833 existing records. [2025-10-21T20:53:39.755891] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:53:39.768173] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-10-21T20:53:39.768256] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-10-21T20:53:39.768977] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-10-21T20:53:39.769042] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-10-21T20:53:39.769556] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T20:53:40.102491] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T20:53:40.131052] [INFO ] [REMOTE ] RMMZ: Full fetch complete (6629 records). [2025-10-21T20:53:40.141684] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-10-21T20:53:40.143715] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:53:40.156157] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-10-21T20:53:40.517787] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-10-21T20:53:40.517888] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-10-21T20:53:40.518167] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-10-21T20:53:40.518209] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-10-21T20:53:40.518622] [DEBUG] [LOCAL ] RMMZ: Trimmed 6629 records to 4789 (keeping 200 days of data) [2025-10-21T20:53:40.550146] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4789 records). [2025-10-21T20:53:40.550318] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-10-21T20:53:40.550428] [INFO ] [MAIN ] Update Progress: 1816/2366 symbols completed. RMMZ took 32.2s. Estimated remaining: 1h 10m 45s. Rate: 7.8 symbols/min [2025-10-21T20:53:40.730028] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:53:40.749907] [DEBUG] [LOCAL ] RNP: Loaded 16118 existing records from primary storage. [2025-10-21T20:53:40.750238] [INFO ] [MAIN ] RNP: Loaded 16118 existing records. [2025-10-21T20:53:40.957924] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-10-21T20:53:40.970535] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:53:40.970961] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-10-21T20:53:40.971019] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-10-21T20:53:40.971229] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-10-21T20:53:40.971270] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-10-21T20:53:41.358501] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:53:41.385513] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T20:53:41.751051] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-10-21T20:53:42.550995] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-10-21T20:53:42.582530] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T20:53:42.884220] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-21T20:53:43.350990] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-10. [2025-10-21T20:53:43.412490] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T20:53:44.151060] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-10-21T20:53:44.408005] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T20:53:44.411276] [INFO ] [REMOTE ] RMT: Full fetch complete (25526 records). [2025-10-21T20:53:44.411343] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-10-21T20:53:44.789029] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-10-21T20:53:44.789154] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-10-21T20:53:44.790069] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-10-21T20:53:44.790134] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-10-21T20:53:44.791026] [DEBUG] [LOCAL ] RMT: Trimmed 25526 records to 17254 (keeping 200 days of data) [2025-10-21T20:53:44.914145] [DEBUG] [LOCAL ] RMT: Primary data saved (17254 records). [2025-10-21T20:53:44.914345] [INFO ] [MAIN ] RMT: Full history saved. [2025-10-21T20:53:44.914476] [INFO ] [MAIN ] Update Progress: 1817/2366 symbols completed. RMT took 27.0s. Estimated remaining: 1h 10m 36s. Rate: 7.8 symbols/min [2025-10-21T20:53:44.958902] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-10-21T20:53:45.095181] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:53:45.095425] [DEBUG] [LOCAL ] RNR: No existing data file found in primary storage. [2025-10-21T20:53:45.095463] [WARN ] [MAIN ] RNR: No existing data found, performing full refresh instead. [2025-10-21T20:53:45.095590] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-10-21T20:53:45.095632] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-10-21T20:53:45.095718] [DEBUG] [LOCAL ] RNR: No primary data file found to delete. [2025-10-21T20:53:45.095761] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-10-21T20:53:45.523945] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:53:45.539774] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T20:53:45.751034] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-10-21T20:53:46.114974] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T20:53:46.551143] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-10-21T20:53:47.351039] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-10-21T20:53:47.749272] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T20:53:47.785305] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T20:53:48.151073] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-10-21T20:53:48.542679] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T20:53:48.951085] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-10-21T20:53:49.751007] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-10-21T20:53:49.902206] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T20:53:50.049619] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T20:53:50.550988] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-10-21T20:53:50.945273] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T20:53:51.351027] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-10-21T20:53:51.755745] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T20:53:52.151079] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-10-21T20:53:52.951056] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-10-21T20:53:53.147445] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T20:53:53.751067] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-10-21T20:53:53.781810] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T20:53:54.076486] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T20:53:54.551065] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-10-21T20:53:55.351072] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-10-21T20:53:55.413915] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T20:53:55.791799] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T20:53:56.151029] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-10-21T20:53:56.214099] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T20:53:56.951039] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-10-21T20:53:57.521396] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T20:53:57.751032] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-10-21T20:53:58.550991] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-10-21T20:53:58.817234] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T20:53:58.859395] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T20:53:59.351022] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-10-21T20:54:00.158834] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-10-21T20:54:00.187032] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T20:54:00.244865] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T20:54:00.951116] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-10-21T20:54:01.328637] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T20:54:01.751050] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-10-21T20:54:02.551115] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-10-21T20:54:02.727837] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T20:54:03.100383] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T20:54:03.351015] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-10-21T20:54:04.151014] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-10-21T20:54:04.335219] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T20:54:04.405439] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T20:54:04.951042] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-10-21T20:54:05.750996] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-10-21T20:54:05.796144] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T20:54:05.848401] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T20:54:06.551031] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-10. [2025-10-21T20:54:07.350979] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-10-21T20:54:07.617103] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T20:54:07.717636] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T20:54:07.721269] [INFO ] [REMOTE ] RNGR: Full fetch complete (28478 records). [2025-10-21T20:54:07.721339] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-10-21T20:54:08.110766] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-10-21T20:54:08.110850] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-10-21T20:54:08.111489] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-10-21T20:54:08.111546] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-10-21T20:54:08.112471] [DEBUG] [LOCAL ] RNGR: Trimmed 28478 records to 20828 (keeping 200 days of data) [2025-10-21T20:54:08.162850] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-10-21T20:54:08.238680] [DEBUG] [LOCAL ] RNGR: Primary data saved (20828 records). [2025-10-21T20:54:08.238809] [INFO ] [MAIN ] RNGR: Full history saved. [2025-10-21T20:54:08.238882] [INFO ] [MAIN ] Update Progress: 1818/2366 symbols completed. RNGR took 28.9s. Estimated remaining: 1h 10m 33s. Rate: 7.8 symbols/min [2025-10-21T20:54:08.410279] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:54:08.410438] [DEBUG] [LOCAL ] RNST: No existing data file found in primary storage. [2025-10-21T20:54:08.410474] [WARN ] [MAIN ] RNST: No existing data found, performing full refresh instead. [2025-10-21T20:54:08.410588] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-10-21T20:54:08.410629] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-10-21T20:54:08.410718] [DEBUG] [LOCAL ] RNST: No primary data file found to delete. [2025-10-21T20:54:08.410758] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-10-21T20:54:08.766346] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:54:08.850777] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T20:54:08.951084] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-10-21T20:54:09.272142] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T20:54:09.751064] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-10-21T20:54:10.551041] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-10. [2025-10-21T20:54:10.600631] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T20:54:11.351091] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-10-21T20:54:11.487189] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T20:54:11.695518] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T20:54:11.699223] [INFO ] [REMOTE ] RNP: Full fetch complete (23520 records). [2025-10-21T20:54:11.699338] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-10-21T20:54:12.062502] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-10-21T20:54:12.062575] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-10-21T20:54:12.062985] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-10-21T20:54:12.063045] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-10-21T20:54:12.063601] [DEBUG] [LOCAL ] RNP: Trimmed 23520 records to 16036 (keeping 200 days of data) [2025-10-21T20:54:12.153042] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-10. [2025-10-21T20:54:12.159053] [DEBUG] [LOCAL ] RNP: Primary data saved (16036 records). [2025-10-21T20:54:12.159162] [INFO ] [MAIN ] RNP: Full history saved. [2025-10-21T20:54:12.159241] [INFO ] [MAIN ] Update Progress: 1819/2366 symbols completed. RNP took 31.6s. Estimated remaining: 1h 10m 24s. Rate: 7.8 symbols/min [2025-10-21T20:54:12.325571] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:54:12.325729] [DEBUG] [LOCAL ] ROG: No existing data file found in primary storage. [2025-10-21T20:54:12.325775] [WARN ] [MAIN ] ROG: No existing data found, performing full refresh instead. [2025-10-21T20:54:12.325878] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-10-21T20:54:12.325918] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-10-21T20:54:12.325958] [DEBUG] [LOCAL ] ROG: No primary data file found to delete. [2025-10-21T20:54:12.325989] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-10-21T20:54:12.680273] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:54:12.837973] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T20:54:12.951042] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-10-21T20:54:13.751009] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-10-21T20:54:13.921222] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T20:54:13.939516] [INFO ] [REMOTE ] RNG: Full fetch complete (69890 records). [2025-10-21T20:54:13.939885] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T20:54:13.943324] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-10-21T20:54:14.391910] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-10-21T20:54:14.392027] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-10-21T20:54:14.393424] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-10-21T20:54:14.393498] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-10-21T20:54:14.395082] [DEBUG] [LOCAL ] RNG: Trimmed 69890 records to 48007 (keeping 200 days of data) [2025-10-21T20:54:14.564703] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-10-21T20:54:14.685900] [DEBUG] [LOCAL ] RNG: Primary data saved (48007 records). [2025-10-21T20:54:14.686048] [INFO ] [MAIN ] RNG: Full history saved. [2025-10-21T20:54:14.686428] [INFO ] [MAIN ] Update Progress: 1820/2366 symbols completed. RNG took 38.0s. Estimated remaining: 1h 10m 15s. Rate: 7.8 symbols/min [2025-10-21T20:54:14.882364] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:54:14.882574] [DEBUG] [LOCAL ] ROK: No existing data file found in primary storage. [2025-10-21T20:54:14.882620] [WARN ] [MAIN ] ROK: No existing data found, performing full refresh instead. [2025-10-21T20:54:14.882760] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-10-21T20:54:14.882812] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-10-21T20:54:14.882861] [DEBUG] [LOCAL ] ROK: No primary data file found to delete. [2025-10-21T20:54:14.882898] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-10-21T20:54:15.312246] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:54:15.351812] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-10-21T20:54:15.354830] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T20:54:15.882189] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T20:54:16.151121] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-10-21T20:54:16.495967] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T20:54:16.951094] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-10-21T20:54:17.445434] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T20:54:17.751111] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-10-21T20:54:18.551000] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-10-21T20:54:18.758372] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-21T20:54:19.211988] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T20:54:19.350997] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-10-21T20:54:20.151049] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-10-21T20:54:20.448011] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-21T20:54:20.832379] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T20:54:20.951037] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-10. [2025-10-21T20:54:21.413243] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T20:54:21.751087] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-10-21T20:54:22.302363] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-21T20:54:22.307817] [INFO ] [REMOTE ] RNR: Full fetch complete (50955 records). [2025-10-21T20:54:22.307902] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-10-21T20:54:22.556189] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-10-21T20:54:22.683510] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-10-21T20:54:22.683599] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-10-21T20:54:22.684710] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-10-21T20:54:22.684776] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-10-21T20:54:22.685937] [DEBUG] [LOCAL ] RNR: Trimmed 50955 records to 33624 (keeping 200 days of data) [2025-10-21T20:54:22.896544] [DEBUG] [LOCAL ] RNR: Primary data saved (33624 records). [2025-10-21T20:54:22.897215] [INFO ] [MAIN ] RNR: Full history saved. [2025-10-21T20:54:22.897299] [INFO ] [MAIN ] Update Progress: 1821/2366 symbols completed. RNR took 38.0s. Estimated remaining: 1h 10m 8s. Rate: 7.8 symbols/min [2025-10-21T20:54:23.069516] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:54:23.069764] [DEBUG] [LOCAL ] ROL: No existing data file found in primary storage. [2025-10-21T20:54:23.069809] [WARN ] [MAIN ] ROL: No existing data found, performing full refresh instead. [2025-10-21T20:54:23.069920] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-10-21T20:54:23.069963] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-10-21T20:54:23.070006] [DEBUG] [LOCAL ] ROL: No primary data file found to delete. [2025-10-21T20:54:23.070038] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-10-21T20:54:23.354788] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-10-21T20:54:23.450702] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:54:23.475791] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T20:54:23.898854] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-21T20:54:24.151062] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-10-21T20:54:24.887725] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T20:54:24.951015] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-10-21T20:54:25.575963] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T20:54:25.750984] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-10-21T20:54:26.069029] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T20:54:26.551029] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-10-21T20:54:27.351056] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-10-21T20:54:27.467721] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T20:54:28.151005] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-10-21T20:54:28.503542] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T20:54:28.627154] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T20:54:28.951003] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-10-21T20:54:29.445016] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T20:54:29.751039] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-10-21T20:54:30.551038] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-10-21T20:54:30.721752] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T20:54:31.005895] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T20:54:31.351035] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-10-21T20:54:32.035202] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T20:54:32.150980] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-10. [2025-10-21T20:54:32.438837] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T20:54:32.951028] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-10. [2025-10-21T20:54:33.351068] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T20:54:33.356567] [INFO ] [REMOTE ] RNST: Full fetch complete (52805 records). [2025-10-21T20:54:33.356703] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-10-21T20:54:33.731467] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-10-21T20:54:33.731545] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-10-21T20:54:33.732498] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-10-21T20:54:33.732560] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-10-21T20:54:33.733684] [DEBUG] [LOCAL ] RNST: Trimmed 52805 records to 36011 (keeping 200 days of data) [2025-10-21T20:54:33.784835] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-10-21T20:54:33.955122] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T20:54:33.960325] [INFO ] [REMOTE ] ROG: Full fetch complete (30697 records). [2025-10-21T20:54:33.961490] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-10-21T20:54:34.047798] [DEBUG] [LOCAL ] RNST: Primary data saved (36011 records). [2025-10-21T20:54:34.066767] [INFO ] [MAIN ] RNST: Full history saved. [2025-10-21T20:54:34.069244] [INFO ] [MAIN ] Update Progress: 1822/2366 symbols completed. RNST took 25.8s. Estimated remaining: 1h 10m 1s. Rate: 7.8 symbols/min [2025-10-21T20:54:34.426875] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:54:34.432583] [DEBUG] [LOCAL ] RPM: No existing data file found in primary storage. [2025-10-21T20:54:34.437761] [WARN ] [MAIN ] RPM: No existing data found, performing full refresh instead. [2025-10-21T20:54:34.448148] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-10-21T20:54:34.448210] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-10-21T20:54:34.466009] [DEBUG] [LOCAL ] RPM: No primary data file found to delete. [2025-10-21T20:54:34.466069] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-10-21T20:54:34.554275] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-10-21T20:54:34.604286] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-10-21T20:54:34.612694] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-10-21T20:54:34.617264] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-10-21T20:54:34.617621] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-10-21T20:54:34.676020] [DEBUG] [LOCAL ] ROG: Trimmed 30697 records to 21822 (keeping 200 days of data) [2025-10-21T20:54:34.978337] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:54:35.003032] [DEBUG] [LOCAL ] ROG: Primary data saved (21822 records). [2025-10-21T20:54:35.003163] [INFO ] [MAIN ] ROG: Full history saved. [2025-10-21T20:54:35.003235] [INFO ] [MAIN ] Update Progress: 1823/2366 symbols completed. ROG took 22.8s. Estimated remaining: 1h 9m 51s. Rate: 7.8 symbols/min [2025-10-21T20:54:35.198706] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:54:35.217783] [DEBUG] [LOCAL ] RPT: Loaded 19109 existing records from primary storage. [2025-10-21T20:54:35.218047] [INFO ] [MAIN ] RPT: Loaded 19109 existing records. [2025-10-21T20:54:35.351257] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-10-21T20:54:35.407129] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:54:35.407497] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-10-21T20:54:35.407554] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-10-21T20:54:35.407938] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-10-21T20:54:35.407997] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-10-21T20:54:35.736842] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T20:54:35.817100] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:54:36.151014] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-10-21T20:54:36.416728] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T20:54:36.634464] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T20:54:36.951024] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-10-21T20:54:37.289806] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T20:54:37.751026] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-10-21T20:54:38.551065] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-10-21T20:54:38.675924] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T20:54:38.844238] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-21T20:54:39.351041] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-10-21T20:54:40.134941] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T20:54:40.150982] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-10-21T20:54:40.950989] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-10-21T20:54:41.299953] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-21T20:54:41.751023] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-10-21T20:54:41.905838] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T20:54:42.556146] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-10-21T20:54:42.568223] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T20:54:43.351053] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-10-21T20:54:43.408947] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T20:54:43.914882] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T20:54:44.151041] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-10-21T20:54:44.519145] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T20:54:44.951039] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-10. [2025-10-21T20:54:45.751016] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-10-21T20:54:45.825267] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T20:54:46.470692] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T20:54:46.476898] [INFO ] [REMOTE ] ROK: Full fetch complete (62671 records). [2025-10-21T20:54:46.477037] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-10-21T20:54:46.556134] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-10-21T20:54:46.862481] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-10-21T20:54:46.862676] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-10-21T20:54:46.863720] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-10-21T20:54:46.863782] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-10-21T20:54:46.864975] [DEBUG] [LOCAL ] ROK: Trimmed 62671 records to 42879 (keeping 200 days of data) [2025-10-21T20:54:47.152110] [DEBUG] [LOCAL ] ROK: Primary data saved (42879 records). [2025-10-21T20:54:47.152285] [INFO ] [MAIN ] ROK: Full history saved. [2025-10-21T20:54:47.152385] [INFO ] [MAIN ] Update Progress: 1824/2366 symbols completed. ROK took 32.5s. Estimated remaining: 1h 9m 45s. Rate: 7.8 symbols/min [2025-10-21T20:54:47.269367] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T20:54:47.363073] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-10-21T20:54:47.365605] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:54:47.396556] [DEBUG] [LOCAL ] RQI: Loaded 29007 existing records from primary storage. [2025-10-21T20:54:47.396856] [INFO ] [MAIN ] RQI: Loaded 29007 existing records. [2025-10-21T20:54:47.574827] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:54:47.575068] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-10-21T20:54:47.575114] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-10-21T20:54:47.575316] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-10-21T20:54:47.575371] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-10-21T20:54:47.930639] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:54:48.151012] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-10-21T20:54:48.311201] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T20:54:48.951095] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-10-21T20:54:49.269811] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T20:54:49.751035] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-10-21T20:54:49.891121] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T20:54:50.551018] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-10-21T20:54:50.696194] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T20:54:51.351067] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-10-21T20:54:51.502978] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T20:54:51.613768] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-21T20:54:52.151084] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-10-21T20:54:52.387851] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-21T20:54:52.951074] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-10-21T20:54:53.751055] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-10-21T20:54:53.972956] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T20:54:54.529621] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T20:54:54.550976] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-10-21T20:54:55.025084] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-21T20:54:55.351089] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-10-21T20:54:56.151020] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-10-21T20:54:56.367384] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T20:54:56.829079] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T20:54:56.951047] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-10-21T20:54:57.009839] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T20:54:57.751021] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-10-21T20:54:58.409432] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T20:54:58.551041] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-10-21T20:54:59.352100] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-10-21T20:54:59.354614] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T20:54:59.843674] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T20:55:00.151050] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-10-21T20:55:00.951053] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-10-21T20:55:01.270731] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T20:55:01.515263] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T20:55:01.751076] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-10-21T20:55:02.111796] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T20:55:02.551074] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-10-21T20:55:03.351076] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-10-21T20:55:03.785858] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T20:55:03.948565] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T20:55:04.151083] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-10-21T20:55:04.436770] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T20:55:04.951050] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-10. [2025-10-21T20:55:05.585834] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T20:55:05.751043] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-10. [2025-10-21T20:55:05.981942] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T20:55:05.985059] [INFO ] [REMOTE ] RPT: Full fetch complete (28193 records). [2025-10-21T20:55:05.985145] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-10-21T20:55:06.356900] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-10-21T20:55:06.356977] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-10-21T20:55:06.357575] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-10-21T20:55:06.357686] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-10-21T20:55:06.358386] [DEBUG] [LOCAL ] RPT: Trimmed 28193 records to 19031 (keeping 200 days of data) [2025-10-21T20:55:06.466086] [DEBUG] [LOCAL ] RPT: Primary data saved (19031 records). [2025-10-21T20:55:06.466224] [INFO ] [MAIN ] RPT: Full history saved. [2025-10-21T20:55:06.466301] [INFO ] [MAIN ] Update Progress: 1825/2366 symbols completed. RPT took 31.5s. Estimated remaining: 1h 9m 40s. Rate: 7.8 symbols/min [2025-10-21T20:55:06.556098] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-10. [2025-10-21T20:55:06.635185] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:55:06.635351] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-10-21T20:55:06.635386] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-10-21T20:55:06.635491] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-10-21T20:55:06.635531] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-10-21T20:55:06.635570] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-10-21T20:55:06.635601] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-10-21T20:55:06.979567] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:55:07.351016] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-10-21T20:55:07.649386] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T20:55:07.657561] [INFO ] [REMOTE ] ROL: Full fetch complete (73218 records). [2025-10-21T20:55:07.657796] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-10-21T20:55:08.054030] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-10-21T20:55:08.054175] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-10-21T20:55:08.055300] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-10-21T20:55:08.055437] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-10-21T20:55:08.056905] [DEBUG] [LOCAL ] ROL: Trimmed 73218 records to 50278 (keeping 200 days of data) [2025-10-21T20:55:08.151064] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-10-21T20:55:08.335412] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T20:55:08.351043] [INFO ] [REMOTE ] RPM: Full fetch complete (59934 records). [2025-10-21T20:55:08.360574] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-10-21T20:55:08.551414] [DEBUG] [LOCAL ] ROL: Primary data saved (50278 records). [2025-10-21T20:55:08.561801] [INFO ] [MAIN ] ROL: Full history saved. [2025-10-21T20:55:08.567019] [INFO ] [MAIN ] Update Progress: 1826/2366 symbols completed. ROL took 45.7s. Estimated remaining: 1h 9m 31s. Rate: 7.8 symbols/min [2025-10-21T20:55:08.937570] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:55:08.943353] [DEBUG] [LOCAL ] RRX: No existing data file found in primary storage. [2025-10-21T20:55:08.948576] [WARN ] [MAIN ] RRX: No existing data found, performing full refresh instead. [2025-10-21T20:55:08.958971] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-10-21T20:55:08.959048] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-10-21T20:55:08.989235] [DEBUG] [LOCAL ] RRX: No primary data file found to delete. [2025-10-21T20:55:08.989368] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-10-21T20:55:09.136761] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-10-21T20:55:09.166696] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-10-21T20:55:09.174104] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-10-21T20:55:09.189711] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-10-21T20:55:09.316239] [DEBUG] [LOCAL ] RPM: Trimmed 59934 records to 42107 (keeping 200 days of data) [2025-10-21T20:55:09.649725] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:55:09.664918] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-10-21T20:55:09.791268] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-21T20:55:09.803552] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-10-21T20:55:09.817344] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T20:55:09.835123] [DEBUG] [LOCAL ] RPM: Primary data saved (42107 records). [2025-10-21T20:55:09.835606] [INFO ] [MAIN ] RPM: Full history saved. [2025-10-21T20:55:09.836168] [INFO ] [MAIN ] Update Progress: 1827/2366 symbols completed. RPM took 35.8s. Estimated remaining: 1h 9m 21s. Rate: 7.8 symbols/min [2025-10-21T20:55:10.019243] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:55:10.019452] [DEBUG] [LOCAL ] RS: No existing data file found in primary storage. [2025-10-21T20:55:10.019503] [WARN ] [MAIN ] RS: No existing data found, performing full refresh instead. [2025-10-21T20:55:10.019616] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-10-21T20:55:10.019689] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-10-21T20:55:10.019748] [DEBUG] [LOCAL ] RS: No primary data file found to delete. [2025-10-21T20:55:10.019784] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-10-21T20:55:10.378891] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:55:10.551001] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-10-21T20:55:11.331800] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T20:55:11.351025] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-10-21T20:55:11.772695] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T20:55:12.151068] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-10-21T20:55:12.194510] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T20:55:12.951044] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-10-21T20:55:13.122380] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T20:55:13.478117] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T20:55:13.751032] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-10-21T20:55:14.464104] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T20:55:14.551024] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-10-21T20:55:15.351025] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-10-21T20:55:15.510815] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T20:55:16.132718] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T20:55:16.150980] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-10-21T20:55:16.951049] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-10. [2025-10-21T20:55:17.209926] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T20:55:17.255409] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T20:55:17.751068] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-10-21T20:55:17.848165] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T20:55:17.853797] [INFO ] [REMOTE ] RQI: Full fetch complete (42781 records). [2025-10-21T20:55:17.853884] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-10-21T20:55:18.228234] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-10-21T20:55:18.228323] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-10-21T20:55:18.229181] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-10-21T20:55:18.229241] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-10-21T20:55:18.230103] [DEBUG] [LOCAL ] RQI: Trimmed 42781 records to 28928 (keeping 200 days of data) [2025-10-21T20:55:18.401221] [DEBUG] [LOCAL ] RQI: Primary data saved (28928 records). [2025-10-21T20:55:18.401347] [INFO ] [MAIN ] RQI: Full history saved. [2025-10-21T20:55:18.401441] [INFO ] [MAIN ] Update Progress: 1828/2366 symbols completed. RQI took 31.2s. Estimated remaining: 1h 9m 14s. Rate: 7.8 symbols/min [2025-10-21T20:55:18.553076] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-10-21T20:55:18.573134] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:55:18.578695] [DEBUG] [LOCAL ] RSF: Loaded 4311 existing records from primary storage. [2025-10-21T20:55:18.578852] [INFO ] [MAIN ] RSF: Loaded 4311 existing records. [2025-10-21T20:55:18.760019] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:55:18.760293] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-10-21T20:55:18.760387] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-10-21T20:55:18.760753] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-10-21T20:55:18.760810] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-10-21T20:55:18.899479] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T20:55:19.135619] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:55:19.351012] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-10-21T20:55:19.973835] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T20:55:20.150994] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-10-21T20:55:20.408118] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T20:55:20.951031] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-10-21T20:55:21.489481] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T20:55:21.751088] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-10-21T20:55:22.352727] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-21T20:55:22.551057] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-10-21T20:55:22.915306] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T20:55:23.231864] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T20:55:23.351010] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-10-21T20:55:24.151075] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-10-21T20:55:24.837353] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T20:55:24.951039] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-10-21T20:55:25.751054] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-10-21T20:55:26.068303] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T20:55:26.551050] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-10-21T20:55:26.714828] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T20:55:27.018012] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T20:55:27.351014] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-10-21T20:55:28.151042] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-10-21T20:55:28.364201] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T20:55:28.926373] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T20:55:28.951001] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-10-21T20:55:29.328311] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T20:55:29.751022] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-10-21T20:55:30.401060] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T20:55:30.551017] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-10-21T20:55:30.793616] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T20:55:31.351014] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-10-21T20:55:32.151006] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-10. [2025-10-21T20:55:32.292904] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T20:55:32.951056] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-10-21T20:55:33.206685] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T20:55:33.369586] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T20:55:33.374582] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-21T20:55:33.379621] [INFO ] [REMOTE ] RS: Full fetch complete (38679 records). [2025-10-21T20:55:33.380369] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-10-21T20:55:33.756395] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-10-21T20:55:33.759774] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-10-21T20:55:33.759875] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-10-21T20:55:33.760728] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-10-21T20:55:33.760899] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-10-21T20:55:33.761812] [DEBUG] [LOCAL ] RS: Trimmed 38679 records to 24603 (keeping 200 days of data) [2025-10-21T20:55:33.911356] [DEBUG] [LOCAL ] RS: Primary data saved (24603 records). [2025-10-21T20:55:33.911486] [INFO ] [MAIN ] RS: Full history saved. [2025-10-21T20:55:33.911555] [INFO ] [MAIN ] Update Progress: 1829/2366 symbols completed. RS took 24.1s. Estimated remaining: 1h 9m 9s. Rate: 7.8 symbols/min [2025-10-21T20:55:34.076365] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:55:34.076567] [DEBUG] [LOCAL ] RSG: No existing data file found in primary storage. [2025-10-21T20:55:34.076622] [WARN ] [MAIN ] RSG: No existing data found, performing full refresh instead. [2025-10-21T20:55:34.076749] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-10-21T20:55:34.076803] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-10-21T20:55:34.076869] [DEBUG] [LOCAL ] RSG: No primary data file found to delete. [2025-10-21T20:55:34.076902] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-10-21T20:55:34.429999] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:55:34.551000] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-10-21T20:55:34.611060] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T20:55:35.351002] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-10-21T20:55:36.151071] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-10-21T20:55:36.402171] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T20:55:36.623829] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T20:55:36.950998] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-10-21T20:55:37.009213] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T20:55:37.751047] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-10-21T20:55:38.402750] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T20:55:38.551056] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-10-21T20:55:38.620670] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T20:55:39.164431] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T20:55:39.351013] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-10. [2025-10-21T20:55:39.852486] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-21T20:55:39.853855] [INFO ] [REMOTE ] RSF: Full fetch complete (5679 records). [2025-10-21T20:55:39.853935] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-10-21T20:55:40.156178] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-10-21T20:55:40.228028] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-10-21T20:55:40.228118] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-10-21T20:55:40.228308] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-10-21T20:55:40.228348] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-10-21T20:55:40.228742] [DEBUG] [LOCAL ] RSF: Trimmed 5679 records to 4283 (keeping 200 days of data) [2025-10-21T20:55:40.254357] [DEBUG] [LOCAL ] RSF: Primary data saved (4283 records). [2025-10-21T20:55:40.254421] [INFO ] [MAIN ] RSF: Full history saved. [2025-10-21T20:55:40.254491] [INFO ] [MAIN ] Update Progress: 1830/2366 symbols completed. RSF took 21.9s. Estimated remaining: 1h 9m 0s. Rate: 7.8 symbols/min [2025-10-21T20:55:40.419289] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:55:40.419407] [DEBUG] [LOCAL ] RSI: No existing data file found in primary storage. [2025-10-21T20:55:40.419443] [WARN ] [MAIN ] RSI: No existing data found, performing full refresh instead. [2025-10-21T20:55:40.419542] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-10-21T20:55:40.419582] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-10-21T20:55:40.419621] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-10-21T20:55:40.419682] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-10-21T20:55:40.762383] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:55:40.951011] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-10-21T20:55:41.751001] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-10-21T20:55:42.164831] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T20:55:42.551003] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-10-21T20:55:42.769525] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T20:55:43.351046] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-10-21T20:55:43.724776] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T20:55:44.151001] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-10-21T20:55:44.713324] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-21T20:55:44.835308] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T20:55:44.951023] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-10-21T20:55:45.566340] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T20:55:45.751133] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-10. [2025-10-21T20:55:46.551068] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-10. [2025-10-21T20:55:46.707159] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T20:55:47.351019] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-10-21T20:55:47.546111] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T20:55:47.554279] [INFO ] [REMOTE ] RRC: Full fetch complete (76751 records). [2025-10-21T20:55:47.554398] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-10-21T20:55:47.967467] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-10-21T20:55:47.967568] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-10-21T20:55:47.968937] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-10-21T20:55:47.969009] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-10-21T20:55:47.970411] [DEBUG] [LOCAL ] RRC: Trimmed 76751 records to 52921 (keeping 200 days of data) [2025-10-21T20:55:48.155629] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-10-21T20:55:48.226681] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T20:55:48.240716] [INFO ] [REMOTE ] RRX: Full fetch complete (58810 records). [2025-10-21T20:55:48.241353] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-10-21T20:55:48.520549] [DEBUG] [LOCAL ] RRC: Primary data saved (52921 records). [2025-10-21T20:55:48.525830] [INFO ] [MAIN ] RRC: Full history saved. [2025-10-21T20:55:48.553730] [INFO ] [MAIN ] Update Progress: 1831/2366 symbols completed. RRC took 42.1s. Estimated remaining: 1h 8m 53s. Rate: 7.8 symbols/min [2025-10-21T20:55:48.889347] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:55:48.893280] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-10-21T20:55:48.893675] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-10-21T20:55:48.894900] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-10-21T20:55:48.894961] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-10-21T20:55:48.896342] [DEBUG] [LOCAL ] RRX: Trimmed 58810 records to 40876 (keeping 200 days of data) [2025-10-21T20:55:49.028077] [DEBUG] [LOCAL ] RSKD: Loaded 33373 existing records from primary storage. [2025-10-21T20:55:49.038101] [INFO ] [MAIN ] RSKD: Loaded 33373 existing records. [2025-10-21T20:55:49.329508] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:55:49.332305] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-10-21T20:55:49.332692] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-10-21T20:55:49.342250] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-10-21T20:55:49.342861] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-10-21T20:55:49.466078] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T20:55:49.530068] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-10-21T20:55:49.648401] [DEBUG] [LOCAL ] RRX: Primary data saved (40876 records). [2025-10-21T20:55:49.665281] [INFO ] [MAIN ] RRX: Full history saved. [2025-10-21T20:55:49.676070] [INFO ] [MAIN ] Update Progress: 1832/2366 symbols completed. RRX took 41.1s. Estimated remaining: 1h 8m 43s. Rate: 7.8 symbols/min [2025-10-21T20:55:49.873794] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:55:49.889808] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-10-21T20:55:49.941151] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:55:49.973842] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T20:55:50.014960] [DEBUG] [LOCAL ] RTO: Loaded 39868 existing records from primary storage. [2025-10-21T20:55:50.015271] [INFO ] [MAIN ] RTO: Loaded 39868 existing records. [2025-10-21T20:55:50.191311] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:55:50.191541] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-10-21T20:55:50.191588] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-10-21T20:55:50.191803] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-10-21T20:55:50.191858] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-10-21T20:55:50.537100] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:55:50.550977] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-10-21T20:55:51.351015] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-10-21T20:55:51.452441] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T20:55:51.671509] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T20:55:52.151024] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-10-21T20:55:52.192549] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T20:55:52.951044] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-10-21T20:55:53.194777] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T20:55:53.516856] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T20:55:53.751026] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-10-21T20:55:54.301847] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T20:55:54.551063] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-10-21T20:55:55.280368] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T20:55:55.351039] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-10-21T20:55:56.059378] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T20:55:56.150981] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-10-21T20:55:56.730533] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T20:55:56.951009] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-10-21T20:55:57.751008] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-10-21T20:55:57.995593] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T20:55:58.548355] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T20:55:58.555255] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-10-21T20:55:58.707981] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-21T20:55:59.351032] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-10-21T20:56:00.092439] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T20:56:00.150990] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-10. [2025-10-21T20:56:00.951049] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-10-21T20:56:01.626611] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-21T20:56:01.689067] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T20:56:01.696986] [INFO ] [REMOTE ] RSI: Full fetch complete (69741 records). [2025-10-21T20:56:01.697146] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-10-21T20:56:01.760740] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-10-21T20:56:02.091923] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-10-21T20:56:02.092006] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-10-21T20:56:02.093146] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-10-21T20:56:02.093209] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-10-21T20:56:02.095005] [DEBUG] [LOCAL ] RSI: Trimmed 69741 records to 46990 (keeping 200 days of data) [2025-10-21T20:56:02.365749] [DEBUG] [LOCAL ] RSI: Primary data saved (46990 records). [2025-10-21T20:56:02.365861] [INFO ] [MAIN ] RSI: Full history saved. [2025-10-21T20:56:02.365926] [INFO ] [MAIN ] Update Progress: 1833/2366 symbols completed. RSI took 22.1s. Estimated remaining: 1h 8m 37s. Rate: 7.8 symbols/min [2025-10-21T20:56:02.534707] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:02.534828] [DEBUG] [LOCAL ] RTX: No existing data file found in primary storage. [2025-10-21T20:56:02.534864] [WARN ] [MAIN ] RTX: No existing data found, performing full refresh instead. [2025-10-21T20:56:02.534970] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-10-21T20:56:02.535010] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-10-21T20:56:02.535050] [DEBUG] [LOCAL ] RTX: No primary data file found to delete. [2025-10-21T20:56:02.535082] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-10-21T20:56:02.566021] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-10-21T20:56:02.899725] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:56:02.925874] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-21T20:56:03.254263] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T20:56:03.350978] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-10-21T20:56:04.156118] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-10-21T20:56:04.177502] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T20:56:04.867247] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T20:56:04.951079] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-10-21T20:56:05.751103] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-10-21T20:56:05.863324] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-21T20:56:06.473803] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T20:56:06.551067] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-10-21T20:56:07.351069] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-10-21T20:56:07.596814] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T20:56:08.023608] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T20:56:08.151022] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-10. [2025-10-21T20:56:08.754278] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-21T20:56:08.951043] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-10-21T20:56:09.550917] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T20:56:09.556032] [INFO ] [REMOTE ] RSKD: Full fetch complete (48292 records). [2025-10-21T20:56:09.556136] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-10-21T20:56:09.761730] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-10-21T20:56:09.933193] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-10-21T20:56:09.933311] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-10-21T20:56:09.934248] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-10-21T20:56:09.934309] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-10-21T20:56:09.935266] [DEBUG] [LOCAL ] RSKD: Trimmed 48292 records to 33301 (keeping 200 days of data) [2025-10-21T20:56:10.111732] [DEBUG] [LOCAL ] RSKD: Primary data saved (33301 records). [2025-10-21T20:56:10.111854] [INFO ] [MAIN ] RSKD: Full history saved. [2025-10-21T20:56:10.111926] [INFO ] [MAIN ] Update Progress: 1834/2366 symbols completed. RSKD took 21.5s. Estimated remaining: 1h 8m 29s. Rate: 7.8 symbols/min [2025-10-21T20:56:10.278621] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:10.319720] [DEBUG] [LOCAL ] RVLV: Loaded 47502 existing records from primary storage. [2025-10-21T20:56:10.320069] [INFO ] [MAIN ] RVLV: Loaded 47502 existing records. [2025-10-21T20:56:10.497941] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:56:10.498158] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-10-21T20:56:10.498206] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-10-21T20:56:10.498514] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-10-21T20:56:10.498570] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-10-21T20:56:10.563360] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-10. [2025-10-21T20:56:10.866741] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:56:11.139274] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-21T20:56:11.213043] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T20:56:11.351042] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-10-21T20:56:12.151152] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-10-21T20:56:12.362789] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T20:56:12.370090] [INFO ] [REMOTE ] RSG: Full fetch complete (68409 records). [2025-10-21T20:56:12.370223] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-10-21T20:56:12.755069] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-10-21T20:56:12.755246] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-10-21T20:56:12.756351] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-10-21T20:56:12.756411] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-10-21T20:56:12.757725] [DEBUG] [LOCAL ] RSG: Trimmed 68409 records to 47364 (keeping 200 days of data) [2025-10-21T20:56:12.969122] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-10-21T20:56:13.054241] [DEBUG] [LOCAL ] RSG: Primary data saved (47364 records). [2025-10-21T20:56:13.054404] [INFO ] [MAIN ] RSG: Full history saved. [2025-10-21T20:56:13.054591] [INFO ] [MAIN ] Update Progress: 1835/2366 symbols completed. RSG took 39.1s. Estimated remaining: 1h 8m 20s. Rate: 7.8 symbols/min [2025-10-21T20:56:13.233495] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T20:56:13.260296] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:13.285840] [DEBUG] [LOCAL ] RVT: Loaded 26373 existing records from primary storage. [2025-10-21T20:56:13.286099] [INFO ] [MAIN ] RVT: Loaded 26373 existing records. [2025-10-21T20:56:13.462564] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:56:13.462859] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-10-21T20:56:13.462957] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-10-21T20:56:13.463214] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-10-21T20:56:13.463282] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-10-21T20:56:13.756141] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-10-21T20:56:13.824716] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:56:14.240133] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-21T20:56:14.318052] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T20:56:14.551001] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-10-21T20:56:15.022198] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T20:56:15.351030] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-10-21T20:56:16.152421] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-10-21T20:56:16.155172] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T20:56:16.951052] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-10-21T20:56:17.336383] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T20:56:17.372323] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T20:56:17.751004] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-10. [2025-10-21T20:56:18.220132] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T20:56:18.551075] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-10-21T20:56:19.356148] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-10-21T20:56:19.364720] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T20:56:19.371630] [INFO ] [REMOTE ] RTO: Full fetch complete (58843 records). [2025-10-21T20:56:19.371805] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-10-21T20:56:19.754821] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-10-21T20:56:19.754895] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-10-21T20:56:19.755889] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-10-21T20:56:19.755952] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-10-21T20:56:19.757032] [DEBUG] [LOCAL ] RTO: Trimmed 58843 records to 39798 (keeping 200 days of data) [2025-10-21T20:56:19.986900] [DEBUG] [LOCAL ] RTO: Primary data saved (39798 records). [2025-10-21T20:56:19.987025] [INFO ] [MAIN ] RTO: Full history saved. [2025-10-21T20:56:19.987145] [INFO ] [MAIN ] Update Progress: 1836/2366 symbols completed. RTO took 30.3s. Estimated remaining: 1h 8m 12s. Rate: 7.8 symbols/min [2025-10-21T20:56:20.156680] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-10-21T20:56:20.159221] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:20.160768] [DEBUG] [LOCAL ] RVTY: No existing data file found in primary storage. [2025-10-21T20:56:20.160847] [WARN ] [MAIN ] RVTY: No existing data found, performing full refresh instead. [2025-10-21T20:56:20.161060] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-10-21T20:56:20.161194] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-21T20:56:20.161263] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-21T20:56:20.161299] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-10-21T20:56:20.467519] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T20:56:20.554212] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:56:20.951096] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-10-21T20:56:21.533896] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T20:56:21.601187] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T20:56:21.751031] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-10-21T20:56:22.551088] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-10-21T20:56:22.910832] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-21T20:56:23.351029] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-10-21T20:56:23.909352] [DEBUG] [REMOTE ] RVTY: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-21T20:56:23.909703] [WARN ] [REMOTE ] RVTY: No data returned for month 2025-01 [2025-10-21T20:56:23.909915] [FATAL] [REMOTE ] RVTY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:56:23.910055] [FATAL] [MAIN ] RVTY: Failed to fetch primary data. [2025-10-21T20:56:23.910127] [WARN ] [MAIN ] RVTY: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:56:23.910199] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-10-21T20:56:23.938184] [DEBUG] [LOCAL ] RVTY: No primary data file found to delete. [2025-10-21T20:56:23.938439] [INFO ] [LOCAL ] RVTY: Starting deletion of derivative data. [2025-10-21T20:56:23.940203] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-21T20:56:23.944255] [DEBUG] [LOCAL ] RVTY: No derivative data file found to delete. [2025-10-21T20:56:23.951387] [INFO ] [MAIN ] Update Progress: 1837/2366 symbols completed. RVTY took 4.0s. Estimated remaining: 1h 8m 3s. Rate: 7.8 symbols/min [2025-10-21T20:56:24.049456] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T20:56:24.151006] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-10-21T20:56:24.951044] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-10-21T20:56:25.455370] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T20:56:25.751033] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-10-21T20:56:26.551006] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-10-21T20:56:26.796690] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T20:56:27.351086] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-10-21T20:56:27.785055] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T20:56:28.045804] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-21T20:56:28.151033] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-10-21T20:56:28.764908] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T20:56:28.951112] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-10-21T20:56:29.751038] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-10-21T20:56:30.344074] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-21T20:56:30.551057] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-10-21T20:56:30.616837] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-21T20:56:31.156594] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T20:56:31.351024] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-10-21T20:56:31.921079] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T20:56:32.151035] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-10-21T20:56:32.637632] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T20:56:32.951028] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-10-21T20:56:33.450691] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-21T20:56:33.751024] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-10-21T20:56:34.551040] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-10. [2025-10-21T20:56:35.177780] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-21T20:56:35.351044] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-10-21T20:56:35.479221] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T20:56:35.798347] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T20:56:35.802823] [INFO ] [REMOTE ] RVT: Full fetch complete (39139 records). [2025-10-21T20:56:35.802928] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-10-21T20:56:36.154353] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-10-21T20:56:36.190612] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-10-21T20:56:36.190734] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-10-21T20:56:36.191555] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-10-21T20:56:36.191607] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-10-21T20:56:36.192481] [DEBUG] [LOCAL ] RVT: Trimmed 39139 records to 26271 (keeping 200 days of data) [2025-10-21T20:56:36.348874] [DEBUG] [LOCAL ] RVT: Primary data saved (26271 records). [2025-10-21T20:56:36.348997] [INFO ] [MAIN ] RVT: Full history saved. [2025-10-21T20:56:36.349080] [INFO ] [MAIN ] Update Progress: 1838/2366 symbols completed. RVT took 23.3s. Estimated remaining: 1h 7m 57s. Rate: 7.8 symbols/min [2025-10-21T20:56:37.503617] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-21T20:56:37.515192] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-10. [2025-10-21T20:56:37.992747] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T20:56:38.002740] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-10. [2025-10-21T20:56:39.711089] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T20:56:39.718771] [INFO ] [REMOTE ] RVLV: Full fetch complete (68989 records). [2025-10-21T20:56:39.745831] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-10-21T20:56:39.751753] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-21T20:56:39.856540] [INFO ] [REMOTE ] RTX: Full fetch complete (77875 records). [2025-10-21T20:56:39.869894] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-10-21T20:56:40.469103] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-10-21T20:56:40.469502] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-10-21T20:56:40.470621] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-10-21T20:56:40.481271] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-10-21T20:56:40.528927] [DEBUG] [LOCAL ] RVLV: Trimmed 68989 records to 47419 (keeping 200 days of data) [2025-10-21T20:56:40.568446] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-10-21T20:56:40.568528] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-10-21T20:56:40.569204] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-10-21T20:56:40.569292] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-10-21T20:56:40.666225] [DEBUG] [LOCAL ] RTX: Trimmed 77875 records to 53706 (keeping 200 days of data) [2025-10-21T20:56:40.967032] [DEBUG] [LOCAL ] RVLV: Primary data saved (47419 records). [2025-10-21T20:56:40.967175] [INFO ] [MAIN ] RVLV: Full history saved. [2025-10-21T20:56:40.967893] [INFO ] [MAIN ] Update Progress: 1839/2366 symbols completed. RVLV took 30.9s. Estimated remaining: 1h 7m 48s. Rate: 7.8 symbols/min [2025-10-21T20:56:41.168563] [DEBUG] [LOCAL ] RTX: Primary data saved (53706 records). [2025-10-21T20:56:41.168723] [INFO ] [MAIN ] RTX: Full history saved. [2025-10-21T20:56:41.168804] [INFO ] [MAIN ] Update Progress: 1840/2366 symbols completed. RTX took 38.8s. Estimated remaining: 1h 7m 39s. Rate: 7.8 symbols/min [2025-10-21T20:56:41.746750] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:41.789452] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-10-21T20:56:41.813011] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-10-21T20:56:41.839529] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-10-21T20:56:41.872743] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-21T20:56:41.876798] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:41.892538] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:41.892737] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-21T20:56:41.896222] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-10-21T20:56:41.895117] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-10-21T20:56:41.896123] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:41.896464] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-10-21T20:56:41.896405] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-10-21T20:56:41.901933] [DEBUG] [LOCAL ] RWT: No existing data file found in primary storage. [2025-10-21T20:56:41.926035] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-10-21T20:56:41.931580] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-21T20:56:41.925969] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-10-21T20:56:41.931458] [WARN ] [MAIN ] RWT: No existing data found, performing full refresh instead. [2025-10-21T20:56:41.957682] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-21T20:56:41.957793] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-10-21T20:56:41.968210] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-10-21T20:56:41.968322] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-21T20:56:41.989722] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-21T20:56:42.039423] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-10-21T20:56:41.989788] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-10-21T20:56:42.077974] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-10-21T20:56:42.099518] [DEBUG] [LOCAL ] RWT: No primary data file found to delete. [2025-10-21T20:56:42.138446] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-10-21T20:56:43.175819] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:56:43.253001] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-10-21T20:56:43.252747] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:56:43.293477] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:56:43.293743] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-10-21T20:56:43.333022] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:56:43.333277] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-10-21T20:56:43.333552] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-10-21T20:56:44.072869] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T20:56:44.074521] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-10-21T20:56:44.093359] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T20:56:44.094504] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-10-21T20:56:44.146455] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T20:56:44.147762] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-10-21T20:56:44.611850] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T20:56:44.613059] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-10-21T20:56:44.689819] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T20:56:44.769938] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-21T20:56:44.950986] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-10-21T20:56:45.066785] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T20:56:45.203934] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T20:56:45.468627] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-21T20:56:45.751100] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-10-21T20:56:46.321317] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T20:56:46.551060] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-10-21T20:56:47.142799] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T20:56:47.351032] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-10-21T20:56:48.151117] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-10-21T20:56:48.944151] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T20:56:48.956243] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-10-21T20:56:48.967290] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T20:56:49.614541] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T20:56:49.751003] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-10-21T20:56:50.443883] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T20:56:50.551054] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-10-21T20:56:51.184666] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-21T20:56:51.351066] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-10-21T20:56:51.898737] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-21T20:56:52.151014] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-10-21T20:56:52.807664] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-21T20:56:52.951041] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-10-21T20:56:53.751072] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-10-21T20:56:54.296345] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-21T20:56:54.551003] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-10-21T20:56:54.577120] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T20:56:55.114736] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T20:56:55.351038] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-10-21T20:56:56.151054] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-10-21T20:56:56.722625] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T20:56:56.951151] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-10-21T20:56:57.131377] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T20:56:57.475241] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-21T20:56:57.751039] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-10-21T20:56:58.280424] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T20:56:58.551141] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-10. [2025-10-21T20:56:58.922545] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-21T20:56:58.923944] [INFO ] [REMOTE ] RWTN: Full fetch complete (3176 records). [2025-10-21T20:56:58.924035] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-10-21T20:56:59.118205] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-21T20:56:59.118462] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:56:59.118533] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:56:59.118607] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-10-21T20:56:59.118704] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-10-21T20:56:59.118756] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-10-21T20:56:59.118799] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-10-21T20:56:59.118857] [INFO ] [MAIN ] Update Progress: 1841/2366 symbols completed. RWTN took 17.9s. Estimated remaining: 1h 7m 34s. Rate: 7.8 symbols/min [2025-10-21T20:56:59.331216] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:56:59.331432] [DEBUG] [LOCAL ] RXO: No existing data file found in primary storage. [2025-10-21T20:56:59.331475] [WARN ] [MAIN ] RXO: No existing data found, performing full refresh instead. [2025-10-21T20:56:59.331585] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-10-21T20:56:59.331627] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-10-21T20:56:59.331710] [DEBUG] [LOCAL ] RXO: No primary data file found to delete. [2025-10-21T20:56:59.331753] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-10-21T20:56:59.356216] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-10-21T20:56:59.704253] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:57:00.151072] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-10-21T20:57:00.951006] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-10-21T20:57:01.185705] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T20:57:01.581205] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-21T20:57:01.751091] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-10-21T20:57:01.816632] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T20:57:02.462756] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-21T20:57:02.551066] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-10-21T20:57:03.289055] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T20:57:03.351037] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-10-21T20:57:04.019887] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-21T20:57:04.151018] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-10. [2025-10-21T20:57:04.722567] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T20:57:04.723519] [INFO ] [REMOTE ] RWTO: Full fetch complete (4817 records). [2025-10-21T20:57:04.723585] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-10-21T20:57:04.911077] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T20:57:04.911291] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:57:04.911360] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:57:04.911423] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-10-21T20:57:04.911480] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-10-21T20:57:04.911516] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-10-21T20:57:04.911555] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-10-21T20:57:04.911614] [INFO ] [MAIN ] Update Progress: 1842/2366 symbols completed. RWTO took 23.7s. Estimated remaining: 1h 7m 25s. Rate: 7.8 symbols/min [2025-10-21T20:57:04.956228] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-10-21T20:57:05.094069] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:57:05.162133] [DEBUG] [LOCAL ] RY: Loaded 47633 existing records from primary storage. [2025-10-21T20:57:05.162677] [INFO ] [MAIN ] RY: Loaded 47633 existing records. [2025-10-21T20:57:05.351056] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:57:05.351403] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-10-21T20:57:05.351470] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-10-21T20:57:05.352093] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-10-21T20:57:05.352153] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-10-21T20:57:05.732467] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:57:05.751037] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-10-21T20:57:06.551050] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-10-21T20:57:06.659553] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T20:57:07.184503] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T20:57:07.351039] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-10-21T20:57:07.529382] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T20:57:08.151114] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-10-21T20:57:08.859708] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T20:57:08.923565] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T20:57:08.950960] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-10-21T20:57:09.751022] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-10-21T20:57:10.551017] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-10. [2025-10-21T20:57:10.737235] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T20:57:11.123800] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T20:57:11.124636] [INFO ] [REMOTE ] RWTP: Full fetch complete (4685 records). [2025-10-21T20:57:11.124739] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-10-21T20:57:11.302609] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-21T20:57:11.302883] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:57:11.302987] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:57:11.303095] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-10-21T20:57:11.303174] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-10-21T20:57:11.303211] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-10-21T20:57:11.303249] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-10-21T20:57:11.303301] [INFO ] [MAIN ] Update Progress: 1843/2366 symbols completed. RWTP took 30.1s. Estimated remaining: 1h 7m 17s. Rate: 7.8 symbols/min [2025-10-21T20:57:11.358132] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-10-21T20:57:11.483113] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:57:11.518901] [DEBUG] [LOCAL ] RYAM: Loaded 35098 existing records from primary storage. [2025-10-21T20:57:11.519201] [INFO ] [MAIN ] RYAM: Loaded 35098 existing records. [2025-10-21T20:57:11.745764] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:57:11.746123] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-10-21T20:57:11.746807] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-10-21T20:57:11.747963] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T20:57:11.758443] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-10-21T20:57:11.758538] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-10-21T20:57:12.147628] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:57:12.150994] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-10-21T20:57:12.951055] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-10-21T20:57:13.296943] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T20:57:13.452854] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T20:57:13.751059] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-10-21T20:57:14.551147] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-10-21T20:57:14.620133] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T20:57:15.351014] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-10-21T20:57:15.391622] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T20:57:16.151062] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-10-21T20:57:16.466998] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T20:57:16.577964] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T20:57:16.951030] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-10-21T20:57:17.480011] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T20:57:17.751066] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-10-21T20:57:18.551048] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-10-21T20:57:18.727550] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T20:57:19.322677] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T20:57:19.350993] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-10-21T20:57:19.914165] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-21T20:57:20.151046] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-10-21T20:57:20.836031] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T20:57:20.950997] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-10-21T20:57:21.756154] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-10. [2025-10-21T20:57:21.767167] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T20:57:22.551014] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-10-21T20:57:22.851429] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T20:57:22.940132] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T20:57:22.948712] [INFO ] [REMOTE ] RWT: Full fetch complete (58038 records). [2025-10-21T20:57:22.948868] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-10-21T20:57:23.323018] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-10-21T20:57:23.323096] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-10-21T20:57:23.324074] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-10-21T20:57:23.324137] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-10-21T20:57:23.325258] [DEBUG] [LOCAL ] RWT: Trimmed 58038 records to 40481 (keeping 200 days of data) [2025-10-21T20:57:23.372062] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-10-21T20:57:23.575774] [DEBUG] [LOCAL ] RWT: Primary data saved (40481 records). [2025-10-21T20:57:23.575913] [INFO ] [MAIN ] RWT: Full history saved. [2025-10-21T20:57:23.576009] [INFO ] [MAIN ] Update Progress: 1844/2366 symbols completed. RWT took 42.4s. Estimated remaining: 1h 7m 11s. Rate: 7.8 symbols/min [2025-10-21T20:57:23.744893] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:57:23.745067] [DEBUG] [LOCAL ] RYAN: No existing data file found in primary storage. [2025-10-21T20:57:23.745103] [WARN ] [MAIN ] RYAN: No existing data found, performing full refresh instead. [2025-10-21T20:57:23.745234] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-10-21T20:57:23.745301] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-10-21T20:57:23.745351] [DEBUG] [LOCAL ] RYAN: No primary data file found to delete. [2025-10-21T20:57:23.745382] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-10-21T20:57:24.107117] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:57:24.150991] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-10-21T20:57:24.192436] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T20:57:24.951000] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-10-21T20:57:25.523267] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-21T20:57:25.751007] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-10-21T20:57:25.847035] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T20:57:26.550998] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-10-21T20:57:26.695359] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T20:57:27.197057] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T20:57:27.351039] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-10. [2025-10-21T20:57:28.151052] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-10-21T20:57:28.181321] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T20:57:28.950999] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-10-21T20:57:29.091292] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T20:57:29.098518] [INFO ] [REMOTE ] RY: Full fetch complete (69221 records). [2025-10-21T20:57:29.098639] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-10-21T20:57:29.482303] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-10-21T20:57:29.482530] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-10-21T20:57:29.483634] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-10-21T20:57:29.483715] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-10-21T20:57:29.485115] [DEBUG] [LOCAL ] RY: Trimmed 69221 records to 47533 (keeping 200 days of data) [2025-10-21T20:57:29.755365] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-10-21T20:57:29.756106] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T20:57:29.813034] [DEBUG] [LOCAL ] RY: Primary data saved (47533 records). [2025-10-21T20:57:29.813157] [INFO ] [MAIN ] RY: Full history saved. [2025-10-21T20:57:29.814057] [INFO ] [MAIN ] Update Progress: 1845/2366 symbols completed. RY took 24.9s. Estimated remaining: 1h 7m 3s. Rate: 7.8 symbols/min [2025-10-21T20:57:29.988158] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:57:30.013398] [DEBUG] [LOCAL ] RYI: Loaded 21736 existing records from primary storage. [2025-10-21T20:57:30.013614] [INFO ] [MAIN ] RYI: Loaded 21736 existing records. [2025-10-21T20:57:30.196441] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:57:30.196679] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-10-21T20:57:30.196739] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-10-21T20:57:30.196923] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-10-21T20:57:30.196962] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-10-21T20:57:30.554322] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-10-21T20:57:30.559015] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:57:30.623040] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T20:57:31.351054] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-10-21T20:57:31.436089] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T20:57:32.145135] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T20:57:32.152604] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-10-21T20:57:32.669392] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T20:57:32.951039] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-10-21T20:57:33.750997] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-10-21T20:57:33.835796] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T20:57:34.161875] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T20:57:34.551033] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-10-21T20:57:35.351065] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-10-21T20:57:35.688357] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T20:57:35.709440] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-21T20:57:36.151013] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-10-21T20:57:36.777812] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T20:57:36.951004] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-10-21T20:57:37.336037] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T20:57:37.751070] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-10. [2025-10-21T20:57:38.551082] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-10-21T20:57:38.606135] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T20:57:39.351085] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-10-21T20:57:39.428587] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T20:57:39.436459] [INFO ] [REMOTE ] RXO: Full fetch complete (68962 records). [2025-10-21T20:57:39.436561] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-10-21T20:57:39.831139] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-10-21T20:57:39.831286] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-10-21T20:57:39.832562] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-10-21T20:57:39.832665] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-10-21T20:57:39.846689] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T20:57:39.852957] [DEBUG] [LOCAL ] RXO: Trimmed 68962 records to 48484 (keeping 200 days of data) [2025-10-21T20:57:40.151344] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-10-21T20:57:40.155330] [DEBUG] [LOCAL ] RXO: Primary data saved (48484 records). [2025-10-21T20:57:40.155566] [INFO ] [MAIN ] RXO: Full history saved. [2025-10-21T20:57:40.155723] [INFO ] [MAIN ] Update Progress: 1846/2366 symbols completed. RXO took 41.0s. Estimated remaining: 1h 6m 56s. Rate: 7.8 symbols/min [2025-10-21T20:57:40.327062] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:57:40.327207] [DEBUG] [LOCAL ] RYN: No existing data file found in primary storage. [2025-10-21T20:57:40.327243] [WARN ] [MAIN ] RYN: No existing data found, performing full refresh instead. [2025-10-21T20:57:40.327347] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-10-21T20:57:40.327404] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-10-21T20:57:40.327471] [DEBUG] [LOCAL ] RYN: No primary data file found to delete. [2025-10-21T20:57:40.327505] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-10-21T20:57:40.681426] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:57:40.845975] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T20:57:40.951026] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-10-21T20:57:41.751858] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T20:57:41.751983] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-10-21T20:57:42.551028] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-10-21T20:57:42.607193] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T20:57:42.969149] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T20:57:43.351110] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-10-21T20:57:44.151064] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-10-21T20:57:44.281171] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T20:57:44.951019] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-10-21T20:57:45.035704] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T20:57:45.677824] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T20:57:45.751106] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-10-21T20:57:46.551146] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-10-21T20:57:46.681540] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T20:57:47.329211] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T20:57:47.351042] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-10-21T20:57:47.946460] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T20:57:48.151041] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-10-21T20:57:48.831959] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T20:57:48.951055] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-10. [2025-10-21T20:57:49.554198] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T20:57:49.751042] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-10. [2025-10-21T20:57:50.410692] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T20:57:50.418277] [INFO ] [REMOTE ] RYAN: Full fetch complete (64940 records). [2025-10-21T20:57:50.418384] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-10-21T20:57:50.562151] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-10-21T20:57:50.813880] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-10-21T20:57:50.813974] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-10-21T20:57:50.815166] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-10-21T20:57:50.815246] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-10-21T20:57:50.816585] [DEBUG] [LOCAL ] RYAN: Trimmed 64940 records to 45079 (keeping 200 days of data) [2025-10-21T20:57:50.923384] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T20:57:50.934810] [INFO ] [REMOTE ] RYAM: Full fetch complete (49146 records). [2025-10-21T20:57:50.938031] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-10-21T20:57:51.352133] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-10-21T20:57:51.615841] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-10-21T20:57:51.621683] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-10-21T20:57:51.626339] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-10-21T20:57:51.635213] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-10-21T20:57:51.668267] [DEBUG] [LOCAL ] RYAM: Trimmed 49146 records to 35073 (keeping 200 days of data) [2025-10-21T20:57:51.677085] [DEBUG] [LOCAL ] RYAN: Primary data saved (45079 records). [2025-10-21T20:57:51.745448] [INFO ] [MAIN ] RYAN: Full history saved. [2025-10-21T20:57:51.776845] [INFO ] [MAIN ] Update Progress: 1847/2366 symbols completed. RYAN took 28.2s. Estimated remaining: 1h 6m 49s. Rate: 7.8 symbols/min [2025-10-21T20:57:52.071736] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:57:52.155839] [DEBUG] [LOCAL ] RZB: Loaded 5937 existing records from primary storage. [2025-10-21T20:57:52.169531] [INFO ] [MAIN ] RZB: Loaded 5937 existing records. [2025-10-21T20:57:52.379666] [DEBUG] [LOCAL ] RYAM: Primary data saved (35073 records). [2025-10-21T20:57:52.382635] [INFO ] [MAIN ] RYAM: Full history saved. [2025-10-21T20:57:52.383567] [INFO ] [MAIN ] Update Progress: 1848/2366 symbols completed. RYAM took 41.1s. Estimated remaining: 1h 6m 39s. Rate: 7.8 symbols/min [2025-10-21T20:57:52.385148] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T20:57:52.552066] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-10-21T20:57:52.617805] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:57:52.666807] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-10-21T20:57:52.690087] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-10-21T20:57:52.692735] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:57:52.693335] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-10-21T20:57:52.693410] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-10-21T20:57:52.816466] [DEBUG] [LOCAL ] RZC: Loaded 6586 existing records from primary storage. [2025-10-21T20:57:52.832228] [INFO ] [MAIN ] RZC: Loaded 6586 existing records. [2025-10-21T20:57:53.200881] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:57:53.204664] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-10-21T20:57:53.210176] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-10-21T20:57:53.254252] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-10-21T20:57:53.300170] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-10-21T20:57:53.303902] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:57:53.309673] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-10-21T20:57:53.318724] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-21T20:57:53.672719] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:57:53.751607] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-10-21T20:57:54.092032] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T20:57:54.243691] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T20:57:54.536562] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T20:57:54.550999] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-10-21T20:57:55.351063] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-10-21T20:57:55.386210] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T20:57:56.151042] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-10-21T20:57:56.950981] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-10-21T20:57:57.135881] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T20:57:57.259424] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T20:57:57.751055] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-10-21T20:57:57.817246] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-21T20:57:58.315544] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T20:57:58.551035] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-10-21T20:57:59.298625] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T20:57:59.351064] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-10-21T20:58:00.103428] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T20:58:00.151078] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-10-21T20:58:00.951008] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-10-21T20:58:01.014801] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T20:58:01.751019] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-10-21T20:58:02.551016] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-10-21T20:58:02.618661] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T20:58:02.685400] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T20:58:03.351010] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-10-21T20:58:03.761317] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T20:58:03.905717] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T20:58:04.151050] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-10-21T20:58:04.951044] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-10-21T20:58:05.751069] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-10-21T20:58:05.890228] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T20:58:06.066377] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T20:58:06.515428] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-21T20:58:06.550979] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-10. [2025-10-21T20:58:07.322626] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T20:58:07.323963] [INFO ] [REMOTE ] RZC: Full fetch complete (9647 records). [2025-10-21T20:58:07.324029] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-10-21T20:58:07.356190] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-10-21T20:58:07.685060] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-10-21T20:58:07.685146] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-10-21T20:58:07.685407] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-10-21T20:58:07.685467] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-10-21T20:58:07.685972] [DEBUG] [LOCAL ] RZC: Trimmed 9647 records to 6559 (keeping 200 days of data) [2025-10-21T20:58:07.725693] [DEBUG] [LOCAL ] RZC: Primary data saved (6559 records). [2025-10-21T20:58:07.725829] [INFO ] [MAIN ] RZC: Full history saved. [2025-10-21T20:58:07.725907] [INFO ] [MAIN ] Update Progress: 1849/2366 symbols completed. RZC took 15.3s. Estimated remaining: 1h 6m 34s. Rate: 7.8 symbols/min [2025-10-21T20:58:07.896308] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:58:07.948308] [DEBUG] [LOCAL ] S: Loaded 53538 existing records from primary storage. [2025-10-21T20:58:07.948595] [INFO ] [MAIN ] S: Loaded 53538 existing records. [2025-10-21T20:58:08.126574] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:58:08.126781] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-10-21T20:58:08.126828] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-10-21T20:58:08.127010] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-10-21T20:58:08.127049] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-10-21T20:58:08.151027] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-10. [2025-10-21T20:58:08.245512] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-21T20:58:08.493141] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:58:08.951057] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-10-21T20:58:09.751012] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-10-21T20:58:09.836438] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T20:58:09.843768] [INFO ] [REMOTE ] RYN: Full fetch complete (65644 records). [2025-10-21T20:58:09.843893] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-10-21T20:58:10.231098] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-10-21T20:58:10.231180] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-10-21T20:58:10.232245] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-10-21T20:58:10.232329] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-10-21T20:58:10.233695] [DEBUG] [LOCAL ] RYN: Trimmed 65644 records to 45758 (keeping 200 days of data) [2025-10-21T20:58:10.447957] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T20:58:10.515585] [DEBUG] [LOCAL ] RYN: Primary data saved (45758 records). [2025-10-21T20:58:10.515755] [INFO ] [MAIN ] RYN: Full history saved. [2025-10-21T20:58:10.515835] [INFO ] [MAIN ] Update Progress: 1850/2366 symbols completed. RYN took 30.4s. Estimated remaining: 1h 6m 25s. Rate: 7.8 symbols/min [2025-10-21T20:58:10.561250] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-10. [2025-10-21T20:58:10.693299] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:58:10.738142] [DEBUG] [LOCAL ] SA: Loaded 44579 existing records from primary storage. [2025-10-21T20:58:10.738480] [INFO ] [MAIN ] SA: Loaded 44579 existing records. [2025-10-21T20:58:10.927971] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:58:10.928391] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-10-21T20:58:10.928504] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-10-21T20:58:10.928761] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-10-21T20:58:10.928820] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-10-21T20:58:11.329885] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-21T20:58:11.336323] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:58:11.350981] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-10-21T20:58:11.843282] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T20:58:11.847201] [INFO ] [REMOTE ] RYI: Full fetch complete (31889 records). [2025-10-21T20:58:11.847336] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-10-21T20:58:12.156153] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-10-21T20:58:12.223211] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-10-21T20:58:12.223289] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-10-21T20:58:12.223952] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-10-21T20:58:12.224015] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-10-21T20:58:12.224838] [DEBUG] [LOCAL ] RYI: Trimmed 31889 records to 21755 (keeping 200 days of data) [2025-10-21T20:58:12.355496] [DEBUG] [LOCAL ] RYI: Primary data saved (21755 records). [2025-10-21T20:58:12.355622] [INFO ] [MAIN ] RYI: Full history saved. [2025-10-21T20:58:12.355737] [INFO ] [MAIN ] Update Progress: 1851/2366 symbols completed. RYI took 42.5s. Estimated remaining: 1h 6m 15s. Rate: 7.8 symbols/min [2025-10-21T20:58:12.531497] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:58:12.542572] [DEBUG] [LOCAL ] SABA: Loaded 9248 existing records from primary storage. [2025-10-21T20:58:12.542818] [INFO ] [MAIN ] SABA: Loaded 9248 existing records. [2025-10-21T20:58:12.725127] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:58:12.725355] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-10-21T20:58:12.725401] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-10-21T20:58:12.725539] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-10-21T20:58:12.725575] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-10-21T20:58:12.980310] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-10-21T20:58:13.086795] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:58:13.109857] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T20:58:13.751128] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-10-21T20:58:14.240899] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-21T20:58:14.365609] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-10-21T20:58:14.551031] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-10-21T20:58:15.135501] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T20:58:15.249970] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T20:58:15.351025] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-10-21T20:58:16.043997] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T20:58:16.151079] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-10-21T20:58:16.951032] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-10-21T20:58:16.984956] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-21T20:58:17.751087] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-10-21T20:58:18.551030] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-10-21T20:58:18.663086] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T20:58:19.131017] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-21T20:58:19.266816] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-21T20:58:19.351024] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-10-21T20:58:20.151041] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-10-21T20:58:20.951075] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-10-21T20:58:21.073500] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T20:58:21.443825] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T20:58:21.751028] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-10. [2025-10-21T20:58:22.106915] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T20:58:22.512334] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T20:58:22.513460] [INFO ] [REMOTE ] RZB: Full fetch complete (8323 records). [2025-10-21T20:58:22.513530] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-10-21T20:58:22.556110] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-10-21T20:58:22.889539] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-10-21T20:58:22.889621] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-10-21T20:58:22.889872] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-10-21T20:58:22.889924] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-10-21T20:58:22.890311] [DEBUG] [LOCAL ] RZB: Trimmed 8323 records to 5931 (keeping 200 days of data) [2025-10-21T20:58:22.925085] [DEBUG] [LOCAL ] RZB: Primary data saved (5931 records). [2025-10-21T20:58:22.925187] [INFO ] [MAIN ] RZB: Full history saved. [2025-10-21T20:58:22.925277] [INFO ] [MAIN ] Update Progress: 1852/2366 symbols completed. RZB took 31.1s. Estimated remaining: 1h 6m 8s. Rate: 7.8 symbols/min [2025-10-21T20:58:23.095264] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:58:23.095407] [DEBUG] [LOCAL ] SAFE: No existing data file found in primary storage. [2025-10-21T20:58:23.095444] [WARN ] [MAIN ] SAFE: No existing data found, performing full refresh instead. [2025-10-21T20:58:23.095547] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-10-21T20:58:23.095607] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-10-21T20:58:23.095676] [DEBUG] [LOCAL ] SAFE: No primary data file found to delete. [2025-10-21T20:58:23.095728] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-10-21T20:58:23.356214] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-10-21T20:58:23.452852] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:58:24.151002] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-10-21T20:58:24.257635] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T20:58:24.951043] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-10-21T20:58:25.079403] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T20:58:25.339280] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T20:58:25.751082] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-10-21T20:58:26.469878] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T20:58:26.550977] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-10-21T20:58:27.299019] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T20:58:27.351002] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-10-21T20:58:27.916998] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T20:58:28.151072] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-10-21T20:58:28.951002] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-10-21T20:58:29.459837] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T20:58:29.509132] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T20:58:29.648633] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T20:58:29.751025] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-10-21T20:58:30.551010] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-10-21T20:58:31.351050] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-10-21T20:58:31.458024] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T20:58:32.022587] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-21T20:58:32.150981] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-10-21T20:58:32.950998] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-10-21T20:58:33.029026] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T20:58:33.044670] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T20:58:33.751009] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-10-21T20:58:34.551073] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-10-21T20:58:35.204384] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T20:58:35.351052] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-10-21T20:58:35.564140] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-10-21T20:58:36.151005] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-10-21T20:58:36.185637] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T20:58:36.791125] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T20:58:36.950995] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-10-21T20:58:37.016345] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T20:58:37.751032] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-10-21T20:58:38.551019] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-10-21T20:58:39.231107] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-21T20:58:39.351004] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-10. [2025-10-21T20:58:39.468880] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T20:58:40.046570] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T20:58:40.151041] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-10-21T20:58:40.161574] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T20:58:40.163794] [INFO ] [REMOTE ] SABA: Full fetch complete (15104 records). [2025-10-21T20:58:40.163867] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-10-21T20:58:40.574092] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-10-21T20:58:40.574168] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-10-21T20:58:40.574532] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-10-21T20:58:40.574571] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-10-21T20:58:40.575071] [DEBUG] [LOCAL ] SABA: Trimmed 15104 records to 9231 (keeping 200 days of data) [2025-10-21T20:58:40.632937] [DEBUG] [LOCAL ] SABA: Primary data saved (9231 records). [2025-10-21T20:58:40.633060] [INFO ] [MAIN ] SABA: Full history saved. [2025-10-21T20:58:40.633137] [INFO ] [MAIN ] Update Progress: 1853/2366 symbols completed. SABA took 28.3s. Estimated remaining: 1h 6m 4s. Rate: 7.8 symbols/min [2025-10-21T20:58:40.825352] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:58:40.825570] [DEBUG] [LOCAL ] SAH: No existing data file found in primary storage. [2025-10-21T20:58:40.825627] [WARN ] [MAIN ] SAH: No existing data found, performing full refresh instead. [2025-10-21T20:58:40.825779] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-10-21T20:58:40.825825] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-10-21T20:58:40.825904] [DEBUG] [LOCAL ] SAH: No primary data file found to delete. [2025-10-21T20:58:40.825963] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-10-21T20:58:40.956212] [INFO ] [REMOTE ] S: Fetching primary data for 2025-10. [2025-10-21T20:58:41.221081] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:58:41.750995] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-10-21T20:58:42.056841] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T20:58:42.551041] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-10. [2025-10-21T20:58:42.906339] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T20:58:43.008431] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-21T20:58:43.017044] [INFO ] [REMOTE ] S: Full fetch complete (77659 records). [2025-10-21T20:58:43.017197] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-10-21T20:58:43.365768] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-10-21T20:58:43.426415] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-10-21T20:58:43.426503] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-10-21T20:58:43.427768] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-10-21T20:58:43.427835] [DEBUG] [LOCAL ] S: Saving primary data. [2025-10-21T20:58:43.429319] [DEBUG] [LOCAL ] S: Trimmed 77659 records to 53538 (keeping 200 days of data) [2025-10-21T20:58:43.740923] [DEBUG] [LOCAL ] S: Primary data saved (53538 records). [2025-10-21T20:58:43.741056] [INFO ] [MAIN ] S: Full history saved. [2025-10-21T20:58:43.741587] [INFO ] [MAIN ] Update Progress: 1854/2366 symbols completed. S took 36.0s. Estimated remaining: 1h 5m 55s. Rate: 7.8 symbols/min [2025-10-21T20:58:43.916239] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:58:43.916419] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-10-21T20:58:43.916454] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-10-21T20:58:43.916563] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-10-21T20:58:43.916604] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-21T20:58:43.916666] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-21T20:58:43.916721] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-10-21T20:58:44.151719] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-10-21T20:58:44.286349] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:58:44.401333] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T20:58:44.409880] [INFO ] [REMOTE ] SA: Full fetch complete (63461 records). [2025-10-21T20:58:44.410043] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-10-21T20:58:44.883502] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T20:58:44.966128] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-10-21T20:58:44.961122] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-10-21T20:58:44.966289] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-10-21T20:58:44.968852] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-10-21T20:58:44.969078] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-10-21T20:58:44.970523] [DEBUG] [LOCAL ] SA: Trimmed 63461 records to 44659 (keeping 200 days of data) [2025-10-21T20:58:45.254824] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T20:58:45.325061] [DEBUG] [LOCAL ] SA: Primary data saved (44659 records). [2025-10-21T20:58:45.325245] [INFO ] [MAIN ] SA: Full history saved. [2025-10-21T20:58:45.326115] [INFO ] [MAIN ] Update Progress: 1855/2366 symbols completed. SA took 34.8s. Estimated remaining: 1h 5m 45s. Rate: 7.8 symbols/min [2025-10-21T20:58:45.484412] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T20:58:45.598860] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:58:45.598999] [DEBUG] [LOCAL ] SAM: No existing data file found in primary storage. [2025-10-21T20:58:45.599058] [WARN ] [MAIN ] SAM: No existing data found, performing full refresh instead. [2025-10-21T20:58:45.599200] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-10-21T20:58:45.599265] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-10-21T20:58:45.599336] [DEBUG] [LOCAL ] SAM: No primary data file found to delete. [2025-10-21T20:58:45.599393] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-10-21T20:58:45.756213] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-10-21T20:58:46.018447] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:58:46.551068] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-10-21T20:58:47.122824] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T20:58:47.351013] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-10-21T20:58:48.010733] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T20:58:48.151013] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-10-21T20:58:48.768511] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T20:58:48.951054] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-10-21T20:58:49.526703] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T20:58:49.751071] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-10-21T20:58:50.343429] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T20:58:50.551048] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-10-21T20:58:50.976695] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-21T20:58:51.164053] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T20:58:51.351015] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-10-21T20:58:52.151084] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-10-21T20:58:52.565076] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-21T20:58:52.599692] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T20:58:52.951068] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-10-21T20:58:53.751056] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-10. [2025-10-21T20:58:54.364425] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T20:58:54.550987] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-10-21T20:58:54.566268] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T20:58:54.570395] [INFO ] [REMOTE ] SAFE: Full fetch complete (44108 records). [2025-10-21T20:58:54.570482] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-10-21T20:58:54.968318] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-10-21T20:58:54.968407] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-10-21T20:58:54.969277] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-10-21T20:58:54.969353] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-10-21T20:58:54.970235] [DEBUG] [LOCAL ] SAFE: Trimmed 44108 records to 30071 (keeping 200 days of data) [2025-10-21T20:58:55.149634] [DEBUG] [LOCAL ] SAFE: Primary data saved (30071 records). [2025-10-21T20:58:55.149784] [INFO ] [MAIN ] SAFE: Full history saved. [2025-10-21T20:58:55.149855] [INFO ] [MAIN ] Update Progress: 1856/2366 symbols completed. SAFE took 32.2s. Estimated remaining: 1h 5m 38s. Rate: 7.8 symbols/min [2025-10-21T20:58:55.329279] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:58:55.358233] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-10-21T20:58:55.381019] [DEBUG] [LOCAL ] SAN: Loaded 52969 existing records from primary storage. [2025-10-21T20:58:55.381331] [INFO ] [MAIN ] SAN: Loaded 52969 existing records. [2025-10-21T20:58:55.563759] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:58:55.563961] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-10-21T20:58:55.564010] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-10-21T20:58:55.564322] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-10-21T20:58:55.564361] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-10-21T20:58:55.866002] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T20:58:55.947026] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:58:56.151079] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-10-21T20:58:56.553735] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T20:58:56.595409] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T20:58:56.951061] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-10-21T20:58:57.751056] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-10-21T20:58:58.207184] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T20:58:58.551044] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-10-21T20:58:58.876680] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T20:58:59.351021] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-10-21T20:58:59.769368] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-21T20:58:59.902108] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T20:59:00.150997] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-10-21T20:59:00.631363] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T20:59:00.951068] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-10-21T20:59:01.459504] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-21T20:59:01.751076] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-10-21T20:59:02.229383] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T20:59:02.551076] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-10. [2025-10-21T20:59:03.062812] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T20:59:03.063502] [INFO ] [REMOTE ] SAJ: Full fetch complete (946 records). [2025-10-21T20:59:03.063566] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-10-21T20:59:03.235109] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-21T20:59:03.235271] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:59:03.235340] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:59:03.235409] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-10-21T20:59:03.235469] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-10-21T20:59:03.235504] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-10-21T20:59:03.235548] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-10-21T20:59:03.235600] [INFO ] [MAIN ] Update Progress: 1857/2366 symbols completed. SAJ took 19.5s. Estimated remaining: 1h 5m 30s. Rate: 7.8 symbols/min [2025-10-21T20:59:03.356127] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-10-21T20:59:03.405386] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:03.451717] [DEBUG] [LOCAL ] SAP: Loaded 49871 existing records from primary storage. [2025-10-21T20:59:03.452021] [INFO ] [MAIN ] SAP: Loaded 49871 existing records. [2025-10-21T20:59:03.627901] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:59:03.628112] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-10-21T20:59:03.628160] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-10-21T20:59:03.628344] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-10-21T20:59:03.628382] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-10-21T20:59:03.973901] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:04.151027] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-10-21T20:59:04.951089] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-10-21T20:59:05.408003] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T20:59:05.750983] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-10-21T20:59:06.023481] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T20:59:06.209238] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-21T20:59:06.551097] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-10-21T20:59:07.351043] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-10-21T20:59:07.958056] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T20:59:08.151109] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-10-21T20:59:08.378885] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T20:59:08.401004] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T20:59:08.951080] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-10-21T20:59:09.750999] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-10-21T20:59:10.012606] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T20:59:10.551049] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-10-21T20:59:10.786037] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T20:59:10.957318] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T20:59:11.351045] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-10-21T20:59:11.697809] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T20:59:12.151075] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-10. [2025-10-21T20:59:12.672152] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T20:59:12.951019] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-10-21T20:59:13.304527] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T20:59:13.307534] [INFO ] [REMOTE ] SAH: Full fetch complete (30817 records). [2025-10-21T20:59:13.307684] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-10-21T20:59:13.677742] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-10-21T20:59:13.677856] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-10-21T20:59:13.678491] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-10-21T20:59:13.678532] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-10-21T20:59:13.679313] [DEBUG] [LOCAL ] SAH: Trimmed 30817 records to 20845 (keeping 200 days of data) [2025-10-21T20:59:13.765820] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-10-21T20:59:13.807384] [DEBUG] [LOCAL ] SAH: Primary data saved (20845 records). [2025-10-21T20:59:13.807517] [INFO ] [MAIN ] SAH: Full history saved. [2025-10-21T20:59:13.807760] [INFO ] [MAIN ] Update Progress: 1858/2366 symbols completed. SAH took 33.2s. Estimated remaining: 1h 5m 23s. Rate: 7.8 symbols/min [2025-10-21T20:59:13.977628] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:13.993531] [DEBUG] [LOCAL ] SAR: Loaded 17251 existing records from primary storage. [2025-10-21T20:59:13.993774] [INFO ] [MAIN ] SAR: Loaded 17251 existing records. [2025-10-21T20:59:14.187931] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:59:14.188243] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-10-21T20:59:14.188310] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-21T20:59:14.188572] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-10-21T20:59:14.188747] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-10-21T20:59:14.491704] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T20:59:14.552676] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-10-21T20:59:14.577412] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:15.350995] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-10-21T20:59:15.434362] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T20:59:15.794877] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T20:59:16.151006] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-10-21T20:59:16.399220] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T20:59:16.951039] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-10-21T20:59:17.751049] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-10-21T20:59:18.012940] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T20:59:18.551025] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-10-21T20:59:18.807865] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T20:59:19.110790] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-21T20:59:19.351036] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-10. [2025-10-21T20:59:20.151049] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-10-21T20:59:20.619741] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-21T20:59:20.645433] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T20:59:20.649326] [INFO ] [REMOTE ] SAM: Full fetch complete (31224 records). [2025-10-21T20:59:20.649466] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-10-21T20:59:20.959850] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-10-21T20:59:21.070393] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-10-21T20:59:21.070507] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-10-21T20:59:21.071825] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-10-21T20:59:21.071895] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-10-21T20:59:21.072915] [DEBUG] [LOCAL ] SAM: Trimmed 31224 records to 21328 (keeping 200 days of data) [2025-10-21T20:59:21.222934] [DEBUG] [LOCAL ] SAM: Primary data saved (21328 records). [2025-10-21T20:59:21.223160] [INFO ] [MAIN ] SAM: Full history saved. [2025-10-21T20:59:21.223297] [INFO ] [MAIN ] Update Progress: 1859/2366 symbols completed. SAM took 35.9s. Estimated remaining: 1h 5m 16s. Rate: 7.8 symbols/min [2025-10-21T20:59:21.404789] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:21.456769] [DEBUG] [LOCAL ] SARO: Loaded 48307 existing records from primary storage. [2025-10-21T20:59:21.457236] [INFO ] [MAIN ] SARO: Loaded 48307 existing records. [2025-10-21T20:59:21.645263] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:59:21.645584] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-10-21T20:59:21.645637] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-10-21T20:59:21.645924] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-10-21T20:59:21.645969] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-10-21T20:59:21.762985] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-10-21T20:59:22.050918] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:22.081934] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T20:59:22.347223] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-21T20:59:22.551058] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-10-21T20:59:23.351087] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-10-21T20:59:23.886232] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-21T20:59:23.928118] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T20:59:24.151024] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-10-21T20:59:24.256237] [DEBUG] [REMOTE ] SAR: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T20:59:24.256476] [WARN ] [REMOTE ] SAR: No data returned for month 2025-04 [2025-10-21T20:59:24.256572] [FATAL] [REMOTE ] SAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:59:24.256701] [FATAL] [MAIN ] SAR: Failed to fetch primary data. [2025-10-21T20:59:24.256761] [WARN ] [MAIN ] SAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:59:24.256829] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-10-21T20:59:24.256889] [DEBUG] [LOCAL ] SAR: No primary data file found to delete. [2025-10-21T20:59:24.256925] [INFO ] [LOCAL ] SAR: Starting deletion of derivative data. [2025-10-21T20:59:24.257359] [DEBUG] [LOCAL ] SAR: Deleted derivative data file. [2025-10-21T20:59:24.257444] [INFO ] [MAIN ] Update Progress: 1860/2366 symbols completed. SAR took 10.4s. Estimated remaining: 1h 5m 7s. Rate: 7.8 symbols/min [2025-10-21T20:59:24.431284] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:24.431472] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-10-21T20:59:24.431510] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-10-21T20:59:24.431625] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-10-21T20:59:24.431706] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-21T20:59:24.431760] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-21T20:59:24.431792] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-10-21T20:59:24.790976] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:24.950990] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-10-21T20:59:25.377129] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T20:59:25.751032] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-10-21T20:59:26.551022] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-10-21T20:59:26.590416] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T20:59:27.351099] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-10-21T20:59:27.674562] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T20:59:27.906207] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-21T20:59:28.151028] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-10-21T20:59:28.679577] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-21T20:59:28.951017] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-10. [2025-10-21T20:59:29.707386] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T20:59:29.751011] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-10-21T20:59:30.551016] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-10-21T20:59:30.668596] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T20:59:30.676886] [INFO ] [REMOTE ] SAN: Full fetch complete (76563 records). [2025-10-21T20:59:30.677044] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-10-21T20:59:31.076213] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-10-21T20:59:31.076289] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-10-21T20:59:31.077531] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-10-21T20:59:31.077614] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-10-21T20:59:31.079069] [DEBUG] [LOCAL ] SAN: Trimmed 76563 records to 52969 (keeping 200 days of data) [2025-10-21T20:59:31.361280] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-10-21T20:59:31.386285] [DEBUG] [LOCAL ] SAN: Primary data saved (52969 records). [2025-10-21T20:59:31.386375] [INFO ] [MAIN ] SAN: Full history saved. [2025-10-21T20:59:31.386458] [INFO ] [MAIN ] Update Progress: 1861/2366 symbols completed. SAN took 36.2s. Estimated remaining: 1h 4m 59s. Rate: 7.8 symbols/min [2025-10-21T20:59:31.564326] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:31.564553] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-10-21T20:59:31.564613] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-10-21T20:59:31.564749] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-10-21T20:59:31.564827] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-21T20:59:31.564879] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-21T20:59:31.564913] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-10-21T20:59:31.773003] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T20:59:31.890978] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-21T20:59:31.967855] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:32.150983] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-10-21T20:59:32.613472] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-21T20:59:32.698971] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T20:59:32.950996] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-10-21T20:59:33.360538] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-21T20:59:33.751093] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-10-21T20:59:34.551078] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-10-21T20:59:34.980701] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-21T20:59:35.351095] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-10-21T20:59:35.786164] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T20:59:35.827628] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-21T20:59:36.151035] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-10-21T20:59:36.951014] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-10-21T20:59:37.751162] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-10-21T20:59:37.854613] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T20:59:37.897475] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T20:59:38.295446] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-21T20:59:38.551157] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-10-21T20:59:39.188420] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-21T20:59:39.351031] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-10. [2025-10-21T20:59:40.151055] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-10-21T20:59:40.639080] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T20:59:40.951035] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-10-21T20:59:41.361873] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-21T20:59:41.369517] [INFO ] [REMOTE ] SAP: Full fetch complete (72259 records). [2025-10-21T20:59:41.369635] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-10-21T20:59:41.574036] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T20:59:41.752704] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-10-21T20:59:41.771303] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-10-21T20:59:41.771390] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-10-21T20:59:41.772552] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-10-21T20:59:41.772614] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-10-21T20:59:41.774227] [DEBUG] [LOCAL ] SAP: Trimmed 72259 records to 49869 (keeping 200 days of data) [2025-10-21T20:59:42.068829] [DEBUG] [LOCAL ] SAP: Primary data saved (49869 records). [2025-10-21T20:59:42.068956] [INFO ] [MAIN ] SAP: Full history saved. [2025-10-21T20:59:42.069336] [INFO ] [MAIN ] Update Progress: 1862/2366 symbols completed. SAP took 38.8s. Estimated remaining: 1h 4m 52s. Rate: 7.8 symbols/min [2025-10-21T20:59:42.243092] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:42.243263] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-10-21T20:59:42.243318] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-10-21T20:59:42.243440] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-10-21T20:59:42.243503] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-21T20:59:42.243549] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-21T20:59:42.243582] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-10-21T20:59:42.329933] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T20:59:42.556204] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-10-21T20:59:42.611706] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:43.058570] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T20:59:43.351028] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-10-21T20:59:43.976924] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T20:59:44.151010] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-10-21T20:59:44.574943] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T20:59:44.951024] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-10-21T20:59:45.479746] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-21T20:59:45.751077] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-10-21T20:59:46.190123] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T20:59:46.551035] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-10-21T20:59:46.985503] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T20:59:47.351068] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-10-21T20:59:48.151081] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-10-21T20:59:48.581056] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T20:59:48.951060] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-10. [2025-10-21T20:59:49.106009] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T20:59:49.509322] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T20:59:49.510133] [INFO ] [REMOTE ] SAY: Full fetch complete (1377 records). [2025-10-21T20:59:49.510200] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-10-21T20:59:49.692693] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-21T20:59:49.692871] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:59:49.692924] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:59:49.692963] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-10-21T20:59:49.693017] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-10-21T20:59:49.693052] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-10-21T20:59:49.693090] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-10-21T20:59:49.693155] [INFO ] [MAIN ] Update Progress: 1863/2366 symbols completed. SAY took 18.3s. Estimated remaining: 1h 4m 44s. Rate: 7.8 symbols/min [2025-10-21T20:59:49.756312] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-10. [2025-10-21T20:59:49.867930] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:49.899527] [DEBUG] [LOCAL ] SB: Loaded 32611 existing records from primary storage. [2025-10-21T20:59:49.899824] [INFO ] [MAIN ] SB: Loaded 32611 existing records. [2025-10-21T20:59:50.075083] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T20:59:50.075303] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-10-21T20:59:50.075355] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-10-21T20:59:50.075554] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-10-21T20:59:50.075613] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-10-21T20:59:50.323742] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T20:59:50.340778] [INFO ] [REMOTE ] SAT: Full fetch complete (1484 records). [2025-10-21T20:59:50.348676] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-10-21T20:59:50.553366] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-10-21T20:59:50.557134] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:50.611897] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-21T20:59:50.612137] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T20:59:50.612221] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T20:59:50.612310] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-10-21T20:59:50.612410] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-10-21T20:59:50.612478] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-10-21T20:59:50.612528] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-10-21T20:59:50.612584] [INFO ] [MAIN ] Update Progress: 1864/2366 symbols completed. SAT took 26.4s. Estimated remaining: 1h 4m 34s. Rate: 7.8 symbols/min [2025-10-21T20:59:50.782259] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:50.782455] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-10-21T20:59:50.782561] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-10-21T20:59:50.782704] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-10-21T20:59:50.782756] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-21T20:59:50.782807] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-21T20:59:50.782845] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-10-21T20:59:51.126833] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:51.351045] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-10-21T20:59:51.736105] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T20:59:51.736407] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-10-21T20:59:51.736526] [FATAL] [REMOTE ] SBDS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T20:59:51.736612] [FATAL] [MAIN ] SBDS: Failed to fetch primary data. [2025-10-21T20:59:51.736714] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T20:59:51.736803] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-10-21T20:59:51.736885] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-10-21T20:59:51.736924] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-10-21T20:59:51.736964] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-10-21T20:59:51.737010] [INFO ] [MAIN ] Update Progress: 1865/2366 symbols completed. SBDS took 1.1s. Estimated remaining: 1h 4m 25s. Rate: 7.8 symbols/min [2025-10-21T20:59:51.905950] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T20:59:51.906107] [DEBUG] [LOCAL ] SBH: No existing data file found in primary storage. [2025-10-21T20:59:51.906142] [WARN ] [MAIN ] SBH: No existing data found, performing full refresh instead. [2025-10-21T20:59:51.906250] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-10-21T20:59:51.906290] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-10-21T20:59:51.906328] [DEBUG] [LOCAL ] SBH: No primary data file found to delete. [2025-10-21T20:59:51.906358] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-10-21T20:59:52.160117] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-10-21T20:59:52.291268] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T20:59:52.459866] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T20:59:52.951058] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-10-21T20:59:53.751055] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-10-21T20:59:53.815855] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T20:59:54.551011] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-10-21T20:59:54.877324] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T20:59:55.351191] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-10-21T20:59:56.093820] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-21T20:59:56.151070] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-10-21T20:59:56.417528] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T20:59:56.636396] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-21T20:59:56.951044] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-10-21T20:59:57.215537] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T20:59:57.369842] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-21T20:59:57.751079] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-10-21T20:59:58.551030] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-10-21T20:59:59.351112] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-10-21T20:59:59.435030] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:00:00.055094] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T21:00:00.151027] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-10-21T21:00:00.951046] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-10-21T21:00:01.185674] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T21:00:01.751085] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-10-21T21:00:01.876983] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T21:00:02.551103] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-10-21T21:00:02.866764] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T21:00:03.351047] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-10. [2025-10-21T21:00:03.899485] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T21:00:04.038052] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T21:00:04.151034] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-10-21T21:00:04.682231] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-21T21:00:04.951004] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-10-21T21:00:05.187899] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T21:00:05.195464] [INFO ] [REMOTE ] SARO: Full fetch complete (69024 records). [2025-10-21T21:00:05.195580] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-10-21T21:00:05.573132] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-10-21T21:00:05.573207] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-10-21T21:00:05.574268] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-10-21T21:00:05.574331] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-10-21T21:00:05.575555] [DEBUG] [LOCAL ] SARO: Trimmed 69024 records to 48274 (keeping 200 days of data) [2025-10-21T21:00:05.772630] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-10-21T21:00:05.853718] [DEBUG] [LOCAL ] SARO: Primary data saved (48274 records). [2025-10-21T21:00:05.853844] [INFO ] [MAIN ] SARO: Full history saved. [2025-10-21T21:00:05.854617] [INFO ] [MAIN ] Update Progress: 1866/2366 symbols completed. SARO took 44.6s. Estimated remaining: 1h 4m 19s. Rate: 7.8 symbols/min [2025-10-21T21:00:06.035957] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:00:06.046030] [DEBUG] [LOCAL ] SBI: Loaded 7716 existing records from primary storage. [2025-10-21T21:00:06.046239] [INFO ] [MAIN ] SBI: Loaded 7716 existing records. [2025-10-21T21:00:06.217210] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:00:06.217434] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-10-21T21:00:06.217479] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-10-21T21:00:06.217680] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-10-21T21:00:06.217737] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-10-21T21:00:06.492568] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T21:00:06.575390] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:00:06.562677] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-10-21T21:00:06.812526] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T21:00:07.351008] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-10-21T21:00:07.951056] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T21:00:08.151036] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-10-21T21:00:08.797028] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T21:00:08.950995] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-10-21T21:00:09.233014] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T21:00:09.751032] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-10-21T21:00:10.517779] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T21:00:10.550987] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-10-21T21:00:11.351002] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-10-21T21:00:11.693383] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T21:00:11.758869] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T21:00:11.776533] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T21:00:12.151077] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-10-21T21:00:12.951082] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-10-21T21:00:13.546431] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-21T21:00:13.751001] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-10-21T21:00:14.038197] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T21:00:14.267700] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-21T21:00:14.551039] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-10-21T21:00:15.351077] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-10. [2025-10-21T21:00:15.853430] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-21T21:00:15.854273] [INFO ] [REMOTE ] SAZ: Full fetch complete (1858 records). [2025-10-21T21:00:15.854347] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-10-21T21:00:16.049097] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T21:00:16.049320] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:00:16.049604] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:00:16.049714] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-10-21T21:00:16.049894] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-10-21T21:00:16.049951] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-10-21T21:00:16.049995] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-10-21T21:00:16.050053] [INFO ] [MAIN ] Update Progress: 1867/2366 symbols completed. SAZ took 34.0s. Estimated remaining: 1h 4m 12s. Rate: 7.8 symbols/min [2025-10-21T21:00:16.160372] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-10-21T21:00:16.178170] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T21:00:16.282381] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:00:16.293174] [DEBUG] [LOCAL ] SBR: Loaded 7870 existing records from primary storage. [2025-10-21T21:00:16.293387] [INFO ] [MAIN ] SBR: Loaded 7870 existing records. [2025-10-21T21:00:16.472956] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:00:16.473164] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-10-21T21:00:16.473217] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-10-21T21:00:16.473361] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-10-21T21:00:16.473400] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-10-21T21:00:16.856320] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:00:16.951052] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-10. [2025-10-21T21:00:17.344950] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T21:00:17.751032] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-10-21T21:00:18.466700] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T21:00:18.471532] [INFO ] [REMOTE ] SB: Full fetch complete (49415 records). [2025-10-21T21:00:18.471618] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-10-21T21:00:18.560363] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-10-21T21:00:18.857175] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-10-21T21:00:18.857253] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-10-21T21:00:18.858208] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-10-21T21:00:18.858270] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-10-21T21:00:18.859260] [DEBUG] [LOCAL ] SB: Trimmed 49415 records to 32516 (keeping 200 days of data) [2025-10-21T21:00:19.044291] [DEBUG] [LOCAL ] SB: Primary data saved (32516 records). [2025-10-21T21:00:19.044466] [INFO ] [MAIN ] SB: Full history saved. [2025-10-21T21:00:19.044560] [INFO ] [MAIN ] Update Progress: 1868/2366 symbols completed. SB took 29.4s. Estimated remaining: 1h 4m 3s. Rate: 7.8 symbols/min [2025-10-21T21:00:19.211238] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:00:19.255832] [DEBUG] [LOCAL ] SBS: Loaded 49323 existing records from primary storage. [2025-10-21T21:00:19.256153] [INFO ] [MAIN ] SBS: Loaded 49323 existing records. [2025-10-21T21:00:19.355622] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-10-21T21:00:19.433219] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:00:19.433390] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-10-21T21:00:19.433435] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-10-21T21:00:19.433846] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-10-21T21:00:19.433901] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-10-21T21:00:19.696277] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T21:00:19.795252] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:00:20.151035] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-10-21T21:00:20.377851] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T21:00:20.425881] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-21T21:00:20.951072] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-10-21T21:00:21.507051] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T21:00:21.751045] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-10-21T21:00:21.955212] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T21:00:22.551074] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-10. [2025-10-21T21:00:22.871260] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T21:00:23.351075] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-10-21T21:00:24.151064] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-10-21T21:00:24.293265] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T21:00:24.301093] [INFO ] [REMOTE ] SBH: Full fetch complete (73020 records). [2025-10-21T21:00:24.301201] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-10-21T21:00:24.399325] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-21T21:00:24.698374] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-10-21T21:00:24.698452] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-10-21T21:00:24.699561] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-10-21T21:00:24.699622] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-10-21T21:00:24.701008] [DEBUG] [LOCAL ] SBH: Trimmed 73020 records to 49869 (keeping 200 days of data) [2025-10-21T21:00:24.953127] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-10-21T21:00:24.987840] [DEBUG] [LOCAL ] SBH: Primary data saved (49869 records). [2025-10-21T21:00:24.988264] [INFO ] [MAIN ] SBH: Full history saved. [2025-10-21T21:00:24.988354] [INFO ] [MAIN ] Update Progress: 1869/2366 symbols completed. SBH took 33.3s. Estimated remaining: 1h 3m 55s. Rate: 7.8 symbols/min [2025-10-21T21:00:25.156712] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:00:25.156907] [DEBUG] [LOCAL ] SBSI: No existing data file found in primary storage. [2025-10-21T21:00:25.156951] [WARN ] [MAIN ] SBSI: No existing data found, performing full refresh instead. [2025-10-21T21:00:25.157057] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-10-21T21:00:25.157098] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-10-21T21:00:25.157141] [DEBUG] [LOCAL ] SBSI: No primary data file found to delete. [2025-10-21T21:00:25.157174] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-10-21T21:00:25.527638] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:00:25.750995] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-10-21T21:00:25.955018] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T21:00:26.400253] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-21T21:00:26.551065] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-10-21T21:00:26.600426] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T21:00:27.316614] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T21:00:27.350977] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-10-21T21:00:28.151022] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-10-21T21:00:28.258368] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T21:00:28.951017] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-10-21T21:00:29.035333] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T21:00:29.751018] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-10-21T21:00:29.811134] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T21:00:30.550993] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-10-21T21:00:30.923444] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T21:00:31.351000] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-10-21T21:00:32.150991] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-10-21T21:00:32.549408] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T21:00:32.604192] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-21T21:00:32.950998] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-10-21T21:00:33.094405] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T21:00:33.750998] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-10-21T21:00:33.968491] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T21:00:34.465908] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T21:00:34.551046] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-10-21T21:00:35.351020] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-10-21T21:00:36.150997] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-10. [2025-10-21T21:00:36.412577] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T21:00:36.493988] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T21:00:36.910810] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T21:00:36.912509] [INFO ] [REMOTE ] SBI: Full fetch complete (10587 records). [2025-10-21T21:00:36.912578] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-10-21T21:00:36.956161] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-10-21T21:00:37.270013] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-10-21T21:00:37.270151] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-10-21T21:00:37.270474] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-10-21T21:00:37.270538] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-10-21T21:00:37.271020] [DEBUG] [LOCAL ] SBI: Trimmed 10587 records to 7743 (keeping 200 days of data) [2025-10-21T21:00:37.314714] [DEBUG] [LOCAL ] SBI: Primary data saved (7743 records). [2025-10-21T21:00:37.314813] [INFO ] [MAIN ] SBI: Full history saved. [2025-10-21T21:00:37.314886] [INFO ] [MAIN ] Update Progress: 1870/2366 symbols completed. SBI took 31.5s. Estimated remaining: 1h 3m 48s. Rate: 7.8 symbols/min [2025-10-21T21:00:37.487789] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:00:37.487923] [DEBUG] [LOCAL ] SBSW: No existing data file found in primary storage. [2025-10-21T21:00:37.487960] [WARN ] [MAIN ] SBSW: No existing data found, performing full refresh instead. [2025-10-21T21:00:37.488067] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-10-21T21:00:37.488108] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-10-21T21:00:37.488149] [DEBUG] [LOCAL ] SBSW: No primary data file found to delete. [2025-10-21T21:00:37.488183] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-10-21T21:00:37.751674] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-10-21T21:00:37.855190] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:00:37.975253] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T21:00:38.551014] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-10-21T21:00:38.796636] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T21:00:39.351059] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-10-21T21:00:40.151075] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-10-21T21:00:40.501619] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T21:00:40.819105] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-21T21:00:40.950998] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-10-21T21:00:41.288265] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T21:00:41.751012] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-10-21T21:00:42.551011] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-10-21T21:00:42.641002] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T21:00:42.803511] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T21:00:43.339755] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T21:00:43.350988] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-10-21T21:00:44.151028] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-10-21T21:00:44.951030] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-10. [2025-10-21T21:00:45.252142] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T21:00:45.751010] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-10-21T21:00:46.011631] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T21:00:46.014590] [INFO ] [REMOTE ] SBSI: Full fetch complete (21325 records). [2025-10-21T21:00:46.014702] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-10-21T21:00:46.382313] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-10-21T21:00:46.382404] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-10-21T21:00:46.382890] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-10-21T21:00:46.382967] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-10-21T21:00:46.392894] [DEBUG] [LOCAL ] SBSI: Trimmed 21325 records to 14915 (keeping 200 days of data) [2025-10-21T21:00:46.411353] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-21T21:00:46.517414] [DEBUG] [LOCAL ] SBSI: Primary data saved (14915 records). [2025-10-21T21:00:46.517520] [INFO ] [MAIN ] SBSI: Full history saved. [2025-10-21T21:00:46.517616] [INFO ] [MAIN ] Update Progress: 1871/2366 symbols completed. SBSI took 21.5s. Estimated remaining: 1h 3m 41s. Rate: 7.8 symbols/min [2025-10-21T21:00:46.556079] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-10-21T21:00:46.704138] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:00:46.701241] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T21:00:46.706242] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-10-21T21:00:46.706311] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-10-21T21:00:46.706714] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-10-21T21:00:46.706765] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-21T21:00:46.706807] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-21T21:00:46.706838] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-10-21T21:00:47.066206] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:00:47.351263] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-10-21T21:00:47.844498] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-21T21:00:48.151089] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-10-21T21:00:48.299268] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T21:00:48.574137] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-21T21:00:48.951115] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-10-21T21:00:49.751044] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-10-21T21:00:49.795671] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T21:00:50.551061] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-10-21T21:00:50.888371] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-21T21:00:51.351021] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-10-21T21:00:51.675634] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-21T21:00:51.759714] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T21:00:52.151034] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-10-21T21:00:52.951078] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-10-21T21:00:53.751021] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-10-21T21:00:54.256788] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-21T21:00:54.392680] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T21:00:54.550986] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-10. [2025-10-21T21:00:54.664998] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T21:00:55.351042] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-10-21T21:00:55.822699] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T21:00:56.151008] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-10-21T21:00:56.232738] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T21:00:56.240348] [INFO ] [REMOTE ] SBS: Full fetch complete (70649 records). [2025-10-21T21:00:56.240459] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-10-21T21:00:56.630621] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-10-21T21:00:56.630725] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-10-21T21:00:56.631803] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-10-21T21:00:56.631866] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-10-21T21:00:56.633189] [DEBUG] [LOCAL ] SBS: Trimmed 70649 records to 49295 (keeping 200 days of data) [2025-10-21T21:00:56.916878] [DEBUG] [LOCAL ] SBS: Primary data saved (49295 records). [2025-10-21T21:00:56.916997] [INFO ] [MAIN ] SBS: Full history saved. [2025-10-21T21:00:56.917073] [INFO ] [MAIN ] Update Progress: 1872/2366 symbols completed. SBS took 37.9s. Estimated remaining: 1h 3m 34s. Rate: 7.8 symbols/min [2025-10-21T21:00:56.956113] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-10-21T21:00:57.093534] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:00:57.105402] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-21T21:00:57.146789] [DEBUG] [LOCAL ] SCCO: Loaded 49602 existing records from primary storage. [2025-10-21T21:00:57.147112] [INFO ] [MAIN ] SCCO: Loaded 49602 existing records. [2025-10-21T21:00:57.323817] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:00:57.324005] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-10-21T21:00:57.324051] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-10-21T21:00:57.324239] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-10-21T21:00:57.324277] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-10-21T21:00:57.691770] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:00:57.751016] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-10-21T21:00:58.039746] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T21:00:58.551000] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-10. [2025-10-21T21:00:59.351019] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-10-21T21:00:59.538030] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T21:00:59.543857] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T21:00:59.541559] [INFO ] [REMOTE ] SBR: Full fetch complete (11363 records). [2025-10-21T21:00:59.544206] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-10-21T21:00:59.907822] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-10-21T21:00:59.907900] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-10-21T21:00:59.908185] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-10-21T21:00:59.908222] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-10-21T21:00:59.908668] [DEBUG] [LOCAL ] SBR: Trimmed 11363 records to 7880 (keeping 200 days of data) [2025-10-21T21:00:59.955660] [DEBUG] [LOCAL ] SBR: Primary data saved (7880 records). [2025-10-21T21:00:59.955782] [INFO ] [MAIN ] SBR: Full history saved. [2025-10-21T21:00:59.955860] [INFO ] [MAIN ] Update Progress: 1873/2366 symbols completed. SBR took 43.9s. Estimated remaining: 1h 3m 25s. Rate: 7.8 symbols/min [2025-10-21T21:01:00.125748] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:01:00.141196] [DEBUG] [LOCAL ] SCD: Loaded 13520 existing records from primary storage. [2025-10-21T21:01:00.141414] [INFO ] [MAIN ] SCD: Loaded 13520 existing records. [2025-10-21T21:01:00.156228] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-10-21T21:01:00.321092] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:01:00.321337] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-10-21T21:01:00.321386] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-10-21T21:01:00.321567] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-10-21T21:01:00.321623] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-10-21T21:01:00.689805] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:01:00.951026] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-10-21T21:01:01.512748] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T21:01:01.751079] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-10-21T21:01:02.180332] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T21:01:02.487032] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-21T21:01:02.551049] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-10-21T21:01:03.038208] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T21:01:03.351004] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-10-21T21:01:03.604380] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T21:01:04.151003] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-10-21T21:01:04.221192] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T21:01:04.951029] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-10-21T21:01:05.557419] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T21:01:05.751038] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-10-21T21:01:06.126522] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-21T21:01:06.551031] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-10-21T21:01:06.996478] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T21:01:07.351030] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-10. [2025-10-21T21:01:07.774101] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-21T21:01:07.788271] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-21T21:01:07.789057] [INFO ] [REMOTE ] SBXD: Full fetch complete (3142 records). [2025-10-21T21:01:07.789126] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-10-21T21:01:07.963686] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-10-21T21:01:07.963900] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:01:07.963968] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:01:07.964037] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-10-21T21:01:07.964098] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-10-21T21:01:07.964133] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-10-21T21:01:07.964176] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-10-21T21:01:07.964230] [INFO ] [MAIN ] Update Progress: 1874/2366 symbols completed. SBXD took 21.4s. Estimated remaining: 1h 3m 17s. Rate: 7.8 symbols/min [2025-10-21T21:01:08.136119] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:01:08.136361] [DEBUG] [LOCAL ] SCHW: No existing data file found in primary storage. [2025-10-21T21:01:08.136410] [WARN ] [MAIN ] SCHW: No existing data found, performing full refresh instead. [2025-10-21T21:01:08.136542] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-10-21T21:01:08.136583] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-10-21T21:01:08.136623] [DEBUG] [LOCAL ] SCHW: No primary data file found to delete. [2025-10-21T21:01:08.136683] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-10-21T21:01:08.156587] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-10-21T21:01:08.488191] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:01:08.951049] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-10-21T21:01:09.751046] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-10-21T21:01:09.776138] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T21:01:10.344402] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T21:01:10.551047] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-10-21T21:01:11.351006] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-10-21T21:01:11.639806] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T21:01:12.151020] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-10-21T21:01:12.709679] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T21:01:12.951022] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-10-21T21:01:13.110114] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T21:01:13.152054] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-21T21:01:13.751072] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-10. [2025-10-21T21:01:14.551008] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-10-21T21:01:14.921309] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T21:01:15.351122] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-10-21T21:01:15.438360] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T21:01:16.075729] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-21T21:01:16.084471] [INFO ] [REMOTE ] SBSW: Full fetch complete (76749 records). [2025-10-21T21:01:16.084611] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-10-21T21:01:16.156179] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-10-21T21:01:16.487477] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-10-21T21:01:16.487559] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-10-21T21:01:16.488838] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-10-21T21:01:16.488901] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-10-21T21:01:16.490394] [DEBUG] [LOCAL ] SBSW: Trimmed 76749 records to 53185 (keeping 200 days of data) [2025-10-21T21:01:16.805790] [DEBUG] [LOCAL ] SBSW: Primary data saved (53185 records). [2025-10-21T21:01:16.805934] [INFO ] [MAIN ] SBSW: Full history saved. [2025-10-21T21:01:16.806004] [INFO ] [MAIN ] Update Progress: 1875/2366 symbols completed. SBSW took 39.5s. Estimated remaining: 1h 3m 10s. Rate: 7.8 symbols/min [2025-10-21T21:01:16.957529] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-10-21T21:01:16.989761] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:01:16.991086] [DEBUG] [LOCAL ] SCI: No existing data file found in primary storage. [2025-10-21T21:01:16.991132] [WARN ] [MAIN ] SCI: No existing data found, performing full refresh instead. [2025-10-21T21:01:16.991281] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-10-21T21:01:16.991323] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-10-21T21:01:16.991363] [DEBUG] [LOCAL ] SCI: No primary data file found to delete. [2025-10-21T21:01:16.991395] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-10-21T21:01:17.359169] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:01:17.525525] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-21T21:01:17.750987] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-10-21T21:01:17.771738] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T21:01:18.169072] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T21:01:18.551052] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-10-21T21:01:19.351108] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-10-21T21:01:19.584377] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T21:01:20.150988] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-10-21T21:01:20.428602] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T21:01:20.951049] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-10-21T21:01:21.130421] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T21:01:21.751021] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-10-21T21:01:21.941674] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T21:01:22.551022] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-10-21T21:01:22.631557] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T21:01:23.351035] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-10-21T21:01:23.552567] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T21:01:24.151025] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-10-21T21:01:24.475203] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T21:01:24.951057] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-10-21T21:01:25.066790] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T21:01:25.322634] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T21:01:25.751000] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-10-21T21:01:26.551027] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-10-21T21:01:27.175901] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-21T21:01:27.350998] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-10-21T21:01:27.712128] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-21T21:01:28.151000] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-10. [2025-10-21T21:01:28.428838] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T21:01:28.951007] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-10-21T21:01:29.020699] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T21:01:29.751003] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-10-21T21:01:29.891204] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T21:01:29.899908] [INFO ] [REMOTE ] SCCO: Full fetch complete (71888 records). [2025-10-21T21:01:29.900094] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-10-21T21:01:30.079609] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T21:01:30.304090] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-10-21T21:01:30.304167] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-10-21T21:01:30.305319] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-10-21T21:01:30.305386] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-10-21T21:01:30.306684] [DEBUG] [LOCAL ] SCCO: Trimmed 71888 records to 49596 (keeping 200 days of data) [2025-10-21T21:01:30.551246] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-10-21T21:01:30.613086] [DEBUG] [LOCAL ] SCCO: Primary data saved (49596 records). [2025-10-21T21:01:30.613209] [INFO ] [MAIN ] SCCO: Full history saved. [2025-10-21T21:01:30.613285] [INFO ] [MAIN ] Update Progress: 1876/2366 symbols completed. SCCO took 33.7s. Estimated remaining: 1h 3m 4s. Rate: 7.8 symbols/min [2025-10-21T21:01:30.788276] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:01:30.788466] [DEBUG] [LOCAL ] SCL: No existing data file found in primary storage. [2025-10-21T21:01:30.788517] [WARN ] [MAIN ] SCL: No existing data found, performing full refresh instead. [2025-10-21T21:01:30.788685] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-10-21T21:01:30.788746] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-10-21T21:01:30.788793] [DEBUG] [LOCAL ] SCL: No primary data file found to delete. [2025-10-21T21:01:30.788827] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-10-21T21:01:31.140930] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:01:31.351015] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-10-21T21:01:31.574206] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T21:01:31.910675] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-21T21:01:32.151022] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-10. [2025-10-21T21:01:32.200498] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T21:01:32.951011] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-10-21T21:01:33.118941] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-21T21:01:33.127298] [INFO ] [REMOTE ] SCHW: Full fetch complete (77865 records). [2025-10-21T21:01:33.127433] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-10-21T21:01:33.520209] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-10-21T21:01:33.520285] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-10-21T21:01:33.521413] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-10-21T21:01:33.521487] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-10-21T21:01:33.522913] [DEBUG] [LOCAL ] SCHW: Trimmed 77865 records to 53685 (keeping 200 days of data) [2025-10-21T21:01:33.753888] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-10-21T21:01:33.851490] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-10-21T21:01:33.851631] [INFO ] [MAIN ] SCHW: Full history saved. [2025-10-21T21:01:33.851745] [INFO ] [MAIN ] Update Progress: 1877/2366 symbols completed. SCHW took 25.9s. Estimated remaining: 1h 2m 55s. Rate: 7.8 symbols/min [2025-10-21T21:01:34.551031] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-10. [2025-10-21T21:01:34.751008] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T21:01:34.769111] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T21:01:35.351057] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-10-21T21:01:35.466490] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T21:01:35.469143] [INFO ] [REMOTE ] SCD: Full fetch complete (17099 records). [2025-10-21T21:01:35.469226] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-10-21T21:01:35.838362] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-10-21T21:01:35.838436] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-10-21T21:01:35.838783] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-10-21T21:01:35.838844] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-10-21T21:01:35.839540] [DEBUG] [LOCAL ] SCD: Trimmed 17099 records to 13518 (keeping 200 days of data) [2025-10-21T21:01:35.921106] [DEBUG] [LOCAL ] SCD: Primary data saved (13518 records). [2025-10-21T21:01:35.921240] [INFO ] [MAIN ] SCD: Full history saved. [2025-10-21T21:01:35.921320] [INFO ] [MAIN ] Update Progress: 1878/2366 symbols completed. SCD took 36.0s. Estimated remaining: 1h 2m 46s. Rate: 7.8 symbols/min [2025-10-21T21:01:36.150987] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-10-21T21:01:36.215145] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T21:01:36.951006] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-10-21T21:01:37.886525] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T21:01:37.896906] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-10-21T21:01:38.130864] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T21:01:38.551110] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-10-21T21:01:39.702431] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T21:01:39.711962] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-10-21T21:01:41.566308] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T21:01:41.579399] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-10-21T21:01:43.349625] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T21:01:43.359513] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-10-21T21:01:45.108236] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T21:01:45.118280] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-10. [2025-10-21T21:01:46.041445] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (7.49 seconds). [2025-10-21T21:01:46.045205] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-10-21T21:01:46.821019] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T21:01:46.828317] [INFO ] [REMOTE ] SCI: Full fetch complete (67575 records). [2025-10-21T21:01:46.828484] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-10-21T21:01:46.959774] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T21:01:46.997228] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-10-21T21:01:47.251583] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-10-21T21:01:47.251709] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-10-21T21:01:47.252879] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-10-21T21:01:47.252945] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-10-21T21:01:47.254370] [DEBUG] [LOCAL ] SCI: Trimmed 67575 records to 46251 (keeping 200 days of data) [2025-10-21T21:01:47.532539] [DEBUG] [LOCAL ] SCI: Primary data saved (46251 records). [2025-10-21T21:01:47.532704] [INFO ] [MAIN ] SCI: Full history saved. [2025-10-21T21:01:47.532790] [INFO ] [MAIN ] Update Progress: 1879/2366 symbols completed. SCI took 30.7s. Estimated remaining: 1h 2m 39s. Rate: 7.8 symbols/min [2025-10-21T21:01:48.095086] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T21:01:48.099017] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-10-21T21:01:49.352047] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-21T21:01:49.356285] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-10-21T21:01:50.343869] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T21:01:50.348265] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-10. [2025-10-21T21:01:51.390383] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T21:01:51.393358] [INFO ] [REMOTE ] SCL: Full fetch complete (21579 records). [2025-10-21T21:01:51.393428] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-10-21T21:01:51.752446] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-10-21T21:01:51.752517] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-10-21T21:01:51.752901] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-10-21T21:01:51.752960] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-10-21T21:01:51.753491] [DEBUG] [LOCAL ] SCL: Trimmed 21579 records to 15125 (keeping 200 days of data) [2025-10-21T21:01:51.846556] [DEBUG] [LOCAL ] SCL: Primary data saved (15125 records). [2025-10-21T21:01:51.846703] [INFO ] [MAIN ] SCL: Full history saved. [2025-10-21T21:01:51.846783] [INFO ] [MAIN ] Update Progress: 1880/2366 symbols completed. SCL took 21.2s. Estimated remaining: 1h 2m 30s. Rate: 7.8 symbols/min [2025-10-21T21:01:52.484048] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:01:52.549531] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:01:52.550390] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:01:52.548765] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:01:52.563472] [DEBUG] [LOCAL ] SDHC: Loaded 10386 existing records from primary storage. [2025-10-21T21:01:52.563842] [INFO ] [MAIN ] SDHC: Loaded 10386 existing records. [2025-10-21T21:01:52.694471] [DEBUG] [LOCAL ] SCM: Loaded 20080 existing records from primary storage. [2025-10-21T21:01:52.711168] [INFO ] [MAIN ] SCM: Loaded 20080 existing records. [2025-10-21T21:01:52.840289] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:01:52.861888] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-10-21T21:01:52.861970] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-10-21T21:01:52.873412] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-10-21T21:01:52.862794] [DEBUG] [LOCAL ] SD: Loaded 28534 existing records from primary storage. [2025-10-21T21:01:52.883973] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-10-21T21:01:52.889449] [INFO ] [MAIN ] SD: Loaded 28534 existing records. [2025-10-21T21:01:52.950639] [DEBUG] [LOCAL ] SCS: Loaded 43377 existing records from primary storage. [2025-10-21T21:01:53.075048] [INFO ] [MAIN ] SCS: Loaded 43377 existing records. [2025-10-21T21:01:53.345820] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:01:53.405523] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-10-21T21:01:53.413696] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:01:53.424270] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-10-21T21:01:53.438869] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-10-21T21:01:53.460478] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-10-21T21:01:53.451584] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-10-21T21:01:53.460761] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-10-21T21:01:53.509593] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-10-21T21:01:53.543124] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-10-21T21:01:53.777989] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:01:53.869229] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-10-21T21:01:53.869442] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-10-21T21:01:53.878602] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-10-21T21:01:53.931923] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-10-21T21:01:54.282058] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:01:54.364722] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-10-21T21:01:54.634729] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:01:54.752525] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:01:54.737488] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-10-21T21:01:54.780027] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-10-21T21:01:54.869380] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:01:54.869686] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-10-21T21:01:55.645222] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T21:01:55.648764] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-10-21T21:01:56.079498] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T21:01:56.084820] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-10-21T21:01:56.106751] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T21:01:56.110577] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-10-21T21:01:56.495327] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T21:01:56.502832] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-10-21T21:01:56.511290] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T21:01:56.514556] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-10-21T21:01:57.216493] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T21:01:57.220151] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-10-21T21:01:57.248282] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T21:01:57.253157] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-10-21T21:01:57.580797] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T21:01:57.584421] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-10-21T21:01:57.893430] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T21:01:57.900953] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-10-21T21:01:58.221126] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T21:01:58.233144] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T21:01:58.236565] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-10-21T21:01:58.232922] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-10-21T21:01:58.299212] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-21T21:01:58.551069] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-10-21T21:01:59.094939] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-21T21:01:59.313257] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T21:01:59.350982] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-10-21T21:01:59.444235] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T21:01:59.595058] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T21:02:00.102577] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T21:02:00.151015] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-10-21T21:02:00.951053] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-10-21T21:02:01.281947] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T21:02:01.751000] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-10-21T21:02:01.846195] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T21:02:02.551066] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-10-21T21:02:02.984504] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T21:02:03.351014] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-10-21T21:02:03.636632] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T21:02:04.151032] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-10-21T21:02:04.775290] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T21:02:04.951007] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-10-21T21:02:05.064674] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T21:02:05.751075] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-10-21T21:02:06.551044] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-10-21T21:02:06.620374] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T21:02:06.940476] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T21:02:07.351048] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-10-21T21:02:07.749038] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T21:02:08.151003] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-10-21T21:02:08.951007] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-10-21T21:02:08.992080] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T21:02:09.438501] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T21:02:09.751006] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-10-21T21:02:09.817462] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T21:02:10.551040] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-10. [2025-10-21T21:02:11.351071] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-10-21T21:02:11.411956] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T21:02:11.843539] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T21:02:11.847766] [INFO ] [REMOTE ] SCM: Full fetch complete (29211 records). [2025-10-21T21:02:11.847852] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-10-21T21:02:12.156219] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-10-21T21:02:12.218683] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-10-21T21:02:12.218826] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-10-21T21:02:12.219429] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-10-21T21:02:12.219469] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-10-21T21:02:12.220248] [DEBUG] [LOCAL ] SCM: Trimmed 29211 records to 20048 (keeping 200 days of data) [2025-10-21T21:02:12.343405] [DEBUG] [LOCAL ] SCM: Primary data saved (20048 records). [2025-10-21T21:02:12.343517] [INFO ] [MAIN ] SCM: Full history saved. [2025-10-21T21:02:12.344171] [INFO ] [MAIN ] Update Progress: 1881/2366 symbols completed. SCM took 20.5s. Estimated remaining: 1h 2m 26s. Rate: 7.8 symbols/min [2025-10-21T21:02:12.536304] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:02:12.550316] [DEBUG] [LOCAL ] SDHY: Loaded 11160 existing records from primary storage. [2025-10-21T21:02:12.550529] [INFO ] [MAIN ] SDHY: Loaded 11160 existing records. [2025-10-21T21:02:12.730470] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:02:12.730685] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-10-21T21:02:12.730751] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-10-21T21:02:12.730906] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-10-21T21:02:12.730948] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-10-21T21:02:12.850575] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T21:02:12.959924] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-10-21T21:02:13.121803] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:02:13.573504] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T21:02:13.751040] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-10. [2025-10-21T21:02:14.352107] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T21:02:14.501922] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T21:02:14.504442] [INFO ] [REMOTE ] SDHC: Full fetch complete (16765 records). [2025-10-21T21:02:14.504522] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-10-21T21:02:14.557419] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-10-21T21:02:14.878484] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-10-21T21:02:14.878560] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-10-21T21:02:14.878981] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-10-21T21:02:14.879043] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-10-21T21:02:14.879587] [DEBUG] [LOCAL ] SDHC: Trimmed 16765 records to 10367 (keeping 200 days of data) [2025-10-21T21:02:14.943718] [DEBUG] [LOCAL ] SDHC: Primary data saved (10367 records). [2025-10-21T21:02:14.943849] [INFO ] [MAIN ] SDHC: Full history saved. [2025-10-21T21:02:14.943930] [INFO ] [MAIN ] Update Progress: 1882/2366 symbols completed. SDHC took 23.1s. Estimated remaining: 1h 2m 17s. Rate: 7.8 symbols/min [2025-10-21T21:02:15.135172] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:02:15.173468] [DEBUG] [LOCAL ] SDRL: Loaded 41446 existing records from primary storage. [2025-10-21T21:02:15.173827] [INFO ] [MAIN ] SDRL: Loaded 41446 existing records. [2025-10-21T21:02:15.356219] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-10-21T21:02:15.387452] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:02:15.387845] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-10-21T21:02:15.387911] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-21T21:02:15.388205] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-10-21T21:02:15.388283] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-10-21T21:02:15.769932] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:02:16.009623] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T21:02:16.151063] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-10-21T21:02:16.631568] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-21T21:02:16.951075] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-10-21T21:02:17.751006] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-10-21T21:02:17.811327] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T21:02:18.551000] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-10. [2025-10-21T21:02:18.645217] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T21:02:18.818150] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-21T21:02:19.351026] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-10-21T21:02:19.558439] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T21:02:19.563076] [INFO ] [REMOTE ] SD: Full fetch complete (40728 records). [2025-10-21T21:02:19.563225] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-10-21T21:02:19.954684] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-10-21T21:02:19.954789] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-10-21T21:02:19.955592] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-10-21T21:02:19.955636] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-10-21T21:02:19.956607] [DEBUG] [LOCAL ] SD: Trimmed 40728 records to 28387 (keeping 200 days of data) [2025-10-21T21:02:20.122844] [DEBUG] [LOCAL ] SD: Primary data saved (28387 records). [2025-10-21T21:02:20.122933] [INFO ] [MAIN ] SD: Full history saved. [2025-10-21T21:02:20.123009] [INFO ] [MAIN ] Update Progress: 1883/2366 symbols completed. SD took 28.3s. Estimated remaining: 1h 2m 9s. Rate: 7.8 symbols/min [2025-10-21T21:02:20.155024] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-10-21T21:02:20.294203] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:02:20.294341] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-10-21T21:02:20.294379] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-10-21T21:02:20.294485] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-10-21T21:02:20.294528] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-21T21:02:20.294569] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-10-21T21:02:20.294601] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-10-21T21:02:20.644630] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:02:20.951042] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-10-21T21:02:21.107075] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T21:02:21.751082] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-10. [2025-10-21T21:02:21.820233] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T21:02:22.551034] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-10-21T21:02:22.741302] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T21:02:23.351009] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-10-21T21:02:23.372470] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T21:02:23.380078] [INFO ] [REMOTE ] SCS: Full fetch complete (61073 records). [2025-10-21T21:02:23.380208] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-10-21T21:02:23.496924] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T21:02:23.776768] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-10-21T21:02:23.776843] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-10-21T21:02:23.777876] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-10-21T21:02:23.777938] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-10-21T21:02:23.779087] [DEBUG] [LOCAL ] SCS: Trimmed 61073 records to 43289 (keeping 200 days of data) [2025-10-21T21:02:24.039369] [DEBUG] [LOCAL ] SCS: Primary data saved (43289 records). [2025-10-21T21:02:24.039513] [INFO ] [MAIN ] SCS: Full history saved. [2025-10-21T21:02:24.040318] [INFO ] [MAIN ] Update Progress: 1884/2366 symbols completed. SCS took 32.2s. Estimated remaining: 1h 1m 60s. Rate: 7.8 symbols/min [2025-10-21T21:02:24.156492] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-10-21T21:02:24.213514] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:02:24.213753] [DEBUG] [LOCAL ] SEE: No existing data file found in primary storage. [2025-10-21T21:02:24.213799] [WARN ] [MAIN ] SEE: No existing data found, performing full refresh instead. [2025-10-21T21:02:24.213907] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-10-21T21:02:24.213952] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-10-21T21:02:24.213993] [DEBUG] [LOCAL ] SEE: No primary data file found to delete. [2025-10-21T21:02:24.214026] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-10-21T21:02:24.566896] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:02:24.951008] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-10-21T21:02:25.523214] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-10-21T21:02:25.544176] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T21:02:25.751021] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-10-21T21:02:25.852731] [DEBUG] [REMOTE ] SDRL: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-21T21:02:25.853115] [WARN ] [REMOTE ] SDRL: No data returned for month 2025-03 [2025-10-21T21:02:25.853245] [FATAL] [REMOTE ] SDRL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:02:25.853351] [FATAL] [MAIN ] SDRL: Failed to fetch primary data. [2025-10-21T21:02:25.853417] [WARN ] [MAIN ] SDRL: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:02:25.853492] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-10-21T21:02:25.853552] [DEBUG] [LOCAL ] SDRL: No primary data file found to delete. [2025-10-21T21:02:25.853587] [INFO ] [LOCAL ] SDRL: Starting deletion of derivative data. [2025-10-21T21:02:25.853737] [DEBUG] [LOCAL ] SDRL: Deleted derivative data file. [2025-10-21T21:02:25.853819] [INFO ] [MAIN ] Update Progress: 1885/2366 symbols completed. SDRL took 10.9s. Estimated remaining: 1h 1m 51s. Rate: 7.8 symbols/min [2025-10-21T21:02:26.024002] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:02:26.038201] [DEBUG] [LOCAL ] SEG: Loaded 12718 existing records from primary storage. [2025-10-21T21:02:26.038417] [INFO ] [MAIN ] SEG: Loaded 12718 existing records. [2025-10-21T21:02:26.217628] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:02:26.217850] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-10-21T21:02:26.217899] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-10-21T21:02:26.218055] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-10-21T21:02:26.218094] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-10-21T21:02:26.556205] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-10-21T21:02:26.593738] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:02:26.662231] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T21:02:27.351051] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-10-21T21:02:27.495028] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T21:02:28.151042] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-10-21T21:02:28.376999] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T21:02:28.951005] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-10-21T21:02:29.015484] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T21:02:29.750994] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-10-21T21:02:29.977880] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T21:02:30.551040] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-10-21T21:02:31.351027] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-10-21T21:02:31.450912] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T21:02:31.491497] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T21:02:32.151007] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-10-21T21:02:32.951048] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-10-21T21:02:33.226411] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T21:02:33.561436] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-21T21:02:33.751065] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-10-21T21:02:33.856489] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T21:02:34.551095] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-10-21T21:02:35.351009] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-10-21T21:02:35.688980] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T21:02:35.874583] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-21T21:02:36.151026] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-10-21T21:02:36.951064] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-10-21T21:02:37.119848] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T21:02:37.153908] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T21:02:37.751041] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-10-21T21:02:38.551010] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-10-21T21:02:39.194292] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-21T21:02:39.216906] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-21T21:02:39.351037] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-10. [2025-10-21T21:02:40.151013] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-10-21T21:02:40.277460] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T21:02:40.280056] [INFO ] [REMOTE ] SDHY: Full fetch complete (15877 records). [2025-10-21T21:02:40.280123] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-10-21T21:02:40.635975] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-10-21T21:02:40.636047] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-10-21T21:02:40.636376] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-10-21T21:02:40.636412] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-10-21T21:02:40.637004] [DEBUG] [LOCAL ] SDHY: Trimmed 15877 records to 11218 (keeping 200 days of data) [2025-10-21T21:02:40.703239] [DEBUG] [LOCAL ] SDHY: Primary data saved (11218 records). [2025-10-21T21:02:40.703365] [INFO ] [MAIN ] SDHY: Full history saved. [2025-10-21T21:02:40.703440] [INFO ] [MAIN ] Update Progress: 1886/2366 symbols completed. SDHY took 28.4s. Estimated remaining: 1h 1m 45s. Rate: 7.8 symbols/min [2025-10-21T21:02:40.874088] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:02:40.874265] [DEBUG] [LOCAL ] SEI: No existing data file found in primary storage. [2025-10-21T21:02:40.874318] [WARN ] [MAIN ] SEI: No existing data found, performing full refresh instead. [2025-10-21T21:02:40.874422] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-10-21T21:02:40.874463] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-10-21T21:02:40.874503] [DEBUG] [LOCAL ] SEI: No primary data file found to delete. [2025-10-21T21:02:40.874533] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-10-21T21:02:40.963352] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-10-21T21:02:41.225367] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:02:41.750996] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-10-21T21:02:42.017106] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T21:02:42.224825] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-21T21:02:42.551003] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-10-21T21:02:42.585761] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (4.83 seconds). [2025-10-21T21:02:43.275087] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:02:43.351028] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-10-21T21:02:44.151086] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-10-21T21:02:44.531628] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-21T21:02:44.951001] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-10-21T21:02:45.259780] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T21:02:45.751006] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-10-21T21:02:45.959830] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T21:02:46.551092] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-10-21T21:02:47.169097] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-21T21:02:47.356139] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-10-21T21:02:47.364050] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T21:02:47.496194] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T21:02:48.151080] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-10-21T21:02:48.950996] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-10-21T21:02:49.233155] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T21:02:49.319301] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-21T21:02:49.751003] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-10-21T21:02:50.457467] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T21:02:50.550986] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-10-21T21:02:50.691063] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T21:02:51.351060] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-10-21T21:02:52.151084] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-10-21T21:02:52.441100] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T21:02:52.951024] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-10. [2025-10-21T21:02:53.579367] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-21T21:02:53.654130] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T21:02:53.751029] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-10. [2025-10-21T21:02:53.775203] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-21T21:02:53.777182] [INFO ] [REMOTE ] SEG: Full fetch complete (19748 records). [2025-10-21T21:02:53.777252] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-10-21T21:02:54.141554] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-10-21T21:02:54.141630] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-10-21T21:02:54.142111] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-10-21T21:02:54.142158] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-10-21T21:02:54.142706] [DEBUG] [LOCAL ] SEG: Trimmed 19748 records to 12613 (keeping 200 days of data) [2025-10-21T21:02:54.216410] [DEBUG] [LOCAL ] SEG: Primary data saved (12613 records). [2025-10-21T21:02:54.216531] [INFO ] [MAIN ] SEG: Full history saved. [2025-10-21T21:02:54.216616] [INFO ] [MAIN ] Update Progress: 1887/2366 symbols completed. SEG took 28.4s. Estimated remaining: 1h 1m 39s. Rate: 7.8 symbols/min [2025-10-21T21:02:54.386942] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:02:54.387214] [DEBUG] [LOCAL ] SEM: No existing data file found in primary storage. [2025-10-21T21:02:54.387264] [WARN ] [MAIN ] SEM: No existing data found, performing full refresh instead. [2025-10-21T21:02:54.387546] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-10-21T21:02:54.387945] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-10-21T21:02:54.388179] [DEBUG] [LOCAL ] SEM: No primary data file found to delete. [2025-10-21T21:02:54.388235] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-10-21T21:02:54.553683] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-10-21T21:02:54.580466] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T21:02:54.704362] [INFO ] [REMOTE ] SE: Full fetch complete (76882 records). [2025-10-21T21:02:54.707076] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-10-21T21:02:54.718314] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T21:02:54.748586] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:02:54.761290] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:02:54.767248] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-10-21T21:02:54.768973] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-10-21T21:02:54.789276] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-10-21T21:02:54.789202] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:02:54.789581] [DEBUG] [LOCAL ] SE: No derivative data file found to delete. [2025-10-21T21:02:54.789687] [INFO ] [MAIN ] Update Progress: 1888/2366 symbols completed. SE took 34.7s. Estimated remaining: 1h 1m 29s. Rate: 7.8 symbols/min [2025-10-21T21:02:54.957390] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:02:54.997462] [DEBUG] [LOCAL ] SEMR: Loaded 42107 existing records from primary storage. [2025-10-21T21:02:54.997791] [INFO ] [MAIN ] SEMR: Loaded 42107 existing records. [2025-10-21T21:02:55.174498] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:02:55.174716] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-10-21T21:02:55.174769] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-10-21T21:02:55.174980] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-10-21T21:02:55.175034] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-10-21T21:02:55.358848] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-10-21T21:02:55.551010] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:02:56.151009] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-10-21T21:02:56.463713] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T21:02:56.951122] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-10-21T21:02:57.100458] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T21:02:57.680465] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T21:02:57.751111] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-10-21T21:02:58.553730] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-10. [2025-10-21T21:02:58.559633] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T21:02:59.351032] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-10-21T21:02:59.557455] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T21:03:00.151107] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-10-21T21:03:00.248555] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T21:03:00.255985] [INFO ] [REMOTE ] SEE: Full fetch complete (70061 records). [2025-10-21T21:03:00.256092] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-10-21T21:03:00.636452] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-10-21T21:03:00.636522] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-10-21T21:03:00.637577] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-10-21T21:03:00.637675] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-10-21T21:03:00.639059] [DEBUG] [LOCAL ] SEE: Trimmed 70061 records to 48111 (keeping 200 days of data) [2025-10-21T21:03:00.927968] [DEBUG] [LOCAL ] SEE: Primary data saved (48111 records). [2025-10-21T21:03:00.928218] [INFO ] [MAIN ] SEE: Full history saved. [2025-10-21T21:03:00.928420] [INFO ] [MAIN ] Update Progress: 1889/2366 symbols completed. SEE took 36.9s. Estimated remaining: 1h 1m 21s. Rate: 7.8 symbols/min [2025-10-21T21:03:00.958999] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-10-21T21:03:01.105883] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:03:01.128583] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T21:03:01.180354] [DEBUG] [LOCAL ] SES: Loaded 51598 existing records from primary storage. [2025-10-21T21:03:01.180670] [INFO ] [MAIN ] SES: Loaded 51598 existing records. [2025-10-21T21:03:01.357143] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:03:01.357410] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-10-21T21:03:01.357458] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-10-21T21:03:01.357740] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-10-21T21:03:01.357798] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-10-21T21:03:01.710857] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:03:01.750979] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-10-21T21:03:02.551069] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-10-21T21:03:02.619368] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T21:03:03.351056] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-10-21T21:03:03.495186] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (3.34 seconds). [2025-10-21T21:03:03.912598] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-21T21:03:04.151016] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-10-21T21:03:04.918396] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (3.17 seconds). [2025-10-21T21:03:04.950996] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-10-21T21:03:05.134879] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T21:03:05.751071] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-10-21T21:03:06.254813] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T21:03:06.535888] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T21:03:06.550990] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-10-21T21:03:07.351055] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-10-21T21:03:08.151035] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-10-21T21:03:08.176221] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T21:03:08.299753] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-21T21:03:08.950999] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-10-21T21:03:09.098675] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T21:03:09.751000] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-10-21T21:03:10.185811] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T21:03:10.550996] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-10-21T21:03:10.609368] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T21:03:11.137572] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T21:03:11.351018] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-10-21T21:03:12.151059] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-10. [2025-10-21T21:03:12.952553] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-10-21T21:03:12.955551] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T21:03:13.101499] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-21T21:03:13.751002] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-10-21T21:03:13.827640] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T21:03:13.839189] [INFO ] [REMOTE ] SEI: Full fetch complete (71110 records). [2025-10-21T21:03:13.839335] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-10-21T21:03:14.224209] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-10-21T21:03:14.224310] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-10-21T21:03:14.225503] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-10-21T21:03:14.225568] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-10-21T21:03:14.227000] [DEBUG] [LOCAL ] SEI: Trimmed 71110 records to 50023 (keeping 200 days of data) [2025-10-21T21:03:14.526560] [DEBUG] [LOCAL ] SEI: Primary data saved (50023 records). [2025-10-21T21:03:14.526868] [INFO ] [MAIN ] SEI: Full history saved. [2025-10-21T21:03:14.526955] [INFO ] [MAIN ] Update Progress: 1890/2366 symbols completed. SEI took 33.8s. Estimated remaining: 1h 1m 15s. Rate: 7.8 symbols/min [2025-10-21T21:03:14.557760] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-10-21T21:03:14.725396] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T21:03:14.727625] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:03:14.736137] [DEBUG] [LOCAL ] SF: No existing data file found in primary storage. [2025-10-21T21:03:14.736485] [WARN ] [MAIN ] SF: No existing data found, performing full refresh instead. [2025-10-21T21:03:14.736780] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-10-21T21:03:14.736832] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-10-21T21:03:14.737265] [DEBUG] [LOCAL ] SF: No primary data file found to delete. [2025-10-21T21:03:14.737317] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-10-21T21:03:15.088477] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:03:15.350986] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-10-21T21:03:16.151105] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-10-21T21:03:16.351084] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T21:03:16.456461] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-21T21:03:16.951027] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-10-21T21:03:17.268877] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T21:03:17.751054] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-10-21T21:03:17.931395] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T21:03:18.551088] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-10-21T21:03:18.685424] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T21:03:19.053880] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T21:03:19.351081] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-10-21T21:03:20.151023] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-10-21T21:03:20.338360] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T21:03:20.951054] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-10-21T21:03:21.020214] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T21:03:21.751080] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-10. [2025-10-21T21:03:22.551046] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-10. [2025-10-21T21:03:22.681311] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T21:03:22.772611] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-21T21:03:23.135147] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T21:03:23.141932] [INFO ] [REMOTE ] SEM: Full fetch complete (61514 records). [2025-10-21T21:03:23.142040] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-10-21T21:03:23.351711] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-10-21T21:03:23.551300] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-10-21T21:03:23.551426] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-10-21T21:03:23.552684] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-10-21T21:03:23.552749] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-10-21T21:03:23.554178] [DEBUG] [LOCAL ] SEM: Trimmed 61514 records to 43198 (keeping 200 days of data) [2025-10-21T21:03:23.818606] [DEBUG] [LOCAL ] SEM: Primary data saved (43198 records). [2025-10-21T21:03:23.818767] [INFO ] [MAIN ] SEM: Full history saved. [2025-10-21T21:03:23.818865] [INFO ] [MAIN ] Update Progress: 1891/2366 symbols completed. SEM took 29.6s. Estimated remaining: 1h 1m 7s. Rate: 7.8 symbols/min [2025-10-21T21:03:24.007243] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:03:24.013712] [DEBUG] [LOCAL ] SFB: Loaded 3778 existing records from primary storage. [2025-10-21T21:03:24.013931] [INFO ] [MAIN ] SFB: Loaded 3778 existing records. [2025-10-21T21:03:24.152133] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-10-21T21:03:24.220447] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:03:24.221142] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-10-21T21:03:24.221226] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-10-21T21:03:24.221473] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-10-21T21:03:24.221543] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-10-21T21:03:24.342090] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T21:03:24.385479] [INFO ] [REMOTE ] SEMR: Full fetch complete (60607 records). [2025-10-21T21:03:24.416313] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-10-21T21:03:24.788869] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:03:24.959668] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-10-21T21:03:25.002975] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-10-21T21:03:25.003179] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-10-21T21:03:25.004288] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-10-21T21:03:25.004397] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-10-21T21:03:25.006018] [DEBUG] [LOCAL ] SEMR: Trimmed 60607 records to 42075 (keeping 200 days of data) [2025-10-21T21:03:25.139737] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:03:25.284968] [DEBUG] [LOCAL ] SEMR: Primary data saved (42075 records). [2025-10-21T21:03:25.285136] [INFO ] [MAIN ] SEMR: Full history saved. [2025-10-21T21:03:25.285930] [INFO ] [MAIN ] Update Progress: 1892/2366 symbols completed. SEMR took 30.5s. Estimated remaining: 1h 0m 58s. Rate: 7.8 symbols/min [2025-10-21T21:03:25.456586] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:03:25.456815] [DEBUG] [LOCAL ] SFBS: No existing data file found in primary storage. [2025-10-21T21:03:25.456857] [WARN ] [MAIN ] SFBS: No existing data found, performing full refresh instead. [2025-10-21T21:03:25.456969] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-10-21T21:03:25.457012] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-10-21T21:03:25.457053] [DEBUG] [LOCAL ] SFBS: No primary data file found to delete. [2025-10-21T21:03:25.457085] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-10-21T21:03:25.755198] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-10-21T21:03:25.821600] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:03:25.829638] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T21:03:26.555407] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-10-21T21:03:26.561025] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-21T21:03:27.351004] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-10-21T21:03:27.380083] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T21:03:27.425361] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T21:03:28.151024] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-10-21T21:03:28.892315] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T21:03:28.950987] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-10-21T21:03:29.750989] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-10-21T21:03:29.926997] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-21T21:03:30.155054] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T21:03:30.551068] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-10-21T21:03:31.057622] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T21:03:31.351052] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-10-21T21:03:31.769970] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T21:03:32.151050] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-10-21T21:03:32.951063] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-10-21T21:03:33.119763] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T21:03:33.175010] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T21:03:33.751032] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-10-21T21:03:34.244076] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-21T21:03:34.551023] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-10-21T21:03:35.241705] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T21:03:35.350996] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-10-21T21:03:35.560593] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T21:03:36.151016] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-10-21T21:03:36.857886] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-21T21:03:36.951007] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-10-21T21:03:37.396097] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-21T21:03:37.750996] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-10-21T21:03:37.798329] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-21T21:03:38.509983] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-21T21:03:38.551006] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-10-21T21:03:39.351068] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-10. [2025-10-21T21:03:40.140542] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T21:03:40.150969] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-10-21T21:03:40.313321] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T21:03:40.321709] [INFO ] [REMOTE ] SES: Full fetch complete (75647 records). [2025-10-21T21:03:40.321835] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-10-21T21:03:40.716635] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-10-21T21:03:40.716762] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-10-21T21:03:40.718061] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-10-21T21:03:40.718124] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-10-21T21:03:40.719527] [DEBUG] [LOCAL ] SES: Trimmed 75647 records to 51604 (keeping 200 days of data) [2025-10-21T21:03:40.976326] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-10-21T21:03:41.021219] [DEBUG] [LOCAL ] SES: Primary data saved (51604 records). [2025-10-21T21:03:41.021483] [INFO ] [MAIN ] SES: Full history saved. [2025-10-21T21:03:41.021904] [INFO ] [MAIN ] Update Progress: 1893/2366 symbols completed. SES took 40.1s. Estimated remaining: 1h 0m 52s. Rate: 7.8 symbols/min [2025-10-21T21:03:41.194496] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:03:41.236301] [DEBUG] [LOCAL ] SFL: Loaded 45331 existing records from primary storage. [2025-10-21T21:03:41.236601] [INFO ] [MAIN ] SFL: Loaded 45331 existing records. [2025-10-21T21:03:41.412525] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:03:41.412742] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-10-21T21:03:41.412809] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-10-21T21:03:41.413016] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-10-21T21:03:41.413070] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-10-21T21:03:41.675777] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T21:03:41.757211] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-10-21T21:03:41.787812] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:03:41.843724] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T21:03:42.508426] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T21:03:42.550978] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-10. [2025-10-21T21:03:43.098267] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T21:03:43.099354] [INFO ] [REMOTE ] SFB: Full fetch complete (5787 records). [2025-10-21T21:03:43.099421] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-10-21T21:03:43.356286] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-10. [2025-10-21T21:03:43.461332] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-10-21T21:03:43.461426] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-10-21T21:03:43.461601] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-10-21T21:03:43.461661] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-10-21T21:03:43.462186] [DEBUG] [LOCAL ] SFB: Trimmed 5787 records to 3739 (keeping 200 days of data) [2025-10-21T21:03:43.486018] [DEBUG] [LOCAL ] SFB: Primary data saved (3739 records). [2025-10-21T21:03:43.486156] [INFO ] [MAIN ] SFB: Full history saved. [2025-10-21T21:03:43.486259] [INFO ] [MAIN ] Update Progress: 1894/2366 symbols completed. SFB took 19.7s. Estimated remaining: 1h 0m 43s. Rate: 7.8 symbols/min [2025-10-21T21:03:43.672990] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:03:43.673202] [DEBUG] [LOCAL ] SG: No existing data file found in primary storage. [2025-10-21T21:03:43.673257] [WARN ] [MAIN ] SG: No existing data found, performing full refresh instead. [2025-10-21T21:03:43.673412] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-10-21T21:03:43.673491] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-10-21T21:03:43.673561] [DEBUG] [LOCAL ] SG: No primary data file found to delete. [2025-10-21T21:03:43.673598] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-10-21T21:03:44.098754] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:03:44.151090] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-10-21T21:03:44.954008] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-10-21T21:03:44.958201] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T21:03:44.964914] [INFO ] [REMOTE ] SF: Full fetch complete (60334 records). [2025-10-21T21:03:44.965006] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-10-21T21:03:45.365250] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-10-21T21:03:45.365375] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-10-21T21:03:45.366461] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-10-21T21:03:45.366541] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-10-21T21:03:45.378075] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T21:03:45.382862] [DEBUG] [LOCAL ] SF: Trimmed 60334 records to 41371 (keeping 200 days of data) [2025-10-21T21:03:45.640440] [DEBUG] [LOCAL ] SF: Primary data saved (41371 records). [2025-10-21T21:03:45.640594] [INFO ] [MAIN ] SF: Full history saved. [2025-10-21T21:03:45.640717] [INFO ] [MAIN ] Update Progress: 1895/2366 symbols completed. SF took 31.1s. Estimated remaining: 1h 0m 34s. Rate: 7.8 symbols/min [2025-10-21T21:03:45.756213] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-10-21T21:03:45.810614] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:03:45.852849] [DEBUG] [LOCAL ] SGHC: Loaded 47247 existing records from primary storage. [2025-10-21T21:03:45.853173] [INFO ] [MAIN ] SGHC: Loaded 47247 existing records. [2025-10-21T21:03:46.028163] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:03:46.028365] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-10-21T21:03:46.028412] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-10-21T21:03:46.028591] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-10-21T21:03:46.028629] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-10-21T21:03:46.384557] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:03:46.551103] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-10-21T21:03:46.661017] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-21T21:03:47.351033] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-10-21T21:03:47.893588] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T21:03:47.971346] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T21:03:48.150997] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-10-21T21:03:48.820052] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T21:03:48.950987] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-10-21T21:03:49.734516] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T21:03:49.750977] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-10-21T21:03:50.093202] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T21:03:50.551078] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-10-21T21:03:51.360115] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-10-21T21:03:51.364976] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T21:03:52.151028] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-10-21T21:03:52.306234] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T21:03:52.951003] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-10-21T21:03:53.149176] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T21:03:53.751009] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-10-21T21:03:53.927385] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T21:03:54.212437] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T21:03:54.551053] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-10-21T21:03:55.351022] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-10-21T21:03:55.587521] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T21:03:56.151060] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-10-21T21:03:56.618971] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-21T21:03:56.664109] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-21T21:03:56.951026] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-10-21T21:03:57.751058] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-10-21T21:03:57.951057] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T21:03:58.000685] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T21:03:58.551046] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-10. [2025-10-21T21:03:59.351013] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-10-21T21:03:59.687232] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T21:03:59.691177] [INFO ] [REMOTE ] SFBS: Full fetch complete (30432 records). [2025-10-21T21:03:59.691289] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-10-21T21:04:00.055555] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-21T21:04:00.113991] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-10-21T21:04:00.114058] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-10-21T21:04:00.114784] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-10-21T21:04:00.114846] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-10-21T21:04:00.115515] [DEBUG] [LOCAL ] SFBS: Trimmed 30432 records to 21362 (keeping 200 days of data) [2025-10-21T21:04:00.170194] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-10-21T21:04:00.250123] [DEBUG] [LOCAL ] SFBS: Primary data saved (21362 records). [2025-10-21T21:04:00.250237] [INFO ] [MAIN ] SFBS: Full history saved. [2025-10-21T21:04:00.250315] [INFO ] [MAIN ] Update Progress: 1896/2366 symbols completed. SFBS took 35.0s. Estimated remaining: 1h 0m 28s. Rate: 7.8 symbols/min [2025-10-21T21:04:00.420913] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:00.421066] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-10-21T21:04:00.421103] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-10-21T21:04:00.421209] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-10-21T21:04:00.421250] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-21T21:04:00.421291] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-21T21:04:00.421322] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-10-21T21:04:00.783813] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:00.950982] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-10-21T21:04:01.263054] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T21:04:01.317844] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:04:01.318144] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-10-21T21:04:01.318250] [FATAL] [REMOTE ] SGI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:04:01.318339] [FATAL] [MAIN ] SGI: Failed to fetch primary data. [2025-10-21T21:04:01.318429] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:04:01.318534] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-10-21T21:04:01.318620] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-10-21T21:04:01.318699] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-10-21T21:04:01.318766] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-10-21T21:04:01.318814] [INFO ] [MAIN ] Update Progress: 1897/2366 symbols completed. SGI took 1.1s. Estimated remaining: 1h 0m 19s. Rate: 7.8 symbols/min [2025-10-21T21:04:01.488416] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:01.497344] [DEBUG] [LOCAL ] SGU: Loaded 6541 existing records from primary storage. [2025-10-21T21:04:01.497531] [INFO ] [MAIN ] SGU: Loaded 6541 existing records. [2025-10-21T21:04:01.677521] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:04:01.677820] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-10-21T21:04:01.677874] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-10-21T21:04:01.678023] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-10-21T21:04:01.678080] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-10-21T21:04:01.756199] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-10-21T21:04:02.037824] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:02.449525] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-21T21:04:02.550985] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-10-21T21:04:03.351014] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-10-21T21:04:03.663301] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T21:04:04.093586] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T21:04:04.151065] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-10-21T21:04:04.584314] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T21:04:04.724719] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T21:04:04.951029] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-10-21T21:04:05.751044] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-10-21T21:04:06.551069] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-10-21T21:04:06.613764] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T21:04:07.170730] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-21T21:04:07.351020] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-10-21T21:04:08.151030] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-10-21T21:04:08.192468] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T21:04:08.951033] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-10-21T21:04:09.055783] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T21:04:09.084275] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T21:04:09.751068] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-10-21T21:04:10.504099] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T21:04:10.550997] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-10-21T21:04:10.666093] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T21:04:11.351043] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-10-21T21:04:12.150992] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-10-21T21:04:12.227720] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T21:04:12.313441] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-21T21:04:12.951058] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-10. [2025-10-21T21:04:13.751084] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-10-21T21:04:14.404198] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-21T21:04:14.551067] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-10-21T21:04:14.780257] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-21T21:04:14.790451] [INFO ] [REMOTE ] SGHC: Full fetch complete (65539 records). [2025-10-21T21:04:14.790591] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-10-21T21:04:15.187965] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-10-21T21:04:15.188040] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-10-21T21:04:15.189125] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-10-21T21:04:15.189189] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-10-21T21:04:15.190420] [DEBUG] [LOCAL ] SGHC: Trimmed 65539 records to 47267 (keeping 200 days of data) [2025-10-21T21:04:15.361238] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-10-21T21:04:15.473675] [DEBUG] [LOCAL ] SGHC: Primary data saved (47267 records). [2025-10-21T21:04:15.473854] [INFO ] [MAIN ] SGHC: Full history saved. [2025-10-21T21:04:15.474483] [INFO ] [MAIN ] Update Progress: 1898/2366 symbols completed. SGHC took 29.8s. Estimated remaining: 1h 0m 13s. Rate: 7.8 symbols/min [2025-10-21T21:04:15.669332] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:15.669637] [DEBUG] [LOCAL ] SHAK: No existing data file found in primary storage. [2025-10-21T21:04:15.669731] [WARN ] [MAIN ] SHAK: No existing data found, performing full refresh instead. [2025-10-21T21:04:15.670298] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-10-21T21:04:15.670356] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-10-21T21:04:15.671792] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T21:04:15.671999] [DEBUG] [LOCAL ] SHAK: No primary data file found to delete. [2025-10-21T21:04:15.681192] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-10-21T21:04:15.964124] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T21:04:16.043197] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:16.151016] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-10-21T21:04:16.863763] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-21T21:04:16.951010] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-10. [2025-10-21T21:04:17.750997] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-10-21T21:04:17.963628] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T21:04:18.373478] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T21:04:18.551013] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-10-21T21:04:18.993279] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T21:04:19.001614] [INFO ] [REMOTE ] SG: Full fetch complete (77471 records). [2025-10-21T21:04:19.001998] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-10-21T21:04:19.364155] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-10-21T21:04:19.433735] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T21:04:19.437558] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-10-21T21:04:19.437670] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-10-21T21:04:19.438912] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-10-21T21:04:19.438990] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-10-21T21:04:19.443092] [DEBUG] [LOCAL ] SG: Trimmed 77471 records to 53504 (keeping 200 days of data) [2025-10-21T21:04:19.753853] [DEBUG] [LOCAL ] SG: Primary data saved (53504 records). [2025-10-21T21:04:19.753980] [INFO ] [MAIN ] SG: Full history saved. [2025-10-21T21:04:19.754047] [INFO ] [MAIN ] Update Progress: 1899/2366 symbols completed. SG took 36.3s. Estimated remaining: 1h 0m 4s. Rate: 7.8 symbols/min [2025-10-21T21:04:19.928715] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:19.954140] [DEBUG] [LOCAL ] SHCO: Loaded 25358 existing records from primary storage. [2025-10-21T21:04:19.954482] [INFO ] [MAIN ] SHCO: Loaded 25358 existing records. [2025-10-21T21:04:20.141848] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:04:20.142023] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-10-21T21:04:20.142070] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-10-21T21:04:20.142227] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-10-21T21:04:20.142283] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-10-21T21:04:20.156155] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-10. [2025-10-21T21:04:20.508680] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:20.951007] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-10-21T21:04:21.037681] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T21:04:21.038946] [INFO ] [REMOTE ] SGU: Full fetch complete (8911 records). [2025-10-21T21:04:21.039028] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-10-21T21:04:21.429791] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-10-21T21:04:21.429942] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-10-21T21:04:21.430228] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-10-21T21:04:21.430405] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-10-21T21:04:21.431050] [DEBUG] [LOCAL ] SGU: Trimmed 8911 records to 6532 (keeping 200 days of data) [2025-10-21T21:04:21.494791] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-21T21:04:21.508949] [DEBUG] [LOCAL ] SGU: Primary data saved (6532 records). [2025-10-21T21:04:21.509424] [INFO ] [MAIN ] SGU: Full history saved. [2025-10-21T21:04:21.509522] [INFO ] [MAIN ] Update Progress: 1900/2366 symbols completed. SGU took 20.2s. Estimated remaining: 59m 55s. Rate: 7.8 symbols/min [2025-10-21T21:04:21.679762] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:21.734322] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-21T21:04:21.734712] [INFO ] [MAIN ] SHEL: Loaded 53675 existing records. [2025-10-21T21:04:21.756222] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-10-21T21:04:21.928856] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:04:21.929245] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-10-21T21:04:21.929411] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-10-21T21:04:21.929673] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-10-21T21:04:21.929732] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-10-21T21:04:22.312467] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T21:04:22.317994] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:22.551036] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-10-21T21:04:23.351076] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-10-21T21:04:23.462335] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T21:04:24.151070] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-10-21T21:04:24.728776] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-21T21:04:24.951063] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-10-21T21:04:25.198617] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T21:04:25.379095] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T21:04:25.751026] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-10-21T21:04:26.550994] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-10-21T21:04:26.722114] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T21:04:27.350991] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-10-21T21:04:27.574096] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T21:04:27.731103] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-21T21:04:28.151018] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-10-21T21:04:28.951012] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-10. [2025-10-21T21:04:29.297766] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T21:04:29.751021] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-10-21T21:04:30.280210] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-21T21:04:30.551006] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-10-21T21:04:30.625871] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T21:04:30.633535] [INFO ] [REMOTE ] SFL: Full fetch complete (65960 records). [2025-10-21T21:04:30.633742] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-10-21T21:04:31.021704] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-10-21T21:04:31.021790] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-10-21T21:04:31.022850] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-10-21T21:04:31.022912] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-10-21T21:04:31.024110] [DEBUG] [LOCAL ] SFL: Trimmed 65960 records to 45311 (keeping 200 days of data) [2025-10-21T21:04:31.291392] [DEBUG] [LOCAL ] SFL: Primary data saved (45311 records). [2025-10-21T21:04:31.291541] [INFO ] [MAIN ] SFL: Full history saved. [2025-10-21T21:04:31.291677] [INFO ] [MAIN ] Update Progress: 1901/2366 symbols completed. SFL took 50.3s. Estimated remaining: 59m 48s. Rate: 7.8 symbols/min [2025-10-21T21:04:31.355704] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-10-21T21:04:31.494900] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:31.497043] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T21:04:31.532951] [DEBUG] [LOCAL ] SHG: Loaded 26655 existing records from primary storage. [2025-10-21T21:04:31.533223] [INFO ] [MAIN ] SHG: Loaded 26655 existing records. [2025-10-21T21:04:31.708732] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:04:31.708943] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-10-21T21:04:31.709029] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-10-21T21:04:31.709222] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-10-21T21:04:31.709278] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-10-21T21:04:32.065382] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:32.082486] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T21:04:32.151001] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-10-21T21:04:32.951044] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-10-21T21:04:33.183559] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T21:04:33.618741] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-21T21:04:33.750983] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-10-21T21:04:34.150753] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T21:04:34.551065] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-10-21T21:04:35.350996] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-10-21T21:04:35.536605] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T21:04:35.600348] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T21:04:36.125138] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T21:04:36.150987] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-10-21T21:04:36.951092] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-10-21T21:04:37.448206] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T21:04:37.751126] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-10-21T21:04:38.344749] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T21:04:38.551087] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-10-21T21:04:39.351046] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-10-21T21:04:40.006448] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T21:04:40.137878] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-21T21:04:40.150981] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-10-21T21:04:40.855898] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T21:04:40.951074] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-10-21T21:04:41.751084] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-10-21T21:04:42.436585] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-21T21:04:42.469310] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T21:04:42.551068] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-10-21T21:04:43.188517] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T21:04:43.351047] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-10. [2025-10-21T21:04:44.151132] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-10-21T21:04:44.467343] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T21:04:44.575393] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-21T21:04:44.580220] [INFO ] [REMOTE ] SHCO: Full fetch complete (37601 records). [2025-10-21T21:04:44.580323] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-10-21T21:04:44.957618] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-10-21T21:04:44.979525] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-10-21T21:04:44.979630] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-10-21T21:04:44.981704] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-10-21T21:04:44.982171] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-10-21T21:04:44.983785] [DEBUG] [LOCAL ] SHCO: Trimmed 37601 records to 25262 (keeping 200 days of data) [2025-10-21T21:04:45.141166] [DEBUG] [LOCAL ] SHCO: Primary data saved (25262 records). [2025-10-21T21:04:45.141345] [INFO ] [MAIN ] SHCO: Full history saved. [2025-10-21T21:04:45.141439] [INFO ] [MAIN ] Update Progress: 1902/2366 symbols completed. SHCO took 25.4s. Estimated remaining: 59m 42s. Rate: 7.8 symbols/min [2025-10-21T21:04:45.322462] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:45.322764] [DEBUG] [LOCAL ] SHO: No existing data file found in primary storage. [2025-10-21T21:04:45.322815] [WARN ] [MAIN ] SHO: No existing data found, performing full refresh instead. [2025-10-21T21:04:45.322939] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-10-21T21:04:45.322982] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-10-21T21:04:45.323024] [DEBUG] [LOCAL ] SHO: No primary data file found to delete. [2025-10-21T21:04:45.323058] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-10-21T21:04:45.709053] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:45.751102] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-10-21T21:04:46.262730] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T21:04:46.551005] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-10-21T21:04:46.601109] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-21T21:04:47.351073] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-10-21T21:04:47.423529] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T21:04:47.960525] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T21:04:48.151021] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-10-21T21:04:48.951098] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-10-21T21:04:49.586765] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-21T21:04:49.751024] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-10-21T21:04:49.947600] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T21:04:50.551055] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-10-21T21:04:50.971598] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-21T21:04:51.351083] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-10. [2025-10-21T21:04:51.983532] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-21T21:04:52.056623] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T21:04:52.151034] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-10. [2025-10-21T21:04:52.951055] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-10-21T21:04:53.312895] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T21:04:53.320621] [INFO ] [REMOTE ] SHAK: Full fetch complete (71167 records). [2025-10-21T21:04:53.320959] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-10-21T21:04:53.711485] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-10-21T21:04:53.711565] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-10-21T21:04:53.712659] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-10-21T21:04:53.712722] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-10-21T21:04:53.714156] [DEBUG] [LOCAL ] SHAK: Trimmed 71167 records to 48675 (keeping 200 days of data) [2025-10-21T21:04:53.763559] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-10-21T21:04:54.009511] [DEBUG] [LOCAL ] SHAK: Primary data saved (48675 records). [2025-10-21T21:04:54.009671] [INFO ] [MAIN ] SHAK: Full history saved. [2025-10-21T21:04:54.009769] [INFO ] [MAIN ] Update Progress: 1903/2366 symbols completed. SHAK took 38.5s. Estimated remaining: 59m 34s. Rate: 7.8 symbols/min [2025-10-21T21:04:54.193777] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:54.224353] [DEBUG] [LOCAL ] SHOC: Loaded 3140 existing records from primary storage. [2025-10-21T21:04:54.224795] [INFO ] [MAIN ] SHOC: Loaded 3140 existing records. [2025-10-21T21:04:54.256216] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T21:04:54.342279] [INFO ] [REMOTE ] SHEL: Full fetch complete (77836 records). [2025-10-21T21:04:54.331386] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T21:04:54.352910] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-10-21T21:04:54.544184] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:04:54.544623] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-10-21T21:04:54.550035] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-10-21T21:04:54.555225] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-10-21T21:04:54.622693] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-10-21T21:04:54.642787] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-10-21T21:04:55.138998] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-10-21T21:04:55.162968] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-10-21T21:04:55.172610] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-10-21T21:04:55.175271] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-10-21T21:04:55.258445] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:55.259217] [DEBUG] [LOCAL ] SHEL: Trimmed 77836 records to 53675 (keeping 200 days of data) [2025-10-21T21:04:55.353726] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-10-21T21:04:55.522695] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T21:04:55.630082] [DEBUG] [LOCAL ] SHEL: Primary data saved (53675 records). [2025-10-21T21:04:55.630219] [INFO ] [MAIN ] SHEL: Full history saved. [2025-10-21T21:04:55.631171] [INFO ] [MAIN ] Update Progress: 1904/2366 symbols completed. SHEL took 34.1s. Estimated remaining: 59m 25s. Rate: 7.8 symbols/min [2025-10-21T21:04:55.804795] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:55.804946] [DEBUG] [LOCAL ] SHW: No existing data file found in primary storage. [2025-10-21T21:04:55.804984] [WARN ] [MAIN ] SHW: No existing data found, performing full refresh instead. [2025-10-21T21:04:55.805090] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-10-21T21:04:55.805131] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-10-21T21:04:55.805173] [DEBUG] [LOCAL ] SHW: No primary data file found to delete. [2025-10-21T21:04:55.805207] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-10-21T21:04:56.168856] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:04:56.163975] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-10-21T21:04:56.186017] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T21:04:56.442789] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T21:04:56.951014] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-10-21T21:04:57.751011] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-10. [2025-10-21T21:04:58.236625] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-21T21:04:58.551061] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-10-21T21:04:59.087110] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T21:04:59.111597] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T21:04:59.122422] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-21T21:04:59.122193] [INFO ] [REMOTE ] SHG: Full fetch complete (41242 records). [2025-10-21T21:04:59.125044] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-10-21T21:04:59.356208] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-10-21T21:04:59.497371] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-10-21T21:04:59.497445] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-10-21T21:04:59.498371] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-10-21T21:04:59.498433] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-10-21T21:04:59.499280] [DEBUG] [LOCAL ] SHG: Trimmed 41242 records to 26685 (keeping 200 days of data) [2025-10-21T21:04:59.654771] [DEBUG] [LOCAL ] SHG: Primary data saved (26685 records). [2025-10-21T21:04:59.654894] [INFO ] [MAIN ] SHG: Full history saved. [2025-10-21T21:04:59.654969] [INFO ] [MAIN ] Update Progress: 1905/2366 symbols completed. SHG took 28.4s. Estimated remaining: 59m 16s. Rate: 7.8 symbols/min [2025-10-21T21:04:59.824373] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:04:59.824524] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-10-21T21:04:59.824562] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-10-21T21:04:59.824716] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-10-21T21:04:59.824788] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-21T21:04:59.824841] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-21T21:04:59.824874] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-10-21T21:05:00.159684] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-10-21T21:05:00.194018] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:05:00.284342] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T21:05:00.951037] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-10-21T21:05:01.751029] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-10-21T21:05:02.125860] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T21:05:02.135346] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:05:02.136616] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-10-21T21:05:02.136724] [FATAL] [REMOTE ] SI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:05:02.136791] [FATAL] [MAIN ] SI: Failed to fetch primary data. [2025-10-21T21:05:02.136855] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:05:02.136933] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-10-21T21:05:02.136996] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-10-21T21:05:02.137032] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-10-21T21:05:02.137071] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-10-21T21:05:02.137114] [INFO ] [MAIN ] Update Progress: 1906/2366 symbols completed. SI took 2.5s. Estimated remaining: 59m 7s. Rate: 7.8 symbols/min [2025-10-21T21:05:02.310608] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:05:02.350799] [DEBUG] [LOCAL ] SID: Loaded 42841 existing records from primary storage. [2025-10-21T21:05:02.351092] [INFO ] [MAIN ] SID: Loaded 42841 existing records. [2025-10-21T21:05:02.535527] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:05:02.536052] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-10-21T21:05:02.536107] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-10-21T21:05:02.537292] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-10-21T21:05:02.537351] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-10-21T21:05:02.558046] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-10-21T21:05:02.928727] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:05:02.930754] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T21:05:03.351011] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-10-21T21:05:04.151033] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-10-21T21:05:04.811914] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-21T21:05:04.951043] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-10-21T21:05:05.289132] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T21:05:05.629085] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T21:05:05.751044] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-10-21T21:05:06.550993] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-10-21T21:05:06.991940] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T21:05:07.351005] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-10-21T21:05:07.593488] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T21:05:07.667288] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T21:05:08.153892] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-10-21T21:05:08.155365] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-21T21:05:08.951070] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-10-21T21:05:09.750989] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-10-21T21:05:09.938165] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T21:05:10.309934] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T21:05:10.550990] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-10-21T21:05:10.642163] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T21:05:11.351077] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-10-21T21:05:12.151003] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-10-21T21:05:12.343531] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T21:05:12.951068] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-10. [2025-10-21T21:05:12.986118] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T21:05:13.751061] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-10-21T21:05:13.989681] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T21:05:14.551002] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-10-21T21:05:14.596000] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-21T21:05:14.597240] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T21:05:14.605917] [INFO ] [REMOTE ] SHO: Full fetch complete (70811 records). [2025-10-21T21:05:14.606072] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-10-21T21:05:15.006615] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-10-21T21:05:15.006723] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-10-21T21:05:15.007959] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-10-21T21:05:15.008023] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-10-21T21:05:15.009375] [DEBUG] [LOCAL ] SHO: Trimmed 70811 records to 49179 (keeping 200 days of data) [2025-10-21T21:05:15.302481] [DEBUG] [LOCAL ] SHO: Primary data saved (49179 records). [2025-10-21T21:05:15.302579] [INFO ] [MAIN ] SHO: Full history saved. [2025-10-21T21:05:15.302713] [INFO ] [MAIN ] Update Progress: 1907/2366 symbols completed. SHO took 30.2s. Estimated remaining: 59m 1s. Rate: 7.8 symbols/min [2025-10-21T21:05:15.357889] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-10-21T21:05:15.476530] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:05:15.476781] [DEBUG] [LOCAL ] SIG: No existing data file found in primary storage. [2025-10-21T21:05:15.476823] [WARN ] [MAIN ] SIG: No existing data found, performing full refresh instead. [2025-10-21T21:05:15.476969] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-10-21T21:05:15.477032] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-10-21T21:05:15.477080] [DEBUG] [LOCAL ] SIG: No primary data file found to delete. [2025-10-21T21:05:15.477112] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-10-21T21:05:15.820751] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:05:16.150996] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-10-21T21:05:16.500179] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T21:05:16.597533] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-21T21:05:16.951015] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-10-21T21:05:17.045413] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T21:05:17.575298] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T21:05:17.751024] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-10-21T21:05:18.551082] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-10-21T21:05:19.351092] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-10-21T21:05:19.431290] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T21:05:19.962878] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T21:05:20.151034] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-10-21T21:05:20.351159] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T21:05:20.951028] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-10-21T21:05:21.751083] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-10. [2025-10-21T21:05:22.178931] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T21:05:22.397479] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T21:05:22.398636] [INFO ] [REMOTE ] SHOC: Full fetch complete (6818 records). [2025-10-21T21:05:22.398728] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-10-21T21:05:22.553944] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-10-21T21:05:22.784958] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-10-21T21:05:22.785076] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-10-21T21:05:22.785362] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-10-21T21:05:22.785453] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-10-21T21:05:22.786145] [DEBUG] [LOCAL ] SHOC: Trimmed 6818 records to 3084 (keeping 200 days of data) [2025-10-21T21:05:22.832886] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T21:05:22.846722] [DEBUG] [LOCAL ] SHOC: Primary data saved (3084 records). [2025-10-21T21:05:22.847121] [INFO ] [MAIN ] SHOC: Full history saved. [2025-10-21T21:05:22.847211] [INFO ] [MAIN ] Update Progress: 1908/2366 symbols completed. SHOC took 28.8s. Estimated remaining: 58m 53s. Rate: 7.8 symbols/min [2025-10-21T21:05:23.068980] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:05:23.093274] [DEBUG] [LOCAL ] SII: Loaded 24165 existing records from primary storage. [2025-10-21T21:05:23.093584] [INFO ] [MAIN ] SII: Loaded 24165 existing records. [2025-10-21T21:05:23.270068] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:05:23.270301] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-10-21T21:05:23.270347] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-10-21T21:05:23.270595] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-10-21T21:05:23.270688] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-10-21T21:05:23.358673] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-10-21T21:05:23.635331] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:05:24.151024] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-10-21T21:05:24.222337] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T21:05:24.951096] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-10-21T21:05:25.213605] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T21:05:25.348767] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T21:05:25.751080] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-10-21T21:05:26.551066] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-10-21T21:05:26.622397] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T21:05:27.351016] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-10-21T21:05:27.739831] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T21:05:28.150998] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-10-21T21:05:28.247078] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T21:05:28.951086] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-10-21T21:05:29.046486] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-21T21:05:29.386349] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T21:05:29.751037] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-10-21T21:05:30.560227] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-10-21T21:05:30.567107] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T21:05:30.934746] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-21T21:05:31.351044] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-10. [2025-10-21T21:05:32.151062] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-10-21T21:05:32.184334] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T21:05:32.951076] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-10. [2025-10-21T21:05:33.124024] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T21:05:33.131449] [INFO ] [REMOTE ] SID: Full fetch complete (61122 records). [2025-10-21T21:05:33.131581] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-10-21T21:05:33.519157] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-10-21T21:05:33.519325] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-10-21T21:05:33.520396] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-10-21T21:05:33.520473] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-10-21T21:05:33.536072] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T21:05:33.542420] [DEBUG] [LOCAL ] SID: Trimmed 61122 records to 42896 (keeping 200 days of data) [2025-10-21T21:05:33.753698] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-10-21T21:05:33.779508] [DEBUG] [LOCAL ] SID: Primary data saved (42896 records). [2025-10-21T21:05:33.779599] [INFO ] [MAIN ] SID: Full history saved. [2025-10-21T21:05:33.780238] [INFO ] [MAIN ] Update Progress: 1909/2366 symbols completed. SID took 31.6s. Estimated remaining: 58m 46s. Rate: 7.8 symbols/min [2025-10-21T21:05:33.947471] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:05:33.978258] [DEBUG] [LOCAL ] SILA: Loaded 30253 existing records from primary storage. [2025-10-21T21:05:33.978504] [INFO ] [MAIN ] SILA: Loaded 30253 existing records. [2025-10-21T21:05:34.153175] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:05:34.153350] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-10-21T21:05:34.153422] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-10-21T21:05:34.153692] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-10-21T21:05:34.153758] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-10-21T21:05:34.507121] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:05:34.550976] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-10-21T21:05:34.766137] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T21:05:34.774088] [INFO ] [REMOTE ] SHW: Full fetch complete (73354 records). [2025-10-21T21:05:34.774205] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-10-21T21:05:35.157692] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-10-21T21:05:35.157777] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-10-21T21:05:35.158940] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-10-21T21:05:35.159003] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-10-21T21:05:35.160329] [DEBUG] [LOCAL ] SHW: Trimmed 73354 records to 50402 (keeping 200 days of data) [2025-10-21T21:05:35.376218] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-10-21T21:05:35.474670] [DEBUG] [LOCAL ] SHW: Primary data saved (50402 records). [2025-10-21T21:05:35.474841] [INFO ] [MAIN ] SHW: Full history saved. [2025-10-21T21:05:35.474983] [INFO ] [MAIN ] Update Progress: 1910/2366 symbols completed. SHW took 39.8s. Estimated remaining: 58m 37s. Rate: 7.8 symbols/min [2025-10-21T21:05:35.647142] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:05:35.668283] [DEBUG] [LOCAL ] SITC: No existing data file found in primary storage. [2025-10-21T21:05:35.671272] [WARN ] [MAIN ] SITC: No existing data found, performing full refresh instead. [2025-10-21T21:05:35.671427] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-10-21T21:05:35.671660] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-10-21T21:05:35.673458] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-21T21:05:35.673667] [DEBUG] [LOCAL ] SITC: No primary data file found to delete. [2025-10-21T21:05:35.682265] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-10-21T21:05:35.814242] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T21:05:36.106677] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:05:36.150999] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-10-21T21:05:36.668719] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T21:05:36.951094] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-10-21T21:05:37.751058] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-10-21T21:05:37.847215] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T21:05:38.345165] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T21:05:38.551043] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-10-21T21:05:39.065087] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T21:05:39.350997] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-10-21T21:05:40.151110] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-10-21T21:05:40.348831] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T21:05:40.674263] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T21:05:40.951093] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-10-21T21:05:41.602684] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T21:05:41.751066] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-10-21T21:05:42.551065] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-10-21T21:05:42.641075] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T21:05:43.332191] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T21:05:43.350990] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-10-21T21:05:43.606569] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T21:05:44.151043] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-10-21T21:05:44.781599] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T21:05:44.950990] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-10-21T21:05:44.971559] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-21T21:05:45.751029] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-10-21T21:05:46.551064] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-10-21T21:05:46.797878] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T21:05:47.351132] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-10. [2025-10-21T21:05:47.532150] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T21:05:47.726522] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T21:05:48.151060] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-10-21T21:05:48.951012] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-10. [2025-10-21T21:05:48.970531] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T21:05:48.977836] [INFO ] [REMOTE ] SIG: Full fetch complete (67724 records). [2025-10-21T21:05:48.977975] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-10-21T21:05:49.427487] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-10-21T21:05:49.427635] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-10-21T21:05:49.428809] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-10-21T21:05:49.428891] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-10-21T21:05:49.430589] [DEBUG] [LOCAL ] SIG: Trimmed 67724 records to 45374 (keeping 200 days of data) [2025-10-21T21:05:49.518581] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T21:05:49.730135] [DEBUG] [LOCAL ] SIG: Primary data saved (45374 records). [2025-10-21T21:05:49.730275] [INFO ] [MAIN ] SIG: Full history saved. [2025-10-21T21:05:49.730356] [INFO ] [MAIN ] Update Progress: 1911/2366 symbols completed. SIG took 34.4s. Estimated remaining: 58m 31s. Rate: 7.8 symbols/min [2025-10-21T21:05:49.759364] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-10-21T21:05:49.903701] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:05:49.939519] [DEBUG] [LOCAL ] SITE: Loaded 35597 existing records from primary storage. [2025-10-21T21:05:49.939841] [INFO ] [MAIN ] SITE: Loaded 35597 existing records. [2025-10-21T21:05:50.122401] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:05:50.122620] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-10-21T21:05:50.122725] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-10-21T21:05:50.122932] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-10-21T21:05:50.122987] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-10-21T21:05:50.400419] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T21:05:50.431780] [INFO ] [REMOTE ] SII: Full fetch complete (31469 records). [2025-10-21T21:05:50.442242] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-10-21T21:05:50.552106] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-10-21T21:05:50.606016] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:05:50.925725] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-10-21T21:05:50.925841] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-10-21T21:05:50.926588] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-10-21T21:05:50.926634] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-10-21T21:05:50.927381] [DEBUG] [LOCAL ] SII: Trimmed 31469 records to 24218 (keeping 200 days of data) [2025-10-21T21:05:51.076323] [DEBUG] [LOCAL ] SII: Primary data saved (24218 records). [2025-10-21T21:05:51.076446] [INFO ] [MAIN ] SII: Full history saved. [2025-10-21T21:05:51.076521] [INFO ] [MAIN ] Update Progress: 1912/2366 symbols completed. SII took 28.2s. Estimated remaining: 58m 22s. Rate: 7.8 symbols/min [2025-10-21T21:05:51.253126] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:05:51.253302] [DEBUG] [LOCAL ] SJM: No existing data file found in primary storage. [2025-10-21T21:05:51.253341] [WARN ] [MAIN ] SJM: No existing data found, performing full refresh instead. [2025-10-21T21:05:51.253448] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-10-21T21:05:51.253491] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-10-21T21:05:51.253533] [DEBUG] [LOCAL ] SJM: No primary data file found to delete. [2025-10-21T21:05:51.253598] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-10-21T21:05:51.359246] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-10-21T21:05:51.589629] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T21:05:51.668444] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:05:52.158415] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-10-21T21:05:52.160684] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T21:05:52.927419] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T21:05:52.950991] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-10-21T21:05:53.751031] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-10-21T21:05:53.787431] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T21:05:54.551051] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-10-21T21:05:54.572859] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T21:05:55.350998] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-10-21T21:05:56.151005] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-10-21T21:05:56.228953] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T21:05:56.270581] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-21T21:05:56.951016] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-10-21T21:05:57.391025] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T21:05:57.666022] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T21:05:57.751067] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-10-21T21:05:58.551025] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-10-21T21:05:58.615010] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T21:05:59.351011] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-10-21T21:05:59.527113] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T21:05:59.892293] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T21:06:00.151096] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-10-21T21:06:00.951082] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-10-21T21:06:01.751153] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-10-21T21:06:01.900320] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T21:06:02.156445] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-10-21T21:06:02.551040] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-10-21T21:06:03.166323] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T21:06:03.351067] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-10. [2025-10-21T21:06:03.588019] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-21T21:06:04.082583] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T21:06:04.150981] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-10-21T21:06:04.546473] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T21:06:04.550886] [INFO ] [REMOTE ] SILA: Full fetch complete (44387 records). [2025-10-21T21:06:04.550974] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-10-21T21:06:04.917953] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-10-21T21:06:04.918031] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-10-21T21:06:04.918896] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-10-21T21:06:04.918959] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-10-21T21:06:04.919878] [DEBUG] [LOCAL ] SILA: Trimmed 44387 records to 30099 (keeping 200 days of data) [2025-10-21T21:06:04.973252] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-10. [2025-10-21T21:06:05.103630] [DEBUG] [LOCAL ] SILA: Primary data saved (30099 records). [2025-10-21T21:06:05.103800] [INFO ] [MAIN ] SILA: Full history saved. [2025-10-21T21:06:05.104425] [INFO ] [MAIN ] Update Progress: 1913/2366 symbols completed. SILA took 31.3s. Estimated remaining: 58m 15s. Rate: 7.8 symbols/min [2025-10-21T21:06:05.272672] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:06:05.295500] [DEBUG] [LOCAL ] SJT: Loaded 22785 existing records from primary storage. [2025-10-21T21:06:05.295760] [INFO ] [MAIN ] SJT: Loaded 22785 existing records. [2025-10-21T21:06:05.470507] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:06:05.470699] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-10-21T21:06:05.470755] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-10-21T21:06:05.470941] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-10-21T21:06:05.470996] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-10-21T21:06:05.752420] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-10-21T21:06:05.833341] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:06:05.990886] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T21:06:06.550996] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-10-21T21:06:06.625196] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T21:06:06.631934] [INFO ] [REMOTE ] SITC: Full fetch complete (60672 records). [2025-10-21T21:06:06.632051] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-10-21T21:06:07.013520] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-10-21T21:06:07.013599] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-10-21T21:06:07.014702] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-10-21T21:06:07.014765] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-10-21T21:06:07.016021] [DEBUG] [LOCAL ] SITC: Trimmed 60672 records to 41712 (keeping 200 days of data) [2025-10-21T21:06:07.272997] [DEBUG] [LOCAL ] SITC: Primary data saved (41712 records). [2025-10-21T21:06:07.273556] [INFO ] [MAIN ] SITC: Full history saved. [2025-10-21T21:06:07.274154] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T21:06:07.274257] [INFO ] [MAIN ] Update Progress: 1914/2366 symbols completed. SITC took 31.8s. Estimated remaining: 58m 6s. Rate: 7.8 symbols/min [2025-10-21T21:06:07.356071] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-10-21T21:06:07.453759] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:06:07.465509] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T21:06:07.500941] [DEBUG] [LOCAL ] SKE: Loaded 37233 existing records from primary storage. [2025-10-21T21:06:07.501205] [INFO ] [MAIN ] SKE: Loaded 37233 existing records. [2025-10-21T21:06:07.675219] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:06:07.675409] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-10-21T21:06:07.675454] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-10-21T21:06:07.675698] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-10-21T21:06:07.675753] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-10-21T21:06:08.026011] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:06:08.151028] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-10-21T21:06:08.951017] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-10-21T21:06:09.115076] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T21:06:09.532723] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T21:06:09.751004] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-10-21T21:06:10.551000] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-10-21T21:06:10.602115] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T21:06:11.259367] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T21:06:11.351067] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-10-21T21:06:11.456603] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T21:06:12.151032] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-10-21T21:06:12.662834] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-21T21:06:12.951043] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-10-21T21:06:13.709708] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T21:06:13.751023] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-10-21T21:06:14.550998] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-10-21T21:06:14.998423] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T21:06:15.020895] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T21:06:15.351091] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-10-21T21:06:16.135237] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T21:06:16.150977] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-10-21T21:06:16.950994] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-10-21T21:06:17.407257] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T21:06:17.736265] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T21:06:17.750982] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-10-21T21:06:17.883572] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T21:06:18.551017] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-10-21T21:06:19.351007] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-10-21T21:06:19.395131] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T21:06:20.151011] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-10-21T21:06:20.281206] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T21:06:20.871115] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T21:06:20.950985] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-10-21T21:06:21.722348] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T21:06:21.750982] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-10. [2025-10-21T21:06:22.550999] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-10-21T21:06:22.855719] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T21:06:23.299221] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-21T21:06:23.305776] [INFO ] [REMOTE ] SITE: Full fetch complete (50793 records). [2025-10-21T21:06:23.305917] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-10-21T21:06:23.363093] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-10-21T21:06:23.778674] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-10-21T21:06:23.778791] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-10-21T21:06:23.780023] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-10-21T21:06:23.780161] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-10-21T21:06:23.781895] [DEBUG] [LOCAL ] SITE: Trimmed 50793 records to 35562 (keeping 200 days of data) [2025-10-21T21:06:23.909196] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T21:06:24.105143] [DEBUG] [LOCAL ] SITE: Primary data saved (35562 records). [2025-10-21T21:06:24.105363] [INFO ] [MAIN ] SITE: Full history saved. [2025-10-21T21:06:24.105487] [INFO ] [MAIN ] Update Progress: 1915/2366 symbols completed. SITE took 34.4s. Estimated remaining: 58m 1s. Rate: 7.8 symbols/min [2025-10-21T21:06:24.157067] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-10-21T21:06:24.347962] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:06:24.358993] [DEBUG] [LOCAL ] SKIL: Loaded 6812 existing records from primary storage. [2025-10-21T21:06:24.359286] [INFO ] [MAIN ] SKIL: Loaded 6812 existing records. [2025-10-21T21:06:24.614305] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:06:24.614628] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-10-21T21:06:24.614734] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-10-21T21:06:24.614956] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-10-21T21:06:24.615090] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-10-21T21:06:24.734810] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T21:06:24.956108] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-10. [2025-10-21T21:06:25.012073] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:06:25.709290] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T21:06:25.750990] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-10-21T21:06:26.550985] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-10-21T21:06:26.821391] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T21:06:26.828998] [INFO ] [REMOTE ] SJM: Full fetch complete (72309 records). [2025-10-21T21:06:26.829110] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-10-21T21:06:27.234398] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-10-21T21:06:27.234473] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-10-21T21:06:27.235571] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-10-21T21:06:27.235631] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-10-21T21:06:27.236930] [DEBUG] [LOCAL ] SJM: Trimmed 72309 records to 50110 (keeping 200 days of data) [2025-10-21T21:06:27.353308] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-10-21T21:06:27.560551] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T21:06:27.581339] [DEBUG] [LOCAL ] SJM: Primary data saved (50110 records). [2025-10-21T21:06:27.581456] [INFO ] [MAIN ] SJM: Full history saved. [2025-10-21T21:06:27.581897] [INFO ] [MAIN ] Update Progress: 1916/2366 symbols completed. SJM took 36.5s. Estimated remaining: 57m 52s. Rate: 7.8 symbols/min [2025-10-21T21:06:27.758704] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:06:27.770436] [DEBUG] [LOCAL ] SKLZ: Loaded 11630 existing records from primary storage. [2025-10-21T21:06:27.770615] [INFO ] [MAIN ] SKLZ: Loaded 11630 existing records. [2025-10-21T21:06:27.880481] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T21:06:27.970367] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:06:27.970567] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-10-21T21:06:27.970615] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-10-21T21:06:27.970784] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-10-21T21:06:27.970838] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-10-21T21:06:28.159596] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-10. [2025-10-21T21:06:28.338811] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:06:28.342789] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T21:06:28.951088] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-10-21T21:06:29.751042] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-10-21T21:06:30.179443] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T21:06:30.232388] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-21T21:06:30.239846] [INFO ] [REMOTE ] SKE: Full fetch complete (52413 records). [2025-10-21T21:06:30.239969] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-10-21T21:06:30.563544] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-10-21T21:06:30.614860] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-10-21T21:06:30.615091] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-10-21T21:06:30.616121] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-10-21T21:06:30.616184] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-10-21T21:06:30.617219] [DEBUG] [LOCAL ] SKE: Trimmed 52413 records to 37343 (keeping 200 days of data) [2025-10-21T21:06:30.831894] [DEBUG] [LOCAL ] SKE: Primary data saved (37343 records). [2025-10-21T21:06:30.832012] [INFO ] [MAIN ] SKE: Full history saved. [2025-10-21T21:06:30.832092] [INFO ] [MAIN ] Update Progress: 1917/2366 symbols completed. SKE took 23.6s. Estimated remaining: 57m 43s. Rate: 7.8 symbols/min [2025-10-21T21:06:30.928587] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T21:06:31.351024] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-10-21T21:06:31.497851] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T21:06:32.151038] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-10-21T21:06:32.363935] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T21:06:32.951064] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-10-21T21:06:33.315391] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T21:06:33.751006] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-10. [2025-10-21T21:06:33.919852] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T21:06:34.551034] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-10-21T21:06:34.746721] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T21:06:34.751440] [INFO ] [REMOTE ] SJT: Full fetch complete (31880 records). [2025-10-21T21:06:34.751581] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-10-21T21:06:35.151537] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-10-21T21:06:35.151622] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-10-21T21:06:35.152375] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-10-21T21:06:35.152432] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-10-21T21:06:35.153219] [DEBUG] [LOCAL ] SJT: Trimmed 31880 records to 22756 (keeping 200 days of data) [2025-10-21T21:06:35.298889] [DEBUG] [LOCAL ] SJT: Primary data saved (22756 records). [2025-10-21T21:06:35.299021] [INFO ] [MAIN ] SJT: Full history saved. [2025-10-21T21:06:35.299100] [INFO ] [MAIN ] Update Progress: 1918/2366 symbols completed. SJT took 30.2s. Estimated remaining: 57m 35s. Rate: 7.8 symbols/min [2025-10-21T21:06:35.351099] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-10-21T21:06:35.628538] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-21T21:06:36.151100] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-10-21T21:06:36.221349] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-21T21:06:36.951042] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-10-21T21:06:37.149844] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T21:06:37.610498] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T21:06:37.751056] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-10-21T21:06:38.423797] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-21T21:06:38.551061] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-10-21T21:06:39.351028] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-10-21T21:06:39.461622] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T21:06:40.151047] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-10-21T21:06:40.240824] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T21:06:40.951137] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-10-21T21:06:40.966062] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T21:06:41.751051] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-10-21T21:06:42.114929] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T21:06:42.222729] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T21:06:42.551071] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-10-21T21:06:43.351028] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-10-21T21:06:43.607335] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T21:06:44.151060] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-10-21T21:06:44.199324] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T21:06:44.951031] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-10. [2025-10-21T21:06:45.199697] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T21:06:45.750993] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-10. [2025-10-21T21:06:45.962305] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T21:06:45.964615] [INFO ] [REMOTE ] SKIL: Full fetch complete (10461 records). [2025-10-21T21:06:45.964709] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-10-21T21:06:46.330542] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-10-21T21:06:46.330617] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-10-21T21:06:46.330886] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-10-21T21:06:46.330939] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-10-21T21:06:46.331348] [DEBUG] [LOCAL ] SKIL: Trimmed 10461 records to 6877 (keeping 200 days of data) [2025-10-21T21:06:46.370026] [DEBUG] [LOCAL ] SKIL: Primary data saved (6877 records). [2025-10-21T21:06:46.370136] [INFO ] [MAIN ] SKIL: Full history saved. [2025-10-21T21:06:46.370210] [INFO ] [MAIN ] Update Progress: 1919/2366 symbols completed. SKIL took 22.3s. Estimated remaining: 57m 28s. Rate: 7.8 symbols/min [2025-10-21T21:06:46.624200] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T21:06:46.626254] [INFO ] [REMOTE ] SKLZ: Full fetch complete (17707 records). [2025-10-21T21:06:46.626322] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-10-21T21:06:47.000436] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-10-21T21:06:47.000511] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-10-21T21:06:47.000906] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-10-21T21:06:47.000966] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-10-21T21:06:47.001467] [DEBUG] [LOCAL ] SKLZ: Trimmed 17707 records to 11495 (keeping 200 days of data) [2025-10-21T21:06:47.063792] [DEBUG] [LOCAL ] SKLZ: Primary data saved (11495 records). [2025-10-21T21:06:47.063920] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-10-21T21:06:47.063999] [INFO ] [MAIN ] Update Progress: 1920/2366 symbols completed. SKLZ took 19.5s. Estimated remaining: 57m 19s. Rate: 7.8 symbols/min [2025-10-21T21:06:47.677436] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:06:47.754357] [DEBUG] [LOCAL ] SKY: No existing data file found in primary storage. [2025-10-21T21:06:47.743933] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:06:47.756485] [DEBUG] [LOCAL ] SKT: No existing data file found in primary storage. [2025-10-21T21:06:47.756352] [WARN ] [MAIN ] SKY: No existing data found, performing full refresh instead. [2025-10-21T21:06:47.759087] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:06:47.756704] [WARN ] [MAIN ] SKT: No existing data found, performing full refresh instead. [2025-10-21T21:06:47.776687] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-10-21T21:06:47.777190] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-10-21T21:06:47.782486] [DEBUG] [LOCAL ] SKT: No primary data file found to delete. [2025-10-21T21:06:47.790469] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-10-21T21:06:47.790593] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-10-21T21:06:47.812847] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-10-21T21:06:47.833417] [DEBUG] [LOCAL ] SKY: No primary data file found to delete. [2025-10-21T21:06:47.840833] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-10-21T21:06:47.947995] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:06:48.234108] [DEBUG] [LOCAL ] SKYH: Loaded 15998 existing records from primary storage. [2025-10-21T21:06:48.300537] [DEBUG] [LOCAL ] SKM: Loaded 35239 existing records from primary storage. [2025-10-21T21:06:48.299803] [INFO ] [MAIN ] SKYH: Loaded 15998 existing records. [2025-10-21T21:06:48.314550] [INFO ] [MAIN ] SKM: Loaded 35239 existing records. [2025-10-21T21:06:48.938324] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:06:49.000922] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-10-21T21:06:48.953272] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:06:49.005498] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:06:49.021744] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-10-21T21:06:49.033956] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:06:49.035032] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-10-21T21:06:49.035175] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-10-21T21:06:49.035238] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-10-21T21:06:49.035347] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-10-21T21:06:49.035450] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-10-21T21:06:49.035536] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-10-21T21:06:49.035508] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-10-21T21:06:49.041099] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-10-21T21:06:49.738296] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:06:49.748923] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-10-21T21:06:49.801866] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:06:49.802177] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-10-21T21:06:50.543398] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T21:06:50.550890] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-10-21T21:06:50.632770] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T21:06:50.640476] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-10-21T21:06:50.809839] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-21T21:06:51.122768] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T21:06:51.351075] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-10-21T21:06:52.027241] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T21:06:52.066108] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T21:06:52.151026] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-10-21T21:06:52.686071] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T21:06:52.951049] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-10-21T21:06:53.240429] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T21:06:53.642921] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T21:06:53.751046] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-10-21T21:06:54.551090] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-10-21T21:06:55.351024] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-10-21T21:06:55.533824] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T21:06:55.776362] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-21T21:06:56.151080] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-10-21T21:06:56.885163] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T21:06:56.950989] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-10-21T21:06:57.352851] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T21:06:57.751022] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-10-21T21:06:58.256203] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T21:06:58.551083] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-10-21T21:06:59.351060] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-10-21T21:06:59.402581] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T21:07:00.151061] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-10-21T21:07:00.511177] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T21:07:00.944740] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T21:07:00.952198] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-10-21T21:07:01.740385] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T21:07:01.750986] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-10-21T21:07:02.551022] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-10-21T21:07:02.613037] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T21:07:03.217176] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T21:07:03.351006] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-10-21T21:07:03.848182] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T21:07:04.151030] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-10-21T21:07:04.951072] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-10-21T21:07:05.366689] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T21:07:05.751008] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-10-21T21:07:05.818521] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T21:07:05.838121] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T21:07:06.551045] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-10-21T21:07:07.036784] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T21:07:07.351032] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-10-21T21:07:07.675793] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T21:07:08.151098] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-10-21T21:07:08.951012] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-10-21T21:07:09.006854] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T21:07:09.130281] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T21:07:09.751064] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-10-21T21:07:10.321987] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T21:07:10.551013] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-10-21T21:07:11.061040] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T21:07:11.351073] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-10-21T21:07:11.666943] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T21:07:12.151032] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-10-21T21:07:12.422513] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T21:07:12.951058] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-10. [2025-10-21T21:07:13.751031] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-10-21T21:07:14.356897] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T21:07:14.551001] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-10-21T21:07:14.671460] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T21:07:14.677724] [INFO ] [REMOTE ] SKY: Full fetch complete (54343 records). [2025-10-21T21:07:14.677828] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-10-21T21:07:14.817784] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T21:07:15.082515] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-10-21T21:07:15.082601] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-10-21T21:07:15.083765] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-10-21T21:07:15.083830] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-10-21T21:07:15.085028] [DEBUG] [LOCAL ] SKY: Trimmed 54343 records to 38650 (keeping 200 days of data) [2025-10-21T21:07:15.305720] [DEBUG] [LOCAL ] SKY: Primary data saved (38650 records). [2025-10-21T21:07:15.305851] [INFO ] [MAIN ] SKY: Full history saved. [2025-10-21T21:07:15.305919] [INFO ] [MAIN ] Update Progress: 1921/2366 symbols completed. SKY took 28.2s. Estimated remaining: 57m 16s. Rate: 7.8 symbols/min [2025-10-21T21:07:15.361298] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-10. [2025-10-21T21:07:15.478791] [INFO ] [MAIN ] SLAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:07:15.478959] [DEBUG] [LOCAL ] SLAI: No existing data file found in primary storage. [2025-10-21T21:07:15.478997] [WARN ] [MAIN ] SLAI: No existing data found, performing full refresh instead. [2025-10-21T21:07:15.479107] [INFO ] [MAIN ] SLAI: Wiping existing primary data before full refresh. [2025-10-21T21:07:15.479148] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-21T21:07:15.479189] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-21T21:07:15.479222] [INFO ] [MAIN ] SLAI: Starting full primary refresh. [2025-10-21T21:07:15.831866] [INFO ] [REMOTE ] SLAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:07:16.151008] [INFO ] [REMOTE ] SLAI: Fetching primary data for 2025-01. [2025-10-21T21:07:16.230810] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:07:16.247175] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T21:07:16.250373] [INFO ] [REMOTE ] SKYH: Full fetch complete (22524 records). [2025-10-21T21:07:16.250443] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-10-21T21:07:16.526785] [DEBUG] [REMOTE ] SLAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:07:16.540151] [WARN ] [REMOTE ] SLAI: No data returned for month 2025-01 [2025-10-21T21:07:16.555820] [FATAL] [REMOTE ] SLAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:07:16.568400] [FATAL] [MAIN ] SLAI: Failed to fetch primary data. [2025-10-21T21:07:16.578443] [WARN ] [MAIN ] SLAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:07:16.587716] [INFO ] [LOCAL ] SLAI: Starting deletion of primary data. [2025-10-21T21:07:16.603868] [DEBUG] [LOCAL ] SLAI: No primary data file found to delete. [2025-10-21T21:07:16.612816] [INFO ] [LOCAL ] SLAI: Starting deletion of derivative data. [2025-10-21T21:07:16.613391] [DEBUG] [LOCAL ] SLAI: No derivative data file found to delete. [2025-10-21T21:07:16.613467] [INFO ] [MAIN ] Update Progress: 1922/2366 symbols completed. SLAI took 1.3s. Estimated remaining: 57m 6s. Rate: 7.8 symbols/min [2025-10-21T21:07:16.645756] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-10-21T21:07:16.683381] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-10-21T21:07:16.695187] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-10-21T21:07:16.705859] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-10-21T21:07:16.733716] [DEBUG] [LOCAL ] SKYH: Trimmed 22524 records to 15910 (keeping 200 days of data) [2025-10-21T21:07:16.790224] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:07:16.827169] [DEBUG] [LOCAL ] SLB: No existing data file found in primary storage. [2025-10-21T21:07:16.836131] [WARN ] [MAIN ] SLB: No existing data found, performing full refresh instead. [2025-10-21T21:07:16.836770] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-10-21T21:07:16.859791] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-21T21:07:16.859863] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-21T21:07:16.859914] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-10-21T21:07:16.954743] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-10-21T21:07:17.166529] [DEBUG] [LOCAL ] SKYH: Primary data saved (15910 records). [2025-10-21T21:07:17.177492] [INFO ] [MAIN ] SKYH: Full history saved. [2025-10-21T21:07:17.177967] [INFO ] [MAIN ] Update Progress: 1923/2366 symbols completed. SKYH took 30.1s. Estimated remaining: 56m 57s. Rate: 7.8 symbols/min [2025-10-21T21:07:17.377255] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:07:17.444456] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:07:17.480125] [DEBUG] [LOCAL ] SLF: Loaded 38690 existing records from primary storage. [2025-10-21T21:07:17.480404] [INFO ] [MAIN ] SLF: Loaded 38690 existing records. [2025-10-21T21:07:17.653153] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:07:17.653352] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-10-21T21:07:17.653398] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-10-21T21:07:17.653601] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-10-21T21:07:17.653690] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-10-21T21:07:17.755139] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-10. [2025-10-21T21:07:18.004134] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:07:18.551057] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-10-21T21:07:18.694915] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T21:07:19.198569] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T21:07:19.204048] [INFO ] [REMOTE ] SKM: Full fetch complete (49206 records). [2025-10-21T21:07:19.204125] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-10-21T21:07:19.353740] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-10. [2025-10-21T21:07:19.582295] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-10-21T21:07:19.582381] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-10-21T21:07:19.583307] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-10-21T21:07:19.583377] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-10-21T21:07:19.584354] [DEBUG] [LOCAL ] SKM: Trimmed 49206 records to 35237 (keeping 200 days of data) [2025-10-21T21:07:19.795997] [DEBUG] [LOCAL ] SKM: Primary data saved (35237 records). [2025-10-21T21:07:19.796117] [INFO ] [MAIN ] SKM: Full history saved. [2025-10-21T21:07:19.796192] [INFO ] [MAIN ] Update Progress: 1924/2366 symbols completed. SKM took 32.7s. Estimated remaining: 56m 48s. Rate: 7.8 symbols/min [2025-10-21T21:07:19.967229] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:07:19.967466] [DEBUG] [LOCAL ] SLG: No existing data file found in primary storage. [2025-10-21T21:07:19.967510] [WARN ] [MAIN ] SLG: No existing data found, performing full refresh instead. [2025-10-21T21:07:19.974145] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-10-21T21:07:19.985503] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-10-21T21:07:19.985614] [DEBUG] [LOCAL ] SLG: No primary data file found to delete. [2025-10-21T21:07:19.986181] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-10-21T21:07:19.986813] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T21:07:20.166109] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-10-21T21:07:20.351499] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:07:20.951037] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-10-21T21:07:21.073367] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T21:07:21.079941] [INFO ] [REMOTE ] SKT: Full fetch complete (60640 records). [2025-10-21T21:07:21.080064] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-10-21T21:07:21.461770] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-10-21T21:07:21.461853] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-10-21T21:07:21.463056] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-10-21T21:07:21.463135] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-10-21T21:07:21.464361] [DEBUG] [LOCAL ] SKT: Trimmed 60640 records to 42370 (keeping 200 days of data) [2025-10-21T21:07:21.718860] [DEBUG] [LOCAL ] SKT: Primary data saved (42370 records). [2025-10-21T21:07:21.718991] [INFO ] [MAIN ] SKT: Full history saved. [2025-10-21T21:07:21.719062] [INFO ] [MAIN ] Update Progress: 1925/2366 symbols completed. SKT took 34.7s. Estimated remaining: 56m 39s. Rate: 7.8 symbols/min [2025-10-21T21:07:21.756292] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-10-21T21:07:21.894611] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:07:21.894915] [DEBUG] [LOCAL ] SLGN: No existing data file found in primary storage. [2025-10-21T21:07:21.894989] [WARN ] [MAIN ] SLGN: No existing data found, performing full refresh instead. [2025-10-21T21:07:21.895278] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-10-21T21:07:21.895385] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-10-21T21:07:21.895519] [DEBUG] [LOCAL ] SLGN: No primary data file found to delete. [2025-10-21T21:07:21.895676] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-10-21T21:07:22.018244] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T21:07:22.291063] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:07:22.551073] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-10-21T21:07:22.766322] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T21:07:23.351041] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-10-21T21:07:23.693113] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T21:07:24.151026] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-10-21T21:07:24.189146] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T21:07:24.958033] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-10-21T21:07:24.978747] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T21:07:25.751141] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-10-21T21:07:26.263705] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-21T21:07:26.492249] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T21:07:26.550980] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-10-21T21:07:27.351070] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-10-21T21:07:27.420192] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T21:07:28.150996] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-10-21T21:07:28.452525] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T21:07:28.955329] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-10-21T21:07:28.958578] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T21:07:29.751006] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-10-21T21:07:30.059360] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T21:07:30.551014] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-10-21T21:07:30.585307] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-21T21:07:31.274039] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T21:07:31.351086] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-10-21T21:07:32.151055] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-10-21T21:07:32.283997] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T21:07:32.951017] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-10-21T21:07:33.751303] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-10-21T21:07:33.755087] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T21:07:33.943712] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-21T21:07:34.553394] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-10-21T21:07:34.556711] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T21:07:35.119754] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T21:07:35.351061] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-10-21T21:07:36.151907] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-10-21T21:07:36.154483] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T21:07:36.951060] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-10-21T21:07:37.534446] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T21:07:37.600711] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T21:07:37.750990] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-10-21T21:07:38.550997] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-10-21T21:07:38.787368] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T21:07:39.198353] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T21:07:39.351021] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-10-21T21:07:40.151013] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-10-21T21:07:40.660403] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-21T21:07:40.951002] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-10-21T21:07:41.080849] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T21:07:41.751056] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-10-21T21:07:41.932366] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T21:07:42.513402] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T21:07:42.551002] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-10-21T21:07:43.351021] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-10-21T21:07:43.691869] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T21:07:44.030923] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T21:07:44.151044] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-10. [2025-10-21T21:07:44.951077] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-10-21T21:07:45.563815] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-21T21:07:45.617068] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T21:07:45.625253] [INFO ] [REMOTE ] SLF: Full fetch complete (56399 records). [2025-10-21T21:07:45.625457] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-10-21T21:07:45.756149] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-10. [2025-10-21T21:07:46.019583] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-10-21T21:07:46.019694] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-10-21T21:07:46.020724] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-10-21T21:07:46.020786] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-10-21T21:07:46.021913] [DEBUG] [LOCAL ] SLF: Trimmed 56399 records to 38518 (keeping 200 days of data) [2025-10-21T21:07:46.256327] [DEBUG] [LOCAL ] SLF: Primary data saved (38518 records). [2025-10-21T21:07:46.256465] [INFO ] [MAIN ] SLF: Full history saved. [2025-10-21T21:07:46.256563] [INFO ] [MAIN ] Update Progress: 1926/2366 symbols completed. SLF took 29.1s. Estimated remaining: 56m 35s. Rate: 7.8 symbols/min [2025-10-21T21:07:46.427958] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:07:46.428150] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-10-21T21:07:46.428219] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-10-21T21:07:46.428359] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-10-21T21:07:46.428459] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-21T21:07:46.428701] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-21T21:07:46.428767] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-10-21T21:07:46.551676] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-10-21T21:07:46.791132] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:07:46.814830] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T21:07:47.350999] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-10-21T21:07:47.445202] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T21:07:47.452264] [INFO ] [REMOTE ] SLG: Full fetch complete (65181 records). [2025-10-21T21:07:47.452388] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-10-21T21:07:47.842960] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-10-21T21:07:47.843042] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-10-21T21:07:47.844118] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-10-21T21:07:47.844182] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-10-21T21:07:47.845496] [DEBUG] [LOCAL ] SLG: Trimmed 65181 records to 45820 (keeping 200 days of data) [2025-10-21T21:07:47.934029] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-21T21:07:48.120806] [DEBUG] [LOCAL ] SLG: Primary data saved (45820 records). [2025-10-21T21:07:48.120931] [INFO ] [MAIN ] SLG: Full history saved. [2025-10-21T21:07:48.120998] [INFO ] [MAIN ] Update Progress: 1927/2366 symbols completed. SLG took 28.3s. Estimated remaining: 56m 26s. Rate: 7.8 symbols/min [2025-10-21T21:07:48.156295] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-10-21T21:07:48.292745] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:07:48.333097] [DEBUG] [LOCAL ] SLQT: Loaded 43489 existing records from primary storage. [2025-10-21T21:07:48.333410] [INFO ] [MAIN ] SLQT: Loaded 43489 existing records. [2025-10-21T21:07:48.506232] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:07:48.506441] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-10-21T21:07:48.506500] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-10-21T21:07:48.506749] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-10-21T21:07:48.506806] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-10-21T21:07:48.763175] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T21:07:48.862353] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:07:48.950983] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-10-21T21:07:49.052278] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-21T21:07:49.751081] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-10-21T21:07:50.246505] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-21T21:07:50.538243] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T21:07:50.551010] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-10-21T21:07:51.351043] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-10-21T21:07:52.151133] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-10-21T21:07:52.464092] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-21T21:07:52.951063] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-10-21T21:07:53.514725] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T21:07:53.569050] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-21T21:07:53.751040] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-10-21T21:07:53.897069] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T21:07:54.188795] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-21T21:07:54.551032] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-10-21T21:07:55.351063] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-10-21T21:07:56.151045] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-10-21T21:07:56.213725] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T21:07:56.709980] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-21T21:07:56.951081] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-10-21T21:07:57.491891] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T21:07:57.530507] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-21T21:07:57.751035] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-10-21T21:07:58.210434] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-21T21:07:58.551032] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-10. [2025-10-21T21:07:59.351166] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-10-21T21:08:00.151039] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-10-21T21:08:00.228119] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T21:08:00.235124] [INFO ] [REMOTE ] SLGN: Full fetch complete (59303 records). [2025-10-21T21:08:00.235228] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-10-21T21:08:00.616126] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-10-21T21:08:00.616250] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-10-21T21:08:00.617456] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-10-21T21:08:00.617520] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-10-21T21:08:00.618735] [DEBUG] [LOCAL ] SLGN: Trimmed 59303 records to 41036 (keeping 200 days of data) [2025-10-21T21:08:00.717193] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T21:08:00.864826] [DEBUG] [LOCAL ] SLGN: Primary data saved (41036 records). [2025-10-21T21:08:00.865050] [INFO ] [MAIN ] SLGN: Full history saved. [2025-10-21T21:08:00.865129] [INFO ] [MAIN ] Update Progress: 1928/2366 symbols completed. SLGN took 39.1s. Estimated remaining: 56m 20s. Rate: 7.8 symbols/min [2025-10-21T21:08:00.956219] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-10. [2025-10-21T21:08:01.043461] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:01.043754] [DEBUG] [LOCAL ] SLVM: No existing data file found in primary storage. [2025-10-21T21:08:01.043828] [WARN ] [MAIN ] SLVM: No existing data found, performing full refresh instead. [2025-10-21T21:08:01.043985] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-10-21T21:08:01.044049] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-10-21T21:08:01.044130] [DEBUG] [LOCAL ] SLVM: No primary data file found to delete. [2025-10-21T21:08:01.044195] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-10-21T21:08:01.186049] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T21:08:01.443983] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:01.503222] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T21:08:01.503968] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1046 records). [2025-10-21T21:08:01.504037] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-10-21T21:08:01.697251] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-21T21:08:01.697451] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:08:01.697539] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:08:01.697674] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-10-21T21:08:01.697751] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-10-21T21:08:01.697797] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-10-21T21:08:01.697836] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-10-21T21:08:01.697890] [INFO ] [MAIN ] Update Progress: 1929/2366 symbols completed. SLNZ took 15.4s. Estimated remaining: 56m 10s. Rate: 7.8 symbols/min [2025-10-21T21:08:01.758382] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-10-21T21:08:01.874827] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:01.875017] [DEBUG] [LOCAL ] SM: No existing data file found in primary storage. [2025-10-21T21:08:01.875056] [WARN ] [MAIN ] SM: No existing data found, performing full refresh instead. [2025-10-21T21:08:01.875169] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-10-21T21:08:01.875211] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-10-21T21:08:01.875253] [DEBUG] [LOCAL ] SM: No primary data file found to delete. [2025-10-21T21:08:01.875286] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-10-21T21:08:02.232761] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:02.551037] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-10. [2025-10-21T21:08:03.015497] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T21:08:03.351039] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-10-21T21:08:03.460225] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T21:08:03.468978] [INFO ] [REMOTE ] SLB: Full fetch complete (77487 records). [2025-10-21T21:08:03.469183] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-10-21T21:08:03.470350] [FATAL] [VALIDATOR ] SLB: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T21:08:03.470457] [FATAL] [MAIN ] SLB: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:08:03.470502] [WARN ] [MAIN ] SLB: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:08:03.470571] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-10-21T21:08:03.470671] [DEBUG] [LOCAL ] SLB: No primary data file found to delete. [2025-10-21T21:08:03.470734] [INFO ] [LOCAL ] SLB: Starting deletion of derivative data. [2025-10-21T21:08:03.470779] [DEBUG] [LOCAL ] SLB: No derivative data file found to delete. [2025-10-21T21:08:03.470848] [INFO ] [MAIN ] Update Progress: 1930/2366 symbols completed. SLB took 46.9s. Estimated remaining: 56m 1s. Rate: 7.8 symbols/min [2025-10-21T21:08:03.663524] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:03.663853] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-10-21T21:08:03.663909] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-10-21T21:08:03.664036] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-10-21T21:08:03.664081] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-21T21:08:03.664122] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-21T21:08:03.664156] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-10-21T21:08:04.046857] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:04.151090] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-10-21T21:08:04.448130] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:08:04.448546] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-10-21T21:08:04.448675] [FATAL] [REMOTE ] SMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:08:04.448740] [FATAL] [MAIN ] SMA: Failed to fetch primary data. [2025-10-21T21:08:04.448777] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:08:04.448845] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-10-21T21:08:04.448916] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-10-21T21:08:04.448963] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-10-21T21:08:04.449003] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-10-21T21:08:04.449055] [INFO ] [MAIN ] Update Progress: 1931/2366 symbols completed. SMA took 1.0s. Estimated remaining: 55m 52s. Rate: 7.8 symbols/min [2025-10-21T21:08:04.624445] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:04.636828] [DEBUG] [LOCAL ] SMBK: Loaded 8274 existing records from primary storage. [2025-10-21T21:08:04.637156] [INFO ] [MAIN ] SMBK: Loaded 8274 existing records. [2025-10-21T21:08:04.833103] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:08:04.833624] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-10-21T21:08:04.833745] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-10-21T21:08:04.834054] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-10-21T21:08:04.834140] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-10-21T21:08:04.956502] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-10-21T21:08:04.937732] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T21:08:05.270391] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:05.751049] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-10-21T21:08:06.551075] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-10-21T21:08:06.761938] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T21:08:07.351005] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-10-21T21:08:07.490177] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T21:08:07.524323] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T21:08:08.151044] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-10-21T21:08:08.602527] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T21:08:08.951066] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-10-21T21:08:09.671234] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T21:08:09.750984] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-10-21T21:08:10.306682] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T21:08:10.551016] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-10-21T21:08:10.847144] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T21:08:11.351072] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-10-21T21:08:12.101977] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T21:08:12.151043] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-10-21T21:08:12.364980] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T21:08:12.951032] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-10-21T21:08:13.081635] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T21:08:13.751083] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-10-21T21:08:14.551051] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-10-21T21:08:14.893475] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T21:08:15.351026] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-10-21T21:08:15.453169] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T21:08:15.534033] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T21:08:16.151036] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-10-21T21:08:16.951055] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-10-21T21:08:16.994379] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T21:08:17.358452] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T21:08:17.751024] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-10-21T21:08:18.379196] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T21:08:18.551006] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-10-21T21:08:19.351010] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-10-21T21:08:19.636150] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T21:08:20.151007] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-10-21T21:08:20.240371] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T21:08:20.302963] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T21:08:20.951022] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-10-21T21:08:21.751019] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-10-21T21:08:22.182005] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T21:08:22.212199] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T21:08:22.550997] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-10-21T21:08:22.662984] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-21T21:08:23.351063] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-10-21T21:08:24.001336] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-21T21:08:24.151003] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-10-21T21:08:24.349470] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-21T21:08:24.951059] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-10-21T21:08:25.612272] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T21:08:25.659666] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T21:08:25.751083] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-10-21T21:08:26.551097] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-10-21T21:08:27.284544] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T21:08:27.351083] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-10. [2025-10-21T21:08:27.755189] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T21:08:28.151083] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-10. [2025-10-21T21:08:28.723587] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T21:08:28.728407] [INFO ] [REMOTE ] SLVM: Full fetch complete (40054 records). [2025-10-21T21:08:28.728513] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-10-21T21:08:28.956276] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-10. [2025-10-21T21:08:29.114729] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-10-21T21:08:29.114828] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-10-21T21:08:29.115779] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-10-21T21:08:29.115843] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-10-21T21:08:29.116888] [DEBUG] [LOCAL ] SLVM: Trimmed 40054 records to 27696 (keeping 200 days of data) [2025-10-21T21:08:29.290388] [DEBUG] [LOCAL ] SLVM: Primary data saved (27696 records). [2025-10-21T21:08:29.290533] [INFO ] [MAIN ] SLVM: Full history saved. [2025-10-21T21:08:29.290609] [INFO ] [MAIN ] Update Progress: 1932/2366 symbols completed. SLVM took 28.4s. Estimated remaining: 55m 48s. Rate: 7.8 symbols/min [2025-10-21T21:08:29.467667] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:29.480033] [DEBUG] [LOCAL ] SMC: Loaded 11111 existing records from primary storage. [2025-10-21T21:08:29.480216] [INFO ] [MAIN ] SMC: Loaded 11111 existing records. [2025-10-21T21:08:29.660376] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:08:29.660706] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-10-21T21:08:29.660770] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-10-21T21:08:29.660910] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-10-21T21:08:29.660946] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-10-21T21:08:29.757756] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-10-21T21:08:29.950945] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T21:08:29.973236] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T21:08:29.993918] [INFO ] [REMOTE ] SMBK: Full fetch complete (11854 records). [2025-10-21T21:08:30.004477] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-10-21T21:08:30.033606] [INFO ] [REMOTE ] SLQT: Full fetch complete (63864 records). [2025-10-21T21:08:30.066324] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:30.087203] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-10-21T21:08:30.552103] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-10-21T21:08:30.788250] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-10-21T21:08:30.798639] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-10-21T21:08:30.804242] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-10-21T21:08:30.804325] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-10-21T21:08:30.843915] [DEBUG] [LOCAL ] SMBK: Trimmed 11854 records to 8280 (keeping 200 days of data) [2025-10-21T21:08:30.917976] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-10-21T21:08:30.918444] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-10-21T21:08:30.926244] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-10-21T21:08:30.926338] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-10-21T21:08:30.934096] [DEBUG] [LOCAL ] SMBK: Primary data saved (8280 records). [2025-10-21T21:08:30.934684] [INFO ] [MAIN ] SMBK: Full history saved. [2025-10-21T21:08:30.934951] [INFO ] [MAIN ] Update Progress: 1933/2366 symbols completed. SMBK took 26.5s. Estimated remaining: 55m 39s. Rate: 7.8 symbols/min [2025-10-21T21:08:31.000828] [DEBUG] [LOCAL ] SLQT: Trimmed 63864 records to 43445 (keeping 200 days of data) [2025-10-21T21:08:31.203479] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:31.407441] [DEBUG] [LOCAL ] SMFG: Loaded 48395 existing records from primary storage. [2025-10-21T21:08:31.410756] [INFO ] [MAIN ] SMFG: Loaded 48395 existing records. [2025-10-21T21:08:31.410871] [DEBUG] [LOCAL ] SLQT: Primary data saved (43445 records). [2025-10-21T21:08:31.441524] [INFO ] [MAIN ] SLQT: Full history saved. [2025-10-21T21:08:31.447836] [INFO ] [MAIN ] Update Progress: 1934/2366 symbols completed. SLQT took 43.3s. Estimated remaining: 55m 30s. Rate: 7.8 symbols/min [2025-10-21T21:08:31.729738] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:08:31.731001] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-10-21T21:08:31.732318] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T21:08:31.741366] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-10-21T21:08:31.741257] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-10-21T21:08:31.781537] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-10-21T21:08:31.782149] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-10-21T21:08:31.920848] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:31.924322] [DEBUG] [LOCAL ] SMG: No existing data file found in primary storage. [2025-10-21T21:08:31.924687] [WARN ] [MAIN ] SMG: No existing data found, performing full refresh instead. [2025-10-21T21:08:31.930380] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-10-21T21:08:31.935601] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-10-21T21:08:31.991503] [DEBUG] [LOCAL ] SMG: No primary data file found to delete. [2025-10-21T21:08:32.001366] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-10-21T21:08:32.250095] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-10-21T21:08:32.365114] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:32.399017] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-10-21T21:08:32.598925] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:32.748017] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T21:08:32.951111] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-10-21T21:08:33.750993] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-10-21T21:08:33.918068] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T21:08:34.333583] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-21T21:08:34.551008] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-10-21T21:08:35.351014] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-10-21T21:08:35.655200] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T21:08:35.838294] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T21:08:36.151129] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-10. [2025-10-21T21:08:36.443366] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T21:08:36.951096] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-10-21T21:08:37.751043] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-10-21T21:08:37.841259] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T21:08:38.047191] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T21:08:38.055513] [INFO ] [REMOTE ] SM: Full fetch complete (75886 records). [2025-10-21T21:08:38.055706] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-10-21T21:08:38.461462] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-10-21T21:08:38.461588] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-10-21T21:08:38.463017] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-10-21T21:08:38.463104] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-10-21T21:08:38.464799] [DEBUG] [LOCAL ] SM: Trimmed 75886 records to 52354 (keeping 200 days of data) [2025-10-21T21:08:38.557283] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-10-21T21:08:38.790753] [DEBUG] [LOCAL ] SM: Primary data saved (52354 records). [2025-10-21T21:08:38.790890] [INFO ] [MAIN ] SM: Full history saved. [2025-10-21T21:08:38.790964] [INFO ] [MAIN ] Update Progress: 1935/2366 symbols completed. SM took 37.1s. Estimated remaining: 55m 22s. Rate: 7.8 symbols/min [2025-10-21T21:08:38.958853] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:38.972328] [DEBUG] [LOCAL ] SMHI: Loaded 13011 existing records from primary storage. [2025-10-21T21:08:38.972520] [INFO ] [MAIN ] SMHI: Loaded 13011 existing records. [2025-10-21T21:08:39.148991] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:08:39.149349] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-10-21T21:08:39.149403] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-10-21T21:08:39.149679] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-10-21T21:08:39.149736] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-10-21T21:08:39.358635] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-10-21T21:08:39.509455] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:39.543685] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T21:08:39.544035] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T21:08:40.151058] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-10-21T21:08:40.951141] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-10-21T21:08:41.167874] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T21:08:41.751060] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-10-21T21:08:41.876424] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T21:08:42.048303] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T21:08:42.551080] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-10-21T21:08:43.351008] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-10-21T21:08:43.526360] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T21:08:44.151008] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-10-21T21:08:44.340884] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T21:08:44.422563] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T21:08:44.951034] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-10-21T21:08:45.751007] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-10-21T21:08:46.551014] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-10-21T21:08:46.877424] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T21:08:47.199255] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-21T21:08:47.351045] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-10-21T21:08:48.151084] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-10. [2025-10-21T21:08:48.640172] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (4.49 seconds). [2025-10-21T21:08:48.956904] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-10-21T21:08:48.973930] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T21:08:49.465114] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (3.71 seconds). [2025-10-21T21:08:49.723523] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T21:08:49.725609] [INFO ] [REMOTE ] SMC: Full fetch complete (16549 records). [2025-10-21T21:08:49.725709] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-10-21T21:08:49.756717] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-10-21T21:08:50.098287] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-10-21T21:08:50.098363] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-10-21T21:08:50.098788] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-10-21T21:08:50.098865] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-10-21T21:08:50.099366] [DEBUG] [LOCAL ] SMC: Trimmed 16549 records to 11048 (keeping 200 days of data) [2025-10-21T21:08:50.162167] [DEBUG] [LOCAL ] SMC: Primary data saved (11048 records). [2025-10-21T21:08:50.162320] [INFO ] [MAIN ] SMC: Full history saved. [2025-10-21T21:08:50.162408] [INFO ] [MAIN ] Update Progress: 1936/2366 symbols completed. SMC took 20.9s. Estimated remaining: 55m 15s. Rate: 7.8 symbols/min [2025-10-21T21:08:50.339239] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:08:50.339428] [DEBUG] [LOCAL ] SMP: No existing data file found in primary storage. [2025-10-21T21:08:50.339472] [WARN ] [MAIN ] SMP: No existing data found, performing full refresh instead. [2025-10-21T21:08:50.339579] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-10-21T21:08:50.339620] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-10-21T21:08:50.339697] [DEBUG] [LOCAL ] SMP: No primary data file found to delete. [2025-10-21T21:08:50.339745] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-10-21T21:08:50.561833] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-10-21T21:08:50.700939] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:08:50.755140] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T21:08:51.350997] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-10-21T21:08:51.552874] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-21T21:08:51.758089] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T21:08:52.151043] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-10-21T21:08:52.940117] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T21:08:52.950978] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-10-21T21:08:53.751014] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-10-21T21:08:53.979420] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-21T21:08:54.550999] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-10-21T21:08:54.640825] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T21:08:54.699192] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T21:08:55.351083] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-10-21T21:08:56.151115] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-10-21T21:08:56.402985] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T21:08:56.463254] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T21:08:56.951023] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-10. [2025-10-21T21:08:57.392596] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T21:08:57.751024] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-10-21T21:08:58.551000] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-10-21T21:08:59.041866] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T21:08:59.351020] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-10-21T21:08:59.633953] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T21:08:59.659547] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-10 (2.71 seconds). [2025-10-21T21:08:59.667301] [INFO ] [REMOTE ] SMFG: Full fetch complete (69330 records). [2025-10-21T21:08:59.667427] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-10-21T21:09:00.064141] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-10-21T21:09:00.064217] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-10-21T21:09:00.065291] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-10-21T21:09:00.065378] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-10-21T21:09:00.066625] [DEBUG] [LOCAL ] SMFG: Trimmed 69330 records to 48330 (keeping 200 days of data) [2025-10-21T21:09:00.151351] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-10-21T21:09:00.346523] [DEBUG] [LOCAL ] SMFG: Primary data saved (48330 records). [2025-10-21T21:09:00.346668] [INFO ] [MAIN ] SMFG: Full history saved. [2025-10-21T21:09:00.346763] [INFO ] [MAIN ] Update Progress: 1937/2366 symbols completed. SMFG took 29.4s. Estimated remaining: 55m 8s. Rate: 7.8 symbols/min [2025-10-21T21:09:00.514980] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:09:00.515133] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-10-21T21:09:00.515170] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-10-21T21:09:00.515304] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-10-21T21:09:00.515367] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-21T21:09:00.515412] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-10-21T21:09:00.515448] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-10-21T21:09:00.893878] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:09:00.917434] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T21:09:00.951041] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-10-21T21:09:01.581389] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-21T21:09:01.751019] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-10-21T21:09:02.138851] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-21T21:09:02.551127] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-10-21T21:09:03.011367] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T21:09:03.351020] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-10-21T21:09:04.151086] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-10. [2025-10-21T21:09:04.802436] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T21:09:04.951004] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-10-21T21:09:05.279733] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-10-21T21:09:05.677672] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T21:09:05.683854] [INFO ] [REMOTE ] SMG: Full fetch complete (62869 records). [2025-10-21T21:09:05.683967] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-10-21T21:09:05.756242] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-10-21T21:09:05.987311] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T21:09:06.126238] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-10-21T21:09:06.126328] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-10-21T21:09:06.127636] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-10-21T21:09:06.127724] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-10-21T21:09:06.129048] [DEBUG] [LOCAL ] SMG: Trimmed 62869 records to 42875 (keeping 200 days of data) [2025-10-21T21:09:06.405184] [DEBUG] [LOCAL ] SMG: Primary data saved (42875 records). [2025-10-21T21:09:06.405336] [INFO ] [MAIN ] SMG: Full history saved. [2025-10-21T21:09:06.405440] [INFO ] [MAIN ] Update Progress: 1938/2366 symbols completed. SMG took 34.9s. Estimated remaining: 54m 60s. Rate: 7.8 symbols/min [2025-10-21T21:09:06.563137] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-10-21T21:09:06.598204] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:09:06.641503] [DEBUG] [LOCAL ] SMRT: Loaded 43776 existing records from primary storage. [2025-10-21T21:09:06.641873] [INFO ] [MAIN ] SMRT: Loaded 43776 existing records. [2025-10-21T21:09:06.838001] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:09:06.838210] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-10-21T21:09:06.838258] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-10-21T21:09:06.838485] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-10-21T21:09:06.838542] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-10-21T21:09:07.097915] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T21:09:07.220830] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:09:07.350996] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-10-21T21:09:07.596428] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T21:09:08.151047] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-10-21T21:09:08.951024] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-10-21T21:09:09.635819] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T21:09:09.751020] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-10-21T21:09:09.959234] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.61 seconds). [2025-10-21T21:09:10.195632] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T21:09:10.551017] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-10-21T21:09:11.333743] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T21:09:11.350989] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-10-21T21:09:11.382842] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T21:09:12.151054] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-10-21T21:09:12.951129] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-10-21T21:09:13.061370] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T21:09:13.751079] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-10-21T21:09:13.876587] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-21T21:09:14.551072] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-10-21T21:09:14.796498] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-21T21:09:15.325059] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T21:09:15.350982] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-10-21T21:09:15.468335] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-21T21:09:16.151057] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-10-21T21:09:16.950996] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-10. [2025-10-21T21:09:17.070949] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T21:09:17.750995] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-10-21T21:09:17.959220] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T21:09:17.962235] [INFO ] [REMOTE ] SMP: Full fetch complete (26476 records). [2025-10-21T21:09:17.962313] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-10-21T21:09:18.341055] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-10-21T21:09:18.341151] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-10-21T21:09:18.341698] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-10-21T21:09:18.341759] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-10-21T21:09:18.342358] [DEBUG] [LOCAL ] SMP: Trimmed 26476 records to 18732 (keeping 200 days of data) [2025-10-21T21:09:18.454414] [DEBUG] [LOCAL ] SMP: Primary data saved (18732 records). [2025-10-21T21:09:18.454549] [INFO ] [MAIN ] SMP: Full history saved. [2025-10-21T21:09:18.454620] [INFO ] [MAIN ] Update Progress: 1939/2366 symbols completed. SMP took 28.3s. Estimated remaining: 54m 53s. Rate: 7.8 symbols/min [2025-10-21T21:09:18.557525] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-10-21T21:09:18.638497] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:09:18.670077] [DEBUG] [LOCAL ] SMWB: Loaded 31939 existing records from primary storage. [2025-10-21T21:09:18.670361] [INFO ] [MAIN ] SMWB: Loaded 31939 existing records. [2025-10-21T21:09:18.849482] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:09:18.850126] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-10-21T21:09:18.850348] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-10-21T21:09:18.850599] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-10-21T21:09:18.850743] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-10-21T21:09:19.161042] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-10-21T21:09:19.295635] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:09:19.350999] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-10-21T21:09:19.554100] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T21:09:19.554559] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T21:09:20.151035] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-10-21T21:09:20.951045] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-10. [2025-10-21T21:09:21.751057] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-10-21T21:09:21.876336] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T21:09:21.878745] [INFO ] [REMOTE ] SMHI: Full fetch complete (21366 records). [2025-10-21T21:09:21.878883] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-10-21T21:09:22.007168] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T21:09:22.294906] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-10-21T21:09:22.295062] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-10-21T21:09:22.295746] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-10-21T21:09:22.295854] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-10-21T21:09:22.296850] [DEBUG] [LOCAL ] SMHI: Trimmed 21366 records to 12854 (keeping 200 days of data) [2025-10-21T21:09:22.397428] [DEBUG] [LOCAL ] SMHI: Primary data saved (12854 records). [2025-10-21T21:09:22.397729] [INFO ] [MAIN ] SMHI: Full history saved. [2025-10-21T21:09:22.398101] [INFO ] [MAIN ] Update Progress: 1940/2366 symbols completed. SMHI took 43.6s. Estimated remaining: 54m 45s. Rate: 7.8 symbols/min [2025-10-21T21:09:22.400208] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-10-21T21:09:22.557337] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-10-21T21:09:22.611075] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:09:22.612075] [DEBUG] [LOCAL ] SN: No existing data file found in primary storage. [2025-10-21T21:09:22.612142] [WARN ] [MAIN ] SN: No existing data found, performing full refresh instead. [2025-10-21T21:09:22.612297] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-10-21T21:09:22.612338] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-10-21T21:09:22.612377] [DEBUG] [LOCAL ] SN: No primary data file found to delete. [2025-10-21T21:09:22.612408] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-10-21T21:09:22.969888] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:09:23.350992] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-10-21T21:09:23.566080] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T21:09:24.151079] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-10-21T21:09:24.767012] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T21:09:24.951067] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-10-21T21:09:25.556000] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-10-21T21:09:25.750996] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-10-21T21:09:25.877558] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T21:09:26.240271] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T21:09:26.551028] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-10-21T21:09:27.351076] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-10. [2025-10-21T21:09:28.151068] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-10-21T21:09:28.282951] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T21:09:28.661800] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-10-21T21:09:28.950990] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-10-21T21:09:29.004742] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T21:09:29.011625] [INFO ] [REMOTE ] SMRT: Full fetch complete (62320 records). [2025-10-21T21:09:29.011765] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-10-21T21:09:29.404906] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-10-21T21:09:29.405031] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-10-21T21:09:29.406438] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-10-21T21:09:29.406683] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-10-21T21:09:29.429919] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T21:09:29.430088] [DEBUG] [LOCAL ] SMRT: Trimmed 62320 records to 43792 (keeping 200 days of data) [2025-10-21T21:09:29.678073] [DEBUG] [LOCAL ] SMRT: Primary data saved (43792 records). [2025-10-21T21:09:29.678203] [INFO ] [MAIN ] SMRT: Full history saved. [2025-10-21T21:09:29.679111] [INFO ] [MAIN ] Update Progress: 1941/2366 symbols completed. SMRT took 23.3s. Estimated remaining: 54m 37s. Rate: 7.8 symbols/min [2025-10-21T21:09:29.756294] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-10-21T21:09:29.854235] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:09:29.854388] [DEBUG] [LOCAL ] SNA: No existing data file found in primary storage. [2025-10-21T21:09:29.854470] [WARN ] [MAIN ] SNA: No existing data found, performing full refresh instead. [2025-10-21T21:09:29.854553] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-10-21T21:09:29.854595] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-10-21T21:09:29.854701] [DEBUG] [LOCAL ] SNA: No primary data file found to delete. [2025-10-21T21:09:29.854772] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-10-21T21:09:30.209273] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:09:30.551093] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-10-21T21:09:31.351048] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-10-21T21:09:31.607820] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T21:09:31.708051] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-21T21:09:32.032265] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T21:09:32.150985] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-10-21T21:09:32.467156] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T21:09:32.951081] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-10-21T21:09:33.662252] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T21:09:33.751078] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-10-21T21:09:34.550994] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-10-21T21:09:34.830481] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T21:09:35.351054] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-10-21T21:09:35.774852] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T21:09:36.151038] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-10-21T21:09:36.951001] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-10-21T21:09:37.236092] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T21:09:37.404185] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-21T21:09:37.656025] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T21:09:37.751066] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-10. [2025-10-21T21:09:38.402729] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T21:09:38.538108] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T21:09:38.545900] [INFO ] [REMOTE ] SMR: Full fetch complete (77587 records). [2025-10-21T21:09:38.546029] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-10-21T21:09:38.546715] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T21:09:38.546804] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:09:38.546847] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:09:38.546919] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-10-21T21:09:38.546982] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-10-21T21:09:38.547017] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-10-21T21:09:38.547056] [DEBUG] [LOCAL ] SMR: No derivative data file found to delete. [2025-10-21T21:09:38.547110] [INFO ] [MAIN ] Update Progress: 1942/2366 symbols completed. SMR took 38.2s. Estimated remaining: 54m 29s. Rate: 7.8 symbols/min [2025-10-21T21:09:38.557301] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-10-21T21:09:38.719444] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:09:38.719678] [DEBUG] [LOCAL ] SNAP: No existing data file found in primary storage. [2025-10-21T21:09:38.719732] [WARN ] [MAIN ] SNAP: No existing data found, performing full refresh instead. [2025-10-21T21:09:38.719849] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-10-21T21:09:38.719912] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-10-21T21:09:38.719953] [DEBUG] [LOCAL ] SNAP: No primary data file found to delete. [2025-10-21T21:09:38.719984] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-10-21T21:09:39.063884] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:09:39.351027] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-10-21T21:09:40.151035] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-10-21T21:09:40.345006] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:09:40.951044] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-10-21T21:09:41.751057] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-10-21T21:09:41.814797] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-21T21:09:41.962639] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T21:09:42.328251] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-21T21:09:42.551029] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-10-21T21:09:42.923963] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T21:09:43.351064] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-10-21T21:09:44.150993] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-10-21T21:09:44.510025] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T21:09:44.726264] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T21:09:44.951048] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-10-21T21:09:45.631615] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T21:09:45.751025] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-10-21T21:09:46.551079] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-10-21T21:09:47.240319] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T21:09:47.350982] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-10-21T21:09:47.946880] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (3.00 seconds). [2025-10-21T21:09:48.151080] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-10-21T21:09:48.436465] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T21:09:48.668516] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T21:09:48.951056] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-10. [2025-10-21T21:09:49.200453] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T21:09:49.751051] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-10-21T21:09:50.016150] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T21:09:50.020477] [INFO ] [REMOTE ] SMWB: Full fetch complete (48828 records). [2025-10-21T21:09:50.020594] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-10-21T21:09:50.393365] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-10-21T21:09:50.393436] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-10-21T21:09:50.394365] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-10-21T21:09:50.394460] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-10-21T21:09:50.395495] [DEBUG] [LOCAL ] SMWB: Trimmed 48828 records to 31817 (keeping 200 days of data) [2025-10-21T21:09:50.554024] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-10-21T21:09:50.574072] [DEBUG] [LOCAL ] SMWB: Primary data saved (31817 records). [2025-10-21T21:09:50.574192] [INFO ] [MAIN ] SMWB: Full history saved. [2025-10-21T21:09:50.574783] [INFO ] [MAIN ] Update Progress: 1943/2366 symbols completed. SMWB took 32.1s. Estimated remaining: 54m 23s. Rate: 7.8 symbols/min [2025-10-21T21:09:50.751451] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:09:50.759088] [DEBUG] [LOCAL ] SNDA: Loaded 4488 existing records from primary storage. [2025-10-21T21:09:50.759294] [INFO ] [MAIN ] SNDA: Loaded 4488 existing records. [2025-10-21T21:09:50.936089] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:09:50.936315] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-10-21T21:09:50.936365] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-10-21T21:09:50.936570] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-10-21T21:09:50.936629] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-10-21T21:09:51.285565] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:09:51.351016] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-10-21T21:09:51.623961] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T21:09:52.151020] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-10-21T21:09:52.251191] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T21:09:52.741165] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-21T21:09:52.951033] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-10-21T21:09:53.345287] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T21:09:53.716189] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T21:09:53.751000] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-10-21T21:09:54.492246] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T21:09:54.551019] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-10-21T21:09:55.139876] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T21:09:55.351057] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-10-21T21:09:56.151001] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-10. [2025-10-21T21:09:56.951092] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-10-21T21:09:57.751054] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-10-21T21:09:57.981213] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-21T21:09:58.070942] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T21:09:58.079085] [INFO ] [REMOTE ] SN: Full fetch complete (71770 records). [2025-10-21T21:09:58.079264] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-10-21T21:09:58.443024] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (3.09 seconds). [2025-10-21T21:09:58.510371] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-10-21T21:09:58.510463] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-10-21T21:09:58.511706] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-10-21T21:09:58.511769] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-10-21T21:09:58.513074] [DEBUG] [LOCAL ] SN: Trimmed 71770 records to 49991 (keeping 200 days of data) [2025-10-21T21:09:58.561763] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-10. [2025-10-21T21:09:58.637833] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T21:09:58.812075] [DEBUG] [LOCAL ] SN: Primary data saved (49991 records). [2025-10-21T21:09:58.812213] [INFO ] [MAIN ] SN: Full history saved. [2025-10-21T21:09:58.812298] [INFO ] [MAIN ] Update Progress: 1944/2366 symbols completed. SN took 36.4s. Estimated remaining: 54m 15s. Rate: 7.8 symbols/min [2025-10-21T21:09:58.980766] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:09:58.980945] [DEBUG] [LOCAL ] SNDR: No existing data file found in primary storage. [2025-10-21T21:09:58.980998] [WARN ] [MAIN ] SNDR: No existing data found, performing full refresh instead. [2025-10-21T21:09:58.981102] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-10-21T21:09:58.981144] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-10-21T21:09:58.981185] [DEBUG] [LOCAL ] SNDR: No primary data file found to delete. [2025-10-21T21:09:58.981215] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-10-21T21:09:59.326088] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:09:59.350981] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-10-21T21:09:59.868686] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T21:09:59.873295] [INFO ] [REMOTE ] SNA: Full fetch complete (39159 records). [2025-10-21T21:09:59.873379] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-10-21T21:10:00.157218] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-10-21T21:10:00.245685] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-10-21T21:10:00.245774] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-10-21T21:10:00.246548] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-10-21T21:10:00.246587] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-10-21T21:10:00.247522] [DEBUG] [LOCAL ] SNA: Trimmed 39159 records to 25833 (keeping 200 days of data) [2025-10-21T21:10:00.406849] [DEBUG] [LOCAL ] SNA: Primary data saved (25833 records). [2025-10-21T21:10:00.406993] [INFO ] [MAIN ] SNA: Full history saved. [2025-10-21T21:10:00.407069] [INFO ] [MAIN ] Update Progress: 1945/2366 symbols completed. SNA took 30.7s. Estimated remaining: 54m 6s. Rate: 7.8 symbols/min [2025-10-21T21:10:00.582891] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:00.625101] [DEBUG] [LOCAL ] SNN: Loaded 44407 existing records from primary storage. [2025-10-21T21:10:00.625400] [INFO ] [MAIN ] SNN: Loaded 44407 existing records. [2025-10-21T21:10:00.806146] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:10:00.806458] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-10-21T21:10:00.814094] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-10-21T21:10:00.827330] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-10-21T21:10:00.827787] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-10-21T21:10:00.828515] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T21:10:00.956247] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-10-21T21:10:01.201752] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:10:01.685037] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T21:10:01.751061] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-10-21T21:10:02.270054] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-21T21:10:02.551020] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-10-21T21:10:02.648791] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-21T21:10:03.351031] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-10-21T21:10:04.151081] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-10-21T21:10:04.367021] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T21:10:04.951059] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-10-21T21:10:05.751068] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-10-21T21:10:05.882855] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-21T21:10:05.918429] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-21T21:10:06.477372] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T21:10:06.519616] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T21:10:06.550992] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-10-21T21:10:07.351039] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-10-21T21:10:08.151043] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-10-21T21:10:08.369977] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T21:10:08.953630] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-10-21T21:10:08.956461] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T21:10:09.751038] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-10-21T21:10:10.551004] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-10-21T21:10:10.805227] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-21T21:10:10.886137] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T21:10:11.032543] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T21:10:11.350986] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-10. [2025-10-21T21:10:11.589514] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T21:10:12.114755] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T21:10:12.116142] [INFO ] [REMOTE ] SNDA: Full fetch complete (7554 records). [2025-10-21T21:10:12.116217] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-10-21T21:10:12.158726] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-10-21T21:10:12.519553] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-10-21T21:10:12.519670] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-10-21T21:10:12.519932] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-10-21T21:10:12.519975] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-10-21T21:10:12.520435] [DEBUG] [LOCAL ] SNDA: Trimmed 7554 records to 4499 (keeping 200 days of data) [2025-10-21T21:10:12.549419] [DEBUG] [LOCAL ] SNDA: Primary data saved (4499 records). [2025-10-21T21:10:12.549588] [INFO ] [MAIN ] SNDA: Full history saved. [2025-10-21T21:10:12.549770] [INFO ] [MAIN ] Update Progress: 1946/2366 symbols completed. SNDA took 22.0s. Estimated remaining: 53m 59s. Rate: 7.8 symbols/min [2025-10-21T21:10:12.769318] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:12.769530] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-10-21T21:10:12.769591] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-10-21T21:10:12.769777] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-10-21T21:10:12.769843] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-21T21:10:12.769913] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-21T21:10:12.769967] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-10-21T21:10:12.956228] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-10-21T21:10:13.323889] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:10:13.751058] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-10-21T21:10:13.868407] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T21:10:14.551040] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-10-21T21:10:15.351017] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-10-21T21:10:15.621200] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T21:10:15.765076] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-10-21T21:10:15.801494] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-21T21:10:16.151032] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-10-21T21:10:16.951078] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-10-21T21:10:17.751014] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-10-21T21:10:17.924437] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-21T21:10:18.160135] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-21T21:10:18.551017] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-10-21T21:10:19.351030] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-10-21T21:10:19.603513] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-21T21:10:19.924455] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-21T21:10:20.151028] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-10. [2025-10-21T21:10:20.495741] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T21:10:20.951019] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-10-21T21:10:21.735724] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-21T21:10:21.750973] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-10-21T21:10:22.550991] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-10-21T21:10:22.578082] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T21:10:22.872976] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-10 (2.72 seconds). [2025-10-21T21:10:22.881569] [INFO ] [REMOTE ] SNAP: Full fetch complete (77975 records). [2025-10-21T21:10:22.881760] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-10-21T21:10:23.279196] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-10-21T21:10:23.279282] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-10-21T21:10:23.280750] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-10-21T21:10:23.280818] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-10-21T21:10:23.282292] [DEBUG] [LOCAL ] SNAP: Trimmed 77975 records to 53796 (keeping 200 days of data) [2025-10-21T21:10:23.370003] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-10-21T21:10:23.604038] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-10-21T21:10:23.604211] [INFO ] [MAIN ] SNAP: Full history saved. [2025-10-21T21:10:23.604303] [INFO ] [MAIN ] Update Progress: 1947/2366 symbols completed. SNAP took 45.1s. Estimated remaining: 53m 52s. Rate: 7.8 symbols/min [2025-10-21T21:10:23.780035] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:23.780209] [DEBUG] [LOCAL ] SNV: No existing data file found in primary storage. [2025-10-21T21:10:23.780245] [WARN ] [MAIN ] SNV: No existing data found, performing full refresh instead. [2025-10-21T21:10:23.780440] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-10-21T21:10:23.780496] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-10-21T21:10:23.780538] [DEBUG] [LOCAL ] SNV: No primary data file found to delete. [2025-10-21T21:10:23.780569] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-10-21T21:10:24.168676] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:10:24.169375] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-10-21T21:10:24.205409] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-21T21:10:24.246369] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T21:10:24.951062] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-10-21T21:10:25.256681] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T21:10:25.751052] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-10. [2025-10-21T21:10:26.061174] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T21:10:26.551043] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-10-21T21:10:26.622555] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T21:10:27.117680] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T21:10:27.125023] [INFO ] [REMOTE ] SNN: Full fetch complete (63132 records). [2025-10-21T21:10:27.125195] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-10-21T21:10:27.356377] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-10-21T21:10:27.527738] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-10-21T21:10:27.527824] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-10-21T21:10:27.528932] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-10-21T21:10:27.528999] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-10-21T21:10:27.530347] [DEBUG] [LOCAL ] SNN: Trimmed 63132 records to 44384 (keeping 200 days of data) [2025-10-21T21:10:27.798233] [DEBUG] [LOCAL ] SNN: Primary data saved (44384 records). [2025-10-21T21:10:27.798358] [INFO ] [MAIN ] SNN: Full history saved. [2025-10-21T21:10:27.799347] [INFO ] [MAIN ] Update Progress: 1948/2366 symbols completed. SNN took 27.4s. Estimated remaining: 53m 44s. Rate: 7.8 symbols/min [2025-10-21T21:10:27.967347] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:27.967669] [DEBUG] [LOCAL ] SNX: No existing data file found in primary storage. [2025-10-21T21:10:27.967754] [WARN ] [MAIN ] SNX: No existing data found, performing full refresh instead. [2025-10-21T21:10:27.967930] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-10-21T21:10:27.967972] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-10-21T21:10:27.968012] [DEBUG] [LOCAL ] SNX: No primary data file found to delete. [2025-10-21T21:10:27.968045] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-10-21T21:10:28.161576] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-10. [2025-10-21T21:10:28.350752] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:10:28.381848] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T21:10:28.951084] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-10-21T21:10:29.751102] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-10-21T21:10:29.944141] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T21:10:29.951502] [INFO ] [REMOTE ] SNDR: Full fetch complete (60208 records). [2025-10-21T21:10:29.951627] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-10-21T21:10:30.341208] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-10-21T21:10:30.341382] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-10-21T21:10:30.342486] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-10-21T21:10:30.342567] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-10-21T21:10:30.354132] [DEBUG] [LOCAL ] SNDR: Trimmed 60208 records to 41593 (keeping 200 days of data) [2025-10-21T21:10:30.374052] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-10-21T21:10:30.558369] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-10-21T21:10:30.643290] [DEBUG] [LOCAL ] SNDR: Primary data saved (41593 records). [2025-10-21T21:10:30.643453] [INFO ] [MAIN ] SNDR: Full history saved. [2025-10-21T21:10:30.643537] [INFO ] [MAIN ] Update Progress: 1949/2366 symbols completed. SNDR took 31.8s. Estimated remaining: 53m 35s. Rate: 7.8 symbols/min [2025-10-21T21:10:30.817851] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:30.818104] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-10-21T21:10:30.818170] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-10-21T21:10:30.818314] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-10-21T21:10:30.818494] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-10-21T21:10:30.818606] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-10-21T21:10:30.818771] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-10-21T21:10:31.047426] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-21T21:10:31.221897] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:10:31.246119] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T21:10:31.350997] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-10-21T21:10:32.151042] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-10-21T21:10:32.951002] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-10-21T21:10:33.119667] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-10-21T21:10:33.229330] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T21:10:33.750998] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-10-21T21:10:33.833111] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T21:10:34.551016] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-10-21T21:10:34.784618] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T21:10:35.351038] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-10-21T21:10:36.084876] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-21T21:10:36.151074] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-10-21T21:10:36.455072] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T21:10:36.951041] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-10-21T21:10:37.053430] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T21:10:37.751059] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-10-21T21:10:38.551032] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-10-21T21:10:38.681119] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-21T21:10:38.764495] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T21:10:39.351038] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-10-21T21:10:39.572636] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T21:10:40.151094] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-10-21T21:10:40.439468] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T21:10:40.951068] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-10-21T21:10:41.374756] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T21:10:41.699266] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T21:10:41.750998] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-10-21T21:10:42.551105] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-10-21T21:10:42.970257] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T21:10:43.351061] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-10-21T21:10:43.377565] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T21:10:44.110564] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T21:10:44.151019] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-10-21T21:10:44.936420] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T21:10:44.950982] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-10-21T21:10:45.751041] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-10-21T21:10:46.085387] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T21:10:46.551053] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-10-21T21:10:46.842750] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T21:10:47.351067] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-10-21T21:10:48.151098] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-10. [2025-10-21T21:10:48.331528] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-21T21:10:48.489502] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T21:10:48.951003] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-10-21T21:10:49.042267] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T21:10:49.750998] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-10-21T21:10:50.019805] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T21:10:50.030856] [INFO ] [REMOTE ] SNV: Full fetch complete (71802 records). [2025-10-21T21:10:50.031028] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-10-21T21:10:50.441114] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-10-21T21:10:50.441194] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-10-21T21:10:50.442258] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-10-21T21:10:50.442320] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-10-21T21:10:50.443568] [DEBUG] [LOCAL ] SNV: Trimmed 71802 records to 49068 (keeping 200 days of data) [2025-10-21T21:10:50.551081] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-10-21T21:10:50.735222] [DEBUG] [LOCAL ] SNV: Primary data saved (49068 records). [2025-10-21T21:10:50.735348] [INFO ] [MAIN ] SNV: Full history saved. [2025-10-21T21:10:50.735417] [INFO ] [MAIN ] Update Progress: 1950/2366 symbols completed. SNV took 27.1s. Estimated remaining: 53m 30s. Rate: 7.8 symbols/min [2025-10-21T21:10:50.906497] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:50.942838] [DEBUG] [LOCAL ] SOBO: Loaded 39419 existing records from primary storage. [2025-10-21T21:10:50.943119] [INFO ] [MAIN ] SOBO: Loaded 39419 existing records. [2025-10-21T21:10:51.126502] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:10:51.126839] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-10-21T21:10:51.126958] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-10-21T21:10:51.127296] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-10-21T21:10:51.127354] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-10-21T21:10:51.496017] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:10:51.496526] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-10-21T21:10:51.551075] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-10-21T21:10:51.563619] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T21:10:52.151000] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-10-21T21:10:52.659481] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-21T21:10:52.951000] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-10-21T21:10:53.182290] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T21:10:53.719289] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T21:10:53.750988] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-10-21T21:10:53.929233] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-21T21:10:54.551019] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-10. [2025-10-21T21:10:55.136534] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T21:10:55.351001] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-10. [2025-10-21T21:10:56.151005] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-10. [2025-10-21T21:10:56.267062] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T21:10:56.275407] [INFO ] [REMOTE ] SNOW: Full fetch complete (77335 records). [2025-10-21T21:10:56.275597] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-10-21T21:10:56.276496] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T21:10:56.276600] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:10:56.276687] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:10:56.276796] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-10-21T21:10:56.276864] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-10-21T21:10:56.276900] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-10-21T21:10:56.276938] [DEBUG] [LOCAL ] SNOW: No derivative data file found to delete. [2025-10-21T21:10:56.276997] [INFO ] [MAIN ] Update Progress: 1951/2366 symbols completed. SNOW took 43.7s. Estimated remaining: 53m 22s. Rate: 7.8 symbols/min [2025-10-21T21:10:56.456088] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:56.505266] [DEBUG] [LOCAL ] SOC: Loaded 51208 existing records from primary storage. [2025-10-21T21:10:56.505737] [INFO ] [MAIN ] SOC: Loaded 51208 existing records. [2025-10-21T21:10:56.652917] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-21T21:10:56.705681] [INFO ] [REMOTE ] SO: Full fetch complete (77773 records). [2025-10-21T21:10:56.714809] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-10-21T21:10:56.735234] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:10:56.800535] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-10-21T21:10:56.811719] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-10-21T21:10:56.835231] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-10-21T21:10:56.837419] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-10-21T21:10:56.965332] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-10-21T21:10:57.466732] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-10-21T21:10:57.468498] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-10-21T21:10:57.485335] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-10-21T21:10:57.492220] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:10:57.492588] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-10-21T21:10:57.493895] [DEBUG] [LOCAL ] SO: Trimmed 77773 records to 53615 (keeping 200 days of data) [2025-10-21T21:10:57.730237] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T21:10:57.751704] [INFO ] [REMOTE ] SNX: Full fetch complete (57323 records). [2025-10-21T21:10:57.756145] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-10-21T21:10:57.760810] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-10-21T21:10:58.067616] [DEBUG] [LOCAL ] SO: Primary data saved (53615 records). [2025-10-21T21:10:58.133948] [INFO ] [MAIN ] SO: Full history saved. [2025-10-21T21:10:58.146190] [INFO ] [MAIN ] Update Progress: 1952/2366 symbols completed. SO took 27.5s. Estimated remaining: 53m 13s. Rate: 7.8 symbols/min [2025-10-21T21:10:58.437987] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:58.441368] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-10-21T21:10:58.441515] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-10-21T21:10:58.443026] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-10-21T21:10:58.443192] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-10-21T21:10:58.450421] [DEBUG] [LOCAL ] SOJC: Loaded 4689 existing records from primary storage. [2025-10-21T21:10:58.450553] [DEBUG] [LOCAL ] SNX: Trimmed 57323 records to 38922 (keeping 200 days of data) [2025-10-21T21:10:58.450916] [INFO ] [MAIN ] SOJC: Loaded 4689 existing records. [2025-10-21T21:10:58.735265] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:10:58.735557] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-10-21T21:10:58.737269] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-10-21T21:10:58.741802] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-10-21T21:10:58.742461] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-10-21T21:10:58.951939] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-21T21:10:59.042968] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-10-21T21:10:59.310879] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:10:59.314721] [DEBUG] [LOCAL ] SNX: Primary data saved (38922 records). [2025-10-21T21:10:59.315127] [INFO ] [MAIN ] SNX: Full history saved. [2025-10-21T21:10:59.315201] [INFO ] [MAIN ] Update Progress: 1953/2366 symbols completed. SNX took 31.5s. Estimated remaining: 53m 4s. Rate: 7.8 symbols/min [2025-10-21T21:10:59.358707] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-10-21T21:10:59.489541] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:10:59.504736] [DEBUG] [LOCAL ] SOJD: Loaded 12905 existing records from primary storage. [2025-10-21T21:10:59.505016] [INFO ] [MAIN ] SOJD: Loaded 12905 existing records. [2025-10-21T21:10:59.684251] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:10:59.684518] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-10-21T21:10:59.684567] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-10-21T21:10:59.684760] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-10-21T21:10:59.684816] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-10-21T21:11:00.048389] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:11:00.074032] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-21T21:11:00.151026] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-10-21T21:11:00.220177] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T21:11:00.951007] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-10-21T21:11:01.143202] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T21:11:01.174743] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-21T21:11:01.751032] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-10-21T21:11:02.551024] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-10-21T21:11:02.583274] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T21:11:03.254870] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T21:11:03.351079] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-10-21T21:11:03.447293] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T21:11:04.151049] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-10-21T21:11:04.183321] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T21:11:04.950995] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-10-21T21:11:05.116821] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T21:11:05.561631] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T21:11:05.751002] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-10-21T21:11:06.511699] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T21:11:06.551040] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-10-21T21:11:07.351045] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-10-21T21:11:07.752630] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T21:11:08.151033] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-10-21T21:11:08.951019] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-10-21T21:11:09.067702] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T21:11:09.731811] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T21:11:09.757106] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-10-21T21:11:09.762207] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T21:11:10.544049] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T21:11:10.550969] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-10-21T21:11:11.213284] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T21:11:11.351032] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-10-21T21:11:12.151080] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-10-21T21:11:12.338216] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T21:11:12.951031] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-10-21T21:11:13.751078] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-10-21T21:11:13.982636] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T21:11:14.047267] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T21:11:14.551069] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-10-21T21:11:15.351033] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-10-21T21:11:15.383710] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T21:11:16.151053] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-10-21T21:11:16.212299] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T21:11:16.392042] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T21:11:16.886083] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T21:11:16.951031] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-10-21T21:11:17.751010] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-10-21T21:11:18.534190] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T21:11:18.535530] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T21:11:18.550978] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-10-21T21:11:19.351028] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-10-21T21:11:20.150999] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-10-21T21:11:20.176435] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T21:11:20.364522] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T21:11:20.951033] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-10-21T21:11:21.751021] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-10. [2025-10-21T21:11:22.055269] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-21T21:11:22.372392] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T21:11:22.373474] [INFO ] [REMOTE ] SOJC: Full fetch complete (7238 records). [2025-10-21T21:11:22.373539] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-10-21T21:11:22.555071] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-10-21T21:11:22.818472] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-21T21:11:22.859213] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-10-21T21:11:22.859338] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-10-21T21:11:22.859596] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-10-21T21:11:22.860036] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-10-21T21:11:22.860477] [DEBUG] [LOCAL ] SOJC: Trimmed 7238 records to 4657 (keeping 200 days of data) [2025-10-21T21:11:22.888276] [DEBUG] [LOCAL ] SOJC: Primary data saved (4657 records). [2025-10-21T21:11:22.888354] [INFO ] [MAIN ] SOJC: Full history saved. [2025-10-21T21:11:22.888428] [INFO ] [MAIN ] Update Progress: 1954/2366 symbols completed. SOJC took 24.7s. Estimated remaining: 52m 59s. Rate: 7.8 symbols/min [2025-10-21T21:11:23.059772] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:11:23.070264] [DEBUG] [LOCAL ] SOJE: Loaded 8803 existing records from primary storage. [2025-10-21T21:11:23.070449] [INFO ] [MAIN ] SOJE: Loaded 8803 existing records. [2025-10-21T21:11:23.248186] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:11:23.248427] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-10-21T21:11:23.248475] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-10-21T21:11:23.248621] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-10-21T21:11:23.248695] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-10-21T21:11:23.354710] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-10-21T21:11:23.647619] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:11:24.151091] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-10-21T21:11:24.293463] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T21:11:24.553307] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-21T21:11:24.951000] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-10-21T21:11:25.062708] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T21:11:25.751073] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-10. [2025-10-21T21:11:26.551004] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-10. [2025-10-21T21:11:26.638452] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T21:11:26.640785] [INFO ] [REMOTE ] SOJD: Full fetch complete (19075 records). [2025-10-21T21:11:26.640858] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-10-21T21:11:27.015706] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-10-21T21:11:27.015824] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-10-21T21:11:27.016251] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-10-21T21:11:27.016324] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-10-21T21:11:27.030795] [DEBUG] [LOCAL ] SOJD: Trimmed 19075 records to 12668 (keeping 200 days of data) [2025-10-21T21:11:27.059575] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-21T21:11:27.145978] [DEBUG] [LOCAL ] SOJD: Primary data saved (12668 records). [2025-10-21T21:11:27.146112] [INFO ] [MAIN ] SOJD: Full history saved. [2025-10-21T21:11:27.146190] [INFO ] [MAIN ] Update Progress: 1955/2366 symbols completed. SOJD took 27.8s. Estimated remaining: 52m 51s. Rate: 7.8 symbols/min [2025-10-21T21:11:27.316560] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:11:27.316806] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-10-21T21:11:27.316854] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-10-21T21:11:27.317000] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-10-21T21:11:27.317065] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-21T21:11:27.317114] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-21T21:11:27.317146] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-10-21T21:11:27.358815] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-10-21T21:11:27.670060] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:11:28.151073] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-10-21T21:11:28.292043] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T21:11:28.298421] [INFO ] [REMOTE ] SOBO: Full fetch complete (58534 records). [2025-10-21T21:11:28.298520] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-10-21T21:11:28.685200] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-10-21T21:11:28.685293] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-10-21T21:11:28.686248] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-10-21T21:11:28.686310] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-10-21T21:11:28.687476] [DEBUG] [LOCAL ] SOBO: Trimmed 58534 records to 39418 (keeping 200 days of data) [2025-10-21T21:11:28.918906] [DEBUG] [LOCAL ] SOBO: Primary data saved (39418 records). [2025-10-21T21:11:28.919031] [INFO ] [MAIN ] SOBO: Full history saved. [2025-10-21T21:11:28.919105] [INFO ] [MAIN ] Update Progress: 1956/2366 symbols completed. SOBO took 38.2s. Estimated remaining: 52m 42s. Rate: 7.8 symbols/min [2025-10-21T21:11:28.962288] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-10-21T21:11:29.091944] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:11:29.104677] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T21:11:29.120872] [DEBUG] [LOCAL ] SOL: Loaded 13587 existing records from primary storage. [2025-10-21T21:11:29.121093] [INFO ] [MAIN ] SOL: Loaded 13587 existing records. [2025-10-21T21:11:29.306987] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:11:29.308056] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-10-21T21:11:29.308118] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-10-21T21:11:29.308803] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-10-21T21:11:29.308860] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-10-21T21:11:29.668505] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:11:29.697058] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-21T21:11:29.751007] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-10-21T21:11:30.022399] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T21:11:30.512557] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T21:11:30.551006] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-10-21T21:11:31.351026] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-10. [2025-10-21T21:11:31.434379] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T21:11:32.151068] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-10-21T21:11:32.951000] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-10-21T21:11:33.386258] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T21:11:33.427547] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-21T21:11:33.435718] [INFO ] [REMOTE ] SOC: Full fetch complete (72173 records). [2025-10-21T21:11:33.435843] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-10-21T21:11:33.756243] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-10-21T21:11:33.831199] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-10-21T21:11:33.831288] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-10-21T21:11:33.832442] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-10-21T21:11:33.832505] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-10-21T21:11:33.833901] [DEBUG] [LOCAL ] SOC: Trimmed 72173 records to 51226 (keeping 200 days of data) [2025-10-21T21:11:34.076243] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T21:11:34.148377] [DEBUG] [LOCAL ] SOC: Primary data saved (51226 records). [2025-10-21T21:11:34.148524] [INFO ] [MAIN ] SOC: Full history saved. [2025-10-21T21:11:34.148980] [INFO ] [MAIN ] Update Progress: 1957/2366 symbols completed. SOC took 37.9s. Estimated remaining: 52m 34s. Rate: 7.8 symbols/min [2025-10-21T21:11:34.544718] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T21:11:34.550994] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-10-21T21:11:35.351112] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-10-21T21:11:35.367399] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T21:11:36.151020] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-10-21T21:11:36.455872] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T21:11:36.951067] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-10-21T21:11:37.004831] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T21:11:37.751050] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-10-21T21:11:38.089554] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T21:11:38.551073] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-10-21T21:11:38.683817] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T21:11:39.247367] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-21T21:11:39.351017] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-10-21T21:11:40.150991] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-10-21T21:11:40.233305] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T21:11:40.951050] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-10-21T21:11:41.008400] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T21:11:41.751066] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-10-21T21:11:41.877633] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T21:11:42.551083] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-10-21T21:11:42.592160] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T21:11:43.351012] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-10-21T21:11:43.513698] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T21:11:44.151051] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-10-21T21:11:44.534515] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T21:11:44.950995] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-10-21T21:11:45.035944] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-21T21:11:45.751085] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-10-21T21:11:46.044094] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T21:11:46.551042] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-10-21T21:11:46.596392] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T21:11:47.304260] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T21:11:47.351055] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-10-21T21:11:48.151031] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-10-21T21:11:48.191578] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T21:11:48.951055] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-10. [2025-10-21T21:11:49.050625] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T21:11:49.508327] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T21:11:49.510116] [INFO ] [REMOTE ] SOJF: Full fetch complete (14090 records). [2025-10-21T21:11:49.510192] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-10-21T21:11:49.696238] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-10-21T21:11:49.696516] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:11:49.696584] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:11:49.696671] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-10-21T21:11:49.696746] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-10-21T21:11:49.696789] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-10-21T21:11:49.696826] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-10-21T21:11:49.696877] [INFO ] [MAIN ] Update Progress: 1958/2366 symbols completed. SOJF took 22.6s. Estimated remaining: 52m 28s. Rate: 7.8 symbols/min [2025-10-21T21:11:49.751022] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-10. [2025-10-21T21:11:50.551025] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-10-21T21:11:50.959899] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T21:11:50.963235] [INFO ] [REMOTE ] SOL: Full fetch complete (21225 records). [2025-10-21T21:11:50.963312] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-10-21T21:11:51.328885] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-10-21T21:11:51.328967] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-10-21T21:11:51.329409] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-10-21T21:11:51.329446] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-10-21T21:11:51.330018] [DEBUG] [LOCAL ] SOL: Trimmed 21225 records to 13572 (keeping 200 days of data) [2025-10-21T21:11:51.404677] [DEBUG] [LOCAL ] SOL: Primary data saved (13572 records). [2025-10-21T21:11:51.404823] [INFO ] [MAIN ] SOL: Full history saved. [2025-10-21T21:11:51.404938] [INFO ] [MAIN ] Update Progress: 1959/2366 symbols completed. SOL took 22.5s. Estimated remaining: 52m 19s. Rate: 7.8 symbols/min [2025-10-21T21:11:51.412378] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T21:11:51.415017] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-10. [2025-10-21T21:11:52.212069] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-21T21:11:52.213726] [INFO ] [REMOTE ] SOJE: Full fetch complete (13446 records). [2025-10-21T21:11:52.213794] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-10-21T21:11:52.575220] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-10-21T21:11:52.575306] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-10-21T21:11:52.575624] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-10-21T21:11:52.575695] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-10-21T21:11:52.576173] [DEBUG] [LOCAL ] SOJE: Trimmed 13446 records to 8777 (keeping 200 days of data) [2025-10-21T21:11:52.627516] [DEBUG] [LOCAL ] SOJE: Primary data saved (8777 records). [2025-10-21T21:11:52.627638] [INFO ] [MAIN ] SOJE: Full history saved. [2025-10-21T21:11:52.627754] [INFO ] [MAIN ] Update Progress: 1960/2366 symbols completed. SOJE took 29.7s. Estimated remaining: 52m 10s. Rate: 7.8 symbols/min [2025-10-21T21:11:53.266166] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:11:53.265381] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:11:53.294367] [DEBUG] [LOCAL ] SOLV: No existing data file found in primary storage. [2025-10-21T21:11:53.295532] [WARN ] [MAIN ] SOLV: No existing data found, performing full refresh instead. [2025-10-21T21:11:53.295452] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:11:53.295873] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-10-21T21:11:53.296005] [DEBUG] [LOCAL ] SON: No existing data file found in primary storage. [2025-10-21T21:11:53.301580] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-10-21T21:11:53.321700] [DEBUG] [LOCAL ] SOLV: No primary data file found to delete. [2025-10-21T21:11:53.296237] [WARN ] [MAIN ] SON: No existing data found, performing full refresh instead. [2025-10-21T21:11:53.344208] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-10-21T21:11:53.346518] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-10-21T21:11:53.352675] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:11:53.358221] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-10-21T21:11:53.376256] [DEBUG] [LOCAL ] SON: No primary data file found to delete. [2025-10-21T21:11:53.381951] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-10-21T21:11:53.596708] [DEBUG] [LOCAL ] SOR: Loaded 2827 existing records from primary storage. [2025-10-21T21:11:53.610958] [INFO ] [MAIN ] SOR: Loaded 2827 existing records. [2025-10-21T21:11:53.884434] [DEBUG] [LOCAL ] SONY: Loaded 53379 existing records from primary storage. [2025-10-21T21:11:53.916272] [INFO ] [MAIN ] SONY: Loaded 53379 existing records. [2025-10-21T21:11:54.390781] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:11:54.467820] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:11:54.470021] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-10-21T21:11:54.473882] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:11:54.475908] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-10-21T21:11:54.475545] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-10-21T21:11:54.498470] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-10-21T21:11:54.501381] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:11:54.501741] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-10-21T21:11:54.501813] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-10-21T21:11:54.501945] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-10-21T21:11:54.502032] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-10-21T21:11:54.507518] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-10-21T21:11:54.534527] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-10-21T21:11:55.247029] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:11:55.269985] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:11:55.270509] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-10-21T21:11:55.271030] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-10-21T21:11:56.207824] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T21:11:56.209389] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-10-21T21:11:56.235727] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T21:11:56.244935] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-10-21T21:11:56.291565] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T21:11:56.865885] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T21:11:56.951047] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-10-21T21:11:57.424500] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-21T21:11:57.592762] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T21:11:57.646296] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T21:11:57.751056] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-10-21T21:11:58.551079] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-10-21T21:11:59.351101] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-10-21T21:11:59.655560] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T21:12:00.063266] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-21T21:12:00.150986] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-10-21T21:12:00.888459] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-21T21:12:00.950987] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-10-21T21:12:01.645826] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T21:12:01.751099] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-10-21T21:12:01.784366] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T21:12:02.551073] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-10-21T21:12:03.350999] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-10-21T21:12:03.548978] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T21:12:04.150998] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-10-21T21:12:04.334028] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T21:12:04.642097] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-21T21:12:04.950991] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-10-21T21:12:05.523912] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-21T21:12:05.621782] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T21:12:05.751052] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-10-21T21:12:06.551015] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-10-21T21:12:07.351045] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-10-21T21:12:07.474454] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T21:12:08.151077] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-10-21T21:12:08.319120] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T21:12:08.951004] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-10-21T21:12:09.579706] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T21:12:09.582949] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-21T21:12:09.751074] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-10-21T21:12:09.868208] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T21:12:10.481582] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T21:12:10.551041] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-10-21T21:12:11.351019] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-10-21T21:12:12.151060] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-10. [2025-10-21T21:12:12.417285] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T21:12:12.909556] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T21:12:12.910542] [INFO ] [REMOTE ] SOR: Full fetch complete (4364 records). [2025-10-21T21:12:12.910610] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-10-21T21:12:12.956171] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-10-21T21:12:13.333296] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-10-21T21:12:13.333494] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-10-21T21:12:13.333761] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-10-21T21:12:13.333865] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-10-21T21:12:13.334934] [DEBUG] [LOCAL ] SOR: Trimmed 4364 records to 2835 (keeping 200 days of data) [2025-10-21T21:12:13.352633] [DEBUG] [LOCAL ] SOR: Primary data saved (2835 records). [2025-10-21T21:12:13.352752] [INFO ] [MAIN ] SOR: Full history saved. [2025-10-21T21:12:13.352831] [INFO ] [MAIN ] Update Progress: 1961/2366 symbols completed. SOR took 20.6s. Estimated remaining: 52m 5s. Rate: 7.8 symbols/min [2025-10-21T21:12:13.524772] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:12:13.565916] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-21T21:12:13.583686] [DEBUG] [LOCAL ] SOS: Loaded 9555 existing records from primary storage. [2025-10-21T21:12:13.584519] [INFO ] [MAIN ] SOS: Loaded 9555 existing records. [2025-10-21T21:12:13.756187] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-10-21T21:12:13.760848] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:12:13.762081] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-10-21T21:12:13.762163] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-10-21T21:12:13.762354] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-10-21T21:12:13.762410] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-10-21T21:12:14.133291] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:12:14.434551] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-21T21:12:14.550992] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-10-21T21:12:15.351062] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-10-21T21:12:15.619043] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T21:12:15.845205] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T21:12:16.151060] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-10-21T21:12:16.951053] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-10-21T21:12:17.037757] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T21:12:17.751054] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-10-21T21:12:18.365107] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-21T21:12:18.550999] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-10-21T21:12:18.677703] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T21:12:19.242407] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T21:12:19.350988] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-10-21T21:12:20.151028] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-10. [2025-10-21T21:12:20.683027] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-21T21:12:20.756833] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T21:12:20.951079] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-10-21T21:12:21.475873] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-21T21:12:21.483368] [INFO ] [REMOTE ] SOLV: Full fetch complete (63407 records). [2025-10-21T21:12:21.483531] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-10-21T21:12:21.758321] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-10-21T21:12:21.896349] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-10-21T21:12:21.896457] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-10-21T21:12:21.898005] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-10-21T21:12:21.898088] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-10-21T21:12:21.899444] [DEBUG] [LOCAL ] SOLV: Trimmed 63407 records to 43445 (keeping 200 days of data) [2025-10-21T21:12:22.167485] [DEBUG] [LOCAL ] SOLV: Primary data saved (43445 records). [2025-10-21T21:12:22.167688] [INFO ] [MAIN ] SOLV: Full history saved. [2025-10-21T21:12:22.167820] [INFO ] [MAIN ] Update Progress: 1962/2366 symbols completed. SOLV took 29.5s. Estimated remaining: 51m 57s. Rate: 7.8 symbols/min [2025-10-21T21:12:22.354228] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:12:22.388588] [DEBUG] [LOCAL ] SPB: Loaded 34136 existing records from primary storage. [2025-10-21T21:12:22.388884] [INFO ] [MAIN ] SPB: Loaded 34136 existing records. [2025-10-21T21:12:22.566480] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-10-21T21:12:22.591229] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:12:22.591706] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-10-21T21:12:22.591772] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-10-21T21:12:22.592016] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-10-21T21:12:22.592086] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-10-21T21:12:22.981215] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T21:12:23.029242] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:12:23.255090] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T21:12:23.351081] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-10-21T21:12:23.982121] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-21T21:12:24.080372] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T21:12:24.150995] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-10-21T21:12:24.748324] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T21:12:24.951040] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-10-21T21:12:25.562314] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-21T21:12:25.751047] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-10. [2025-10-21T21:12:26.551033] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-10. [2025-10-21T21:12:27.351102] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-10-21T21:12:27.396736] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T21:12:27.404116] [INFO ] [REMOTE ] SON: Full fetch complete (62957 records). [2025-10-21T21:12:27.404231] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-10-21T21:12:27.786723] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-10-21T21:12:27.786810] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-10-21T21:12:27.787903] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-10-21T21:12:27.787964] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-10-21T21:12:27.789193] [DEBUG] [LOCAL ] SON: Trimmed 62957 records to 43528 (keeping 200 days of data) [2025-10-21T21:12:28.059430] [DEBUG] [LOCAL ] SON: Primary data saved (43528 records). [2025-10-21T21:12:28.059591] [INFO ] [MAIN ] SON: Full history saved. [2025-10-21T21:12:28.059698] [INFO ] [MAIN ] Update Progress: 1963/2366 symbols completed. SON took 35.4s. Estimated remaining: 51m 49s. Rate: 7.8 symbols/min [2025-10-21T21:12:28.158171] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-10-21T21:12:28.173398] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T21:12:28.250149] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:12:28.296929] [DEBUG] [LOCAL ] SPCE: Loaded 50018 existing records from primary storage. [2025-10-21T21:12:28.297486] [INFO ] [MAIN ] SPCE: Loaded 50018 existing records. [2025-10-21T21:12:28.479913] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:12:28.500710] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-10-21T21:12:28.500860] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-10-21T21:12:28.501077] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-10-21T21:12:28.501513] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-10-21T21:12:28.507795] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T21:12:28.611164] [INFO ] [REMOTE ] SONY: Full fetch complete (77413 records). [2025-10-21T21:12:28.613846] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-10-21T21:12:28.960317] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-10-21T21:12:29.244330] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:12:29.301680] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-10-21T21:12:29.301773] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-10-21T21:12:29.302915] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-10-21T21:12:29.302979] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-10-21T21:12:29.304416] [DEBUG] [LOCAL ] SONY: Trimmed 77413 records to 53378 (keeping 200 days of data) [2025-10-21T21:12:29.628780] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T21:12:29.639260] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T21:12:29.650986] [DEBUG] [LOCAL ] SONY: Primary data saved (53378 records). [2025-10-21T21:12:29.651070] [INFO ] [MAIN ] SONY: Full history saved. [2025-10-21T21:12:29.651137] [INFO ] [MAIN ] Update Progress: 1964/2366 symbols completed. SONY took 37.0s. Estimated remaining: 51m 40s. Rate: 7.8 symbols/min [2025-10-21T21:12:29.752120] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-10-21T21:12:29.823800] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:12:29.832445] [DEBUG] [LOCAL ] SPE: Loaded 6265 existing records from primary storage. [2025-10-21T21:12:29.832672] [INFO ] [MAIN ] SPE: Loaded 6265 existing records. [2025-10-21T21:12:30.018849] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:12:30.019101] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-10-21T21:12:30.019215] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-10-21T21:12:30.019461] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-10-21T21:12:30.019533] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-10-21T21:12:30.389126] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:12:30.550992] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-10-21T21:12:31.210206] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T21:12:31.351012] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-10-21T21:12:31.400867] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T21:12:32.151026] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-10-21T21:12:32.951020] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-10-21T21:12:33.022038] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T21:12:33.355881] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T21:12:33.751029] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-10-21T21:12:34.017709] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T21:12:34.551022] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-10-21T21:12:34.971220] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T21:12:35.351004] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-10-21T21:12:35.475244] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T21:12:36.151056] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-10-21T21:12:36.951078] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-10-21T21:12:36.998481] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T21:12:37.409213] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T21:12:37.751078] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-10-21T21:12:38.308955] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T21:12:38.551097] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-10-21T21:12:38.976926] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T21:12:39.351046] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-10-21T21:12:40.107806] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T21:12:40.120306] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T21:12:40.150990] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-10-21T21:12:40.777204] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T21:12:40.951044] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-10-21T21:12:41.751031] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-10-21T21:12:42.551025] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-10-21T21:12:43.016571] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-21T21:12:43.322738] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T21:12:43.351036] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-10-21T21:12:43.396228] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-21T21:12:44.151040] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-10-21T21:12:44.916842] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T21:12:44.950995] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-10-21T21:12:45.440476] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T21:12:45.751043] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-10-21T21:12:46.368342] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T21:12:46.377916] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T21:12:46.551008] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-10. [2025-10-21T21:12:47.351054] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-10-21T21:12:47.363404] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T21:12:47.364808] [INFO ] [REMOTE ] SPE: Full fetch complete (9836 records). [2025-10-21T21:12:47.364874] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-10-21T21:12:47.718372] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-10-21T21:12:47.718483] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-10-21T21:12:47.718770] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-10-21T21:12:47.718840] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-10-21T21:12:47.719381] [DEBUG] [LOCAL ] SPE: Trimmed 9836 records to 6238 (keeping 200 days of data) [2025-10-21T21:12:47.757288] [DEBUG] [LOCAL ] SPE: Primary data saved (6238 records). [2025-10-21T21:12:47.757399] [INFO ] [MAIN ] SPE: Full history saved. [2025-10-21T21:12:47.757474] [INFO ] [MAIN ] Update Progress: 1965/2366 symbols completed. SPE took 18.1s. Estimated remaining: 51m 34s. Rate: 7.8 symbols/min [2025-10-21T21:12:47.927155] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:12:47.927316] [DEBUG] [LOCAL ] SPG: No existing data file found in primary storage. [2025-10-21T21:12:47.927353] [WARN ] [MAIN ] SPG: No existing data found, performing full refresh instead. [2025-10-21T21:12:47.927468] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-10-21T21:12:47.927532] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-10-21T21:12:47.927635] [DEBUG] [LOCAL ] SPG: No primary data file found to delete. [2025-10-21T21:12:47.927724] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-10-21T21:12:48.162942] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-10-21T21:12:48.285523] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:12:48.951086] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-10-21T21:12:49.646425] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-21T21:12:49.750996] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-10-21T21:12:49.815232] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T21:12:50.394076] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T21:12:50.551010] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-10-21T21:12:51.351014] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-10-21T21:12:51.785311] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T21:12:52.151087] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-10-21T21:12:52.384853] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T21:12:52.697292] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T21:12:52.951057] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-10-21T21:12:53.751095] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-10-21T21:12:54.423298] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-21T21:12:54.551015] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-10-21T21:12:55.035786] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-21T21:12:55.222125] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T21:12:55.351028] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-10. [2025-10-21T21:12:56.151068] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-10. [2025-10-21T21:12:56.745802] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-21T21:12:56.951052] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-10-21T21:12:56.965815] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T21:12:56.970603] [INFO ] [REMOTE ] SPB: Full fetch complete (47733 records). [2025-10-21T21:12:56.970736] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-10-21T21:12:57.338762] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T21:12:57.360242] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-10-21T21:12:57.360331] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-10-21T21:12:57.362576] [INFO ] [REMOTE ] SOS: Full fetch complete (11172 records). [2025-10-21T21:12:57.362404] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-10-21T21:12:57.362767] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-10-21T21:12:57.362857] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-10-21T21:12:57.468154] [DEBUG] [LOCAL ] SPB: Trimmed 47733 records to 34128 (keeping 200 days of data) [2025-10-21T21:12:57.765047] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-10-21T21:12:57.923861] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-10-21T21:12:57.924058] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-10-21T21:12:57.933865] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-10-21T21:12:57.954267] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-10-21T21:12:57.962957] [DEBUG] [LOCAL ] SOS: Trimmed 11172 records to 9535 (keeping 200 days of data) [2025-10-21T21:12:58.031069] [DEBUG] [LOCAL ] SOS: Primary data saved (9535 records). [2025-10-21T21:12:58.038952] [INFO ] [MAIN ] SOS: Full history saved. [2025-10-21T21:12:58.039085] [INFO ] [MAIN ] Update Progress: 1966/2366 symbols completed. SOS took 44.7s. Estimated remaining: 51m 27s. Rate: 7.8 symbols/min [2025-10-21T21:12:58.038829] [DEBUG] [LOCAL ] SPB: Primary data saved (34128 records). [2025-10-21T21:12:58.050754] [INFO ] [MAIN ] SPB: Full history saved. [2025-10-21T21:12:58.051230] [INFO ] [MAIN ] Update Progress: 1967/2366 symbols completed. SPB took 35.9s. Estimated remaining: 51m 18s. Rate: 7.8 symbols/min [2025-10-21T21:12:58.388955] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:12:58.408533] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:12:58.408629] [DEBUG] [LOCAL ] SPGI: No existing data file found in primary storage. [2025-10-21T21:12:58.408804] [WARN ] [MAIN ] SPGI: No existing data found, performing full refresh instead. [2025-10-21T21:12:58.409244] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-10-21T21:12:58.409286] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-10-21T21:12:58.409330] [DEBUG] [LOCAL ] SPGI: No primary data file found to delete. [2025-10-21T21:12:58.409361] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-10-21T21:12:58.609106] [DEBUG] [LOCAL ] SPH: Loaded 16660 existing records from primary storage. [2025-10-21T21:12:58.659755] [INFO ] [MAIN ] SPH: Loaded 16660 existing records. [2025-10-21T21:12:58.970252] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:12:59.004830] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:12:59.005837] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-10-21T21:12:59.006194] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-10-21T21:12:59.007228] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-10-21T21:12:59.007431] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-10-21T21:12:59.007488] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-10-21T21:12:59.419916] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:12:59.421972] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-10-21T21:12:59.425966] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-21T21:12:59.565714] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T21:13:00.151106] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-10-21T21:13:00.813373] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T21:13:00.951064] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-10-21T21:13:00.996104] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-21T21:13:01.753823] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-10. [2025-10-21T21:13:01.761799] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T21:13:01.931906] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T21:13:02.551048] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-10-21T21:13:02.717078] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T21:13:02.726269] [INFO ] [REMOTE ] SPCE: Full fetch complete (72648 records). [2025-10-21T21:13:02.726474] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-10-21T21:13:03.188611] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-10-21T21:13:03.188761] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-10-21T21:13:03.190585] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-10-21T21:13:03.190677] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-10-21T21:13:03.192604] [DEBUG] [LOCAL ] SPCE: Trimmed 72648 records to 50041 (keeping 200 days of data) [2025-10-21T21:13:03.363375] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-10-21T21:13:03.509597] [DEBUG] [LOCAL ] SPCE: Primary data saved (50041 records). [2025-10-21T21:13:03.509870] [INFO ] [MAIN ] SPCE: Full history saved. [2025-10-21T21:13:03.510862] [INFO ] [MAIN ] Update Progress: 1968/2366 symbols completed. SPCE took 35.5s. Estimated remaining: 51m 10s. Rate: 7.8 symbols/min [2025-10-21T21:13:03.697844] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:13:03.748328] [DEBUG] [LOCAL ] SPHR: Loaded 40682 existing records from primary storage. [2025-10-21T21:13:03.748883] [INFO ] [MAIN ] SPHR: Loaded 40682 existing records. [2025-10-21T21:13:03.938362] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:13:03.938581] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-10-21T21:13:03.938630] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-10-21T21:13:03.938862] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-10-21T21:13:03.938906] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-10-21T21:13:04.162330] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-10-21T21:13:04.297813] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:13:04.480072] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T21:13:04.951118] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-10-21T21:13:05.335585] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T21:13:05.581802] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-21T21:13:05.751086] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-10-21T21:13:06.436822] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T21:13:06.551042] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-10-21T21:13:07.351026] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-10-21T21:13:07.544633] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T21:13:08.123678] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T21:13:08.151038] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-10-21T21:13:08.872423] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T21:13:08.951071] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-10-21T21:13:09.751113] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-10-21T21:13:09.879888] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T21:13:10.551080] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-10-21T21:13:10.743276] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T21:13:10.907377] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T21:13:11.351127] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-10-21T21:13:12.151025] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-10-21T21:13:12.514390] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T21:13:12.951061] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-10-21T21:13:13.751043] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-10-21T21:13:13.850779] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T21:13:14.154488] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T21:13:14.551047] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-10-21T21:13:15.188823] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (4.64 seconds). [2025-10-21T21:13:15.351051] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-10-21T21:13:15.663018] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-21T21:13:16.151980] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-10-21T21:13:16.156004] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T21:13:16.951049] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-10-21T21:13:17.010035] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T21:13:17.236837] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T21:13:17.751044] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-10-21T21:13:18.069237] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T21:13:18.551015] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-10-21T21:13:19.290810] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T21:13:19.351144] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-10. [2025-10-21T21:13:19.680828] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T21:13:20.151078] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-10-21T21:13:20.951074] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-10-21T21:13:21.164563] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T21:13:21.173439] [INFO ] [REMOTE ] SPG: Full fetch complete (72058 records). [2025-10-21T21:13:21.173720] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-10-21T21:13:21.569542] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-10-21T21:13:21.569693] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-10-21T21:13:21.571574] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-10-21T21:13:21.571666] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-10-21T21:13:21.573595] [DEBUG] [LOCAL ] SPG: Trimmed 72058 records to 50015 (keeping 200 days of data) [2025-10-21T21:13:21.771869] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-10-21T21:13:21.925163] [DEBUG] [LOCAL ] SPG: Primary data saved (50015 records). [2025-10-21T21:13:21.925358] [INFO ] [MAIN ] SPG: Full history saved. [2025-10-21T21:13:21.925460] [INFO ] [MAIN ] Update Progress: 1969/2366 symbols completed. SPG took 34.2s. Estimated remaining: 51m 4s. Rate: 7.8 symbols/min [2025-10-21T21:13:22.111138] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:13:22.138613] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-21T21:13:22.187277] [DEBUG] [LOCAL ] SPIR: Loaded 37644 existing records from primary storage. [2025-10-21T21:13:22.187907] [INFO ] [MAIN ] SPIR: Loaded 37644 existing records. [2025-10-21T21:13:22.382022] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:13:22.382488] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-10-21T21:13:22.382551] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-10-21T21:13:22.382809] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-10-21T21:13:22.382868] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-10-21T21:13:22.558045] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-10-21T21:13:22.687616] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T21:13:22.804458] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:13:22.921495] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-21T21:13:23.351048] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-10. [2025-10-21T21:13:24.151002] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-10-21T21:13:24.421233] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T21:13:24.556606] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T21:13:24.559372] [INFO ] [REMOTE ] SPH: Full fetch complete (27773 records). [2025-10-21T21:13:24.559508] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-10-21T21:13:24.942344] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-10-21T21:13:24.942452] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-10-21T21:13:24.943160] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-10-21T21:13:24.943241] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-10-21T21:13:24.944298] [DEBUG] [LOCAL ] SPH: Trimmed 27773 records to 16617 (keeping 200 days of data) [2025-10-21T21:13:24.985529] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-10-21T21:13:25.046455] [DEBUG] [LOCAL ] SPH: Primary data saved (16617 records). [2025-10-21T21:13:25.046613] [INFO ] [MAIN ] SPH: Full history saved. [2025-10-21T21:13:25.046727] [INFO ] [MAIN ] Update Progress: 1970/2366 symbols completed. SPH took 27.0s. Estimated remaining: 50m 56s. Rate: 7.8 symbols/min [2025-10-21T21:13:25.214905] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:13:25.222205] [DEBUG] [LOCAL ] SPMC: Loaded 5386 existing records from primary storage. [2025-10-21T21:13:25.222382] [INFO ] [MAIN ] SPMC: Loaded 5386 existing records. [2025-10-21T21:13:25.396564] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:13:25.396793] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-10-21T21:13:25.396842] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-10-21T21:13:25.396981] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-10-21T21:13:25.397018] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-10-21T21:13:25.754079] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-10-21T21:13:25.756877] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T21:13:25.784976] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:13:26.047908] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T21:13:26.551012] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-10-21T21:13:27.351085] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-10-21T21:13:27.470627] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T21:13:27.852546] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T21:13:28.016797] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T21:13:28.151034] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-10-21T21:13:28.951042] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-10-21T21:13:29.751171] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-10. [2025-10-21T21:13:29.825314] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T21:13:29.841124] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T21:13:30.551041] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-10-21T21:13:31.351096] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-10-21T21:13:31.862576] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-21T21:13:31.870503] [INFO ] [REMOTE ] SPGI: Full fetch complete (67734 records). [2025-10-21T21:13:31.870683] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-10-21T21:13:32.152902] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-10-21T21:13:32.289901] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T21:13:32.290014] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-10-21T21:13:32.292624] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-10-21T21:13:32.294082] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-10-21T21:13:32.294216] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-10-21T21:13:32.318286] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T21:13:32.317199] [DEBUG] [LOCAL ] SPGI: Trimmed 67734 records to 45905 (keeping 200 days of data) [2025-10-21T21:13:32.605833] [DEBUG] [LOCAL ] SPGI: Primary data saved (45905 records). [2025-10-21T21:13:32.605952] [INFO ] [MAIN ] SPGI: Full history saved. [2025-10-21T21:13:32.606021] [INFO ] [MAIN ] Update Progress: 1971/2366 symbols completed. SPGI took 34.6s. Estimated remaining: 50m 48s. Rate: 7.8 symbols/min [2025-10-21T21:13:32.772111] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:13:32.772262] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-10-21T21:13:32.772297] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-10-21T21:13:32.772403] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-10-21T21:13:32.772442] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-21T21:13:32.772481] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-21T21:13:32.772512] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-10-21T21:13:32.958076] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-10-21T21:13:33.137622] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:13:33.751063] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-10-21T21:13:33.799423] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T21:13:34.043672] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T21:13:34.551049] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-10-21T21:13:34.949853] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:13:34.950334] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-10-21T21:13:34.950476] [FATAL] [REMOTE ] SPME: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:13:34.950531] [FATAL] [MAIN ] SPME: Failed to fetch primary data. [2025-10-21T21:13:34.950568] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:13:34.950610] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-10-21T21:13:34.950712] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-10-21T21:13:34.950772] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-10-21T21:13:34.950817] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-10-21T21:13:34.950872] [INFO ] [MAIN ] Update Progress: 1972/2366 symbols completed. SPME took 2.3s. Estimated remaining: 50m 39s. Rate: 7.8 symbols/min [2025-10-21T21:13:35.135158] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:13:35.135385] [DEBUG] [LOCAL ] SPNT: No existing data file found in primary storage. [2025-10-21T21:13:35.135424] [WARN ] [MAIN ] SPNT: No existing data found, performing full refresh instead. [2025-10-21T21:13:35.135547] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-10-21T21:13:35.135589] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-10-21T21:13:35.135631] [DEBUG] [LOCAL ] SPNT: No primary data file found to delete. [2025-10-21T21:13:35.135701] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-10-21T21:13:35.356320] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-10-21T21:13:35.546580] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:13:35.550278] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T21:13:36.151007] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-10. [2025-10-21T21:13:36.173018] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T21:13:36.951098] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-10-21T21:13:37.607089] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T21:13:37.751082] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-10-21T21:13:37.917539] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T21:13:37.924985] [INFO ] [REMOTE ] SPHR: Full fetch complete (58780 records). [2025-10-21T21:13:37.925093] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-10-21T21:13:38.306727] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-10-21T21:13:38.306808] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-10-21T21:13:38.307830] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-10-21T21:13:38.307897] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-10-21T21:13:38.310087] [DEBUG] [LOCAL ] SPHR: Trimmed 58780 records to 40695 (keeping 200 days of data) [2025-10-21T21:13:38.537313] [DEBUG] [LOCAL ] SPHR: Primary data saved (40695 records). [2025-10-21T21:13:38.537430] [INFO ] [MAIN ] SPHR: Full history saved. [2025-10-21T21:13:38.537501] [INFO ] [MAIN ] Update Progress: 1973/2366 symbols completed. SPHR took 35.0s. Estimated remaining: 50m 31s. Rate: 7.8 symbols/min [2025-10-21T21:13:38.558264] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-10-21T21:13:38.715827] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:13:38.716632] [DEBUG] [LOCAL ] SPOT: No existing data file found in primary storage. [2025-10-21T21:13:38.716753] [WARN ] [MAIN ] SPOT: No existing data found, performing full refresh instead. [2025-10-21T21:13:38.716983] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-10-21T21:13:38.717036] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-21T21:13:38.717080] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-10-21T21:13:38.717111] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-10-21T21:13:38.839072] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T21:13:39.103132] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:13:39.353746] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-10-21T21:13:39.355220] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T21:13:40.151085] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-10-21T21:13:40.951111] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-10-21T21:13:41.517815] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-21T21:13:41.608668] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T21:13:41.681349] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T21:13:41.751041] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-10-21T21:13:42.551019] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-10-21T21:13:43.322796] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T21:13:43.350986] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-10. [2025-10-21T21:13:43.443174] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T21:13:44.105104] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T21:13:44.106596] [INFO ] [REMOTE ] SPMC: Full fetch complete (8353 records). [2025-10-21T21:13:44.106690] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-10-21T21:13:44.159789] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-10-21T21:13:44.467408] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-10-21T21:13:44.467485] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-10-21T21:13:44.467758] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-10-21T21:13:44.467820] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-10-21T21:13:44.468248] [DEBUG] [LOCAL ] SPMC: Trimmed 8353 records to 5407 (keeping 200 days of data) [2025-10-21T21:13:44.501102] [DEBUG] [LOCAL ] SPMC: Primary data saved (5407 records). [2025-10-21T21:13:44.501188] [INFO ] [MAIN ] SPMC: Full history saved. [2025-10-21T21:13:44.501258] [INFO ] [MAIN ] Update Progress: 1974/2366 symbols completed. SPMC took 19.5s. Estimated remaining: 50m 23s. Rate: 7.8 symbols/min [2025-10-21T21:13:44.674354] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:13:44.711686] [DEBUG] [LOCAL ] SPR: Loaded 40983 existing records from primary storage. [2025-10-21T21:13:44.711961] [INFO ] [MAIN ] SPR: Loaded 40983 existing records. [2025-10-21T21:13:44.889141] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:13:44.889346] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-10-21T21:13:44.889391] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-10-21T21:13:44.889628] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-10-21T21:13:44.889717] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-10-21T21:13:44.956242] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-10-21T21:13:45.246168] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:13:45.751100] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-10-21T21:13:45.847835] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T21:13:46.551052] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-10-21T21:13:47.208013] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T21:13:47.268583] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-21T21:13:47.351021] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-10-21T21:13:48.102588] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T21:13:48.151010] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-10. [2025-10-21T21:13:48.451742] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T21:13:48.951028] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-10-21T21:13:49.751006] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-10-21T21:13:49.914574] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T21:13:49.921010] [INFO ] [REMOTE ] SPIR: Full fetch complete (54102 records). [2025-10-21T21:13:49.921129] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-10-21T21:13:50.309864] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-10-21T21:13:50.309965] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-10-21T21:13:50.310971] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-10-21T21:13:50.311031] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-10-21T21:13:50.312207] [DEBUG] [LOCAL ] SPIR: Trimmed 54102 records to 37525 (keeping 200 days of data) [2025-10-21T21:13:50.530435] [DEBUG] [LOCAL ] SPIR: Primary data saved (37525 records). [2025-10-21T21:13:50.530578] [INFO ] [MAIN ] SPIR: Full history saved. [2025-10-21T21:13:50.530674] [INFO ] [MAIN ] Update Progress: 1975/2366 symbols completed. SPIR took 28.6s. Estimated remaining: 50m 14s. Rate: 7.8 symbols/min [2025-10-21T21:13:50.554669] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-10-21T21:13:50.705124] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:13:50.717144] [DEBUG] [LOCAL ] SPRU: Loaded 10032 existing records from primary storage. [2025-10-21T21:13:50.717356] [INFO ] [MAIN ] SPRU: Loaded 10032 existing records. [2025-10-21T21:13:50.900282] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:13:50.900682] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-10-21T21:13:50.900753] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-10-21T21:13:50.900947] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-10-21T21:13:50.901020] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-10-21T21:13:51.259908] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:13:51.341055] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T21:13:51.350978] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-10-21T21:13:51.988802] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-21T21:13:52.151021] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-10-21T21:13:52.906204] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-21T21:13:52.937107] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T21:13:52.950984] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-10-21T21:13:53.751028] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-10-21T21:13:53.776316] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T21:13:54.500180] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T21:13:54.551009] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-10-21T21:13:54.581526] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T21:13:55.351090] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-10-21T21:13:56.151063] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-10-21T21:13:56.951098] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-10-21T21:13:57.020264] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T21:13:57.125883] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-21T21:13:57.646684] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-21T21:13:57.751020] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-10-21T21:13:57.818795] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T21:13:58.551047] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-10-21T21:13:58.596150] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-21T21:13:59.351093] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-10-21T21:14:00.135167] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T21:14:00.151009] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-10-21T21:14:00.275926] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T21:14:00.951029] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-10-21T21:14:01.751097] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-10-21T21:14:02.551058] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-10-21T21:14:02.634533] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-21T21:14:02.634794] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T21:14:03.361061] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-10. [2025-10-21T21:14:03.391274] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-21T21:14:03.921401] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-21T21:14:04.151070] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-10-21T21:14:04.388259] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T21:14:04.393332] [INFO ] [REMOTE ] SPNT: Full fetch complete (48462 records). [2025-10-21T21:14:04.393452] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-10-21T21:14:04.860575] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-10-21T21:14:04.860677] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-10-21T21:14:04.861614] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-10-21T21:14:04.861683] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-10-21T21:14:04.862719] [DEBUG] [LOCAL ] SPNT: Trimmed 48462 records to 34304 (keeping 200 days of data) [2025-10-21T21:14:04.953732] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-10-21T21:14:05.061070] [DEBUG] [LOCAL ] SPNT: Primary data saved (34304 records). [2025-10-21T21:14:05.061200] [INFO ] [MAIN ] SPNT: Full history saved. [2025-10-21T21:14:05.061271] [INFO ] [MAIN ] Update Progress: 1976/2366 symbols completed. SPNT took 30.1s. Estimated remaining: 50m 8s. Rate: 7.8 symbols/min [2025-10-21T21:14:05.229354] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:14:05.229521] [DEBUG] [LOCAL ] SPXC: No existing data file found in primary storage. [2025-10-21T21:14:05.229565] [WARN ] [MAIN ] SPXC: No existing data found, performing full refresh instead. [2025-10-21T21:14:05.229708] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-10-21T21:14:05.229757] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-10-21T21:14:05.229798] [DEBUG] [LOCAL ] SPXC: No primary data file found to delete. [2025-10-21T21:14:05.229829] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-10-21T21:14:05.585230] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:14:05.720989] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T21:14:05.750997] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-10-21T21:14:06.206549] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-21T21:14:06.550997] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-10-21T21:14:06.650996] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T21:14:07.351054] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-10-21T21:14:08.151071] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-10-21T21:14:08.951049] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-10-21T21:14:09.107556] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T21:14:09.227749] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-21T21:14:09.645988] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T21:14:09.751022] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-10-21T21:14:09.872262] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-21T21:14:10.551061] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-10-21T21:14:11.351087] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-10-21T21:14:11.524720] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T21:14:12.151034] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-10. [2025-10-21T21:14:12.408353] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-21T21:14:12.945335] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T21:14:12.953077] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-10-21T21:14:12.997603] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T21:14:13.000681] [INFO ] [REMOTE ] SPRU: Full fetch complete (12240 records). [2025-10-21T21:14:13.000759] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-10-21T21:14:13.355753] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-10-21T21:14:13.355831] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-10-21T21:14:13.356085] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-10-21T21:14:13.356122] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-10-21T21:14:13.356554] [DEBUG] [LOCAL ] SPRU: Trimmed 12240 records to 10030 (keeping 200 days of data) [2025-10-21T21:14:13.410222] [DEBUG] [LOCAL ] SPRU: Primary data saved (10030 records). [2025-10-21T21:14:13.410335] [INFO ] [MAIN ] SPRU: Full history saved. [2025-10-21T21:14:13.410410] [INFO ] [MAIN ] Update Progress: 1977/2366 symbols completed. SPRU took 22.9s. Estimated remaining: 50m 1s. Rate: 7.8 symbols/min [2025-10-21T21:14:13.579602] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:14:13.591188] [DEBUG] [LOCAL ] SPXX: Loaded 9266 existing records from primary storage. [2025-10-21T21:14:13.591395] [INFO ] [MAIN ] SPXX: Loaded 9266 existing records. [2025-10-21T21:14:13.752120] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-10-21T21:14:13.774928] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:14:13.775154] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-10-21T21:14:13.775258] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-10-21T21:14:13.776209] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-10-21T21:14:13.776280] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-10-21T21:14:14.140290] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:14:14.324864] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T21:14:14.551033] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-10-21T21:14:15.224505] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T21:14:15.350988] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-10-21T21:14:15.821283] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-21T21:14:16.151036] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-10-21T21:14:16.951001] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-10-21T21:14:17.661047] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-21T21:14:17.750992] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-10-21T21:14:17.800530] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T21:14:18.551077] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-10-21T21:14:19.137613] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-21T21:14:19.341186] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T21:14:19.350983] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-10. [2025-10-21T21:14:19.815894] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-21T21:14:20.034695] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-21T21:14:20.041955] [INFO ] [REMOTE ] SPOT: Full fetch complete (73391 records). [2025-10-21T21:14:20.042105] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-10-21T21:14:20.042926] [FATAL] [VALIDATOR ] SPOT: Data is stale - most recent date (2025-10-20) is before last completed trading day (2025-10-21). Symbol may be delisted or halted. [2025-10-21T21:14:20.043011] [FATAL] [MAIN ] SPOT: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:14:20.043085] [WARN ] [MAIN ] SPOT: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:14:20.043169] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-10-21T21:14:20.043259] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-10-21T21:14:20.043315] [INFO ] [LOCAL ] SPOT: Starting deletion of derivative data. [2025-10-21T21:14:20.043357] [DEBUG] [LOCAL ] SPOT: No derivative data file found to delete. [2025-10-21T21:14:20.043411] [INFO ] [MAIN ] Update Progress: 1978/2366 symbols completed. SPOT took 41.5s. Estimated remaining: 49m 53s. Rate: 7.8 symbols/min [2025-10-21T21:14:20.156107] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-10. [2025-10-21T21:14:20.221443] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:14:20.268107] [DEBUG] [LOCAL ] SQM: Loaded 48976 existing records from primary storage. [2025-10-21T21:14:20.268400] [INFO ] [MAIN ] SQM: Loaded 48976 existing records. [2025-10-21T21:14:20.444991] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:14:20.445208] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-10-21T21:14:20.445257] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-10-21T21:14:20.445449] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-10-21T21:14:20.445505] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-10-21T21:14:20.803058] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:14:20.951004] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-10-21T21:14:21.751056] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-10-21T21:14:22.052343] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T21:14:22.058754] [INFO ] [REMOTE ] SPR: Full fetch complete (60062 records). [2025-10-21T21:14:22.058872] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-10-21T21:14:22.401097] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T21:14:22.482953] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-10-21T21:14:22.483035] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-10-21T21:14:22.484118] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-10-21T21:14:22.484181] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-10-21T21:14:22.485358] [DEBUG] [LOCAL ] SPR: Trimmed 60062 records to 40875 (keeping 200 days of data) [2025-10-21T21:14:22.568156] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-10-21T21:14:22.723242] [DEBUG] [LOCAL ] SPR: Primary data saved (40875 records). [2025-10-21T21:14:22.723356] [INFO ] [MAIN ] SPR: Full history saved. [2025-10-21T21:14:22.723910] [INFO ] [MAIN ] Update Progress: 1979/2366 symbols completed. SPR took 38.2s. Estimated remaining: 49m 44s. Rate: 7.8 symbols/min [2025-10-21T21:14:22.894245] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:14:22.922039] [DEBUG] [LOCAL ] SQNS: Loaded 27927 existing records from primary storage. [2025-10-21T21:14:22.922280] [INFO ] [MAIN ] SQNS: Loaded 27927 existing records. [2025-10-21T21:14:23.112744] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:14:23.119489] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-10-21T21:14:23.121920] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-10-21T21:14:23.122269] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-10-21T21:14:23.122681] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-10-21T21:14:23.123466] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-10-21T21:14:23.369363] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-10-21T21:14:23.477900] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T21:14:23.496842] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:14:24.151075] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-10-21T21:14:24.569275] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T21:14:24.951092] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-10-21T21:14:25.193280] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T21:14:25.751078] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-10-21T21:14:26.550992] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-10-21T21:14:26.732626] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T21:14:26.760498] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T21:14:27.351004] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-10-21T21:14:27.514463] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T21:14:28.151022] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-10-21T21:14:28.208103] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T21:14:28.951083] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-10-21T21:14:29.750989] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-10-21T21:14:29.828995] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-21T21:14:30.052547] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T21:14:30.551004] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-10-21T21:14:30.646118] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T21:14:31.351104] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-10-21T21:14:32.151074] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-10-21T21:14:32.415636] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T21:14:32.464196] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T21:14:32.951082] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-10-21T21:14:33.042960] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T21:14:33.751038] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-10-21T21:14:34.255115] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T21:14:34.551130] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-10-21T21:14:34.577760] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T21:14:35.351017] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-10-21T21:14:36.151053] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-10-21T21:14:36.310217] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T21:14:36.358592] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T21:14:36.951000] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-10-21T21:14:37.029066] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T21:14:37.751066] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-10-21T21:14:38.367911] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T21:14:38.551071] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-10-21T21:14:39.298975] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T21:14:39.351015] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-10-21T21:14:40.151015] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-10-21T21:14:40.942480] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-21T21:14:40.952362] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-10-21T21:14:41.355847] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T21:14:41.725071] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T21:14:41.751145] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-10-21T21:14:41.783624] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-21T21:14:42.551045] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-10-21T21:14:43.350993] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-10. [2025-10-21T21:14:43.559863] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T21:14:43.855346] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-21T21:14:44.151020] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-10-21T21:14:44.531870] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T21:14:44.535493] [INFO ] [REMOTE ] SPXC: Full fetch complete (34118 records). [2025-10-21T21:14:44.535578] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-10-21T21:14:44.895998] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-10-21T21:14:44.896076] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-10-21T21:14:44.896736] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-10-21T21:14:44.896798] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-10-21T21:14:44.897531] [DEBUG] [LOCAL ] SPXC: Trimmed 34118 records to 23233 (keeping 200 days of data) [2025-10-21T21:14:44.958171] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-10-21T21:14:45.042002] [DEBUG] [LOCAL ] SPXC: Primary data saved (23233 records). [2025-10-21T21:14:45.042151] [INFO ] [MAIN ] SPXC: Full history saved. [2025-10-21T21:14:45.042233] [INFO ] [MAIN ] Update Progress: 1980/2366 symbols completed. SPXC took 40.0s. Estimated remaining: 49m 39s. Rate: 7.8 symbols/min [2025-10-21T21:14:45.208820] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:14:45.208997] [DEBUG] [LOCAL ] SR: No existing data file found in primary storage. [2025-10-21T21:14:45.209036] [WARN ] [MAIN ] SR: No existing data found, performing full refresh instead. [2025-10-21T21:14:45.209170] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-10-21T21:14:45.209236] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-10-21T21:14:45.209286] [DEBUG] [LOCAL ] SR: No primary data file found to delete. [2025-10-21T21:14:45.209320] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-10-21T21:14:45.553548] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:14:45.751007] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-10-21T21:14:46.034532] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T21:14:46.551005] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-10-21T21:14:46.734681] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T21:14:47.281457] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T21:14:47.351014] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-10-21T21:14:48.119814] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T21:14:48.150993] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-10. [2025-10-21T21:14:48.863044] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T21:14:48.950987] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-10-21T21:14:49.740229] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T21:14:49.748424] [INFO ] [REMOTE ] SQM: Full fetch complete (69859 records). [2025-10-21T21:14:49.748539] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-10-21T21:14:49.760910] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-10. [2025-10-21T21:14:50.180232] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-10-21T21:14:50.180333] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-10-21T21:14:50.181529] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-10-21T21:14:50.181611] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-10-21T21:14:50.183277] [DEBUG] [LOCAL ] SQM: Trimmed 69859 records to 48969 (keeping 200 days of data) [2025-10-21T21:14:50.287009] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T21:14:50.488624] [DEBUG] [LOCAL ] SQM: Primary data saved (48969 records). [2025-10-21T21:14:50.488977] [INFO ] [MAIN ] SQM: Full history saved. [2025-10-21T21:14:50.489696] [INFO ] [MAIN ] Update Progress: 1981/2366 symbols completed. SQM took 30.4s. Estimated remaining: 49m 31s. Rate: 7.8 symbols/min [2025-10-21T21:14:50.556211] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-10. [2025-10-21T21:14:50.660688] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:14:50.660831] [DEBUG] [LOCAL ] SRE: No existing data file found in primary storage. [2025-10-21T21:14:50.660866] [WARN ] [MAIN ] SRE: No existing data found, performing full refresh instead. [2025-10-21T21:14:50.661008] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-10-21T21:14:50.661090] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-10-21T21:14:50.661149] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-10-21T21:14:50.661183] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-10-21T21:14:50.792718] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T21:14:50.838230] [INFO ] [REMOTE ] SQNS: Full fetch complete (33010 records). [2025-10-21T21:14:50.888666] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-10-21T21:14:51.191766] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:14:51.356204] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-10-21T21:14:51.422126] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-10-21T21:14:51.422248] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-10-21T21:14:51.423428] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-10-21T21:14:51.423587] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-10-21T21:14:51.424488] [DEBUG] [LOCAL ] SQNS: Trimmed 33010 records to 27998 (keeping 200 days of data) [2025-10-21T21:14:51.579095] [DEBUG] [LOCAL ] SQNS: Primary data saved (27998 records). [2025-10-21T21:14:51.579227] [INFO ] [MAIN ] SQNS: Full history saved. [2025-10-21T21:14:51.579308] [INFO ] [MAIN ] Update Progress: 1982/2366 symbols completed. SQNS took 28.9s. Estimated remaining: 49m 22s. Rate: 7.8 symbols/min [2025-10-21T21:14:51.689546] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T21:14:51.717938] [INFO ] [REMOTE ] SPXX: Full fetch complete (13445 records). [2025-10-21T21:14:51.731244] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-10-21T21:14:51.861390] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:14:52.018974] [DEBUG] [LOCAL ] SREA: Loaded 9830 existing records from primary storage. [2025-10-21T21:14:52.030492] [INFO ] [MAIN ] SREA: Loaded 9830 existing records. [2025-10-21T21:14:52.157296] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-10-21T21:14:52.300171] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-10-21T21:14:52.318011] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-10-21T21:14:52.320591] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-10-21T21:14:52.320734] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-10-21T21:14:52.344512] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:14:52.345262] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-10-21T21:14:52.345363] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-10-21T21:14:52.345087] [DEBUG] [LOCAL ] SPXX: Trimmed 13445 records to 9192 (keeping 200 days of data) [2025-10-21T21:14:52.346001] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-10-21T21:14:52.346081] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-10-21T21:14:52.598084] [DEBUG] [LOCAL ] SPXX: Primary data saved (9192 records). [2025-10-21T21:14:52.635371] [INFO ] [MAIN ] SPXX: Full history saved. [2025-10-21T21:14:52.646977] [INFO ] [MAIN ] Update Progress: 1983/2366 symbols completed. SPXX took 39.2s. Estimated remaining: 49m 13s. Rate: 7.8 symbols/min [2025-10-21T21:14:52.968072] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:14:52.974289] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:14:52.974967] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-10-21T21:14:53.013197] [DEBUG] [LOCAL ] SRFM: Loaded 39590 existing records from primary storage. [2025-10-21T21:14:53.013507] [INFO ] [MAIN ] SRFM: Loaded 39590 existing records. [2025-10-21T21:14:53.188293] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:14:53.188491] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-10-21T21:14:53.188540] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-10-21T21:14:53.188759] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-10-21T21:14:53.188815] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-10-21T21:14:53.560212] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:14:53.588284] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-21T21:14:53.750985] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-10-21T21:14:53.943352] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:14:54.002492] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T21:14:54.551034] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-10-21T21:14:55.351069] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-10-21T21:14:55.435999] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T21:14:55.650697] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T21:14:56.151032] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-10-21T21:14:56.779085] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T21:14:56.951038] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-10-21T21:14:57.069701] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T21:14:57.751077] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-10-21T21:14:58.444122] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T21:14:58.550990] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-10-21T21:14:59.105199] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-21T21:14:59.351037] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-10-21T21:15:00.110734] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T21:15:00.151032] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-10-21T21:15:00.951097] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-10-21T21:15:01.610781] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-21T21:15:01.751040] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-10-21T21:15:01.964493] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T21:15:02.054695] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T21:15:02.551064] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-10-21T21:15:02.855481] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T21:15:03.351084] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-10-21T21:15:03.773118] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T21:15:04.150999] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-10-21T21:15:04.480792] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T21:15:04.951074] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-10-21T21:15:05.699020] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T21:15:05.750979] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-10-21T21:15:05.957618] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T21:15:06.551025] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-10-21T21:15:07.316366] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T21:15:07.350983] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-10-21T21:15:07.426199] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T21:15:08.151089] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-10. [2025-10-21T21:15:08.951048] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-10-21T21:15:09.443952] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T21:15:09.483234] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T21:15:09.488061] [INFO ] [REMOTE ] SR: Full fetch complete (46198 records). [2025-10-21T21:15:09.488280] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-10-21T21:15:09.756180] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-10-21T21:15:09.865667] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-10-21T21:15:09.865753] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-10-21T21:15:09.866621] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-10-21T21:15:09.866700] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-10-21T21:15:09.867770] [DEBUG] [LOCAL ] SR: Trimmed 46198 records to 32385 (keeping 200 days of data) [2025-10-21T21:15:10.063028] [DEBUG] [LOCAL ] SR: Primary data saved (32385 records). [2025-10-21T21:15:10.063262] [INFO ] [MAIN ] SR: Full history saved. [2025-10-21T21:15:10.063375] [INFO ] [MAIN ] Update Progress: 1984/2366 symbols completed. SR took 25.0s. Estimated remaining: 49m 7s. Rate: 7.8 symbols/min [2025-10-21T21:15:10.208455] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T21:15:10.266848] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:15:10.281337] [DEBUG] [LOCAL ] SRG: Loaded 14970 existing records from primary storage. [2025-10-21T21:15:10.281573] [INFO ] [MAIN ] SRG: Loaded 14970 existing records. [2025-10-21T21:15:10.461517] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:15:10.461754] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-10-21T21:15:10.461807] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-10-21T21:15:10.461994] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-10-21T21:15:10.462049] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-10-21T21:15:10.557290] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-10-21T21:15:10.812428] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:15:11.351020] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-10-21T21:15:11.805778] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-21T21:15:12.151027] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-10-21T21:15:12.429375] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T21:15:12.602879] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T21:15:12.861789] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T21:15:12.951035] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-10-21T21:15:13.751045] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-10-21T21:15:13.839046] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-21T21:15:14.550982] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-10-21T21:15:15.351047] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-10-21T21:15:16.151068] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-10. [2025-10-21T21:15:16.524808] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-10-21T21:15:16.552766] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T21:15:16.829729] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-21T21:15:16.951027] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-10-21T21:15:16.959483] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T21:15:16.961243] [INFO ] [REMOTE ] SREA: Full fetch complete (14884 records). [2025-10-21T21:15:16.961358] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-10-21T21:15:17.320064] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-10-21T21:15:17.320140] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-10-21T21:15:17.320463] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-10-21T21:15:17.320524] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-10-21T21:15:17.321184] [DEBUG] [LOCAL ] SREA: Trimmed 14884 records to 9778 (keeping 200 days of data) [2025-10-21T21:15:17.380054] [DEBUG] [LOCAL ] SREA: Primary data saved (9778 records). [2025-10-21T21:15:17.380177] [INFO ] [MAIN ] SREA: Full history saved. [2025-10-21T21:15:17.380255] [INFO ] [MAIN ] Update Progress: 1985/2366 symbols completed. SREA took 25.8s. Estimated remaining: 48m 59s. Rate: 7.8 symbols/min [2025-10-21T21:15:17.562947] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:15:17.589766] [DEBUG] [LOCAL ] SRI: Loaded 26431 existing records from primary storage. [2025-10-21T21:15:17.590025] [INFO ] [MAIN ] SRI: Loaded 26431 existing records. [2025-10-21T21:15:17.753735] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-10-21T21:15:17.789064] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:15:17.789357] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-10-21T21:15:17.789403] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-10-21T21:15:17.789586] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-10-21T21:15:17.789667] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-10-21T21:15:18.157501] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:15:18.158631] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T21:15:18.551045] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-10-21T21:15:19.351001] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-10-21T21:15:19.831072] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-21T21:15:20.110828] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-21T21:15:20.150985] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-10-21T21:15:20.951043] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-10-21T21:15:21.197459] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T21:15:21.501404] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T21:15:21.751054] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-10-21T21:15:22.074938] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T21:15:22.551025] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-10-21T21:15:23.225168] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T21:15:23.351061] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-10-21T21:15:24.151040] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-10-21T21:15:24.792686] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-21T21:15:24.951042] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-10-21T21:15:25.072277] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T21:15:25.506353] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-21T21:15:25.751046] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-10-21T21:15:26.058506] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T21:15:26.551042] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-10. [2025-10-21T21:15:26.724445] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T21:15:27.351037] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-10-21T21:15:28.151051] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-10-21T21:15:28.459825] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T21:15:28.709434] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-21T21:15:28.717333] [INFO ] [REMOTE ] SRFM: Full fetch complete (51056 records). [2025-10-21T21:15:28.717432] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-10-21T21:15:28.956242] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-10. [2025-10-21T21:15:29.090084] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-10-21T21:15:29.090159] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-10-21T21:15:29.091122] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-10-21T21:15:29.091185] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-10-21T21:15:29.092232] [DEBUG] [LOCAL ] SRFM: Trimmed 51056 records to 39815 (keeping 200 days of data) [2025-10-21T21:15:29.313900] [DEBUG] [LOCAL ] SRFM: Primary data saved (39815 records). [2025-10-21T21:15:29.314032] [INFO ] [MAIN ] SRFM: Full history saved. [2025-10-21T21:15:29.314108] [INFO ] [MAIN ] Update Progress: 1986/2366 symbols completed. SRFM took 36.7s. Estimated remaining: 48m 52s. Rate: 7.8 symbols/min [2025-10-21T21:15:29.482519] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:15:29.482685] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-10-21T21:15:29.482736] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-10-21T21:15:29.482841] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-10-21T21:15:29.482882] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-21T21:15:29.482921] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-21T21:15:29.482952] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-10-21T21:15:29.621696] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T21:15:29.759710] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-10-21T21:15:29.862087] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:15:30.551046] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-10-21T21:15:30.909463] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-21T21:15:30.917554] [INFO ] [REMOTE ] SRE: Full fetch complete (77505 records). [2025-10-21T21:15:30.917719] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-10-21T21:15:31.114635] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T21:15:31.238426] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-21T21:15:31.356500] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-10. [2025-10-21T21:15:31.376442] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-10-21T21:15:31.376530] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-10-21T21:15:31.377918] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-10-21T21:15:31.377991] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-10-21T21:15:31.379774] [DEBUG] [LOCAL ] SRE: Trimmed 77505 records to 53414 (keeping 200 days of data) [2025-10-21T21:15:31.719830] [DEBUG] [LOCAL ] SRE: Primary data saved (53414 records). [2025-10-21T21:15:31.719965] [INFO ] [MAIN ] SRE: Full history saved. [2025-10-21T21:15:31.720036] [INFO ] [MAIN ] Update Progress: 1987/2366 symbols completed. SRE took 41.2s. Estimated remaining: 48m 44s. Rate: 7.8 symbols/min [2025-10-21T21:15:31.903212] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:15:31.913371] [DEBUG] [LOCAL ] SRV: Loaded 7460 existing records from primary storage. [2025-10-21T21:15:31.913633] [INFO ] [MAIN ] SRV: Loaded 7460 existing records. [2025-10-21T21:15:32.092271] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:15:32.092466] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-10-21T21:15:32.092512] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-10-21T21:15:32.092680] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-10-21T21:15:32.092735] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-10-21T21:15:32.156154] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-10-21T21:15:32.459182] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:15:32.459474] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T21:15:32.462215] [INFO ] [REMOTE ] SRG: Full fetch complete (23191 records). [2025-10-21T21:15:32.462288] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-10-21T21:15:32.751126] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T21:15:32.848349] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-10-21T21:15:32.848441] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-10-21T21:15:32.848950] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-10-21T21:15:32.849013] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-10-21T21:15:32.849840] [DEBUG] [LOCAL ] SRG: Trimmed 23191 records to 14827 (keeping 200 days of data) [2025-10-21T21:15:32.929053] [DEBUG] [LOCAL ] SRG: Primary data saved (14827 records). [2025-10-21T21:15:32.929176] [INFO ] [MAIN ] SRG: Full history saved. [2025-10-21T21:15:32.929250] [INFO ] [MAIN ] Update Progress: 1988/2366 symbols completed. SRG took 22.9s. Estimated remaining: 48m 35s. Rate: 7.8 symbols/min [2025-10-21T21:15:32.958245] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-10-21T21:15:33.102708] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:15:33.103083] [DEBUG] [LOCAL ] SSB: No existing data file found in primary storage. [2025-10-21T21:15:33.103122] [WARN ] [MAIN ] SSB: No existing data found, performing full refresh instead. [2025-10-21T21:15:33.103276] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-10-21T21:15:33.103318] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-10-21T21:15:33.103408] [DEBUG] [LOCAL ] SSB: No primary data file found to delete. [2025-10-21T21:15:33.103449] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-10-21T21:15:33.468705] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:15:33.750992] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-10-21T21:15:33.941110] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T21:15:34.551000] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-10-21T21:15:35.351057] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-10-21T21:15:35.384826] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T21:15:35.426091] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T21:15:36.151018] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-10-21T21:15:36.692166] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-21T21:15:36.951071] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-10-21T21:15:36.990820] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T21:15:37.543340] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T21:15:37.751014] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-10-21T21:15:38.551005] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-10-21T21:15:38.671020] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T21:15:39.107124] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-21T21:15:39.351045] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-10-21T21:15:40.151050] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-10-21T21:15:40.769870] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T21:15:40.951065] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-10-21T21:15:41.439442] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T21:15:41.751067] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-10-21T21:15:42.246488] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-21T21:15:42.334125] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-21T21:15:42.551032] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-10-21T21:15:43.351062] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-10-21T21:15:43.860694] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T21:15:44.151002] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-10-21T21:15:44.319258] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-21T21:15:44.507335] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-21T21:15:44.951030] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-10-21T21:15:45.751075] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-10-21T21:15:45.852313] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-21T21:15:46.217315] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T21:15:46.551006] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-10. [2025-10-21T21:15:47.005576] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-21T21:15:47.006418] [INFO ] [REMOTE ] SRL: Full fetch complete (1666 records). [2025-10-21T21:15:47.006490] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-10-21T21:15:47.186025] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-21T21:15:47.186220] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:15:47.186288] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:15:47.186341] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-10-21T21:15:47.186397] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-10-21T21:15:47.186435] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-10-21T21:15:47.186476] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-10-21T21:15:47.186534] [INFO ] [MAIN ] Update Progress: 1989/2366 symbols completed. SRL took 17.9s. Estimated remaining: 48m 28s. Rate: 7.8 symbols/min [2025-10-21T21:15:47.360184] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-10-21T21:15:47.362966] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:15:47.363902] [DEBUG] [LOCAL ] SSD: No existing data file found in primary storage. [2025-10-21T21:15:47.363954] [WARN ] [MAIN ] SSD: No existing data found, performing full refresh instead. [2025-10-21T21:15:47.364123] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-10-21T21:15:47.364244] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-10-21T21:15:47.364308] [DEBUG] [LOCAL ] SSD: No primary data file found to delete. [2025-10-21T21:15:47.364344] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-10-21T21:15:47.725022] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:15:48.151079] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-10-21T21:15:48.951068] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-10-21T21:15:49.298088] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T21:15:49.461891] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T21:15:49.751051] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-10-21T21:15:49.782208] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T21:15:50.551021] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-10-21T21:15:51.351003] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-10-21T21:15:51.397150] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T21:15:51.540056] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T21:15:52.151011] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-10-21T21:15:52.380796] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T21:15:52.951045] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-10-21T21:15:53.631140] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T21:15:53.751040] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-10-21T21:15:54.534565] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T21:15:54.550989] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-10-21T21:15:54.611854] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-21T21:15:55.351034] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-10-21T21:15:55.850783] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T21:15:56.151054] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-10-21T21:15:56.260412] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T21:15:56.950998] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-10-21T21:15:57.333540] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T21:15:57.751063] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-10-21T21:15:57.793368] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T21:15:58.551063] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-10. [2025-10-21T21:15:59.081953] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T21:15:59.351006] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-10. [2025-10-21T21:15:59.627517] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-21T21:15:59.631017] [INFO ] [REMOTE ] SRI: Full fetch complete (39726 records). [2025-10-21T21:15:59.631100] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-10-21T21:16:00.017636] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-10-21T21:16:00.017818] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-10-21T21:16:00.018729] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-10-21T21:16:00.018805] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-10-21T21:16:00.019786] [DEBUG] [LOCAL ] SRI: Trimmed 39726 records to 26340 (keeping 200 days of data) [2025-10-21T21:16:00.105894] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T21:16:00.110221] [INFO ] [REMOTE ] SRV: Full fetch complete (11304 records). [2025-10-21T21:16:00.111255] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-10-21T21:16:00.156470] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-10-21T21:16:00.549634] [DEBUG] [LOCAL ] SRI: Primary data saved (26340 records). [2025-10-21T21:16:00.558289] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-10-21T21:16:00.558441] [INFO ] [MAIN ] SRI: Full history saved. [2025-10-21T21:16:00.558387] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-10-21T21:16:00.558582] [INFO ] [MAIN ] Update Progress: 1990/2366 symbols completed. SRI took 43.2s. Estimated remaining: 48m 22s. Rate: 7.8 symbols/min [2025-10-21T21:16:00.558906] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-10-21T21:16:00.570151] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-10-21T21:16:00.660470] [DEBUG] [LOCAL ] SRV: Trimmed 11304 records to 7446 (keeping 200 days of data) [2025-10-21T21:16:00.779624] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:16:00.783110] [DEBUG] [LOCAL ] SRV: Primary data saved (7446 records). [2025-10-21T21:16:00.783435] [INFO ] [MAIN ] SRV: Full history saved. [2025-10-21T21:16:00.783733] [INFO ] [MAIN ] Update Progress: 1991/2366 symbols completed. SRV took 29.1s. Estimated remaining: 48m 12s. Rate: 7.8 symbols/min [2025-10-21T21:16:00.953962] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-10-21T21:16:00.975442] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:16:00.992738] [DEBUG] [LOCAL ] SSL: Loaded 41522 existing records from primary storage. [2025-10-21T21:16:00.993034] [INFO ] [MAIN ] SSL: Loaded 41522 existing records. [2025-10-21T21:16:01.101967] [DEBUG] [LOCAL ] SST: Loaded 11489 existing records from primary storage. [2025-10-21T21:16:01.117746] [INFO ] [MAIN ] SST: Loaded 11489 existing records. [2025-10-21T21:16:01.294924] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:16:01.341947] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-10-21T21:16:01.358946] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-10-21T21:16:01.361945] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:16:01.362218] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-10-21T21:16:01.362267] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-10-21T21:16:01.362435] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-10-21T21:16:01.362398] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-10-21T21:16:01.362586] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-10-21T21:16:01.362726] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-10-21T21:16:01.974684] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T21:16:02.053124] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-10-21T21:16:02.121119] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:16:02.226379] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:16:02.550995] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-10-21T21:16:02.739638] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T21:16:03.351013] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-10-21T21:16:03.379120] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-21T21:16:04.151007] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-10-21T21:16:04.369718] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T21:16:04.951055] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-10-21T21:16:04.992917] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T21:16:05.239039] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T21:16:05.751036] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-10-21T21:16:06.242222] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T21:16:06.551041] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-10-21T21:16:07.351029] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-10-21T21:16:07.496142] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T21:16:07.955784] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T21:16:08.151025] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-10-21T21:16:08.792490] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T21:16:08.950993] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-10-21T21:16:09.100154] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T21:16:09.751019] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-10-21T21:16:10.551051] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-10-21T21:16:10.683219] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T21:16:11.025815] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T21:16:11.351050] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-10. [2025-10-21T21:16:11.704331] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T21:16:12.151055] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-10-21T21:16:12.717719] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T21:16:12.724202] [INFO ] [REMOTE ] SSB: Full fetch complete (61540 records). [2025-10-21T21:16:12.724316] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-10-21T21:16:12.956719] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T21:16:12.956195] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-10-21T21:16:13.129488] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-10-21T21:16:13.129566] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-10-21T21:16:13.130663] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-10-21T21:16:13.130724] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-10-21T21:16:13.131887] [DEBUG] [LOCAL ] SSB: Trimmed 61540 records to 42721 (keeping 200 days of data) [2025-10-21T21:16:13.384604] [DEBUG] [LOCAL ] SSB: Primary data saved (42721 records). [2025-10-21T21:16:13.384760] [INFO ] [MAIN ] SSB: Full history saved. [2025-10-21T21:16:13.384837] [INFO ] [MAIN ] Update Progress: 1992/2366 symbols completed. SSB took 40.5s. Estimated remaining: 48m 6s. Rate: 7.8 symbols/min [2025-10-21T21:16:13.556437] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:16:13.556588] [DEBUG] [LOCAL ] SSTK: No existing data file found in primary storage. [2025-10-21T21:16:13.556624] [WARN ] [MAIN ] SSTK: No existing data found, performing full refresh instead. [2025-10-21T21:16:13.556758] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-10-21T21:16:13.556799] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-10-21T21:16:13.556860] [DEBUG] [LOCAL ] SSTK: No primary data file found to delete. [2025-10-21T21:16:13.556891] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-10-21T21:16:13.756085] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-10-21T21:16:13.928578] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:16:14.297892] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T21:16:14.551044] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-10-21T21:16:14.774325] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T21:16:15.351022] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-10-21T21:16:16.086821] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T21:16:16.150976] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-10. [2025-10-21T21:16:16.951007] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-10-21T21:16:17.249919] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T21:16:17.301448] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T21:16:17.304948] [INFO ] [REMOTE ] SSD: Full fetch complete (32468 records). [2025-10-21T21:16:17.305022] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-10-21T21:16:17.670972] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-10-21T21:16:17.671049] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-10-21T21:16:17.671603] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-10-21T21:16:17.671660] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-10-21T21:16:17.672363] [DEBUG] [LOCAL ] SSD: Trimmed 32468 records to 22487 (keeping 200 days of data) [2025-10-21T21:16:17.760255] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-10-21T21:16:17.811335] [DEBUG] [LOCAL ] SSD: Primary data saved (22487 records). [2025-10-21T21:16:17.811446] [INFO ] [MAIN ] SSD: Full history saved. [2025-10-21T21:16:17.811526] [INFO ] [MAIN ] Update Progress: 1993/2366 symbols completed. SSD took 30.6s. Estimated remaining: 47m 57s. Rate: 7.8 symbols/min [2025-10-21T21:16:17.982943] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:16:17.983187] [DEBUG] [LOCAL ] ST: No existing data file found in primary storage. [2025-10-21T21:16:17.983241] [WARN ] [MAIN ] ST: No existing data found, performing full refresh instead. [2025-10-21T21:16:17.983348] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-10-21T21:16:17.983388] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-10-21T21:16:17.983427] [DEBUG] [LOCAL ] ST: No primary data file found to delete. [2025-10-21T21:16:17.983459] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-10-21T21:16:18.284303] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T21:16:18.366360] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:16:18.550979] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-10-21T21:16:19.120992] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-21T21:16:19.351042] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-10-21T21:16:20.151013] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-10-21T21:16:20.322221] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T21:16:20.951028] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-10-21T21:16:21.329941] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-21T21:16:21.751002] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-10-21T21:16:21.839535] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T21:16:21.978148] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T21:16:22.551030] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-10-21T21:16:23.342021] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T21:16:23.350969] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-10-21T21:16:23.418364] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T21:16:23.943597] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T21:16:24.150984] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-10-21T21:16:24.951022] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-10. [2025-10-21T21:16:25.684380] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-21T21:16:25.685835] [INFO ] [REMOTE ] SST: Full fetch complete (18016 records). [2025-10-21T21:16:25.685902] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-10-21T21:16:25.760856] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-10-21T21:16:26.057958] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-10-21T21:16:26.058052] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-10-21T21:16:26.058490] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-10-21T21:16:26.058566] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-10-21T21:16:26.059302] [DEBUG] [LOCAL ] SST: Trimmed 18016 records to 11434 (keeping 200 days of data) [2025-10-21T21:16:26.138492] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T21:16:26.163215] [DEBUG] [LOCAL ] SST: Primary data saved (11434 records). [2025-10-21T21:16:26.163687] [INFO ] [MAIN ] SST: Full history saved. [2025-10-21T21:16:26.163777] [INFO ] [MAIN ] Update Progress: 1994/2366 symbols completed. SST took 25.4s. Estimated remaining: 47m 50s. Rate: 7.8 symbols/min [2025-10-21T21:16:26.335300] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:16:26.335460] [DEBUG] [LOCAL ] STAG: No existing data file found in primary storage. [2025-10-21T21:16:26.335497] [WARN ] [MAIN ] STAG: No existing data found, performing full refresh instead. [2025-10-21T21:16:26.335612] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-10-21T21:16:26.335681] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-10-21T21:16:26.335751] [DEBUG] [LOCAL ] STAG: No primary data file found to delete. [2025-10-21T21:16:26.335818] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-10-21T21:16:26.556146] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-10-21T21:16:26.694379] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:16:27.351017] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-10-21T21:16:27.566765] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-21T21:16:28.128982] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T21:16:28.150984] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-10-21T21:16:28.950998] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-10-21T21:16:29.237365] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T21:16:29.390720] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T21:16:29.751016] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-10-21T21:16:30.405500] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T21:16:30.550984] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-10-21T21:16:30.944529] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T21:16:31.351119] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-10-21T21:16:32.151006] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-10-21T21:16:32.234091] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:16:32.951002] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-10-21T21:16:33.171685] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T21:16:33.318105] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T21:16:33.751028] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-10-21T21:16:34.551006] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-10-21T21:16:34.710899] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T21:16:35.351013] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-10-21T21:16:35.437149] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T21:16:36.151018] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-10-21T21:16:36.369994] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T21:16:36.400447] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-21T21:16:36.951016] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-10-21T21:16:37.728418] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T21:16:37.750983] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-10-21T21:16:38.178786] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T21:16:38.551057] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-10-21T21:16:39.351057] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-10. [2025-10-21T21:16:39.657535] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T21:16:40.151079] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-10. [2025-10-21T21:16:40.503186] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T21:16:40.935458] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T21:16:40.942245] [INFO ] [REMOTE ] SSL: Full fetch complete (60090 records). [2025-10-21T21:16:40.942375] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-10-21T21:16:40.956347] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-10-21T21:16:41.330742] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-10-21T21:16:41.330929] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-10-21T21:16:41.332202] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-10-21T21:16:41.332294] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-10-21T21:16:41.333595] [DEBUG] [LOCAL ] SSL: Trimmed 60090 records to 41459 (keeping 200 days of data) [2025-10-21T21:16:41.437603] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T21:16:41.443636] [INFO ] [REMOTE ] SSTK: Full fetch complete (41792 records). [2025-10-21T21:16:41.444842] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-10-21T21:16:41.758731] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-10-21T21:16:41.961204] [DEBUG] [LOCAL ] SSL: Primary data saved (41459 records). [2025-10-21T21:16:41.974368] [INFO ] [MAIN ] SSL: Full history saved. [2025-10-21T21:16:41.976591] [INFO ] [MAIN ] Update Progress: 1995/2366 symbols completed. SSL took 41.4s. Estimated remaining: 47m 43s. Rate: 7.8 symbols/min [2025-10-21T21:16:41.976777] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-10-21T21:16:42.008582] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-10-21T21:16:42.020780] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-10-21T21:16:42.041595] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-10-21T21:16:42.079411] [DEBUG] [LOCAL ] SSTK: Trimmed 41792 records to 25352 (keeping 200 days of data) [2025-10-21T21:16:42.238960] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:16:42.243240] [DEBUG] [LOCAL ] STC: No existing data file found in primary storage. [2025-10-21T21:16:42.243534] [WARN ] [MAIN ] STC: No existing data found, performing full refresh instead. [2025-10-21T21:16:42.244916] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-10-21T21:16:42.244995] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-10-21T21:16:42.246071] [DEBUG] [LOCAL ] STC: No primary data file found to delete. [2025-10-21T21:16:42.247875] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-10-21T21:16:42.546750] [DEBUG] [LOCAL ] SSTK: Primary data saved (25352 records). [2025-10-21T21:16:42.558311] [INFO ] [MAIN ] SSTK: Full history saved. [2025-10-21T21:16:42.568723] [INFO ] [MAIN ] Update Progress: 1996/2366 symbols completed. SSTK took 29.2s. Estimated remaining: 47m 34s. Rate: 7.8 symbols/min [2025-10-21T21:16:42.768239] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:16:42.784452] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-10-21T21:16:42.839489] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:16:42.840501] [DEBUG] [LOCAL ] STE: No existing data file found in primary storage. [2025-10-21T21:16:42.840560] [WARN ] [MAIN ] STE: No existing data found, performing full refresh instead. [2025-10-21T21:16:42.840770] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-10-21T21:16:42.840836] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-10-21T21:16:42.840946] [DEBUG] [LOCAL ] STE: No primary data file found to delete. [2025-10-21T21:16:42.841059] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-10-21T21:16:43.241314] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:16:43.243795] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-21T21:16:43.351044] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-10-21T21:16:43.623598] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T21:16:44.151060] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-10-21T21:16:44.181989] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T21:16:44.951057] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-10-21T21:16:45.275981] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T21:16:45.751091] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-10-21T21:16:45.837035] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T21:16:46.551081] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-10-21T21:16:46.757768] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T21:16:47.351034] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-10. [2025-10-21T21:16:47.664437] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-21T21:16:47.781581] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T21:16:48.151071] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-10-21T21:16:48.951061] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-10-21T21:16:49.066032] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T21:16:49.075198] [INFO ] [REMOTE ] ST: Full fetch complete (72142 records). [2025-10-21T21:16:49.075416] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-10-21T21:16:49.490566] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-10-21T21:16:49.490688] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-10-21T21:16:49.492102] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-10-21T21:16:49.492167] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-10-21T21:16:49.493591] [DEBUG] [LOCAL ] ST: Trimmed 72142 records to 49719 (keeping 200 days of data) [2025-10-21T21:16:49.760275] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-10-21T21:16:49.828128] [DEBUG] [LOCAL ] ST: Primary data saved (49719 records). [2025-10-21T21:16:49.828394] [INFO ] [MAIN ] ST: Full history saved. [2025-10-21T21:16:49.828562] [INFO ] [MAIN ] Update Progress: 1997/2366 symbols completed. ST took 32.0s. Estimated remaining: 47m 27s. Rate: 7.8 symbols/min [2025-10-21T21:16:49.865991] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T21:16:50.138775] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T21:16:50.551121] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-10-21T21:16:51.351021] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-10-21T21:16:51.654506] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T21:16:51.703550] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-21T21:16:52.151068] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-10-21T21:16:52.951003] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-10-21T21:16:52.997381] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T21:16:53.373483] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T21:16:53.751008] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-10-21T21:16:54.551055] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-10-21T21:16:54.769538] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T21:16:55.351059] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-10-21T21:16:55.485954] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T21:16:55.546108] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T21:16:56.151013] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-10-21T21:16:56.950986] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-10-21T21:16:57.118367] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T21:16:57.180210] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T21:16:57.751077] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-10. [2025-10-21T21:16:58.481095] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T21:16:58.551005] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-10-21T21:16:59.351057] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-10-21T21:16:59.644205] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-21T21:16:59.652146] [INFO ] [REMOTE ] STAG: Full fetch complete (72558 records). [2025-10-21T21:16:59.652259] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-10-21T21:17:00.052825] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-10-21T21:17:00.052925] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-10-21T21:17:00.054066] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-10-21T21:17:00.054129] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-10-21T21:17:00.055678] [DEBUG] [LOCAL ] STAG: Trimmed 72558 records to 50089 (keeping 200 days of data) [2025-10-21T21:17:00.403133] [DEBUG] [LOCAL ] STAG: Primary data saved (50089 records). [2025-10-21T21:17:00.403373] [INFO ] [MAIN ] STAG: Full history saved. [2025-10-21T21:17:00.403481] [INFO ] [MAIN ] Update Progress: 1998/2366 symbols completed. STAG took 34.2s. Estimated remaining: 47m 19s. Rate: 7.8 symbols/min [2025-10-21T21:17:00.429468] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T21:17:00.442510] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-10-21T21:17:00.519758] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T21:17:00.951105] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-10-21T21:17:02.143760] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T21:17:02.151199] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-10-21T21:17:02.239407] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T21:17:02.551082] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-10-21T21:17:03.620121] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T21:17:03.638061] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T21:17:03.637675] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-10. [2025-10-21T21:17:04.151076] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-10. [2025-10-21T21:17:05.171556] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T21:17:05.174800] [INFO ] [REMOTE ] STC: Full fetch complete (25568 records). [2025-10-21T21:17:05.174958] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-10-21T21:17:05.295464] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-21T21:17:05.324972] [INFO ] [REMOTE ] STE: Full fetch complete (50944 records). [2025-10-21T21:17:05.357348] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-10-21T21:17:05.905201] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-10-21T21:17:05.911000] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-10-21T21:17:05.922148] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-10-21T21:17:05.927341] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-10-21T21:17:05.964621] [DEBUG] [LOCAL ] STC: Trimmed 25568 records to 17388 (keeping 200 days of data) [2025-10-21T21:17:05.998382] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-10-21T21:17:05.998452] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-10-21T21:17:05.999222] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-10-21T21:17:06.043632] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-10-21T21:17:06.084348] [DEBUG] [LOCAL ] STE: Trimmed 50944 records to 35240 (keeping 200 days of data) [2025-10-21T21:17:06.196034] [DEBUG] [LOCAL ] STC: Primary data saved (17388 records). [2025-10-21T21:17:06.204617] [INFO ] [MAIN ] STC: Full history saved. [2025-10-21T21:17:06.206122] [INFO ] [MAIN ] Update Progress: 1999/2366 symbols completed. STC took 24.2s. Estimated remaining: 47m 11s. Rate: 7.8 symbols/min [2025-10-21T21:17:06.320150] [DEBUG] [LOCAL ] STE: Primary data saved (35240 records). [2025-10-21T21:17:06.320280] [INFO ] [MAIN ] STE: Full history saved. [2025-10-21T21:17:06.320349] [INFO ] [MAIN ] Update Progress: 2000/2366 symbols completed. STE took 23.7s. Estimated remaining: 47m 2s. Rate: 7.8 symbols/min [2025-10-21T21:17:06.863988] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:06.945958] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:06.930861] [DEBUG] [LOCAL ] STEL: No existing data file found in primary storage. [2025-10-21T21:17:06.960751] [WARN ] [MAIN ] STEL: No existing data found, performing full refresh instead. [2025-10-21T21:17:06.995824] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-10-21T21:17:07.008530] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-10-21T21:17:07.008374] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:07.030297] [DEBUG] [LOCAL ] STEL: No primary data file found to delete. [2025-10-21T21:17:07.033700] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:07.033987] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-10-21T21:17:07.071963] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-10-21T21:17:07.088019] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-10-21T21:17:07.105826] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-10-21T21:17:07.105924] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-21T21:17:07.152616] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-21T21:17:07.153477] [DEBUG] [LOCAL ] STEW: Loaded 15442 existing records from primary storage. [2025-10-21T21:17:07.159149] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-10-21T21:17:07.180286] [INFO ] [MAIN ] STEW: Loaded 15442 existing records. [2025-10-21T21:17:07.479628] [DEBUG] [LOCAL ] STEM: Loaded 38621 existing records from primary storage. [2025-10-21T21:17:07.564732] [INFO ] [MAIN ] STEM: Loaded 38621 existing records. [2025-10-21T21:17:07.819468] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:17:07.861425] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-10-21T21:17:07.933989] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-10-21T21:17:07.948699] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:07.971314] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-10-21T21:17:08.001043] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-10-21T21:17:08.076235] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:17:08.063095] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-10-21T21:17:08.122971] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-10-21T21:17:08.131802] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-10-21T21:17:08.159913] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-10-21T21:17:08.197632] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-10-21T21:17:08.280280] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:08.295998] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-10-21T21:17:08.862391] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:08.891283] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-10-21T21:17:08.890841] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:08.892381] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-10-21T21:17:09.021846] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T21:17:09.022837] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-10-21T21:17:09.223481] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T21:17:09.227528] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-10-21T21:17:09.497402] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-21T21:17:09.558529] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T21:17:09.751056] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-10-21T21:17:10.084272] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T21:17:10.257086] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T21:17:10.551025] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-10-21T21:17:11.329276] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-21T21:17:11.350982] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-10-21T21:17:11.492581] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T21:17:12.151073] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-10-21T21:17:12.679518] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-21T21:17:12.951054] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-10-21T21:17:13.229972] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T21:17:13.751057] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-10-21T21:17:14.074086] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-21T21:17:14.550989] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-10-21T21:17:14.862443] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T21:17:15.204099] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T21:17:15.351024] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-10-21T21:17:16.151031] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-10-21T21:17:16.862595] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T21:17:16.950996] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-10-21T21:17:17.751073] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-10-21T21:17:17.886055] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T21:17:18.082413] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T21:17:18.551085] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-10-21T21:17:19.351119] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-10-21T21:17:19.407632] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T21:17:19.814848] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-21T21:17:20.151015] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-10-21T21:17:20.584841] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T21:17:20.950998] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-10-21T21:17:21.016692] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T21:17:21.751015] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-10-21T21:17:22.551007] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-10-21T21:17:22.908333] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-21T21:17:22.970081] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-21T21:17:22.972988] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T21:17:23.351033] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-10-21T21:17:23.915556] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-21T21:17:24.151033] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-10-21T21:17:24.951010] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-10-21T21:17:25.087563] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T21:17:25.751038] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-10-21T21:17:26.551046] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-10-21T21:17:26.844054] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T21:17:26.932334] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T21:17:27.351045] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-10-21T21:17:28.014823] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T21:17:28.151077] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-10-21T21:17:28.951019] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-10-21T21:17:29.075869] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T21:17:29.573458] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T21:17:29.626032] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-21T21:17:29.751054] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-10-21T21:17:30.551039] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-10-21T21:17:31.350993] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-10. [2025-10-21T21:17:31.423889] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T21:17:31.715115] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T21:17:31.824044] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T21:17:31.824978] [INFO ] [REMOTE ] STG: Full fetch complete (2492 records). [2025-10-21T21:17:31.825046] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-10-21T21:17:32.005359] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-21T21:17:32.005588] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:17:32.005680] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:17:32.005738] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-10-21T21:17:32.005795] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-10-21T21:17:32.005830] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-10-21T21:17:32.005868] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-10-21T21:17:32.005921] [INFO ] [MAIN ] Update Progress: 2001/2366 symbols completed. STG took 25.7s. Estimated remaining: 46m 58s. Rate: 7.8 symbols/min [2025-10-21T21:17:32.157690] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-10. [2025-10-21T21:17:32.183699] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:32.195383] [DEBUG] [LOCAL ] STK: Loaded 9842 existing records from primary storage. [2025-10-21T21:17:32.195579] [INFO ] [MAIN ] STK: Loaded 9842 existing records. [2025-10-21T21:17:32.402112] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:17:32.402333] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-10-21T21:17:32.402379] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-10-21T21:17:32.402552] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-10-21T21:17:32.402608] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-10-21T21:17:32.787638] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:32.951021] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-10-21T21:17:33.116939] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T21:17:33.119387] [INFO ] [REMOTE ] STEW: Full fetch complete (21748 records). [2025-10-21T21:17:33.119458] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-10-21T21:17:33.492856] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-10-21T21:17:33.492931] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-10-21T21:17:33.493426] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-10-21T21:17:33.493471] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-10-21T21:17:33.494053] [DEBUG] [LOCAL ] STEW: Trimmed 21748 records to 15274 (keeping 200 days of data) [2025-10-21T21:17:33.585176] [DEBUG] [LOCAL ] STEW: Primary data saved (15274 records). [2025-10-21T21:17:33.585310] [INFO ] [MAIN ] STEW: Full history saved. [2025-10-21T21:17:33.585388] [INFO ] [MAIN ] Update Progress: 2002/2366 symbols completed. STEW took 27.2s. Estimated remaining: 46m 49s. Rate: 7.8 symbols/min [2025-10-21T21:17:33.756687] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-10-21T21:17:33.759334] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:33.760326] [DEBUG] [LOCAL ] STLA: No existing data file found in primary storage. [2025-10-21T21:17:33.760372] [WARN ] [MAIN ] STLA: No existing data found, performing full refresh instead. [2025-10-21T21:17:33.760481] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-10-21T21:17:33.760521] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-10-21T21:17:33.760560] [DEBUG] [LOCAL ] STLA: No primary data file found to delete. [2025-10-21T21:17:33.760592] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-10-21T21:17:33.873930] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T21:17:34.118105] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:34.551047] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-10-21T21:17:35.289434] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T21:17:35.351011] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-10-21T21:17:36.151029] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-10. [2025-10-21T21:17:36.774309] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T21:17:36.944527] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T21:17:36.952088] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-10-21T21:17:37.695243] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T21:17:37.701188] [INFO ] [REMOTE ] STEM: Full fetch complete (60891 records). [2025-10-21T21:17:37.701280] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-10-21T21:17:37.764311] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-10-21T21:17:38.082449] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-10-21T21:17:38.082529] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-10-21T21:17:38.083798] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-10-21T21:17:38.083902] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-10-21T21:17:38.085043] [DEBUG] [LOCAL ] STEM: Trimmed 60891 records to 38495 (keeping 200 days of data) [2025-10-21T21:17:38.308358] [DEBUG] [LOCAL ] STEM: Primary data saved (38495 records). [2025-10-21T21:17:38.308483] [INFO ] [MAIN ] STEM: Full history saved. [2025-10-21T21:17:38.308584] [INFO ] [MAIN ] Update Progress: 2003/2366 symbols completed. STEM took 32.0s. Estimated remaining: 46m 41s. Rate: 7.8 symbols/min [2025-10-21T21:17:38.486847] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:38.486990] [DEBUG] [LOCAL ] STM: No existing data file found in primary storage. [2025-10-21T21:17:38.487026] [WARN ] [MAIN ] STM: No existing data found, performing full refresh instead. [2025-10-21T21:17:38.487131] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-10-21T21:17:38.487172] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-10-21T21:17:38.487213] [DEBUG] [LOCAL ] STM: No primary data file found to delete. [2025-10-21T21:17:38.487244] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-10-21T21:17:38.560999] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-10-21T21:17:38.858785] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:38.867141] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T21:17:39.193935] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-21T21:17:39.351032] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-10-21T21:17:39.846606] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-21T21:17:40.150997] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-10. [2025-10-21T21:17:40.229735] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T21:17:40.950994] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-10-21T21:17:41.303892] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-21T21:17:41.307379] [INFO ] [REMOTE ] STEL: Full fetch complete (32270 records). [2025-10-21T21:17:41.307466] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-10-21T21:17:41.700069] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-10-21T21:17:41.700150] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-10-21T21:17:41.700816] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-10-21T21:17:41.700877] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-10-21T21:17:41.701683] [DEBUG] [LOCAL ] STEL: Trimmed 32270 records to 22486 (keeping 200 days of data) [2025-10-21T21:17:41.753782] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-10-21T21:17:41.840122] [DEBUG] [LOCAL ] STEL: Primary data saved (22486 records). [2025-10-21T21:17:41.840249] [INFO ] [MAIN ] STEL: Full history saved. [2025-10-21T21:17:41.840317] [INFO ] [MAIN ] Update Progress: 2004/2366 symbols completed. STEL took 35.5s. Estimated remaining: 46m 32s. Rate: 7.8 symbols/min [2025-10-21T21:17:42.017671] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:42.042692] [DEBUG] [LOCAL ] STN: Loaded 22776 existing records from primary storage. [2025-10-21T21:17:42.042957] [INFO ] [MAIN ] STN: Loaded 22776 existing records. [2025-10-21T21:17:42.236416] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:17:42.236634] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-10-21T21:17:42.236716] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-10-21T21:17:42.236903] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-10-21T21:17:42.236944] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-10-21T21:17:42.557408] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-10-21T21:17:42.601115] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:42.731330] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T21:17:42.984354] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-21T21:17:43.351080] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-10-21T21:17:44.151036] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-10-21T21:17:44.573308] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T21:17:44.762269] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-21T21:17:44.951056] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-10-21T21:17:45.082883] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T21:17:45.751027] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-10-21T21:17:46.353043] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T21:17:46.551053] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-10-21T21:17:47.350992] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-10-21T21:17:47.400336] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T21:17:48.039375] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-21T21:17:48.150976] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-10-21T21:17:48.721388] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T21:17:48.951056] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-10-21T21:17:49.751043] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-10-21T21:17:49.835427] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T21:17:50.480372] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-21T21:17:50.550991] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-10-21T21:17:51.064823] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T21:17:51.351032] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-10-21T21:17:52.151025] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-10-21T21:17:52.951036] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-10-21T21:17:53.014048] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-21T21:17:53.751095] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-10-21T21:17:54.050376] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-21T21:17:54.077841] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T21:17:54.551038] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-10-21T21:17:54.612144] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-21T21:17:55.351029] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-10-21T21:17:55.556675] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-21T21:17:56.152437] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-10-21T21:17:56.158520] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-21T21:17:56.951102] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-10. [2025-10-21T21:17:57.387446] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T21:17:57.714408] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-21T21:17:57.750988] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-10-21T21:17:57.871225] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T21:17:57.873535] [INFO ] [REMOTE ] STK: Full fetch complete (14359 records). [2025-10-21T21:17:57.873609] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-10-21T21:17:58.234089] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-10-21T21:17:58.234167] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-10-21T21:17:58.234479] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-10-21T21:17:58.234520] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-10-21T21:17:58.235003] [DEBUG] [LOCAL ] STK: Trimmed 14359 records to 9780 (keeping 200 days of data) [2025-10-21T21:17:58.294420] [DEBUG] [LOCAL ] STK: Primary data saved (9780 records). [2025-10-21T21:17:58.294560] [INFO ] [MAIN ] STK: Full history saved. [2025-10-21T21:17:58.294638] [INFO ] [MAIN ] Update Progress: 2005/2366 symbols completed. STK took 26.3s. Estimated remaining: 46m 26s. Rate: 7.8 symbols/min [2025-10-21T21:17:58.464385] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:17:58.504772] [DEBUG] [LOCAL ] STNG: Loaded 43623 existing records from primary storage. [2025-10-21T21:17:58.505065] [INFO ] [MAIN ] STNG: Loaded 43623 existing records. [2025-10-21T21:17:58.556296] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-10-21T21:17:58.708579] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:17:58.708854] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-10-21T21:17:58.708936] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-10-21T21:17:58.709428] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-10-21T21:17:58.709507] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-10-21T21:17:59.140891] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:17:59.351042] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-10-21T21:17:59.862114] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-21T21:18:00.151039] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-10-21T21:18:00.745494] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-21T21:18:00.951016] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-10-21T21:18:01.238838] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T21:18:01.751053] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-10-21T21:18:02.191731] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-21T21:18:02.551018] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-10-21T21:18:03.257728] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T21:18:03.351308] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-10-21T21:18:03.381321] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T21:18:03.478708] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-21T21:18:04.151056] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-10-21T21:18:04.951026] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-10-21T21:18:05.563771] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-21T21:18:05.751026] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-10-21T21:18:06.422319] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-21T21:18:06.551014] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-10-21T21:18:06.876303] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T21:18:07.351032] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-10-21T21:18:08.013536] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-21T21:18:08.151038] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-10. [2025-10-21T21:18:08.786482] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T21:18:08.950998] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-10-21T21:18:09.215078] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T21:18:09.751065] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-10-21T21:18:10.318980] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T21:18:10.411236] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-21T21:18:10.419436] [INFO ] [REMOTE ] STLA: Full fetch complete (77662 records). [2025-10-21T21:18:10.419553] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-10-21T21:18:10.559024] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-10-21T21:18:10.826137] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-10-21T21:18:10.826324] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-10-21T21:18:10.828339] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-10-21T21:18:10.828421] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-10-21T21:18:10.830338] [DEBUG] [LOCAL ] STLA: Trimmed 77662 records to 53557 (keeping 200 days of data) [2025-10-21T21:18:11.159509] [DEBUG] [LOCAL ] STLA: Primary data saved (53557 records). [2025-10-21T21:18:11.159670] [INFO ] [MAIN ] STLA: Full history saved. [2025-10-21T21:18:11.159759] [INFO ] [MAIN ] Update Progress: 2006/2366 symbols completed. STLA took 37.6s. Estimated remaining: 46m 19s. Rate: 7.8 symbols/min [2025-10-21T21:18:11.337285] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:18:11.349712] [DEBUG] [LOCAL ] STRV: Loaded 11011 existing records from primary storage. [2025-10-21T21:18:11.349926] [INFO ] [MAIN ] STRV: Loaded 11011 existing records. [2025-10-21T21:18:11.381599] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-10. [2025-10-21T21:18:11.567081] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:18:11.578878] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-10-21T21:18:11.579050] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-10-21T21:18:11.580832] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T21:18:11.589187] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-10-21T21:18:11.589852] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-10-21T21:18:11.715386] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T21:18:11.963896] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:18:12.151038] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-10. [2025-10-21T21:18:12.951057] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-10-21T21:18:13.325747] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T21:18:13.329457] [INFO ] [REMOTE ] STN: Full fetch complete (32640 records). [2025-10-21T21:18:13.329579] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-10-21T21:18:13.728672] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-10-21T21:18:13.728976] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-10-21T21:18:13.730149] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-10-21T21:18:13.731271] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-10-21T21:18:13.731177] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-10-21T21:18:13.740562] [DEBUG] [LOCAL ] STN: Trimmed 32640 records to 22707 (keeping 200 days of data) [2025-10-21T21:18:13.740722] [INFO ] [REMOTE ] STM: Full fetch complete (77695 records). [2025-10-21T21:18:13.741155] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-10-21T21:18:13.815229] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-10-21T21:18:14.036879] [DEBUG] [LOCAL ] STN: Primary data saved (22707 records). [2025-10-21T21:18:14.066433] [INFO ] [MAIN ] STN: Full history saved. [2025-10-21T21:18:14.087392] [INFO ] [MAIN ] Update Progress: 2007/2366 symbols completed. STN took 32.2s. Estimated remaining: 46m 11s. Rate: 7.8 symbols/min [2025-10-21T21:18:14.496815] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-10-21T21:18:14.498375] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:18:14.498529] [DEBUG] [LOCAL ] STT: No existing data file found in primary storage. [2025-10-21T21:18:14.496993] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-10-21T21:18:14.499956] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-10-21T21:18:14.500195] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-10-21T21:18:14.500030] [WARN ] [MAIN ] STT: No existing data found, performing full refresh instead. [2025-10-21T21:18:14.500941] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-10-21T21:18:14.501096] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-10-21T21:18:14.501315] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-10-21T21:18:14.501450] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-10-21T21:18:14.546719] [DEBUG] [LOCAL ] STM: Trimmed 77695 records to 53573 (keeping 200 days of data) [2025-10-21T21:18:15.070829] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-21T21:18:15.156292] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-10-21T21:18:15.155890] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:18:15.238311] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-21T21:18:15.263550] [DEBUG] [LOCAL ] STM: Primary data saved (53573 records). [2025-10-21T21:18:15.263706] [INFO ] [MAIN ] STM: Full history saved. [2025-10-21T21:18:15.263792] [INFO ] [MAIN ] Update Progress: 2008/2366 symbols completed. STM took 37.0s. Estimated remaining: 46m 2s. Rate: 7.8 symbols/min [2025-10-21T21:18:15.356142] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-10-21T21:18:15.435887] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:18:15.436045] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-10-21T21:18:15.436081] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-10-21T21:18:15.436208] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-10-21T21:18:15.436249] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-21T21:18:15.436289] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-21T21:18:15.436320] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-10-21T21:18:15.795064] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:18:16.151051] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-10-21T21:18:16.951055] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-10-21T21:18:17.141215] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-21T21:18:17.247249] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:18:17.247581] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-10-21T21:18:17.247710] [FATAL] [REMOTE ] STUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:18:17.247770] [FATAL] [MAIN ] STUB: Failed to fetch primary data. [2025-10-21T21:18:17.247829] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:18:17.247876] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-10-21T21:18:17.247931] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-10-21T21:18:17.247966] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-10-21T21:18:17.248005] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-10-21T21:18:17.248051] [INFO ] [MAIN ] Update Progress: 2009/2366 symbols completed. STUB took 2.0s. Estimated remaining: 45m 53s. Rate: 7.8 symbols/min [2025-10-21T21:18:17.431408] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T21:18:17.430967] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:18:17.465828] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-21T21:18:17.498088] [DEBUG] [LOCAL ] STVN: Loaded 26823 existing records from primary storage. [2025-10-21T21:18:17.498345] [INFO ] [MAIN ] STVN: Loaded 26823 existing records. [2025-10-21T21:18:17.691420] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:18:17.691672] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-10-21T21:18:17.691731] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-10-21T21:18:17.692152] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-10-21T21:18:17.692208] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-10-21T21:18:17.756094] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-10-21T21:18:18.037489] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:18:18.551048] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-10-21T21:18:18.829756] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T21:18:19.351026] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-10-21T21:18:19.907429] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-21T21:18:20.151013] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-10-21T21:18:20.951071] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-10-21T21:18:21.215003] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-21T21:18:21.354826] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T21:18:21.751005] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-10-21T21:18:22.327728] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T21:18:22.550992] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-10-21T21:18:22.701111] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T21:18:23.351024] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-10-21T21:18:24.151016] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-10-21T21:18:24.205416] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T21:18:24.291999] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-21T21:18:24.951018] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-10-21T21:18:25.751052] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-10-21T21:18:26.026365] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T21:18:26.535946] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T21:18:26.550991] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-10. [2025-10-21T21:18:27.040245] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T21:18:27.351039] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-10-21T21:18:28.151070] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-10-21T21:18:28.254384] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T21:18:28.260660] [INFO ] [REMOTE ] STNG: Full fetch complete (64180 records). [2025-10-21T21:18:28.260755] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-10-21T21:18:28.640812] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-10-21T21:18:28.640904] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-10-21T21:18:28.641998] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-10-21T21:18:28.642060] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-10-21T21:18:28.643377] [DEBUG] [LOCAL ] STNG: Trimmed 64180 records to 43434 (keeping 200 days of data) [2025-10-21T21:18:28.855230] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T21:18:28.945155] [DEBUG] [LOCAL ] STNG: Primary data saved (43434 records). [2025-10-21T21:18:28.945278] [INFO ] [MAIN ] STNG: Full history saved. [2025-10-21T21:18:28.945989] [INFO ] [MAIN ] Update Progress: 2010/2366 symbols completed. STNG took 30.7s. Estimated remaining: 45m 46s. Rate: 7.8 symbols/min [2025-10-21T21:18:28.957450] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-10-21T21:18:29.062385] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-21T21:18:29.127303] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:18:29.127421] [DEBUG] [LOCAL ] STWD: No existing data file found in primary storage. [2025-10-21T21:18:29.127457] [WARN ] [MAIN ] STWD: No existing data found, performing full refresh instead. [2025-10-21T21:18:29.127564] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-10-21T21:18:29.127635] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-10-21T21:18:29.127720] [DEBUG] [LOCAL ] STWD: No primary data file found to delete. [2025-10-21T21:18:29.127766] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-10-21T21:18:29.471213] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:18:29.751031] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-10-21T21:18:30.268931] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T21:18:30.551052] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-10-21T21:18:31.351048] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-10-21T21:18:31.645144] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T21:18:31.958020] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T21:18:32.151017] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-10-21T21:18:32.951017] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-10-21T21:18:33.204899] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T21:18:33.751073] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-10-21T21:18:33.807113] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T21:18:33.994685] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T21:18:34.551014] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-10-21T21:18:35.351012] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-10-21T21:18:35.388453] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T21:18:35.705877] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T21:18:36.151024] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-10-21T21:18:36.951094] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-10-21T21:18:37.140406] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T21:18:37.751037] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-10-21T21:18:38.029032] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T21:18:38.175174] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T21:18:38.551131] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-10-21T21:18:39.351125] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-10. [2025-10-21T21:18:39.948722] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-21T21:18:40.151011] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-10-21T21:18:40.212710] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T21:18:40.214615] [INFO ] [REMOTE ] STRV: Full fetch complete (17400 records). [2025-10-21T21:18:40.214705] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-10-21T21:18:40.576552] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-10-21T21:18:40.576633] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-10-21T21:18:40.576996] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-10-21T21:18:40.577054] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-10-21T21:18:40.577515] [DEBUG] [LOCAL ] STRV: Trimmed 17400 records to 10844 (keeping 200 days of data) [2025-10-21T21:18:40.640614] [DEBUG] [LOCAL ] STRV: Primary data saved (10844 records). [2025-10-21T21:18:40.640941] [INFO ] [MAIN ] STRV: Full history saved. [2025-10-21T21:18:40.641034] [INFO ] [MAIN ] Update Progress: 2011/2366 symbols completed. STRV took 29.5s. Estimated remaining: 45m 39s. Rate: 7.8 symbols/min [2025-10-21T21:18:40.807060] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:18:40.810407] [DEBUG] [LOCAL ] STXD: Loaded 1245 existing records from primary storage. [2025-10-21T21:18:40.810535] [INFO ] [MAIN ] STXD: Loaded 1245 existing records. [2025-10-21T21:18:40.957009] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-10-21T21:18:40.986054] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:18:40.986397] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-10-21T21:18:40.986463] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-10-21T21:18:40.986636] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-10-21T21:18:40.986734] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-10-21T21:18:41.344937] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:18:41.750990] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-10-21T21:18:42.447194] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T21:18:42.449790] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (3.90 seconds). [2025-10-21T21:18:42.550975] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-10-21T21:18:43.161266] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (3.01 seconds). [2025-10-21T21:18:43.219447] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-21T21:18:43.350985] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-10-21T21:18:44.151015] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-10-21T21:18:44.369802] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T21:18:44.745459] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T21:18:44.802348] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-21T21:18:44.951043] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-10-21T21:18:45.534198] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T21:18:45.750996] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-10-21T21:18:46.551036] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-10. [2025-10-21T21:18:46.717801] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T21:18:47.351016] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-10-21T21:18:47.759261] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T21:18:47.763779] [INFO ] [REMOTE ] STVN: Full fetch complete (39305 records). [2025-10-21T21:18:47.763862] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-10-21T21:18:47.930092] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-21T21:18:48.142203] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-10-21T21:18:48.142274] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-10-21T21:18:48.143042] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-10-21T21:18:48.143104] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-10-21T21:18:48.143926] [DEBUG] [LOCAL ] STVN: Trimmed 39305 records to 26735 (keeping 200 days of data) [2025-10-21T21:18:48.191989] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-10-21T21:18:48.301167] [DEBUG] [LOCAL ] STVN: Primary data saved (26735 records). [2025-10-21T21:18:48.301318] [INFO ] [MAIN ] STVN: Full history saved. [2025-10-21T21:18:48.301403] [INFO ] [MAIN ] Update Progress: 2012/2366 symbols completed. STVN took 31.1s. Estimated remaining: 45m 31s. Rate: 7.8 symbols/min [2025-10-21T21:18:48.486922] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:18:48.491722] [DEBUG] [LOCAL ] STXE: Loaded 2087 existing records from primary storage. [2025-10-21T21:18:48.491884] [INFO ] [MAIN ] STXE: Loaded 2087 existing records. [2025-10-21T21:18:48.693545] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:18:48.693851] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-10-21T21:18:48.693924] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-10-21T21:18:48.694091] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-10-21T21:18:48.694147] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-10-21T21:18:48.956327] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-10-21T21:18:49.072550] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:18:49.558722] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T21:18:49.751028] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-10-21T21:18:50.194489] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-21T21:18:50.222394] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T21:18:50.551071] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-10-21T21:18:51.351025] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-10-21T21:18:51.811140] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-21T21:18:52.150984] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-10. [2025-10-21T21:18:52.627251] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-21T21:18:52.951077] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-10-21T21:18:53.741910] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T21:18:53.750971] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-10-21T21:18:54.335766] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T21:18:54.550985] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-10-21T21:18:54.735088] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-10 (2.58 seconds). [2025-10-21T21:18:54.742942] [INFO ] [REMOTE ] STT: Full fetch complete (74515 records). [2025-10-21T21:18:54.743054] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-10-21T21:18:54.982956] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-21T21:18:55.136796] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-10-21T21:18:55.136868] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-10-21T21:18:55.138023] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-10-21T21:18:55.138084] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-10-21T21:18:55.139366] [DEBUG] [LOCAL ] STT: Trimmed 74515 records to 51089 (keeping 200 days of data) [2025-10-21T21:18:55.351048] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-10-21T21:18:55.455777] [DEBUG] [LOCAL ] STT: Primary data saved (51089 records). [2025-10-21T21:18:55.455923] [INFO ] [MAIN ] STT: Full history saved. [2025-10-21T21:18:55.456017] [INFO ] [MAIN ] Update Progress: 2013/2366 symbols completed. STT took 41.3s. Estimated remaining: 45m 24s. Rate: 7.8 symbols/min [2025-10-21T21:18:55.623577] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:18:55.623753] [DEBUG] [LOCAL ] STXG: No existing data file found in primary storage. [2025-10-21T21:18:55.623796] [WARN ] [MAIN ] STXG: No existing data found, performing full refresh instead. [2025-10-21T21:18:55.623899] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-10-21T21:18:55.623939] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-10-21T21:18:55.623979] [DEBUG] [LOCAL ] STXG: No primary data file found to delete. [2025-10-21T21:18:55.624010] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-10-21T21:18:55.978767] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:18:56.042013] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-21T21:18:56.150978] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-10-21T21:18:56.850034] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T21:18:56.950980] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-10-21T21:18:57.634067] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-21T21:18:57.750998] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-10-21T21:18:58.223162] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-21T21:18:58.551050] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-10-21T21:18:59.325883] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T21:18:59.350981] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-10-21T21:19:00.108004] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T21:19:00.151045] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-10-21T21:19:00.810417] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-21T21:19:00.951096] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-10. [2025-10-21T21:19:01.599589] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-21T21:19:01.600547] [INFO ] [REMOTE ] STXD: Full fetch complete (2154 records). [2025-10-21T21:19:01.600614] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-10-21T21:19:01.756151] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-10-21T21:19:01.971948] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-10-21T21:19:01.972023] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-10-21T21:19:01.972113] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-10-21T21:19:01.972150] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-10-21T21:19:01.972463] [DEBUG] [LOCAL ] STXD: Trimmed 2154 records to 1345 (keeping 200 days of data) [2025-10-21T21:19:01.980761] [DEBUG] [LOCAL ] STXD: Primary data saved (1345 records). [2025-10-21T21:19:01.980821] [INFO ] [MAIN ] STXD: Full history saved. [2025-10-21T21:19:01.980883] [INFO ] [MAIN ] Update Progress: 2014/2366 symbols completed. STXD took 21.3s. Estimated remaining: 45m 16s. Rate: 7.8 symbols/min [2025-10-21T21:19:02.156391] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:02.163630] [DEBUG] [LOCAL ] STXK: Loaded 1512 existing records from primary storage. [2025-10-21T21:19:02.163821] [INFO ] [MAIN ] STXK: Loaded 1512 existing records. [2025-10-21T21:19:02.342010] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:19:02.342861] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-10-21T21:19:02.342974] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-10-21T21:19:02.343207] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-10-21T21:19:02.343280] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-10-21T21:19:02.505770] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-21T21:19:02.559000] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-10-21T21:19:02.715939] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:03.330885] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T21:19:03.351063] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-10-21T21:19:03.960603] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-21T21:19:04.151048] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-10-21T21:19:04.827744] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T21:19:04.950978] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-10-21T21:19:05.492031] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-21T21:19:05.751080] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-10-21T21:19:06.551068] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-10-21T21:19:07.123617] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T21:19:07.351000] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-10-21T21:19:07.674515] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T21:19:07.911365] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-21T21:19:08.151039] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-10-21T21:19:08.765403] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T21:19:08.950999] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-10-21T21:19:09.570679] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T21:19:09.751008] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-10-21T21:19:10.338821] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T21:19:10.551064] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-10-21T21:19:11.141499] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T21:19:11.351014] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-10-21T21:19:11.947258] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T21:19:12.151069] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-10-21T21:19:12.737779] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T21:19:12.951038] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-10-21T21:19:13.562423] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T21:19:13.751056] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-10-21T21:19:14.366495] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T21:19:14.551026] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-10-21T21:19:15.118321] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T21:19:15.351070] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-10. [2025-10-21T21:19:15.988440] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T21:19:15.989483] [INFO ] [REMOTE ] STXG: Full fetch complete (4046 records). [2025-10-21T21:19:15.989567] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-10-21T21:19:16.155150] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-10-21T21:19:16.359941] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-10-21T21:19:16.360016] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-10-21T21:19:16.360144] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-10-21T21:19:16.360181] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-10-21T21:19:16.360531] [DEBUG] [LOCAL ] STXG: Trimmed 4046 records to 2349 (keeping 200 days of data) [2025-10-21T21:19:16.374487] [DEBUG] [LOCAL ] STXG: Primary data saved (2349 records). [2025-10-21T21:19:16.374545] [INFO ] [MAIN ] STXG: Full history saved. [2025-10-21T21:19:16.374603] [INFO ] [MAIN ] Update Progress: 2015/2366 symbols completed. STXG took 20.9s. Estimated remaining: 45m 9s. Rate: 7.8 symbols/min [2025-10-21T21:19:16.540435] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:16.540590] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-10-21T21:19:16.540626] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-10-21T21:19:16.540774] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-10-21T21:19:16.540814] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-21T21:19:16.540853] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-21T21:19:16.540893] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-10-21T21:19:16.888199] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:16.950985] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-10-21T21:19:17.450922] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-21T21:19:17.751078] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-10-21T21:19:18.156367] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-21T21:19:18.551007] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-10-21T21:19:19.085033] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T21:19:19.115253] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-21T21:19:19.351033] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-10. [2025-10-21T21:19:20.049243] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T21:19:20.050225] [INFO ] [REMOTE ] STXE: Full fetch complete (3492 records). [2025-10-21T21:19:20.050293] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-10-21T21:19:20.156195] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-10-21T21:19:20.428525] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-10-21T21:19:20.428600] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-10-21T21:19:20.428754] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-10-21T21:19:20.428832] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-10-21T21:19:20.429216] [DEBUG] [LOCAL ] STXE: Trimmed 3492 records to 2078 (keeping 200 days of data) [2025-10-21T21:19:20.441708] [DEBUG] [LOCAL ] STXE: Primary data saved (2078 records). [2025-10-21T21:19:20.441770] [INFO ] [MAIN ] STXE: Full history saved. [2025-10-21T21:19:20.441834] [INFO ] [MAIN ] Update Progress: 2016/2366 symbols completed. STXE took 32.1s. Estimated remaining: 45m 1s. Rate: 7.8 symbols/min [2025-10-21T21:19:20.623959] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:20.629009] [DEBUG] [LOCAL ] STXT: Loaded 2492 existing records from primary storage. [2025-10-21T21:19:20.629168] [INFO ] [MAIN ] STXT: Loaded 2492 existing records. [2025-10-21T21:19:20.707534] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T21:19:20.821946] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:19:20.822176] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-10-21T21:19:20.822235] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-10-21T21:19:20.822372] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-10-21T21:19:20.822429] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-10-21T21:19:20.956110] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-10. [2025-10-21T21:19:21.190451] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:21.526219] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-21T21:19:21.527121] [INFO ] [REMOTE ] STXK: Full fetch complete (2397 records). [2025-10-21T21:19:21.527188] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-10-21T21:19:21.756265] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-10. [2025-10-21T21:19:21.884539] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-10-21T21:19:21.884619] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-10-21T21:19:21.884779] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-10-21T21:19:21.884834] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-10-21T21:19:21.885188] [DEBUG] [LOCAL ] STXK: Trimmed 2397 records to 1487 (keeping 200 days of data) [2025-10-21T21:19:21.895057] [DEBUG] [LOCAL ] STXK: Primary data saved (1487 records). [2025-10-21T21:19:21.895116] [INFO ] [MAIN ] STXK: Full history saved. [2025-10-21T21:19:21.895180] [INFO ] [MAIN ] Update Progress: 2017/2366 symbols completed. STXK took 19.9s. Estimated remaining: 44m 52s. Rate: 7.8 symbols/min [2025-10-21T21:19:22.059663] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:22.063303] [DEBUG] [LOCAL ] STXV: Loaded 1488 existing records from primary storage. [2025-10-21T21:19:22.063436] [INFO ] [MAIN ] STXV: Loaded 1488 existing records. [2025-10-21T21:19:22.253501] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:19:22.253774] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-10-21T21:19:22.253828] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-10-21T21:19:22.253953] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-10-21T21:19:22.253990] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-10-21T21:19:22.558378] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-10-21T21:19:22.650427] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:23.056244] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T21:19:23.351042] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-10-21T21:19:23.776034] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-21T21:19:23.784316] [INFO ] [REMOTE ] STWD: Full fetch complete (75357 records). [2025-10-21T21:19:23.784451] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-10-21T21:19:24.083855] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-21T21:19:24.151703] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-10-21T21:19:24.193474] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-10-21T21:19:24.193573] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-10-21T21:19:24.194968] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-10-21T21:19:24.195037] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-10-21T21:19:24.196761] [DEBUG] [LOCAL ] STWD: Trimmed 75357 records to 51968 (keeping 200 days of data) [2025-10-21T21:19:24.527919] [DEBUG] [LOCAL ] STWD: Primary data saved (51968 records). [2025-10-21T21:19:24.528080] [INFO ] [MAIN ] STWD: Full history saved. [2025-10-21T21:19:24.528162] [INFO ] [MAIN ] Update Progress: 2018/2366 symbols completed. STWD took 55.6s. Estimated remaining: 44m 43s. Rate: 7.8 symbols/min [2025-10-21T21:19:24.707187] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:24.708030] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T21:19:24.708153] [DEBUG] [LOCAL ] STZ: No existing data file found in primary storage. [2025-10-21T21:19:24.709622] [WARN ] [MAIN ] STZ: No existing data found, performing full refresh instead. [2025-10-21T21:19:24.709768] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-10-21T21:19:24.709811] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-21T21:19:24.709873] [DEBUG] [LOCAL ] STZ: No primary data file found to delete. [2025-10-21T21:19:24.709905] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-10-21T21:19:24.956209] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-10-21T21:19:25.066526] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:25.541184] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T21:19:25.751042] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-10-21T21:19:26.551074] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-10-21T21:19:27.042328] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-21T21:19:27.351012] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-10-21T21:19:27.974406] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T21:19:28.151080] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-10-21T21:19:28.520985] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-21T21:19:28.568811] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (2.82 seconds). [2025-10-21T21:19:28.951080] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-10-21T21:19:29.751078] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-10-21T21:19:30.550995] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-10-21T21:19:30.600791] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T21:19:31.025971] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-21T21:19:31.174405] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T21:19:31.351042] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-10-21T21:19:32.151054] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-10-21T21:19:32.830412] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-21T21:19:32.951046] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-10-21T21:19:33.468744] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-21T21:19:33.522571] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-21T21:19:33.751058] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-10-21T21:19:34.550995] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-10-21T21:19:34.580083] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T21:19:34.658042] [DEBUG] [REMOTE ] STZ: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T21:19:34.658386] [WARN ] [REMOTE ] STZ: No data returned for month 2025-04 [2025-10-21T21:19:34.658504] [FATAL] [REMOTE ] STZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:19:34.658626] [FATAL] [MAIN ] STZ: Failed to fetch primary data. [2025-10-21T21:19:34.658730] [WARN ] [MAIN ] STZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:19:34.658823] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-10-21T21:19:34.658917] [DEBUG] [LOCAL ] STZ: No primary data file found to delete. [2025-10-21T21:19:34.658980] [INFO ] [LOCAL ] STZ: Starting deletion of derivative data. [2025-10-21T21:19:34.659052] [DEBUG] [LOCAL ] STZ: No derivative data file found to delete. [2025-10-21T21:19:34.659130] [INFO ] [MAIN ] Update Progress: 2019/2366 symbols completed. STZ took 10.1s. Estimated remaining: 44m 36s. Rate: 7.8 symbols/min [2025-10-21T21:19:34.840562] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:34.840741] [DEBUG] [LOCAL ] SU: No existing data file found in primary storage. [2025-10-21T21:19:34.840806] [WARN ] [MAIN ] SU: No existing data found, performing full refresh instead. [2025-10-21T21:19:34.840914] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-10-21T21:19:34.840954] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-10-21T21:19:34.841010] [DEBUG] [LOCAL ] SU: No primary data file found to delete. [2025-10-21T21:19:34.841076] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-10-21T21:19:35.214787] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:35.351030] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-10-21T21:19:35.764208] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-21T21:19:36.151004] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-10-21T21:19:36.591604] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T21:19:36.951077] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-10-21T21:19:37.389618] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-21T21:19:37.751036] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-10-21T21:19:38.293764] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-21T21:19:38.551076] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-10-21T21:19:39.027266] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T21:19:39.351075] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-10-21T21:19:39.829546] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T21:19:40.150995] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-10. [2025-10-21T21:19:40.621052] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T21:19:40.621775] [INFO ] [REMOTE ] STXM: Full fetch complete (1395 records). [2025-10-21T21:19:40.621840] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-10-21T21:19:40.795084] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-21T21:19:40.795325] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:19:40.795394] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:19:40.795461] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-10-21T21:19:40.795520] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-10-21T21:19:40.795553] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-10-21T21:19:40.795596] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-10-21T21:19:40.795679] [INFO ] [MAIN ] Update Progress: 2020/2366 symbols completed. STXM took 24.4s. Estimated remaining: 44m 28s. Rate: 7.8 symbols/min [2025-10-21T21:19:40.954689] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-10-21T21:19:40.962585] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:41.003153] [DEBUG] [LOCAL ] SUI: Loaded 42016 existing records from primary storage. [2025-10-21T21:19:41.003426] [INFO ] [MAIN ] SUI: Loaded 42016 existing records. [2025-10-21T21:19:41.175848] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:19:41.176080] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-10-21T21:19:41.176126] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-10-21T21:19:41.176319] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-10-21T21:19:41.176387] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-10-21T21:19:41.494255] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T21:19:41.527927] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:41.751048] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-10-21T21:19:42.320576] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T21:19:42.551057] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-10-21T21:19:43.351080] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-10-21T21:19:43.852299] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T21:19:44.151002] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-10-21T21:19:44.251984] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T21:19:44.764021] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T21:19:44.951013] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-10-21T21:19:45.541416] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T21:19:45.751046] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-10-21T21:19:46.493340] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T21:19:46.551028] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-10-21T21:19:47.351082] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-10-21T21:19:48.000116] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-21T21:19:48.151015] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-10. [2025-10-21T21:19:48.352710] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T21:19:48.624263] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T21:19:48.625132] [INFO ] [REMOTE ] STXV: Full fetch complete (2517 records). [2025-10-21T21:19:48.625199] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-10-21T21:19:48.960510] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-10-21T21:19:48.981419] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-10-21T21:19:48.981495] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-10-21T21:19:48.981589] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-10-21T21:19:48.981628] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-10-21T21:19:48.981975] [DEBUG] [LOCAL ] STXV: Trimmed 2517 records to 1469 (keeping 200 days of data) [2025-10-21T21:19:48.991404] [DEBUG] [LOCAL ] STXV: Primary data saved (1469 records). [2025-10-21T21:19:48.991579] [INFO ] [MAIN ] STXV: Full history saved. [2025-10-21T21:19:48.991680] [INFO ] [MAIN ] Update Progress: 2021/2366 symbols completed. STXV took 27.1s. Estimated remaining: 44m 20s. Rate: 7.8 symbols/min [2025-10-21T21:19:49.158056] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:49.193405] [DEBUG] [LOCAL ] SUN: Loaded 38845 existing records from primary storage. [2025-10-21T21:19:49.193692] [INFO ] [MAIN ] SUN: Loaded 38845 existing records. [2025-10-21T21:19:49.367169] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:19:49.367354] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-10-21T21:19:49.367401] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-10-21T21:19:49.367601] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-10-21T21:19:49.367697] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-10-21T21:19:49.720907] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:49.750982] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-10-21T21:19:50.551019] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-10-21T21:19:50.693435] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T21:19:51.351055] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-10-21T21:19:51.409043] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T21:19:52.151019] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-10-21T21:19:52.275399] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T21:19:52.923245] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T21:19:52.952875] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-10-21T21:19:52.954317] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T21:19:53.751025] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-10. [2025-10-21T21:19:54.295733] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-21T21:19:54.296676] [INFO ] [REMOTE ] STXT: Full fetch complete (3889 records). [2025-10-21T21:19:54.296745] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-10-21T21:19:54.555411] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-10-21T21:19:54.667231] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-10-21T21:19:54.667378] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-10-21T21:19:54.667591] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-10-21T21:19:54.667704] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-10-21T21:19:54.668246] [DEBUG] [LOCAL ] STXT: Trimmed 3889 records to 2505 (keeping 200 days of data) [2025-10-21T21:19:54.687807] [DEBUG] [LOCAL ] STXT: Primary data saved (2505 records). [2025-10-21T21:19:54.703007] [INFO ] [MAIN ] STXT: Full history saved. [2025-10-21T21:19:54.715367] [INFO ] [MAIN ] Update Progress: 2022/2366 symbols completed. STXT took 34.3s. Estimated remaining: 44m 12s. Rate: 7.8 symbols/min [2025-10-21T21:19:54.717201] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-21T21:19:54.898393] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:19:54.945675] [DEBUG] [LOCAL ] SUPV: Loaded 48009 existing records from primary storage. [2025-10-21T21:19:54.945968] [INFO ] [MAIN ] SUPV: Loaded 48009 existing records. [2025-10-21T21:19:55.123835] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:19:55.124064] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-10-21T21:19:55.124136] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-10-21T21:19:55.124428] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-10-21T21:19:55.124493] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-10-21T21:19:55.356839] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-10-21T21:19:55.484082] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:19:56.151111] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-10-21T21:19:56.291475] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T21:19:56.951109] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-10-21T21:19:57.385797] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T21:19:57.751016] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-10-21T21:19:57.973471] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T21:19:58.483358] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T21:19:58.550984] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-10-21T21:19:59.351025] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-10-21T21:19:59.649517] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T21:20:00.151073] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-10-21T21:20:00.206342] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T21:20:00.951008] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-10-21T21:20:01.032977] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T21:20:01.751003] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-10-21T21:20:02.131532] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T21:20:02.551073] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-10-21T21:20:02.778967] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T21:20:03.302014] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T21:20:03.351019] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-10-21T21:20:04.151021] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-10-21T21:20:04.300128] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T21:20:04.951061] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-10-21T21:20:05.336813] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T21:20:05.595270] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T21:20:05.751060] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-10-21T21:20:06.551031] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-10-21T21:20:06.862487] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T21:20:07.351014] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-10-21T21:20:07.626274] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T21:20:08.096300] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T21:20:08.151026] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-10-21T21:20:08.951004] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-10-21T21:20:09.198620] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T21:20:09.751032] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-10-21T21:20:09.829235] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:20:10.551033] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-10-21T21:20:10.607286] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T21:20:11.356133] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-10-21T21:20:11.370600] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T21:20:12.151024] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-10-21T21:20:12.394253] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-21T21:20:12.951011] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-10. [2025-10-21T21:20:13.653853] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-21T21:20:13.751072] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-10-21T21:20:14.551143] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-10. [2025-10-21T21:20:14.703033] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-10-21T21:20:14.772208] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T21:20:14.780418] [INFO ] [REMOTE ] SU: Full fetch complete (77568 records). [2025-10-21T21:20:14.780542] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-10-21T21:20:15.172570] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-10-21T21:20:15.172677] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-10-21T21:20:15.173901] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-10-21T21:20:15.173963] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-10-21T21:20:15.175383] [DEBUG] [LOCAL ] SU: Trimmed 77568 records to 53432 (keeping 200 days of data) [2025-10-21T21:20:15.352629] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-10-21T21:20:15.530151] [DEBUG] [LOCAL ] SU: Primary data saved (53432 records). [2025-10-21T21:20:15.530885] [INFO ] [MAIN ] SU: Full history saved. [2025-10-21T21:20:15.531776] [INFO ] [MAIN ] Update Progress: 2023/2366 symbols completed. SU took 40.9s. Estimated remaining: 44m 7s. Rate: 7.8 symbols/min [2025-10-21T21:20:15.531623] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T21:20:15.723964] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:20:15.766605] [DEBUG] [LOCAL ] SUZ: Loaded 45627 existing records from primary storage. [2025-10-21T21:20:15.766945] [INFO ] [MAIN ] SUZ: Loaded 45627 existing records. [2025-10-21T21:20:15.946976] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:20:15.947186] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-10-21T21:20:15.947237] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-10-21T21:20:15.947423] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-10-21T21:20:15.947473] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-10-21T21:20:16.156171] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-10-21T21:20:16.311135] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:20:16.329311] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T21:20:16.335949] [INFO ] [REMOTE ] SUI: Full fetch complete (60842 records). [2025-10-21T21:20:16.336067] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-10-21T21:20:16.726957] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-10-21T21:20:16.727029] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-10-21T21:20:16.728100] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-10-21T21:20:16.728161] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-10-21T21:20:16.729290] [DEBUG] [LOCAL ] SUI: Trimmed 60842 records to 41883 (keeping 200 days of data) [2025-10-21T21:20:16.951582] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-10-21T21:20:16.984601] [DEBUG] [LOCAL ] SUI: Primary data saved (41883 records). [2025-10-21T21:20:16.984803] [INFO ] [MAIN ] SUI: Full history saved. [2025-10-21T21:20:16.984955] [INFO ] [MAIN ] Update Progress: 2024/2366 symbols completed. SUI took 36.2s. Estimated remaining: 43m 58s. Rate: 7.8 symbols/min [2025-10-21T21:20:17.171021] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:20:17.207945] [DEBUG] [LOCAL ] SVV: Loaded 40326 existing records from primary storage. [2025-10-21T21:20:17.208222] [INFO ] [MAIN ] SVV: Loaded 40326 existing records. [2025-10-21T21:20:17.399321] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:20:17.399860] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-10-21T21:20:17.399915] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-10-21T21:20:17.400163] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-10-21T21:20:17.400223] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-10-21T21:20:17.646011] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-21T21:20:17.751497] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-10-21T21:20:17.817481] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:20:17.842227] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T21:20:18.551034] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-10-21T21:20:18.713269] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T21:20:19.351077] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-10-21T21:20:20.129133] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T21:20:20.151056] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-10-21T21:20:20.340924] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-10-21T21:20:20.951035] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-10. [2025-10-21T21:20:21.023766] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T21:20:21.720189] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T21:20:21.750992] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-10-21T21:20:22.436005] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T21:20:22.444150] [INFO ] [REMOTE ] SUPV: Full fetch complete (68961 records). [2025-10-21T21:20:22.444286] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-10-21T21:20:22.553914] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-10-21T21:20:22.847429] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-10-21T21:20:22.847561] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-10-21T21:20:22.849094] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-10-21T21:20:22.849159] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-10-21T21:20:22.850601] [DEBUG] [LOCAL ] SUPV: Trimmed 68961 records to 48049 (keeping 200 days of data) [2025-10-21T21:20:23.126631] [DEBUG] [LOCAL ] SUPV: Primary data saved (48049 records). [2025-10-21T21:20:23.126793] [INFO ] [MAIN ] SUPV: Full history saved. [2025-10-21T21:20:23.127602] [INFO ] [MAIN ] Update Progress: 2025/2366 symbols completed. SUPV took 28.4s. Estimated remaining: 43m 50s. Rate: 7.8 symbols/min [2025-10-21T21:20:23.300773] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:20:23.351620] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-10-21T21:20:23.353788] [DEBUG] [LOCAL ] SW: Loaded 53179 existing records from primary storage. [2025-10-21T21:20:23.354089] [INFO ] [MAIN ] SW: Loaded 53179 existing records. [2025-10-21T21:20:23.536144] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:20:23.536505] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-10-21T21:20:23.536599] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-10-21T21:20:23.536992] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-10-21T21:20:23.537053] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-10-21T21:20:23.676151] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-21T21:20:23.945312] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:20:23.971224] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T21:20:24.151043] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-10-21T21:20:24.951048] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-10-21T21:20:25.687380] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-10-21T21:20:25.750999] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-10-21T21:20:25.996397] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T21:20:26.551073] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-10-21T21:20:26.809732] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T21:20:27.062730] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T21:20:27.351103] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-10-21T21:20:27.817052] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T21:20:28.151041] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-10-21T21:20:28.951067] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-10-21T21:20:29.216316] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T21:20:29.751004] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-10-21T21:20:29.931767] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T21:20:30.508993] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T21:20:30.550998] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-10-21T21:20:31.351050] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-10. [2025-10-21T21:20:31.556527] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-21T21:20:32.151011] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-10-21T21:20:32.294181] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T21:20:32.950996] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-10-21T21:20:33.058903] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T21:20:33.065434] [INFO ] [REMOTE ] SUN: Full fetch complete (55571 records). [2025-10-21T21:20:33.065557] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-10-21T21:20:33.439945] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-10-21T21:20:33.440020] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-10-21T21:20:33.441053] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-10-21T21:20:33.441113] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-10-21T21:20:33.442171] [DEBUG] [LOCAL ] SUN: Trimmed 55571 records to 38843 (keeping 200 days of data) [2025-10-21T21:20:33.677386] [DEBUG] [LOCAL ] SUN: Primary data saved (38843 records). [2025-10-21T21:20:33.677514] [INFO ] [MAIN ] SUN: Full history saved. [2025-10-21T21:20:33.677612] [INFO ] [MAIN ] Update Progress: 2026/2366 symbols completed. SUN took 44.7s. Estimated remaining: 43m 43s. Rate: 7.8 symbols/min [2025-10-21T21:20:33.758749] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-10-21T21:20:33.855716] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:20:33.903352] [DEBUG] [LOCAL ] SWK: Loaded 52434 existing records from primary storage. [2025-10-21T21:20:33.903675] [INFO ] [MAIN ] SWK: Loaded 52434 existing records. [2025-10-21T21:20:34.088373] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:20:34.088835] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-10-21T21:20:34.088989] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-10-21T21:20:34.089409] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-10-21T21:20:34.089518] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-10-21T21:20:34.190465] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T21:20:34.479990] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:20:34.551061] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-10-21T21:20:34.758708] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-21T21:20:35.351033] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-10-21T21:20:35.577334] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T21:20:36.087866] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T21:20:36.150995] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-10-21T21:20:36.951010] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-10-21T21:20:37.275502] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-21T21:20:37.751027] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-10-21T21:20:37.972498] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T21:20:38.551025] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-10-21T21:20:38.641866] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T21:20:39.350994] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-10-21T21:20:39.729835] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-21T21:20:40.151012] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-10-21T21:20:40.542042] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T21:20:40.668990] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T21:20:40.951042] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-10. [2025-10-21T21:20:41.751027] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-10-21T21:20:41.875638] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T21:20:42.550998] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-10-21T21:20:42.574673] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T21:20:42.581549] [INFO ] [REMOTE ] SVV: Full fetch complete (57471 records). [2025-10-21T21:20:42.581685] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-10-21T21:20:42.976762] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-10-21T21:20:42.976858] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-10-21T21:20:42.977971] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-10-21T21:20:42.978077] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-10-21T21:20:42.979314] [DEBUG] [LOCAL ] SVV: Trimmed 57471 records to 40296 (keeping 200 days of data) [2025-10-21T21:20:43.214948] [DEBUG] [LOCAL ] SVV: Primary data saved (40296 records). [2025-10-21T21:20:43.215098] [INFO ] [MAIN ] SVV: Full history saved. [2025-10-21T21:20:43.215184] [INFO ] [MAIN ] Update Progress: 2027/2366 symbols completed. SVV took 26.2s. Estimated remaining: 43m 36s. Rate: 7.8 symbols/min [2025-10-21T21:20:43.351444] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-10-21T21:20:43.439112] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:20:43.444383] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-21T21:20:43.485140] [DEBUG] [LOCAL ] SWX: Loaded 30791 existing records from primary storage. [2025-10-21T21:20:43.485429] [INFO ] [MAIN ] SWX: Loaded 30791 existing records. [2025-10-21T21:20:43.691764] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:20:43.691983] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-10-21T21:20:43.692031] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-10-21T21:20:43.692233] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-10-21T21:20:43.692308] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-10-21T21:20:44.105696] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:20:44.150988] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-10-21T21:20:44.246084] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T21:20:44.951005] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-10-21T21:20:45.383167] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-21T21:20:45.416578] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-21T21:20:45.751021] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-10-21T21:20:46.551023] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-10-21T21:20:46.690229] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T21:20:47.351050] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-10-21T21:20:47.575409] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T21:20:47.790084] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-21T21:20:48.151042] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-10. [2025-10-21T21:20:48.951002] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-10-21T21:20:49.030916] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:20:49.601219] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T21:20:49.610158] [INFO ] [REMOTE ] SUZ: Full fetch complete (66775 records). [2025-10-21T21:20:49.610353] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-10-21T21:20:49.756161] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-10-21T21:20:50.070800] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-10-21T21:20:50.070931] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-10-21T21:20:50.072946] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-10-21T21:20:50.073058] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-10-21T21:20:50.074914] [DEBUG] [LOCAL ] SUZ: Trimmed 66775 records to 45564 (keeping 200 days of data) [2025-10-21T21:20:50.455097] [DEBUG] [LOCAL ] SUZ: Primary data saved (45564 records). [2025-10-21T21:20:50.455688] [INFO ] [MAIN ] SUZ: Full history saved. [2025-10-21T21:20:50.456678] [INFO ] [MAIN ] Update Progress: 2028/2366 symbols completed. SUZ took 34.9s. Estimated remaining: 43m 28s. Rate: 7.8 symbols/min [2025-10-21T21:20:50.551980] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-10-21T21:20:50.704601] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:20:50.742639] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T21:20:50.782581] [DEBUG] [LOCAL ] SWZ: Loaded 6016 existing records from primary storage. [2025-10-21T21:20:50.795149] [INFO ] [MAIN ] SWZ: Loaded 6016 existing records. [2025-10-21T21:20:50.844676] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-21T21:20:51.012991] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:20:51.013189] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-10-21T21:20:51.013234] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-10-21T21:20:51.013406] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-10-21T21:20:51.013460] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-10-21T21:20:51.353936] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-10. [2025-10-21T21:20:51.357456] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:20:51.978413] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-21T21:20:52.151069] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-10-21T21:20:52.950998] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-10-21T21:20:53.130087] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T21:20:53.138500] [INFO ] [REMOTE ] SW: Full fetch complete (77090 records). [2025-10-21T21:20:53.138696] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-10-21T21:20:53.550827] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-10-21T21:20:53.551003] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-10-21T21:20:53.552381] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-10-21T21:20:53.552492] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-10-21T21:20:53.554346] [DEBUG] [LOCAL ] SW: Trimmed 77090 records to 53179 (keeping 200 days of data) [2025-10-21T21:20:53.766139] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-10-21T21:20:53.798825] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T21:20:53.938291] [DEBUG] [LOCAL ] SW: Primary data saved (53179 records). [2025-10-21T21:20:53.938434] [INFO ] [MAIN ] SW: Full history saved. [2025-10-21T21:20:53.939247] [INFO ] [MAIN ] Update Progress: 2029/2366 symbols completed. SW took 30.8s. Estimated remaining: 43m 19s. Rate: 7.8 symbols/min [2025-10-21T21:20:54.106190] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:20:54.145606] [DEBUG] [LOCAL ] SXC: Loaded 41615 existing records from primary storage. [2025-10-21T21:20:54.145928] [INFO ] [MAIN ] SXC: Loaded 41615 existing records. [2025-10-21T21:20:54.330749] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T21:20:54.330133] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:20:54.332618] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-10-21T21:20:54.332704] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-10-21T21:20:54.332917] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-10-21T21:20:54.332960] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-10-21T21:20:54.560047] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-10-21T21:20:54.688199] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:20:55.144140] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T21:20:55.351049] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-10-21T21:20:56.151157] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-10-21T21:20:56.600215] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-21T21:20:56.845107] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T21:20:56.870821] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:20:56.950983] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-10-21T21:20:57.751006] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-10-21T21:20:58.424225] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T21:20:58.449257] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-21T21:20:58.550994] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-10-21T21:20:59.351018] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-10-21T21:20:59.431725] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T21:21:00.151065] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-10-21T21:21:00.379601] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-21T21:21:00.951077] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-10-21T21:21:01.751061] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-10-21T21:21:02.535431] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T21:21:02.564279] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-10-21T21:21:02.571370] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-21T21:21:02.609618] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T21:21:03.351032] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-10. [2025-10-21T21:21:03.997456] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T21:21:04.151066] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-10-21T21:21:04.950987] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-10-21T21:21:05.214491] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T21:21:05.223596] [INFO ] [REMOTE ] SWK: Full fetch complete (75549 records). [2025-10-21T21:21:05.223779] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-10-21T21:21:05.616431] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-10-21T21:21:05.616580] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-10-21T21:21:05.618005] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-10-21T21:21:05.618070] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-10-21T21:21:05.619462] [DEBUG] [LOCAL ] SWK: Trimmed 75549 records to 52419 (keeping 200 days of data) [2025-10-21T21:21:05.798424] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-10-21T21:21:05.874009] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T21:21:05.979465] [DEBUG] [LOCAL ] SWK: Primary data saved (52419 records). [2025-10-21T21:21:05.979609] [INFO ] [MAIN ] SWK: Full history saved. [2025-10-21T21:21:05.980048] [INFO ] [MAIN ] Update Progress: 2030/2366 symbols completed. SWK took 32.3s. Estimated remaining: 43m 12s. Rate: 7.8 symbols/min [2025-10-21T21:21:06.164880] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:21:06.186957] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T21:21:06.203897] [DEBUG] [LOCAL ] SXI: Loaded 12056 existing records from primary storage. [2025-10-21T21:21:06.204116] [INFO ] [MAIN ] SXI: Loaded 12056 existing records. [2025-10-21T21:21:06.323070] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T21:21:06.401057] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:21:06.401275] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-10-21T21:21:06.401383] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-10-21T21:21:06.401559] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-10-21T21:21:06.401614] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-10-21T21:21:06.557533] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-10-21T21:21:06.805171] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:21:07.351014] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-10-21T21:21:07.965257] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T21:21:08.084771] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T21:21:08.151039] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-10-21T21:21:08.951043] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-10-21T21:21:09.565338] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T21:21:09.676246] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-21T21:21:09.750997] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-10-21T21:21:10.342619] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T21:21:10.551018] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-10. [2025-10-21T21:21:11.093837] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-21T21:21:11.095291] [INFO ] [REMOTE ] SWZ: Full fetch complete (8263 records). [2025-10-21T21:21:11.095363] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-10-21T21:21:11.356123] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-10-21T21:21:11.473244] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-10-21T21:21:11.473319] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-10-21T21:21:11.473563] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-10-21T21:21:11.473611] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-10-21T21:21:11.474083] [DEBUG] [LOCAL ] SWZ: Trimmed 8263 records to 6032 (keeping 200 days of data) [2025-10-21T21:21:11.507417] [DEBUG] [LOCAL ] SWZ: Primary data saved (6032 records). [2025-10-21T21:21:11.507503] [INFO ] [MAIN ] SWZ: Full history saved. [2025-10-21T21:21:11.507598] [INFO ] [MAIN ] Update Progress: 2031/2366 symbols completed. SWZ took 21.1s. Estimated remaining: 43m 4s. Rate: 7.8 symbols/min [2025-10-21T21:21:11.683429] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:21:11.714680] [DEBUG] [LOCAL ] SXT: Loaded 29870 existing records from primary storage. [2025-10-21T21:21:11.714942] [INFO ] [MAIN ] SXT: Loaded 29870 existing records. [2025-10-21T21:21:11.901231] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:21:11.901471] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-10-21T21:21:11.901517] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-10-21T21:21:11.901851] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-10-21T21:21:11.901906] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-10-21T21:21:12.156050] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-10-21T21:21:12.203194] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-21T21:21:12.283031] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:21:12.951024] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-10-21T21:21:13.751020] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-10-21T21:21:13.798251] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T21:21:14.104781] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T21:21:14.531006] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T21:21:14.550982] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-10-21T21:21:15.338218] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-21T21:21:15.350981] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-10-21T21:21:16.151001] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-10-21T21:21:16.222909] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-21T21:21:16.951081] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-10-21T21:21:17.505298] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T21:21:17.751018] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-10-21T21:21:17.767686] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T21:21:18.551031] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-10-21T21:21:19.364222] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-10. [2025-10-21T21:21:19.370938] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T21:21:19.660910] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T21:21:20.151044] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-10-21T21:21:20.565215] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T21:21:20.569749] [INFO ] [REMOTE ] SWX: Full fetch complete (43835 records). [2025-10-21T21:21:20.569862] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-10-21T21:21:20.956694] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-10-21T21:21:20.959534] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-10-21T21:21:20.960400] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-10-21T21:21:20.961385] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-10-21T21:21:20.961543] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-10-21T21:21:20.962479] [DEBUG] [LOCAL ] SWX: Trimmed 43835 records to 30720 (keeping 200 days of data) [2025-10-21T21:21:21.144285] [DEBUG] [LOCAL ] SWX: Primary data saved (30720 records). [2025-10-21T21:21:21.144415] [INFO ] [MAIN ] SWX: Full history saved. [2025-10-21T21:21:21.144490] [INFO ] [MAIN ] Update Progress: 2032/2366 symbols completed. SWX took 37.9s. Estimated remaining: 42m 57s. Rate: 7.8 symbols/min [2025-10-21T21:21:21.310764] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:21:21.359094] [DEBUG] [LOCAL ] SYF: Loaded 53453 existing records from primary storage. [2025-10-21T21:21:21.359411] [INFO ] [MAIN ] SYF: Loaded 53453 existing records. [2025-10-21T21:21:21.539244] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:21:21.539500] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-10-21T21:21:21.539551] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-21T21:21:21.539776] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-10-21T21:21:21.539835] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-10-21T21:21:21.752268] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-10-21T21:21:21.934348] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-21T21:21:21.969537] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:21:21.975349] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T21:21:22.551088] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-10-21T21:21:22.955719] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T21:21:23.351013] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-10-21T21:21:24.151042] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-10-21T21:21:24.326247] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T21:21:24.791022] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-21T21:21:24.951034] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-10-21T21:21:25.595911] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T21:21:25.750999] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-10. [2025-10-21T21:21:26.139425] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T21:21:26.551017] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-10-21T21:21:27.243591] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T21:21:27.250412] [INFO ] [REMOTE ] SXC: Full fetch complete (61029 records). [2025-10-21T21:21:27.250536] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-10-21T21:21:27.356201] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-10-21T21:21:27.633890] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-10-21T21:21:27.633972] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-10-21T21:21:27.635034] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-10-21T21:21:27.635097] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-10-21T21:21:27.636778] [DEBUG] [LOCAL ] SXC: Trimmed 61029 records to 41628 (keeping 200 days of data) [2025-10-21T21:21:27.885278] [DEBUG] [LOCAL ] SXC: Primary data saved (41628 records). [2025-10-21T21:21:27.885419] [INFO ] [MAIN ] SXC: Full history saved. [2025-10-21T21:21:27.886147] [INFO ] [MAIN ] Update Progress: 2033/2366 symbols completed. SXC took 33.9s. Estimated remaining: 42m 49s. Rate: 7.8 symbols/min [2025-10-21T21:21:28.062322] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:21:28.108799] [DEBUG] [LOCAL ] SYK: Loaded 46886 existing records from primary storage. [2025-10-21T21:21:28.109118] [INFO ] [MAIN ] SYK: Loaded 46886 existing records. [2025-10-21T21:21:28.153844] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-10-21T21:21:28.300064] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:21:28.300535] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-10-21T21:21:28.300831] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-10-21T21:21:28.311338] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-10-21T21:21:28.326963] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-10-21T21:21:28.409861] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T21:21:28.403744] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T21:21:28.710755] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:21:28.951031] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-10-21T21:21:29.311950] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T21:21:29.751056] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-10-21T21:21:30.551126] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-10-21T21:21:30.835749] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T21:21:30.859463] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-21T21:21:31.351085] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-10-21T21:21:32.151005] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-10-21T21:21:32.705724] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T21:21:32.950996] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-10-21T21:21:33.129776] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-21T21:21:33.751051] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-10-21T21:21:33.965757] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T21:21:34.195182] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T21:21:34.489805] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T21:21:34.551040] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-10. [2025-10-21T21:21:35.351027] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-10-21T21:21:35.459824] [DEBUG] [REMOTE ] SYF: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-21T21:21:35.460033] [WARN ] [REMOTE ] SYF: No data returned for month 2025-04 [2025-10-21T21:21:35.460128] [FATAL] [REMOTE ] SYF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:21:35.460210] [FATAL] [MAIN ] SYF: Failed to fetch primary data. [2025-10-21T21:21:35.460287] [WARN ] [MAIN ] SYF: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:21:35.460345] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-10-21T21:21:35.460413] [DEBUG] [LOCAL ] SYF: No primary data file found to delete. [2025-10-21T21:21:35.460463] [INFO ] [LOCAL ] SYF: Starting deletion of derivative data. [2025-10-21T21:21:35.460675] [DEBUG] [LOCAL ] SYF: Deleted derivative data file. [2025-10-21T21:21:35.460772] [INFO ] [MAIN ] Update Progress: 2034/2366 symbols completed. SYF took 14.3s. Estimated remaining: 42m 41s. Rate: 7.8 symbols/min [2025-10-21T21:21:35.576481] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T21:21:35.595373] [INFO ] [REMOTE ] SXI: Full fetch complete (15761 records). [2025-10-21T21:21:35.605776] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-10-21T21:21:35.724910] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:21:36.077698] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-10-21T21:21:36.077827] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-10-21T21:21:36.078335] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-10-21T21:21:36.078483] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-10-21T21:21:36.079969] [DEBUG] [LOCAL ] SYY: Loaded 53207 existing records from primary storage. [2025-10-21T21:21:36.080283] [INFO ] [MAIN ] SYY: Loaded 53207 existing records. [2025-10-21T21:21:36.151764] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-10-21T21:21:36.124570] [DEBUG] [LOCAL ] SXI: Trimmed 15761 records to 12082 (keeping 200 days of data) [2025-10-21T21:21:36.328158] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:21:36.330277] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-10-21T21:21:36.334324] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-10-21T21:21:36.335975] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-10-21T21:21:36.336540] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-10-21T21:21:36.421707] [DEBUG] [LOCAL ] SXI: Primary data saved (12082 records). [2025-10-21T21:21:36.440563] [INFO ] [MAIN ] SXI: Full history saved. [2025-10-21T21:21:36.442923] [INFO ] [MAIN ] Update Progress: 2035/2366 symbols completed. SXI took 30.5s. Estimated remaining: 42m 32s. Rate: 7.8 symbols/min [2025-10-21T21:21:36.804336] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:21:36.890832] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:21:36.931694] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-21T21:21:36.931983] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-10-21T21:21:36.962356] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-10-21T21:21:37.108938] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:21:37.109118] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-10-21T21:21:37.109166] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-10-21T21:21:37.109364] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-10-21T21:21:37.109421] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-10-21T21:21:37.456418] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:21:37.751046] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-10-21T21:21:37.993329] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T21:21:38.551047] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-10-21T21:21:38.790297] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T21:21:39.351024] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-10-21T21:21:40.095271] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-21T21:21:40.151012] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-10-21T21:21:40.951042] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-10-21T21:21:41.040205] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T21:21:41.123243] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-21T21:21:41.151808] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-21T21:21:41.751076] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-10. [2025-10-21T21:21:42.551064] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-10-21T21:21:43.079712] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-21T21:21:43.087130] [INFO ] [REMOTE ] SXT: Full fetch complete (39633 records). [2025-10-21T21:21:43.087294] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-10-21T21:21:43.385768] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-10-21T21:21:43.638602] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-10-21T21:21:43.638728] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-10-21T21:21:43.639522] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-10-21T21:21:43.639566] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-10-21T21:21:43.640560] [DEBUG] [LOCAL ] SXT: Trimmed 39633 records to 29847 (keeping 200 days of data) [2025-10-21T21:21:43.848270] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.90 seconds). [2025-10-21T21:21:43.875014] [DEBUG] [LOCAL ] SXT: Primary data saved (29847 records). [2025-10-21T21:21:43.875152] [INFO ] [MAIN ] SXT: Full history saved. [2025-10-21T21:21:43.876083] [INFO ] [MAIN ] Update Progress: 2036/2366 symbols completed. SXT took 32.4s. Estimated remaining: 42m 25s. Rate: 7.8 symbols/min [2025-10-21T21:21:44.051478] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:21:44.094661] [DEBUG] [LOCAL ] TAC: Loaded 43339 existing records from primary storage. [2025-10-21T21:21:44.094969] [INFO ] [MAIN ] TAC: Loaded 43339 existing records. [2025-10-21T21:21:44.156493] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-10-21T21:21:44.274761] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:21:44.274969] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-10-21T21:21:44.275018] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-10-21T21:21:44.275205] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-10-21T21:21:44.275242] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-10-21T21:21:44.631584] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:21:44.772207] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-21T21:21:44.951001] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-10-21T21:21:45.224726] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-21T21:21:45.751019] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-10-21T21:21:46.387325] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T21:21:46.551029] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-10-21T21:21:46.825519] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-21T21:21:46.965952] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T21:21:47.351040] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-10-21T21:21:48.150999] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-10-21T21:21:48.332519] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T21:21:48.951016] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-10-21T21:21:49.751031] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-10-21T21:21:49.883290] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T21:21:49.931980] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-21T21:21:50.551001] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-10-21T21:21:51.351039] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-10-21T21:21:51.410169] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-21T21:21:51.459423] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T21:21:52.096663] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T21:21:52.151095] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-10-21T21:21:52.951016] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-10-21T21:21:53.754406] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-10-21T21:21:53.761414] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-21T21:21:53.974247] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T21:21:54.485167] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T21:21:54.550998] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-10-21T21:21:55.351055] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-10-21T21:21:55.620296] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-21T21:21:56.151083] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-10-21T21:21:56.693857] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-21T21:21:56.824806] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T21:21:56.950994] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-10-21T21:21:57.682002] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T21:21:57.751036] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-10-21T21:21:58.551085] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-10-21T21:21:59.350996] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-10-21T21:21:59.578594] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T21:21:59.619000] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-21T21:21:59.779251] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-21T21:22:00.151074] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-10. [2025-10-21T21:22:00.951009] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-10-21T21:22:01.442393] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-21T21:22:01.751030] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-10-21T21:22:01.868454] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T21:22:01.876001] [INFO ] [REMOTE ] SYK: Full fetch complete (69168 records). [2025-10-21T21:22:01.876133] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-10-21T21:22:02.258256] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-10-21T21:22:02.258328] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-10-21T21:22:02.259468] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-10-21T21:22:02.259530] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-10-21T21:22:02.260788] [DEBUG] [LOCAL ] SYK: Trimmed 69168 records to 46824 (keeping 200 days of data) [2025-10-21T21:22:02.547211] [DEBUG] [LOCAL ] SYK: Primary data saved (46824 records). [2025-10-21T21:22:02.547337] [INFO ] [MAIN ] SYK: Full history saved. [2025-10-21T21:22:02.547418] [INFO ] [MAIN ] Update Progress: 2037/2366 symbols completed. SYK took 34.7s. Estimated remaining: 42m 19s. Rate: 7.8 symbols/min [2025-10-21T21:22:02.551047] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-10-21T21:22:03.334849] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T21:22:03.350975] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-10-21T21:22:03.392194] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-21T21:22:04.150992] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-10-21T21:22:04.442753] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T21:22:04.951059] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-10. [2025-10-21T21:22:05.004402] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T21:22:05.751076] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-10-21T21:22:06.549068] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-21T21:22:06.560482] [INFO ] [REMOTE ] T: Fetching primary data for 2025-10. [2025-10-21T21:22:06.705445] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T21:22:06.714159] [INFO ] [REMOTE ] SYY: Full fetch complete (77230 records). [2025-10-21T21:22:06.714310] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-10-21T21:22:07.158211] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-10-21T21:22:07.158434] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-10-21T21:22:07.159887] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-10-21T21:22:07.159974] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-10-21T21:22:07.183822] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T21:22:07.192809] [DEBUG] [LOCAL ] SYY: Trimmed 77230 records to 53206 (keeping 200 days of data) [2025-10-21T21:22:07.370760] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-10. [2025-10-21T21:22:07.523281] [DEBUG] [LOCAL ] SYY: Primary data saved (53206 records). [2025-10-21T21:22:07.523423] [INFO ] [MAIN ] SYY: Full history saved. [2025-10-21T21:22:07.523502] [INFO ] [MAIN ] Update Progress: 2038/2366 symbols completed. SYY took 32.1s. Estimated remaining: 42m 11s. Rate: 7.8 symbols/min [2025-10-21T21:22:09.018153] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-10 (2.46 seconds). [2025-10-21T21:22:09.026854] [INFO ] [REMOTE ] T: Full fetch complete (77978 records). [2025-10-21T21:22:09.026966] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-10-21T21:22:09.407926] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T21:22:09.461239] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-10-21T21:22:09.461066] [INFO ] [REMOTE ] TAC: Full fetch complete (64693 records). [2025-10-21T21:22:09.461459] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-10-21T21:22:09.462771] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-10-21T21:22:09.461412] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-10-21T21:22:09.462885] [DEBUG] [LOCAL ] T: Saving primary data. [2025-10-21T21:22:09.553099] [DEBUG] [LOCAL ] T: Trimmed 77978 records to 53798 (keeping 200 days of data) [2025-10-21T21:22:10.121713] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-10-21T21:22:10.125240] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-10-21T21:22:10.137265] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-10-21T21:22:10.137397] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-10-21T21:22:10.205858] [DEBUG] [LOCAL ] TAC: Trimmed 64693 records to 43392 (keeping 200 days of data) [2025-10-21T21:22:10.224556] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-10-21T21:22:10.224857] [INFO ] [MAIN ] T: Full history saved. [2025-10-21T21:22:10.225888] [INFO ] [MAIN ] Update Progress: 2039/2366 symbols completed. T took 33.8s. Estimated remaining: 42m 2s. Rate: 7.8 symbols/min [2025-10-21T21:22:10.489884] [DEBUG] [LOCAL ] TAC: Primary data saved (43392 records). [2025-10-21T21:22:10.490092] [INFO ] [MAIN ] TAC: Full history saved. [2025-10-21T21:22:10.491178] [INFO ] [MAIN ] Update Progress: 2040/2366 symbols completed. TAC took 26.6s. Estimated remaining: 41m 53s. Rate: 7.8 symbols/min [2025-10-21T21:22:11.062328] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:22:11.120118] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:22:11.209695] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:22:11.211915] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:22:11.287243] [DEBUG] [LOCAL ] TAL: Loaded 51731 existing records from primary storage. [2025-10-21T21:22:11.301589] [INFO ] [MAIN ] TAL: Loaded 51731 existing records. [2025-10-21T21:22:11.350162] [DEBUG] [LOCAL ] TALO: Loaded 51031 existing records from primary storage. [2025-10-21T21:22:11.409967] [INFO ] [MAIN ] TALO: Loaded 51031 existing records. [2025-10-21T21:22:11.474136] [DEBUG] [LOCAL ] TAK: Loaded 50251 existing records from primary storage. [2025-10-21T21:22:11.498747] [INFO ] [MAIN ] TAK: Loaded 50251 existing records. [2025-10-21T21:22:11.534039] [DEBUG] [LOCAL ] TAP: Loaded 52985 existing records from primary storage. [2025-10-21T21:22:11.594420] [INFO ] [MAIN ] TAP: Loaded 52985 existing records. [2025-10-21T21:22:11.797152] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:22:11.902785] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-10-21T21:22:11.897396] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:22:11.928973] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-10-21T21:22:12.000057] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-10-21T21:22:12.006434] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-10-21T21:22:12.000197] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-10-21T21:22:12.007118] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-10-21T21:22:12.023881] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-10-21T21:22:12.047988] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:22:12.092387] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-10-21T21:22:12.071571] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-10-21T21:22:12.186582] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:22:12.191894] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-10-21T21:22:12.233062] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-10-21T21:22:12.288271] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-10-21T21:22:12.312908] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-10-21T21:22:12.323333] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-10-21T21:22:12.379024] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-10-21T21:22:12.473901] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-10-21T21:22:13.383368] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:22:13.400855] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:22:13.416462] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-10-21T21:22:13.434992] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-10-21T21:22:13.556445] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:22:13.556974] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-10-21T21:22:13.634427] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:22:13.634810] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-10-21T21:22:15.192424] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T21:22:15.203258] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-10-21T21:22:15.273488] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T21:22:15.284083] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-10-21T21:22:15.314852] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T21:22:15.325800] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-10-21T21:22:15.367893] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T21:22:15.378619] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-10-21T21:22:16.879013] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T21:22:16.913472] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-10-21T21:22:16.916618] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T21:22:16.927858] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-10-21T21:22:16.955698] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T21:22:16.966638] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-10-21T21:22:17.279423] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-21T21:22:17.289317] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-10-21T21:22:18.452723] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T21:22:18.463877] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-10-21T21:22:18.522229] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-21T21:22:18.550976] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-10-21T21:22:18.725792] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T21:22:19.351064] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-10-21T21:22:20.207506] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-21T21:22:20.219032] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-10-21T21:22:20.251244] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:22:20.291342] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T21:22:20.951070] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-10-21T21:22:21.181237] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T21:22:21.751021] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-10-21T21:22:22.229976] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T21:22:22.551014] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-10-21T21:22:22.636378] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T21:22:23.351059] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-10-21T21:22:23.433545] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T21:22:24.151002] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-10-21T21:22:24.424947] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T21:22:24.509363] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T21:22:24.951068] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-10-21T21:22:25.751112] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-10-21T21:22:25.860549] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T21:22:26.551040] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-10-21T21:22:26.732886] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T21:22:27.351083] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-10-21T21:22:27.537688] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T21:22:28.151030] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-10-21T21:22:28.426484] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T21:22:28.951064] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-10-21T21:22:29.173414] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T21:22:29.751046] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-10-21T21:22:29.951513] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T21:22:30.551063] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-10-21T21:22:30.615547] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T21:22:31.351057] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-10-21T21:22:31.467063] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T21:22:32.151023] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-10-21T21:22:32.226334] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:22:32.951032] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-10-21T21:22:33.081955] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T21:22:33.751041] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-10. [2025-10-21T21:22:34.057665] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T21:22:34.546720] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T21:22:34.556616] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-10-21T21:22:35.348206] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T21:22:35.355437] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-10-21T21:22:35.357352] [INFO ] [REMOTE ] TALO: Full fetch complete (73412 records). [2025-10-21T21:22:35.357455] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-10-21T21:22:35.744794] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-10-21T21:22:35.744880] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-10-21T21:22:35.746034] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-10-21T21:22:35.746156] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-10-21T21:22:35.747630] [DEBUG] [LOCAL ] TALO: Trimmed 73412 records to 51003 (keeping 200 days of data) [2025-10-21T21:22:36.044994] [DEBUG] [LOCAL ] TALO: Primary data saved (51003 records). [2025-10-21T21:22:36.045132] [INFO ] [MAIN ] TALO: Full history saved. [2025-10-21T21:22:36.046055] [INFO ] [MAIN ] Update Progress: 2041/2366 symbols completed. TALO took 25.5s. Estimated remaining: 41m 48s. Rate: 7.8 symbols/min [2025-10-21T21:22:36.161297] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-10-21T21:22:36.218268] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:22:36.231615] [DEBUG] [LOCAL ] TBB: Loaded 11444 existing records from primary storage. [2025-10-21T21:22:36.231962] [INFO ] [MAIN ] TBB: Loaded 11444 existing records. [2025-10-21T21:22:36.411569] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:22:36.411776] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-10-21T21:22:36.411825] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-10-21T21:22:36.412090] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-10-21T21:22:36.412145] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-10-21T21:22:36.775191] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:22:36.873036] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-21T21:22:36.950990] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-10-21T21:22:37.039087] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T21:22:37.751000] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-10. [2025-10-21T21:22:37.873514] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T21:22:38.065165] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T21:22:38.551041] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-10-21T21:22:39.017111] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T21:22:39.025497] [INFO ] [REMOTE ] TAK: Full fetch complete (72003 records). [2025-10-21T21:22:39.025706] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-10-21T21:22:39.219813] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-21T21:22:39.356147] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-10. [2025-10-21T21:22:39.444732] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-10-21T21:22:39.444812] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-10-21T21:22:39.446004] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-10-21T21:22:39.446065] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-10-21T21:22:39.447516] [DEBUG] [LOCAL ] TAK: Trimmed 72003 records to 50230 (keeping 200 days of data) [2025-10-21T21:22:39.740251] [DEBUG] [LOCAL ] TAK: Primary data saved (50230 records). [2025-10-21T21:22:39.740380] [INFO ] [MAIN ] TAK: Full history saved. [2025-10-21T21:22:39.740477] [INFO ] [MAIN ] Update Progress: 2042/2366 symbols completed. TAK took 29.2s. Estimated remaining: 41m 40s. Rate: 7.8 symbols/min [2025-10-21T21:22:39.908203] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:22:39.940984] [DEBUG] [LOCAL ] TBBB: Loaded 35683 existing records from primary storage. [2025-10-21T21:22:39.941247] [INFO ] [MAIN ] TBBB: Loaded 35683 existing records. [2025-10-21T21:22:40.118992] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:22:40.119212] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-10-21T21:22:40.119259] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-10-21T21:22:40.119453] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-10-21T21:22:40.119509] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-10-21T21:22:40.156239] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-10-21T21:22:40.503830] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:22:40.950995] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-10-21T21:22:41.201300] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T21:22:41.209389] [INFO ] [REMOTE ] TAP: Full fetch complete (76542 records). [2025-10-21T21:22:41.209509] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-10-21T21:22:41.599731] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-10-21T21:22:41.599827] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-10-21T21:22:41.601142] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-10-21T21:22:41.601208] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-10-21T21:22:41.602635] [DEBUG] [LOCAL ] TAP: Trimmed 76542 records to 52976 (keeping 200 days of data) [2025-10-21T21:22:41.784213] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-10-21T21:22:41.943018] [DEBUG] [LOCAL ] TAP: Primary data saved (52976 records). [2025-10-21T21:22:41.943163] [INFO ] [MAIN ] TAP: Full history saved. [2025-10-21T21:22:41.943548] [INFO ] [MAIN ] Update Progress: 2043/2366 symbols completed. TAP took 31.4s. Estimated remaining: 41m 31s. Rate: 7.8 symbols/min [2025-10-21T21:22:42.145354] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:22:42.148335] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-21T21:22:42.174826] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T21:22:42.195344] [DEBUG] [LOCAL ] TBI: Loaded 22807 existing records from primary storage. [2025-10-21T21:22:42.195581] [INFO ] [MAIN ] TBI: Loaded 22807 existing records. [2025-10-21T21:22:42.377145] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:22:42.377352] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-10-21T21:22:42.377414] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-10-21T21:22:42.377709] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-10-21T21:22:42.377776] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-10-21T21:22:42.554435] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-10-21T21:22:42.710340] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T21:22:42.755732] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:22:43.351002] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-10. [2025-10-21T21:22:44.181147] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-10-21T21:22:44.199226] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T21:22:44.951000] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-10-21T21:22:45.046227] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T21:22:45.054818] [INFO ] [REMOTE ] TAL: Full fetch complete (75718 records). [2025-10-21T21:22:45.054962] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-10-21T21:22:45.219521] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T21:22:45.486569] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-10-21T21:22:45.486691] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-10-21T21:22:45.487993] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-10-21T21:22:45.488063] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-10-21T21:22:45.489598] [DEBUG] [LOCAL ] TAL: Trimmed 75718 records to 51724 (keeping 200 days of data) [2025-10-21T21:22:45.768318] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-10-21T21:22:45.814302] [DEBUG] [LOCAL ] TAL: Primary data saved (51724 records). [2025-10-21T21:22:45.814439] [INFO ] [MAIN ] TAL: Full history saved. [2025-10-21T21:22:45.814520] [INFO ] [MAIN ] Update Progress: 2044/2366 symbols completed. TAL took 35.3s. Estimated remaining: 41m 23s. Rate: 7.8 symbols/min [2025-10-21T21:22:45.997832] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:22:45.998038] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-10-21T21:22:45.998093] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-10-21T21:22:45.998213] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-10-21T21:22:45.998256] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-21T21:22:45.998296] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-21T21:22:45.998327] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-10-21T21:22:46.360494] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:22:46.423213] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T21:22:46.550999] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-10-21T21:22:46.636181] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T21:22:47.351085] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-10-21T21:22:47.738341] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-21T21:22:48.119912] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T21:22:48.150989] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-10-21T21:22:48.483453] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-21T21:22:48.951117] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-10-21T21:22:49.751104] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-10-21T21:22:50.439839] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T21:22:50.551002] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-10-21T21:22:50.852889] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T21:22:51.351079] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-10-21T21:22:51.953836] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T21:22:52.151063] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-10-21T21:22:52.290066] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T21:22:52.951064] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-10-21T21:22:53.751025] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-10-21T21:22:54.077165] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-21T21:22:54.551100] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-10-21T21:22:55.351089] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-10-21T21:23:04.630294] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (9.28 seconds). [2025-10-21T21:23:04.631287] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-10-21T21:23:05.087833] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (12.14 seconds). [2025-10-21T21:23:05.093620] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-10-21T21:23:05.105489] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T21:23:05.106414] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-10-21T21:23:05.370334] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-21T21:23:05.371266] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-10-21T21:23:05.722856] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-21T21:23:05.723809] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-10-21T21:23:06.064134] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-21T21:23:06.065068] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-10-21T21:23:06.175313] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T21:23:06.181591] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-10-21T21:23:06.415464] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-21T21:23:06.416353] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-10. [2025-10-21T21:23:06.702502] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (12.15 seconds). [2025-10-21T21:23:06.706147] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-10-21T21:23:06.777849] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-21T21:23:06.778614] [INFO ] [REMOTE ] TBLU: Full fetch complete (1223 records). [2025-10-21T21:23:06.778705] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-10-21T21:23:06.954044] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-21T21:23:06.954248] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:23:06.954333] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:23:06.954436] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-10-21T21:23:06.954517] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-10-21T21:23:06.954554] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-10-21T21:23:06.954594] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-10-21T21:23:06.954679] [INFO ] [MAIN ] Update Progress: 2045/2366 symbols completed. TBLU took 21.1s. Estimated remaining: 41m 17s. Rate: 7.8 symbols/min [2025-10-21T21:23:07.123829] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:07.130627] [DEBUG] [LOCAL ] TBN: Loaded 3997 existing records from primary storage. [2025-10-21T21:23:07.130854] [INFO ] [MAIN ] TBN: Loaded 3997 existing records. [2025-10-21T21:23:07.313223] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:23:07.313437] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-10-21T21:23:07.313501] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-10-21T21:23:07.313692] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-10-21T21:23:07.313757] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-10-21T21:23:07.503361] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T21:23:07.578935] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-10-21T21:23:07.688038] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:07.688359] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-10-21T21:23:08.122361] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-21T21:23:08.123840] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-10-21T21:23:08.730130] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T21:23:08.731782] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-10-21T21:23:09.394502] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-21T21:23:09.396010] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-10-21T21:23:09.825379] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-21T21:23:09.826480] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-10-21T21:23:10.190675] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-21T21:23:10.191862] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-10-21T21:23:10.483138] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (18.33 seconds). [2025-10-21T21:23:10.491493] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-10-21T21:23:10.650871] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-21T21:23:10.652181] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-10-21T21:23:11.229231] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (3.65 seconds). [2025-10-21T21:23:11.232413] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-10-21T21:23:11.348346] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (5.17 seconds). [2025-10-21T21:23:11.353689] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-10-21T21:23:11.405810] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T21:23:11.824228] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T21:23:12.096184] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-21T21:23:12.151011] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-10-21T21:23:12.439264] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-21T21:23:12.947563] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T21:23:12.950973] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-10. [2025-10-21T21:23:13.505572] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T21:23:13.507409] [INFO ] [REMOTE ] TBB: Full fetch complete (16371 records). [2025-10-21T21:23:13.507492] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-10-21T21:23:13.756118] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-10-21T21:23:13.921196] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-10-21T21:23:13.921271] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-10-21T21:23:13.921615] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-10-21T21:23:13.921680] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-10-21T21:23:13.922195] [DEBUG] [LOCAL ] TBB: Trimmed 16371 records to 11406 (keeping 200 days of data) [2025-10-21T21:23:13.989068] [DEBUG] [LOCAL ] TBB: Primary data saved (11406 records). [2025-10-21T21:23:13.989183] [INFO ] [MAIN ] TBB: Full history saved. [2025-10-21T21:23:13.989253] [INFO ] [MAIN ] Update Progress: 2046/2366 symbols completed. TBB took 37.9s. Estimated remaining: 41m 10s. Rate: 7.8 symbols/min [2025-10-21T21:23:14.153275] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:14.153427] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-10-21T21:23:14.153463] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-10-21T21:23:14.153567] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-10-21T21:23:14.153606] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-21T21:23:14.153674] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-21T21:23:14.153726] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-10-21T21:23:14.506085] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:14.551004] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-10-21T21:23:14.895526] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T21:23:15.083124] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-21T21:23:15.351021] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-10-21T21:23:16.151024] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-10-21T21:23:16.404094] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T21:23:16.951052] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-10-21T21:23:17.317697] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T21:23:17.361514] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-21T21:23:17.751026] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-10-21T21:23:17.958386] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:23:17.958732] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-10-21T21:23:17.958818] [FATAL] [REMOTE ] TCAI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:23:17.958886] [FATAL] [MAIN ] TCAI: Failed to fetch primary data. [2025-10-21T21:23:17.958945] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:23:17.959018] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-10-21T21:23:17.959079] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-10-21T21:23:17.959112] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-10-21T21:23:17.959149] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-10-21T21:23:17.959194] [INFO ] [MAIN ] Update Progress: 2047/2366 symbols completed. TCAI took 4.0s. Estimated remaining: 41m 1s. Rate: 7.8 symbols/min [2025-10-21T21:23:18.125883] [INFO ] [MAIN ] TCBX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:18.137446] [DEBUG] [LOCAL ] TCBX: Loaded 10256 existing records from primary storage. [2025-10-21T21:23:18.137741] [INFO ] [MAIN ] TCBX: Loaded 10256 existing records. [2025-10-21T21:23:18.328329] [WARN ] [MAIN ] TCBX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:23:18.328556] [INFO ] [MAIN ] TCBX: Wiping existing primary data before full refresh. [2025-10-21T21:23:18.328605] [INFO ] [LOCAL ] TCBX: Starting deletion of primary data. [2025-10-21T21:23:18.328785] [DEBUG] [LOCAL ] TCBX: Deleted primary data file. [2025-10-21T21:23:18.328838] [INFO ] [MAIN ] TCBX: Starting full primary refresh. [2025-10-21T21:23:18.556241] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-10. [2025-10-21T21:23:18.692396] [INFO ] [REMOTE ] TCBX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:19.333535] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T21:23:19.335719] [INFO ] [REMOTE ] TBN: Full fetch complete (5960 records). [2025-10-21T21:23:19.335787] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-10-21T21:23:19.356471] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-10. [2025-10-21T21:23:19.723911] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-10-21T21:23:19.724016] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-10-21T21:23:19.724276] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-10-21T21:23:19.724318] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-10-21T21:23:19.724822] [DEBUG] [LOCAL ] TBN: Trimmed 5960 records to 4035 (keeping 200 days of data) [2025-10-21T21:23:19.754294] [DEBUG] [LOCAL ] TBN: Primary data saved (4035 records). [2025-10-21T21:23:19.754444] [INFO ] [MAIN ] TBN: Full history saved. [2025-10-21T21:23:19.754530] [INFO ] [MAIN ] Update Progress: 2048/2366 symbols completed. TBN took 12.8s. Estimated remaining: 40m 53s. Rate: 7.8 symbols/min [2025-10-21T21:23:19.929111] [INFO ] [MAIN ] TCPA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:19.929278] [DEBUG] [LOCAL ] TCPA: No existing data file found in primary storage. [2025-10-21T21:23:19.929314] [WARN ] [MAIN ] TCPA: No existing data found, performing full refresh instead. [2025-10-21T21:23:19.929420] [INFO ] [MAIN ] TCPA: Wiping existing primary data before full refresh. [2025-10-21T21:23:19.929461] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-21T21:23:19.929501] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-21T21:23:19.929563] [INFO ] [MAIN ] TCPA: Starting full primary refresh. [2025-10-21T21:23:20.158586] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-10. [2025-10-21T21:23:20.283613] [INFO ] [REMOTE ] TCPA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:20.609036] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T21:23:20.613431] [INFO ] [REMOTE ] TBI: Full fetch complete (32076 records). [2025-10-21T21:23:20.613576] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-10-21T21:23:20.952204] [INFO ] [REMOTE ] TCPA: Fetching primary data for 2025-01. [2025-10-21T21:23:20.981951] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-10-21T21:23:20.982012] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-10-21T21:23:20.982638] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-10-21T21:23:20.982717] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-10-21T21:23:20.983406] [DEBUG] [LOCAL ] TBI: Trimmed 32076 records to 22817 (keeping 200 days of data) [2025-10-21T21:23:21.104812] [DEBUG] [LOCAL ] TBI: Primary data saved (22817 records). [2025-10-21T21:23:21.104932] [INFO ] [MAIN ] TBI: Full history saved. [2025-10-21T21:23:21.105006] [INFO ] [MAIN ] Update Progress: 2049/2366 symbols completed. TBI took 39.2s. Estimated remaining: 40m 44s. Rate: 7.8 symbols/min [2025-10-21T21:23:21.213279] [DEBUG] [REMOTE ] TCPA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:23:21.234089] [WARN ] [REMOTE ] TCPA: No data returned for month 2025-01 [2025-10-21T21:23:21.252471] [FATAL] [REMOTE ] TCPA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:23:21.276517] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:21.256754] [FATAL] [MAIN ] TCPA: Failed to fetch primary data. [2025-10-21T21:23:21.277153] [WARN ] [MAIN ] TCPA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:23:21.277235] [INFO ] [LOCAL ] TCPA: Starting deletion of primary data. [2025-10-21T21:23:21.277319] [DEBUG] [LOCAL ] TCPA: No primary data file found to delete. [2025-10-21T21:23:21.277496] [INFO ] [LOCAL ] TCPA: Starting deletion of derivative data. [2025-10-21T21:23:21.277669] [DEBUG] [LOCAL ] TCPA: No derivative data file found to delete. [2025-10-21T21:23:21.277740] [INFO ] [MAIN ] Update Progress: 2050/2366 symbols completed. TCPA took 1.5s. Estimated remaining: 40m 35s. Rate: 7.8 symbols/min [2025-10-21T21:23:21.464956] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:21.466350] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T21:23:21.473039] [INFO ] [REMOTE ] TBBB: Full fetch complete (51985 records). [2025-10-21T21:23:21.473131] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-10-21T21:23:21.670293] [DEBUG] [LOCAL ] TD: Loaded 52287 existing records from primary storage. [2025-10-21T21:23:21.699927] [INFO ] [MAIN ] TD: Loaded 52287 existing records. [2025-10-21T21:23:21.762363] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-01. [2025-10-21T21:23:21.932894] [DEBUG] [LOCAL ] TDC: Loaded 46477 existing records from primary storage. [2025-10-21T21:23:21.957468] [INFO ] [MAIN ] TDC: Loaded 46477 existing records. [2025-10-21T21:23:22.122885] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-10-21T21:23:22.150080] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-10-21T21:23:22.166102] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-10-21T21:23:22.215344] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-10-21T21:23:22.236451] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:23:22.247714] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-10-21T21:23:22.253027] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-10-21T21:23:22.268636] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-10-21T21:23:22.273944] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-10-21T21:23:22.345714] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:23:22.321117] [DEBUG] [LOCAL ] TBBB: Trimmed 51985 records to 35673 (keeping 200 days of data) [2025-10-21T21:23:22.367857] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-10-21T21:23:22.373380] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-10-21T21:23:22.395548] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-10-21T21:23:22.407441] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-10-21T21:23:23.080664] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T21:23:23.141846] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-02. [2025-10-21T21:23:23.169794] [DEBUG] [LOCAL ] TBBB: Primary data saved (35673 records). [2025-10-21T21:23:23.221532] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:23.177782] [INFO ] [MAIN ] TBBB: Full history saved. [2025-10-21T21:23:23.246564] [INFO ] [MAIN ] Update Progress: 2051/2366 symbols completed. TBBB took 43.5s. Estimated remaining: 40m 26s. Rate: 7.8 symbols/min [2025-10-21T21:23:23.348050] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:23.353677] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-10-21T21:23:23.455713] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:23.464265] [DEBUG] [LOCAL ] TDF: Loaded 6264 existing records from primary storage. [2025-10-21T21:23:23.464485] [INFO ] [MAIN ] TDF: Loaded 6264 existing records. [2025-10-21T21:23:23.646682] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:23:23.646902] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-10-21T21:23:23.646962] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-10-21T21:23:23.647124] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-10-21T21:23:23.647183] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-10-21T21:23:24.006188] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:24.031391] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T21:23:24.150997] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-10-21T21:23:24.951095] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-03. [2025-10-21T21:23:24.969239] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T21:23:25.135593] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T21:23:25.722384] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T21:23:25.751014] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-04. [2025-10-21T21:23:26.550990] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-10-21T21:23:26.703179] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T21:23:27.331867] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T21:23:27.350980] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-10-21T21:23:28.151055] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-05. [2025-10-21T21:23:28.164222] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T21:23:28.909962] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T21:23:28.951007] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-10-21T21:23:29.656624] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-21T21:23:29.751092] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-10-21T21:23:30.551079] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-10-21T21:23:31.205208] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T21:23:31.318505] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T21:23:31.350983] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-10-21T21:23:32.151083] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-06. [2025-10-21T21:23:32.870556] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-21T21:23:32.898016] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T21:23:32.950994] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-07. [2025-10-21T21:23:33.751034] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-10-21T21:23:33.769499] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T21:23:34.420744] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-21T21:23:34.551024] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-10-21T21:23:35.351052] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-10-21T21:23:36.100688] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-21T21:23:36.151084] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-10-21T21:23:36.235843] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T21:23:36.951024] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-08. [2025-10-21T21:23:37.625260] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-21T21:23:37.656962] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T21:23:37.750991] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-10-21T21:23:38.360745] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T21:23:38.551014] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-10-21T21:23:39.351060] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-10-21T21:23:39.365986] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T21:23:40.151039] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-10-21T21:23:40.951003] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-09. [2025-10-21T21:23:41.143620] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T21:23:41.732886] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T21:23:41.761672] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-10. [2025-10-21T21:23:41.764371] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T21:23:42.542790] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T21:23:42.544379] [INFO ] [REMOTE ] TDF: Full fetch complete (10348 records). [2025-10-21T21:23:42.544445] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-10-21T21:23:42.556178] [INFO ] [REMOTE ] TCBX: Fetching primary data for 2025-10. [2025-10-21T21:23:42.899597] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-10-21T21:23:42.899695] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-10-21T21:23:42.899943] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-10-21T21:23:42.899985] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-10-21T21:23:42.900408] [DEBUG] [LOCAL ] TDF: Trimmed 10348 records to 6251 (keeping 200 days of data) [2025-10-21T21:23:42.936449] [DEBUG] [LOCAL ] TDF: Primary data saved (6251 records). [2025-10-21T21:23:42.936535] [INFO ] [MAIN ] TDF: Full history saved. [2025-10-21T21:23:42.936609] [INFO ] [MAIN ] Update Progress: 2052/2366 symbols completed. TDF took 19.7s. Estimated remaining: 40m 21s. Rate: 7.8 symbols/min [2025-10-21T21:23:43.102665] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:43.125541] [DEBUG] [LOCAL ] TDG: Loaded 22139 existing records from primary storage. [2025-10-21T21:23:43.125801] [INFO ] [MAIN ] TDG: Loaded 22139 existing records. [2025-10-21T21:23:43.303191] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:23:43.303488] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-10-21T21:23:43.303542] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-10-21T21:23:43.303739] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-10-21T21:23:43.303794] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-10-21T21:23:43.357878] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-10-21T21:23:43.413587] [INFO ] [REMOTE ] TCBX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T21:23:43.432475] [INFO ] [REMOTE ] TCBX: Full fetch complete (15815 records). [2025-10-21T21:23:43.442850] [DEBUG] [VALIDATOR ] TCBX: Validating primary data. [2025-10-21T21:23:43.946884] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:44.056761] [DEBUG] [VALIDATOR ] TCBX: All expected trading days are present. [2025-10-21T21:23:44.056834] [DEBUG] [VALIDATOR ] TCBX: Primary data validation passed. [2025-10-21T21:23:44.057138] [INFO ] [MAIN ] TCBX: Fetched primary data is valid. [2025-10-21T21:23:44.057177] [DEBUG] [LOCAL ] TCBX: Saving primary data. [2025-10-21T21:23:44.057676] [DEBUG] [LOCAL ] TCBX: Trimmed 15815 records to 10240 (keeping 200 days of data) [2025-10-21T21:23:44.116912] [DEBUG] [LOCAL ] TCBX: Primary data saved (10240 records). [2025-10-21T21:23:44.117047] [INFO ] [MAIN ] TCBX: Full history saved. [2025-10-21T21:23:44.117128] [INFO ] [MAIN ] Update Progress: 2053/2366 symbols completed. TCBX took 26.2s. Estimated remaining: 40m 12s. Rate: 7.8 symbols/min [2025-10-21T21:23:44.156216] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-10-21T21:23:44.295581] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:23:44.344453] [DEBUG] [LOCAL ] TDOC: Loaded 53368 existing records from primary storage. [2025-10-21T21:23:44.344782] [INFO ] [MAIN ] TDOC: Loaded 53368 existing records. [2025-10-21T21:23:44.528456] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:23:44.528692] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-10-21T21:23:44.528772] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-10-21T21:23:44.528982] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-10-21T21:23:44.529037] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-10-21T21:23:44.901497] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:23:44.950988] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-10-21T21:23:45.015414] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T21:23:45.751101] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-10-21T21:23:46.127446] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T21:23:46.550991] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-10-21T21:23:46.626392] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-21T21:23:46.893051] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T21:23:47.351051] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-10-21T21:23:48.150992] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-10-21T21:23:48.628708] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-21T21:23:48.833475] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T21:23:48.951036] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-10-21T21:23:49.751026] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-10-21T21:23:50.332915] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T21:23:50.415466] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-21T21:23:50.550987] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-10-21T21:23:51.351060] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-10-21T21:23:51.422391] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T21:23:52.151068] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-10-21T21:23:52.585413] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T21:23:52.951003] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-10-21T21:23:53.061733] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T21:23:53.466378] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T21:23:53.751081] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-10-21T21:23:54.551020] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-10-21T21:23:54.671025] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-21T21:23:54.718156] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T21:23:55.351029] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-10-21T21:23:56.160368] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-10-21T21:23:56.165557] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T21:23:56.682129] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T21:23:56.951032] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-10-21T21:23:57.751064] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-10. [2025-10-21T21:23:58.090758] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T21:23:58.128560] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T21:23:58.551074] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-10-21T21:23:59.344700] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T21:23:59.351465] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-10-21T21:23:59.353091] [INFO ] [REMOTE ] TDC: Full fetch complete (67711 records). [2025-10-21T21:23:59.353168] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-10-21T21:23:59.743737] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-10-21T21:23:59.743814] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-10-21T21:23:59.744915] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-10-21T21:23:59.744977] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-10-21T21:23:59.746234] [DEBUG] [LOCAL ] TDC: Trimmed 67711 records to 46430 (keeping 200 days of data) [2025-10-21T21:24:00.013890] [DEBUG] [LOCAL ] TDC: Primary data saved (46430 records). [2025-10-21T21:24:00.014024] [INFO ] [MAIN ] TDC: Full history saved. [2025-10-21T21:24:00.014101] [INFO ] [MAIN ] Update Progress: 2054/2366 symbols completed. TDC took 38.7s. Estimated remaining: 40m 5s. Rate: 7.8 symbols/min [2025-10-21T21:24:00.160815] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-10-21T21:24:00.185900] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:00.224966] [DEBUG] [LOCAL ] TDS: Loaded 42428 existing records from primary storage. [2025-10-21T21:24:00.225271] [INFO ] [MAIN ] TDS: Loaded 42428 existing records. [2025-10-21T21:24:00.404719] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:24:00.404981] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-10-21T21:24:00.405117] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-10-21T21:24:00.405418] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-10-21T21:24:00.405470] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-10-21T21:24:00.769554] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-21T21:24:00.791565] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:00.951037] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-10-21T21:24:01.307537] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T21:24:01.359554] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T21:24:01.751014] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-10-21T21:24:02.551057] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-10-21T21:24:03.351087] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-10-21T21:24:03.449265] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-10-21T21:24:03.596933] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T21:24:03.767321] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T21:24:04.151022] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-10-21T21:24:04.427672] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T21:24:04.950998] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-10-21T21:24:05.566928] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T21:24:05.751008] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-10-21T21:24:06.446536] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T21:24:06.551016] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-10-21T21:24:07.351080] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-10. [2025-10-21T21:24:07.529103] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T21:24:08.156151] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-10-21T21:24:08.168775] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-21T21:24:08.950997] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-10-21T21:24:09.076502] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-21T21:24:09.084415] [INFO ] [REMOTE ] TD: Full fetch complete (75902 records). [2025-10-21T21:24:09.084534] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-10-21T21:24:09.499221] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-10-21T21:24:09.499381] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-10-21T21:24:09.500563] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-10-21T21:24:09.500776] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-10-21T21:24:09.516276] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T21:24:09.522095] [DEBUG] [LOCAL ] TD: Trimmed 75902 records to 52251 (keeping 200 days of data) [2025-10-21T21:24:09.751692] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-10-21T21:24:09.848924] [DEBUG] [LOCAL ] TD: Primary data saved (52251 records). [2025-10-21T21:24:09.849085] [INFO ] [MAIN ] TD: Full history saved. [2025-10-21T21:24:09.850053] [INFO ] [MAIN ] Update Progress: 2055/2366 symbols completed. TD took 48.7s. Estimated remaining: 39m 58s. Rate: 7.8 symbols/min [2025-10-21T21:24:10.028573] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:10.069598] [DEBUG] [LOCAL ] TDW: Loaded 45039 existing records from primary storage. [2025-10-21T21:24:10.069893] [INFO ] [MAIN ] TDW: Loaded 45039 existing records. [2025-10-21T21:24:10.248153] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:24:10.248550] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-10-21T21:24:10.248601] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-10-21T21:24:10.248880] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-10-21T21:24:10.248935] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-10-21T21:24:10.560720] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-10-21T21:24:10.599611] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:11.066949] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T21:24:11.151163] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T21:24:11.350995] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-10. [2025-10-21T21:24:12.151014] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-10-21T21:24:12.322752] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T21:24:12.576323] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T21:24:12.580286] [INFO ] [REMOTE ] TDG: Full fetch complete (32079 records). [2025-10-21T21:24:12.580390] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-10-21T21:24:12.944315] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-10-21T21:24:12.944388] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-10-21T21:24:12.944973] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-10-21T21:24:12.945032] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-10-21T21:24:12.945714] [DEBUG] [LOCAL ] TDG: Trimmed 32079 records to 22101 (keeping 200 days of data) [2025-10-21T21:24:13.001311] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-10-21T21:24:13.086981] [DEBUG] [LOCAL ] TDG: Primary data saved (22101 records). [2025-10-21T21:24:13.087094] [INFO ] [MAIN ] TDG: Full history saved. [2025-10-21T21:24:13.087165] [INFO ] [MAIN ] Update Progress: 2056/2366 symbols completed. TDG took 30.2s. Estimated remaining: 39m 50s. Rate: 7.8 symbols/min [2025-10-21T21:24:13.256090] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:13.277618] [DEBUG] [LOCAL ] TDY: Loaded 22191 existing records from primary storage. [2025-10-21T21:24:13.277874] [INFO ] [MAIN ] TDY: Loaded 22191 existing records. [2025-10-21T21:24:13.451016] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:24:13.451223] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-10-21T21:24:13.451321] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-10-21T21:24:13.451553] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-10-21T21:24:13.451617] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-10-21T21:24:13.756151] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-10. [2025-10-21T21:24:13.816083] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:13.952570] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T21:24:14.263937] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T21:24:14.551046] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-10-21T21:24:15.351052] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-10-21T21:24:15.788610] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T21:24:15.797578] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-21T21:24:15.806318] [INFO ] [REMOTE ] TDOC: Full fetch complete (77438 records). [2025-10-21T21:24:15.806439] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-10-21T21:24:16.155291] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-10-21T21:24:16.197296] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-10-21T21:24:16.197480] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-10-21T21:24:16.198724] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-10-21T21:24:16.198824] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-10-21T21:24:16.200388] [DEBUG] [LOCAL ] TDOC: Trimmed 77438 records to 53368 (keeping 200 days of data) [2025-10-21T21:24:16.496409] [DEBUG] [LOCAL ] TDOC: Primary data saved (53368 records). [2025-10-21T21:24:16.496578] [INFO ] [MAIN ] TDOC: Full history saved. [2025-10-21T21:24:16.497269] [INFO ] [MAIN ] Update Progress: 2057/2366 symbols completed. TDOC took 32.4s. Estimated remaining: 39m 41s. Rate: 7.8 symbols/min [2025-10-21T21:24:16.611608] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T21:24:16.683473] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:16.683637] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-10-21T21:24:16.683713] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-10-21T21:24:16.683819] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-10-21T21:24:16.683860] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-21T21:24:16.683899] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-21T21:24:16.683930] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-10-21T21:24:16.958795] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-10-21T21:24:17.049056] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:17.751105] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-10-21T21:24:17.798420] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T21:24:17.952614] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:24:17.952998] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-10-21T21:24:17.953084] [FATAL] [REMOTE ] TE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:24:17.953133] [FATAL] [MAIN ] TE: Failed to fetch primary data. [2025-10-21T21:24:17.953165] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:24:17.953242] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-10-21T21:24:17.953328] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-10-21T21:24:17.953381] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-10-21T21:24:17.953423] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-10-21T21:24:17.953466] [INFO ] [MAIN ] Update Progress: 2058/2366 symbols completed. TE took 1.5s. Estimated remaining: 39m 33s. Rate: 7.8 symbols/min [2025-10-21T21:24:18.122144] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:18.133890] [DEBUG] [LOCAL ] TEAF: Loaded 7386 existing records from primary storage. [2025-10-21T21:24:18.134105] [INFO ] [MAIN ] TEAF: Loaded 7386 existing records. [2025-10-21T21:24:18.286314] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T21:24:18.328340] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:24:18.328484] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-10-21T21:24:18.328528] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-10-21T21:24:18.329065] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-10-21T21:24:18.329122] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-10-21T21:24:18.560817] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-10-21T21:24:18.676156] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:19.351011] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-10-21T21:24:19.760735] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T21:24:20.151003] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-10-21T21:24:20.752386] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-21T21:24:20.951006] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-10-21T21:24:21.074423] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T21:24:21.563364] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-21T21:24:21.751052] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-10-21T21:24:22.551093] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-10-21T21:24:23.232719] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-21T21:24:23.351001] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-10-21T21:24:23.426681] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T21:24:24.106498] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T21:24:24.151087] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-10-21T21:24:24.951072] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-10-21T21:24:25.361627] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T21:24:25.751046] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-10-21T21:24:26.098803] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T21:24:26.551030] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-10-21T21:24:27.351032] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-10-21T21:24:27.476840] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T21:24:27.760171] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T21:24:28.151068] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-10-21T21:24:28.951003] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-10-21T21:24:28.996071] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T21:24:29.375805] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T21:24:29.751041] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-10-21T21:24:30.539331] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T21:24:30.550974] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-10-21T21:24:31.066473] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T21:24:31.351027] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-10. [2025-10-21T21:24:32.151015] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-10-21T21:24:32.181795] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T21:24:32.524718] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-21T21:24:32.783689] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T21:24:32.790134] [INFO ] [REMOTE ] TDS: Full fetch complete (61412 records). [2025-10-21T21:24:32.790271] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-10-21T21:24:32.956224] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-10-21T21:24:33.212387] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-10-21T21:24:33.212467] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-10-21T21:24:33.213739] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-10-21T21:24:33.213866] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-10-21T21:24:33.215495] [DEBUG] [LOCAL ] TDS: Trimmed 61412 records to 42285 (keeping 200 days of data) [2025-10-21T21:24:33.484315] [DEBUG] [LOCAL ] TDS: Primary data saved (42285 records). [2025-10-21T21:24:33.484438] [INFO ] [MAIN ] TDS: Full history saved. [2025-10-21T21:24:33.484515] [INFO ] [MAIN ] Update Progress: 2059/2366 symbols completed. TDS took 33.5s. Estimated remaining: 39m 26s. Rate: 7.8 symbols/min [2025-10-21T21:24:33.662435] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:33.714095] [DEBUG] [LOCAL ] TECK: Loaded 53435 existing records from primary storage. [2025-10-21T21:24:33.714446] [INFO ] [MAIN ] TECK: Loaded 53435 existing records. [2025-10-21T21:24:33.761312] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-10-21T21:24:33.920772] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:24:33.921014] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-10-21T21:24:33.921118] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-10-21T21:24:33.921444] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-10-21T21:24:33.921501] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-10-21T21:24:34.228135] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T21:24:34.336211] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:34.551022] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-10-21T21:24:35.351039] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-10-21T21:24:35.389675] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T21:24:36.151055] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-10-21T21:24:36.167107] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T21:24:36.372212] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T21:24:36.951102] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-10-21T21:24:37.521067] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T21:24:37.754042] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-10-21T21:24:37.756087] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T21:24:38.551073] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-10-21T21:24:38.812635] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T21:24:39.351079] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-10-21T21:24:39.361793] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T21:24:40.151045] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-10-21T21:24:40.951086] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-10-21T21:24:41.095762] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T21:24:41.756285] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-10. [2025-10-21T21:24:41.773211] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-21T21:24:41.803247] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T21:24:42.551139] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-10. [2025-10-21T21:24:42.801479] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T21:24:42.804662] [INFO ] [REMOTE ] TDY: Full fetch complete (31995 records). [2025-10-21T21:24:42.804744] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-10-21T21:24:43.189236] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-10-21T21:24:43.189314] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-10-21T21:24:43.189981] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-10-21T21:24:43.190045] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-10-21T21:24:43.190870] [DEBUG] [LOCAL ] TDY: Trimmed 31995 records to 22123 (keeping 200 days of data) [2025-10-21T21:24:43.293449] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T21:24:43.329041] [INFO ] [REMOTE ] TEAF: Full fetch complete (10185 records). [2025-10-21T21:24:43.332611] [DEBUG] [LOCAL ] TDY: Primary data saved (22123 records). [2025-10-21T21:24:43.332761] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-10-21T21:24:43.332940] [INFO ] [MAIN ] TDY: Full history saved. [2025-10-21T21:24:43.333064] [INFO ] [MAIN ] Update Progress: 2060/2366 symbols completed. TDY took 30.2s. Estimated remaining: 39m 19s. Rate: 7.8 symbols/min [2025-10-21T21:24:43.356090] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-10-21T21:24:43.695512] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:43.894697] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-10-21T21:24:43.894813] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-10-21T21:24:43.895078] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-10-21T21:24:43.895117] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-10-21T21:24:43.895586] [DEBUG] [LOCAL ] TEAF: Trimmed 10185 records to 7398 (keeping 200 days of data) [2025-10-21T21:24:43.952035] [DEBUG] [LOCAL ] TEAF: Primary data saved (7398 records). [2025-10-21T21:24:43.952853] [INFO ] [MAIN ] TEAF: Full history saved. [2025-10-21T21:24:43.952976] [INFO ] [MAIN ] Update Progress: 2061/2366 symbols completed. TEAF took 26.0s. Estimated remaining: 39m 10s. Rate: 7.8 symbols/min [2025-10-21T21:24:43.952758] [DEBUG] [LOCAL ] TEF: Loaded 36882 existing records from primary storage. [2025-10-21T21:24:43.985296] [INFO ] [MAIN ] TEF: Loaded 36882 existing records. [2025-10-21T21:24:44.163044] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-10. [2025-10-21T21:24:44.334178] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:44.356549] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:24:44.356825] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-10-21T21:24:44.356874] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-10-21T21:24:44.357077] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-10-21T21:24:44.357118] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-10-21T21:24:44.536319] [DEBUG] [LOCAL ] TEI: Loaded 21267 existing records from primary storage. [2025-10-21T21:24:44.562384] [INFO ] [MAIN ] TEI: Loaded 21267 existing records. [2025-10-21T21:24:44.931875] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:44.928822] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:24:44.932305] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-10-21T21:24:44.932359] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-10-21T21:24:44.932549] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-10-21T21:24:44.932608] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-10-21T21:24:44.965786] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-10-21T21:24:45.310787] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:45.344190] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-21T21:24:45.389409] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-21T21:24:45.396260] [INFO ] [REMOTE ] TDW: Full fetch complete (66716 records). [2025-10-21T21:24:45.396356] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-10-21T21:24:45.756237] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-10-21T21:24:45.778035] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-10-21T21:24:45.778102] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-10-21T21:24:45.779294] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-10-21T21:24:45.779356] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-10-21T21:24:45.780901] [DEBUG] [LOCAL ] TDW: Trimmed 66716 records to 44963 (keeping 200 days of data) [2025-10-21T21:24:46.040545] [DEBUG] [LOCAL ] TDW: Primary data saved (44963 records). [2025-10-21T21:24:46.040727] [INFO ] [MAIN ] TDW: Full history saved. [2025-10-21T21:24:46.041370] [INFO ] [MAIN ] Update Progress: 2062/2366 symbols completed. TDW took 36.2s. Estimated remaining: 39m 1s. Rate: 7.8 symbols/min [2025-10-21T21:24:46.218716] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:24:46.272375] [DEBUG] [LOCAL ] TEL: Loaded 51047 existing records from primary storage. [2025-10-21T21:24:46.272767] [INFO ] [MAIN ] TEL: Loaded 51047 existing records. [2025-10-21T21:24:46.460070] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:24:46.460264] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-10-21T21:24:46.460312] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-10-21T21:24:46.460500] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-10-21T21:24:46.460556] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-10-21T21:24:46.562446] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-10-21T21:24:46.769278] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T21:24:46.859229] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:24:47.351012] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-10-21T21:24:47.701869] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T21:24:47.751767] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T21:24:48.151026] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-10-21T21:24:48.424071] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T21:24:48.951106] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-10-21T21:24:49.704679] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T21:24:49.751017] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-10-21T21:24:50.473450] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T21:24:50.551046] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-10-21T21:24:51.351038] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-10-21T21:24:51.491325] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T21:24:51.643241] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T21:24:52.151008] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-10-21T21:24:52.465961] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T21:24:52.951033] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-10-21T21:24:53.362104] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T21:24:53.751052] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-10-21T21:24:54.551038] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-10-21T21:24:54.701570] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T21:24:54.835178] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T21:24:55.351042] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-10-21T21:24:56.151097] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-10-21T21:24:56.330001] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T21:24:56.406748] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T21:24:56.951093] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-10-21T21:24:57.593488] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T21:24:57.751051] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-10-21T21:24:58.551009] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-10-21T21:24:58.761741] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T21:24:59.046470] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-21T21:24:59.351035] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-10-21T21:25:00.026752] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T21:25:00.150988] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-10-21T21:25:00.750402] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-21T21:25:00.951042] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-10-21T21:25:01.751034] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-10-21T21:25:02.347928] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-21T21:25:02.381220] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T21:25:02.522294] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-21T21:25:02.550996] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-10-21T21:25:03.351036] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-10-21T21:25:03.574704] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T21:25:04.151042] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-10-21T21:25:04.951000] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-10. [2025-10-21T21:25:05.197834] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T21:25:05.333085] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T21:25:05.751009] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-10-21T21:25:06.551003] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-10-21T21:25:06.822014] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-21T21:25:06.831761] [INFO ] [REMOTE ] TECK: Full fetch complete (77528 records). [2025-10-21T21:25:06.831883] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-10-21T21:25:07.177345] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T21:25:07.259720] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-10-21T21:25:07.259806] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-10-21T21:25:07.260996] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-10-21T21:25:07.261059] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-10-21T21:25:07.262439] [DEBUG] [LOCAL ] TECK: Trimmed 77528 records to 53435 (keeping 200 days of data) [2025-10-21T21:25:07.352124] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-10-21T21:25:07.586999] [DEBUG] [LOCAL ] TECK: Primary data saved (53435 records). [2025-10-21T21:25:07.587128] [INFO ] [MAIN ] TECK: Full history saved. [2025-10-21T21:25:07.587202] [INFO ] [MAIN ] Update Progress: 2063/2366 symbols completed. TECK took 34.1s. Estimated remaining: 38m 56s. Rate: 7.8 symbols/min [2025-10-21T21:25:07.757110] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:25:07.787149] [DEBUG] [LOCAL ] TEN: Loaded 30597 existing records from primary storage. [2025-10-21T21:25:07.787401] [INFO ] [MAIN ] TEN: Loaded 30597 existing records. [2025-10-21T21:25:07.977125] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:25:07.977326] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-10-21T21:25:07.977393] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-10-21T21:25:07.977601] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-10-21T21:25:07.977698] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-10-21T21:25:08.151958] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-10. [2025-10-21T21:25:08.340761] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:25:08.461460] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-21T21:25:08.461000] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-21T21:25:08.951079] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-10. [2025-10-21T21:25:09.589492] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T21:25:09.595329] [INFO ] [REMOTE ] TEF: Full fetch complete (54544 records). [2025-10-21T21:25:09.595418] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-10-21T21:25:09.757218] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-10-21T21:25:09.789921] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T21:25:09.876682] [INFO ] [REMOTE ] TEI: Full fetch complete (30641 records). [2025-10-21T21:25:09.887783] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-10-21T21:25:10.169208] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-10-21T21:25:10.169685] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-10-21T21:25:10.186529] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-10-21T21:25:10.186619] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-10-21T21:25:10.305974] [DEBUG] [LOCAL ] TEF: Trimmed 54544 records to 36837 (keeping 200 days of data) [2025-10-21T21:25:10.474483] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-10-21T21:25:10.475063] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-10-21T21:25:10.478251] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-10-21T21:25:10.478331] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-10-21T21:25:10.486252] [DEBUG] [LOCAL ] TEI: Trimmed 30641 records to 21227 (keeping 200 days of data) [2025-10-21T21:25:10.587205] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-10-21T21:25:10.721834] [DEBUG] [LOCAL ] TEF: Primary data saved (36837 records). [2025-10-21T21:25:10.722927] [INFO ] [MAIN ] TEF: Full history saved. [2025-10-21T21:25:10.723057] [INFO ] [MAIN ] Update Progress: 2064/2366 symbols completed. TEF took 27.4s. Estimated remaining: 38m 47s. Rate: 7.8 symbols/min [2025-10-21T21:25:10.763936] [DEBUG] [LOCAL ] TEI: Primary data saved (21227 records). [2025-10-21T21:25:10.807178] [INFO ] [MAIN ] TEI: Full history saved. [2025-10-21T21:25:10.823103] [INFO ] [MAIN ] Update Progress: 2065/2366 symbols completed. TEI took 26.9s. Estimated remaining: 38m 39s. Rate: 7.8 symbols/min [2025-10-21T21:25:11.052963] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:25:11.071608] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:25:11.091735] [DEBUG] [LOCAL ] TEO: Loaded 22830 existing records from primary storage. [2025-10-21T21:25:11.092024] [INFO ] [MAIN ] TEO: Loaded 22830 existing records. [2025-10-21T21:25:11.288258] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:25:11.303608] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-10-21T21:25:11.303714] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-10-21T21:25:11.304472] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-10-21T21:25:11.304433] [DEBUG] [LOCAL ] TEVA: Loaded 53622 existing records from primary storage. [2025-10-21T21:25:11.304580] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-10-21T21:25:11.336165] [INFO ] [MAIN ] TEVA: Loaded 53622 existing records. [2025-10-21T21:25:11.761478] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:25:11.778738] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-10-21T21:25:11.810290] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-21T21:25:11.830686] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-10-21T21:25:11.871065] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:25:11.837467] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-10-21T21:25:11.882380] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-10-21T21:25:12.080258] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T21:25:12.157467] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-10-21T21:25:12.218480] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-10-21T21:25:12.306923] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:25:12.951007] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-10-21T21:25:13.071820] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-21T21:25:13.161464] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-21T21:25:13.751072] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-10-21T21:25:14.551000] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-10-21T21:25:14.757318] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T21:25:14.915845] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T21:25:15.351057] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-10-21T21:25:16.106529] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T21:25:16.130523] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T21:25:16.150984] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-10-21T21:25:16.951011] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-10-21T21:25:17.278841] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T21:25:17.751061] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-10-21T21:25:18.551022] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-10-21T21:25:18.873450] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-21T21:25:18.967694] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T21:25:19.351012] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-10-21T21:25:20.151048] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-10-21T21:25:20.431780] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T21:25:20.638166] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-21T21:25:20.951075] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-10-21T21:25:21.751017] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-10-21T21:25:21.936112] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T21:25:22.032295] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T21:25:22.551069] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-10-21T21:25:23.293139] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T21:25:23.351010] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-10-21T21:25:24.151010] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-10-21T21:25:24.412568] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-21T21:25:24.636121] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T21:25:24.951024] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-10-21T21:25:25.337909] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-21T21:25:25.751003] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-10-21T21:25:25.979465] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-21T21:25:26.550994] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-10-21T21:25:27.104216] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T21:25:27.351027] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-10-21T21:25:28.151089] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-10-21T21:25:28.551426] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T21:25:28.685979] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T21:25:28.951022] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-10. [2025-10-21T21:25:29.117309] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T21:25:29.750996] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-10-21T21:25:30.113965] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T21:25:30.118183] [INFO ] [REMOTE ] TEO: Full fetch complete (32709 records). [2025-10-21T21:25:30.118270] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-10-21T21:25:30.486255] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-10-21T21:25:30.486353] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-10-21T21:25:30.487033] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-10-21T21:25:30.487093] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-10-21T21:25:30.487861] [DEBUG] [LOCAL ] TEO: Trimmed 32709 records to 22817 (keeping 200 days of data) [2025-10-21T21:25:30.566777] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-10-21T21:25:30.614305] [DEBUG] [LOCAL ] TEO: Primary data saved (22817 records). [2025-10-21T21:25:30.614417] [INFO ] [MAIN ] TEO: Full history saved. [2025-10-21T21:25:30.614489] [INFO ] [MAIN ] Update Progress: 2066/2366 symbols completed. TEO took 19.9s. Estimated remaining: 38m 33s. Rate: 7.8 symbols/min [2025-10-21T21:25:30.779489] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:25:30.819220] [DEBUG] [LOCAL ] TEX: Loaded 43641 existing records from primary storage. [2025-10-21T21:25:30.819513] [INFO ] [MAIN ] TEX: Loaded 43641 existing records. [2025-10-21T21:25:30.992459] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:25:30.992621] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-10-21T21:25:30.992698] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-10-21T21:25:30.992901] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-10-21T21:25:30.992956] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-10-21T21:25:31.345855] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:25:31.350985] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-10-21T21:25:31.906509] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-21T21:25:31.948085] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T21:25:32.151091] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-10-21T21:25:32.517351] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-21T21:25:32.951093] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-10-21T21:25:33.751005] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-10-21T21:25:34.239542] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-21T21:25:34.551015] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-10-21T21:25:34.661049] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-21T21:25:35.301197] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T21:25:35.350998] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-10-21T21:25:35.732698] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T21:25:36.151023] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-10. [2025-10-21T21:25:36.819039] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T21:25:36.950990] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-10-21T21:25:37.751055] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-10-21T21:25:37.790836] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-21T21:25:37.798503] [INFO ] [REMOTE ] TEL: Full fetch complete (73807 records). [2025-10-21T21:25:37.798675] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-10-21T21:25:37.874441] [DEBUG] [REMOTE ] TEVA: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-21T21:25:37.900988] [WARN ] [REMOTE ] TEVA: No data returned for month 2025-07 [2025-10-21T21:25:37.906670] [FATAL] [REMOTE ] TEVA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:25:37.917109] [FATAL] [MAIN ] TEVA: Failed to fetch primary data. [2025-10-21T21:25:37.940068] [WARN ] [MAIN ] TEVA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:25:37.959628] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-10-21T21:25:37.979221] [DEBUG] [LOCAL ] TEVA: No primary data file found to delete. [2025-10-21T21:25:37.999404] [INFO ] [LOCAL ] TEVA: Starting deletion of derivative data. [2025-10-21T21:25:38.072389] [DEBUG] [LOCAL ] TEVA: Deleted derivative data file. [2025-10-21T21:25:38.088221] [INFO ] [MAIN ] Update Progress: 2067/2366 symbols completed. TEVA took 27.3s. Estimated remaining: 38m 25s. Rate: 7.8 symbols/min [2025-10-21T21:25:38.323902] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-10-21T21:25:38.348682] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-10-21T21:25:38.349934] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-10-21T21:25:38.374390] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-10-21T21:25:38.375931] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:25:38.377552] [DEBUG] [LOCAL ] TEL: Trimmed 73807 records to 51052 (keeping 200 days of data) [2025-10-21T21:25:38.587421] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-10. [2025-10-21T21:25:38.642401] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T21:25:38.688993] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-21T21:25:38.698437] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-10-21T21:25:38.960965] [DEBUG] [LOCAL ] TEL: Primary data saved (51052 records). [2025-10-21T21:25:38.965406] [INFO ] [MAIN ] TEL: Full history saved. [2025-10-21T21:25:38.966343] [INFO ] [MAIN ] Update Progress: 2068/2366 symbols completed. TEL took 52.9s. Estimated remaining: 38m 16s. Rate: 7.8 symbols/min [2025-10-21T21:25:38.965249] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:25:38.998420] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-10-21T21:25:39.037301] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-10-21T21:25:39.059932] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-10-21T21:25:39.068302] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-10-21T21:25:39.263605] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:25:39.357978] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-10-21T21:25:39.522133] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:25:39.533149] [DEBUG] [LOCAL ] TFII: Loaded 32631 existing records from primary storage. [2025-10-21T21:25:39.533362] [INFO ] [MAIN ] TFII: Loaded 32631 existing records. [2025-10-21T21:25:39.712019] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:25:39.712227] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-10-21T21:25:39.712273] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-10-21T21:25:39.712485] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-10-21T21:25:39.712540] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-10-21T21:25:39.902743] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-21T21:25:39.986539] [INFO ] [REMOTE ] TEN: Full fetch complete (44046 records). [2025-10-21T21:25:40.010711] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-10-21T21:25:40.159043] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-10-21T21:25:40.200956] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:25:40.474970] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-10-21T21:25:40.475047] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-10-21T21:25:40.475928] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-10-21T21:25:40.475989] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-10-21T21:25:40.476875] [DEBUG] [LOCAL ] TEN: Trimmed 44046 records to 30504 (keeping 200 days of data) [2025-10-21T21:25:40.653621] [DEBUG] [LOCAL ] TEN: Primary data saved (30504 records). [2025-10-21T21:25:40.653787] [INFO ] [MAIN ] TEN: Full history saved. [2025-10-21T21:25:40.653871] [INFO ] [MAIN ] Update Progress: 2069/2366 symbols completed. TEN took 33.1s. Estimated remaining: 38m 8s. Rate: 7.8 symbols/min [2025-10-21T21:25:40.827705] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:25:40.850627] [DEBUG] [LOCAL ] TFIN: Loaded 23845 existing records from primary storage. [2025-10-21T21:25:40.850903] [INFO ] [MAIN ] TFIN: Loaded 23845 existing records. [2025-10-21T21:25:40.957316] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-10-21T21:25:41.039043] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:25:41.039269] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-10-21T21:25:41.039316] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-10-21T21:25:41.039477] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-10-21T21:25:41.039515] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-10-21T21:25:41.427745] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:25:41.441360] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-21T21:25:41.744668] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T21:25:41.754784] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-10-21T21:25:41.839300] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-21T21:25:42.551115] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-10-21T21:25:43.257472] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T21:25:43.351036] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-10-21T21:25:44.151056] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-10-21T21:25:44.349070] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T21:25:44.370832] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-21T21:25:44.951042] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-10-21T21:25:45.741444] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T21:25:45.751013] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-10-21T21:25:46.551011] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-10-21T21:25:46.756458] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T21:25:46.860149] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-21T21:25:47.351075] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-10-21T21:25:47.877544] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T21:25:48.151028] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-10-21T21:25:48.831852] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T21:25:48.951031] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-10-21T21:25:49.645001] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-21T21:25:49.751004] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-10. [2025-10-21T21:25:50.551060] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-10-21T21:25:50.620018] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T21:25:51.192630] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-21T21:25:51.199092] [INFO ] [REMOTE ] TEX: Full fetch complete (64436 records). [2025-10-21T21:25:51.199198] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-10-21T21:25:51.358124] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-10-21T21:25:51.592002] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-10-21T21:25:51.592087] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-10-21T21:25:51.593199] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-10-21T21:25:51.593260] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-10-21T21:25:51.594412] [DEBUG] [LOCAL ] TEX: Trimmed 64436 records to 43602 (keeping 200 days of data) [2025-10-21T21:25:51.857547] [DEBUG] [LOCAL ] TEX: Primary data saved (43602 records). [2025-10-21T21:25:51.857717] [INFO ] [MAIN ] TEX: Full history saved. [2025-10-21T21:25:51.858446] [INFO ] [MAIN ] Update Progress: 2070/2366 symbols completed. TEX took 21.2s. Estimated remaining: 38m 0s. Rate: 7.8 symbols/min [2025-10-21T21:25:52.025320] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:25:52.063899] [DEBUG] [LOCAL ] TFPM: Loaded 39797 existing records from primary storage. [2025-10-21T21:25:52.064195] [INFO ] [MAIN ] TFPM: Loaded 39797 existing records. [2025-10-21T21:25:52.161780] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-10-21T21:25:52.247105] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:25:52.247444] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-10-21T21:25:52.247494] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-10-21T21:25:52.247809] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-10-21T21:25:52.247865] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-10-21T21:25:52.600272] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:25:52.630552] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-21T21:25:52.667343] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T21:25:52.951070] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-10-21T21:25:53.377960] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T21:25:53.751000] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-10-21T21:25:54.362049] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-21T21:25:54.551008] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-10-21T21:25:55.173675] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-21T21:25:55.351011] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-10-21T21:25:56.151048] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-10-21T21:25:56.383699] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T21:25:56.438221] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T21:25:56.951009] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-10-21T21:25:57.004001] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T21:25:57.751051] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-10-21T21:25:58.058320] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T21:25:58.551044] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-10-21T21:25:59.173987] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T21:25:59.351009] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-10-21T21:25:59.519581] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-21T21:26:00.150990] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-10-21T21:26:00.336345] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T21:26:00.951046] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-10-21T21:26:01.750997] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-10-21T21:26:02.014292] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T21:26:02.067441] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T21:26:02.551006] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-10-21T21:26:02.989991] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T21:26:03.351021] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-10-21T21:26:04.150998] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-10-21T21:26:04.477955] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T21:26:04.637210] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T21:26:04.950995] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-10-21T21:26:05.382939] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T21:26:05.750995] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-10-21T21:26:06.551031] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-10. [2025-10-21T21:26:06.841209] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T21:26:07.238310] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-21T21:26:07.350999] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-10-21T21:26:07.724202] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T21:26:07.728944] [INFO ] [REMOTE ] TFII: Full fetch complete (47934 records). [2025-10-21T21:26:07.729032] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-10-21T21:26:08.124892] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-10-21T21:26:08.124977] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-10-21T21:26:08.125947] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-10-21T21:26:08.126007] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-10-21T21:26:08.126955] [DEBUG] [LOCAL ] TFII: Trimmed 47934 records to 32402 (keeping 200 days of data) [2025-10-21T21:26:08.180707] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-10-21T21:26:08.325597] [DEBUG] [LOCAL ] TFII: Primary data saved (32402 records). [2025-10-21T21:26:08.325768] [INFO ] [MAIN ] TFII: Full history saved. [2025-10-21T21:26:08.326332] [INFO ] [MAIN ] Update Progress: 2071/2366 symbols completed. TFII took 29.4s. Estimated remaining: 37m 54s. Rate: 7.8 symbols/min [2025-10-21T21:26:08.496850] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:08.509503] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T21:26:08.549777] [DEBUG] [LOCAL ] TFX: Loaded 35956 existing records from primary storage. [2025-10-21T21:26:08.550062] [INFO ] [MAIN ] TFX: Loaded 35956 existing records. [2025-10-21T21:26:08.724400] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:26:08.724600] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-10-21T21:26:08.724667] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-10-21T21:26:08.724855] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-10-21T21:26:08.724894] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-10-21T21:26:08.960110] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-10-21T21:26:09.085014] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:26:09.751052] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-10-21T21:26:10.088259] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T21:26:10.533517] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T21:26:10.550991] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-10-21T21:26:10.811727] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T21:26:11.351058] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-10. [2025-10-21T21:26:12.151064] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-10. [2025-10-21T21:26:12.174411] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T21:26:12.236540] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T21:26:12.240731] [INFO ] [REMOTE ] TFIN: Full fetch complete (32538 records). [2025-10-21T21:26:12.240822] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-10-21T21:26:12.607956] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-10-21T21:26:12.608044] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-10-21T21:26:12.608852] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-10-21T21:26:12.608915] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-10-21T21:26:12.609712] [DEBUG] [LOCAL ] TFIN: Trimmed 32538 records to 23764 (keeping 200 days of data) [2025-10-21T21:26:12.746550] [DEBUG] [LOCAL ] TFIN: Primary data saved (23764 records). [2025-10-21T21:26:12.746734] [INFO ] [MAIN ] TFIN: Full history saved. [2025-10-21T21:26:12.746840] [INFO ] [MAIN ] Update Progress: 2072/2366 symbols completed. TFIN took 32.1s. Estimated remaining: 37m 46s. Rate: 7.8 symbols/min [2025-10-21T21:26:12.914755] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:12.926726] [DEBUG] [LOCAL ] TG: Loaded 10704 existing records from primary storage. [2025-10-21T21:26:12.926943] [INFO ] [MAIN ] TG: Loaded 10704 existing records. [2025-10-21T21:26:12.957436] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-10-21T21:26:13.105304] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:26:13.105566] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-10-21T21:26:13.105618] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-10-21T21:26:13.105832] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-10-21T21:26:13.105891] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-10-21T21:26:13.462584] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:26:13.757847] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-10-21T21:26:13.772889] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T21:26:13.781561] [INFO ] [REMOTE ] TFC: Full fetch complete (77843 records). [2025-10-21T21:26:13.781748] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-10-21T21:26:14.167882] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-10-21T21:26:14.167963] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-10-21T21:26:14.169165] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-10-21T21:26:14.169227] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-10-21T21:26:14.170613] [DEBUG] [LOCAL ] TFC: Trimmed 77843 records to 53667 (keeping 200 days of data) [2025-10-21T21:26:14.504238] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-10-21T21:26:14.504617] [INFO ] [MAIN ] TFC: Full history saved. [2025-10-21T21:26:14.505450] [INFO ] [MAIN ] Update Progress: 2073/2366 symbols completed. TFC took 36.4s. Estimated remaining: 37m 37s. Rate: 7.8 symbols/min [2025-10-21T21:26:14.561471] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-10-21T21:26:14.691816] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:14.664262] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T21:26:14.694993] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-10-21T21:26:14.695068] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-10-21T21:26:14.695347] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-10-21T21:26:14.695587] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-21T21:26:14.703946] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-21T21:26:14.716248] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-10-21T21:26:14.787663] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-21T21:26:15.083183] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:26:15.351065] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-10-21T21:26:15.557785] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:26:15.558037] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-10-21T21:26:15.558121] [FATAL] [REMOTE ] TGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:26:15.558171] [FATAL] [MAIN ] TGE: Failed to fetch primary data. [2025-10-21T21:26:15.558204] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:26:15.558258] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-10-21T21:26:15.558313] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-10-21T21:26:15.558347] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-10-21T21:26:15.558384] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-10-21T21:26:15.558430] [INFO ] [MAIN ] Update Progress: 2074/2366 symbols completed. TGE took 1.1s. Estimated remaining: 37m 29s. Rate: 7.8 symbols/min [2025-10-21T21:26:15.728416] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:15.757803] [DEBUG] [LOCAL ] TGLS: Loaded 27616 existing records from primary storage. [2025-10-21T21:26:15.758074] [INFO ] [MAIN ] TGLS: Loaded 27616 existing records. [2025-10-21T21:26:15.940613] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:26:15.940894] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-10-21T21:26:15.940976] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-10-21T21:26:15.941402] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-10-21T21:26:15.941458] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-10-21T21:26:16.158363] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-10-21T21:26:16.297292] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:26:16.318830] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T21:26:16.951048] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-10-21T21:26:16.958414] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T21:26:17.751069] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-10-21T21:26:18.492623] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T21:26:18.550982] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-10-21T21:26:18.584240] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-21T21:26:19.351059] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-10-21T21:26:20.157169] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-10-21T21:26:20.162764] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T21:26:20.235976] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-21T21:26:20.950998] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-10-21T21:26:21.751009] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-10-21T21:26:21.896179] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T21:26:22.236837] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T21:26:22.551029] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-10-21T21:26:22.580951] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T21:26:23.351061] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-10. [2025-10-21T21:26:23.924192] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T21:26:24.151086] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-10-21T21:26:24.951035] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-10-21T21:26:25.097916] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T21:26:25.105137] [INFO ] [REMOTE ] TFPM: Full fetch complete (52892 records). [2025-10-21T21:26:25.105303] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-10-21T21:26:25.486934] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-10-21T21:26:25.487035] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-10-21T21:26:25.488096] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-10-21T21:26:25.488158] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-10-21T21:26:25.489278] [DEBUG] [LOCAL ] TFPM: Trimmed 52892 records to 39841 (keeping 200 days of data) [2025-10-21T21:26:25.727680] [DEBUG] [LOCAL ] TFPM: Primary data saved (39841 records). [2025-10-21T21:26:25.728469] [INFO ] [MAIN ] TFPM: Full history saved. [2025-10-21T21:26:25.728559] [INFO ] [MAIN ] Update Progress: 2075/2366 symbols completed. TFPM took 33.9s. Estimated remaining: 37m 21s. Rate: 7.8 symbols/min [2025-10-21T21:26:25.759576] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-10-21T21:26:25.902972] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:25.927968] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T21:26:25.980436] [DEBUG] [LOCAL ] TGNA: Loaded 48621 existing records from primary storage. [2025-10-21T21:26:25.980779] [INFO ] [MAIN ] TGNA: Loaded 48621 existing records. [2025-10-21T21:26:26.168185] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:26:26.168551] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-10-21T21:26:26.168624] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-10-21T21:26:26.174238] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-10-21T21:26:26.182981] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-10-21T21:26:26.228373] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-21T21:26:26.488875] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-21T21:26:26.552477] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-10-21T21:26:26.574866] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:26:27.351011] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-10-21T21:26:27.367143] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T21:26:28.151016] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-10-21T21:26:28.805308] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-21T21:26:28.951050] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-10-21T21:26:29.503731] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T21:26:29.751057] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-10-21T21:26:30.261790] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T21:26:30.551035] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-10-21T21:26:31.309065] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T21:26:31.350986] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-10-21T21:26:32.073538] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T21:26:32.150993] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-10-21T21:26:32.949790] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T21:26:32.958348] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-10-21T21:26:33.208568] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T21:26:33.751028] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-10-21T21:26:34.314263] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T21:26:34.550998] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-10-21T21:26:35.351005] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-10-21T21:26:35.384423] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T21:26:35.565551] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T21:26:36.151064] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-10-21T21:26:36.951052] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-10. [2025-10-21T21:26:37.054027] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T21:26:37.082921] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-21T21:26:37.751018] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-10. [2025-10-21T21:26:37.973158] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T21:26:37.978529] [INFO ] [REMOTE ] TFX: Full fetch complete (54723 records). [2025-10-21T21:26:37.978615] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-10-21T21:26:38.362556] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-10-21T21:26:38.362752] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-10-21T21:26:38.363834] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-10-21T21:26:38.363895] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-10-21T21:26:38.365070] [DEBUG] [LOCAL ] TFX: Trimmed 54723 records to 35780 (keeping 200 days of data) [2025-10-21T21:26:38.563422] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T21:26:38.562905] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-10-21T21:26:38.568781] [INFO ] [REMOTE ] TG: Full fetch complete (15169 records). [2025-10-21T21:26:38.571342] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-10-21T21:26:38.704958] [DEBUG] [LOCAL ] TFX: Primary data saved (35780 records). [2025-10-21T21:26:38.715374] [INFO ] [MAIN ] TFX: Full history saved. [2025-10-21T21:26:38.716246] [INFO ] [MAIN ] Update Progress: 2076/2366 symbols completed. TFX took 30.4s. Estimated remaining: 37m 14s. Rate: 7.8 symbols/min [2025-10-21T21:26:39.076780] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:39.140945] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-10-21T21:26:39.141039] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-10-21T21:26:39.141382] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-10-21T21:26:39.141441] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-10-21T21:26:39.142128] [DEBUG] [LOCAL ] TG: Trimmed 15169 records to 10652 (keeping 200 days of data) [2025-10-21T21:26:39.220468] [DEBUG] [LOCAL ] TGS: Loaded 33811 existing records from primary storage. [2025-10-21T21:26:39.219857] [DEBUG] [LOCAL ] TG: Primary data saved (10652 records). [2025-10-21T21:26:39.220594] [INFO ] [MAIN ] TG: Full history saved. [2025-10-21T21:26:39.220727] [INFO ] [MAIN ] Update Progress: 2077/2366 symbols completed. TG took 26.5s. Estimated remaining: 37m 6s. Rate: 7.8 symbols/min [2025-10-21T21:26:39.221098] [INFO ] [MAIN ] TGS: Loaded 33811 existing records. [2025-10-21T21:26:39.358015] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-10-21T21:26:39.397030] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:26:39.397172] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-10-21T21:26:39.397217] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-10-21T21:26:39.397381] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-10-21T21:26:39.397418] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-10-21T21:26:39.742281] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:26:40.151053] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-10-21T21:26:40.331220] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T21:26:40.913823] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T21:26:40.950979] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-10-21T21:26:41.557479] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-21T21:26:41.751087] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-10-21T21:26:41.898586] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-21T21:26:42.551102] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-10-21T21:26:43.055562] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-21T21:26:43.351039] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-10-21T21:26:43.700867] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T21:26:44.151034] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-10-21T21:26:44.952824] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-10-21T21:26:44.954450] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T21:26:45.554306] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T21:26:45.751023] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-10-21T21:26:46.339431] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-21T21:26:46.551026] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-10-21T21:26:47.164965] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T21:26:47.351032] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-10-21T21:26:47.951390] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T21:26:48.151009] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-10-21T21:26:48.951053] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-10-21T21:26:48.983904] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T21:26:49.499516] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T21:26:49.751049] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-10-21T21:26:49.871540] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T21:26:50.551079] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-10-21T21:26:51.096961] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T21:26:51.351058] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-10. [2025-10-21T21:26:52.151002] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-10-21T21:26:52.331227] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T21:26:52.512523] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T21:26:52.516878] [INFO ] [REMOTE ] TGLS: Full fetch complete (40638 records). [2025-10-21T21:26:52.516961] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-10-21T21:26:52.898486] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-10-21T21:26:52.898563] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-10-21T21:26:52.899357] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-10-21T21:26:52.899418] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-10-21T21:26:52.900255] [DEBUG] [LOCAL ] TGLS: Trimmed 40638 records to 27714 (keeping 200 days of data) [2025-10-21T21:26:52.953923] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-10-21T21:26:53.069952] [DEBUG] [LOCAL ] TGLS: Primary data saved (27714 records). [2025-10-21T21:26:53.070078] [INFO ] [MAIN ] TGLS: Full history saved. [2025-10-21T21:26:53.070829] [INFO ] [MAIN ] Update Progress: 2078/2366 symbols completed. TGLS took 37.5s. Estimated remaining: 36m 59s. Rate: 7.8 symbols/min [2025-10-21T21:26:53.470353] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T21:26:53.751097] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-10-21T21:26:54.839002] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T21:26:54.850108] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-10. [2025-10-21T21:26:55.018056] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T21:26:55.351084] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-10-21T21:26:56.531317] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T21:26:56.538874] [INFO ] [REMOTE ] TGNA: Full fetch complete (70095 records). [2025-10-21T21:26:56.539002] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-10-21T21:26:56.950130] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-10-21T21:26:56.950262] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-10-21T21:26:56.951470] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-10-21T21:26:56.951556] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-10-21T21:26:56.985016] [DEBUG] [LOCAL ] TGNA: Trimmed 70095 records to 48566 (keeping 200 days of data) [2025-10-21T21:26:56.987385] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T21:26:56.996817] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-10. [2025-10-21T21:26:57.282498] [DEBUG] [LOCAL ] TGNA: Primary data saved (48566 records). [2025-10-21T21:26:57.282619] [INFO ] [MAIN ] TGNA: Full history saved. [2025-10-21T21:26:57.283442] [INFO ] [MAIN ] Update Progress: 2079/2366 symbols completed. TGNA took 31.6s. Estimated remaining: 36m 51s. Rate: 7.8 symbols/min [2025-10-21T21:26:58.521145] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T21:26:58.527028] [INFO ] [REMOTE ] TGS: Full fetch complete (48689 records). [2025-10-21T21:26:58.527118] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-10-21T21:26:58.910303] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-10-21T21:26:58.910379] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-10-21T21:26:58.911304] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-10-21T21:26:58.911365] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-10-21T21:26:58.912294] [DEBUG] [LOCAL ] TGS: Trimmed 48689 records to 33875 (keeping 200 days of data) [2025-10-21T21:26:59.107941] [DEBUG] [LOCAL ] TGS: Primary data saved (33875 records). [2025-10-21T21:26:59.108073] [INFO ] [MAIN ] TGS: Full history saved. [2025-10-21T21:26:59.108163] [INFO ] [MAIN ] Update Progress: 2080/2366 symbols completed. TGS took 20.4s. Estimated remaining: 36m 42s. Rate: 7.8 symbols/min [2025-10-21T21:26:59.769616] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:59.771857] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:59.778476] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:59.798605] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:26:59.802842] [DEBUG] [LOCAL ] THIR: Loaded 2407 existing records from primary storage. [2025-10-21T21:26:59.803340] [INFO ] [MAIN ] THIR: Loaded 2407 existing records. [2025-10-21T21:27:00.009196] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:00.010119] [DEBUG] [LOCAL ] THG: Loaded 21672 existing records from primary storage. [2025-10-21T21:27:00.010364] [INFO ] [MAIN ] THG: Loaded 21672 existing records. [2025-10-21T21:27:00.015995] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-10-21T21:27:00.021661] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-10-21T21:27:00.052000] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-10-21T21:27:00.087693] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-10-21T21:27:00.187484] [DEBUG] [LOCAL ] THC: Loaded 46820 existing records from primary storage. [2025-10-21T21:27:00.204762] [INFO ] [MAIN ] THC: Loaded 46820 existing records. [2025-10-21T21:27:00.340089] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-21T21:27:00.440728] [INFO ] [MAIN ] TGT: Loaded 53777 existing records. [2025-10-21T21:27:00.449445] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:00.508958] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-10-21T21:27:00.583889] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-10-21T21:27:00.794456] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-10-21T21:27:00.842232] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:00.851015] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-10-21T21:27:00.869221] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-10-21T21:27:00.869338] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-10-21T21:27:00.972221] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-10-21T21:27:00.988978] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:00.989109] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-10-21T21:27:01.032745] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-10-21T21:27:01.088359] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:01.103882] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-10-21T21:27:01.109357] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-10-21T21:27:01.138874] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-10-21T21:27:01.145132] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-10-21T21:27:01.703393] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-21T21:27:01.732124] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-10-21T21:27:01.981610] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:02.008755] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-10-21T21:27:02.150921] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:02.149981] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:02.151242] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-10-21T21:27:02.151482] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-10-21T21:27:02.289238] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-21T21:27:02.290245] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-10-21T21:27:02.695750] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-21T21:27:02.696776] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-10-21T21:27:03.222459] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-21T21:27:03.223836] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-10-21T21:27:03.238278] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-21T21:27:03.350980] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-10-21T21:27:03.458100] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-21T21:27:03.668321] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-21T21:27:03.779415] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T21:27:04.075775] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T21:27:04.151010] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-10-21T21:27:04.951081] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-10-21T21:27:05.380448] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-21T21:27:05.436546] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-21T21:27:05.751013] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-10-21T21:27:06.218500] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-21T21:27:06.551016] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-10-21T21:27:07.351017] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-10-21T21:27:08.150990] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-10-21T21:27:08.604105] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-21T21:27:08.847633] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-21T21:27:08.950995] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-10-21T21:27:09.020193] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T21:27:09.751063] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-10-21T21:27:10.213473] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-21T21:27:10.329747] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T21:27:10.551052] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-10-21T21:27:11.351095] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-10-21T21:27:11.783955] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T21:27:12.151071] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-10. [2025-10-21T21:27:12.476121] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-21T21:27:12.477316] [INFO ] [REMOTE ] THIR: Full fetch complete (2923 records). [2025-10-21T21:27:12.477405] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-10-21T21:27:12.831880] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-10-21T21:27:12.831962] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-10-21T21:27:12.832082] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-10-21T21:27:12.832120] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-10-21T21:27:12.832449] [DEBUG] [LOCAL ] THIR: Trimmed 2923 records to 2426 (keeping 200 days of data) [2025-10-21T21:27:12.847028] [DEBUG] [LOCAL ] THIR: Primary data saved (2426 records). [2025-10-21T21:27:12.847156] [INFO ] [MAIN ] THIR: Full history saved. [2025-10-21T21:27:12.847234] [INFO ] [MAIN ] Update Progress: 2081/2366 symbols completed. THIR took 13.7s. Estimated remaining: 36m 35s. Rate: 7.8 symbols/min [2025-10-21T21:27:12.956094] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-10-21T21:27:13.015991] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:27:13.018915] [DEBUG] [LOCAL ] THLV: Loaded 1505 existing records from primary storage. [2025-10-21T21:27:13.019046] [INFO ] [MAIN ] THLV: Loaded 1505 existing records. [2025-10-21T21:27:13.195729] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:13.195916] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-10-21T21:27:13.195963] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-10-21T21:27:13.196094] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-10-21T21:27:13.196132] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-10-21T21:27:13.596944] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:13.751000] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-10-21T21:27:13.869678] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-21T21:27:14.288398] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-21T21:27:14.550992] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-10-21T21:27:14.837068] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T21:27:15.351036] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-10-21T21:27:15.601548] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T21:27:16.151076] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-10-21T21:27:16.951103] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-10-21T21:27:17.393306] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-21T21:27:17.733349] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-21T21:27:17.750980] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-10-21T21:27:18.200673] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T21:27:18.551069] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-10-21T21:27:19.351061] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-10-21T21:27:19.794552] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-21T21:27:20.151013] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-10-21T21:27:20.189517] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-21T21:27:20.313297] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T21:27:20.951078] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-10-21T21:27:21.386119] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T21:27:21.751093] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-10-21T21:27:22.551003] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-10-21T21:27:22.677289] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T21:27:22.845286] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T21:27:22.986624] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T21:27:23.351022] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-10-21T21:27:24.151055] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-10-21T21:27:24.592970] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-21T21:27:24.951048] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-10-21T21:27:25.096044] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T21:27:25.751032] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-10-21T21:27:26.160688] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-21T21:27:26.551044] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-10-21T21:27:26.900211] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-21T21:27:27.037458] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-21T21:27:27.350998] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-10-21T21:27:28.151046] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-10-21T21:27:28.948711] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T21:27:28.957189] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-10-21T21:27:29.751022] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-10-21T21:27:29.974616] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T21:27:30.463800] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-21T21:27:30.551031] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-10-21T21:27:30.887077] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-21T21:27:31.306473] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-21T21:27:31.351027] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-10. [2025-10-21T21:27:32.150995] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-10-21T21:27:32.389800] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T21:27:32.393297] [INFO ] [REMOTE ] THG: Full fetch complete (31453 records). [2025-10-21T21:27:32.393390] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-10-21T21:27:32.761745] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-10-21T21:27:32.761837] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-10-21T21:27:32.762458] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-10-21T21:27:32.762518] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-10-21T21:27:32.763230] [DEBUG] [LOCAL ] THG: Trimmed 31453 records to 21609 (keeping 200 days of data) [2025-10-21T21:27:32.895038] [DEBUG] [LOCAL ] THG: Primary data saved (21609 records). [2025-10-21T21:27:32.895155] [INFO ] [MAIN ] THG: Full history saved. [2025-10-21T21:27:32.895229] [INFO ] [MAIN ] Update Progress: 2082/2366 symbols completed. THG took 33.7s. Estimated remaining: 36m 29s. Rate: 7.8 symbols/min [2025-10-21T21:27:32.958363] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-10. [2025-10-21T21:27:33.068124] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:27:33.112548] [DEBUG] [LOCAL ] THO: Loaded 41224 existing records from primary storage. [2025-10-21T21:27:33.112863] [INFO ] [MAIN ] THO: Loaded 41224 existing records. [2025-10-21T21:27:33.285264] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:33.285513] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-10-21T21:27:33.285581] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-10-21T21:27:33.285822] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-10-21T21:27:33.285895] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-10-21T21:27:33.640609] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:33.751016] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-10-21T21:27:34.439524] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T21:27:34.446375] [INFO ] [REMOTE ] THC: Full fetch complete (68729 records). [2025-10-21T21:27:34.446758] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-10-21T21:27:34.568568] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-10-21T21:27:34.585046] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-21T21:27:34.941398] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-10-21T21:27:34.941496] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-10-21T21:27:34.943105] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-10-21T21:27:34.943181] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-10-21T21:27:34.944624] [DEBUG] [LOCAL ] THC: Trimmed 68729 records to 46709 (keeping 200 days of data) [2025-10-21T21:27:35.021890] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-21T21:27:35.309182] [DEBUG] [LOCAL ] THC: Primary data saved (46709 records). [2025-10-21T21:27:35.309332] [INFO ] [MAIN ] THC: Full history saved. [2025-10-21T21:27:35.309964] [INFO ] [MAIN ] Update Progress: 2083/2366 symbols completed. THC took 36.2s. Estimated remaining: 36m 21s. Rate: 7.8 symbols/min [2025-10-21T21:27:35.356173] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-10-21T21:27:35.537729] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:27:35.564353] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T21:27:35.604860] [DEBUG] [LOCAL ] THQ: Loaded 25401 existing records from primary storage. [2025-10-21T21:27:35.605140] [INFO ] [MAIN ] THQ: Loaded 25401 existing records. [2025-10-21T21:27:35.787721] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:35.787927] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-10-21T21:27:35.787974] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-10-21T21:27:35.788165] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-10-21T21:27:35.788220] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-10-21T21:27:36.158236] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:36.153629] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-10. [2025-10-21T21:27:36.501368] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-21T21:27:36.502212] [INFO ] [REMOTE ] THLV: Full fetch complete (2536 records). [2025-10-21T21:27:36.502278] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-10-21T21:27:36.851101] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-10-21T21:27:36.851178] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-10-21T21:27:36.851281] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-10-21T21:27:36.851319] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-10-21T21:27:36.851661] [DEBUG] [LOCAL ] THLV: Trimmed 2536 records to 1495 (keeping 200 days of data) [2025-10-21T21:27:36.860595] [DEBUG] [LOCAL ] THLV: Primary data saved (1495 records). [2025-10-21T21:27:36.860736] [INFO ] [MAIN ] THLV: Full history saved. [2025-10-21T21:27:36.860870] [INFO ] [MAIN ] Update Progress: 2084/2366 symbols completed. THLV took 24.0s. Estimated remaining: 36m 12s. Rate: 7.8 symbols/min [2025-10-21T21:27:36.956445] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-10-21T21:27:37.031431] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:27:37.050462] [DEBUG] [LOCAL ] THR: Loaded 19630 existing records from primary storage. [2025-10-21T21:27:37.050730] [INFO ] [MAIN ] THR: Loaded 19630 existing records. [2025-10-21T21:27:37.228341] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:37.228562] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-10-21T21:27:37.228615] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-10-21T21:27:37.228810] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-10-21T21:27:37.228860] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-10-21T21:27:37.601142] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:37.750994] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-10-21T21:27:38.005900] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-21T21:27:38.475853] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T21:27:38.533238] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T21:27:38.550983] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-10-21T21:27:39.350993] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-10-21T21:27:39.616635] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T21:27:40.151069] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-10-21T21:27:40.951040] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-10. [2025-10-21T21:27:41.012480] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T21:27:41.261007] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T21:27:41.751066] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-10-21T21:27:42.551032] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-10-21T21:27:42.821069] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T21:27:43.291531] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-21T21:27:43.299853] [INFO ] [REMOTE ] TGT: Full fetch complete (77955 records). [2025-10-21T21:27:43.299994] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-10-21T21:27:43.362669] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-10-21T21:27:43.723000] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-10-21T21:27:43.723080] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-10-21T21:27:43.724304] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-10-21T21:27:43.724367] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-10-21T21:27:43.725803] [DEBUG] [LOCAL ] TGT: Trimmed 77955 records to 53777 (keeping 200 days of data) [2025-10-21T21:27:44.056588] [DEBUG] [LOCAL ] TGT: Primary data saved (53777 records). [2025-10-21T21:27:44.056746] [INFO ] [MAIN ] TGT: Full history saved. [2025-10-21T21:27:44.056832] [INFO ] [MAIN ] Update Progress: 2085/2366 symbols completed. TGT took 44.9s. Estimated remaining: 36m 4s. Rate: 7.8 symbols/min [2025-10-21T21:27:44.158203] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-10-21T21:27:44.230178] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:27:44.266178] [DEBUG] [LOCAL ] THS: Loaded 38682 existing records from primary storage. [2025-10-21T21:27:44.266448] [INFO ] [MAIN ] THS: Loaded 38682 existing records. [2025-10-21T21:27:44.458926] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:27:44.459924] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-10-21T21:27:44.460906] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T21:27:44.461034] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-10-21T21:27:44.465637] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-10-21T21:27:44.480129] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-10-21T21:27:44.555541] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T21:27:44.851036] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:27:44.950995] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-10-21T21:27:45.308542] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T21:27:45.751097] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-10-21T21:27:46.210577] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T21:27:46.551070] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-10-21T21:27:46.727859] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T21:27:47.351022] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-10-21T21:27:48.039104] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T21:27:48.150996] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-10-21T21:27:48.419566] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T21:27:48.951066] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-10-21T21:27:49.531516] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T21:27:49.751016] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-10-21T21:27:49.948694] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T21:27:50.551055] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-10-21T21:27:50.927690] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T21:27:51.351074] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-10-21T21:27:52.146342] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T21:27:52.154338] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-10-21T21:27:52.472021] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-21T21:27:52.951037] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-10-21T21:27:53.336616] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-21T21:27:53.751024] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-10-21T21:27:54.514354] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T21:27:54.550986] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-10-21T21:27:54.805921] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T21:27:55.351074] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-10-21T21:27:56.024386] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T21:27:56.151027] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-10-21T21:27:56.955466] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-10-21T21:27:56.960541] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T21:27:57.613064] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-21T21:27:57.751000] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-10-21T21:27:58.454587] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T21:27:58.550993] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-10-21T21:27:59.076328] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T21:27:59.351017] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-10-21T21:27:59.892183] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-21T21:28:00.150998] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-10-21T21:28:00.455426] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-21T21:28:00.951083] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-10-21T21:28:01.757264] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-10-21T21:28:01.763156] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T21:28:02.001761] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T21:28:02.551002] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-10-21T21:28:02.963153] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T21:28:03.351039] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-10. [2025-10-21T21:28:03.836010] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-21T21:28:04.151025] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-10-21T21:28:04.298932] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-21T21:28:04.302106] [INFO ] [REMOTE ] THR: Full fetch complete (28840 records). [2025-10-21T21:28:04.302222] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-10-21T21:28:04.665698] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-10-21T21:28:04.665786] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-10-21T21:28:04.666597] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-10-21T21:28:04.666637] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-10-21T21:28:04.667324] [DEBUG] [LOCAL ] THR: Trimmed 28840 records to 19653 (keeping 200 days of data) [2025-10-21T21:28:04.778852] [DEBUG] [LOCAL ] THR: Primary data saved (19653 records). [2025-10-21T21:28:04.778981] [INFO ] [MAIN ] THR: Full history saved. [2025-10-21T21:28:04.779059] [INFO ] [MAIN ] Update Progress: 2086/2366 symbols completed. THR took 27.9s. Estimated remaining: 35m 58s. Rate: 7.8 symbols/min [2025-10-21T21:28:04.943056] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:28:04.953234] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-10-21T21:28:04.963564] [DEBUG] [LOCAL ] THW: Loaded 19667 existing records from primary storage. [2025-10-21T21:28:04.963924] [INFO ] [MAIN ] THW: Loaded 19667 existing records. [2025-10-21T21:28:05.140225] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:28:05.140473] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-10-21T21:28:05.140525] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-10-21T21:28:05.140731] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-10-21T21:28:05.140788] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-10-21T21:28:05.494087] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:28:05.724237] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T21:28:05.750987] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-10-21T21:28:06.551029] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-10-21T21:28:06.618197] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T21:28:07.350999] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-10. [2025-10-21T21:28:07.396963] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T21:28:07.767911] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T21:28:08.151022] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-10. [2025-10-21T21:28:08.534501] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T21:28:08.540740] [INFO ] [REMOTE ] THS: Full fetch complete (54562 records). [2025-10-21T21:28:08.540841] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-10-21T21:28:08.929600] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-10-21T21:28:08.929705] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-10-21T21:28:08.930737] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-10-21T21:28:08.930798] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-10-21T21:28:08.931815] [DEBUG] [LOCAL ] THS: Trimmed 54562 records to 38685 (keeping 200 days of data) [2025-10-21T21:28:08.978747] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-10. [2025-10-21T21:28:09.170854] [DEBUG] [LOCAL ] THS: Primary data saved (38685 records). [2025-10-21T21:28:09.171001] [INFO ] [MAIN ] THS: Full history saved. [2025-10-21T21:28:09.171079] [INFO ] [MAIN ] Update Progress: 2087/2366 symbols completed. THS took 25.1s. Estimated remaining: 35m 50s. Rate: 7.8 symbols/min [2025-10-21T21:28:09.356097] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:28:09.353200] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T21:28:09.359629] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-10-21T21:28:09.360002] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-10-21T21:28:09.360129] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-10-21T21:28:09.360206] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-21T21:28:09.360386] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-21T21:28:09.360438] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-10-21T21:28:09.392028] [INFO ] [REMOTE ] THQ: Full fetch complete (34818 records). [2025-10-21T21:28:09.424363] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-10-21T21:28:09.753086] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-10-21T21:28:10.049046] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:28:10.117218] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-10-21T21:28:10.117291] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-10-21T21:28:10.118015] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-10-21T21:28:10.118075] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-10-21T21:28:10.118950] [DEBUG] [LOCAL ] THQ: Trimmed 34818 records to 25421 (keeping 200 days of data) [2025-10-21T21:28:10.269695] [DEBUG] [LOCAL ] THQ: Primary data saved (25421 records). [2025-10-21T21:28:10.269820] [INFO ] [MAIN ] THQ: Full history saved. [2025-10-21T21:28:10.269896] [INFO ] [MAIN ] Update Progress: 2088/2366 symbols completed. THQ took 35.0s. Estimated remaining: 35m 42s. Rate: 7.8 symbols/min [2025-10-21T21:28:10.445095] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:28:10.479068] [DEBUG] [LOCAL ] TIMB: Loaded 35027 existing records from primary storage. [2025-10-21T21:28:10.479332] [INFO ] [MAIN ] TIMB: Loaded 35027 existing records. [2025-10-21T21:28:10.551312] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-10-21T21:28:10.678273] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:28:10.681467] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-10-21T21:28:10.681680] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-10-21T21:28:10.683489] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T21:28:10.683569] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-10-21T21:28:10.683681] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-10-21T21:28:10.735432] [INFO ] [REMOTE ] THO: Full fetch complete (60090 records). [2025-10-21T21:28:10.768210] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-10-21T21:28:10.815677] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:28:10.849798] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-10-21T21:28:10.864133] [FATAL] [REMOTE ] TIC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:28:10.870689] [FATAL] [MAIN ] TIC: Failed to fetch primary data. [2025-10-21T21:28:10.881259] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:28:10.943088] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-10-21T21:28:10.970450] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-10-21T21:28:11.003011] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-10-21T21:28:11.148255] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-10-21T21:28:11.183181] [INFO ] [MAIN ] Update Progress: 2089/2366 symbols completed. TIC took 2.0s. Estimated remaining: 35m 33s. Rate: 7.8 symbols/min [2025-10-21T21:28:11.289122] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T21:28:11.382154] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-10-21T21:28:11.593762] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:28:11.622931] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-10-21T21:28:11.638521] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-10-21T21:28:11.658881] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-10-21T21:28:11.666207] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-10-21T21:28:11.685298] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:28:11.687485] [DEBUG] [LOCAL ] THO: Trimmed 60090 records to 41053 (keeping 200 days of data) [2025-10-21T21:28:11.692109] [DEBUG] [LOCAL ] TISI: Loaded 3305 existing records from primary storage. [2025-10-21T21:28:11.755819] [INFO ] [MAIN ] TISI: Loaded 3305 existing records. [2025-10-21T21:28:12.130214] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:28:12.136998] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-10-21T21:28:12.137081] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-10-21T21:28:12.136756] [DEBUG] [LOCAL ] THO: Primary data saved (41053 records). [2025-10-21T21:28:12.137243] [INFO ] [MAIN ] THO: Full history saved. [2025-10-21T21:28:12.137422] [INFO ] [MAIN ] Update Progress: 2090/2366 symbols completed. THO took 39.2s. Estimated remaining: 35m 25s. Rate: 7.8 symbols/min [2025-10-21T21:28:12.137444] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-10-21T21:28:12.143263] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-10-21T21:28:12.203804] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-10-21T21:28:12.564510] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:28:12.623946] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-21T21:28:12.718977] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:28:12.731855] [DEBUG] [LOCAL ] TIXT: Loaded 32585 existing records from primary storage. [2025-10-21T21:28:12.732126] [INFO ] [MAIN ] TIXT: Loaded 32585 existing records. [2025-10-21T21:28:12.908158] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:28:12.908411] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-10-21T21:28:12.908458] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-10-21T21:28:12.908699] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-10-21T21:28:12.908758] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-10-21T21:28:12.963320] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-10-21T21:28:13.267161] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:28:13.493679] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-21T21:28:13.735245] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T21:28:13.751009] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-10-21T21:28:14.211399] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-21T21:28:14.551050] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-10-21T21:28:15.311832] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T21:28:15.351034] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-10-21T21:28:16.151042] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-10-21T21:28:16.800031] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T21:28:16.951003] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-10-21T21:28:17.206527] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-21T21:28:17.751101] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-10-21T21:28:17.914535] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T21:28:18.228690] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-21T21:28:18.551070] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-10-21T21:28:18.932874] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-21T21:28:19.351100] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-10-21T21:28:20.151022] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-10-21T21:28:20.696403] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-21T21:28:20.951043] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-10-21T21:28:21.241363] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T21:28:21.750996] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-10-21T21:28:22.080119] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T21:28:22.551008] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-10-21T21:28:22.769329] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-21T21:28:23.351043] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-10-21T21:28:23.677125] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T21:28:23.991440] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-21T21:28:24.151035] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-10-21T21:28:24.583814] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T21:28:24.951036] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-10-21T21:28:25.751024] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-10-21T21:28:26.480305] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T21:28:26.550998] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-10-21T21:28:27.103962] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-21T21:28:27.351079] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-10-21T21:28:27.371134] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T21:28:27.672306] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-21T21:28:28.151107] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-10-21T21:28:28.951064] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-10-21T21:28:29.499576] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T21:28:29.602400] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T21:28:29.751033] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-10. [2025-10-21T21:28:30.216947] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T21:28:30.218353] [INFO ] [REMOTE ] TISI: Full fetch complete (4825 records). [2025-10-21T21:28:30.218427] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-10-21T21:28:30.556248] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-10-21T21:28:30.615923] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-10-21T21:28:30.616035] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-10-21T21:28:30.616250] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-10-21T21:28:30.616294] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-10-21T21:28:30.616794] [DEBUG] [LOCAL ] TISI: Trimmed 4825 records to 3247 (keeping 200 days of data) [2025-10-21T21:28:30.638821] [DEBUG] [LOCAL ] TISI: Primary data saved (3247 records). [2025-10-21T21:28:30.638987] [INFO ] [MAIN ] TISI: Full history saved. [2025-10-21T21:28:30.639093] [INFO ] [MAIN ] Update Progress: 2091/2366 symbols completed. TISI took 19.4s. Estimated remaining: 35m 18s. Rate: 7.8 symbols/min [2025-10-21T21:28:30.835287] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:28:30.889947] [DEBUG] [LOCAL ] TJX: Loaded 53664 existing records from primary storage. [2025-10-21T21:28:30.890263] [INFO ] [MAIN ] TJX: Loaded 53664 existing records. [2025-10-21T21:28:31.063190] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:28:31.063492] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-10-21T21:28:31.063553] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-10-21T21:28:31.064027] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-10-21T21:28:31.064085] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-10-21T21:28:31.356216] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-10-21T21:28:31.414448] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:28:31.674692] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T21:28:32.151042] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-10-21T21:28:32.803954] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T21:28:32.951028] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-10-21T21:28:33.144447] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T21:28:33.751020] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-10-21T21:28:34.544887] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T21:28:34.552825] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-10. [2025-10-21T21:28:35.351024] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-10-21T21:28:35.611707] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T21:28:35.615039] [INFO ] [REMOTE ] THW: Full fetch complete (28764 records). [2025-10-21T21:28:35.615145] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-10-21T21:28:35.981940] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-21T21:28:36.033417] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-10-21T21:28:36.033489] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-10-21T21:28:36.034041] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-10-21T21:28:36.034100] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-10-21T21:28:36.034765] [DEBUG] [LOCAL ] THW: Trimmed 28764 records to 19658 (keeping 200 days of data) [2025-10-21T21:28:36.148340] [DEBUG] [LOCAL ] THW: Primary data saved (19658 records). [2025-10-21T21:28:36.148465] [INFO ] [MAIN ] THW: Full history saved. [2025-10-21T21:28:36.148539] [INFO ] [MAIN ] Update Progress: 2092/2366 symbols completed. THW took 31.4s. Estimated remaining: 35m 10s. Rate: 7.8 symbols/min [2025-10-21T21:28:36.160114] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-10-21T21:28:36.322013] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:28:36.356754] [DEBUG] [LOCAL ] TK: Loaded 39202 existing records from primary storage. [2025-10-21T21:28:36.357050] [INFO ] [MAIN ] TK: Loaded 39202 existing records. [2025-10-21T21:28:36.542672] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:28:36.554633] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-10-21T21:28:36.555302] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-10-21T21:28:36.556402] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T21:28:36.563441] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-10-21T21:28:36.563989] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-10-21T21:28:36.912889] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:28:36.951011] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-10-21T21:28:37.751013] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-10-21T21:28:38.075374] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-21T21:28:38.405778] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T21:28:38.551045] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-10-21T21:28:39.268862] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:28:39.350996] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-10. [2025-10-21T21:28:40.151049] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-10-21T21:28:40.394622] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T21:28:40.400246] [INFO ] [REMOTE ] TIXT: Full fetch complete (46134 records). [2025-10-21T21:28:40.400349] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-10-21T21:28:40.784329] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-10-21T21:28:40.784414] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-10-21T21:28:40.785304] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-10-21T21:28:40.795150] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-10-21T21:28:40.814321] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-10-21T21:28:40.825310] [DEBUG] [LOCAL ] TIXT: Trimmed 46134 records to 32637 (keeping 200 days of data) [2025-10-21T21:28:40.962510] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-10-21T21:28:41.006232] [DEBUG] [LOCAL ] TIXT: Primary data saved (32637 records). [2025-10-21T21:28:41.006337] [INFO ] [MAIN ] TIXT: Full history saved. [2025-10-21T21:28:41.006418] [INFO ] [MAIN ] Update Progress: 2093/2366 symbols completed. TIXT took 28.9s. Estimated remaining: 35m 2s. Rate: 7.8 symbols/min [2025-10-21T21:28:41.177782] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:28:41.214469] [DEBUG] [LOCAL ] TKC: Loaded 39869 existing records from primary storage. [2025-10-21T21:28:41.214763] [INFO ] [MAIN ] TKC: Loaded 39869 existing records. [2025-10-21T21:28:41.391883] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:28:41.392085] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-10-21T21:28:41.392131] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-10-21T21:28:41.392306] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-10-21T21:28:41.392344] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-10-21T21:28:41.693926] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T21:28:41.755678] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-10-21T21:28:41.780251] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:28:42.421241] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T21:28:42.551056] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-10-21T21:28:43.351024] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-10-21T21:28:44.151151] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-10-21T21:28:44.267551] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T21:28:44.869432] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-10-21T21:28:44.950988] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-10-21T21:28:45.666186] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T21:28:45.691044] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-21T21:28:45.750976] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-10-21T21:28:46.550989] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-10-21T21:28:46.910091] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T21:28:47.351046] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-10-21T21:28:47.806210] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-10-21T21:28:48.007746] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T21:28:48.151041] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-10-21T21:28:48.851580] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T21:28:48.950989] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-10-21T21:28:49.751058] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-10-21T21:28:50.094503] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-21T21:28:50.473406] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T21:28:50.551068] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-10-21T21:28:51.347910] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T21:28:51.356294] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-10-21T21:28:52.165053] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-10-21T21:28:52.167664] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T21:28:52.573877] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T21:28:52.951088] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-10-21T21:28:53.756145] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-10-21T21:28:53.776485] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T21:28:54.551059] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-10-21T21:28:54.908630] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-21T21:28:55.296234] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T21:28:55.350986] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-10-21T21:28:55.926186] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T21:28:56.151026] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-10-21T21:28:56.950413] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T21:28:56.958422] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-10-21T21:28:57.751019] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-10-21T21:28:58.123147] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T21:28:58.411760] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T21:28:58.550990] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-10-21T21:28:59.154094] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T21:28:59.351031] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-10-21T21:28:59.724076] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T21:29:00.150994] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-10-21T21:29:00.576925] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T21:29:00.951018] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-10. [2025-10-21T21:29:01.509698] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T21:29:01.751014] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-10-21T21:29:02.083845] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T21:29:02.089889] [INFO ] [REMOTE ] TIMB: Full fetch complete (53173 records). [2025-10-21T21:29:02.090016] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-10-21T21:29:02.480765] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-10-21T21:29:02.480850] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-10-21T21:29:02.481831] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-10-21T21:29:02.481894] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-10-21T21:29:02.482932] [DEBUG] [LOCAL ] TIMB: Trimmed 53173 records to 34863 (keeping 200 days of data) [2025-10-21T21:29:02.568138] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-10. [2025-10-21T21:29:02.694905] [DEBUG] [LOCAL ] TIMB: Primary data saved (34863 records). [2025-10-21T21:29:02.695039] [INFO ] [MAIN ] TIMB: Full history saved. [2025-10-21T21:29:02.695330] [INFO ] [MAIN ] Update Progress: 2094/2366 symbols completed. TIMB took 52.4s. Estimated remaining: 34m 56s. Rate: 7.8 symbols/min [2025-10-21T21:29:02.862255] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:29:02.905461] [DEBUG] [LOCAL ] TKO: Loaded 43606 existing records from primary storage. [2025-10-21T21:29:02.905786] [INFO ] [MAIN ] TKO: Loaded 43606 existing records. [2025-10-21T21:29:03.088787] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:29:03.089040] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-10-21T21:29:03.089173] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-10-21T21:29:03.089500] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-10-21T21:29:03.089556] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-10-21T21:29:03.361193] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-10-21T21:29:03.484556] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:29:03.486565] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T21:29:04.151044] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-10. [2025-10-21T21:29:04.427250] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T21:29:04.435621] [INFO ] [REMOTE ] TJX: Full fetch complete (77832 records). [2025-10-21T21:29:04.435793] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-10-21T21:29:04.602172] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T21:29:04.858321] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-10-21T21:29:04.858401] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-10-21T21:29:04.859744] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-10-21T21:29:04.859808] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-10-21T21:29:04.861254] [DEBUG] [LOCAL ] TJX: Trimmed 77832 records to 53663 (keeping 200 days of data) [2025-10-21T21:29:04.951048] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-10. [2025-10-21T21:29:05.193516] [DEBUG] [LOCAL ] TJX: Primary data saved (53663 records). [2025-10-21T21:29:05.193670] [INFO ] [MAIN ] TJX: Full history saved. [2025-10-21T21:29:05.193778] [INFO ] [MAIN ] Update Progress: 2095/2366 symbols completed. TJX took 34.6s. Estimated remaining: 34m 48s. Rate: 7.8 symbols/min [2025-10-21T21:29:05.359767] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:29:05.396421] [DEBUG] [LOCAL ] TKR: Loaded 39466 existing records from primary storage. [2025-10-21T21:29:05.396724] [INFO ] [MAIN ] TKR: Loaded 39466 existing records. [2025-10-21T21:29:05.571702] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:29:05.571872] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-10-21T21:29:05.571918] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-10-21T21:29:05.572087] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-10-21T21:29:05.572124] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-10-21T21:29:05.761457] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-10-21T21:29:05.962744] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:29:05.964613] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T21:29:05.972120] [INFO ] [REMOTE ] TKC: Full fetch complete (54399 records). [2025-10-21T21:29:05.972219] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-10-21T21:29:06.349850] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T21:29:06.393675] [INFO ] [REMOTE ] TK: Full fetch complete (56294 records). [2025-10-21T21:29:06.406979] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-10-21T21:29:06.407104] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-10-21T21:29:06.407256] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-10-21T21:29:06.408359] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-10-21T21:29:06.408629] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-10-21T21:29:06.510993] [DEBUG] [LOCAL ] TKC: Trimmed 54399 records to 39988 (keeping 200 days of data) [2025-10-21T21:29:06.605088] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-10-21T21:29:06.967519] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-10-21T21:29:06.967882] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-10-21T21:29:06.968992] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-10-21T21:29:06.969107] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-10-21T21:29:07.010491] [DEBUG] [LOCAL ] TK: Trimmed 56294 records to 39169 (keeping 200 days of data) [2025-10-21T21:29:07.130894] [DEBUG] [LOCAL ] TKC: Primary data saved (39988 records). [2025-10-21T21:29:07.142713] [INFO ] [MAIN ] TKC: Full history saved. [2025-10-21T21:29:07.148728] [INFO ] [MAIN ] Update Progress: 2096/2366 symbols completed. TKC took 26.1s. Estimated remaining: 34m 40s. Rate: 7.8 symbols/min [2025-10-21T21:29:07.374421] [DEBUG] [LOCAL ] TK: Primary data saved (39169 records). [2025-10-21T21:29:07.377996] [INFO ] [MAIN ] TK: Full history saved. [2025-10-21T21:29:07.389541] [INFO ] [MAIN ] Update Progress: 2097/2366 symbols completed. TK took 31.2s. Estimated remaining: 34m 31s. Rate: 7.8 symbols/min [2025-10-21T21:29:07.524941] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:29:07.633341] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:29:07.673783] [DEBUG] [LOCAL ] TLYS: Loaded 16437 existing records from primary storage. [2025-10-21T21:29:07.674859] [INFO ] [MAIN ] TLYS: Loaded 16437 existing records. [2025-10-21T21:29:07.674449] [DEBUG] [LOCAL ] TLK: Loaded 38763 existing records from primary storage. [2025-10-21T21:29:07.706341] [INFO ] [MAIN ] TLK: Loaded 38763 existing records. [2025-10-21T21:29:07.904024] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-21T21:29:08.022606] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-10-21T21:29:08.068147] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:29:08.069013] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-10-21T21:29:08.072347] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:29:08.072995] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-10-21T21:29:08.072898] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-10-21T21:29:08.073208] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-10-21T21:29:08.073328] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-10-21T21:29:08.073518] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-10-21T21:29:08.073589] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-10-21T21:29:08.073739] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-10-21T21:29:08.608040] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-21T21:29:08.663278] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-10-21T21:29:08.800573] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:29:08.819080] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:29:08.950975] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-10-21T21:29:09.740855] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T21:29:09.750967] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-10-21T21:29:09.875272] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-21T21:29:10.347994] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T21:29:10.541990] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T21:29:10.550966] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-10-21T21:29:11.129540] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T21:29:11.351048] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-10-21T21:29:12.151078] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-10-21T21:29:12.796688] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-21T21:29:12.866851] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:29:12.950979] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-10-21T21:29:13.751064] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-10-21T21:29:14.551049] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-10-21T21:29:14.629113] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T21:29:15.351049] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-10-21T21:29:15.589846] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T21:29:15.703546] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T21:29:16.151002] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-10-21T21:29:16.951004] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-10-21T21:29:17.092489] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T21:29:17.414035] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-21T21:29:17.751015] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-10-21T21:29:18.551050] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-10-21T21:29:18.821284] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T21:29:18.885794] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T21:29:19.351070] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-10-21T21:29:19.939255] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-21T21:29:20.151077] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-10-21T21:29:20.951100] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-10-21T21:29:21.751140] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-10-21T21:29:21.843392] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T21:29:21.906401] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-21T21:29:22.551075] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-10-21T21:29:23.351056] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-10-21T21:29:23.475949] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T21:29:24.134082] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T21:29:24.150966] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-10-21T21:29:24.215994] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (4.86 seconds). [2025-10-21T21:29:24.236164] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-21T21:29:24.951052] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-10-21T21:29:25.553109] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T21:29:25.751058] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-10-21T21:29:26.555233] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-10-21T21:29:26.556905] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T21:29:26.619747] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T21:29:27.351038] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-10-21T21:29:28.108110] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T21:29:28.150998] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-10-21T21:29:28.746746] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T21:29:28.951106] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-10-21T21:29:29.573124] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T21:29:29.751028] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-10-21T21:29:30.551120] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-10-21T21:29:30.555772] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T21:29:30.574188] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T21:29:31.351009] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-10. [2025-10-21T21:29:32.151055] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-10. [2025-10-21T21:29:32.584790] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T21:29:32.749958] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T21:29:32.759314] [INFO ] [REMOTE ] TLK: Full fetch complete (57612 records). [2025-10-21T21:29:32.759448] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-10-21T21:29:32.978367] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T21:29:32.954187] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-10-21T21:29:33.022675] [INFO ] [REMOTE ] TLYS: Full fetch complete (21165 records). [2025-10-21T21:29:33.044698] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-10-21T21:29:33.390724] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-10-21T21:29:33.391469] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-10-21T21:29:33.409041] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-10-21T21:29:33.450577] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-10-21T21:29:33.526446] [DEBUG] [LOCAL ] TLK: Trimmed 57612 records to 38728 (keeping 200 days of data) [2025-10-21T21:29:33.697468] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-10-21T21:29:33.711007] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-10-21T21:29:33.712166] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-10-21T21:29:33.712799] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-10-21T21:29:33.738765] [DEBUG] [LOCAL ] TLYS: Trimmed 21165 records to 16514 (keeping 200 days of data) [2025-10-21T21:29:33.816806] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-10-21T21:29:33.913134] [DEBUG] [LOCAL ] TLYS: Primary data saved (16514 records). [2025-10-21T21:29:33.921224] [INFO ] [MAIN ] TLYS: Full history saved. [2025-10-21T21:29:33.921612] [INFO ] [MAIN ] Update Progress: 2098/2366 symbols completed. TLYS took 26.5s. Estimated remaining: 34m 26s. Rate: 7.8 symbols/min [2025-10-21T21:29:34.040716] [DEBUG] [LOCAL ] TLK: Primary data saved (38728 records). [2025-10-21T21:29:34.051326] [INFO ] [MAIN ] TLK: Full history saved. [2025-10-21T21:29:34.056553] [INFO ] [MAIN ] Update Progress: 2099/2366 symbols completed. TLK took 26.9s. Estimated remaining: 34m 17s. Rate: 7.8 symbols/min [2025-10-21T21:29:34.132798] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:29:34.294493] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:29:34.321614] [DEBUG] [LOCAL ] TM: Loaded 36215 existing records from primary storage. [2025-10-21T21:29:34.322137] [INFO ] [MAIN ] TM: Loaded 36215 existing records. [2025-10-21T21:29:34.539060] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:29:34.539342] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-10-21T21:29:34.539438] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-10-21T21:29:34.541511] [DEBUG] [LOCAL ] TME: Loaded 53210 existing records from primary storage. [2025-10-21T21:29:34.541842] [INFO ] [MAIN ] TME: Loaded 53210 existing records. [2025-10-21T21:29:34.541749] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-10-21T21:29:34.562546] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-10-21T21:29:34.927997] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-21T21:29:34.984611] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:29:35.026043] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-10-21T21:29:35.026174] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-10-21T21:29:35.027058] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-10-21T21:29:35.045506] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-10-21T21:29:35.053059] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-10-21T21:29:35.288840] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:29:35.365760] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-10-21T21:29:35.513200] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:29:35.562015] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T21:29:36.151065] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-10-21T21:29:36.597459] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T21:29:36.768905] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T21:29:36.951042] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-10-21T21:29:37.751069] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-10. [2025-10-21T21:29:38.033637] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T21:29:38.112774] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-21T21:29:38.551034] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-10-21T21:29:38.779041] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T21:29:38.784764] [INFO ] [REMOTE ] TKR: Full fetch complete (58029 records). [2025-10-21T21:29:38.784892] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-10-21T21:29:39.177710] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-10-21T21:29:39.177873] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-10-21T21:29:39.178948] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-10-21T21:29:39.179079] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-10-21T21:29:39.180392] [DEBUG] [LOCAL ] TKR: Trimmed 58029 records to 39382 (keeping 200 days of data) [2025-10-21T21:29:39.360400] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-10-21T21:29:39.414380] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-21T21:29:39.459296] [DEBUG] [LOCAL ] TKR: Primary data saved (39382 records). [2025-10-21T21:29:39.459438] [INFO ] [MAIN ] TKR: Full history saved. [2025-10-21T21:29:39.459523] [INFO ] [MAIN ] Update Progress: 2100/2366 symbols completed. TKR took 34.3s. Estimated remaining: 34m 9s. Rate: 7.8 symbols/min [2025-10-21T21:29:39.628361] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:29:39.628567] [DEBUG] [LOCAL ] TMHC: No existing data file found in primary storage. [2025-10-21T21:29:39.628620] [WARN ] [MAIN ] TMHC: No existing data found, performing full refresh instead. [2025-10-21T21:29:39.628757] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-10-21T21:29:39.628808] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-10-21T21:29:39.628850] [DEBUG] [LOCAL ] TMHC: No primary data file found to delete. [2025-10-21T21:29:39.628881] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-10-21T21:29:39.972532] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:29:40.151026] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-10-21T21:29:40.951091] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-10. [2025-10-21T21:29:41.074498] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T21:29:41.686155] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T21:29:41.751056] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-10-21T21:29:42.551023] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-10-21T21:29:42.604857] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T21:29:42.611995] [INFO ] [REMOTE ] TKO: Full fetch complete (65552 records). [2025-10-21T21:29:42.612097] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-10-21T21:29:42.997685] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-10-21T21:29:42.997769] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-10-21T21:29:42.998825] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-10-21T21:29:42.998886] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-10-21T21:29:43.000115] [DEBUG] [LOCAL ] TKO: Trimmed 65552 records to 43540 (keeping 200 days of data) [2025-10-21T21:29:43.266718] [DEBUG] [LOCAL ] TKO: Primary data saved (43540 records). [2025-10-21T21:29:43.266814] [INFO ] [MAIN ] TKO: Full history saved. [2025-10-21T21:29:43.267379] [INFO ] [MAIN ] Update Progress: 2101/2366 symbols completed. TKO took 40.6s. Estimated remaining: 34m 1s. Rate: 7.8 symbols/min [2025-10-21T21:29:43.367022] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-10-21T21:29:43.465869] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:29:43.470670] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T21:29:43.529348] [DEBUG] [LOCAL ] TMO: Loaded 52402 existing records from primary storage. [2025-10-21T21:29:43.529691] [INFO ] [MAIN ] TMO: Loaded 52402 existing records. [2025-10-21T21:29:43.705069] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:29:43.705243] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-10-21T21:29:43.705289] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-10-21T21:29:43.705463] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-10-21T21:29:43.705499] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-10-21T21:29:44.053324] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:29:44.150982] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-10-21T21:29:44.324741] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T21:29:44.951046] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-10-21T21:29:45.443479] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-21T21:29:45.751054] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-10-21T21:29:45.784895] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T21:29:46.214875] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-21T21:29:46.551030] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-10-21T21:29:47.351103] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-10-21T21:29:48.151067] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-10-21T21:29:48.334818] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T21:29:48.406627] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-10-21T21:29:48.951055] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-10-21T21:29:49.302353] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-21T21:29:49.751069] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-10-21T21:29:49.802200] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T21:29:50.338254] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T21:29:50.551043] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-10-21T21:29:51.351041] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-10-21T21:29:51.544409] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T21:29:52.151067] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-10-21T21:29:52.651969] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T21:29:52.951061] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-10-21T21:29:53.232984] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T21:29:53.751040] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-10-21T21:29:53.806834] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T21:29:54.551004] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-10-21T21:29:54.676696] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T21:29:55.351002] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-10-21T21:29:55.659818] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-21T21:29:56.090839] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T21:29:56.151019] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-10-21T21:29:56.951033] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-10-21T21:29:57.370576] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-21T21:29:57.707852] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-21T21:29:57.751047] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-10-21T21:29:58.551018] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-10-21T21:29:59.174628] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-21T21:29:59.350980] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-10-21T21:29:59.462486] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T21:30:00.142984] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-21T21:30:00.150980] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-10-21T21:30:00.951086] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-10-21T21:30:01.685049] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-21T21:30:01.753150] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-10-21T21:30:01.757195] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T21:30:02.551042] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-10. [2025-10-21T21:30:03.269720] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-21T21:30:03.351025] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-10-21T21:30:03.735312] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-21T21:30:03.760610] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-21T21:30:03.766242] [INFO ] [REMOTE ] TM: Full fetch complete (52099 records). [2025-10-21T21:30:03.766362] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-10-21T21:30:04.154239] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-10-21T21:30:04.155445] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-10-21T21:30:04.155535] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-10-21T21:30:04.156580] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-10-21T21:30:04.156779] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-10-21T21:30:04.157902] [DEBUG] [LOCAL ] TM: Trimmed 52099 records to 36158 (keeping 200 days of data) [2025-10-21T21:30:04.373882] [DEBUG] [LOCAL ] TM: Primary data saved (36158 records). [2025-10-21T21:30:04.374049] [INFO ] [MAIN ] TM: Full history saved. [2025-10-21T21:30:04.374777] [INFO ] [MAIN ] Update Progress: 2102/2366 symbols completed. TM took 30.5s. Estimated remaining: 33m 55s. Rate: 7.8 symbols/min [2025-10-21T21:30:04.547936] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:04.564510] [DEBUG] [LOCAL ] TNC: Loaded 14395 existing records from primary storage. [2025-10-21T21:30:04.564763] [INFO ] [MAIN ] TNC: Loaded 14395 existing records. [2025-10-21T21:30:04.739052] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:30:04.739242] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-10-21T21:30:04.739287] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-10-21T21:30:04.739442] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-10-21T21:30:04.739480] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-10-21T21:30:04.965185] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-10-21T21:30:05.119543] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:05.568027] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-21T21:30:05.751000] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-10-21T21:30:06.192874] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T21:30:06.551089] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-10. [2025-10-21T21:30:06.642330] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:30:07.351032] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-10-21T21:30:08.010684] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-21T21:30:08.151009] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-10. [2025-10-21T21:30:08.575376] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-21T21:30:08.583464] [INFO ] [REMOTE ] TMO: Full fetch complete (75710 records). [2025-10-21T21:30:08.583599] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-10-21T21:30:08.967841] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-10-21T21:30:08.972818] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-10-21T21:30:08.972968] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-10-21T21:30:08.974333] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-10-21T21:30:08.974418] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-10-21T21:30:08.976064] [DEBUG] [LOCAL ] TMO: Trimmed 75710 records to 52404 (keeping 200 days of data) [2025-10-21T21:30:09.249856] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T21:30:09.338042] [DEBUG] [LOCAL ] TMO: Primary data saved (52404 records). [2025-10-21T21:30:09.338169] [INFO ] [MAIN ] TMO: Full history saved. [2025-10-21T21:30:09.338755] [INFO ] [MAIN ] Update Progress: 2103/2366 symbols completed. TMO took 26.1s. Estimated remaining: 33m 47s. Rate: 7.8 symbols/min [2025-10-21T21:30:09.519128] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:09.548258] [DEBUG] [LOCAL ] TNET: Loaded 28275 existing records from primary storage. [2025-10-21T21:30:09.548524] [INFO ] [MAIN ] TNET: Loaded 28275 existing records. [2025-10-21T21:30:09.724164] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:30:09.724345] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-10-21T21:30:09.724390] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-10-21T21:30:09.724548] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-10-21T21:30:09.724585] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-10-21T21:30:09.767295] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-10. [2025-10-21T21:30:10.088180] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:10.098173] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T21:30:10.133114] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-21T21:30:10.141390] [INFO ] [REMOTE ] TME: Full fetch complete (77161 records). [2025-10-21T21:30:10.141509] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-10-21T21:30:10.522951] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-10-21T21:30:10.523041] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-10-21T21:30:10.524260] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-10-21T21:30:10.524329] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-10-21T21:30:10.525853] [DEBUG] [LOCAL ] TME: Trimmed 77161 records to 53206 (keeping 200 days of data) [2025-10-21T21:30:10.573979] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-10-21T21:30:10.832788] [DEBUG] [LOCAL ] TME: Primary data saved (53206 records). [2025-10-21T21:30:10.832914] [INFO ] [MAIN ] TME: Full history saved. [2025-10-21T21:30:10.833754] [INFO ] [MAIN ] Update Progress: 2104/2366 symbols completed. TME took 36.8s. Estimated remaining: 33m 38s. Rate: 7.8 symbols/min [2025-10-21T21:30:11.003828] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:11.004014] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-10-21T21:30:11.004051] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-10-21T21:30:11.004159] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-10-21T21:30:11.004199] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-21T21:30:11.004238] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-21T21:30:11.004269] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-10-21T21:30:11.354516] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-10-21T21:30:11.359274] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:11.556152] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T21:30:11.563889] [INFO ] [REMOTE ] TMHC: Full fetch complete (66531 records). [2025-10-21T21:30:11.564008] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-10-21T21:30:11.862874] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T21:30:11.966798] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-10-21T21:30:11.966878] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-10-21T21:30:11.968042] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-10-21T21:30:11.968109] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-10-21T21:30:11.969423] [DEBUG] [LOCAL ] TMHC: Trimmed 66531 records to 45654 (keeping 200 days of data) [2025-10-21T21:30:12.163933] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-10-21T21:30:12.229970] [DEBUG] [LOCAL ] TMHC: Primary data saved (45654 records). [2025-10-21T21:30:12.230108] [INFO ] [MAIN ] TMHC: Full history saved. [2025-10-21T21:30:12.230183] [INFO ] [MAIN ] Update Progress: 2105/2366 symbols completed. TMHC took 32.8s. Estimated remaining: 33m 30s. Rate: 7.8 symbols/min [2025-10-21T21:30:12.396070] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:12.429547] [DEBUG] [LOCAL ] TNK: Loaded 35462 existing records from primary storage. [2025-10-21T21:30:12.429851] [INFO ] [MAIN ] TNK: Loaded 35462 existing records. [2025-10-21T21:30:12.606624] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:30:12.606931] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-10-21T21:30:12.607014] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-10-21T21:30:12.607237] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-10-21T21:30:12.607285] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-10-21T21:30:12.801587] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T21:30:12.957036] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-10-21T21:30:12.979155] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:13.328987] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T21:30:13.751019] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-10-21T21:30:14.403858] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:30:14.404185] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-10-21T21:30:14.404281] [FATAL] [REMOTE ] TNGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:30:14.404328] [FATAL] [MAIN ] TNGY: Failed to fetch primary data. [2025-10-21T21:30:14.404361] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:30:14.404397] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-10-21T21:30:14.404455] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-10-21T21:30:14.404517] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-10-21T21:30:14.404592] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-10-21T21:30:14.404668] [INFO ] [MAIN ] Update Progress: 2106/2366 symbols completed. TNGY took 3.6s. Estimated remaining: 33m 21s. Rate: 7.8 symbols/min [2025-10-21T21:30:14.552501] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-21T21:30:14.551051] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-10-21T21:30:14.628366] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:14.669184] [DEBUG] [LOCAL ] TNL: Loaded 41798 existing records from primary storage. [2025-10-21T21:30:14.669526] [INFO ] [MAIN ] TNL: Loaded 41798 existing records. [2025-10-21T21:30:14.866990] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:30:14.867170] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-10-21T21:30:14.867228] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-10-21T21:30:14.867432] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-10-21T21:30:14.867504] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-10-21T21:30:15.267981] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:15.350991] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-10-21T21:30:16.151034] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-10-21T21:30:16.185091] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T21:30:16.951024] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-10-21T21:30:17.133429] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T21:30:17.235340] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T21:30:17.751050] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-10-21T21:30:18.326204] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T21:30:18.551091] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-10-21T21:30:18.901330] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T21:30:19.351039] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-10-21T21:30:20.151065] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-10-21T21:30:20.248221] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T21:30:20.318760] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-21T21:30:20.951042] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-10-21T21:30:21.245794] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-21T21:30:21.751084] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-10-21T21:30:22.523472] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T21:30:22.550977] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-10-21T21:30:23.051707] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T21:30:23.351086] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-10-21T21:30:24.153426] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-10-21T21:30:24.158807] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T21:30:24.938319] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T21:30:24.950973] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-10-21T21:30:25.336538] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T21:30:25.751060] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-10-21T21:30:26.252421] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-21T21:30:26.551065] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-10-21T21:30:26.693461] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T21:30:27.351039] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-10-21T21:30:27.955525] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T21:30:28.151097] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-10-21T21:30:28.951058] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-10-21T21:30:28.995273] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T21:30:29.471706] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-21T21:30:29.751065] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-10-21T21:30:30.311102] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-21T21:30:30.551019] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-10-21T21:30:31.326548] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T21:30:31.350982] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-10-21T21:30:31.509881] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-21T21:30:32.151084] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-10-21T21:30:32.910129] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T21:30:32.951069] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-10-21T21:30:33.195733] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T21:30:33.751120] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-10-21T21:30:34.298267] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-21T21:30:34.551072] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-10-21T21:30:34.787076] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T21:30:35.351081] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-10-21T21:30:35.439352] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-21T21:30:36.151030] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-10-21T21:30:36.604163] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-21T21:30:36.951031] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-10-21T21:30:36.981149] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-21T21:30:37.751066] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-10. [2025-10-21T21:30:38.323164] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T21:30:38.551063] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-10-21T21:30:38.613861] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T21:30:38.616321] [INFO ] [REMOTE ] TNC: Full fetch complete (22238 records). [2025-10-21T21:30:38.616419] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-10-21T21:30:39.032909] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-10-21T21:30:39.033022] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-10-21T21:30:39.033807] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-10-21T21:30:39.033872] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-10-21T21:30:39.034724] [DEBUG] [LOCAL ] TNC: Trimmed 22238 records to 14293 (keeping 200 days of data) [2025-10-21T21:30:39.129673] [DEBUG] [LOCAL ] TNC: Primary data saved (14293 records). [2025-10-21T21:30:39.129883] [INFO ] [MAIN ] TNC: Full history saved. [2025-10-21T21:30:39.129991] [INFO ] [MAIN ] Update Progress: 2107/2366 symbols completed. TNC took 34.8s. Estimated remaining: 33m 16s. Rate: 7.8 symbols/min [2025-10-21T21:30:39.307228] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:39.362048] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-10. [2025-10-21T21:30:39.365720] [DEBUG] [LOCAL ] TOL: Loaded 50629 existing records from primary storage. [2025-10-21T21:30:39.366272] [INFO ] [MAIN ] TOL: Loaded 50629 existing records. [2025-10-21T21:30:39.555097] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:30:39.555417] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-10-21T21:30:39.555474] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-10-21T21:30:39.555829] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-10-21T21:30:39.555889] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-10-21T21:30:39.935218] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:40.151213] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-10. [2025-10-21T21:30:40.239761] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T21:30:40.656159] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-21T21:30:40.661871] [INFO ] [REMOTE ] TNK: Full fetch complete (51916 records). [2025-10-21T21:30:40.661988] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-10-21T21:30:40.956223] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-10-21T21:30:41.065333] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-10-21T21:30:41.065449] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-10-21T21:30:41.066762] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-10-21T21:30:41.066841] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-10-21T21:30:41.068378] [DEBUG] [LOCAL ] TNK: Trimmed 51916 records to 35374 (keeping 200 days of data) [2025-10-21T21:30:41.269953] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-21T21:30:41.307951] [INFO ] [REMOTE ] TNET: Full fetch complete (41772 records). [2025-10-21T21:30:41.324770] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-10-21T21:30:41.324628] [DEBUG] [LOCAL ] TNK: Primary data saved (35374 records). [2025-10-21T21:30:41.325078] [INFO ] [MAIN ] TNK: Full history saved. [2025-10-21T21:30:41.325243] [INFO ] [MAIN ] Update Progress: 2108/2366 symbols completed. TNK took 29.1s. Estimated remaining: 33m 7s. Rate: 7.8 symbols/min [2025-10-21T21:30:41.700786] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:41.755523] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-10-21T21:30:41.910617] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-10-21T21:30:41.910736] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-10-21T21:30:41.911725] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-10-21T21:30:41.911811] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-10-21T21:30:41.912907] [DEBUG] [LOCAL ] TNET: Trimmed 41772 records to 28267 (keeping 200 days of data) [2025-10-21T21:30:42.058244] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-21T21:30:42.062569] [INFO ] [MAIN ] TOST: Loaded 53690 existing records. [2025-10-21T21:30:42.309785] [DEBUG] [LOCAL ] TNET: Primary data saved (28267 records). [2025-10-21T21:30:42.307106] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:30:42.309966] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-10-21T21:30:42.310056] [INFO ] [MAIN ] TNET: Full history saved. [2025-10-21T21:30:42.310576] [INFO ] [MAIN ] Update Progress: 2109/2366 symbols completed. TNET took 33.0s. Estimated remaining: 32m 59s. Rate: 7.8 symbols/min [2025-10-21T21:30:42.310675] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-10-21T21:30:42.365339] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-10-21T21:30:42.374627] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-10-21T21:30:42.602991] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:42.889461] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:42.890235] [DEBUG] [LOCAL ] TPB: Loaded 26151 existing records from primary storage. [2025-10-21T21:30:42.890917] [INFO ] [MAIN ] TPB: Loaded 26151 existing records. [2025-10-21T21:30:42.890736] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-10-21T21:30:43.075144] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-21T21:30:43.115969] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:30:43.125509] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-10-21T21:30:43.126207] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-10-21T21:30:43.126462] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-10-21T21:30:43.126518] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-10-21T21:30:43.296232] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T21:30:43.359561] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-10. [2025-10-21T21:30:43.521480] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:44.151063] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-10-21T21:30:44.751915] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T21:30:44.880682] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T21:30:44.887316] [INFO ] [REMOTE ] TNL: Full fetch complete (59626 records). [2025-10-21T21:30:44.887460] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-10-21T21:30:44.955103] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-10-21T21:30:45.319463] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-10-21T21:30:45.324802] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-10-21T21:30:45.331973] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T21:30:45.333465] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-10-21T21:30:45.341186] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-10-21T21:30:45.342578] [DEBUG] [LOCAL ] TNL: Trimmed 59626 records to 41725 (keeping 200 days of data) [2025-10-21T21:30:45.601465] [DEBUG] [LOCAL ] TNL: Primary data saved (41725 records). [2025-10-21T21:30:45.601573] [INFO ] [MAIN ] TNL: Full history saved. [2025-10-21T21:30:45.601667] [INFO ] [MAIN ] Update Progress: 2110/2366 symbols completed. TNL took 31.2s. Estimated remaining: 32m 51s. Rate: 7.8 symbols/min [2025-10-21T21:30:45.751043] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-10-21T21:30:45.768525] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:30:45.806582] [DEBUG] [LOCAL ] TPC: Loaded 39183 existing records from primary storage. [2025-10-21T21:30:45.806884] [INFO ] [MAIN ] TPC: Loaded 39183 existing records. [2025-10-21T21:30:45.981127] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:30:45.981341] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-10-21T21:30:45.981394] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-10-21T21:30:45.981590] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-10-21T21:30:45.981679] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-10-21T21:30:46.374583] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:30:46.550982] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-10-21T21:30:46.774517] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T21:30:46.850468] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T21:30:47.351021] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-10-21T21:30:47.991259] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T21:30:48.150988] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-10-21T21:30:48.500744] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-21T21:30:48.951050] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-10-21T21:30:49.488739] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T21:30:49.751003] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-10-21T21:30:50.551000] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-10-21T21:30:50.849055] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-21T21:30:51.351031] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-10-21T21:30:51.569918] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T21:30:51.949225] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-21T21:30:52.151043] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-10-21T21:30:52.950993] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-10-21T21:30:53.225627] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T21:30:53.247771] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T21:30:53.751065] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-10-21T21:30:54.550995] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-10-21T21:30:54.748861] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T21:30:54.821730] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T21:30:55.351037] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-10-21T21:30:56.046701] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T21:30:56.150989] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-10-21T21:30:56.938976] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T21:30:56.950983] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-10-21T21:30:57.663253] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T21:30:57.751003] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-10-21T21:30:58.551020] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-10-21T21:30:58.875072] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T21:30:59.268882] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T21:30:59.350987] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-10-21T21:30:59.707950] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T21:31:00.151035] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-10-21T21:31:00.951029] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-10-21T21:31:00.988906] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T21:31:01.751017] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-10-21T21:31:02.135603] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-21T21:31:02.224795] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-21T21:31:02.551066] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-10-21T21:31:03.350992] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-10-21T21:31:03.683903] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-21T21:31:03.911367] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T21:31:04.151078] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-10-21T21:31:04.951048] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-10-21T21:31:05.055769] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T21:31:05.339141] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T21:31:05.751015] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-10. [2025-10-21T21:31:06.551021] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-10-21T21:31:07.031186] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-21T21:31:07.036293] [INFO ] [REMOTE ] TPB: Full fetch complete (36191 records). [2025-10-21T21:31:07.036369] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-10-21T21:31:07.353899] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-10-21T21:31:07.422525] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-21T21:31:07.471287] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-10-21T21:31:07.471595] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-10-21T21:31:07.472347] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-10-21T21:31:07.472429] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-10-21T21:31:07.473813] [DEBUG] [LOCAL ] TPB: Trimmed 36191 records to 26263 (keeping 200 days of data) [2025-10-21T21:31:07.630522] [DEBUG] [LOCAL ] TPB: Primary data saved (26263 records). [2025-10-21T21:31:07.630670] [INFO ] [MAIN ] TPB: Full history saved. [2025-10-21T21:31:07.630767] [INFO ] [MAIN ] Update Progress: 2111/2366 symbols completed. TPB took 25.3s. Estimated remaining: 32m 45s. Rate: 7.8 symbols/min [2025-10-21T21:31:07.807355] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:31:07.868621] [DEBUG] [LOCAL ] TPH: Loaded 44829 existing records from primary storage. [2025-10-21T21:31:07.868999] [INFO ] [MAIN ] TPH: Loaded 44829 existing records. [2025-10-21T21:31:08.061747] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:31:08.062098] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-10-21T21:31:08.062166] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-10-21T21:31:08.062364] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-10-21T21:31:08.062438] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-10-21T21:31:08.153057] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-10-21T21:31:08.410590] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T21:31:08.460954] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:31:08.558598] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T21:31:08.951035] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-10-21T21:31:09.750994] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-10. [2025-10-21T21:31:10.378362] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T21:31:10.414345] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-21T21:31:10.551070] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-10-21T21:31:10.880132] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T21:31:10.886008] [INFO ] [REMOTE ] TPC: Full fetch complete (55397 records). [2025-10-21T21:31:10.886127] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-10-21T21:31:11.265112] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-10-21T21:31:11.265200] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-10-21T21:31:11.266249] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-10-21T21:31:11.266314] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-10-21T21:31:11.267504] [DEBUG] [LOCAL ] TPC: Trimmed 55397 records to 39129 (keeping 200 days of data) [2025-10-21T21:31:11.353703] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-10-21T21:31:11.497120] [DEBUG] [LOCAL ] TPC: Primary data saved (39129 records). [2025-10-21T21:31:11.497367] [INFO ] [MAIN ] TPC: Full history saved. [2025-10-21T21:31:11.497482] [INFO ] [MAIN ] Update Progress: 2112/2366 symbols completed. TPC took 25.9s. Estimated remaining: 32m 36s. Rate: 7.8 symbols/min [2025-10-21T21:31:11.666015] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:31:11.680038] [DEBUG] [LOCAL ] TPL: Loaded 12450 existing records from primary storage. [2025-10-21T21:31:11.680266] [INFO ] [MAIN ] TPL: Loaded 12450 existing records. [2025-10-21T21:31:11.856946] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:31:11.857190] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-10-21T21:31:11.857236] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-10-21T21:31:11.857415] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-10-21T21:31:11.857470] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-10-21T21:31:12.158092] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-10-21T21:31:12.223349] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:31:12.257376] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T21:31:12.951120] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-10-21T21:31:13.433729] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-21T21:31:13.697004] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T21:31:13.751004] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-10-21T21:31:14.004296] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-21T21:31:14.551070] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-10-21T21:31:15.351094] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-10. [2025-10-21T21:31:15.466595] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T21:31:16.151000] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-10-21T21:31:16.400992] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T21:31:16.950996] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-10-21T21:31:17.275880] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-21T21:31:17.284336] [INFO ] [REMOTE ] TOST: Full fetch complete (77852 records). [2025-10-21T21:31:17.284479] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-10-21T21:31:17.685977] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-10-21T21:31:17.686191] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-10-21T21:31:17.687551] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-10-21T21:31:17.687688] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-10-21T21:31:17.689443] [DEBUG] [LOCAL ] TOST: Trimmed 77852 records to 53690 (keeping 200 days of data) [2025-10-21T21:31:17.772151] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-10-21T21:31:17.834845] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T21:31:18.039505] [DEBUG] [LOCAL ] TOST: Primary data saved (53690 records). [2025-10-21T21:31:18.039634] [INFO ] [MAIN ] TOST: Full history saved. [2025-10-21T21:31:18.039749] [INFO ] [MAIN ] Update Progress: 2113/2366 symbols completed. TOST took 36.7s. Estimated remaining: 32m 29s. Rate: 7.8 symbols/min [2025-10-21T21:31:18.205314] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:31:18.254200] [DEBUG] [LOCAL ] TPR: Loaded 53371 existing records from primary storage. [2025-10-21T21:31:18.254495] [INFO ] [MAIN ] TPR: Loaded 53371 existing records. [2025-10-21T21:31:18.433039] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:31:18.433270] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-10-21T21:31:18.433323] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-10-21T21:31:18.433707] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-10-21T21:31:18.433766] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-10-21T21:31:18.554516] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-10-21T21:31:18.732900] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-21T21:31:18.815764] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:31:18.845582] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T21:31:19.351081] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-10. [2025-10-21T21:31:20.151003] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-10-21T21:31:20.322553] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T21:31:20.951057] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-10-21T21:31:21.202172] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T21:31:21.216905] [INFO ] [REMOTE ] TOL: Full fetch complete (73786 records). [2025-10-21T21:31:21.217731] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T21:31:21.217827] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-10-21T21:31:21.606633] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-10-21T21:31:21.606746] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-10-21T21:31:21.607971] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-10-21T21:31:21.608033] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-10-21T21:31:21.609527] [DEBUG] [LOCAL ] TOL: Trimmed 73786 records to 50598 (keeping 200 days of data) [2025-10-21T21:31:21.787995] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-10-21T21:31:21.929705] [DEBUG] [LOCAL ] TOL: Primary data saved (50598 records). [2025-10-21T21:31:21.929852] [INFO ] [MAIN ] TOL: Full history saved. [2025-10-21T21:31:21.929927] [INFO ] [MAIN ] Update Progress: 2114/2366 symbols completed. TOL took 42.8s. Estimated remaining: 32m 20s. Rate: 7.8 symbols/min [2025-10-21T21:31:22.099799] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:31:22.125391] [DEBUG] [LOCAL ] TPVG: Loaded 27321 existing records from primary storage. [2025-10-21T21:31:22.125670] [INFO ] [MAIN ] TPVG: Loaded 27321 existing records. [2025-10-21T21:31:22.302632] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:31:22.302904] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-10-21T21:31:22.302953] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-10-21T21:31:22.303115] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-10-21T21:31:22.303153] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-10-21T21:31:22.552333] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-10-21T21:31:22.663611] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:31:22.695742] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T21:31:23.121666] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T21:31:23.281140] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T21:31:23.350998] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-10-21T21:31:24.151029] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-10-21T21:31:24.507004] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T21:31:24.813519] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-21T21:31:24.951057] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-10-21T21:31:25.751068] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-10-21T21:31:26.551107] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-10-21T21:31:26.692661] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T21:31:27.235139] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T21:31:27.256253] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T21:31:27.351022] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-10-21T21:31:28.151074] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-10-21T21:31:28.421138] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-21T21:31:28.951034] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-10-21T21:31:29.638625] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T21:31:29.660378] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T21:31:29.751190] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-10-21T21:31:30.551107] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-10-21T21:31:31.232119] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T21:31:31.351007] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-10-21T21:31:32.142901] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T21:31:32.151396] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-10-21T21:31:32.659263] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T21:31:32.951048] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-10-21T21:31:33.673186] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T21:31:33.751021] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-10-21T21:31:33.934001] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T21:31:34.551066] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-10-21T21:31:34.717142] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.17 seconds). [2025-10-21T21:31:35.351008] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-10. [2025-10-21T21:31:35.654242] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T21:31:36.151023] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-10. [2025-10-21T21:31:36.240441] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T21:31:36.242669] [INFO ] [REMOTE ] TPL: Full fetch complete (17545 records). [2025-10-21T21:31:36.242749] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-10-21T21:31:36.609327] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-10-21T21:31:36.609405] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-10-21T21:31:36.609819] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-10-21T21:31:36.609882] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-10-21T21:31:36.610457] [DEBUG] [LOCAL ] TPL: Trimmed 17545 records to 12355 (keeping 200 days of data) [2025-10-21T21:31:36.689201] [DEBUG] [LOCAL ] TPL: Primary data saved (12355 records). [2025-10-21T21:31:36.689348] [INFO ] [MAIN ] TPL: Full history saved. [2025-10-21T21:31:36.689455] [INFO ] [MAIN ] Update Progress: 2115/2366 symbols completed. TPL took 25.2s. Estimated remaining: 32m 14s. Rate: 7.8 symbols/min [2025-10-21T21:31:36.867344] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:31:36.877239] [DEBUG] [LOCAL ] TPYP: Loaded 7931 existing records from primary storage. [2025-10-21T21:31:36.877457] [INFO ] [MAIN ] TPYP: Loaded 7931 existing records. [2025-10-21T21:31:36.956161] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-10-21T21:31:37.068881] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:31:37.069102] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-10-21T21:31:37.069151] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-10-21T21:31:37.069314] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-10-21T21:31:37.069371] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-10-21T21:31:37.423242] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:31:37.517895] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T21:31:37.524703] [INFO ] [REMOTE ] TPH: Full fetch complete (64927 records). [2025-10-21T21:31:37.524842] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-10-21T21:31:37.760309] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-10-21T21:31:37.911707] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-10-21T21:31:37.911800] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-10-21T21:31:37.912897] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-10-21T21:31:37.912959] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-10-21T21:31:37.914307] [DEBUG] [LOCAL ] TPH: Trimmed 64927 records to 44813 (keeping 200 days of data) [2025-10-21T21:31:38.188244] [DEBUG] [LOCAL ] TPH: Primary data saved (44813 records). [2025-10-21T21:31:38.189580] [INFO ] [MAIN ] TPH: Full history saved. [2025-10-21T21:31:38.189484] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-21T21:31:38.190343] [INFO ] [MAIN ] Update Progress: 2116/2366 symbols completed. TPH took 30.6s. Estimated remaining: 32m 5s. Rate: 7.8 symbols/min [2025-10-21T21:31:38.363918] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:31:38.371860] [DEBUG] [LOCAL ] TPZ: Loaded 4653 existing records from primary storage. [2025-10-21T21:31:38.372076] [INFO ] [MAIN ] TPZ: Loaded 4653 existing records. [2025-10-21T21:31:38.553074] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-10-21T21:31:38.556775] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:31:38.558188] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-10-21T21:31:38.558246] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-10-21T21:31:38.558371] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-10-21T21:31:38.558407] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-10-21T21:31:38.893874] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T21:31:38.924936] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:31:39.351048] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-10-21T21:31:39.663923] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T21:31:40.151057] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-10-21T21:31:40.185192] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T21:31:40.951028] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-10-21T21:31:41.751049] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-10-21T21:31:41.899161] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T21:31:42.093965] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T21:31:42.519983] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T21:31:42.551027] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-10-21T21:31:43.333395] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T21:31:43.350989] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-10-21T21:31:44.151025] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-10-21T21:31:44.200590] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-21T21:31:44.890541] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T21:31:44.951069] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-10-21T21:31:45.751038] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-10-21T21:31:46.205253] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T21:31:46.551084] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-10-21T21:31:47.052355] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T21:31:47.351021] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-10-21T21:31:47.629599] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-21T21:31:47.992448] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T21:31:48.151017] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-10-21T21:31:48.951034] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-10-21T21:31:49.738514] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T21:31:49.750989] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-10-21T21:31:50.060808] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-21T21:31:50.435927] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T21:31:50.550990] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-10-21T21:31:51.293627] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-21T21:31:51.351072] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-10-21T21:31:52.151097] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-10-21T21:31:52.889890] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T21:31:52.950993] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-10-21T21:31:53.548848] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T21:31:53.736436] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T21:31:53.750994] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-10-21T21:31:54.551020] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-10-21T21:31:55.351009] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-10-21T21:31:55.702978] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T21:31:55.856863] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-21T21:31:56.023497] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-21T21:31:56.150994] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-10-21T21:31:56.919722] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T21:31:56.951007] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-10. [2025-10-21T21:31:57.751007] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-10-21T21:31:58.551075] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-10-21T21:31:58.665509] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T21:31:58.666747] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T21:31:58.677141] [INFO ] [REMOTE ] TPR: Full fetch complete (77499 records). [2025-10-21T21:31:58.677243] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-10-21T21:31:59.068584] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-10-21T21:31:59.068724] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-10-21T21:31:59.069914] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-10-21T21:31:59.069976] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-10-21T21:31:59.071326] [DEBUG] [LOCAL ] TPR: Trimmed 77499 records to 53367 (keeping 200 days of data) [2025-10-21T21:31:59.137125] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-21T21:31:59.353538] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-10. [2025-10-21T21:31:59.400830] [DEBUG] [LOCAL ] TPR: Primary data saved (53367 records). [2025-10-21T21:31:59.400924] [INFO ] [MAIN ] TPR: Full history saved. [2025-10-21T21:31:59.401003] [INFO ] [MAIN ] Update Progress: 2117/2366 symbols completed. TPR took 41.4s. Estimated remaining: 31m 59s. Rate: 7.8 symbols/min [2025-10-21T21:32:00.151020] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-10. [2025-10-21T21:32:00.606950] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T21:32:00.612113] [INFO ] [REMOTE ] TPVG: Full fetch complete (39268 records). [2025-10-21T21:32:00.612214] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-10-21T21:32:00.906439] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T21:32:00.928747] [INFO ] [REMOTE ] TPYP: Full fetch complete (12413 records). [2025-10-21T21:32:00.954333] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-10-21T21:32:00.954276] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-10-21T21:32:01.024883] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-10-21T21:32:01.069912] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-10-21T21:32:01.097558] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-10-21T21:32:01.097937] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-10-21T21:32:01.147030] [DEBUG] [LOCAL ] TPVG: Trimmed 39268 records to 27256 (keeping 200 days of data) [2025-10-21T21:32:01.514112] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-10-21T21:32:01.514199] [DEBUG] [LOCAL ] TPVG: Primary data saved (27256 records). [2025-10-21T21:32:01.514284] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-10-21T21:32:01.514363] [INFO ] [MAIN ] TPVG: Full history saved. [2025-10-21T21:32:01.514467] [INFO ] [MAIN ] Update Progress: 2118/2366 symbols completed. TPVG took 39.6s. Estimated remaining: 31m 51s. Rate: 7.8 symbols/min [2025-10-21T21:32:01.514822] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-10-21T21:32:01.515022] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-10-21T21:32:01.515800] [DEBUG] [LOCAL ] TPYP: Trimmed 12413 records to 7931 (keeping 200 days of data) [2025-10-21T21:32:01.561018] [DEBUG] [LOCAL ] TPYP: Primary data saved (7931 records). [2025-10-21T21:32:01.561099] [INFO ] [MAIN ] TPYP: Full history saved. [2025-10-21T21:32:01.561167] [INFO ] [MAIN ] Update Progress: 2119/2366 symbols completed. TPYP took 24.9s. Estimated remaining: 31m 42s. Rate: 7.8 symbols/min [2025-10-21T21:32:01.654548] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-21T21:32:01.750994] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-10. [2025-10-21T21:32:02.327330] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-21T21:32:02.328522] [INFO ] [REMOTE ] TPZ: Full fetch complete (8487 records). [2025-10-21T21:32:02.328588] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-10-21T21:32:02.677726] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-10-21T21:32:02.677808] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-10-21T21:32:02.678044] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-10-21T21:32:02.678080] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-10-21T21:32:02.678449] [DEBUG] [LOCAL ] TPZ: Trimmed 8487 records to 4643 (keeping 200 days of data) [2025-10-21T21:32:02.705375] [DEBUG] [LOCAL ] TPZ: Primary data saved (4643 records). [2025-10-21T21:32:02.705449] [INFO ] [MAIN ] TPZ: Full history saved. [2025-10-21T21:32:02.705515] [INFO ] [MAIN ] Update Progress: 2120/2366 symbols completed. TPZ took 24.5s. Estimated remaining: 31m 34s. Rate: 7.8 symbols/min [2025-10-21T21:32:03.325577] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:03.324391] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:03.377896] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:03.431187] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:03.448609] [DEBUG] [LOCAL ] TRAK: Loaded 9660 existing records from primary storage. [2025-10-21T21:32:03.448875] [INFO ] [MAIN ] TRAK: Loaded 9660 existing records. [2025-10-21T21:32:03.501683] [DEBUG] [LOCAL ] TR: Loaded 19094 existing records from primary storage. [2025-10-21T21:32:03.529490] [DEBUG] [LOCAL ] TRC: Loaded 15518 existing records from primary storage. [2025-10-21T21:32:03.542322] [INFO ] [MAIN ] TR: Loaded 19094 existing records. [2025-10-21T21:32:03.558950] [INFO ] [MAIN ] TRC: Loaded 15518 existing records. [2025-10-21T21:32:03.896378] [DEBUG] [LOCAL ] TREX: Loaded 49841 existing records from primary storage. [2025-10-21T21:32:03.894942] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:32:03.902420] [INFO ] [MAIN ] TREX: Loaded 49841 existing records. [2025-10-21T21:32:03.929791] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-10-21T21:32:03.969927] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-10-21T21:32:04.072389] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-10-21T21:32:04.092341] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-10-21T21:32:04.144193] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:32:04.178867] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-10-21T21:32:04.178998] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-10-21T21:32:04.242335] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-10-21T21:32:04.253053] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-10-21T21:32:04.242229] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:32:04.318388] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-10-21T21:32:04.376892] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-10-21T21:32:04.438831] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:32:04.449864] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-10-21T21:32:04.481105] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-10-21T21:32:04.536700] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-10-21T21:32:04.574217] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-10-21T21:32:04.574128] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-10-21T21:32:04.662149] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-10-21T21:32:05.318867] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:32:05.422113] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:32:05.431870] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-10-21T21:32:05.475449] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-10-21T21:32:05.740820] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:32:05.751737] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-10-21T21:32:05.773138] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:32:05.773498] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-10-21T21:32:06.287885] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T21:32:06.290363] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-10-21T21:32:06.417797] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T21:32:06.551068] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-10-21T21:32:06.724835] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T21:32:07.032043] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T21:32:07.332995] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T21:32:07.350974] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-10-21T21:32:07.796796] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T21:32:08.151033] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-10-21T21:32:08.926786] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-21T21:32:08.950978] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-10-21T21:32:09.206305] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T21:32:09.751063] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-10-21T21:32:10.527325] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-21T21:32:10.550985] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-10-21T21:32:10.853951] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T21:32:11.351011] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-10-21T21:32:12.151004] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-10-21T21:32:12.279909] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T21:32:12.299451] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T21:32:12.951059] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-10-21T21:32:13.071330] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T21:32:13.638111] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T21:32:13.751066] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-10-21T21:32:14.551013] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-10-21T21:32:14.684602] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-21T21:32:15.351057] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-10-21T21:32:15.374533] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T21:32:16.150995] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-10-21T21:32:16.266479] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T21:32:16.928663] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-21T21:32:16.950984] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-10-21T21:32:17.631078] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T21:32:17.751012] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-10-21T21:32:18.550385] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T21:32:18.551306] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-10-21T21:32:19.351078] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-10-21T21:32:20.151085] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-10-21T21:32:20.230890] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T21:32:20.951072] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-10-21T21:32:21.078969] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T21:32:21.119754] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T21:32:21.751026] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-10-21T21:32:22.118322] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-21T21:32:22.527038] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T21:32:22.551033] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-10-21T21:32:23.351079] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-10-21T21:32:23.362100] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T21:32:24.151029] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-10-21T21:32:24.553782] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-21T21:32:24.951048] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-10. [2025-10-21T21:32:25.144930] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T21:32:25.751032] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-10-21T21:32:25.987846] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-21T21:32:25.990521] [INFO ] [REMOTE ] TRAK: Full fetch complete (13695 records). [2025-10-21T21:32:25.990603] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-10-21T21:32:26.420991] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-10-21T21:32:26.421063] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-10-21T21:32:26.421449] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-10-21T21:32:26.421512] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-10-21T21:32:26.422377] [DEBUG] [LOCAL ] TRAK: Trimmed 13695 records to 9636 (keeping 200 days of data) [2025-10-21T21:32:26.480316] [DEBUG] [LOCAL ] TRAK: Primary data saved (9636 records). [2025-10-21T21:32:26.480446] [INFO ] [MAIN ] TRAK: Full history saved. [2025-10-21T21:32:26.480520] [INFO ] [MAIN ] Update Progress: 2121/2366 symbols completed. TRAK took 23.8s. Estimated remaining: 31m 28s. Rate: 7.8 symbols/min [2025-10-21T21:32:26.556132] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-10-21T21:32:26.655215] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:26.710902] [DEBUG] [LOCAL ] TRGP: Loaded 50800 existing records from primary storage. [2025-10-21T21:32:26.711202] [INFO ] [MAIN ] TRGP: Loaded 50800 existing records. [2025-10-21T21:32:26.917246] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:32:26.917514] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-10-21T21:32:26.917570] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-10-21T21:32:26.917891] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-10-21T21:32:26.917949] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-10-21T21:32:27.339011] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:32:27.350997] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-10-21T21:32:27.502139] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T21:32:27.506400] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T21:32:28.151030] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-10-21T21:32:28.368713] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T21:32:28.951056] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-10-21T21:32:29.073250] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T21:32:29.751023] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-10. [2025-10-21T21:32:30.530213] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T21:32:30.532624] [INFO ] [REMOTE ] TRC: Full fetch complete (21799 records). [2025-10-21T21:32:30.532740] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-10-21T21:32:30.563352] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-10-21T21:32:30.918978] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-10-21T21:32:30.919141] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-10-21T21:32:30.919874] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-10-21T21:32:30.919982] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-10-21T21:32:30.920985] [DEBUG] [LOCAL ] TRC: Trimmed 21799 records to 15460 (keeping 200 days of data) [2025-10-21T21:32:31.013779] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-21T21:32:31.049720] [DEBUG] [LOCAL ] TRC: Primary data saved (15460 records). [2025-10-21T21:32:31.049842] [INFO ] [MAIN ] TRC: Full history saved. [2025-10-21T21:32:31.049921] [INFO ] [MAIN ] Update Progress: 2122/2366 symbols completed. TRC took 28.3s. Estimated remaining: 31m 20s. Rate: 7.8 symbols/min [2025-10-21T21:32:31.222588] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:31.257578] [DEBUG] [LOCAL ] TRN: Loaded 36521 existing records from primary storage. [2025-10-21T21:32:31.257898] [INFO ] [MAIN ] TRN: Loaded 36521 existing records. [2025-10-21T21:32:31.356173] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-10-21T21:32:31.438946] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:32:31.439142] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-10-21T21:32:31.439187] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-10-21T21:32:31.439456] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-10-21T21:32:31.439512] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-10-21T21:32:31.785812] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:32:32.106827] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T21:32:32.151005] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-10-21T21:32:32.951034] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-10-21T21:32:33.101320] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T21:32:33.730518] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T21:32:33.750976] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-10. [2025-10-21T21:32:33.830278] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:32:34.550998] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-10-21T21:32:34.929129] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-21T21:32:34.932243] [INFO ] [REMOTE ] TR: Full fetch complete (25479 records). [2025-10-21T21:32:34.932346] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-10-21T21:32:35.296391] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-10-21T21:32:35.296493] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-10-21T21:32:35.297109] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-10-21T21:32:35.297193] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-10-21T21:32:35.297914] [DEBUG] [LOCAL ] TR: Trimmed 25479 records to 19126 (keeping 200 days of data) [2025-10-21T21:32:35.354481] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-10-21T21:32:35.415042] [DEBUG] [LOCAL ] TR: Primary data saved (19126 records). [2025-10-21T21:32:35.415159] [INFO ] [MAIN ] TR: Full history saved. [2025-10-21T21:32:35.415231] [INFO ] [MAIN ] Update Progress: 2123/2366 symbols completed. TR took 32.7s. Estimated remaining: 31m 12s. Rate: 7.8 symbols/min [2025-10-21T21:32:35.596663] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:35.635330] [DEBUG] [LOCAL ] TRNO: Loaded 43861 existing records from primary storage. [2025-10-21T21:32:35.635603] [INFO ] [MAIN ] TRNO: Loaded 43861 existing records. [2025-10-21T21:32:35.808045] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:32:35.808235] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-10-21T21:32:35.808281] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-10-21T21:32:35.808449] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-10-21T21:32:35.808489] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-10-21T21:32:36.161355] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-10-21T21:32:36.167170] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:32:36.370727] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T21:32:36.951072] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-10-21T21:32:37.144118] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T21:32:37.550102] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T21:32:37.751020] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-10-21T21:32:38.437808] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T21:32:38.551013] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-10. [2025-10-21T21:32:38.671851] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-21T21:32:39.351031] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-10-21T21:32:40.151035] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-10-21T21:32:40.303989] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T21:32:40.311861] [INFO ] [REMOTE ] TREX: Full fetch complete (71774 records). [2025-10-21T21:32:40.312000] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-10-21T21:32:40.693664] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-10-21T21:32:40.693760] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-10-21T21:32:40.695060] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-10-21T21:32:40.695129] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-10-21T21:32:40.696549] [DEBUG] [LOCAL ] TREX: Trimmed 71774 records to 49829 (keeping 200 days of data) [2025-10-21T21:32:40.955479] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-10-21T21:32:41.035275] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T21:32:41.060929] [DEBUG] [LOCAL ] TREX: Primary data saved (49829 records). [2025-10-21T21:32:41.061180] [INFO ] [MAIN ] TREX: Full history saved. [2025-10-21T21:32:41.061619] [INFO ] [MAIN ] Update Progress: 2124/2366 symbols completed. TREX took 38.3s. Estimated remaining: 31m 4s. Rate: 7.8 symbols/min [2025-10-21T21:32:41.236054] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:41.260788] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T21:32:41.311527] [DEBUG] [LOCAL ] TROX: Loaded 52248 existing records from primary storage. [2025-10-21T21:32:41.311881] [INFO ] [MAIN ] TROX: Loaded 52248 existing records. [2025-10-21T21:32:41.485238] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:32:41.485449] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-10-21T21:32:41.485497] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-10-21T21:32:41.485748] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-10-21T21:32:41.485805] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-10-21T21:32:41.757804] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-10-21T21:32:41.842938] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:32:42.556111] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-10-21T21:32:42.569842] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-21T21:32:43.350995] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-10-21T21:32:43.638764] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T21:32:44.151006] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-10-21T21:32:44.184258] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T21:32:44.919018] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T21:32:44.950986] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-10-21T21:32:45.610161] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T21:32:45.751008] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-10-21T21:32:46.551004] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-10-21T21:32:46.636741] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T21:32:47.118818] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T21:32:47.351019] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-10-21T21:32:48.151083] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-10-21T21:32:48.234251] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T21:32:48.683919] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T21:32:48.951016] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-10-21T21:32:49.738674] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T21:32:49.750985] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-10-21T21:32:50.424953] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T21:32:50.551011] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-10-21T21:32:51.272759] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-21T21:32:51.350989] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-10-21T21:32:52.150997] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-10-21T21:32:52.284947] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T21:32:52.951001] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-10-21T21:32:53.135625] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T21:32:53.758886] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-10-21T21:32:53.764042] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T21:32:54.455144] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T21:32:54.551019] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-10-21T21:32:55.351019] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-10-21T21:32:55.616629] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T21:32:55.916417] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T21:32:56.151098] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-10-21T21:32:56.951080] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-10-21T21:32:57.134478] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-21T21:32:57.751009] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-10. [2025-10-21T21:32:57.796387] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T21:32:58.551010] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-10-21T21:32:58.660694] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T21:32:59.010325] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T21:32:59.015565] [INFO ] [REMOTE ] TRN: Full fetch complete (52660 records). [2025-10-21T21:32:59.015693] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-10-21T21:32:59.356224] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-10-21T21:32:59.406969] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-10-21T21:32:59.407040] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-10-21T21:32:59.408049] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-10-21T21:32:59.408108] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-10-21T21:32:59.409138] [DEBUG] [LOCAL ] TRN: Trimmed 52660 records to 36427 (keeping 200 days of data) [2025-10-21T21:32:59.642373] [DEBUG] [LOCAL ] TRN: Primary data saved (36427 records). [2025-10-21T21:32:59.642500] [INFO ] [MAIN ] TRN: Full history saved. [2025-10-21T21:32:59.642577] [INFO ] [MAIN ] Update Progress: 2125/2366 symbols completed. TRN took 28.6s. Estimated remaining: 30m 57s. Rate: 7.8 symbols/min [2025-10-21T21:32:59.822053] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:32:59.871467] [DEBUG] [LOCAL ] TRP: Loaded 52150 existing records from primary storage. [2025-10-21T21:32:59.871795] [INFO ] [MAIN ] TRP: Loaded 52150 existing records. [2025-10-21T21:33:00.057047] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:33:00.057444] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-10-21T21:33:00.057517] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-10-21T21:33:00.058004] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-10-21T21:33:00.058201] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-10-21T21:33:00.153219] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-10-21T21:33:00.194775] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T21:33:00.453514] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:00.951031] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-10. [2025-10-21T21:33:01.174124] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T21:33:01.751037] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-10-21T21:33:01.862427] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-21T21:33:02.024032] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T21:33:02.030433] [INFO ] [REMOTE ] TRNO: Full fetch complete (62927 records). [2025-10-21T21:33:02.030580] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-10-21T21:33:02.428971] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-10-21T21:33:02.429045] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-10-21T21:33:02.430117] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-10-21T21:33:02.430177] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-10-21T21:33:02.431301] [DEBUG] [LOCAL ] TRNO: Trimmed 62927 records to 43765 (keeping 200 days of data) [2025-10-21T21:33:02.599920] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-10-21T21:33:02.692282] [DEBUG] [LOCAL ] TRNO: Primary data saved (43765 records). [2025-10-21T21:33:02.692416] [INFO ] [MAIN ] TRNO: Full history saved. [2025-10-21T21:33:02.692499] [INFO ] [MAIN ] Update Progress: 2126/2366 symbols completed. TRNO took 27.3s. Estimated remaining: 30m 49s. Rate: 7.8 symbols/min [2025-10-21T21:33:02.857515] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:33:02.857756] [DEBUG] [LOCAL ] TRTX: No existing data file found in primary storage. [2025-10-21T21:33:02.857801] [WARN ] [MAIN ] TRTX: No existing data found, performing full refresh instead. [2025-10-21T21:33:02.857907] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-10-21T21:33:02.857948] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-10-21T21:33:02.857987] [DEBUG] [LOCAL ] TRTX: No primary data file found to delete. [2025-10-21T21:33:02.858018] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-10-21T21:33:03.212199] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:03.351008] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-10-21T21:33:03.608722] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T21:33:04.151047] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-10-21T21:33:04.402271] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T21:33:04.462922] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-21T21:33:04.951014] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-10-21T21:33:05.731384] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T21:33:05.750989] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-10-21T21:33:06.550997] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-10-21T21:33:06.746778] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T21:33:07.073783] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T21:33:07.351008] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-10-21T21:33:08.151015] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-10-21T21:33:08.299509] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T21:33:08.731986] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T21:33:08.951040] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-10. [2025-10-21T21:33:09.000965] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-21T21:33:09.751059] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-10-21T21:33:10.551006] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-10-21T21:33:10.790503] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T21:33:10.799138] [INFO ] [REMOTE ] TROX: Full fetch complete (74106 records). [2025-10-21T21:33:10.799272] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-10-21T21:33:11.185851] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-10-21T21:33:11.186040] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-10-21T21:33:11.187281] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-10-21T21:33:11.187396] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-10-21T21:33:11.189021] [DEBUG] [LOCAL ] TROX: Trimmed 74106 records to 52247 (keeping 200 days of data) [2025-10-21T21:33:11.305840] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T21:33:11.387171] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-10-21T21:33:11.519692] [DEBUG] [LOCAL ] TROX: Primary data saved (52247 records). [2025-10-21T21:33:11.519828] [INFO ] [MAIN ] TROX: Full history saved. [2025-10-21T21:33:11.520237] [INFO ] [MAIN ] Update Progress: 2127/2366 symbols completed. TROX took 30.5s. Estimated remaining: 30m 41s. Rate: 7.8 symbols/min [2025-10-21T21:33:11.684203] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:33:11.733951] [DEBUG] [LOCAL ] TRU: Loaded 51460 existing records from primary storage. [2025-10-21T21:33:11.734239] [INFO ] [MAIN ] TRU: Loaded 51460 existing records. [2025-10-21T21:33:11.912140] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:33:11.912346] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-10-21T21:33:11.912395] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-10-21T21:33:11.912588] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-10-21T21:33:11.912627] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-10-21T21:33:12.157336] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-10. [2025-10-21T21:33:12.273953] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:12.343051] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:33:12.951084] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-10-21T21:33:13.025213] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T21:33:13.751014] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-10-21T21:33:13.916059] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T21:33:13.923853] [INFO ] [REMOTE ] TRGP: Full fetch complete (73639 records). [2025-10-21T21:33:13.923974] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-10-21T21:33:14.310192] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-10-21T21:33:14.310270] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-10-21T21:33:14.311438] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-10-21T21:33:14.311502] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-10-21T21:33:14.312886] [DEBUG] [LOCAL ] TRGP: Trimmed 73639 records to 50756 (keeping 200 days of data) [2025-10-21T21:33:14.551672] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-10-21T21:33:14.635725] [DEBUG] [LOCAL ] TRGP: Primary data saved (50756 records). [2025-10-21T21:33:14.635860] [INFO ] [MAIN ] TRGP: Full history saved. [2025-10-21T21:33:14.636702] [INFO ] [MAIN ] Update Progress: 2128/2366 symbols completed. TRGP took 48.2s. Estimated remaining: 30m 33s. Rate: 7.8 symbols/min [2025-10-21T21:33:14.844794] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:33:14.863370] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T21:33:14.893183] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T21:33:14.941914] [DEBUG] [LOCAL ] TRV: Loaded 47484 existing records from primary storage. [2025-10-21T21:33:14.942197] [INFO ] [MAIN ] TRV: Loaded 47484 existing records. [2025-10-21T21:33:15.154564] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:33:15.154803] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-10-21T21:33:15.154852] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-10-21T21:33:15.155059] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-10-21T21:33:15.155118] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-10-21T21:33:15.356256] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-10-21T21:33:15.519526] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:16.150988] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-10-21T21:33:16.421538] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T21:33:16.951052] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-10-21T21:33:17.172508] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T21:33:17.522201] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T21:33:17.751002] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-10-21T21:33:18.551011] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-10-21T21:33:18.727351] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T21:33:19.351094] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-10-21T21:33:19.499357] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T21:33:19.951273] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-21T21:33:20.151006] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-10-21T21:33:20.929828] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T21:33:20.950972] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-10-21T21:33:21.751049] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-10-21T21:33:21.937832] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:33:22.551098] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-10-21T21:33:22.729241] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-21T21:33:23.351020] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-10-21T21:33:24.083589] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-21T21:33:24.150987] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-10-21T21:33:24.951003] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-10-21T21:33:25.210865] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T21:33:25.751043] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-10-21T21:33:25.903290] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T21:33:26.551043] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-10-21T21:33:27.515596] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-21T21:33:27.525982] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-10-21T21:33:27.969129] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-21T21:33:28.151102] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-10. [2025-10-21T21:33:29.389238] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T21:33:29.400821] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-10-21T21:33:29.748466] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T21:33:29.756770] [INFO ] [REMOTE ] TRP: Full fetch complete (75745 records). [2025-10-21T21:33:29.756905] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-10-21T21:33:30.146959] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-10-21T21:33:30.147039] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-10-21T21:33:30.148231] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-10-21T21:33:30.148294] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-10-21T21:33:30.149719] [DEBUG] [LOCAL ] TRP: Trimmed 75745 records to 52128 (keeping 200 days of data) [2025-10-21T21:33:30.415216] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (9.46 seconds). [2025-10-21T21:33:30.463265] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-10-21T21:33:30.502032] [DEBUG] [LOCAL ] TRP: Primary data saved (52128 records). [2025-10-21T21:33:30.502150] [INFO ] [MAIN ] TRP: Full history saved. [2025-10-21T21:33:30.503073] [INFO ] [MAIN ] Update Progress: 2129/2366 symbols completed. TRP took 30.9s. Estimated remaining: 30m 26s. Rate: 7.8 symbols/min [2025-10-21T21:33:30.681551] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:33:30.729966] [DEBUG] [LOCAL ] TS: Loaded 51678 existing records from primary storage. [2025-10-21T21:33:30.730276] [INFO ] [MAIN ] TS: Loaded 51678 existing records. [2025-10-21T21:33:30.909430] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:33:30.909811] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-10-21T21:33:30.909943] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-10-21T21:33:30.910407] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-10-21T21:33:30.910514] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-10-21T21:33:31.080250] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:33:31.164837] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-10-21T21:33:31.314896] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:31.350979] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-10-21T21:33:32.618787] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-21T21:33:32.629352] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-10-21T21:33:32.956912] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-21T21:33:32.968132] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-10. [2025-10-21T21:33:33.039052] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T21:33:33.751026] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-10-21T21:33:34.612592] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T21:33:34.622995] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-10-21T21:33:34.683573] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T21:33:34.691630] [INFO ] [REMOTE ] TRU: Full fetch complete (74151 records). [2025-10-21T21:33:34.691779] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-10-21T21:33:35.097140] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-10-21T21:33:35.097287] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-10-21T21:33:35.098476] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-10-21T21:33:35.098582] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-10-21T21:33:35.100283] [DEBUG] [LOCAL ] TRU: Trimmed 74151 records to 51460 (keeping 200 days of data) [2025-10-21T21:33:35.237909] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T21:33:35.351560] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-10-21T21:33:35.451503] [DEBUG] [LOCAL ] TRU: Primary data saved (51460 records). [2025-10-21T21:33:35.451629] [INFO ] [MAIN ] TRU: Full history saved. [2025-10-21T21:33:35.452102] [INFO ] [MAIN ] Update Progress: 2130/2366 symbols completed. TRU took 23.9s. Estimated remaining: 30m 18s. Rate: 7.8 symbols/min [2025-10-21T21:33:35.620661] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:33:35.648678] [DEBUG] [LOCAL ] TSE: Loaded 27846 existing records from primary storage. [2025-10-21T21:33:35.648976] [INFO ] [MAIN ] TSE: Loaded 27846 existing records. [2025-10-21T21:33:35.830813] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:33:35.831002] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-10-21T21:33:35.831056] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-10-21T21:33:35.831230] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-10-21T21:33:35.831285] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-10-21T21:33:36.205289] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:36.205670] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-10-21T21:33:36.334894] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T21:33:36.950996] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-10-21T21:33:37.355965] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-21T21:33:37.751069] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-10-21T21:33:38.603206] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (13.65 seconds). [2025-10-21T21:33:38.614423] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-10. [2025-10-21T21:33:38.672008] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T21:33:38.893872] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-21T21:33:39.351071] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-10-21T21:33:40.005274] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-21T21:33:40.010980] [INFO ] [REMOTE ] TRTX: Full fetch complete (53014 records). [2025-10-21T21:33:40.011091] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-10-21T21:33:40.160633] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-10-21T21:33:40.415671] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-10-21T21:33:40.425895] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-10-21T21:33:40.427087] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-10-21T21:33:40.428336] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-21T21:33:40.427636] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-10-21T21:33:40.436227] [DEBUG] [LOCAL ] TRTX: Trimmed 53014 records to 37056 (keeping 200 days of data) [2025-10-21T21:33:40.650578] [DEBUG] [LOCAL ] TRTX: Primary data saved (37056 records). [2025-10-21T21:33:40.650736] [INFO ] [MAIN ] TRTX: Full history saved. [2025-10-21T21:33:40.650814] [INFO ] [MAIN ] Update Progress: 2131/2366 symbols completed. TRTX took 38.0s. Estimated remaining: 30m 10s. Rate: 7.8 symbols/min [2025-10-21T21:33:40.821898] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:33:40.831942] [DEBUG] [LOCAL ] TSI: Loaded 8213 existing records from primary storage. [2025-10-21T21:33:40.832158] [INFO ] [MAIN ] TSI: Loaded 8213 existing records. [2025-10-21T21:33:40.951076] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-10-21T21:33:41.018291] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:33:41.018497] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-10-21T21:33:41.018546] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-10-21T21:33:41.018732] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-10-21T21:33:41.018787] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-10-21T21:33:41.383155] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:41.716802] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (6.37 seconds). [2025-10-21T21:33:41.751045] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-10-21T21:33:42.003198] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-21T21:33:42.200937] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T21:33:42.551078] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-10-21T21:33:43.312164] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T21:33:43.351003] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-10-21T21:33:43.746745] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T21:33:44.151072] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-10-21T21:33:44.951010] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-10-21T21:33:45.280093] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T21:33:45.751057] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-10-21T21:33:46.025732] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T21:33:46.236631] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-21T21:33:46.551024] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-10-21T21:33:47.123483] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T21:33:47.350982] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-10-21T21:33:47.391166] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T21:33:47.959174] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-21T21:33:48.151110] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-10-21T21:33:48.951059] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-10-21T21:33:49.751008] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-10. [2025-10-21T21:33:49.866325] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T21:33:50.182148] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T21:33:50.551022] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-10-21T21:33:51.351065] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-10-21T21:33:51.435478] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T21:33:51.442949] [INFO ] [REMOTE ] TRV: Full fetch complete (69965 records). [2025-10-21T21:33:51.443070] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-10-21T21:33:51.832030] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-10-21T21:33:51.832113] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-10-21T21:33:51.833275] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-10-21T21:33:51.833337] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-10-21T21:33:51.834629] [DEBUG] [LOCAL ] TRV: Trimmed 69965 records to 47486 (keeping 200 days of data) [2025-10-21T21:33:52.129735] [DEBUG] [LOCAL ] TRV: Primary data saved (47486 records). [2025-10-21T21:33:52.129854] [INFO ] [MAIN ] TRV: Full history saved. [2025-10-21T21:33:52.130488] [INFO ] [MAIN ] Update Progress: 2132/2366 symbols completed. TRV took 37.5s. Estimated remaining: 30m 3s. Rate: 7.8 symbols/min [2025-10-21T21:33:52.167088] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-10-21T21:33:52.303918] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:33:52.340490] [DEBUG] [LOCAL ] TSLX: Loaded 35864 existing records from primary storage. [2025-10-21T21:33:52.340783] [INFO ] [MAIN ] TSLX: Loaded 35864 existing records. [2025-10-21T21:33:52.524378] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:33:52.524811] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-10-21T21:33:52.540086] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-10-21T21:33:52.552361] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-10-21T21:33:52.557586] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-10-21T21:33:52.591400] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-21T21:33:52.588776] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-21T21:33:52.943816] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:52.950994] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-10-21T21:33:53.190986] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T21:33:53.751052] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-10. [2025-10-21T21:33:54.009962] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T21:33:54.550991] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-10-21T21:33:54.854040] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T21:33:54.858837] [INFO ] [REMOTE ] TSE: Full fetch complete (40710 records). [2025-10-21T21:33:54.858922] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-10-21T21:33:55.233240] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-10-21T21:33:55.233354] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-10-21T21:33:55.234167] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-10-21T21:33:55.234228] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-10-21T21:33:55.235209] [DEBUG] [LOCAL ] TSE: Trimmed 40710 records to 27688 (keeping 200 days of data) [2025-10-21T21:33:55.363928] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-10-21T21:33:55.390743] [DEBUG] [LOCAL ] TSE: Primary data saved (27688 records). [2025-10-21T21:33:55.390868] [INFO ] [MAIN ] TSE: Full history saved. [2025-10-21T21:33:55.390944] [INFO ] [MAIN ] Update Progress: 2133/2366 symbols completed. TSE took 19.9s. Estimated remaining: 29m 55s. Rate: 7.8 symbols/min [2025-10-21T21:33:55.559037] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:33:55.616089] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-21T21:33:55.616389] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-10-21T21:33:55.793480] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:33:55.793735] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-10-21T21:33:55.793787] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-10-21T21:33:55.794133] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-10-21T21:33:55.794170] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-10-21T21:33:56.160079] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:33:56.156227] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-10-21T21:33:56.814176] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T21:33:56.950999] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-10-21T21:33:57.309357] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-10-21T21:33:57.605979] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T21:33:57.751013] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-10-21T21:33:58.551022] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-10-21T21:33:58.566824] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-21T21:33:59.351005] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-10-21T21:33:59.674516] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-21T21:33:59.943995] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T21:34:00.150997] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-10-21T21:34:00.270688] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T21:34:00.951023] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-10-21T21:34:01.751052] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-10-21T21:34:02.551005] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-10. [2025-10-21T21:34:02.626150] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-21T21:34:02.650855] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T21:34:03.017331] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.87 seconds). [2025-10-21T21:34:03.351022] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-10-21T21:34:04.151034] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-10-21T21:34:04.219890] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T21:34:04.228757] [INFO ] [REMOTE ] TS: Full fetch complete (74819 records). [2025-10-21T21:34:04.228922] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-10-21T21:34:04.619603] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-10-21T21:34:04.626419] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-10-21T21:34:04.627964] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-10-21T21:34:04.626680] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T21:34:04.628132] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-10-21T21:34:04.632301] [DEBUG] [LOCAL ] TS: Trimmed 74819 records to 51660 (keeping 200 days of data) [2025-10-21T21:34:04.928973] [DEBUG] [LOCAL ] TS: Primary data saved (51660 records). [2025-10-21T21:34:04.929115] [INFO ] [MAIN ] TS: Full history saved. [2025-10-21T21:34:04.929213] [INFO ] [MAIN ] Update Progress: 2134/2366 symbols completed. TS took 34.4s. Estimated remaining: 29m 47s. Rate: 7.8 symbols/min [2025-10-21T21:34:04.959768] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-10-21T21:34:05.099310] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:34:05.148514] [DEBUG] [LOCAL ] TSN: Loaded 53079 existing records from primary storage. [2025-10-21T21:34:05.148872] [INFO ] [MAIN ] TSN: Loaded 53079 existing records. [2025-10-21T21:34:05.321168] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:34:05.321357] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-10-21T21:34:05.321419] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-10-21T21:34:05.321667] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-10-21T21:34:05.321724] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-10-21T21:34:05.671809] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:34:05.750988] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-10-21T21:34:05.785750] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T21:34:06.081877] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-10-21T21:34:06.551035] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-10-21T21:34:07.351005] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-10-21T21:34:07.439901] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T21:34:07.586465] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-21T21:34:08.076448] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-21T21:34:08.150984] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-10. [2025-10-21T21:34:08.937133] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T21:34:08.939767] [INFO ] [REMOTE ] TSI: Full fetch complete (13977 records). [2025-10-21T21:34:08.939842] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-10-21T21:34:08.961436] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-10-21T21:34:09.323921] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-10-21T21:34:09.323998] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-10-21T21:34:09.324293] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-10-21T21:34:09.324331] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-10-21T21:34:09.324818] [DEBUG] [LOCAL ] TSI: Trimmed 13977 records to 8226 (keeping 200 days of data) [2025-10-21T21:34:09.371310] [DEBUG] [LOCAL ] TSI: Primary data saved (8226 records). [2025-10-21T21:34:09.371439] [INFO ] [MAIN ] TSI: Full history saved. [2025-10-21T21:34:09.371518] [INFO ] [MAIN ] Update Progress: 2135/2366 symbols completed. TSI took 28.7s. Estimated remaining: 29m 39s. Rate: 7.8 symbols/min [2025-10-21T21:34:09.538219] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:34:09.551129] [DEBUG] [LOCAL ] TSQ: Loaded 11603 existing records from primary storage. [2025-10-21T21:34:09.551353] [INFO ] [MAIN ] TSQ: Loaded 11603 existing records. [2025-10-21T21:34:09.724537] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:34:09.724798] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-10-21T21:34:09.724848] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-10-21T21:34:09.725004] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-10-21T21:34:09.725041] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-10-21T21:34:09.756177] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-10-21T21:34:10.087466] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:34:10.551071] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-10-21T21:34:11.351056] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-10-21T21:34:11.627452] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-21T21:34:11.983906] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (3.02 seconds). [2025-10-21T21:34:12.002422] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T21:34:12.024442] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T21:34:12.150983] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-10-21T21:34:12.951056] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-10-21T21:34:13.364535] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T21:34:13.732223] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T21:34:13.750983] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-10-21T21:34:14.551002] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-10-21T21:34:14.593295] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-21T21:34:15.351022] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-10-21T21:34:16.151025] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-10-21T21:34:16.432931] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T21:34:16.853626] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T21:34:16.950996] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-10-21T21:34:17.006777] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T21:34:17.751037] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-10-21T21:34:18.421377] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T21:34:18.551112] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-10-21T21:34:19.350996] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-10-21T21:34:19.699322] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T21:34:20.151040] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-10-21T21:34:20.693154] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T21:34:20.951101] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-10-21T21:34:21.140315] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-21T21:34:21.238122] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.69 seconds). [2025-10-21T21:34:21.751069] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-10-21T21:34:22.551058] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-10-21T21:34:22.740220] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T21:34:22.752999] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-21T21:34:23.351093] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-10-21T21:34:24.150997] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-10-21T21:34:24.185021] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T21:34:24.951099] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-10. [2025-10-21T21:34:25.192564] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-21T21:34:25.751081] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-10-21T21:34:25.926151] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T21:34:26.472455] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T21:34:26.479540] [INFO ] [REMOTE ] TSLX: Full fetch complete (50660 records). [2025-10-21T21:34:26.479716] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-10-21T21:34:26.559086] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-10-21T21:34:26.870406] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-10-21T21:34:26.870502] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-10-21T21:34:26.871515] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-10-21T21:34:26.871577] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-10-21T21:34:26.872620] [DEBUG] [LOCAL ] TSLX: Trimmed 50660 records to 35822 (keeping 200 days of data) [2025-10-21T21:34:27.086961] [DEBUG] [LOCAL ] TSLX: Primary data saved (35822 records). [2025-10-21T21:34:27.087105] [INFO ] [MAIN ] TSLX: Full history saved. [2025-10-21T21:34:27.087887] [INFO ] [MAIN ] Update Progress: 2136/2366 symbols completed. TSLX took 35.0s. Estimated remaining: 29m 33s. Rate: 7.8 symbols/min [2025-10-21T21:34:27.252242] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:34:27.297746] [DEBUG] [LOCAL ] TT: Loaded 47092 existing records from primary storage. [2025-10-21T21:34:27.298039] [INFO ] [MAIN ] TT: Loaded 47092 existing records. [2025-10-21T21:34:27.360754] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-10-21T21:34:27.476873] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:34:27.477125] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-10-21T21:34:27.477175] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-10-21T21:34:27.477381] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-10-21T21:34:27.477475] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-10-21T21:34:27.868164] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:34:28.151023] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-10-21T21:34:28.162272] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-21T21:34:28.591632] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-21T21:34:28.640914] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-21T21:34:28.951036] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-10-21T21:34:29.753786] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-10-21T21:34:29.755551] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T21:34:29.942477] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T21:34:30.551074] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-10. [2025-10-21T21:34:31.217120] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T21:34:31.219324] [INFO ] [REMOTE ] TSQ: Full fetch complete (16302 records). [2025-10-21T21:34:31.219401] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-10-21T21:34:31.356237] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-10-21T21:34:31.625256] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-10-21T21:34:31.625364] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-10-21T21:34:31.626041] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-10-21T21:34:31.626107] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-10-21T21:34:31.626988] [DEBUG] [LOCAL ] TSQ: Trimmed 16302 records to 11587 (keeping 200 days of data) [2025-10-21T21:34:31.710367] [DEBUG] [LOCAL ] TSQ: Primary data saved (11587 records). [2025-10-21T21:34:31.710691] [INFO ] [MAIN ] TSQ: Full history saved. [2025-10-21T21:34:31.710855] [INFO ] [MAIN ] Update Progress: 2137/2366 symbols completed. TSQ took 22.3s. Estimated remaining: 29m 25s. Rate: 7.8 symbols/min [2025-10-21T21:34:31.892356] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:34:31.892524] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-10-21T21:34:31.892561] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-10-21T21:34:31.892699] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-10-21T21:34:31.892753] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-21T21:34:31.892795] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-21T21:34:31.892827] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-10-21T21:34:32.156859] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-10-21T21:34:32.267793] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:34:32.581293] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-10-21T21:34:32.951083] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-10-21T21:34:33.301345] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:34:33.301701] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-10-21T21:34:33.301788] [FATAL] [REMOTE ] TTAM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:34:33.301833] [FATAL] [MAIN ] TTAM: Failed to fetch primary data. [2025-10-21T21:34:33.301866] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:34:33.301904] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-10-21T21:34:33.301959] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-10-21T21:34:33.301992] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-10-21T21:34:33.302031] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-10-21T21:34:33.302078] [INFO ] [MAIN ] Update Progress: 2138/2366 symbols completed. TTAM took 1.6s. Estimated remaining: 29m 16s. Rate: 7.8 symbols/min [2025-10-21T21:34:33.491759] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:34:33.508861] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-21T21:34:33.556120] [DEBUG] [LOCAL ] TTC: Loaded 41748 existing records from primary storage. [2025-10-21T21:34:33.556414] [INFO ] [MAIN ] TTC: Loaded 41748 existing records. [2025-10-21T21:34:33.739380] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:34:33.739768] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-10-21T21:34:33.739839] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-10-21T21:34:33.740136] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-10-21T21:34:33.740201] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-10-21T21:34:33.760798] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-10-21T21:34:34.102582] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:34:34.129750] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-21T21:34:34.561042] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-10-21T21:34:34.566636] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T21:34:35.351076] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-10-21T21:34:36.151034] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-10-21T21:34:36.951000] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-10. [2025-10-21T21:34:37.384421] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.82 seconds). [2025-10-21T21:34:37.423711] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-21T21:34:37.666152] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:34:37.750997] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-10-21T21:34:38.551113] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-10. [2025-10-21T21:34:38.804524] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-21T21:34:38.812986] [INFO ] [REMOTE ] TSN: Full fetch complete (76665 records). [2025-10-21T21:34:38.813116] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-10-21T21:34:39.209409] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-10-21T21:34:39.209521] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-10-21T21:34:39.211085] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-10-21T21:34:39.211283] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-10-21T21:34:39.212710] [DEBUG] [LOCAL ] TSN: Trimmed 76665 records to 53088 (keeping 200 days of data) [2025-10-21T21:34:39.388766] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-10-21T21:34:39.478538] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-21T21:34:39.587091] [DEBUG] [LOCAL ] TSN: Primary data saved (53088 records). [2025-10-21T21:34:39.587221] [INFO ] [MAIN ] TSN: Full history saved. [2025-10-21T21:34:39.588109] [INFO ] [MAIN ] Update Progress: 2139/2366 symbols completed. TSN took 34.7s. Estimated remaining: 29m 8s. Rate: 7.8 symbols/min [2025-10-21T21:34:39.754692] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:34:39.804728] [DEBUG] [LOCAL ] TTE: Loaded 51594 existing records from primary storage. [2025-10-21T21:34:39.805023] [INFO ] [MAIN ] TTE: Loaded 51594 existing records. [2025-10-21T21:34:39.979185] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:34:39.979423] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-10-21T21:34:39.979470] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-10-21T21:34:39.979963] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-10-21T21:34:39.980021] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-10-21T21:34:40.152429] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-10-21T21:34:40.331244] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:34:40.951052] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-10-21T21:34:41.328807] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-21T21:34:41.337560] [INFO ] [REMOTE ] TSM: Full fetch complete (77999 records). [2025-10-21T21:34:41.337805] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-10-21T21:34:41.474752] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-21T21:34:41.761609] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-10-21T21:34:41.786011] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-10-21T21:34:41.786138] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-10-21T21:34:41.787543] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-10-21T21:34:41.787715] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-10-21T21:34:41.789267] [DEBUG] [LOCAL ] TSM: Trimmed 77999 records to 53819 (keeping 200 days of data) [2025-10-21T21:34:42.154315] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T21:34:42.187789] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-10-21T21:34:42.188011] [INFO ] [MAIN ] TSM: Full history saved. [2025-10-21T21:34:42.188780] [INFO ] [MAIN ] Update Progress: 2140/2366 symbols completed. TSM took 46.8s. Estimated remaining: 29m 0s. Rate: 7.8 symbols/min [2025-10-21T21:34:42.361664] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:34:42.394305] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T21:34:42.438910] [DEBUG] [LOCAL ] TTI: Loaded 46578 existing records from primary storage. [2025-10-21T21:34:42.439201] [INFO ] [MAIN ] TTI: Loaded 46578 existing records. [2025-10-21T21:34:42.556217] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-10-21T21:34:42.618798] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:34:42.618986] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-10-21T21:34:42.619033] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-10-21T21:34:42.619251] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-10-21T21:34:42.619306] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-10-21T21:34:42.964391] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:34:43.351027] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-10-21T21:34:43.637325] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-21T21:34:44.151017] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-10-21T21:34:44.211497] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T21:34:44.951053] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-10-21T21:34:45.002096] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T21:34:45.706038] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T21:34:45.751018] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-10-21T21:34:46.551064] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-10-21T21:34:46.627124] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T21:34:47.299912] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T21:34:47.350991] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-10-21T21:34:47.867517] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-21T21:34:48.151017] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-10-21T21:34:48.898918] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T21:34:48.951009] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-10-21T21:34:49.374271] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-21T21:34:49.751054] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-10-21T21:34:50.551004] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-10-21T21:34:50.914447] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-21T21:34:50.991489] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T21:34:51.351024] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-10-21T21:34:52.117094] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T21:34:52.150984] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-10-21T21:34:52.951045] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-10-21T21:34:53.161482] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T21:34:53.631936] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T21:34:53.751028] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-10-21T21:34:54.540702] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-21T21:34:54.550986] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-10-21T21:34:55.351006] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-10-21T21:34:55.499888] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-21T21:34:56.096133] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T21:34:56.150975] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-10. [2025-10-21T21:34:56.905574] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T21:34:56.950984] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-10-21T21:34:57.139346] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T21:34:57.145911] [INFO ] [REMOTE ] TTC: Full fetch complete (61941 records). [2025-10-21T21:34:57.146048] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-10-21T21:34:57.531069] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-10-21T21:34:57.531147] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-10-21T21:34:57.532246] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-10-21T21:34:57.532349] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-10-21T21:34:57.533687] [DEBUG] [LOCAL ] TTC: Trimmed 61941 records to 41627 (keeping 200 days of data) [2025-10-21T21:34:57.755460] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-10-21T21:34:57.785960] [DEBUG] [LOCAL ] TTC: Primary data saved (41627 records). [2025-10-21T21:34:57.786055] [INFO ] [MAIN ] TTC: Full history saved. [2025-10-21T21:34:57.786123] [INFO ] [MAIN ] Update Progress: 2141/2366 symbols completed. TTC took 24.5s. Estimated remaining: 28m 53s. Rate: 7.8 symbols/min [2025-10-21T21:34:57.951928] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:34:57.997011] [DEBUG] [LOCAL ] TU: Loaded 49805 existing records from primary storage. [2025-10-21T21:34:57.997297] [INFO ] [MAIN ] TU: Loaded 49805 existing records. [2025-10-21T21:34:58.173335] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:34:58.173528] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-10-21T21:34:58.173573] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-10-21T21:34:58.173801] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-10-21T21:34:58.173856] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-10-21T21:34:58.527190] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:34:58.550981] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-10-21T21:34:58.686784] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T21:34:59.198684] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T21:34:59.351005] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-10. [2025-10-21T21:35:00.151012] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-10-21T21:35:00.274431] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T21:35:00.951001] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-10-21T21:35:01.261855] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-21T21:35:01.272589] [INFO ] [REMOTE ] TT: Full fetch complete (69957 records). [2025-10-21T21:35:01.272875] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-10-21T21:35:01.671802] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-10-21T21:35:01.671900] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-10-21T21:35:01.673459] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-10-21T21:35:01.673551] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-10-21T21:35:01.675106] [DEBUG] [LOCAL ] TT: Trimmed 69957 records to 47010 (keeping 200 days of data) [2025-10-21T21:35:01.768829] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-10-21T21:35:01.933151] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T21:35:02.023662] [DEBUG] [LOCAL ] TT: Primary data saved (47010 records). [2025-10-21T21:35:02.023816] [INFO ] [MAIN ] TT: Full history saved. [2025-10-21T21:35:02.024744] [INFO ] [MAIN ] Update Progress: 2142/2366 symbols completed. TT took 34.9s. Estimated remaining: 28m 45s. Rate: 7.8 symbols/min [2025-10-21T21:35:02.218409] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:35:02.273840] [DEBUG] [LOCAL ] TUYA: Loaded 45927 existing records from primary storage. [2025-10-21T21:35:02.274133] [INFO ] [MAIN ] TUYA: Loaded 45927 existing records. [2025-10-21T21:35:02.455981] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:35:02.456374] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-10-21T21:35:02.456484] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-10-21T21:35:02.456852] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-10-21T21:35:02.457059] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-10-21T21:35:02.551979] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-10-21T21:35:02.587913] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T21:35:02.858048] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:35:03.351005] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-10-21T21:35:03.782619] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T21:35:04.151003] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-10-21T21:35:04.250488] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T21:35:04.951006] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-10-21T21:35:05.203364] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T21:35:05.750999] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-10-21T21:35:05.877840] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T21:35:06.551021] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-10-21T21:35:06.787891] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T21:35:07.351023] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-10-21T21:35:07.440457] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T21:35:08.065858] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T21:35:08.151055] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-10-21T21:35:08.951030] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-10-21T21:35:09.120117] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T21:35:09.751040] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-10. [2025-10-21T21:35:10.107916] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-21T21:35:10.551003] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-10-21T21:35:10.699201] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T21:35:11.351035] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-10-21T21:35:11.529233] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T21:35:11.537678] [INFO ] [REMOTE ] TTE: Full fetch complete (75082 records). [2025-10-21T21:35:11.537823] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-10-21T21:35:11.948357] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-10-21T21:35:11.948477] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-10-21T21:35:11.949803] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-10-21T21:35:11.949988] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-10-21T21:35:11.966982] [DEBUG] [LOCAL ] TTE: Trimmed 75082 records to 51560 (keeping 200 days of data) [2025-10-21T21:35:11.985388] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T21:35:12.169557] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-10-21T21:35:12.314319] [DEBUG] [LOCAL ] TTE: Primary data saved (51560 records). [2025-10-21T21:35:12.314562] [INFO ] [MAIN ] TTE: Full history saved. [2025-10-21T21:35:12.315686] [INFO ] [MAIN ] Update Progress: 2143/2366 symbols completed. TTE took 32.7s. Estimated remaining: 28m 38s. Rate: 7.8 symbols/min [2025-10-21T21:35:12.505739] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:35:12.549810] [DEBUG] [LOCAL ] TV: Loaded 41489 existing records from primary storage. [2025-10-21T21:35:12.550130] [INFO ] [MAIN ] TV: Loaded 41489 existing records. [2025-10-21T21:35:12.723830] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:35:12.724027] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-10-21T21:35:12.724073] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-10-21T21:35:12.724470] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-10-21T21:35:12.724527] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-10-21T21:35:12.963894] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-10-21T21:35:13.080913] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:35:13.225435] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T21:35:13.515751] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T21:35:13.751021] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-10-21T21:35:14.551067] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-10. [2025-10-21T21:35:14.583929] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T21:35:15.351005] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-10-21T21:35:15.395972] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T21:35:16.151100] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-10-21T21:35:16.361472] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-21T21:35:16.375859] [INFO ] [REMOTE ] TTI: Full fetch complete (66417 records). [2025-10-21T21:35:16.376159] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-10-21T21:35:16.888877] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-10-21T21:35:16.889029] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-10-21T21:35:16.890620] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-10-21T21:35:16.890853] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-10-21T21:35:16.892439] [DEBUG] [LOCAL ] TTI: Trimmed 66417 records to 46631 (keeping 200 days of data) [2025-10-21T21:35:16.951764] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-10-21T21:35:17.171073] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-21T21:35:17.259492] [DEBUG] [LOCAL ] TTI: Primary data saved (46631 records). [2025-10-21T21:35:17.259637] [INFO ] [MAIN ] TTI: Full history saved. [2025-10-21T21:35:17.260205] [INFO ] [MAIN ] Update Progress: 2144/2366 symbols completed. TTI took 35.1s. Estimated remaining: 28m 30s. Rate: 7.8 symbols/min [2025-10-21T21:35:17.450620] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:35:17.456356] [DEBUG] [LOCAL ] TVC: Loaded 3148 existing records from primary storage. [2025-10-21T21:35:17.456531] [INFO ] [MAIN ] TVC: Loaded 3148 existing records. [2025-10-21T21:35:17.641668] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:35:17.642012] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-10-21T21:35:17.642095] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-10-21T21:35:17.642349] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-10-21T21:35:17.642497] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-10-21T21:35:17.758096] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-10-21T21:35:17.854342] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T21:35:18.048424] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:35:18.551037] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-10-21T21:35:18.755768] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-21T21:35:18.903386] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-21T21:35:19.351063] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-10-21T21:35:19.645977] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T21:35:20.151021] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-10-21T21:35:20.736013] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T21:35:20.908076] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T21:35:20.950995] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-10-21T21:35:21.751009] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-10-21T21:35:22.246422] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-21T21:35:22.559897] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-10-21T21:35:22.578397] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T21:35:23.112578] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-21T21:35:23.350998] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-10-21T21:35:24.151058] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-10-21T21:35:24.849658] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T21:35:24.951035] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-10-21T21:35:25.185889] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T21:35:25.750994] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-10-21T21:35:25.906315] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-21T21:35:26.551035] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-10-21T21:35:27.054775] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-21T21:35:27.351007] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-10-21T21:35:27.413747] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T21:35:28.151035] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-10-21T21:35:28.951008] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-10-21T21:35:29.050295] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T21:35:29.451285] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-21T21:35:29.636148] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T21:35:29.751022] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-10-21T21:35:30.551013] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-10. [2025-10-21T21:35:31.351001] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-10-21T21:35:31.386597] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T21:35:31.835483] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-21T21:35:32.126631] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T21:35:32.134618] [INFO ] [REMOTE ] TU: Full fetch complete (72888 records). [2025-10-21T21:35:32.134758] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-10-21T21:35:32.156108] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-10-21T21:35:32.536713] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-10-21T21:35:32.536807] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-10-21T21:35:32.538032] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-10-21T21:35:32.538116] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-10-21T21:35:32.539529] [DEBUG] [LOCAL ] TU: Trimmed 72888 records to 49803 (keeping 200 days of data) [2025-10-21T21:35:32.835110] [DEBUG] [LOCAL ] TU: Primary data saved (49803 records). [2025-10-21T21:35:32.835232] [INFO ] [MAIN ] TU: Full history saved. [2025-10-21T21:35:32.835306] [INFO ] [MAIN ] Update Progress: 2145/2366 symbols completed. TU took 35.0s. Estimated remaining: 28m 23s. Rate: 7.8 symbols/min [2025-10-21T21:35:32.956196] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-10. [2025-10-21T21:35:33.011615] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:35:33.016516] [DEBUG] [LOCAL ] TVE: Loaded 2584 existing records from primary storage. [2025-10-21T21:35:33.016708] [INFO ] [MAIN ] TVE: Loaded 2584 existing records. [2025-10-21T21:35:33.218084] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:35:33.218265] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-10-21T21:35:33.218311] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-10-21T21:35:33.218467] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-10-21T21:35:33.218521] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-10-21T21:35:33.582042] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:35:33.642231] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T21:35:33.643165] [INFO ] [REMOTE ] TVC: Full fetch complete (5065 records). [2025-10-21T21:35:33.643231] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-10-21T21:35:33.753707] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-10-21T21:35:33.838326] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T21:35:34.058814] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-10-21T21:35:34.058890] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-10-21T21:35:34.059066] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-10-21T21:35:34.059105] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-10-21T21:35:34.059455] [DEBUG] [LOCAL ] TVC: Trimmed 5065 records to 3141 (keeping 200 days of data) [2025-10-21T21:35:34.077930] [DEBUG] [LOCAL ] TVC: Primary data saved (3141 records). [2025-10-21T21:35:34.078004] [INFO ] [MAIN ] TVC: Full history saved. [2025-10-21T21:35:34.078073] [INFO ] [MAIN ] Update Progress: 2146/2366 symbols completed. TVC took 16.8s. Estimated remaining: 28m 15s. Rate: 7.8 symbols/min [2025-10-21T21:35:34.261914] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:35:34.305148] [DEBUG] [LOCAL ] TWI: Loaded 33967 existing records from primary storage. [2025-10-21T21:35:34.305549] [INFO ] [MAIN ] TWI: Loaded 33967 existing records. [2025-10-21T21:35:34.385871] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T21:35:34.517199] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:35:34.517513] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-10-21T21:35:34.517565] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-10-21T21:35:34.517882] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-10-21T21:35:34.517941] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-10-21T21:35:34.556282] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-10-21T21:35:34.919567] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:35:35.250208] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T21:35:35.351092] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-10-21T21:35:36.151029] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-10-21T21:35:36.794230] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T21:35:36.951054] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-10-21T21:35:37.511206] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T21:35:37.756104] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-10-21T21:35:37.761744] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T21:35:38.551052] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-10-21T21:35:39.247676] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T21:35:39.351041] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-10-21T21:35:39.852204] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-21T21:35:40.151060] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-10-21T21:35:40.201341] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T21:35:40.623338] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T21:35:40.951069] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-10-21T21:35:41.576375] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-21T21:35:41.751240] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-10-21T21:35:42.551034] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-10-21T21:35:43.300181] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T21:35:43.351003] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-10-21T21:35:44.048047] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T21:35:44.151043] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-10-21T21:35:44.641475] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-21T21:35:44.808580] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T21:35:44.951032] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-10. [2025-10-21T21:35:45.751019] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-10-21T21:35:46.057305] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-21T21:35:46.208773] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T21:35:46.214288] [INFO ] [REMOTE ] TV: Full fetch complete (61086 records). [2025-10-21T21:35:46.214384] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-10-21T21:35:46.559594] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-10-21T21:35:46.601958] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-10-21T21:35:46.602054] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-10-21T21:35:46.603323] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-10-21T21:35:46.603391] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-10-21T21:35:46.605084] [DEBUG] [LOCAL ] TV: Trimmed 61086 records to 41369 (keeping 200 days of data) [2025-10-21T21:35:46.838455] [DEBUG] [LOCAL ] TV: Primary data saved (41369 records). [2025-10-21T21:35:46.838580] [INFO ] [MAIN ] TV: Full history saved. [2025-10-21T21:35:46.839361] [INFO ] [MAIN ] Update Progress: 2147/2366 symbols completed. TV took 34.5s. Estimated remaining: 28m 7s. Rate: 7.8 symbols/min [2025-10-21T21:35:47.008474] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:35:47.064200] [DEBUG] [LOCAL ] TWLO: Loaded 52836 existing records from primary storage. [2025-10-21T21:35:47.064508] [INFO ] [MAIN ] TWLO: Loaded 52836 existing records. [2025-10-21T21:35:47.240415] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T21:35:47.245638] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:35:47.247433] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-10-21T21:35:47.247482] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-10-21T21:35:47.247752] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-10-21T21:35:47.247808] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-10-21T21:35:47.356201] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-10-21T21:35:47.599554] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:35:48.151058] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-10. [2025-10-21T21:35:48.498559] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T21:35:48.626544] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-21T21:35:48.627477] [INFO ] [REMOTE ] TVE: Full fetch complete (4222 records). [2025-10-21T21:35:48.627545] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-10-21T21:35:48.959683] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-10-21T21:35:48.983068] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-10-21T21:35:48.983145] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-10-21T21:35:48.983283] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-10-21T21:35:48.983321] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-10-21T21:35:48.983708] [DEBUG] [LOCAL ] TVE: Trimmed 4222 records to 2575 (keeping 200 days of data) [2025-10-21T21:35:48.999544] [DEBUG] [LOCAL ] TVE: Primary data saved (2575 records). [2025-10-21T21:35:48.999679] [INFO ] [MAIN ] TVE: Full history saved. [2025-10-21T21:35:48.999775] [INFO ] [MAIN ] Update Progress: 2148/2366 symbols completed. TVE took 16.2s. Estimated remaining: 27m 59s. Rate: 7.8 symbols/min [2025-10-21T21:35:49.169253] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:35:49.174694] [DEBUG] [LOCAL ] TWN: Loaded 3258 existing records from primary storage. [2025-10-21T21:35:49.174855] [INFO ] [MAIN ] TWN: Loaded 3258 existing records. [2025-10-21T21:35:49.353808] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:35:49.354043] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-10-21T21:35:49.354110] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-10-21T21:35:49.354272] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-10-21T21:35:49.354327] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-10-21T21:35:49.705398] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:35:49.751037] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-10-21T21:35:50.350718] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-21T21:35:50.354077] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T21:35:50.551053] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-10-21T21:35:51.351078] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-10-21T21:35:51.974356] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T21:35:52.151034] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-10-21T21:35:52.589992] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-21T21:35:52.951060] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-10-21T21:35:53.702575] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T21:35:53.750989] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-10-21T21:35:54.186259] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T21:35:54.355029] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T21:35:54.551031] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-10-21T21:35:55.351064] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-10-21T21:35:55.884759] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-21T21:35:56.150984] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-10. [2025-10-21T21:35:56.613475] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-21T21:35:56.951035] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-10-21T21:35:57.709423] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-21T21:35:57.716492] [INFO ] [REMOTE ] TUYA: Full fetch complete (66849 records). [2025-10-21T21:35:57.716613] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-10-21T21:35:57.760808] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-10-21T21:35:58.149783] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-10-21T21:35:58.149898] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-10-21T21:35:58.151421] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-10-21T21:35:58.151510] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-10-21T21:35:58.153268] [DEBUG] [LOCAL ] TUYA: Trimmed 66849 records to 45890 (keeping 200 days of data) [2025-10-21T21:35:58.409015] [DEBUG] [LOCAL ] TUYA: Primary data saved (45890 records). [2025-10-21T21:35:58.409140] [INFO ] [MAIN ] TUYA: Full history saved. [2025-10-21T21:35:58.409774] [INFO ] [MAIN ] Update Progress: 2149/2366 symbols completed. TUYA took 56.4s. Estimated remaining: 27m 52s. Rate: 7.8 symbols/min [2025-10-21T21:35:58.553289] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-10-21T21:35:58.577870] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:35:58.624917] [DEBUG] [LOCAL ] TWO: Loaded 48624 existing records from primary storage. [2025-10-21T21:35:58.625300] [INFO ] [MAIN ] TWO: Loaded 48624 existing records. [2025-10-21T21:35:58.803344] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:35:58.803826] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-10-21T21:35:58.803909] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-10-21T21:35:58.804186] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-10-21T21:35:58.804322] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-10-21T21:35:59.203867] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-21T21:35:59.201923] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:35:59.294486] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T21:35:59.315801] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T21:35:59.350981] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-10-21T21:36:00.151065] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-10-21T21:36:00.951017] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-10-21T21:36:01.307334] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T21:36:01.342558] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-21T21:36:01.468547] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-21T21:36:01.751021] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-10-21T21:36:02.551037] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-10-21T21:36:03.351014] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-10-21T21:36:03.771951] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-21T21:36:04.151047] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-10-21T21:36:04.187381] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T21:36:04.266125] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-21T21:36:04.690026] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-21T21:36:04.951020] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-10-21T21:36:05.751021] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-10-21T21:36:06.076481] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-21T21:36:06.551019] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-10. [2025-10-21T21:36:07.351014] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-10-21T21:36:07.606561] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T21:36:07.866699] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-21T21:36:07.872228] [INFO ] [REMOTE ] TWI: Full fetch complete (52121 records). [2025-10-21T21:36:07.872313] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-10-21T21:36:08.157016] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-10-21T21:36:08.250724] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-10-21T21:36:08.250815] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-10-21T21:36:08.251848] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-10-21T21:36:08.251912] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-10-21T21:36:08.253044] [DEBUG] [LOCAL ] TWI: Trimmed 52121 records to 33883 (keeping 200 days of data) [2025-10-21T21:36:08.441865] [DEBUG] [LOCAL ] TWI: Primary data saved (33883 records). [2025-10-21T21:36:08.442038] [INFO ] [MAIN ] TWI: Full history saved. [2025-10-21T21:36:08.442132] [INFO ] [MAIN ] Update Progress: 2150/2366 symbols completed. TWI took 34.4s. Estimated remaining: 27m 44s. Rate: 7.8 symbols/min [2025-10-21T21:36:08.610145] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:36:08.610315] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-10-21T21:36:08.610353] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-10-21T21:36:08.610460] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-10-21T21:36:08.610500] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-21T21:36:08.610540] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-21T21:36:08.610570] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-10-21T21:36:08.713990] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-21T21:36:08.951775] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-10-21T21:36:08.975066] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:36:09.003002] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T21:36:09.751134] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-10-21T21:36:10.551114] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-10-21T21:36:10.741953] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:36:10.742336] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-10-21T21:36:10.742428] [FATAL] [REMOTE ] TWOD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:36:10.742483] [FATAL] [MAIN ] TWOD: Failed to fetch primary data. [2025-10-21T21:36:10.742517] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:36:10.742582] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-10-21T21:36:10.742674] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-10-21T21:36:10.742734] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-10-21T21:36:10.742778] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-10-21T21:36:10.742824] [INFO ] [MAIN ] Update Progress: 2151/2366 symbols completed. TWOD took 2.3s. Estimated remaining: 27m 36s. Rate: 7.8 symbols/min [2025-10-21T21:36:10.916746] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:36:10.938900] [DEBUG] [LOCAL ] TX: Loaded 23414 existing records from primary storage. [2025-10-21T21:36:10.939124] [INFO ] [MAIN ] TX: Loaded 23414 existing records. [2025-10-21T21:36:11.109016] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-21T21:36:11.183089] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:36:11.184020] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-10-21T21:36:11.184085] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-10-21T21:36:11.184259] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-10-21T21:36:11.184297] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-10-21T21:36:11.356926] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-10-21T21:36:11.542036] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:36:11.577696] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T21:36:11.896623] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-21T21:36:12.151015] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-10-21T21:36:12.951068] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-10-21T21:36:13.393502] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-21T21:36:13.751011] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-10-21T21:36:14.522055] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T21:36:14.550986] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-10. [2025-10-21T21:36:15.136463] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T21:36:15.137851] [INFO ] [REMOTE ] TWN: Full fetch complete (5212 records). [2025-10-21T21:36:15.137919] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-10-21T21:36:15.358158] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-10-21T21:36:15.495729] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-10-21T21:36:15.495804] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-10-21T21:36:15.495953] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-10-21T21:36:15.495989] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-10-21T21:36:15.496324] [DEBUG] [LOCAL ] TWN: Trimmed 5212 records to 3232 (keeping 200 days of data) [2025-10-21T21:36:15.515133] [DEBUG] [LOCAL ] TWN: Primary data saved (3232 records). [2025-10-21T21:36:15.515255] [INFO ] [MAIN ] TWN: Full history saved. [2025-10-21T21:36:15.515383] [INFO ] [MAIN ] Update Progress: 2152/2366 symbols completed. TWN took 26.5s. Estimated remaining: 27m 28s. Rate: 7.8 symbols/min [2025-10-21T21:36:15.685328] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:36:15.723944] [DEBUG] [LOCAL ] TXNM: Loaded 43149 existing records from primary storage. [2025-10-21T21:36:15.724216] [INFO ] [MAIN ] TXNM: Loaded 43149 existing records. [2025-10-21T21:36:15.901863] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:36:15.913419] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-10-21T21:36:15.918613] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-10-21T21:36:15.933282] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-10-21T21:36:15.933363] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-10-21T21:36:16.016306] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-21T21:36:16.156116] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-10-21T21:36:16.353109] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:36:16.793223] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T21:36:16.951087] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-10-21T21:36:17.751054] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-10-21T21:36:18.048130] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-21T21:36:18.086251] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T21:36:18.551021] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-10. [2025-10-21T21:36:19.351006] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-10-21T21:36:19.771745] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T21:36:20.151111] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-10-21T21:36:20.183729] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T21:36:20.191976] [INFO ] [REMOTE ] TWLO: Full fetch complete (76634 records). [2025-10-21T21:36:20.192132] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-10-21T21:36:20.594243] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-10-21T21:36:20.594414] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-10-21T21:36:20.595609] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-10-21T21:36:20.595695] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-10-21T21:36:20.597038] [DEBUG] [LOCAL ] TWLO: Trimmed 76634 records to 52824 (keeping 200 days of data) [2025-10-21T21:36:20.738552] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T21:36:20.936215] [DEBUG] [LOCAL ] TWLO: Primary data saved (52824 records). [2025-10-21T21:36:20.936349] [INFO ] [MAIN ] TWLO: Full history saved. [2025-10-21T21:36:20.937253] [INFO ] [MAIN ] Update Progress: 2153/2366 symbols completed. TWLO took 34.1s. Estimated remaining: 27m 20s. Rate: 7.8 symbols/min [2025-10-21T21:36:20.957903] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-10-21T21:36:21.109906] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:36:21.131877] [DEBUG] [LOCAL ] TXO: Loaded 19974 existing records from primary storage. [2025-10-21T21:36:21.132115] [INFO ] [MAIN ] TXO: Loaded 19974 existing records. [2025-10-21T21:36:21.310222] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:36:21.310423] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-10-21T21:36:21.310478] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-10-21T21:36:21.310675] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-10-21T21:36:21.310731] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-10-21T21:36:21.703398] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:36:21.750982] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-10-21T21:36:22.043588] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T21:36:22.207666] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T21:36:22.551068] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-10-21T21:36:22.659534] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T21:36:23.351072] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-10-21T21:36:23.876740] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-21T21:36:24.151002] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-10-21T21:36:24.364320] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-21T21:36:24.951087] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-10-21T21:36:25.723566] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T21:36:25.750976] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-10. [2025-10-21T21:36:26.472496] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T21:36:26.551059] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-10-21T21:36:27.351072] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-10-21T21:36:27.430431] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-21T21:36:27.467990] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-21T21:36:27.476685] [INFO ] [REMOTE ] TWO: Full fetch complete (69278 records). [2025-10-21T21:36:27.477030] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-10-21T21:36:27.881167] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-10-21T21:36:27.881301] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-10-21T21:36:27.883162] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-10-21T21:36:27.883226] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-10-21T21:36:27.884904] [DEBUG] [LOCAL ] TWO: Trimmed 69278 records to 48595 (keeping 200 days of data) [2025-10-21T21:36:28.151035] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-10-21T21:36:28.205981] [DEBUG] [LOCAL ] TWO: Primary data saved (48595 records). [2025-10-21T21:36:28.206178] [INFO ] [MAIN ] TWO: Full history saved. [2025-10-21T21:36:28.207038] [INFO ] [MAIN ] Update Progress: 2154/2366 symbols completed. TWO took 29.8s. Estimated remaining: 27m 12s. Rate: 7.8 symbols/min [2025-10-21T21:36:28.381802] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:36:28.433033] [DEBUG] [LOCAL ] TXT: Loaded 49541 existing records from primary storage. [2025-10-21T21:36:28.433438] [INFO ] [MAIN ] TXT: Loaded 49541 existing records. [2025-10-21T21:36:28.615165] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:36:28.615442] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-10-21T21:36:28.615493] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-10-21T21:36:28.615913] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-10-21T21:36:28.615973] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-10-21T21:36:28.953151] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-10-21T21:36:29.009190] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T21:36:29.008439] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:36:29.101633] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T21:36:29.750999] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-10-21T21:36:29.992090] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T21:36:30.551115] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-10-21T21:36:31.225270] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T21:36:31.351038] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-10-21T21:36:32.151040] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-10-21T21:36:32.352770] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T21:36:32.454325] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T21:36:32.951037] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-10-21T21:36:33.758350] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-10-21T21:36:33.763681] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T21:36:34.228156] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T21:36:34.551066] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-10-21T21:36:35.351063] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-10-21T21:36:35.411781] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T21:36:35.979873] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T21:36:36.151035] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-10-21T21:36:36.384994] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T21:36:36.906256] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-21T21:36:36.951009] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-10-21T21:36:37.751091] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-10-21T21:36:38.210699] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T21:36:38.551053] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-10-21T21:36:39.361485] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-10-21T21:36:39.364577] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T21:36:39.822770] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T21:36:40.151008] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-10-21T21:36:40.378190] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-21T21:36:40.951070] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-10-21T21:36:41.141260] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T21:36:41.751037] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-10. [2025-10-21T21:36:42.394468] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-21T21:36:42.550992] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-10-21T21:36:42.853672] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T21:36:42.857546] [INFO ] [REMOTE ] TX: Full fetch complete (35584 records). [2025-10-21T21:36:42.857684] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-10-21T21:36:43.220738] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-10-21T21:36:43.220815] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-10-21T21:36:43.221471] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-10-21T21:36:43.221509] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-10-21T21:36:43.222260] [DEBUG] [LOCAL ] TX: Trimmed 35584 records to 23337 (keeping 200 days of data) [2025-10-21T21:36:43.351939] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-10-21T21:36:43.357942] [DEBUG] [LOCAL ] TX: Primary data saved (23337 records). [2025-10-21T21:36:43.358014] [INFO ] [MAIN ] TX: Full history saved. [2025-10-21T21:36:43.358085] [INFO ] [MAIN ] Update Progress: 2155/2366 symbols completed. TX took 32.6s. Estimated remaining: 27m 5s. Rate: 7.8 symbols/min [2025-10-21T21:36:43.524183] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:36:43.532952] [DEBUG] [LOCAL ] TY: Loaded 7553 existing records from primary storage. [2025-10-21T21:36:43.533110] [INFO ] [MAIN ] TY: Loaded 7553 existing records. [2025-10-21T21:36:43.704984] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:36:43.705196] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-10-21T21:36:43.705242] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-10-21T21:36:43.705373] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-10-21T21:36:43.705410] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-10-21T21:36:44.059627] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:36:44.150983] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-10-21T21:36:44.268504] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T21:36:44.624179] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-21T21:36:44.934337] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T21:36:44.950979] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-10. [2025-10-21T21:36:45.751023] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-10-21T21:36:46.428033] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-21T21:36:46.454561] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T21:36:46.461039] [INFO ] [REMOTE ] TXNM: Full fetch complete (62896 records). [2025-10-21T21:36:46.461150] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-10-21T21:36:46.556845] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-10-21T21:36:46.838154] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-10-21T21:36:46.838230] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-10-21T21:36:46.839318] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-10-21T21:36:46.839380] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-10-21T21:36:46.840522] [DEBUG] [LOCAL ] TXNM: Trimmed 62896 records to 42998 (keeping 200 days of data) [2025-10-21T21:36:47.095855] [DEBUG] [LOCAL ] TXNM: Primary data saved (42998 records). [2025-10-21T21:36:47.095984] [INFO ] [MAIN ] TXNM: Full history saved. [2025-10-21T21:36:47.096065] [INFO ] [MAIN ] Update Progress: 2156/2366 symbols completed. TXNM took 31.6s. Estimated remaining: 26m 57s. Rate: 7.8 symbols/min [2025-10-21T21:36:47.285485] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:36:47.302149] [DEBUG] [LOCAL ] TYG: Loaded 13996 existing records from primary storage. [2025-10-21T21:36:47.302368] [INFO ] [MAIN ] TYG: Loaded 13996 existing records. [2025-10-21T21:36:47.359313] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-10-21T21:36:47.497438] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:36:47.497967] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-10-21T21:36:47.498039] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-10-21T21:36:47.498219] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-10-21T21:36:47.498271] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-10-21T21:36:47.682353] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-21T21:36:47.885401] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:36:48.136071] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T21:36:48.150983] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-10-21T21:36:48.920588] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T21:36:48.950985] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-10-21T21:36:49.668972] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T21:36:49.750994] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-10-21T21:36:50.551033] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-10-21T21:36:51.351038] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-10. [2025-10-21T21:36:51.538895] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:36:51.666744] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T21:36:52.151001] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-10-21T21:36:52.492267] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T21:36:52.496459] [INFO ] [REMOTE ] TXO: Full fetch complete (27176 records). [2025-10-21T21:36:52.496602] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-10-21T21:36:52.884751] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-10-21T21:36:52.884837] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-10-21T21:36:52.885470] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-10-21T21:36:52.885533] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-10-21T21:36:52.886348] [DEBUG] [LOCAL ] TXO: Trimmed 27176 records to 20033 (keeping 200 days of data) [2025-10-21T21:36:52.956927] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-10-21T21:36:53.020162] [DEBUG] [LOCAL ] TXO: Primary data saved (20033 records). [2025-10-21T21:36:53.020288] [INFO ] [MAIN ] TXO: Full history saved. [2025-10-21T21:36:53.020361] [INFO ] [MAIN ] Update Progress: 2157/2366 symbols completed. TXO took 32.1s. Estimated remaining: 26m 49s. Rate: 7.8 symbols/min [2025-10-21T21:36:53.750998] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-10-21T21:36:53.820879] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-21T21:36:53.825316] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T21:36:54.342132] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T21:36:54.551084] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-10-21T21:36:55.351075] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-10-21T21:36:56.150997] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-10-21T21:36:56.248075] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-21T21:36:56.298993] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-21T21:36:56.577756] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-21T21:36:56.951040] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-10-21T21:36:57.751033] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-10-21T21:36:57.924639] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T21:36:58.509339] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T21:36:58.550991] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-10-21T21:36:59.055805] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-21T21:36:59.351043] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-10-21T21:37:00.151107] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-10-21T21:37:00.275568] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-21T21:37:00.951076] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-10-21T21:37:01.751020] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-10. [2025-10-21T21:37:01.837829] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T21:37:01.922707] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T21:37:02.392175] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T21:37:02.394262] [INFO ] [REMOTE ] TY: Full fetch complete (11335 records). [2025-10-21T21:37:02.394423] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-10-21T21:37:02.564808] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-10-21T21:37:02.843065] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-10-21T21:37:02.843149] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-10-21T21:37:02.843461] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-10-21T21:37:02.843501] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-10-21T21:37:02.844041] [DEBUG] [LOCAL ] TY: Trimmed 11335 records to 7550 (keeping 200 days of data) [2025-10-21T21:37:02.891771] [DEBUG] [LOCAL ] TY: Primary data saved (7550 records). [2025-10-21T21:37:02.891914] [INFO ] [MAIN ] TY: Full history saved. [2025-10-21T21:37:02.891995] [INFO ] [MAIN ] Update Progress: 2158/2366 symbols completed. TY took 19.5s. Estimated remaining: 26m 42s. Rate: 7.8 symbols/min [2025-10-21T21:37:03.351398] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-10-21T21:37:03.758632] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-21T21:37:04.151082] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-10-21T21:37:05.048009] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T21:37:05.058612] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-10-21T21:37:05.105230] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-21T21:37:05.750993] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-10-21T21:37:05.857561] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T21:37:06.551092] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-10. [2025-10-21T21:37:06.594945] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-21T21:37:07.351025] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-10. [2025-10-21T21:37:08.146991] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T21:37:08.154884] [INFO ] [REMOTE ] TXT: Full fetch complete (72397 records). [2025-10-21T21:37:08.155040] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-10-21T21:37:08.270792] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T21:37:08.294417] [INFO ] [REMOTE ] TYG: Full fetch complete (22176 records). [2025-10-21T21:37:08.313001] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-10-21T21:37:08.867675] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-10-21T21:37:08.873534] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-10-21T21:37:08.874875] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-10-21T21:37:08.874963] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-10-21T21:37:08.953851] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-10-21T21:37:08.953637] [DEBUG] [LOCAL ] TXT: Trimmed 72397 records to 49516 (keeping 200 days of data) [2025-10-21T21:37:08.954226] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-10-21T21:37:08.954472] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-10-21T21:37:08.954542] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-10-21T21:37:08.955453] [DEBUG] [LOCAL ] TYG: Trimmed 22176 records to 13977 (keeping 200 days of data) [2025-10-21T21:37:09.141915] [DEBUG] [LOCAL ] TYG: Primary data saved (13977 records). [2025-10-21T21:37:09.153131] [INFO ] [MAIN ] TYG: Full history saved. [2025-10-21T21:37:09.156011] [INFO ] [MAIN ] Update Progress: 2159/2366 symbols completed. TYG took 22.1s. Estimated remaining: 26m 34s. Rate: 7.8 symbols/min [2025-10-21T21:37:09.342370] [DEBUG] [LOCAL ] TXT: Primary data saved (49516 records). [2025-10-21T21:37:09.342502] [INFO ] [MAIN ] TXT: Full history saved. [2025-10-21T21:37:09.343073] [INFO ] [MAIN ] Update Progress: 2160/2366 symbols completed. TXT took 41.1s. Estimated remaining: 26m 26s. Rate: 7.8 symbols/min [2025-10-21T21:37:09.953362] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:10.002164] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:10.008206] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:10.052396] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:10.073800] [DEBUG] [LOCAL ] TYL: Loaded 22229 existing records from primary storage. [2025-10-21T21:37:10.074118] [INFO ] [MAIN ] TYL: Loaded 22229 existing records. [2025-10-21T21:37:10.328117] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:10.331144] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-10-21T21:37:10.330909] [DEBUG] [LOCAL ] UA: Loaded 50486 existing records from primary storage. [2025-10-21T21:37:10.331813] [INFO ] [MAIN ] UA: Loaded 50486 existing records. [2025-10-21T21:37:10.332455] [DEBUG] [LOCAL ] UAA: Loaded 53499 existing records from primary storage. [2025-10-21T21:37:10.331628] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-10-21T21:37:10.338219] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-10-21T21:37:10.332769] [INFO ] [MAIN ] UAA: Loaded 53499 existing records. [2025-10-21T21:37:10.344685] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-10-21T21:37:10.619066] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-21T21:37:10.672669] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-10-21T21:37:10.931619] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:11.008318] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:11.029085] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-10-21T21:37:11.061107] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-10-21T21:37:11.071760] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-10-21T21:37:11.066473] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-10-21T21:37:11.121138] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-10-21T21:37:11.121082] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-10-21T21:37:11.131725] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-10-21T21:37:11.131580] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-10-21T21:37:11.283201] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:11.343318] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-10-21T21:37:11.444674] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-10-21T21:37:11.484358] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-10-21T21:37:11.498252] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-10-21T21:37:11.535669] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:11.551591] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-10-21T21:37:12.334087] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:12.398076] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-10-21T21:37:12.397390] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:12.406629] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-10-21T21:37:12.428584] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:12.429192] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-10-21T21:37:12.776057] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T21:37:12.780468] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-10-21T21:37:13.851434] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T21:37:13.861713] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-10-21T21:37:13.888916] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-21T21:37:13.893301] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-10-21T21:37:14.074015] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-21T21:37:14.084406] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-10-21T21:37:14.497711] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T21:37:14.550989] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-10-21T21:37:15.066694] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-21T21:37:15.351056] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-10-21T21:37:15.601815] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T21:37:15.964453] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-21T21:37:16.151047] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-10-21T21:37:16.714729] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T21:37:16.748704] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-21T21:37:16.951058] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-10-21T21:37:17.750999] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-10-21T21:37:17.898978] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T21:37:17.950792] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T21:37:18.551062] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-10-21T21:37:19.351000] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-10-21T21:37:19.553820] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T21:37:19.604847] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T21:37:20.151035] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-10-21T21:37:20.951087] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-10-21T21:37:21.033005] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-21T21:37:21.640461] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-21T21:37:21.751001] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-10-21T21:37:22.556103] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-10-21T21:37:22.578077] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-21T21:37:22.923686] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-21T21:37:23.351030] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-10-21T21:37:24.151034] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-10-21T21:37:24.728301] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T21:37:24.858957] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-21T21:37:24.912595] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T21:37:24.951051] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-10-21T21:37:25.751041] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-10-21T21:37:26.554571] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-10. [2025-10-21T21:37:26.560150] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T21:37:27.351052] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-10-21T21:37:27.553581] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T21:37:27.579676] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T21:37:27.583185] [INFO ] [REMOTE ] TYL: Full fetch complete (31641 records). [2025-10-21T21:37:27.583259] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-10-21T21:37:27.943364] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-10-21T21:37:27.943435] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-10-21T21:37:27.943987] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-10-21T21:37:27.944046] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-10-21T21:37:27.944738] [DEBUG] [LOCAL ] TYL: Trimmed 31641 records to 22129 (keeping 200 days of data) [2025-10-21T21:37:28.074793] [DEBUG] [LOCAL ] TYL: Primary data saved (22129 records). [2025-10-21T21:37:28.074911] [INFO ] [MAIN ] TYL: Full history saved. [2025-10-21T21:37:28.074984] [INFO ] [MAIN ] Update Progress: 2161/2366 symbols completed. TYL took 18.7s. Estimated remaining: 26m 19s. Rate: 7.8 symbols/min [2025-10-21T21:37:28.156223] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-10-21T21:37:28.248896] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:28.256507] [DEBUG] [LOCAL ] UAN: Loaded 5412 existing records from primary storage. [2025-10-21T21:37:28.256719] [INFO ] [MAIN ] UAN: Loaded 5412 existing records. [2025-10-21T21:37:28.430942] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:28.431129] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-10-21T21:37:28.431173] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-10-21T21:37:28.431368] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-10-21T21:37:28.431425] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-10-21T21:37:28.787120] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:28.949399] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T21:37:28.958315] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-10-21T21:37:29.659342] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T21:37:29.750996] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-10-21T21:37:30.551063] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-10-21T21:37:31.129467] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-21T21:37:31.252942] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-21T21:37:31.351032] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-10-21T21:37:31.523450] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T21:37:32.151067] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-10-21T21:37:32.951000] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-10-21T21:37:32.991366] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T21:37:33.434157] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-21T21:37:33.751057] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-10-21T21:37:34.331560] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-21T21:37:34.360424] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T21:37:34.551086] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-10-21T21:37:35.351095] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-10-21T21:37:36.151008] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-10-21T21:37:36.435283] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-21T21:37:36.894056] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-21T21:37:36.950979] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-10-21T21:37:37.236189] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T21:37:37.751001] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-10-21T21:37:38.551062] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-10-21T21:37:38.940614] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-21T21:37:39.292472] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-21T21:37:39.350995] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-10. [2025-10-21T21:37:39.631789] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-21T21:37:40.151186] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-10-21T21:37:40.951068] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-10-21T21:37:41.093956] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T21:37:41.102261] [INFO ] [REMOTE ] UAA: Full fetch complete (77642 records). [2025-10-21T21:37:41.102396] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-10-21T21:37:41.517742] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-10-21T21:37:41.517842] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-10-21T21:37:41.519085] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-10-21T21:37:41.519152] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-10-21T21:37:41.520694] [DEBUG] [LOCAL ] UAA: Trimmed 77642 records to 53498 (keeping 200 days of data) [2025-10-21T21:37:41.696477] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T21:37:41.751060] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-10. [2025-10-21T21:37:41.846612] [DEBUG] [LOCAL ] UAA: Primary data saved (53498 records). [2025-10-21T21:37:41.846764] [INFO ] [MAIN ] UAA: Full history saved. [2025-10-21T21:37:41.847415] [INFO ] [MAIN ] Update Progress: 2162/2366 symbols completed. UAA took 32.5s. Estimated remaining: 26m 12s. Rate: 7.8 symbols/min [2025-10-21T21:37:42.012900] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:42.066025] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-21T21:37:42.066361] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-10-21T21:37:42.244718] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:42.244917] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-10-21T21:37:42.244963] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-10-21T21:37:42.245171] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-10-21T21:37:42.245226] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-10-21T21:37:42.553077] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-10-21T21:37:42.607306] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:42.642817] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-21T21:37:43.141933] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T21:37:43.351046] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-10-21T21:37:43.539334] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T21:37:43.547257] [INFO ] [REMOTE ] UA: Full fetch complete (73199 records). [2025-10-21T21:37:43.547367] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-10-21T21:37:43.932898] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-10-21T21:37:43.932979] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-10-21T21:37:43.934155] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-10-21T21:37:43.934218] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-10-21T21:37:43.935583] [DEBUG] [LOCAL ] UA: Trimmed 73199 records to 50476 (keeping 200 days of data) [2025-10-21T21:37:44.151293] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-10-21T21:37:44.214915] [DEBUG] [LOCAL ] UA: Primary data saved (50476 records). [2025-10-21T21:37:44.215026] [INFO ] [MAIN ] UA: Full history saved. [2025-10-21T21:37:44.215100] [INFO ] [MAIN ] Update Progress: 2163/2366 symbols completed. UA took 34.9s. Estimated remaining: 26m 4s. Rate: 7.8 symbols/min [2025-10-21T21:37:44.385538] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:44.433088] [DEBUG] [LOCAL ] UBS: Loaded 52297 existing records from primary storage. [2025-10-21T21:37:44.433395] [INFO ] [MAIN ] UBS: Loaded 52297 existing records. [2025-10-21T21:37:44.608311] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:44.608483] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-10-21T21:37:44.608545] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-10-21T21:37:44.608769] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-10-21T21:37:44.608824] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-10-21T21:37:44.885806] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T21:37:44.953012] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-10-21T21:37:44.966124] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:45.492168] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-21T21:37:45.496793] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-21T21:37:45.751034] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-10-21T21:37:46.551033] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-10-21T21:37:47.351033] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-10. [2025-10-21T21:37:48.008805] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-21T21:37:48.009997] [INFO ] [REMOTE ] UAN: Full fetch complete (7900 records). [2025-10-21T21:37:48.010100] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-10-21T21:37:48.162871] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-10-21T21:37:48.378589] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-21T21:37:48.424856] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-10-21T21:37:48.424930] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-10-21T21:37:48.425148] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-10-21T21:37:48.425188] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-10-21T21:37:48.425593] [DEBUG] [LOCAL ] UAN: Trimmed 7900 records to 5407 (keeping 200 days of data) [2025-10-21T21:37:48.458060] [DEBUG] [LOCAL ] UAN: Primary data saved (5407 records). [2025-10-21T21:37:48.458167] [INFO ] [MAIN ] UAN: Full history saved. [2025-10-21T21:37:48.458247] [INFO ] [MAIN ] Update Progress: 2164/2366 symbols completed. UAN took 20.4s. Estimated remaining: 25m 56s. Rate: 7.8 symbols/min [2025-10-21T21:37:48.631956] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:48.668674] [DEBUG] [LOCAL ] UCB: Loaded 37801 existing records from primary storage. [2025-10-21T21:37:48.668950] [INFO ] [MAIN ] UCB: Loaded 37801 existing records. [2025-10-21T21:37:48.853311] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:48.853712] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-10-21T21:37:48.853813] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-10-21T21:37:48.854283] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-10-21T21:37:48.854351] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-10-21T21:37:48.956247] [INFO ] [REMOTE ] U: Fetching primary data for 2025-10. [2025-10-21T21:37:49.178103] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-10-21T21:37:49.262476] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:49.751002] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-10-21T21:37:50.010172] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-21T21:37:50.551031] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-10-21T21:37:51.256403] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T21:37:51.323618] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-21T21:37:51.332245] [INFO ] [REMOTE ] U: Full fetch complete (77975 records). [2025-10-21T21:37:51.332401] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-10-21T21:37:51.356165] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-10-21T21:37:51.735350] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-10-21T21:37:51.735432] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-10-21T21:37:51.736801] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-10-21T21:37:51.736870] [DEBUG] [LOCAL ] U: Saving primary data. [2025-10-21T21:37:51.738306] [DEBUG] [LOCAL ] U: Trimmed 77975 records to 53799 (keeping 200 days of data) [2025-10-21T21:37:52.058817] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-10-21T21:37:52.058967] [INFO ] [MAIN ] U: Full history saved. [2025-10-21T21:37:52.059603] [INFO ] [MAIN ] Update Progress: 2165/2366 symbols completed. U took 42.7s. Estimated remaining: 25m 47s. Rate: 7.8 symbols/min [2025-10-21T21:37:52.158842] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-10-21T21:37:52.235174] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:37:52.265938] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T21:37:52.320141] [DEBUG] [LOCAL ] UDR: Loaded 52109 existing records from primary storage. [2025-10-21T21:37:52.320484] [INFO ] [MAIN ] UDR: Loaded 52109 existing records. [2025-10-21T21:37:52.513710] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:37:52.513971] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-10-21T21:37:52.514031] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-10-21T21:37:52.514220] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-10-21T21:37:52.514286] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-10-21T21:37:52.874069] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:37:52.950986] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-10-21T21:37:53.502720] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T21:37:53.751000] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-10-21T21:37:53.807767] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-21T21:37:54.551016] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-10-21T21:37:54.605544] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T21:37:55.351055] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-10-21T21:37:55.713953] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-21T21:37:56.151075] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-10-21T21:37:56.848711] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T21:37:56.950982] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-10-21T21:37:57.015802] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-21T21:37:57.751048] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-10-21T21:37:58.017369] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-21T21:37:58.120025] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T21:37:58.551080] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-10-21T21:37:59.070741] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T21:37:59.351088] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-10-21T21:38:00.148405] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T21:38:00.158521] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-10-21T21:38:00.951085] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-10-21T21:38:01.550630] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T21:38:01.751015] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-10-21T21:38:01.950761] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-21T21:38:02.550999] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-10-21T21:38:02.737703] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T21:38:03.140420] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T21:38:03.351018] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-10-21T21:38:04.151025] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-10-21T21:38:04.351941] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T21:38:04.951213] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-10-21T21:38:04.955602] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T21:38:05.751023] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-10-21T21:38:06.551119] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-10-21T21:38:06.750031] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-21T21:38:06.792188] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T21:38:06.834112] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-21T21:38:07.351046] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-10-21T21:38:08.151080] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-10-21T21:38:08.385711] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T21:38:08.951076] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-10-21T21:38:09.755679] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-10-21T21:38:09.760550] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-21T21:38:09.810595] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-21T21:38:10.551012] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-10-21T21:38:10.680801] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-21T21:38:11.093829] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T21:38:11.351104] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-10-21T21:38:12.151098] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-10. [2025-10-21T21:38:12.951090] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-10-21T21:38:13.014807] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T21:38:13.133097] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-21T21:38:13.552098] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T21:38:13.558335] [INFO ] [REMOTE ] UCB: Full fetch complete (54942 records). [2025-10-21T21:38:13.558460] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-10-21T21:38:13.756201] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-10-21T21:38:13.947266] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-10-21T21:38:13.947337] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-10-21T21:38:13.948475] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-10-21T21:38:13.948538] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-10-21T21:38:13.949618] [DEBUG] [LOCAL ] UCB: Trimmed 54942 records to 37764 (keeping 200 days of data) [2025-10-21T21:38:14.179097] [DEBUG] [LOCAL ] UCB: Primary data saved (37764 records). [2025-10-21T21:38:14.179274] [INFO ] [MAIN ] UCB: Full history saved. [2025-10-21T21:38:14.179370] [INFO ] [MAIN ] Update Progress: 2166/2366 symbols completed. UCB took 25.7s. Estimated remaining: 25m 41s. Rate: 7.8 symbols/min [2025-10-21T21:38:14.351830] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:38:14.393111] [DEBUG] [LOCAL ] UE: Loaded 42603 existing records from primary storage. [2025-10-21T21:38:14.393427] [INFO ] [MAIN ] UE: Loaded 42603 existing records. [2025-10-21T21:38:14.556582] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-10-21T21:38:14.579753] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:38:14.580229] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-10-21T21:38:14.580472] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-10-21T21:38:14.580747] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-10-21T21:38:14.580806] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-10-21T21:38:14.963058] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:38:14.992088] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-21T21:38:15.351051] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-10-21T21:38:16.151001] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-10. [2025-10-21T21:38:16.293678] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-10-21T21:38:16.490348] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-21T21:38:16.552929] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T21:38:16.951000] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-10-21T21:38:17.718030] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T21:38:17.726280] [INFO ] [REMOTE ] UBS: Full fetch complete (75966 records). [2025-10-21T21:38:17.726395] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-10-21T21:38:17.758985] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-10-21T21:38:18.125808] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-10-21T21:38:18.125936] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-10-21T21:38:18.127135] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-10-21T21:38:18.127238] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-10-21T21:38:18.148907] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T21:38:18.148036] [DEBUG] [LOCAL ] UBS: Trimmed 75966 records to 52290 (keeping 200 days of data) [2025-10-21T21:38:18.460687] [DEBUG] [LOCAL ] UBS: Primary data saved (52290 records). [2025-10-21T21:38:18.460829] [INFO ] [MAIN ] UBS: Full history saved. [2025-10-21T21:38:18.460935] [INFO ] [MAIN ] Update Progress: 2167/2366 symbols completed. UBS took 34.2s. Estimated remaining: 25m 33s. Rate: 7.8 symbols/min [2025-10-21T21:38:18.558251] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-10-21T21:38:18.630538] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:38:18.640246] [DEBUG] [LOCAL ] UFI: Loaded 8161 existing records from primary storage. [2025-10-21T21:38:18.640451] [INFO ] [MAIN ] UFI: Loaded 8161 existing records. [2025-10-21T21:38:18.815756] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:38:18.815988] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-10-21T21:38:18.816037] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-10-21T21:38:18.816201] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-10-21T21:38:18.816259] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-10-21T21:38:19.170117] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:38:19.351020] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-10-21T21:38:20.067520] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T21:38:20.151041] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-10-21T21:38:20.209056] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-21T21:38:20.278493] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T21:38:20.664578] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-21T21:38:20.951079] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-10. [2025-10-21T21:38:21.660106] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T21:38:21.668552] [INFO ] [REMOTE ] UBER: Full fetch complete (77986 records). [2025-10-21T21:38:21.668765] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-10-21T21:38:21.756172] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-10-21T21:38:22.062499] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-10-21T21:38:22.062581] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-10-21T21:38:22.063792] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-10-21T21:38:22.063853] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-10-21T21:38:22.065235] [DEBUG] [LOCAL ] UBER: Trimmed 77986 records to 53806 (keeping 200 days of data) [2025-10-21T21:38:22.414262] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-10-21T21:38:22.414907] [INFO ] [MAIN ] UBER: Full history saved. [2025-10-21T21:38:22.415867] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-21T21:38:22.416593] [INFO ] [MAIN ] Update Progress: 2168/2366 symbols completed. UBER took 40.6s. Estimated remaining: 25m 25s. Rate: 7.8 symbols/min [2025-10-21T21:38:22.556079] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-10. [2025-10-21T21:38:22.601403] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:38:22.649870] [DEBUG] [LOCAL ] UGI: Loaded 50511 existing records from primary storage. [2025-10-21T21:38:22.650156] [INFO ] [MAIN ] UGI: Loaded 50511 existing records. [2025-10-21T21:38:22.826724] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:38:22.826906] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-10-21T21:38:22.826963] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-10-21T21:38:22.827159] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-10-21T21:38:22.827198] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-10-21T21:38:23.184447] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:38:23.351030] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-10-21T21:38:24.151066] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-10-21T21:38:24.308525] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T21:38:24.316807] [INFO ] [REMOTE ] UDR: Full fetch complete (75106 records). [2025-10-21T21:38:24.316955] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-10-21T21:38:24.703610] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-10-21T21:38:24.703726] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-10-21T21:38:24.704917] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-10-21T21:38:24.704979] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-10-21T21:38:24.706301] [DEBUG] [LOCAL ] UDR: Trimmed 75106 records to 52107 (keeping 200 days of data) [2025-10-21T21:38:24.921685] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-21T21:38:24.951005] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-10-21T21:38:25.036027] [DEBUG] [LOCAL ] UDR: Primary data saved (52107 records). [2025-10-21T21:38:25.036238] [INFO ] [MAIN ] UDR: Full history saved. [2025-10-21T21:38:25.036722] [INFO ] [MAIN ] Update Progress: 2169/2366 symbols completed. UDR took 33.0s. Estimated remaining: 25m 17s. Rate: 7.8 symbols/min [2025-10-21T21:38:25.230996] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T21:38:25.272231] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:38:25.311800] [DEBUG] [LOCAL ] UGP: Loaded 42987 existing records from primary storage. [2025-10-21T21:38:25.312080] [INFO ] [MAIN ] UGP: Loaded 42987 existing records. [2025-10-21T21:38:25.483966] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:38:25.484136] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-10-21T21:38:25.484182] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-10-21T21:38:25.484352] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-10-21T21:38:25.484389] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-10-21T21:38:25.757419] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-10-21T21:38:25.835108] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:38:25.904230] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T21:38:26.551099] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-10-21T21:38:27.351018] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-10-21T21:38:27.492896] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T21:38:28.068766] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:38:28.150994] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-10-21T21:38:28.815165] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-21T21:38:28.951009] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-10-21T21:38:29.675490] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T21:38:29.751013] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-10-21T21:38:30.551006] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-10-21T21:38:30.681587] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T21:38:30.681993] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T21:38:31.351084] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-10-21T21:38:32.151018] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-10-21T21:38:32.210341] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T21:38:32.904685] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T21:38:32.951049] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-10-21T21:38:33.659782] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T21:38:33.750996] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-10-21T21:38:33.970418] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T21:38:34.551034] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-10-21T21:38:35.179964] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T21:38:35.351037] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-10-21T21:38:35.962603] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-21T21:38:36.148972] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T21:38:36.157529] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-10-21T21:38:36.932803] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-21T21:38:36.950980] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-10-21T21:38:37.723408] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T21:38:37.751045] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-10-21T21:38:38.551021] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-10-21T21:38:39.242810] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T21:38:39.351004] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-10-21T21:38:39.829843] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T21:38:40.151036] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-10-21T21:38:40.893470] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T21:38:40.950986] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-10-21T21:38:41.449088] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T21:38:41.751056] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-10-21T21:38:42.456200] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T21:38:42.550984] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-10-21T21:38:43.326481] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-21T21:38:43.350990] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-10-21T21:38:43.951383] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T21:38:44.151002] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-10. [2025-10-21T21:38:44.931597] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T21:38:44.951018] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-10-21T21:38:45.533301] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T21:38:45.542615] [INFO ] [REMOTE ] UE: Full fetch complete (61115 records). [2025-10-21T21:38:45.542776] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-10-21T21:38:45.758376] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-10. [2025-10-21T21:38:45.931305] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-10-21T21:38:45.931382] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-10-21T21:38:45.932451] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-10-21T21:38:45.932514] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-10-21T21:38:45.933698] [DEBUG] [LOCAL ] UE: Trimmed 61115 records to 42559 (keeping 200 days of data) [2025-10-21T21:38:46.200908] [DEBUG] [LOCAL ] UE: Primary data saved (42559 records). [2025-10-21T21:38:46.201033] [INFO ] [MAIN ] UE: Full history saved. [2025-10-21T21:38:46.202237] [INFO ] [MAIN ] Update Progress: 2170/2366 symbols completed. UE took 32.0s. Estimated remaining: 25m 10s. Rate: 7.8 symbols/min [2025-10-21T21:38:46.374223] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:38:46.393574] [DEBUG] [LOCAL ] UHAL: Loaded 16899 existing records from primary storage. [2025-10-21T21:38:46.393848] [INFO ] [MAIN ] UHAL: Loaded 16899 existing records. [2025-10-21T21:38:46.553800] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-10-21T21:38:46.578608] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:38:46.579288] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-10-21T21:38:46.579414] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-10-21T21:38:46.579603] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-10-21T21:38:46.579685] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-10-21T21:38:46.668047] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-21T21:38:46.692863] [INFO ] [REMOTE ] UFI: Full fetch complete (12409 records). [2025-10-21T21:38:46.693219] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-10-21T21:38:46.865496] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T21:38:47.307217] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:38:47.354685] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-10. [2025-10-21T21:38:47.395815] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-10-21T21:38:47.395937] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-10-21T21:38:47.396251] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-10-21T21:38:47.396294] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-10-21T21:38:47.396792] [DEBUG] [LOCAL ] UFI: Trimmed 12409 records to 8223 (keeping 200 days of data) [2025-10-21T21:38:47.441294] [DEBUG] [LOCAL ] UFI: Primary data saved (8223 records). [2025-10-21T21:38:47.441404] [INFO ] [MAIN ] UFI: Full history saved. [2025-10-21T21:38:47.441480] [INFO ] [MAIN ] Update Progress: 2171/2366 symbols completed. UFI took 29.0s. Estimated remaining: 25m 2s. Rate: 7.8 symbols/min [2025-10-21T21:38:47.611844] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:38:47.651963] [DEBUG] [LOCAL ] UHS: Loaded 39895 existing records from primary storage. [2025-10-21T21:38:47.652260] [INFO ] [MAIN ] UHS: Loaded 39895 existing records. [2025-10-21T21:38:47.834753] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:38:47.834955] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-10-21T21:38:47.835008] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-10-21T21:38:47.835180] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-10-21T21:38:47.835219] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-10-21T21:38:48.162680] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-10-21T21:38:48.206523] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:38:48.357468] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T21:38:48.932749] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T21:38:48.939720] [INFO ] [REMOTE ] UGP: Full fetch complete (62184 records). [2025-10-21T21:38:48.939822] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-10-21T21:38:48.961058] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-10-21T21:38:49.246805] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T21:38:49.338424] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-10-21T21:38:49.338500] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-10-21T21:38:49.339567] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-10-21T21:38:49.339680] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-10-21T21:38:49.340839] [DEBUG] [LOCAL ] UGP: Trimmed 62184 records to 42954 (keeping 200 days of data) [2025-10-21T21:38:49.582717] [DEBUG] [LOCAL ] UGP: Primary data saved (42954 records). [2025-10-21T21:38:49.582833] [INFO ] [MAIN ] UGP: Full history saved. [2025-10-21T21:38:49.583402] [INFO ] [MAIN ] Update Progress: 2172/2366 symbols completed. UGP took 24.5s. Estimated remaining: 24m 54s. Rate: 7.8 symbols/min [2025-10-21T21:38:49.749134] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:38:49.751009] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-10-21T21:38:49.761593] [DEBUG] [LOCAL ] UHT: Loaded 10229 existing records from primary storage. [2025-10-21T21:38:49.761814] [INFO ] [MAIN ] UHT: Loaded 10229 existing records. [2025-10-21T21:38:49.937446] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:38:49.937684] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-10-21T21:38:49.937748] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-10-21T21:38:49.937892] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-10-21T21:38:49.937929] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-10-21T21:38:50.297298] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:38:50.436549] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-21T21:38:50.550981] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-10-21T21:38:51.351047] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-10-21T21:38:51.549964] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T21:38:52.111909] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T21:38:52.127171] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-21T21:38:52.151007] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-10-21T21:38:52.880948] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-21T21:38:52.951000] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-10-21T21:38:53.735377] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T21:38:53.750975] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-10-21T21:38:54.551075] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-10-21T21:38:54.662087] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T21:38:55.180192] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-21T21:38:55.350996] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-10-21T21:38:56.151002] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-10-21T21:38:56.911287] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T21:38:56.950977] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-10-21T21:38:57.751034] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-10-21T21:38:57.900300] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T21:38:58.551111] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-10-21T21:38:58.696228] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T21:38:58.705980] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-21T21:38:59.351021] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-10-21T21:39:00.156147] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-10-21T21:39:00.179438] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T21:39:00.179659] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T21:39:00.951040] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-10-21T21:39:01.749754] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-21T21:39:01.752373] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-10-21T21:39:01.777046] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T21:39:02.551069] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-10-21T21:39:02.761202] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-21T21:39:03.351081] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-10-21T21:39:04.150997] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-10-21T21:39:04.229971] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T21:39:04.355088] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T21:39:04.663262] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-21T21:39:04.951021] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-10-21T21:39:05.751103] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-10-21T21:39:05.776508] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T21:39:06.551051] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-10. [2025-10-21T21:39:07.351029] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-10-21T21:39:07.410311] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T21:39:08.151014] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-10-21T21:39:08.173752] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T21:39:08.200552] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T21:39:08.208529] [INFO ] [REMOTE ] UGI: Full fetch complete (73485 records). [2025-10-21T21:39:08.208716] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-10-21T21:39:08.597211] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-10-21T21:39:08.597291] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-10-21T21:39:08.598497] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-10-21T21:39:08.598562] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-10-21T21:39:08.600031] [DEBUG] [LOCAL ] UGI: Trimmed 73485 records to 50513 (keeping 200 days of data) [2025-10-21T21:39:08.907415] [DEBUG] [LOCAL ] UGI: Primary data saved (50513 records). [2025-10-21T21:39:08.907545] [INFO ] [MAIN ] UGI: Full history saved. [2025-10-21T21:39:08.908204] [INFO ] [MAIN ] Update Progress: 2173/2366 symbols completed. UGI took 46.5s. Estimated remaining: 24m 47s. Rate: 7.8 symbols/min [2025-10-21T21:39:08.951489] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-10. [2025-10-21T21:39:09.080519] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:39:09.097517] [DEBUG] [LOCAL ] UI: Loaded 14122 existing records from primary storage. [2025-10-21T21:39:09.097814] [INFO ] [MAIN ] UI: Loaded 14122 existing records. [2025-10-21T21:39:09.209390] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T21:39:09.289362] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:39:09.289523] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-10-21T21:39:09.289570] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-10-21T21:39:09.289766] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-10-21T21:39:09.289822] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-10-21T21:39:09.634036] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:39:09.750980] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-10-21T21:39:09.847432] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T21:39:09.849976] [INFO ] [REMOTE ] UHT: Full fetch complete (15090 records). [2025-10-21T21:39:09.850044] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-10-21T21:39:10.222226] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-10-21T21:39:10.222300] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-10-21T21:39:10.222688] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-10-21T21:39:10.222749] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-10-21T21:39:10.223233] [DEBUG] [LOCAL ] UHT: Trimmed 15090 records to 10251 (keeping 200 days of data) [2025-10-21T21:39:10.286053] [DEBUG] [LOCAL ] UHT: Primary data saved (10251 records). [2025-10-21T21:39:10.286170] [INFO ] [MAIN ] UHT: Full history saved. [2025-10-21T21:39:10.286243] [INFO ] [MAIN ] Update Progress: 2174/2366 symbols completed. UHT took 20.7s. Estimated remaining: 24m 39s. Rate: 7.8 symbols/min [2025-10-21T21:39:10.460353] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:39:10.494735] [DEBUG] [LOCAL ] UIS: Loaded 36775 existing records from primary storage. [2025-10-21T21:39:10.495087] [INFO ] [MAIN ] UIS: Loaded 36775 existing records. [2025-10-21T21:39:10.556314] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-10-21T21:39:10.646936] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T21:39:10.708323] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:39:10.708564] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-10-21T21:39:10.708613] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-10-21T21:39:10.708846] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-10-21T21:39:10.708903] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-10-21T21:39:11.075410] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:39:11.350991] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-10-21T21:39:12.151092] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-10-21T21:39:12.186397] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T21:39:12.250416] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T21:39:12.951070] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-10-21T21:39:13.268320] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-21T21:39:13.751055] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-10-21T21:39:14.321168] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T21:39:14.551012] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-10-21T21:39:14.742404] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T21:39:15.351022] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-10-21T21:39:15.494325] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-21T21:39:16.094308] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T21:39:16.151005] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-10. [2025-10-21T21:39:16.951043] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-10-21T21:39:17.532699] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T21:39:17.538278] [INFO ] [REMOTE ] UHS: Full fetch complete (58198 records). [2025-10-21T21:39:17.538392] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-10-21T21:39:17.758573] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-10-21T21:39:17.924586] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-10-21T21:39:17.924983] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-10-21T21:39:17.926235] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-10-21T21:39:17.926312] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-10-21T21:39:17.927676] [DEBUG] [LOCAL ] UHS: Trimmed 58198 records to 39747 (keeping 200 days of data) [2025-10-21T21:39:18.186517] [DEBUG] [LOCAL ] UHS: Primary data saved (39747 records). [2025-10-21T21:39:18.186713] [INFO ] [MAIN ] UHS: Full history saved. [2025-10-21T21:39:18.186835] [INFO ] [MAIN ] Update Progress: 2175/2366 symbols completed. UHS took 30.7s. Estimated remaining: 24m 31s. Rate: 7.8 symbols/min [2025-10-21T21:39:18.419202] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T21:39:18.420929] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:39:18.485168] [DEBUG] [LOCAL ] UL: Loaded 53076 existing records from primary storage. [2025-10-21T21:39:18.485554] [INFO ] [MAIN ] UL: Loaded 53076 existing records. [2025-10-21T21:39:18.556343] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-10-21T21:39:18.691259] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:39:18.691664] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-10-21T21:39:18.691731] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-10-21T21:39:18.692237] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-10-21T21:39:18.692297] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-10-21T21:39:18.891246] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T21:39:19.085217] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:39:19.351070] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-10-21T21:39:20.005321] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T21:39:20.021548] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-21T21:39:20.150980] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-10-21T21:39:20.951055] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-10-21T21:39:21.023780] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-21T21:39:21.751064] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-10-21T21:39:22.334786] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T21:39:22.551018] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-10-21T21:39:22.795013] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-21T21:39:23.356986] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-10-21T21:39:23.358738] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T21:39:24.151058] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-10-21T21:39:24.951034] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-10-21T21:39:25.228401] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T21:39:25.670450] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-21T21:39:25.750979] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-10-21T21:39:25.823911] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T21:39:26.551075] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-10-21T21:39:27.236687] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T21:39:27.351042] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-10-21T21:39:28.151003] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-10-21T21:39:28.335129] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T21:39:28.696883] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T21:39:28.951021] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-10-21T21:39:29.164359] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T21:39:29.751038] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-10-21T21:39:30.551036] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-10-21T21:39:30.892998] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-21T21:39:31.019503] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-21T21:39:31.351085] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-10. [2025-10-21T21:39:32.151041] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-10. [2025-10-21T21:39:32.228341] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T21:39:32.338454] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T21:39:32.341568] [INFO ] [REMOTE ] UHAL: Full fetch complete (23436 records). [2025-10-21T21:39:32.341674] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-10-21T21:39:32.719197] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-10-21T21:39:32.719275] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-10-21T21:39:32.719850] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-10-21T21:39:32.719912] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-10-21T21:39:32.720561] [DEBUG] [LOCAL ] UHAL: Trimmed 23436 records to 16906 (keeping 200 days of data) [2025-10-21T21:39:32.821329] [DEBUG] [LOCAL ] UHAL: Primary data saved (16906 records). [2025-10-21T21:39:32.821466] [INFO ] [MAIN ] UHAL: Full history saved. [2025-10-21T21:39:32.821541] [INFO ] [MAIN ] Update Progress: 2176/2366 symbols completed. UHAL took 46.6s. Estimated remaining: 24m 24s. Rate: 7.8 symbols/min [2025-10-21T21:39:32.960908] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-10-21T21:39:32.992961] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:39:33.031062] [DEBUG] [LOCAL ] ULS: Loaded 38818 existing records from primary storage. [2025-10-21T21:39:33.031359] [INFO ] [MAIN ] ULS: Loaded 38818 existing records. [2025-10-21T21:39:33.232261] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:39:33.232674] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-10-21T21:39:33.232845] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-10-21T21:39:33.233085] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-10-21T21:39:33.233143] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-10-21T21:39:33.526073] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T21:39:33.550340] [INFO ] [REMOTE ] UI: Full fetch complete (19657 records). [2025-10-21T21:39:33.577614] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-10-21T21:39:33.682831] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:39:33.756099] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-10-21T21:39:34.002377] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-10-21T21:39:34.002464] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-10-21T21:39:34.002986] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-10-21T21:39:34.003047] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-10-21T21:39:34.003610] [DEBUG] [LOCAL ] UI: Trimmed 19657 records to 14137 (keeping 200 days of data) [2025-10-21T21:39:34.091219] [DEBUG] [LOCAL ] UI: Primary data saved (14137 records). [2025-10-21T21:39:34.091352] [INFO ] [MAIN ] UI: Full history saved. [2025-10-21T21:39:34.091428] [INFO ] [MAIN ] Update Progress: 2177/2366 symbols completed. UI took 25.2s. Estimated remaining: 24m 16s. Rate: 7.8 symbols/min [2025-10-21T21:39:34.258490] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:39:34.306716] [DEBUG] [LOCAL ] UMC: Loaded 52683 existing records from primary storage. [2025-10-21T21:39:34.313751] [INFO ] [MAIN ] UMC: Loaded 52683 existing records. [2025-10-21T21:39:34.389935] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T21:39:34.508683] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:39:34.508904] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-10-21T21:39:34.508971] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-10-21T21:39:34.509156] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-10-21T21:39:34.509192] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-10-21T21:39:34.563060] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-10. [2025-10-21T21:39:34.859932] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:39:35.351006] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-10-21T21:39:35.499218] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T21:39:35.947371] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-21T21:39:35.953607] [INFO ] [REMOTE ] UIS: Full fetch complete (51991 records). [2025-10-21T21:39:35.953752] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-10-21T21:39:36.162629] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-10-21T21:39:36.390140] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-10-21T21:39:36.390236] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-10-21T21:39:36.391442] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-10-21T21:39:36.391508] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-10-21T21:39:36.392724] [DEBUG] [LOCAL ] UIS: Trimmed 51991 records to 36713 (keeping 200 days of data) [2025-10-21T21:39:36.612489] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T21:39:36.648713] [DEBUG] [LOCAL ] UIS: Primary data saved (36713 records). [2025-10-21T21:39:36.648957] [INFO ] [MAIN ] UIS: Full history saved. [2025-10-21T21:39:36.649880] [INFO ] [MAIN ] Update Progress: 2178/2366 symbols completed. UIS took 26.4s. Estimated remaining: 24m 8s. Rate: 7.8 symbols/min [2025-10-21T21:39:36.831871] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:39:36.876295] [DEBUG] [LOCAL ] UMH: Loaded 34230 existing records from primary storage. [2025-10-21T21:39:36.876793] [INFO ] [MAIN ] UMH: Loaded 34230 existing records. [2025-10-21T21:39:36.956156] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-10-21T21:39:37.071287] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:39:37.071622] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-10-21T21:39:37.071713] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-10-21T21:39:37.072010] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-10-21T21:39:37.072070] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-10-21T21:39:37.431933] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:39:37.750999] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-10-21T21:39:37.990899] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T21:39:38.392379] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T21:39:38.551009] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-10-21T21:39:38.590559] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T21:39:39.351047] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-10-21T21:39:40.078877] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-21T21:39:40.151016] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-10-21T21:39:40.951048] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-10-21T21:39:41.222912] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-21T21:39:41.734781] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T21:39:41.750985] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-10-21T21:39:42.551008] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-10-21T21:39:42.742102] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T21:39:42.877963] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T21:39:43.351035] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-10-21T21:39:43.734482] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T21:39:44.151058] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-10-21T21:39:44.758833] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T21:39:44.951055] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-10-21T21:39:45.751110] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-10-21T21:39:46.098496] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T21:39:46.293374] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T21:39:46.551094] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-10-21T21:39:47.244275] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T21:39:47.351045] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-10-21T21:39:47.671863] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-21T21:39:48.151020] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-10-21T21:39:48.951004] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-10-21T21:39:49.034560] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:39:49.099187] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T21:39:49.751025] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-10-21T21:39:50.441607] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T21:39:50.551033] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-10-21T21:39:51.351038] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-10-21T21:39:51.564112] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T21:39:51.872477] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T21:39:52.151032] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-10-21T21:39:52.951089] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-10. [2025-10-21T21:39:53.189890] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T21:39:53.631932] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T21:39:53.751022] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-10-21T21:39:54.551009] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-10. [2025-10-21T21:39:54.775286] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-21T21:39:54.784117] [INFO ] [REMOTE ] UL: Full fetch complete (77080 records). [2025-10-21T21:39:54.784249] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-10-21T21:39:55.205136] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-10-21T21:39:55.205243] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-10-21T21:39:55.206505] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-10-21T21:39:55.206571] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-10-21T21:39:55.208033] [DEBUG] [LOCAL ] UL: Trimmed 77080 records to 53072 (keeping 200 days of data) [2025-10-21T21:39:55.378989] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-10-21T21:39:55.529254] [DEBUG] [LOCAL ] UL: Primary data saved (53072 records). [2025-10-21T21:39:55.529431] [INFO ] [MAIN ] UL: Full history saved. [2025-10-21T21:39:55.529525] [INFO ] [MAIN ] Update Progress: 2179/2366 symbols completed. UL took 37.3s. Estimated remaining: 24m 1s. Rate: 7.8 symbols/min [2025-10-21T21:39:55.702729] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:39:55.734138] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-21T21:39:55.754116] [DEBUG] [LOCAL ] UNF: Loaded 11812 existing records from primary storage. [2025-10-21T21:39:55.754326] [INFO ] [MAIN ] UNF: Loaded 11812 existing records. [2025-10-21T21:39:55.933545] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:39:55.933843] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-10-21T21:39:55.933926] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-10-21T21:39:55.934266] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-10-21T21:39:55.934322] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-10-21T21:39:55.978348] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-21T21:39:56.020423] [INFO ] [REMOTE ] ULS: Full fetch complete (53902 records). [2025-10-21T21:39:56.031341] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-10-21T21:39:56.151439] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-10-21T21:39:56.593864] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:39:56.685444] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-10-21T21:39:56.685578] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-10-21T21:39:56.686713] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-10-21T21:39:56.686790] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-10-21T21:39:56.687956] [DEBUG] [LOCAL ] ULS: Trimmed 53902 records to 38649 (keeping 200 days of data) [2025-10-21T21:39:56.832087] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T21:39:56.948132] [DEBUG] [LOCAL ] ULS: Primary data saved (38649 records). [2025-10-21T21:39:56.948254] [INFO ] [MAIN ] ULS: Full history saved. [2025-10-21T21:39:56.948328] [INFO ] [MAIN ] Update Progress: 2180/2366 symbols completed. ULS took 24.1s. Estimated remaining: 23m 53s. Rate: 7.8 symbols/min [2025-10-21T21:39:56.959237] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-10-21T21:39:57.116521] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:39:57.158811] [DEBUG] [LOCAL ] UNFI: Loaded 42612 existing records from primary storage. [2025-10-21T21:39:57.159077] [INFO ] [MAIN ] UNFI: Loaded 42612 existing records. [2025-10-21T21:39:57.334509] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:39:57.334783] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-10-21T21:39:57.334845] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-10-21T21:39:57.335080] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-10-21T21:39:57.335149] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-10-21T21:39:57.688287] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:39:57.750979] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-10-21T21:39:57.813567] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T21:39:58.016626] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T21:39:58.551098] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-10-21T21:39:59.182255] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-21T21:39:59.351092] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-10-21T21:40:00.123769] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T21:40:00.151022] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-10-21T21:40:00.292571] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T21:40:00.951025] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-10-21T21:40:01.489563] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T21:40:01.751034] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-10-21T21:40:02.008999] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T21:40:02.551036] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-10-21T21:40:03.156752] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-21T21:40:03.351019] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-10-21T21:40:04.150999] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-10-21T21:40:04.520425] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-21T21:40:04.899817] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T21:40:04.950976] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-10-21T21:40:05.750995] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-10-21T21:40:06.386965] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T21:40:06.551044] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-10. [2025-10-21T21:40:07.351060] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-10-21T21:40:07.642120] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-21T21:40:08.151029] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-10-21T21:40:08.311875] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T21:40:08.866148] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (4.72 seconds). [2025-10-21T21:40:08.951023] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-10-21T21:40:09.751046] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-10-21T21:40:09.996534] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-21T21:40:10.182039] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-10 (3.63 seconds). [2025-10-21T21:40:10.188172] [INFO ] [REMOTE ] UMH: Full fetch complete (47334 records). [2025-10-21T21:40:10.188278] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-10-21T21:40:10.570260] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-10. [2025-10-21T21:40:10.590801] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-21T21:40:10.612536] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-10-21T21:40:10.612752] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-10-21T21:40:10.613887] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-10-21T21:40:10.613989] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-10-21T21:40:10.615720] [DEBUG] [LOCAL ] UMH: Trimmed 47334 records to 34236 (keeping 200 days of data) [2025-10-21T21:40:10.738238] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:40:10.857573] [DEBUG] [LOCAL ] UMH: Primary data saved (34236 records). [2025-10-21T21:40:10.857811] [INFO ] [MAIN ] UMH: Full history saved. [2025-10-21T21:40:10.858237] [INFO ] [MAIN ] Update Progress: 2181/2366 symbols completed. UMH took 34.2s. Estimated remaining: 23m 46s. Rate: 7.8 symbols/min [2025-10-21T21:40:11.023306] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:40:11.075845] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-21T21:40:11.076172] [INFO ] [MAIN ] UNH: Loaded 53819 existing records. [2025-10-21T21:40:11.247922] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:40:11.248130] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-10-21T21:40:11.248180] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-10-21T21:40:11.248509] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-10-21T21:40:11.248553] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-10-21T21:40:11.352579] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-10-21T21:40:11.615457] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:40:12.151056] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-10-21T21:40:12.569126] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-21T21:40:12.577337] [INFO ] [REMOTE ] UMC: Full fetch complete (76674 records). [2025-10-21T21:40:12.577492] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-10-21T21:40:12.975492] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-10-21T21:40:12.994917] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T21:40:13.034478] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-10-21T21:40:13.035229] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-10-21T21:40:13.037083] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-10-21T21:40:13.037431] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-21T21:40:13.038054] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-10-21T21:40:13.042917] [DEBUG] [LOCAL ] UMC: Trimmed 76674 records to 52685 (keeping 200 days of data) [2025-10-21T21:40:13.341225] [DEBUG] [LOCAL ] UMC: Primary data saved (52685 records). [2025-10-21T21:40:13.341366] [INFO ] [MAIN ] UMC: Full history saved. [2025-10-21T21:40:13.341926] [INFO ] [MAIN ] Update Progress: 2182/2366 symbols completed. UMC took 39.3s. Estimated remaining: 23m 37s. Rate: 7.8 symbols/min [2025-10-21T21:40:13.509167] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:40:13.554531] [DEBUG] [LOCAL ] UNM: Loaded 48078 existing records from primary storage. [2025-10-21T21:40:13.554869] [INFO ] [MAIN ] UNM: Loaded 48078 existing records. [2025-10-21T21:40:13.738054] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:40:13.738256] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-10-21T21:40:13.738303] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-10-21T21:40:13.738488] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-10-21T21:40:13.738526] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-10-21T21:40:13.761254] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-10-21T21:40:14.109020] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:40:14.551046] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-10-21T21:40:15.230602] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-21T21:40:15.351104] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-10-21T21:40:15.565356] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T21:40:15.786547] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-21T21:40:16.151039] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-10-21T21:40:16.951031] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-10-21T21:40:17.533003] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-21T21:40:17.698120] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T21:40:17.751003] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-10-21T21:40:17.834307] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T21:40:18.551073] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-10-21T21:40:19.351010] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-10-21T21:40:20.150098] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T21:40:20.159164] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-10-21T21:40:20.199513] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-21T21:40:20.586241] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-10-21T21:40:20.951020] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-10-21T21:40:21.718077] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T21:40:21.750987] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-10-21T21:40:22.556128] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-10. [2025-10-21T21:40:22.571327] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T21:40:22.970216] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-21T21:40:23.351034] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-10. [2025-10-21T21:40:23.446620] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T21:40:23.449414] [INFO ] [REMOTE ] UNF: Full fetch complete (17816 records). [2025-10-21T21:40:23.449492] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-10-21T21:40:23.828165] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-10-21T21:40:23.828253] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-10-21T21:40:23.828783] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-10-21T21:40:23.828847] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-10-21T21:40:23.829509] [DEBUG] [LOCAL ] UNF: Trimmed 17816 records to 11736 (keeping 200 days of data) [2025-10-21T21:40:23.910126] [DEBUG] [LOCAL ] UNF: Primary data saved (11736 records). [2025-10-21T21:40:23.910273] [INFO ] [MAIN ] UNF: Full history saved. [2025-10-21T21:40:23.910366] [INFO ] [MAIN ] Update Progress: 2183/2366 symbols completed. UNF took 28.4s. Estimated remaining: 23m 30s. Rate: 7.8 symbols/min [2025-10-21T21:40:24.091556] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:40:24.097260] [DEBUG] [LOCAL ] UNMA: Loaded 3457 existing records from primary storage. [2025-10-21T21:40:24.097439] [INFO ] [MAIN ] UNMA: Loaded 3457 existing records. [2025-10-21T21:40:24.161404] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-10-21T21:40:24.279705] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:40:24.279906] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-10-21T21:40:24.279954] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-10-21T21:40:24.280091] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-10-21T21:40:24.280130] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-10-21T21:40:24.670566] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:40:24.854307] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T21:40:24.861606] [INFO ] [REMOTE ] UNFI: Full fetch complete (59837 records). [2025-10-21T21:40:24.861746] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-10-21T21:40:24.956083] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-10-21T21:40:25.249228] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-10-21T21:40:25.249324] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-10-21T21:40:25.250435] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-10-21T21:40:25.250497] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-10-21T21:40:25.251719] [DEBUG] [LOCAL ] UNFI: Trimmed 59837 records to 42625 (keeping 200 days of data) [2025-10-21T21:40:25.518797] [DEBUG] [LOCAL ] UNFI: Primary data saved (42625 records). [2025-10-21T21:40:25.518937] [INFO ] [MAIN ] UNFI: Full history saved. [2025-10-21T21:40:25.519925] [INFO ] [MAIN ] Update Progress: 2184/2366 symbols completed. UNFI took 28.6s. Estimated remaining: 23m 22s. Rate: 7.8 symbols/min [2025-10-21T21:40:25.692078] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:40:25.743893] [DEBUG] [LOCAL ] UNP: Loaded 53362 existing records from primary storage. [2025-10-21T21:40:25.744191] [INFO ] [MAIN ] UNP: Loaded 53362 existing records. [2025-10-21T21:40:25.764806] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-10-21T21:40:25.931188] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:40:25.931498] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-10-21T21:40:25.931572] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-10-21T21:40:25.931840] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-10-21T21:40:25.931901] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-10-21T21:40:26.104561] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T21:40:26.324961] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:40:26.385109] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-21T21:40:26.551056] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-10-21T21:40:27.173407] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T21:40:27.347435] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-21T21:40:27.357605] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-10-21T21:40:28.151069] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-10-21T21:40:28.951066] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-10-21T21:40:29.197048] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T21:40:29.751038] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-10-21T21:40:30.551016] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-10-21T21:40:30.716553] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T21:40:30.756915] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-21T21:40:31.142870] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T21:40:31.351042] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-10-21T21:40:31.465395] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T21:40:32.151025] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-10-21T21:40:32.951102] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-10-21T21:40:33.111533] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T21:40:33.293845] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-21T21:40:33.751052] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-10-21T21:40:34.322837] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-21T21:40:34.551043] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-10-21T21:40:34.594986] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-21T21:40:35.122298] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T21:40:35.351078] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-10-21T21:40:35.940151] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T21:40:36.151085] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-10-21T21:40:36.951045] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-10-21T21:40:37.642376] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T21:40:37.750987] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-10-21T21:40:38.551110] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-10-21T21:40:39.350998] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-10-21T21:40:39.465409] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T21:40:39.618111] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-21T21:40:39.902600] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-21T21:40:40.151004] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-10-21T21:40:40.400604] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T21:40:40.951067] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-10-21T21:40:41.750994] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-10-21T21:40:41.814630] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T21:40:42.551016] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-10-21T21:40:42.969402] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-21T21:40:43.103384] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T21:40:43.351018] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-10. [2025-10-21T21:40:43.824124] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-21T21:40:43.825228] [INFO ] [REMOTE ] UNMA: Full fetch complete (5443 records). [2025-10-21T21:40:43.825296] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-10-21T21:40:44.151511] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-10-21T21:40:44.176342] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-10-21T21:40:44.177092] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-10-21T21:40:44.177296] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-10-21T21:40:44.177360] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-10-21T21:40:44.177814] [DEBUG] [LOCAL ] UNMA: Trimmed 5443 records to 3456 (keeping 200 days of data) [2025-10-21T21:40:44.200336] [DEBUG] [LOCAL ] UNMA: Primary data saved (3456 records). [2025-10-21T21:40:44.200429] [INFO ] [MAIN ] UNMA: Full history saved. [2025-10-21T21:40:44.200503] [INFO ] [MAIN ] Update Progress: 2185/2366 symbols completed. UNMA took 20.3s. Estimated remaining: 23m 15s. Rate: 7.8 symbols/min [2025-10-21T21:40:44.369938] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:40:44.411681] [DEBUG] [LOCAL ] UP: Loaded 44329 existing records from primary storage. [2025-10-21T21:40:44.411982] [INFO ] [MAIN ] UP: Loaded 44329 existing records. [2025-10-21T21:40:44.591697] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:40:44.591937] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-10-21T21:40:44.591991] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-10-21T21:40:44.592303] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-10-21T21:40:44.592380] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-10-21T21:40:44.920559] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (3.17 seconds). [2025-10-21T21:40:44.963818] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-10-21T21:40:45.005898] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:40:45.751080] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-10-21T21:40:45.798004] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T21:40:46.516163] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T21:40:46.550980] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-10-21T21:40:47.334165] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T21:40:47.350991] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-10-21T21:40:48.151000] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-10-21T21:40:48.353508] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T21:40:48.951037] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-10-21T21:40:49.602910] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T21:40:49.751025] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-10. [2025-10-21T21:40:49.858251] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-21T21:40:50.551001] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-10-21T21:40:51.097972] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T21:40:51.340707] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T21:40:51.347966] [INFO ] [REMOTE ] UNM: Full fetch complete (69962 records). [2025-10-21T21:40:51.348101] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-10-21T21:40:51.359835] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-10-21T21:40:51.738709] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-10-21T21:40:51.738858] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-10-21T21:40:51.740089] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-10-21T21:40:51.740151] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-10-21T21:40:51.741438] [DEBUG] [LOCAL ] UNM: Trimmed 69962 records to 47997 (keeping 200 days of data) [2025-10-21T21:40:52.057412] [DEBUG] [LOCAL ] UNM: Primary data saved (47997 records). [2025-10-21T21:40:52.059046] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-21T21:40:52.058088] [INFO ] [MAIN ] UNM: Full history saved. [2025-10-21T21:40:52.059739] [INFO ] [MAIN ] Update Progress: 2186/2366 symbols completed. UNM took 38.7s. Estimated remaining: 23m 7s. Rate: 7.8 symbols/min [2025-10-21T21:40:52.156104] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-10. [2025-10-21T21:40:52.244040] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:40:52.295082] [DEBUG] [LOCAL ] UPS: Loaded 53720 existing records from primary storage. [2025-10-21T21:40:52.295401] [INFO ] [MAIN ] UPS: Loaded 53720 existing records. [2025-10-21T21:40:52.468017] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:40:52.468239] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-10-21T21:40:52.468283] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-10-21T21:40:52.468497] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-10-21T21:40:52.468551] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-10-21T21:40:52.819337] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:40:52.951004] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-10-21T21:40:53.071384] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T21:40:53.079721] [INFO ] [REMOTE ] UNH: Full fetch complete (77960 records). [2025-10-21T21:40:53.079872] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-10-21T21:40:53.477890] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-10-21T21:40:53.478059] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-10-21T21:40:53.479427] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-10-21T21:40:53.479570] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-10-21T21:40:53.481330] [DEBUG] [LOCAL ] UNH: Trimmed 77960 records to 53819 (keeping 200 days of data) [2025-10-21T21:40:53.605428] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-21T21:40:53.771132] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-10-21T21:40:53.936521] [DEBUG] [LOCAL ] UNH: Primary data saved (53819 records). [2025-10-21T21:40:53.936704] [INFO ] [MAIN ] UNH: Full history saved. [2025-10-21T21:40:53.937454] [INFO ] [MAIN ] Update Progress: 2187/2366 symbols completed. UNH took 43.1s. Estimated remaining: 22m 59s. Rate: 7.8 symbols/min [2025-10-21T21:40:54.133793] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:40:54.170914] [DEBUG] [LOCAL ] URI: Loaded 34532 existing records from primary storage. [2025-10-21T21:40:54.171209] [INFO ] [MAIN ] URI: Loaded 34532 existing records. [2025-10-21T21:40:54.410012] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:40:54.410284] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-10-21T21:40:54.410353] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-10-21T21:40:54.410582] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-10-21T21:40:54.410689] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-10-21T21:40:54.552260] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-10-21T21:40:54.983325] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:40:55.019391] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-21T21:40:55.340274] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-21T21:40:55.351090] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-10-21T21:40:56.117526] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-21T21:40:56.151028] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-10. [2025-10-21T21:40:56.850883] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T21:40:56.859073] [INFO ] [REMOTE ] UNP: Full fetch complete (77129 records). [2025-10-21T21:40:56.859226] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-10-21T21:40:56.956771] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-10-21T21:40:57.291023] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-10-21T21:40:57.291664] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-10-21T21:40:57.292990] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-10-21T21:40:57.295466] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-10-21T21:40:57.295362] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-21T21:40:57.305472] [DEBUG] [LOCAL ] UNP: Trimmed 77129 records to 53362 (keeping 200 days of data) [2025-10-21T21:40:57.638243] [DEBUG] [LOCAL ] UNP: Primary data saved (53362 records). [2025-10-21T21:40:57.638378] [INFO ] [MAIN ] UNP: Full history saved. [2025-10-21T21:40:57.638954] [INFO ] [MAIN ] Update Progress: 2188/2366 symbols completed. UNP took 32.1s. Estimated remaining: 22m 51s. Rate: 7.8 symbols/min [2025-10-21T21:40:57.756152] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-10-21T21:40:57.806805] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:40:57.843432] [DEBUG] [LOCAL ] USA: Loaded 36476 existing records from primary storage. [2025-10-21T21:40:57.843730] [INFO ] [MAIN ] USA: Loaded 36476 existing records. [2025-10-21T21:40:58.015462] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:40:58.015693] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-10-21T21:40:58.015751] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-10-21T21:40:58.015933] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-10-21T21:40:58.015970] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-10-21T21:40:58.359346] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:40:58.550994] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-10-21T21:40:59.039460] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-21T21:40:59.133217] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-21T21:40:59.351025] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-10-21T21:41:00.118566] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T21:41:00.151007] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-10-21T21:41:00.951058] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-10-21T21:41:01.245218] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-21T21:41:01.751126] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-10-21T21:41:02.297910] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-21T21:41:02.423308] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T21:41:02.551028] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-10-21T21:41:03.351010] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-10-21T21:41:03.504406] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T21:41:03.830357] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-21T21:41:04.151031] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-10-21T21:41:04.951024] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-10-21T21:41:05.662071] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-21T21:41:05.760830] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T21:41:05.759340] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-10-21T21:41:06.551086] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-10-21T21:41:06.942957] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T21:41:07.095525] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T21:41:07.351042] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-10-21T21:41:07.977778] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T21:41:08.151124] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-10-21T21:41:08.798325] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-21T21:41:08.951097] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-10-21T21:41:09.553765] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T21:41:09.751034] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-10-21T21:41:10.551008] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-10-21T21:41:11.066455] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T21:41:11.351043] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-10. [2025-10-21T21:41:12.007446] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-21T21:41:12.100502] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-21T21:41:12.151038] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-10-21T21:41:12.951048] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-10-21T21:41:13.247587] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-21T21:41:13.255931] [INFO ] [REMOTE ] UP: Full fetch complete (63083 records). [2025-10-21T21:41:13.256082] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-10-21T21:41:13.661412] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-10-21T21:41:13.661552] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-10-21T21:41:13.662858] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-10-21T21:41:13.662945] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-10-21T21:41:13.664389] [DEBUG] [LOCAL ] UP: Trimmed 63083 records to 44384 (keeping 200 days of data) [2025-10-21T21:41:13.755872] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-10-21T21:41:13.780179] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T21:41:13.943314] [DEBUG] [LOCAL ] UP: Primary data saved (44384 records). [2025-10-21T21:41:13.943447] [INFO ] [MAIN ] UP: Full history saved. [2025-10-21T21:41:13.943524] [INFO ] [MAIN ] Update Progress: 2189/2366 symbols completed. UP took 29.7s. Estimated remaining: 22m 44s. Rate: 7.8 symbols/min [2025-10-21T21:41:14.116882] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:41:14.138175] [DEBUG] [LOCAL ] USAC: Loaded 21832 existing records from primary storage. [2025-10-21T21:41:14.138418] [INFO ] [MAIN ] USAC: Loaded 21832 existing records. [2025-10-21T21:41:14.319303] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:41:14.319710] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-10-21T21:41:14.319774] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-10-21T21:41:14.320200] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-10-21T21:41:14.327285] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-10-21T21:41:14.415943] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T21:41:14.556232] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-10-21T21:41:14.712103] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:41:15.351039] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-10-21T21:41:15.560007] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T21:41:16.151037] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-10-21T21:41:16.310146] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-21T21:41:16.475884] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-21T21:41:16.951045] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-10. [2025-10-21T21:41:17.539322] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-21T21:41:17.544127] [INFO ] [REMOTE ] URI: Full fetch complete (52704 records). [2025-10-21T21:41:17.544252] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-10-21T21:41:17.759446] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-10-21T21:41:17.930493] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-10-21T21:41:17.930589] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-10-21T21:41:17.931722] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-10-21T21:41:17.931793] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-10-21T21:41:17.933049] [DEBUG] [LOCAL ] URI: Trimmed 52704 records to 34400 (keeping 200 days of data) [2025-10-21T21:41:18.170744] [DEBUG] [LOCAL ] URI: Primary data saved (34400 records). [2025-10-21T21:41:18.171098] [INFO ] [MAIN ] URI: Full history saved. [2025-10-21T21:41:18.171838] [INFO ] [MAIN ] Update Progress: 2190/2366 symbols completed. URI took 24.2s. Estimated remaining: 22m 36s. Rate: 7.8 symbols/min [2025-10-21T21:41:18.382033] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:41:18.436109] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-21T21:41:18.436464] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-10-21T21:41:18.562608] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-10-21T21:41:18.632057] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:41:18.633188] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-10-21T21:41:18.633313] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-10-21T21:41:18.633780] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-10-21T21:41:18.633845] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-10-21T21:41:18.835973] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-21T21:41:19.051113] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:41:19.186845] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T21:41:19.351041] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-10-21T21:41:19.444617] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-21T21:41:20.151043] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-10-21T21:41:20.951074] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-10-21T21:41:21.116934] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T21:41:21.377291] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T21:41:21.751077] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-10-21T21:41:22.284700] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T21:41:22.551041] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-10-21T21:41:23.351032] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-10-21T21:41:23.462520] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T21:41:24.141881] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T21:41:24.150989] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-10-21T21:41:24.951088] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-10-21T21:41:25.269747] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-21T21:41:25.737562] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-10-21T21:41:25.750976] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-10-21T21:41:26.150607] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-21T21:41:26.551037] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-10-21T21:41:27.351058] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-10-21T21:41:28.029268] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T21:41:28.151600] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-10. [2025-10-21T21:41:28.151529] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-21T21:41:28.531327] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T21:41:28.951038] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-10-21T21:41:29.600529] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T21:41:29.606912] [INFO ] [REMOTE ] USA: Full fetch complete (52582 records). [2025-10-21T21:41:29.607030] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-10-21T21:41:29.759135] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-10. [2025-10-21T21:41:30.002993] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-10-21T21:41:30.003102] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-10-21T21:41:30.004128] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-10-21T21:41:30.004200] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-10-21T21:41:30.005373] [DEBUG] [LOCAL ] USA: Trimmed 52582 records to 36487 (keeping 200 days of data) [2025-10-21T21:41:30.215813] [DEBUG] [LOCAL ] USA: Primary data saved (36487 records). [2025-10-21T21:41:30.215956] [INFO ] [MAIN ] USA: Full history saved. [2025-10-21T21:41:30.216034] [INFO ] [MAIN ] Update Progress: 2191/2366 symbols completed. USA took 32.6s. Estimated remaining: 22m 29s. Rate: 7.8 symbols/min [2025-10-21T21:41:30.384044] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:41:30.434895] [DEBUG] [LOCAL ] USFD: Loaded 51212 existing records from primary storage. [2025-10-21T21:41:30.435214] [INFO ] [MAIN ] USFD: Loaded 51212 existing records. [2025-10-21T21:41:30.556244] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-10-21T21:41:30.651815] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:41:30.655745] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-10-21T21:41:30.656073] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-10-21T21:41:30.658486] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-10-21T21:41:30.658590] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-10-21T21:41:30.658408] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-21T21:41:30.762312] [INFO ] [REMOTE ] UPS: Full fetch complete (77880 records). [2025-10-21T21:41:30.774551] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-10-21T21:41:31.346612] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-21T21:41:31.438118] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-10-21T21:41:31.494520] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:41:31.637900] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-10-21T21:41:31.638103] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-10-21T21:41:31.639795] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-10-21T21:41:31.639974] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-10-21T21:41:31.641634] [DEBUG] [LOCAL ] UPS: Trimmed 77880 records to 53720 (keeping 200 days of data) [2025-10-21T21:41:31.762518] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-21T21:41:32.025538] [DEBUG] [LOCAL ] UPS: Primary data saved (53720 records). [2025-10-21T21:41:32.025697] [INFO ] [MAIN ] UPS: Full history saved. [2025-10-21T21:41:32.026237] [INFO ] [MAIN ] Update Progress: 2192/2366 symbols completed. UPS took 40.0s. Estimated remaining: 22m 21s. Rate: 7.8 symbols/min [2025-10-21T21:41:32.166336] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-10-21T21:41:32.197865] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:41:32.216114] [DEBUG] [LOCAL ] USNA: Loaded 18032 existing records from primary storage. [2025-10-21T21:41:32.216345] [INFO ] [MAIN ] USNA: Loaded 18032 existing records. [2025-10-21T21:41:32.422578] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:41:32.422898] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-10-21T21:41:32.422975] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-10-21T21:41:32.423234] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-10-21T21:41:32.423303] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-10-21T21:41:32.827225] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:41:32.951046] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-10-21T21:41:33.474486] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T21:41:33.553344] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T21:41:33.577534] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-21T21:41:33.751084] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-10-21T21:41:34.551067] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-10-21T21:41:35.351085] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-10-21T21:41:35.422212] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T21:41:35.576266] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T21:41:36.151020] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-10-21T21:41:36.951057] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-10-21T21:41:37.266450] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T21:41:37.489213] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-21T21:41:37.751027] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-10-21T21:41:37.924059] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-21T21:41:38.551027] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-10-21T21:41:38.766367] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-21T21:41:39.351033] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-10-21T21:41:39.477030] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T21:41:40.151044] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-10-21T21:41:40.951055] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-10-21T21:41:41.096283] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-21T21:41:41.751075] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-10-21T21:41:42.039836] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T21:41:42.140944] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T21:41:42.551027] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-10. [2025-10-21T21:41:43.351026] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-10-21T21:41:43.557821] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T21:41:43.582125] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-21T21:41:43.585460] [INFO ] [REMOTE ] USAC: Full fetch complete (35183 records). [2025-10-21T21:41:43.585532] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-10-21T21:41:43.966362] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-10-21T21:41:43.966437] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-10-21T21:41:43.967163] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-10-21T21:41:43.967224] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-10-21T21:41:43.968049] [DEBUG] [LOCAL ] USAC: Trimmed 35183 records to 21711 (keeping 200 days of data) [2025-10-21T21:41:44.096888] [DEBUG] [LOCAL ] USAC: Primary data saved (21711 records). [2025-10-21T21:41:44.097018] [INFO ] [MAIN ] USAC: Full history saved. [2025-10-21T21:41:44.097099] [INFO ] [MAIN ] Update Progress: 2193/2366 symbols completed. USAC took 30.2s. Estimated remaining: 22m 13s. Rate: 7.8 symbols/min [2025-10-21T21:41:44.160244] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-10-21T21:41:44.268527] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:41:44.286021] [DEBUG] [LOCAL ] USPH: Loaded 17179 existing records from primary storage. [2025-10-21T21:41:44.286253] [INFO ] [MAIN ] USPH: Loaded 17179 existing records. [2025-10-21T21:41:44.469213] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:41:44.470198] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-10-21T21:41:44.470390] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-10-21T21:41:44.470626] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-10-21T21:41:44.470735] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-10-21T21:41:44.590091] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T21:41:44.851226] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:41:44.951021] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-10-21T21:41:45.751098] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-10-21T21:41:45.903459] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T21:41:45.903806] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-21T21:41:46.551082] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-10-21T21:41:47.311071] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T21:41:47.350979] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-10-21T21:41:47.795362] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-21T21:41:48.151035] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-10-21T21:41:48.349583] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-21T21:41:48.951038] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-10-21T21:41:49.750991] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-10-21T21:41:49.885871] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T21:41:50.160372] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-21T21:41:50.551051] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-10-21T21:41:51.360073] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-10-21T21:41:51.365942] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T21:41:51.544513] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-21T21:41:52.151092] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-10-21T21:41:52.868416] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-21T21:41:52.951020] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-10-21T21:41:53.126610] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T21:41:53.751082] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-10-21T21:41:54.468368] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:41:54.550996] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-10-21T21:41:54.696526] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-21T21:41:55.351020] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-10-21T21:41:55.569224] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-21T21:41:56.151033] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-10-21T21:41:56.951055] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-10. [2025-10-21T21:41:57.135679] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-21T21:41:57.156977] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-21T21:41:57.751050] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-10. [2025-10-21T21:41:58.497563] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T21:41:58.506200] [INFO ] [REMOTE ] USB: Full fetch complete (77867 records). [2025-10-21T21:41:58.506344] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-10-21T21:41:58.561227] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-10-21T21:41:58.915968] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-21T21:41:58.945677] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-10-21T21:41:58.945841] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-10-21T21:41:58.947287] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-10-21T21:41:58.947371] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-10-21T21:41:58.948076] [INFO ] [REMOTE ] USFD: Full fetch complete (74309 records). [2025-10-21T21:41:58.948429] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-10-21T21:41:58.981761] [DEBUG] [LOCAL ] USB: Trimmed 77867 records to 53688 (keeping 200 days of data) [2025-10-21T21:41:59.364128] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-10-21T21:41:59.574332] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-21T21:41:59.574903] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-10-21T21:41:59.575583] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-10-21T21:41:59.577150] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-10-21T21:41:59.580800] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-10-21T21:41:59.584897] [DEBUG] [LOCAL ] USFD: Trimmed 74309 records to 51154 (keeping 200 days of data) [2025-10-21T21:41:59.911702] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-10-21T21:41:59.918708] [INFO ] [MAIN ] USB: Full history saved. [2025-10-21T21:41:59.921212] [INFO ] [MAIN ] Update Progress: 2194/2366 symbols completed. USB took 41.7s. Estimated remaining: 22m 6s. Rate: 7.8 symbols/min [2025-10-21T21:42:00.162673] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:00.160456] [DEBUG] [LOCAL ] USFD: Primary data saved (51154 records). [2025-10-21T21:42:00.160341] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-10-21T21:42:00.162844] [INFO ] [MAIN ] USFD: Full history saved. [2025-10-21T21:42:00.165104] [INFO ] [MAIN ] Update Progress: 2195/2366 symbols completed. USFD took 29.9s. Estimated remaining: 21m 58s. Rate: 7.8 symbols/min [2025-10-21T21:42:00.349159] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:00.361267] [DEBUG] [LOCAL ] UTF: Loaded 30922 existing records from primary storage. [2025-10-21T21:42:00.361579] [INFO ] [MAIN ] UTF: Loaded 30922 existing records. [2025-10-21T21:42:00.560872] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:00.561163] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-10-21T21:42:00.561212] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-10-21T21:42:00.561428] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-10-21T21:42:00.561484] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-10-21T21:42:00.690162] [DEBUG] [LOCAL ] UTI: Loaded 40371 existing records from primary storage. [2025-10-21T21:42:00.698980] [INFO ] [MAIN ] UTI: Loaded 40371 existing records. [2025-10-21T21:42:00.838906] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T21:42:00.958341] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-10-21T21:42:01.034038] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:01.047994] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-10-21T21:42:01.071943] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-10-21T21:42:01.086291] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-10-21T21:42:01.091595] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-10-21T21:42:01.280128] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T21:42:01.319120] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:01.564084] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:01.751033] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-10-21T21:42:02.172784] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T21:42:02.551020] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-10. [2025-10-21T21:42:03.245082] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-21T21:42:03.350991] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-10-21T21:42:03.617883] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T21:42:03.621602] [INFO ] [REMOTE ] USNA: Full fetch complete (27017 records). [2025-10-21T21:42:03.621727] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-10-21T21:42:04.048874] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-10-21T21:42:04.048976] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-10-21T21:42:04.049804] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-10-21T21:42:04.049894] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-10-21T21:42:04.050904] [DEBUG] [LOCAL ] USNA: Trimmed 27017 records to 18002 (keeping 200 days of data) [2025-10-21T21:42:04.151769] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-10-21T21:42:04.168128] [DEBUG] [LOCAL ] USNA: Primary data saved (18002 records). [2025-10-21T21:42:04.169392] [INFO ] [MAIN ] USNA: Full history saved. [2025-10-21T21:42:04.169480] [INFO ] [MAIN ] Update Progress: 2196/2366 symbols completed. USNA took 32.1s. Estimated remaining: 21m 50s. Rate: 7.8 symbols/min [2025-10-21T21:42:04.373823] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:04.386411] [DEBUG] [LOCAL ] UTL: Loaded 11878 existing records from primary storage. [2025-10-21T21:42:04.386758] [INFO ] [MAIN ] UTL: Loaded 11878 existing records. [2025-10-21T21:42:04.639748] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:04.640061] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-10-21T21:42:04.640135] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-10-21T21:42:04.640383] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-10-21T21:42:04.640436] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-10-21T21:42:04.963814] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-21T21:42:04.963918] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-10-21T21:42:05.112048] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:05.738639] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-21T21:42:05.750987] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-10-21T21:42:06.021503] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-21T21:42:06.551089] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-10-21T21:42:07.244749] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T21:42:07.351003] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-10-21T21:42:07.464993] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T21:42:08.151049] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-10-21T21:42:08.499078] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-21T21:42:08.925927] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T21:42:08.950983] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-10-21T21:42:09.751017] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-10-21T21:42:10.551059] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-10-21T21:42:10.612902] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T21:42:11.128067] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T21:42:11.140049] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T21:42:11.351046] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-10-21T21:42:12.151061] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-10. [2025-10-21T21:42:12.159533] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T21:42:12.951036] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-10-21T21:42:13.146188] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-21T21:42:13.149334] [INFO ] [REMOTE ] USPH: Full fetch complete (23008 records). [2025-10-21T21:42:13.149404] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-10-21T21:42:13.512619] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-10-21T21:42:13.512743] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-10-21T21:42:13.513217] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-10-21T21:42:13.513256] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-10-21T21:42:13.513844] [DEBUG] [LOCAL ] USPH: Trimmed 23008 records to 17099 (keeping 200 days of data) [2025-10-21T21:42:13.614566] [DEBUG] [LOCAL ] USPH: Primary data saved (17099 records). [2025-10-21T21:42:13.614722] [INFO ] [MAIN ] USPH: Full history saved. [2025-10-21T21:42:13.614809] [INFO ] [MAIN ] Update Progress: 2197/2366 symbols completed. USPH took 29.5s. Estimated remaining: 21m 42s. Rate: 7.8 symbols/min [2025-10-21T21:42:13.751075] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-10-21T21:42:14.422118] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-21T21:42:14.436091] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-21T21:42:14.551027] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-10-21T21:42:15.351107] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-10-21T21:42:15.862592] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-21T21:42:16.151100] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-10-21T21:42:16.898912] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-21T21:42:16.951018] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-10-21T21:42:17.395409] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-21T21:42:17.751062] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-10-21T21:42:18.417974] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-21T21:42:18.551057] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-10-21T21:42:18.619673] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-21T21:42:19.351093] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-10-21T21:42:20.005117] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-21T21:42:20.104715] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-21T21:42:20.150980] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-10-21T21:42:20.951051] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-10-21T21:42:21.729194] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T21:42:21.750990] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-10. [2025-10-21T21:42:22.478961] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-21T21:42:22.550997] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-10-21T21:42:23.358852] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-10-21T21:42:23.364372] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T21:42:23.372027] [INFO ] [REMOTE ] UTF: Full fetch complete (43795 records). [2025-10-21T21:42:23.372139] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-10-21T21:42:23.774068] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-10-21T21:42:23.774232] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-10-21T21:42:23.775142] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-10-21T21:42:23.775220] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-10-21T21:42:23.776246] [DEBUG] [LOCAL ] UTF: Trimmed 43795 records to 31001 (keeping 200 days of data) [2025-10-21T21:42:23.993944] [DEBUG] [LOCAL ] UTF: Primary data saved (31001 records). [2025-10-21T21:42:23.995438] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T21:42:23.994453] [INFO ] [MAIN ] UTF: Full history saved. [2025-10-21T21:42:24.004204] [INFO ] [MAIN ] Update Progress: 2198/2366 symbols completed. UTF took 24.1s. Estimated remaining: 21m 35s. Rate: 7.8 symbols/min [2025-10-21T21:42:24.151041] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-10. [2025-10-21T21:42:24.210295] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T21:42:24.951063] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-10-21T21:42:25.427388] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T21:42:25.643178] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-21T21:42:25.649285] [INFO ] [REMOTE ] UTI: Full fetch complete (58767 records). [2025-10-21T21:42:25.649418] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-10-21T21:42:25.752503] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-10-21T21:42:26.055576] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-10-21T21:42:26.055686] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-10-21T21:42:26.057006] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-10-21T21:42:26.057070] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-10-21T21:42:26.059365] [DEBUG] [LOCAL ] UTI: Trimmed 58767 records to 40317 (keeping 200 days of data) [2025-10-21T21:42:26.311450] [DEBUG] [LOCAL ] UTI: Primary data saved (40317 records). [2025-10-21T21:42:26.311574] [INFO ] [MAIN ] UTI: Full history saved. [2025-10-21T21:42:26.311674] [INFO ] [MAIN ] Update Progress: 2199/2366 symbols completed. UTI took 26.1s. Estimated remaining: 21m 27s. Rate: 7.8 symbols/min [2025-10-21T21:42:26.459953] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-21T21:42:26.551086] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-10-21T21:42:27.492599] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-21T21:42:27.496719] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-10. [2025-10-21T21:42:28.426379] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T21:42:28.428962] [INFO ] [REMOTE ] UTL: Full fetch complete (15816 records). [2025-10-21T21:42:28.429031] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-10-21T21:42:28.784582] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-10-21T21:42:28.784683] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-10-21T21:42:28.784954] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-10-21T21:42:28.784993] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-10-21T21:42:28.785478] [DEBUG] [LOCAL ] UTL: Trimmed 15816 records to 11875 (keeping 200 days of data) [2025-10-21T21:42:28.852863] [DEBUG] [LOCAL ] UTL: Primary data saved (11875 records). [2025-10-21T21:42:28.852973] [INFO ] [MAIN ] UTL: Full history saved. [2025-10-21T21:42:28.853046] [INFO ] [MAIN ] Update Progress: 2200/2366 symbols completed. UTL took 24.7s. Estimated remaining: 21m 19s. Rate: 7.8 symbols/min [2025-10-21T21:42:29.428414] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:29.515715] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:29.546033] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:29.566721] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:29.585072] [DEBUG] [LOCAL ] UVE: Loaded 22011 existing records from primary storage. [2025-10-21T21:42:29.585318] [INFO ] [MAIN ] UVE: Loaded 22011 existing records. [2025-10-21T21:42:29.723307] [DEBUG] [LOCAL ] UVV: Loaded 22837 existing records from primary storage. [2025-10-21T21:42:29.775107] [INFO ] [MAIN ] UVV: Loaded 22837 existing records. [2025-10-21T21:42:29.805760] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:29.847293] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-10-21T21:42:29.847459] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-10-21T21:42:29.894297] [DEBUG] [LOCAL ] UTZ: Loaded 44488 existing records from primary storage. [2025-10-21T21:42:29.903764] [INFO ] [MAIN ] UTZ: Loaded 44488 existing records. [2025-10-21T21:42:29.903671] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-10-21T21:42:29.915637] [DEBUG] [LOCAL ] UWMC: Loaded 52957 existing records from primary storage. [2025-10-21T21:42:29.931961] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-10-21T21:42:29.977775] [INFO ] [MAIN ] UWMC: Loaded 52957 existing records. [2025-10-21T21:42:30.437216] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:30.479668] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-10-21T21:42:30.481791] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-10-21T21:42:30.490225] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:30.559934] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-10-21T21:42:30.560155] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-10-21T21:42:30.560035] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-10-21T21:42:30.653672] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-10-21T21:42:30.724259] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:30.732728] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-10-21T21:42:30.759071] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-10-21T21:42:30.753874] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-10-21T21:42:30.771336] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-10-21T21:42:30.776607] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-10-21T21:42:30.798107] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-10-21T21:42:30.994922] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:31.070980] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-10-21T21:42:31.685894] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:31.696762] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-10-21T21:42:31.834562] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:31.854191] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:31.851416] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-10-21T21:42:31.854485] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-10-21T21:42:32.162237] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-21T21:42:32.166029] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-10-21T21:42:32.840860] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-21T21:42:32.844919] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-10-21T21:42:32.941846] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T21:42:32.950972] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-10-21T21:42:33.030280] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T21:42:33.189606] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T21:42:33.751070] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-10-21T21:42:33.978809] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T21:42:34.046986] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-21T21:42:34.551123] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-10-21T21:42:35.351080] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-10-21T21:42:35.427522] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T21:42:35.486280] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-21T21:42:36.151122] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-10-21T21:42:36.442543] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-21T21:42:36.951019] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-10-21T21:42:37.720057] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-21T21:42:37.750993] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-10-21T21:42:38.119598] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T21:42:38.551070] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-10-21T21:42:39.299911] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T21:42:39.350980] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-10-21T21:42:39.772729] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T21:42:40.151047] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-10-21T21:42:40.179638] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-21T21:42:40.951085] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-10-21T21:42:41.751062] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-10-21T21:42:42.024151] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T21:42:42.050265] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T21:42:42.550994] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-10-21T21:42:43.015843] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-21T21:42:43.351084] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-10-21T21:42:44.151006] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-10-21T21:42:44.479350] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T21:42:44.503865] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T21:42:44.871594] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T21:42:44.951027] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-10-21T21:42:45.751060] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-10-21T21:42:46.000140] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T21:42:46.551130] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-10-21T21:42:47.351016] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-10. [2025-10-21T21:42:47.416377] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T21:42:47.833351] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T21:42:48.151036] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-10-21T21:42:48.374005] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T21:42:48.377744] [INFO ] [REMOTE ] UVE: Full fetch complete (30310 records). [2025-10-21T21:42:48.377844] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-10-21T21:42:48.741616] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-10-21T21:42:48.741718] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-10-21T21:42:48.742317] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-10-21T21:42:48.742356] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-10-21T21:42:48.743049] [DEBUG] [LOCAL ] UVE: Trimmed 30310 records to 21996 (keeping 200 days of data) [2025-10-21T21:42:48.872610] [DEBUG] [LOCAL ] UVE: Primary data saved (21996 records). [2025-10-21T21:42:48.872729] [INFO ] [MAIN ] UVE: Full history saved. [2025-10-21T21:42:48.872816] [INFO ] [MAIN ] Update Progress: 2201/2366 symbols completed. UVE took 20.0s. Estimated remaining: 21m 12s. Rate: 7.8 symbols/min [2025-10-21T21:42:48.956087] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-10-21T21:42:49.048283] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:49.055914] [DEBUG] [LOCAL ] UZD: Loaded 5930 existing records from primary storage. [2025-10-21T21:42:49.056068] [INFO ] [MAIN ] UZD: Loaded 5930 existing records. [2025-10-21T21:42:49.232735] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:49.232981] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-10-21T21:42:49.233043] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-10-21T21:42:49.233236] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-10-21T21:42:49.233293] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-10-21T21:42:49.589088] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:49.751074] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-10-21T21:42:50.009001] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-21T21:42:50.474551] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-21T21:42:50.550996] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-10-21T21:42:50.664380] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T21:42:51.213485] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-21T21:42:51.351026] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-10-21T21:42:52.151066] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-10-21T21:42:52.436974] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T21:42:52.951075] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-10-21T21:42:53.747269] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T21:42:53.757204] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-10-21T21:42:54.548813] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T21:42:54.557436] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-10-21T21:42:54.872231] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T21:42:54.964586] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-21T21:42:55.351029] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-10. [2025-10-21T21:42:56.151015] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-10-21T21:42:56.226976] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-21T21:42:56.230451] [INFO ] [REMOTE ] UVV: Full fetch complete (30191 records). [2025-10-21T21:42:56.230553] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-10-21T21:42:56.639264] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-10-21T21:42:56.639380] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-10-21T21:42:56.640525] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-10-21T21:42:56.640619] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-10-21T21:42:56.641935] [DEBUG] [LOCAL ] UVV: Trimmed 30191 records to 22842 (keeping 200 days of data) [2025-10-21T21:42:56.806916] [DEBUG] [LOCAL ] UVV: Primary data saved (22842 records). [2025-10-21T21:42:56.807076] [INFO ] [MAIN ] UVV: Full history saved. [2025-10-21T21:42:56.807191] [INFO ] [MAIN ] Update Progress: 2202/2366 symbols completed. UVV took 28.0s. Estimated remaining: 21m 4s. Rate: 7.8 symbols/min [2025-10-21T21:42:56.956085] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-10-21T21:42:56.991607] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-21T21:42:57.084519] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:42:57.095001] [DEBUG] [LOCAL ] UZE: Loaded 7056 existing records from primary storage. [2025-10-21T21:42:57.095236] [INFO ] [MAIN ] UZE: Loaded 7056 existing records. [2025-10-21T21:42:57.340741] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:42:57.341038] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-10-21T21:42:57.341108] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-10-21T21:42:57.341314] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-10-21T21:42:57.341385] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-10-21T21:42:57.762689] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-10-21T21:42:57.769969] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:42:58.551067] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-10-21T21:42:58.854362] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-21T21:42:58.947624] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-21T21:42:59.352459] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-10-21T21:42:59.355427] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-21T21:42:59.928779] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-21T21:43:00.151033] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-10-21T21:43:00.950995] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-10-21T21:43:01.612884] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-21T21:43:01.751023] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-10-21T21:43:01.793202] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T21:43:02.551007] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-10-21T21:43:02.564318] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T21:43:03.351105] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-10-21T21:43:04.151009] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-10-21T21:43:04.471587] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-21T21:43:04.847881] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-21T21:43:04.951004] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-10-21T21:43:05.272495] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T21:43:05.741157] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T21:43:05.750977] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-10-21T21:43:06.507201] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-21T21:43:06.550994] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-10. [2025-10-21T21:43:07.351035] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-10-21T21:43:08.079335] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-21T21:43:08.080333] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T21:43:08.088207] [INFO ] [REMOTE ] UTZ: Full fetch complete (64578 records). [2025-10-21T21:43:08.088302] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-10-21T21:43:08.156223] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-10-21T21:43:08.473418] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-10-21T21:43:08.473527] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-10-21T21:43:08.474621] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-10-21T21:43:08.474706] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-10-21T21:43:08.475867] [DEBUG] [LOCAL ] UTZ: Trimmed 64578 records to 44393 (keeping 200 days of data) [2025-10-21T21:43:08.734966] [DEBUG] [LOCAL ] UTZ: Primary data saved (44393 records). [2025-10-21T21:43:08.735087] [INFO ] [MAIN ] UTZ: Full history saved. [2025-10-21T21:43:08.735165] [INFO ] [MAIN ] Update Progress: 2203/2366 symbols completed. UTZ took 39.9s. Estimated remaining: 20m 57s. Rate: 7.8 symbols/min [2025-10-21T21:43:08.903702] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:43:08.903855] [DEBUG] [LOCAL ] UZF: No existing data file found in primary storage. [2025-10-21T21:43:08.903890] [WARN ] [MAIN ] UZF: No existing data found, performing full refresh instead. [2025-10-21T21:43:08.903993] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-10-21T21:43:08.904032] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-21T21:43:08.904072] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-21T21:43:08.904103] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-10-21T21:43:08.957528] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-10-21T21:43:09.255506] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:43:09.751078] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-10-21T21:43:09.863699] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-21T21:43:10.093063] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-21T21:43:10.403687] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T21:43:10.551080] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-10-21T21:43:11.143149] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-21T21:43:11.351036] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-10. [2025-10-21T21:43:11.865055] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T21:43:11.866094] [INFO ] [REMOTE ] UZD: Full fetch complete (8903 records). [2025-10-21T21:43:11.866160] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-10-21T21:43:12.156190] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-10-21T21:43:12.254989] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-10-21T21:43:12.255116] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-10-21T21:43:12.255360] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-10-21T21:43:12.255399] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-10-21T21:43:12.255824] [DEBUG] [LOCAL ] UZD: Trimmed 8903 records to 5886 (keeping 200 days of data) [2025-10-21T21:43:12.291079] [DEBUG] [LOCAL ] UZD: Primary data saved (5886 records). [2025-10-21T21:43:12.291185] [INFO ] [MAIN ] UZD: Full history saved. [2025-10-21T21:43:12.291260] [INFO ] [MAIN ] Update Progress: 2204/2366 symbols completed. UZD took 23.4s. Estimated remaining: 20m 49s. Rate: 7.8 symbols/min [2025-10-21T21:43:12.460282] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:43:12.511845] [DEBUG] [LOCAL ] V: Loaded 53752 existing records from primary storage. [2025-10-21T21:43:12.512165] [INFO ] [MAIN ] V: Loaded 53752 existing records. [2025-10-21T21:43:12.689086] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:43:12.689379] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-10-21T21:43:12.689427] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-10-21T21:43:12.689724] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-10-21T21:43:12.689813] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-10-21T21:43:12.916212] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T21:43:12.956110] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-10-21T21:43:13.054506] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:43:13.610638] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T21:43:13.751055] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-10-21T21:43:14.397855] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-21T21:43:14.551081] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-10-21T21:43:15.351099] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-10. [2025-10-21T21:43:15.536915] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T21:43:16.150999] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-10-21T21:43:16.763534] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T21:43:16.951016] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-10. [2025-10-21T21:43:17.044398] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T21:43:17.053963] [INFO ] [REMOTE ] UWMC: Full fetch complete (75920 records). [2025-10-21T21:43:17.054128] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-10-21T21:43:17.501291] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-10-21T21:43:17.501472] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-10-21T21:43:17.504120] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-10-21T21:43:17.504221] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-10-21T21:43:17.506717] [DEBUG] [LOCAL ] UWMC: Trimmed 75920 records to 52961 (keeping 200 days of data) [2025-10-21T21:43:17.575063] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T21:43:17.611843] [INFO ] [REMOTE ] UZE: Full fetch complete (9805 records). [2025-10-21T21:43:17.616387] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-10-21T21:43:17.752331] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-10-21T21:43:18.225108] [DEBUG] [LOCAL ] UWMC: Primary data saved (52961 records). [2025-10-21T21:43:18.233085] [INFO ] [MAIN ] UWMC: Full history saved. [2025-10-21T21:43:18.233436] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-10-21T21:43:18.233244] [INFO ] [MAIN ] Update Progress: 2205/2366 symbols completed. UWMC took 49.4s. Estimated remaining: 20m 41s. Rate: 7.8 symbols/min [2025-10-21T21:43:18.239090] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-10-21T21:43:18.278715] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-10-21T21:43:18.278858] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-10-21T21:43:18.318692] [DEBUG] [LOCAL ] UZE: Trimmed 9805 records to 7025 (keeping 200 days of data) [2025-10-21T21:43:18.464176] [DEBUG] [LOCAL ] UZE: Primary data saved (7025 records). [2025-10-21T21:43:18.466118] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:43:18.466333] [INFO ] [MAIN ] UZE: Full history saved. [2025-10-21T21:43:18.467051] [INFO ] [MAIN ] Update Progress: 2206/2366 symbols completed. UZE took 21.7s. Estimated remaining: 20m 33s. Rate: 7.8 symbols/min [2025-10-21T21:43:18.560507] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-10-21T21:43:18.660924] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:43:18.684394] [DEBUG] [LOCAL ] VAC: Loaded 33877 existing records from primary storage. [2025-10-21T21:43:18.685008] [INFO ] [MAIN ] VAC: Loaded 33877 existing records. [2025-10-21T21:43:18.903421] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:43:18.905069] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-10-21T21:43:18.905159] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-10-21T21:43:18.906056] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-10-21T21:43:18.906159] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-10-21T21:43:18.905978] [DEBUG] [LOCAL ] VAL: Loaded 50021 existing records from primary storage. [2025-10-21T21:43:18.951285] [INFO ] [MAIN ] VAL: Loaded 50021 existing records. [2025-10-21T21:43:19.338909] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:43:19.385386] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-10-21T21:43:19.385706] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-10-21T21:43:19.419492] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-21T21:43:19.424374] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-10-21T21:43:19.427032] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-10-21T21:43:19.427861] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-10-21T21:43:19.609432] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:43:19.898617] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:43:20.055744] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-21T21:43:20.151078] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-10-21T21:43:20.408347] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T21:43:20.951076] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-10-21T21:43:21.751022] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-10-21T21:43:21.881477] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T21:43:22.375920] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-21T21:43:22.551048] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-10-21T21:43:23.043616] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-21T21:43:23.351061] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-10-21T21:43:23.905741] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T21:43:24.151090] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-10-21T21:43:24.951080] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-10-21T21:43:25.522237] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T21:43:25.698561] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-21T21:43:25.751017] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-10-21T21:43:26.199789] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T21:43:26.551052] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-10-21T21:43:26.913899] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-21T21:43:27.233942] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T21:43:27.351045] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-10-21T21:43:28.151007] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-10-21T21:43:28.626574] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-21T21:43:28.910084] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T21:43:28.950983] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-10-21T21:43:29.751082] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-10-21T21:43:30.434107] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T21:43:30.551042] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-10-21T21:43:31.319557] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T21:43:31.350994] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-10-21T21:43:31.377164] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-21T21:43:32.151064] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-10-21T21:43:32.951021] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-10-21T21:43:33.172563] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T21:43:33.751062] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-10-21T21:43:34.399788] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-21T21:43:34.536892] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-21T21:43:34.550981] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-10-21T21:43:35.351096] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-10-21T21:43:35.480934] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T21:43:36.151120] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-10-21T21:43:36.698933] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T21:43:36.731724] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-21T21:43:36.800118] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-21T21:43:36.951073] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-10-21T21:43:37.751067] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-10-21T21:43:38.018610] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T21:43:38.551074] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-10-21T21:43:39.291859] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T21:43:39.351000] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-10-21T21:43:40.151008] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-10. [2025-10-21T21:43:40.643197] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T21:43:40.644211] [INFO ] [REMOTE ] UZF: Full fetch complete (8425 records). [2025-10-21T21:43:40.644276] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-10-21T21:43:40.833755] [WARN ] [VALIDATOR ] UZF: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T21:43:40.834349] [FATAL] [MAIN ] UZF: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:43:40.834596] [WARN ] [MAIN ] UZF: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:43:40.834882] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-10-21T21:43:40.835005] [DEBUG] [LOCAL ] UZF: No primary data file found to delete. [2025-10-21T21:43:40.835227] [INFO ] [LOCAL ] UZF: Starting deletion of derivative data. [2025-10-21T21:43:40.835306] [DEBUG] [LOCAL ] UZF: No derivative data file found to delete. [2025-10-21T21:43:40.835401] [INFO ] [MAIN ] Update Progress: 2207/2366 symbols completed. UZF took 32.1s. Estimated remaining: 20m 26s. Rate: 7.8 symbols/min [2025-10-21T21:43:40.963790] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-10-21T21:43:41.015579] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:43:41.076306] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-10-21T21:43:41.090339] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-21T21:43:41.145953] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-21T21:43:41.146276] [INFO ] [MAIN ] VALE: Loaded 53693 existing records. [2025-10-21T21:43:41.327159] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:43:41.327365] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-10-21T21:43:41.327410] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-10-21T21:43:41.327788] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-10-21T21:43:41.327845] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-10-21T21:43:41.695421] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:43:41.751043] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-10-21T21:43:42.417766] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T21:43:42.551036] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-10-21T21:43:43.350998] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-10. [2025-10-21T21:43:43.883548] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-21T21:43:44.151014] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-10-21T21:43:44.365151] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T21:43:44.536360] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T21:43:44.541285] [INFO ] [REMOTE ] VAC: Full fetch complete (48667 records). [2025-10-21T21:43:44.541376] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-10-21T21:43:44.921905] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-10-21T21:43:44.921981] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-10-21T21:43:44.923048] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-10-21T21:43:44.923110] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-10-21T21:43:44.924072] [DEBUG] [LOCAL ] VAC: Trimmed 48667 records to 33699 (keeping 200 days of data) [2025-10-21T21:43:44.976389] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-10-21T21:43:45.137306] [DEBUG] [LOCAL ] VAC: Primary data saved (33699 records). [2025-10-21T21:43:45.137451] [INFO ] [MAIN ] VAC: Full history saved. [2025-10-21T21:43:45.137550] [INFO ] [MAIN ] Update Progress: 2208/2366 symbols completed. VAC took 26.9s. Estimated remaining: 20m 18s. Rate: 7.8 symbols/min [2025-10-21T21:43:45.326747] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:43:45.334063] [DEBUG] [LOCAL ] VATE: Loaded 5107 existing records from primary storage. [2025-10-21T21:43:45.334229] [INFO ] [MAIN ] VATE: Loaded 5107 existing records. [2025-10-21T21:43:45.510182] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:43:45.510366] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-10-21T21:43:45.510417] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-10-21T21:43:45.510552] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-10-21T21:43:45.510607] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-10-21T21:43:45.756093] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-10-21T21:43:45.855751] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:43:46.495098] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-21T21:43:46.550979] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-10-21T21:43:46.709226] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T21:43:47.351062] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-10-21T21:43:47.884339] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-21T21:43:48.150997] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-10. [2025-10-21T21:43:48.392138] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T21:43:48.575113] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T21:43:48.951023] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-10-21T21:43:49.722992] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T21:43:49.730713] [INFO ] [REMOTE ] VAL: Full fetch complete (72926 records). [2025-10-21T21:43:49.730849] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-10-21T21:43:49.756403] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-10-21T21:43:49.865775] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T21:43:50.190633] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-10-21T21:43:50.190760] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-10-21T21:43:50.192325] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-10-21T21:43:50.192414] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-10-21T21:43:50.193975] [DEBUG] [LOCAL ] VAL: Trimmed 72926 records to 49919 (keeping 200 days of data) [2025-10-21T21:43:50.553436] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-10-21T21:43:50.608772] [DEBUG] [LOCAL ] VAL: Primary data saved (49919 records). [2025-10-21T21:43:50.608961] [INFO ] [MAIN ] VAL: Full history saved. [2025-10-21T21:43:50.610254] [INFO ] [MAIN ] Update Progress: 2209/2366 symbols completed. VAL took 32.1s. Estimated remaining: 20m 10s. Rate: 7.8 symbols/min [2025-10-21T21:43:50.837834] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:43:50.852168] [DEBUG] [LOCAL ] VBF: Loaded 7267 existing records from primary storage. [2025-10-21T21:43:50.852474] [INFO ] [MAIN ] VBF: Loaded 7267 existing records. [2025-10-21T21:43:51.109098] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:43:51.109321] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-10-21T21:43:51.109368] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-10-21T21:43:51.109516] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-10-21T21:43:51.109553] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-10-21T21:43:51.372417] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-10-21T21:43:51.486317] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:43:51.841983] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-21T21:43:52.151049] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-10-21T21:43:52.181878] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-21T21:43:52.584823] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T21:43:52.951065] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-10-21T21:43:53.592310] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-21T21:43:53.751018] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-10-21T21:43:54.489149] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-21T21:43:54.489798] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T21:43:54.550979] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-10-21T21:43:55.351032] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-10-21T21:43:55.976714] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-21T21:43:56.151038] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-10-21T21:43:56.636885] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-21T21:43:56.898960] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-21T21:43:56.951025] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-10-21T21:43:57.650216] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-21T21:43:57.750982] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-10-21T21:43:58.408586] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-21T21:43:58.550995] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-10-21T21:43:59.351035] [INFO ] [REMOTE ] V: Fetching primary data for 2025-10. [2025-10-21T21:44:00.112934] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T21:44:00.121999] [INFO ] [REMOTE ] V: Full fetch complete (77927 records). [2025-10-21T21:44:00.122128] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-10-21T21:44:00.156064] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-10-21T21:44:00.554334] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-10-21T21:44:00.554444] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-10-21T21:44:00.555813] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-10-21T21:44:00.555893] [DEBUG] [LOCAL ] V: Saving primary data. [2025-10-21T21:44:00.557493] [DEBUG] [LOCAL ] V: Trimmed 77927 records to 53751 (keeping 200 days of data) [2025-10-21T21:44:00.684935] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-21T21:44:00.934374] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-21T21:44:00.937387] [DEBUG] [LOCAL ] V: Primary data saved (53751 records). [2025-10-21T21:44:00.938847] [INFO ] [MAIN ] V: Full history saved. [2025-10-21T21:44:00.942189] [INFO ] [MAIN ] Update Progress: 2210/2366 symbols completed. V took 48.7s. Estimated remaining: 20m 3s. Rate: 7.8 symbols/min [2025-10-21T21:44:00.956184] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-10-21T21:44:01.112365] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:44:01.129348] [DEBUG] [LOCAL ] VCV: Loaded 13517 existing records from primary storage. [2025-10-21T21:44:01.129630] [INFO ] [MAIN ] VCV: Loaded 13517 existing records. [2025-10-21T21:44:01.304591] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:44:01.304807] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-10-21T21:44:01.304910] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-10-21T21:44:01.305090] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-10-21T21:44:01.305129] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-10-21T21:44:01.654613] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:44:01.751031] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-10-21T21:44:02.328353] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-21T21:44:02.551065] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-10-21T21:44:03.323663] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-21T21:44:03.350994] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-10-21T21:44:03.387427] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-21T21:44:04.151059] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-10-21T21:44:04.907876] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-21T21:44:04.951111] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-10-21T21:44:05.276271] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T21:44:05.729843] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T21:44:05.751071] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-10-21T21:44:06.551060] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-10-21T21:44:07.204018] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-21T21:44:07.351053] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-10-21T21:44:07.675879] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-21T21:44:08.099736] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-21T21:44:08.151031] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-10. [2025-10-21T21:44:08.951057] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-10-21T21:44:09.701628] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-21T21:44:09.751030] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-10-21T21:44:10.179623] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-21T21:44:10.187938] [INFO ] [REMOTE ] VALE: Full fetch complete (77873 records). [2025-10-21T21:44:10.188054] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-10-21T21:44:10.522099] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-21T21:44:10.556096] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-10-21T21:44:10.644395] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-10-21T21:44:10.644525] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-10-21T21:44:10.646770] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-10-21T21:44:10.646850] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-10-21T21:44:10.649170] [DEBUG] [LOCAL ] VALE: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-21T21:44:11.033523] [DEBUG] [LOCAL ] VALE: Primary data saved (53693 records). [2025-10-21T21:44:11.033753] [INFO ] [MAIN ] VALE: Full history saved. [2025-10-21T21:44:11.033917] [INFO ] [MAIN ] Update Progress: 2211/2366 symbols completed. VALE took 30.2s. Estimated remaining: 19m 55s. Rate: 7.8 symbols/min [2025-10-21T21:44:11.227409] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:44:11.280065] [DEBUG] [LOCAL ] VEEV: Loaded 47245 existing records from primary storage. [2025-10-21T21:44:11.280522] [INFO ] [MAIN ] VEEV: Loaded 47245 existing records. [2025-10-21T21:44:11.353531] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-10-21T21:44:11.462277] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-21T21:44:11.499508] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:44:11.503281] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-10-21T21:44:11.503369] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-10-21T21:44:11.503635] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-10-21T21:44:11.503785] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-10-21T21:44:11.942521] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:44:12.145766] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-21T21:44:12.150968] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-10-21T21:44:12.845121] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-21T21:44:12.951042] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-10-21T21:44:13.621633] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-21T21:44:13.751067] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-10. [2025-10-21T21:44:14.522246] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-21T21:44:14.524405] [INFO ] [REMOTE ] VBF: Full fetch complete (10923 records). [2025-10-21T21:44:14.524474] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-10-21T21:44:14.556178] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-10-21T21:44:14.886334] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-10-21T21:44:14.886415] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-10-21T21:44:14.886711] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-10-21T21:44:14.886792] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-10-21T21:44:14.887564] [DEBUG] [LOCAL ] VBF: Trimmed 10923 records to 7245 (keeping 200 days of data) [2025-10-21T21:44:14.931701] [DEBUG] [LOCAL ] VBF: Primary data saved (7245 records). [2025-10-21T21:44:14.931840] [INFO ] [MAIN ] VBF: Full history saved. [2025-10-21T21:44:14.931917] [INFO ] [MAIN ] Update Progress: 2212/2366 symbols completed. VBF took 24.3s. Estimated remaining: 19m 47s. Rate: 7.8 symbols/min [2025-10-21T21:44:15.104701] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:44:15.118198] [DEBUG] [LOCAL ] VEL: Loaded 12088 existing records from primary storage. [2025-10-21T21:44:15.118420] [INFO ] [MAIN ] VEL: Loaded 12088 existing records. [2025-10-21T21:44:15.303159] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:44:15.303393] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-10-21T21:44:15.303444] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-10-21T21:44:15.303617] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-10-21T21:44:15.303703] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-10-21T21:44:15.356730] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-10-21T21:44:15.606728] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T21:44:15.676074] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:44:16.132920] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-21T21:44:16.150973] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-10. [2025-10-21T21:44:16.531329] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-21T21:44:16.532768] [INFO ] [REMOTE ] VATE: Full fetch complete (10611 records). [2025-10-21T21:44:16.532835] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-10-21T21:44:16.890099] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-10-21T21:44:16.890178] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-10-21T21:44:16.890423] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-10-21T21:44:16.890460] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-10-21T21:44:16.890894] [DEBUG] [LOCAL ] VATE: Trimmed 10611 records to 5093 (keeping 200 days of data) [2025-10-21T21:44:16.917966] [DEBUG] [LOCAL ] VATE: Primary data saved (5093 records). [2025-10-21T21:44:16.918043] [INFO ] [MAIN ] VATE: Full history saved. [2025-10-21T21:44:16.918110] [INFO ] [MAIN ] Update Progress: 2213/2366 symbols completed. VATE took 31.8s. Estimated remaining: 19m 39s. Rate: 7.8 symbols/min [2025-10-21T21:44:16.956689] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-10-21T21:44:17.087706] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:44:17.125939] [DEBUG] [LOCAL ] VET: Loaded 44200 existing records from primary storage. [2025-10-21T21:44:17.126218] [INFO ] [MAIN ] VET: Loaded 44200 existing records. [2025-10-21T21:44:17.301573] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:44:17.301824] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-10-21T21:44:17.301870] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-10-21T21:44:17.302045] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-10-21T21:44:17.302080] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-10-21T21:44:17.658205] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:44:17.753675] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-10-21T21:44:17.754453] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T21:44:18.551092] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-10-21T21:44:19.330299] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-21T21:44:19.351013] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-10-21T21:44:19.357907] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T21:44:20.151039] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-10-21T21:44:20.951076] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-10-21T21:44:21.000366] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-21T21:44:21.156457] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-21T21:44:21.751002] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-10-21T21:44:21.906269] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-21T21:44:22.551042] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-10-21T21:44:23.271495] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-21T21:44:23.357954] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-10-21T21:44:23.358871] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-21T21:44:24.151045] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-10-21T21:44:24.288696] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-21T21:44:24.951066] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-10-21T21:44:25.085385] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T21:44:25.751018] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-10-21T21:44:26.551113] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-10-21T21:44:26.616584] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T21:44:26.736021] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T21:44:27.351006] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-10-21T21:44:27.467543] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-21T21:44:28.151108] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-10. [2025-10-21T21:44:28.859207] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T21:44:28.861209] [INFO ] [REMOTE ] VCV: Full fetch complete (18425 records). [2025-10-21T21:44:28.861291] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-10-21T21:44:28.956206] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-10-21T21:44:29.253007] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T21:44:29.262915] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-10-21T21:44:29.262991] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-10-21T21:44:29.272286] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-10-21T21:44:29.272364] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-10-21T21:44:29.273590] [DEBUG] [LOCAL ] VCV: Trimmed 18425 records to 13321 (keeping 200 days of data) [2025-10-21T21:44:29.352666] [DEBUG] [LOCAL ] VCV: Primary data saved (13321 records). [2025-10-21T21:44:29.352801] [INFO ] [MAIN ] VCV: Full history saved. [2025-10-21T21:44:29.352877] [INFO ] [MAIN ] Update Progress: 2214/2366 symbols completed. VCV took 28.4s. Estimated remaining: 19m 32s. Rate: 7.8 symbols/min [2025-10-21T21:44:29.520673] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:44:29.572206] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-21T21:44:29.572505] [INFO ] [MAIN ] VFC: Loaded 53607 existing records. [2025-10-21T21:44:29.750359] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:44:29.750601] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-10-21T21:44:29.750673] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-10-21T21:44:29.750878] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-10-21T21:44:29.750916] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-10-21T21:44:29.761911] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-10-21T21:44:30.134847] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:44:30.521072] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-21T21:44:30.550999] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-10-21T21:44:30.737964] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-21T21:44:31.351029] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-10-21T21:44:32.034967] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T21:44:32.150997] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-10-21T21:44:32.196734] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T21:44:32.951026] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-10-21T21:44:33.607241] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-21T21:44:33.760709] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-10-21T21:44:33.766089] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T21:44:34.551032] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-10-21T21:44:35.351025] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-10. [2025-10-21T21:44:35.554804] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T21:44:36.151016] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-10-21T21:44:36.214225] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-21T21:44:36.216497] [INFO ] [REMOTE ] VEL: Full fetch complete (17163 records). [2025-10-21T21:44:36.216570] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-10-21T21:44:36.546489] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T21:44:36.631315] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-10-21T21:44:36.631399] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-10-21T21:44:36.631831] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-10-21T21:44:36.631891] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-10-21T21:44:36.632507] [DEBUG] [LOCAL ] VEL: Trimmed 17163 records to 11980 (keeping 200 days of data) [2025-10-21T21:44:36.715737] [DEBUG] [LOCAL ] VEL: Primary data saved (11980 records). [2025-10-21T21:44:36.715883] [INFO ] [MAIN ] VEL: Full history saved. [2025-10-21T21:44:36.715964] [INFO ] [MAIN ] Update Progress: 2215/2366 symbols completed. VEL took 21.8s. Estimated remaining: 19m 24s. Rate: 7.8 symbols/min [2025-10-21T21:44:36.911780] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:44:36.911974] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-10-21T21:44:36.912011] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-10-21T21:44:36.912121] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-10-21T21:44:36.912161] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-21T21:44:36.912202] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-21T21:44:36.912234] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-10-21T21:44:36.956818] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-10-21T21:44:37.269595] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:44:37.751049] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-10-21T21:44:37.937549] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-21T21:44:38.551020] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-10-21T21:44:38.583284] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T21:44:39.351024] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-10-21T21:44:39.588315] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-21T21:44:40.030611] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T21:44:40.151032] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-10-21T21:44:40.515911] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-21T21:44:40.951072] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-10-21T21:44:41.751028] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-10-21T21:44:41.824713] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T21:44:42.551046] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-10-21T21:44:42.956303] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-21T21:44:43.020385] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-21T21:44:43.351058] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-10-21T21:44:44.151113] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-10-21T21:44:44.281385] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-21T21:44:44.824731] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T21:44:44.951081] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-10-21T21:44:45.751086] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-10-21T21:44:46.104736] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T21:44:46.551057] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-10-21T21:44:46.719252] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T21:44:47.267817] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:44:47.351019] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-10. [2025-10-21T21:44:48.150999] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-10-21T21:44:48.584059] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-21T21:44:48.750325] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T21:44:48.757478] [INFO ] [REMOTE ] VET: Full fetch complete (64510 records). [2025-10-21T21:44:48.757606] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-10-21T21:44:48.962230] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-10-21T21:44:49.160086] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-10-21T21:44:49.160187] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-10-21T21:44:49.161704] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-10-21T21:44:49.161785] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-10-21T21:44:49.163491] [DEBUG] [LOCAL ] VET: Trimmed 64510 records to 44150 (keeping 200 days of data) [2025-10-21T21:44:49.421926] [DEBUG] [LOCAL ] VET: Primary data saved (44150 records). [2025-10-21T21:44:49.422058] [INFO ] [MAIN ] VET: Full history saved. [2025-10-21T21:44:49.422695] [INFO ] [MAIN ] Update Progress: 2216/2366 symbols completed. VET took 32.5s. Estimated remaining: 19m 17s. Rate: 7.8 symbols/min [2025-10-21T21:44:49.599311] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:44:49.609320] [DEBUG] [LOCAL ] VGI: Loaded 5227 existing records from primary storage. [2025-10-21T21:44:49.609535] [INFO ] [MAIN ] VGI: Loaded 5227 existing records. [2025-10-21T21:44:49.756101] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-10-21T21:44:49.803219] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:44:49.803560] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-10-21T21:44:49.803627] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-10-21T21:44:49.803848] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-10-21T21:44:49.803909] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-10-21T21:44:50.166876] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:44:50.254636] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-21T21:44:50.551014] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-10-21T21:44:50.729014] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T21:44:51.351061] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-10-21T21:44:51.818382] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-21T21:44:52.151000] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-10-21T21:44:52.500480] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T21:44:52.878290] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T21:44:52.951023] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-10. [2025-10-21T21:44:53.750999] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-10-21T21:44:53.987397] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-21T21:44:54.364931] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-21T21:44:54.372321] [INFO ] [REMOTE ] VEEV: Full fetch complete (68420 records). [2025-10-21T21:44:54.372452] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-10-21T21:44:54.560278] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-10-21T21:44:54.756152] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-10-21T21:44:54.756232] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-10-21T21:44:54.757340] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-10-21T21:44:54.757403] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-10-21T21:44:54.758666] [DEBUG] [LOCAL ] VEEV: Trimmed 68420 records to 47200 (keeping 200 days of data) [2025-10-21T21:44:55.033393] [DEBUG] [LOCAL ] VEEV: Primary data saved (47200 records). [2025-10-21T21:44:55.033528] [INFO ] [MAIN ] VEEV: Full history saved. [2025-10-21T21:44:55.033606] [INFO ] [MAIN ] Update Progress: 2217/2366 symbols completed. VEEV took 44.0s. Estimated remaining: 19m 9s. Rate: 7.8 symbols/min [2025-10-21T21:44:55.205531] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:44:55.224538] [DEBUG] [LOCAL ] VGM: Loaded 18689 existing records from primary storage. [2025-10-21T21:44:55.224810] [INFO ] [MAIN ] VGM: Loaded 18689 existing records. [2025-10-21T21:44:55.354715] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-10-21T21:44:55.412056] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:44:55.413358] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-10-21T21:44:55.413445] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-10-21T21:44:55.413597] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-10-21T21:44:55.413635] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-10-21T21:44:55.474481] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T21:44:55.782139] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:44:55.815372] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T21:44:56.151072] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-10-21T21:44:56.739478] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T21:44:56.951070] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-10-21T21:44:57.359025] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-21T21:44:57.751012] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-10. [2025-10-21T21:44:58.551001] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-10-21T21:44:58.924078] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-21T21:44:59.351031] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-10-21T21:44:59.376969] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-21T21:44:59.586053] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-21T21:44:59.598280] [INFO ] [REMOTE ] VFC: Full fetch complete (77749 records). [2025-10-21T21:44:59.598446] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-10-21T21:44:59.991620] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T21:44:59.991862] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-10-21T21:44:59.993792] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-10-21T21:44:59.995007] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-10-21T21:44:59.995068] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-10-21T21:44:59.996331] [DEBUG] [LOCAL ] VFC: Trimmed 77749 records to 53607 (keeping 200 days of data) [2025-10-21T21:45:00.173789] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-10-21T21:45:00.327254] [DEBUG] [LOCAL ] VFC: Primary data saved (53607 records). [2025-10-21T21:45:00.327393] [INFO ] [MAIN ] VFC: Full history saved. [2025-10-21T21:45:00.327940] [INFO ] [MAIN ] Update Progress: 2218/2366 symbols completed. VFC took 31.0s. Estimated remaining: 19m 1s. Rate: 7.8 symbols/min [2025-10-21T21:45:00.494622] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:45:00.500258] [DEBUG] [LOCAL ] VHI: Loaded 2733 existing records from primary storage. [2025-10-21T21:45:00.500450] [INFO ] [MAIN ] VHI: Loaded 2733 existing records. [2025-10-21T21:45:00.679703] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:45:00.679914] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-10-21T21:45:00.679964] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-10-21T21:45:00.680132] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-10-21T21:45:00.680190] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-10-21T21:45:00.955326] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-10-21T21:45:01.036764] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:45:01.751055] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-10-21T21:45:02.148015] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T21:45:02.368588] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-21T21:45:02.549885] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T21:45:02.551581] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-10-21T21:45:02.964244] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-21T21:45:03.351038] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-10-21T21:45:04.151006] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-10-21T21:45:04.385245] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-21T21:45:04.600438] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-21T21:45:04.951018] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-10-21T21:45:05.612733] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-21T21:45:05.751015] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-10-21T21:45:06.551039] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-10-21T21:45:06.821267] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T21:45:07.154558] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T21:45:07.351040] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-10-21T21:45:07.830610] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T21:45:08.151068] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-10-21T21:45:08.852584] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-21T21:45:08.951014] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-10-21T21:45:09.591294] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-21T21:45:09.751036] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-10-21T21:45:10.487274] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-21T21:45:10.550990] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-10. [2025-10-21T21:45:11.114914] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-21T21:45:11.116183] [INFO ] [REMOTE ] VGI: Full fetch complete (7567 records). [2025-10-21T21:45:11.116252] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-10-21T21:45:11.359436] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-10-21T21:45:11.522276] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-10-21T21:45:11.522353] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-10-21T21:45:11.522558] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-10-21T21:45:11.522595] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-10-21T21:45:11.523005] [DEBUG] [LOCAL ] VGI: Trimmed 7567 records to 5225 (keeping 200 days of data) [2025-10-21T21:45:11.552675] [DEBUG] [LOCAL ] VGI: Primary data saved (5225 records). [2025-10-21T21:45:11.552782] [INFO ] [MAIN ] VGI: Full history saved. [2025-10-21T21:45:11.552856] [INFO ] [MAIN ] Update Progress: 2219/2366 symbols completed. VGI took 22.1s. Estimated remaining: 18m 53s. Rate: 7.8 symbols/min [2025-10-21T21:45:11.735235] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:45:11.735464] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-10-21T21:45:11.735515] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-10-21T21:45:11.735630] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-10-21T21:45:11.735721] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-21T21:45:11.735829] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-21T21:45:11.735909] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-10-21T21:45:12.026486] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-21T21:45:12.105214] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:45:12.151058] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-10-21T21:45:12.364283] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:45:12.364607] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-10-21T21:45:12.364715] [FATAL] [REMOTE ] VIA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:45:12.364764] [FATAL] [MAIN ] VIA: Failed to fetch primary data. [2025-10-21T21:45:12.364824] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:45:12.364895] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-10-21T21:45:12.364955] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-10-21T21:45:12.364990] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-10-21T21:45:12.365031] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-10-21T21:45:12.365084] [INFO ] [MAIN ] Update Progress: 2220/2366 symbols completed. VIA took 0.8s. Estimated remaining: 18m 45s. Rate: 7.8 symbols/min [2025-10-21T21:45:12.538758] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:45:12.590375] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-21T21:45:12.590739] [INFO ] [MAIN ] VICI: Loaded 53653 existing records. [2025-10-21T21:45:12.770852] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:45:12.771063] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-10-21T21:45:12.771113] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-10-21T21:45:12.771326] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-10-21T21:45:12.771380] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-10-21T21:45:12.957749] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-10-21T21:45:13.123029] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:45:13.540593] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-21T21:45:13.751039] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-10-21T21:45:14.551082] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-10-21T21:45:15.351059] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-10-21T21:45:15.768835] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-21T21:45:15.769726] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T21:45:16.151031] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-10-21T21:45:16.683225] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-21T21:45:16.951015] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-10-21T21:45:17.101617] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-21T21:45:17.520281] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T21:45:17.751095] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-10-21T21:45:18.241553] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-21T21:45:18.551042] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-10-21T21:45:19.351093] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-10-21T21:45:19.894756] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-21T21:45:20.151007] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-10-21T21:45:20.292454] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T21:45:20.951045] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-10. [2025-10-21T21:45:21.751023] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-10-21T21:45:21.994819] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T21:45:22.550984] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-10. [2025-10-21T21:45:22.868078] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T21:45:23.039080] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T21:45:23.041283] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-21T21:45:23.042790] [INFO ] [REMOTE ] VHI: Full fetch complete (4323 records). [2025-10-21T21:45:23.043059] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-10-21T21:45:23.131751] [INFO ] [REMOTE ] VG: Full fetch complete (72299 records). [2025-10-21T21:45:23.152670] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-10-21T21:45:23.362431] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-10-21T21:45:23.539129] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-21T21:45:23.550843] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:45:23.561198] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:45:23.566430] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-10-21T21:45:23.578958] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-10-21T21:45:23.579038] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-10-21T21:45:23.597590] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-10-21T21:45:23.618391] [INFO ] [MAIN ] Update Progress: 2221/2366 symbols completed. VG took 46.9s. Estimated remaining: 18m 38s. Rate: 7.8 symbols/min [2025-10-21T21:45:23.618589] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-10-21T21:45:23.624753] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-10-21T21:45:23.651217] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-10-21T21:45:23.662616] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-10-21T21:45:23.695549] [DEBUG] [LOCAL ] VHI: Trimmed 4323 records to 2711 (keeping 200 days of data) [2025-10-21T21:45:23.755956] [DEBUG] [LOCAL ] VHI: Primary data saved (2711 records). [2025-10-21T21:45:23.756046] [INFO ] [MAIN ] VHI: Full history saved. [2025-10-21T21:45:23.761246] [INFO ] [MAIN ] Update Progress: 2222/2366 symbols completed. VHI took 23.4s. Estimated remaining: 18m 29s. Rate: 7.8 symbols/min [2025-10-21T21:45:23.894263] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:45:23.985579] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:45:24.030515] [DEBUG] [LOCAL ] VIK: Loaded 52392 existing records from primary storage. [2025-10-21T21:45:24.030942] [INFO ] [MAIN ] VIK: Loaded 52392 existing records. [2025-10-21T21:45:24.155943] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-10-21T21:45:24.209046] [DEBUG] [LOCAL ] VIPS: Loaded 51269 existing records from primary storage. [2025-10-21T21:45:24.254017] [INFO ] [MAIN ] VIPS: Loaded 51269 existing records. [2025-10-21T21:45:24.287322] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:45:24.350757] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-10-21T21:45:24.373797] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-10-21T21:45:24.385091] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-10-21T21:45:24.385233] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-10-21T21:45:24.585536] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:45:24.613455] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-10-21T21:45:24.632946] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-10-21T21:45:24.614541] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T21:45:24.665909] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-10-21T21:45:24.705329] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-10-21T21:45:24.998258] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:45:24.969515] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-10-21T21:45:25.230385] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:45:25.751034] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-10-21T21:45:26.094835] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T21:45:26.195573] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-21T21:45:26.551043] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-10-21T21:45:27.358725] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-10-21T21:45:27.385481] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T21:45:27.424427] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-21T21:45:28.151056] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-10-21T21:45:28.951037] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-10. [2025-10-21T21:45:29.494287] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T21:45:29.749876] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T21:45:29.759294] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-10-21T21:45:29.823844] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-21T21:45:29.827145] [INFO ] [REMOTE ] VGM: Full fetch complete (25802 records). [2025-10-21T21:45:29.827251] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-10-21T21:45:30.191298] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-10-21T21:45:30.191376] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-10-21T21:45:30.191910] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-10-21T21:45:30.191971] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-10-21T21:45:30.192697] [DEBUG] [LOCAL ] VGM: Trimmed 25802 records to 18689 (keeping 200 days of data) [2025-10-21T21:45:30.307135] [DEBUG] [LOCAL ] VGM: Primary data saved (18689 records). [2025-10-21T21:45:30.307304] [INFO ] [MAIN ] VGM: Full history saved. [2025-10-21T21:45:30.307402] [INFO ] [MAIN ] Update Progress: 2223/2366 symbols completed. VGM took 35.3s. Estimated remaining: 18m 22s. Rate: 7.8 symbols/min [2025-10-21T21:45:30.499752] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:45:30.542856] [DEBUG] [LOCAL ] VIRT: Loaded 46585 existing records from primary storage. [2025-10-21T21:45:30.543177] [INFO ] [MAIN ] VIRT: Loaded 46585 existing records. [2025-10-21T21:45:30.556138] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-10-21T21:45:30.719588] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:45:30.719814] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-10-21T21:45:30.719861] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-10-21T21:45:30.720063] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-10-21T21:45:30.720119] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-10-21T21:45:31.066698] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:45:31.351039] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-10-21T21:45:31.490922] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T21:45:32.150993] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-10-21T21:45:32.376513] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-21T21:45:32.581794] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T21:45:32.951080] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-10-21T21:45:33.751062] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-10-21T21:45:33.778016] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T21:45:34.551074] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-10-21T21:45:34.803435] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T21:45:35.351010] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-10-21T21:45:35.593434] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T21:45:35.724628] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T21:45:36.151037] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-10-21T21:45:36.951005] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-10-21T21:45:37.078625] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T21:45:37.751008] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-10-21T21:45:37.892515] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T21:45:38.551017] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-10-21T21:45:38.968985] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T21:45:39.351004] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-10-21T21:45:39.530071] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T21:45:40.151013] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-10-21T21:45:40.276098] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T21:45:40.951021] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-10-21T21:45:41.095528] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T21:45:41.332214] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T21:45:41.751081] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-10-21T21:45:42.551007] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-10-21T21:45:42.643016] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T21:45:43.351032] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-10-21T21:45:43.416835] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T21:45:44.007081] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T21:45:44.151011] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-10-21T21:45:44.949745] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T21:45:44.960038] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-10-21T21:45:45.649364] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T21:45:45.750989] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-10-21T21:45:46.551028] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-10-21T21:45:46.602457] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-21T21:45:47.351005] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-10-21T21:45:47.533097] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T21:45:47.860119] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-21T21:45:48.151024] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-10-21T21:45:48.951096] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-10-21T21:45:49.028906] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T21:45:49.751047] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-10-21T21:45:49.826047] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T21:45:50.551034] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-10-21T21:45:50.985418] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-21T21:45:51.030964] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-21T21:45:51.351040] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-10. [2025-10-21T21:45:51.976218] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-21T21:45:51.984508] [INFO ] [REMOTE ] VICI: Full fetch complete (77801 records). [2025-10-21T21:45:51.984690] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-10-21T21:45:52.151156] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-10. [2025-10-21T21:45:52.409372] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T21:45:52.438586] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-10-21T21:45:52.439309] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-10-21T21:45:52.440670] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-10-21T21:45:52.440752] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-10-21T21:45:52.442605] [DEBUG] [LOCAL ] VICI: Trimmed 77801 records to 53653 (keeping 200 days of data) [2025-10-21T21:45:52.779757] [DEBUG] [LOCAL ] VICI: Primary data saved (53653 records). [2025-10-21T21:45:52.779895] [INFO ] [MAIN ] VICI: Full history saved. [2025-10-21T21:45:52.780525] [INFO ] [MAIN ] Update Progress: 2224/2366 symbols completed. VICI took 40.4s. Estimated remaining: 18m 15s. Rate: 7.8 symbols/min [2025-10-21T21:45:52.961288] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-10-21T21:45:52.966032] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:45:53.017099] [DEBUG] [LOCAL ] VIST: Loaded 46676 existing records from primary storage. [2025-10-21T21:45:53.017436] [INFO ] [MAIN ] VIST: Loaded 46676 existing records. [2025-10-21T21:45:53.190561] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:45:53.190814] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-10-21T21:45:53.190861] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-10-21T21:45:53.191118] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-10-21T21:45:53.191175] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-10-21T21:45:53.544450] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:45:53.751053] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-10-21T21:45:53.917536] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-21T21:45:53.926056] [INFO ] [REMOTE ] VIK: Full fetch complete (75965 records). [2025-10-21T21:45:53.926219] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-10-21T21:45:54.467348] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-10-21T21:45:54.467570] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-10-21T21:45:54.470457] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-10-21T21:45:54.470575] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-10-21T21:45:54.472762] [DEBUG] [LOCAL ] VIK: Trimmed 75965 records to 52374 (keeping 200 days of data) [2025-10-21T21:45:54.553978] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-10-21T21:45:54.783311] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-21T21:45:54.966251] [DEBUG] [LOCAL ] VIK: Primary data saved (52374 records). [2025-10-21T21:45:54.966434] [INFO ] [MAIN ] VIK: Full history saved. [2025-10-21T21:45:54.966554] [INFO ] [MAIN ] Update Progress: 2225/2366 symbols completed. VIK took 31.3s. Estimated remaining: 18m 7s. Rate: 7.8 symbols/min [2025-10-21T21:45:55.183813] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:45:55.227876] [DEBUG] [LOCAL ] VIV: Loaded 44697 existing records from primary storage. [2025-10-21T21:45:55.228222] [INFO ] [MAIN ] VIV: Loaded 44697 existing records. [2025-10-21T21:45:55.356120] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-10-21T21:45:55.422590] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:45:55.422890] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-10-21T21:45:55.423067] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-10-21T21:45:55.423588] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-10-21T21:45:55.423717] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-10-21T21:45:55.806231] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:45:55.870342] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T21:45:56.151013] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-10-21T21:45:56.374226] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-21T21:45:56.951052] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-10-21T21:45:57.093156] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T21:45:57.650132] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T21:45:57.751070] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-10-21T21:45:58.564607] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-10. [2025-10-21T21:45:58.568626] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T21:45:59.115494] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-21T21:45:59.351074] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-10. [2025-10-21T21:46:00.137445] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T21:46:00.145421] [INFO ] [REMOTE ] VIRT: Full fetch complete (67562 records). [2025-10-21T21:46:00.145602] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-10-21T21:46:00.158552] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-10-21T21:46:00.548780] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-10-21T21:46:00.548902] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-10-21T21:46:00.550152] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-10-21T21:46:00.550216] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-10-21T21:46:00.551531] [DEBUG] [LOCAL ] VIRT: Trimmed 67562 records to 46483 (keeping 200 days of data) [2025-10-21T21:46:00.835912] [DEBUG] [LOCAL ] VIRT: Primary data saved (46483 records). [2025-10-21T21:46:00.836066] [INFO ] [MAIN ] VIRT: Full history saved. [2025-10-21T21:46:00.836154] [INFO ] [MAIN ] Update Progress: 2226/2366 symbols completed. VIRT took 30.5s. Estimated remaining: 17m 59s. Rate: 7.8 symbols/min [2025-10-21T21:46:00.954931] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-10-21T21:46:01.019245] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:46:01.041709] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T21:46:01.050395] [INFO ] [REMOTE ] VIPS: Full fetch complete (74852 records). [2025-10-21T21:46:01.050528] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-10-21T21:46:01.188278] [DEBUG] [LOCAL ] VKQ: Loaded 17880 existing records from primary storage. [2025-10-21T21:46:01.204634] [INFO ] [MAIN ] VKQ: Loaded 17880 existing records. [2025-10-21T21:46:01.497774] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:46:01.579582] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-10-21T21:46:01.600479] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-10-21T21:46:01.630283] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-10-21T21:46:01.630528] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-10-21T21:46:01.944838] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-10-21T21:46:01.945288] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-10-21T21:46:01.973320] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-10-21T21:46:02.030273] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-10-21T21:46:02.140965] [DEBUG] [LOCAL ] VIPS: Trimmed 74852 records to 51260 (keeping 200 days of data) [2025-10-21T21:46:02.168570] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-21T21:46:02.294170] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-10-21T21:46:02.387858] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:46:02.562953] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-10-21T21:46:02.605316] [DEBUG] [LOCAL ] VIPS: Primary data saved (51260 records). [2025-10-21T21:46:02.605458] [INFO ] [MAIN ] VIPS: Full history saved. [2025-10-21T21:46:02.605668] [INFO ] [MAIN ] Update Progress: 2227/2366 symbols completed. VIPS took 38.8s. Estimated remaining: 17m 51s. Rate: 7.8 symbols/min [2025-10-21T21:46:02.740420] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T21:46:02.811775] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:46:02.840557] [DEBUG] [LOCAL ] VLN: Loaded 30887 existing records from primary storage. [2025-10-21T21:46:02.840844] [INFO ] [MAIN ] VLN: Loaded 30887 existing records. [2025-10-21T21:46:03.017513] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:46:03.017809] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-10-21T21:46:03.017859] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-10-21T21:46:03.018046] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-10-21T21:46:03.018101] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-10-21T21:46:03.321416] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T21:46:03.360554] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-10-21T21:46:03.389613] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:46:03.917312] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-21T21:46:04.151098] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-10-21T21:46:04.337487] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T21:46:04.951063] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-10-21T21:46:05.756897] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-10-21T21:46:05.759686] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T21:46:05.933316] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-21T21:46:06.551044] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-10-21T21:46:07.219781] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T21:46:07.350981] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-10-21T21:46:08.140509] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-21T21:46:08.150976] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-10-21T21:46:08.469207] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T21:46:08.951080] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-10-21T21:46:09.691948] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T21:46:09.711458] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-21T21:46:09.750979] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-10-21T21:46:10.551094] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-10-21T21:46:10.971910] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-21T21:46:11.351021] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-10-21T21:46:12.151050] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-10-21T21:46:12.367068] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-21T21:46:12.951060] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-10-21T21:46:13.023981] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T21:46:13.074324] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T21:46:13.751056] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-10-21T21:46:14.559879] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-10-21T21:46:14.565386] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T21:46:14.855086] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-21T21:46:15.351078] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-10-21T21:46:15.494409] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-21T21:46:16.151069] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-10-21T21:46:16.547069] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T21:46:16.951074] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-10-21T21:46:17.753248] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-10-21T21:46:17.757319] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-21T21:46:18.550997] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-10-21T21:46:18.673478] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T21:46:18.973297] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-21T21:46:19.351018] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-10-21T21:46:20.151007] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-10-21T21:46:20.412516] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T21:46:20.957365] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-10-21T21:46:20.978920] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-21T21:46:21.750996] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-10-21T21:46:21.787375] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T21:46:21.987632] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T21:46:22.551056] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-10. [2025-10-21T21:46:23.303893] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-21T21:46:23.351054] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-10-21T21:46:23.922241] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T21:46:23.930015] [INFO ] [REMOTE ] VIST: Full fetch complete (67475 records). [2025-10-21T21:46:23.930146] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-10-21T21:46:24.157156] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-10-21T21:46:24.323292] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-10-21T21:46:24.323450] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-10-21T21:46:24.324639] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-10-21T21:46:24.324863] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-10-21T21:46:24.326189] [DEBUG] [LOCAL ] VIST: Trimmed 67475 records to 46653 (keeping 200 days of data) [2025-10-21T21:46:24.435979] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-21T21:46:24.607205] [DEBUG] [LOCAL ] VIST: Primary data saved (46653 records). [2025-10-21T21:46:24.607334] [INFO ] [MAIN ] VIST: Full history saved. [2025-10-21T21:46:24.607882] [INFO ] [MAIN ] Update Progress: 2228/2366 symbols completed. VIST took 31.8s. Estimated remaining: 17m 44s. Rate: 7.8 symbols/min [2025-10-21T21:46:24.775214] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:46:24.834595] [DEBUG] [LOCAL ] VLO: Loaded 52982 existing records from primary storage. [2025-10-21T21:46:24.835028] [INFO ] [MAIN ] VLO: Loaded 52982 existing records. [2025-10-21T21:46:24.956217] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-10. [2025-10-21T21:46:25.029116] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:46:25.029344] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-10-21T21:46:25.029393] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-10-21T21:46:25.029566] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-10-21T21:46:25.029602] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-10-21T21:46:25.410784] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:46:25.750994] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-10-21T21:46:25.891978] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-21T21:46:26.467105] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-21T21:46:26.473279] [INFO ] [REMOTE ] VLN: Full fetch complete (43370 records). [2025-10-21T21:46:26.473367] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-10-21T21:46:26.556100] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-10. [2025-10-21T21:46:26.880388] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-10-21T21:46:26.881452] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-21T21:46:26.881612] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-10-21T21:46:26.887200] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-10-21T21:46:26.887694] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-10-21T21:46:26.888722] [DEBUG] [LOCAL ] VLN: Trimmed 43370 records to 30957 (keeping 200 days of data) [2025-10-21T21:46:27.062983] [DEBUG] [LOCAL ] VLN: Primary data saved (30957 records). [2025-10-21T21:46:27.063129] [INFO ] [MAIN ] VLN: Full history saved. [2025-10-21T21:46:27.063210] [INFO ] [MAIN ] Update Progress: 2229/2366 symbols completed. VLN took 24.5s. Estimated remaining: 17m 36s. Rate: 7.8 symbols/min [2025-10-21T21:46:27.236181] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:46:27.273516] [DEBUG] [LOCAL ] VLRS: Loaded 39472 existing records from primary storage. [2025-10-21T21:46:27.273929] [INFO ] [MAIN ] VLRS: Loaded 39472 existing records. [2025-10-21T21:46:27.356189] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-10-21T21:46:27.452571] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:46:27.452811] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-10-21T21:46:27.452858] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-10-21T21:46:27.453031] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-10-21T21:46:27.453069] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-10-21T21:46:27.810378] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:46:28.123498] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T21:46:28.131635] [INFO ] [REMOTE ] VIV: Full fetch complete (64420 records). [2025-10-21T21:46:28.131796] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-10-21T21:46:28.156269] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-10-21T21:46:28.532022] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-21T21:46:28.616391] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-10-21T21:46:28.616469] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-10-21T21:46:28.617742] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-10-21T21:46:28.617806] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-10-21T21:46:28.619140] [DEBUG] [LOCAL ] VIV: Trimmed 64420 records to 44664 (keeping 200 days of data) [2025-10-21T21:46:28.919450] [DEBUG] [LOCAL ] VIV: Primary data saved (44664 records). [2025-10-21T21:46:28.919570] [INFO ] [MAIN ] VIV: Full history saved. [2025-10-21T21:46:28.920493] [INFO ] [MAIN ] Update Progress: 2230/2366 symbols completed. VIV took 34.0s. Estimated remaining: 17m 28s. Rate: 7.8 symbols/min [2025-10-21T21:46:28.956117] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-10. [2025-10-21T21:46:29.152482] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:46:29.161412] [DEBUG] [LOCAL ] VLT: Loaded 4389 existing records from primary storage. [2025-10-21T21:46:29.161619] [INFO ] [MAIN ] VLT: Loaded 4389 existing records. [2025-10-21T21:46:29.338116] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:46:29.338338] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-10-21T21:46:29.338397] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-10-21T21:46:29.338532] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-10-21T21:46:29.338569] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-10-21T21:46:29.703039] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:46:29.713078] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T21:46:29.750992] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-10-21T21:46:29.962261] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-21T21:46:29.965731] [INFO ] [REMOTE ] VKQ: Full fetch complete (24617 records). [2025-10-21T21:46:29.965827] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-10-21T21:46:30.334114] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-10-21T21:46:30.334199] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-10-21T21:46:30.334714] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-10-21T21:46:30.334775] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-10-21T21:46:30.335387] [DEBUG] [LOCAL ] VKQ: Trimmed 24617 records to 17897 (keeping 200 days of data) [2025-10-21T21:46:30.440333] [DEBUG] [LOCAL ] VKQ: Primary data saved (17897 records). [2025-10-21T21:46:30.440459] [INFO ] [MAIN ] VKQ: Full history saved. [2025-10-21T21:46:30.440534] [INFO ] [MAIN ] Update Progress: 2231/2366 symbols completed. VKQ took 29.6s. Estimated remaining: 17m 20s. Rate: 7.8 symbols/min [2025-10-21T21:46:30.556074] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-10-21T21:46:30.617430] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T21:46:30.620115] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:46:30.667718] [DEBUG] [LOCAL ] VLTO: Loaded 46138 existing records from primary storage. [2025-10-21T21:46:30.668109] [INFO ] [MAIN ] VLTO: Loaded 46138 existing records. [2025-10-21T21:46:30.843112] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:46:30.843317] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-10-21T21:46:30.843390] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-10-21T21:46:30.843672] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-10-21T21:46:30.843749] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-10-21T21:46:31.186791] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:46:31.351029] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-10-21T21:46:31.975410] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-21T21:46:32.151054] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-10-21T21:46:32.445833] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-21T21:46:32.788376] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-21T21:46:32.951046] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-10-21T21:46:33.751061] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-10-21T21:46:34.373004] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-21T21:46:34.551018] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-10-21T21:46:35.320961] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-21T21:46:35.350995] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-10-21T21:46:36.147312] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-21T21:46:36.156074] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-10-21T21:46:36.625100] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T21:46:36.950548] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-21T21:46:36.952277] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-10-21T21:46:37.751013] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-10-21T21:46:38.343757] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T21:46:38.472530] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-21T21:46:38.550986] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-10-21T21:46:39.140109] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-21T21:46:39.351013] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-10-21T21:46:40.151036] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-10-21T21:46:40.951008] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-10-21T21:46:41.429847] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-21T21:46:41.660872] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-21T21:46:41.751008] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-10-21T21:46:42.551013] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-10-21T21:46:42.599602] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T21:46:43.190906] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-21T21:46:43.351001] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-10-21T21:46:44.151082] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-10-21T21:46:44.393474] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T21:46:44.559871] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T21:46:44.755157] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T21:46:44.951023] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-10-21T21:46:45.751025] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-10-21T21:46:46.334934] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T21:46:46.551007] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-10-21T21:46:46.719285] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T21:46:47.164434] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T21:46:47.351130] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-10. [2025-10-21T21:46:47.705916] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-21T21:46:47.708128] [INFO ] [REMOTE ] VLT: Full fetch complete (7459 records). [2025-10-21T21:46:47.708296] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-10-21T21:46:48.163040] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-10-21T21:46:48.183743] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-10-21T21:46:48.183879] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-10-21T21:46:48.184239] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-10-21T21:46:48.184286] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-10-21T21:46:48.185102] [DEBUG] [LOCAL ] VLT: Trimmed 7459 records to 4344 (keeping 200 days of data) [2025-10-21T21:46:48.219482] [DEBUG] [LOCAL ] VLT: Primary data saved (4344 records). [2025-10-21T21:46:48.219707] [INFO ] [MAIN ] VLT: Full history saved. [2025-10-21T21:46:48.219825] [INFO ] [MAIN ] Update Progress: 2232/2366 symbols completed. VLT took 19.3s. Estimated remaining: 17m 13s. Rate: 7.8 symbols/min [2025-10-21T21:46:48.432766] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:46:48.474818] [DEBUG] [LOCAL ] VMC: Loaded 42371 existing records from primary storage. [2025-10-21T21:46:48.475116] [INFO ] [MAIN ] VMC: Loaded 42371 existing records. [2025-10-21T21:46:48.648152] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:46:48.648333] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-10-21T21:46:48.648379] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-10-21T21:46:48.648594] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-10-21T21:46:48.648687] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-10-21T21:46:48.962359] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-10-21T21:46:49.001800] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:46:49.751078] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-10-21T21:46:50.095174] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T21:46:50.550997] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-10-21T21:46:50.714498] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T21:46:51.351034] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-10-21T21:46:51.386716] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T21:46:51.492002] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T21:46:52.151040] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-10-21T21:46:52.895361] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T21:46:52.951003] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-10-21T21:46:53.342480] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-21T21:46:53.751008] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-10. [2025-10-21T21:46:54.551022] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-10-21T21:46:54.804783] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T21:46:54.810410] [INFO ] [REMOTE ] VLRS: Full fetch complete (58264 records). [2025-10-21T21:46:54.810504] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-10-21T21:46:55.239456] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-10-21T21:46:55.239568] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-10-21T21:46:55.240632] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-10-21T21:46:55.240731] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-10-21T21:46:55.243309] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-21T21:46:55.254673] [DEBUG] [LOCAL ] VLRS: Trimmed 58264 records to 39297 (keeping 200 days of data) [2025-10-21T21:46:55.351164] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-10-21T21:46:55.470982] [DEBUG] [LOCAL ] VLRS: Primary data saved (39297 records). [2025-10-21T21:46:55.471108] [INFO ] [MAIN ] VLRS: Full history saved. [2025-10-21T21:46:55.471611] [INFO ] [MAIN ] Update Progress: 2233/2366 symbols completed. VLRS took 28.4s. Estimated remaining: 17m 5s. Rate: 7.8 symbols/min [2025-10-21T21:46:55.638794] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:46:55.655548] [DEBUG] [LOCAL ] VMI: Loaded 14963 existing records from primary storage. [2025-10-21T21:46:55.655798] [INFO ] [MAIN ] VMI: Loaded 14963 existing records. [2025-10-21T21:46:55.829251] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:46:55.829403] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-10-21T21:46:55.829447] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-10-21T21:46:55.829618] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-10-21T21:46:55.829702] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-10-21T21:46:56.180577] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:46:56.151729] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-10-21T21:46:56.294762] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-21T21:46:56.951037] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-10-21T21:46:57.046028] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T21:46:57.751014] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-10-21T21:46:57.881688] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-21T21:46:58.041951] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T21:46:58.551040] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-10-21T21:46:59.351010] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-10-21T21:46:59.400824] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T21:47:00.151067] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-10-21T21:47:00.498741] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-21T21:47:00.919236] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T21:47:00.950992] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-10-21T21:47:01.751069] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-10-21T21:47:01.924681] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T21:47:02.147593] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-21T21:47:02.551010] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-10-21T21:47:02.658533] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-21T21:47:03.351037] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-10-21T21:47:04.151018] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-10-21T21:47:04.271015] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-21T21:47:04.951004] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-10-21T21:47:05.047856] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T21:47:05.070498] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-21T21:47:05.751020] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-10-21T21:47:06.551060] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-10-21T21:47:06.628881] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T21:47:06.882724] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-21T21:47:07.351021] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-10-21T21:47:08.151015] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-10. [2025-10-21T21:47:08.460492] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T21:47:08.956116] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-10-21T21:47:08.972378] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-21T21:47:09.691757] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T21:47:09.699718] [INFO ] [REMOTE ] VLTO: Full fetch complete (67391 records). [2025-10-21T21:47:09.699869] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-10-21T21:47:09.760397] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-10-21T21:47:09.995855] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-21T21:47:10.112083] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-10-21T21:47:10.112160] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-10-21T21:47:10.113263] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-10-21T21:47:10.113327] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-10-21T21:47:10.114557] [DEBUG] [LOCAL ] VLTO: Trimmed 67391 records to 46100 (keeping 200 days of data) [2025-10-21T21:47:10.395325] [DEBUG] [LOCAL ] VLTO: Primary data saved (46100 records). [2025-10-21T21:47:10.395474] [INFO ] [MAIN ] VLTO: Full history saved. [2025-10-21T21:47:10.395556] [INFO ] [MAIN ] Update Progress: 2234/2366 symbols completed. VLTO took 40.0s. Estimated remaining: 16m 58s. Rate: 7.8 symbols/min [2025-10-21T21:47:10.567629] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-10. [2025-10-21T21:47:10.571469] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:47:10.591854] [DEBUG] [LOCAL ] VMO: Loaded 20784 existing records from primary storage. [2025-10-21T21:47:10.592118] [INFO ] [MAIN ] VMO: Loaded 20784 existing records. [2025-10-21T21:47:10.766993] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:47:10.767197] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-10-21T21:47:10.767244] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-10-21T21:47:10.767402] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-10-21T21:47:10.767439] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-10-21T21:47:11.123180] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:47:11.322814] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T21:47:11.331145] [INFO ] [REMOTE ] VLO: Full fetch complete (76909 records). [2025-10-21T21:47:11.331325] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-10-21T21:47:11.363264] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-10-21T21:47:11.689631] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T21:47:11.766560] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-10-21T21:47:11.766667] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-10-21T21:47:11.768095] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-10-21T21:47:11.768307] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-10-21T21:47:11.769946] [DEBUG] [LOCAL ] VLO: Trimmed 76909 records to 52963 (keeping 200 days of data) [2025-10-21T21:47:12.121849] [DEBUG] [LOCAL ] VLO: Primary data saved (52963 records). [2025-10-21T21:47:12.121998] [INFO ] [MAIN ] VLO: Full history saved. [2025-10-21T21:47:12.122803] [INFO ] [MAIN ] Update Progress: 2235/2366 symbols completed. VLO took 47.5s. Estimated remaining: 16m 50s. Rate: 7.8 symbols/min [2025-10-21T21:47:12.154623] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-10-21T21:47:12.298123] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:47:12.342960] [DEBUG] [LOCAL ] VNO: Loaded 48936 existing records from primary storage. [2025-10-21T21:47:12.343254] [INFO ] [MAIN ] VNO: Loaded 48936 existing records. [2025-10-21T21:47:12.520400] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-21T21:47:12.547317] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:47:12.551368] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-10-21T21:47:12.551912] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-10-21T21:47:12.552305] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-10-21T21:47:12.552363] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-10-21T21:47:12.914408] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:47:12.951016] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-10-21T21:47:13.751020] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-10-21T21:47:13.808504] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T21:47:14.548463] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T21:47:14.557482] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-10-21T21:47:14.804273] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T21:47:15.350993] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-10. [2025-10-21T21:47:15.741503] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T21:47:15.860973] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T21:47:15.867314] [INFO ] [REMOTE ] VMC: Full fetch complete (62341 records). [2025-10-21T21:47:15.867446] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-10-21T21:47:16.159307] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-10-21T21:47:16.258292] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-10-21T21:47:16.258379] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-10-21T21:47:16.259598] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-10-21T21:47:16.259722] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-10-21T21:47:16.261071] [DEBUG] [LOCAL ] VMC: Trimmed 62341 records to 42258 (keeping 200 days of data) [2025-10-21T21:47:16.515953] [DEBUG] [LOCAL ] VMC: Primary data saved (42258 records). [2025-10-21T21:47:16.516074] [INFO ] [MAIN ] VMC: Full history saved. [2025-10-21T21:47:16.516575] [INFO ] [MAIN ] Update Progress: 2236/2366 symbols completed. VMC took 28.3s. Estimated remaining: 16m 42s. Rate: 7.8 symbols/min [2025-10-21T21:47:16.684578] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:47:16.726299] [DEBUG] [LOCAL ] VNT: Loaded 43986 existing records from primary storage. [2025-10-21T21:47:16.726581] [INFO ] [MAIN ] VNT: Loaded 43986 existing records. [2025-10-21T21:47:16.899694] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:47:16.899888] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-10-21T21:47:16.899934] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-10-21T21:47:16.900149] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-10-21T21:47:16.900216] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-10-21T21:47:16.962027] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-10-21T21:47:17.248503] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:47:17.643972] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T21:47:17.738548] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-21T21:47:17.750973] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-10-21T21:47:18.551028] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-10-21T21:47:18.914536] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T21:47:19.351029] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-10-21T21:47:20.151037] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-10-21T21:47:20.257869] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T21:47:20.938611] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T21:47:20.950973] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-10-21T21:47:21.159871] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T21:47:21.751020] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-10-21T21:47:22.203079] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T21:47:22.551028] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-10-21T21:47:23.350997] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-10-21T21:47:23.415345] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-21T21:47:23.536875] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-21T21:47:24.151065] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-10-21T21:47:24.725594] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T21:47:24.951048] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-10-21T21:47:25.750986] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-10-21T21:47:25.855416] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T21:47:26.057710] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-21T21:47:26.551053] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-10-21T21:47:26.812935] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T21:47:27.350992] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-10-21T21:47:27.662224] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T21:47:28.151005] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-10-21T21:47:28.951080] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-10-21T21:47:29.121948] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T21:47:29.751132] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-10-21T21:47:29.803528] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-21T21:47:29.852073] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-21T21:47:30.551037] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-10-21T21:47:31.351033] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-10-21T21:47:31.482174] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T21:47:31.661579] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T21:47:32.151074] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-10. [2025-10-21T21:47:32.415415] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-21T21:47:32.951004] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-10-21T21:47:33.001294] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-21T21:47:33.004765] [INFO ] [REMOTE ] VMI: Full fetch complete (21342 records). [2025-10-21T21:47:33.005011] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-10-21T21:47:33.360246] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-10-21T21:47:33.360326] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-10-21T21:47:33.360767] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-10-21T21:47:33.360829] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-10-21T21:47:33.361373] [DEBUG] [LOCAL ] VMI: Trimmed 21342 records to 14976 (keeping 200 days of data) [2025-10-21T21:47:33.452598] [DEBUG] [LOCAL ] VMI: Primary data saved (14976 records). [2025-10-21T21:47:33.452757] [INFO ] [MAIN ] VMI: Full history saved. [2025-10-21T21:47:33.452841] [INFO ] [MAIN ] Update Progress: 2237/2366 symbols completed. VMI took 38.0s. Estimated remaining: 16m 35s. Rate: 7.8 symbols/min [2025-10-21T21:47:33.751029] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-10-21T21:47:34.324325] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T21:47:34.551052] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-10-21T21:47:35.351039] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-10-21T21:47:35.417333] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T21:47:35.668237] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-21T21:47:36.151007] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-10-21T21:47:36.959113] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-10. [2025-10-21T21:47:36.961639] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T21:47:37.751051] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-10-21T21:47:37.781880] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T21:47:37.887999] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-21T21:47:37.891421] [INFO ] [REMOTE ] VMO: Full fetch complete (30809 records). [2025-10-21T21:47:37.891491] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-10-21T21:47:38.250145] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-10-21T21:47:38.250218] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-10-21T21:47:38.250775] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-10-21T21:47:38.250835] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-10-21T21:47:38.251488] [DEBUG] [LOCAL ] VMO: Trimmed 30809 records to 20749 (keeping 200 days of data) [2025-10-21T21:47:38.368829] [DEBUG] [LOCAL ] VMO: Primary data saved (20749 records). [2025-10-21T21:47:38.368946] [INFO ] [MAIN ] VMO: Full history saved. [2025-10-21T21:47:38.369019] [INFO ] [MAIN ] Update Progress: 2238/2366 symbols completed. VMO took 28.0s. Estimated remaining: 16m 27s. Rate: 7.8 symbols/min [2025-10-21T21:47:38.550987] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-10. [2025-10-21T21:47:39.268411] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T21:47:39.351062] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-10-21T21:47:39.719637] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T21:47:39.727149] [INFO ] [REMOTE ] VNO: Full fetch complete (70537 records). [2025-10-21T21:47:39.727307] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-10-21T21:47:40.174211] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-10-21T21:47:40.174363] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-10-21T21:47:40.176015] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-10-21T21:47:40.176112] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-10-21T21:47:40.178033] [DEBUG] [LOCAL ] VNO: Trimmed 70537 records to 48874 (keeping 200 days of data) [2025-10-21T21:47:40.626074] [DEBUG] [LOCAL ] VNO: Primary data saved (48874 records). [2025-10-21T21:47:40.626386] [INFO ] [MAIN ] VNO: Full history saved. [2025-10-21T21:47:40.627311] [INFO ] [MAIN ] Update Progress: 2239/2366 symbols completed. VNO took 28.5s. Estimated remaining: 16m 19s. Rate: 7.8 symbols/min [2025-10-21T21:47:40.817082] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T21:47:40.832054] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-10. [2025-10-21T21:47:42.351140] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T21:47:42.358673] [INFO ] [REMOTE ] VNT: Full fetch complete (64320 records). [2025-10-21T21:47:42.358798] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-10-21T21:47:42.771507] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-10-21T21:47:42.771585] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-10-21T21:47:42.772687] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-10-21T21:47:42.772748] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-10-21T21:47:42.773918] [DEBUG] [LOCAL ] VNT: Trimmed 64320 records to 43930 (keeping 200 days of data) [2025-10-21T21:47:43.030010] [DEBUG] [LOCAL ] VNT: Primary data saved (43930 records). [2025-10-21T21:47:43.030131] [INFO ] [MAIN ] VNT: Full history saved. [2025-10-21T21:47:43.030608] [INFO ] [MAIN ] Update Progress: 2240/2366 symbols completed. VNT took 26.5s. Estimated remaining: 16m 11s. Rate: 7.8 symbols/min [2025-10-21T21:47:43.646397] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:47:43.693822] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:47:43.743772] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:47:43.757700] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:47:43.757861] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-10-21T21:47:43.758535] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-10-21T21:47:43.758805] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-10-21T21:47:43.758876] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-21T21:47:43.758930] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-21T21:47:43.758970] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-10-21T21:47:43.883281] [DEBUG] [LOCAL ] VOC: Loaded 9011 existing records from primary storage. [2025-10-21T21:47:43.884252] [DEBUG] [LOCAL ] VPG: Loaded 17102 existing records from primary storage. [2025-10-21T21:47:43.895721] [INFO ] [MAIN ] VPG: Loaded 17102 existing records. [2025-10-21T21:47:43.895550] [INFO ] [MAIN ] VOC: Loaded 9011 existing records. [2025-10-21T21:47:44.351295] [DEBUG] [LOCAL ] VOYA: Loaded 42073 existing records from primary storage. [2025-10-21T21:47:44.475935] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:47:44.478185] [INFO ] [MAIN ] VOYA: Loaded 42073 existing records. [2025-10-21T21:47:44.551221] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-10-21T21:47:44.583218] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-10-21T21:47:44.560589] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:47:44.600378] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:47:44.600445] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-10-21T21:47:44.638853] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-10-21T21:47:44.644243] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-10-21T21:47:44.644177] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-10-21T21:47:44.666585] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-10-21T21:47:44.696094] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-10-21T21:47:44.701994] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-10-21T21:47:44.912533] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:47:44.951366] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:47:44.988933] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-10-21T21:47:45.013387] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-10-21T21:47:45.017074] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-10-21T21:47:45.017450] [FATAL] [REMOTE ] VOYG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:47:45.056241] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-10-21T21:47:45.075693] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-10-21T21:47:45.022976] [FATAL] [MAIN ] VOYG: Failed to fetch primary data. [2025-10-21T21:47:45.128287] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:47:45.192690] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-10-21T21:47:45.293108] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-10-21T21:47:45.361462] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-10-21T21:47:45.413227] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-10-21T21:47:45.444689] [INFO ] [MAIN ] Update Progress: 2241/2366 symbols completed. VOYG took 2.4s. Estimated remaining: 16m 3s. Rate: 7.8 symbols/min [2025-10-21T21:47:45.778551] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:47:45.808129] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-10-21T21:47:45.853246] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:47:45.933197] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-10-21T21:47:45.991486] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:47:46.092307] [DEBUG] [LOCAL ] VPV: Loaded 5429 existing records from primary storage. [2025-10-21T21:47:46.088541] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:47:46.092770] [INFO ] [MAIN ] VPV: Loaded 5429 existing records. [2025-10-21T21:47:46.093144] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-10-21T21:47:46.278630] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:47:46.278893] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-10-21T21:47:46.278951] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-10-21T21:47:46.279121] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-10-21T21:47:46.279177] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-10-21T21:47:46.627111] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:47:46.627560] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-10-21T21:47:46.784126] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-21T21:47:46.787011] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-10-21T21:47:46.893424] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-21T21:47:46.896063] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-10-21T21:47:47.424734] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-21T21:47:47.427279] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-10-21T21:47:47.626263] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T21:47:47.634855] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-10-21T21:47:47.656403] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-21T21:47:47.688851] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-21T21:47:48.150996] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-10-21T21:47:48.234024] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T21:47:48.679052] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-21T21:47:48.951015] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-10-21T21:47:49.081992] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-21T21:47:49.555707] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-21T21:47:49.751057] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-10-21T21:47:50.551026] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-10-21T21:47:50.689266] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-21T21:47:51.351061] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-10-21T21:47:52.151058] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-10-21T21:47:52.250674] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T21:47:52.487921] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T21:47:52.951007] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-10-21T21:47:53.056297] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-21T21:47:53.751026] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-10-21T21:47:54.040902] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T21:47:54.543278] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-21T21:47:54.550981] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-10-21T21:47:55.322267] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-21T21:47:55.351045] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-10-21T21:47:56.151059] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-10-21T21:47:56.195062] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-21T21:47:56.915273] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T21:47:56.951044] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-10-21T21:47:57.544780] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-21T21:47:57.751029] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-10-21T21:47:58.551061] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-10-21T21:47:58.597315] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-21T21:47:59.351071] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-10-21T21:47:59.582215] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T21:48:00.151089] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-10-21T21:48:00.799636] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-21T21:48:00.950996] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-10-21T21:48:01.211177] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T21:48:01.546009] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-21T21:48:01.751068] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-10-21T21:48:02.551029] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-10-21T21:48:03.121145] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-21T21:48:03.157320] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T21:48:03.351038] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-10-21T21:48:04.147602] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T21:48:04.150969] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-10. [2025-10-21T21:48:04.827935] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-21T21:48:04.829590] [INFO ] [REMOTE ] VOC: Full fetch complete (13133 records). [2025-10-21T21:48:04.829690] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-10-21T21:48:04.956191] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-10-21T21:48:05.202820] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-10-21T21:48:05.202899] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-10-21T21:48:05.203196] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-10-21T21:48:05.203236] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-10-21T21:48:05.203762] [DEBUG] [LOCAL ] VOC: Trimmed 13133 records to 8997 (keeping 200 days of data) [2025-10-21T21:48:05.254554] [DEBUG] [LOCAL ] VOC: Primary data saved (8997 records). [2025-10-21T21:48:05.254713] [INFO ] [MAIN ] VOC: Full history saved. [2025-10-21T21:48:05.254802] [INFO ] [MAIN ] Update Progress: 2242/2366 symbols completed. VOC took 22.2s. Estimated remaining: 15m 56s. Rate: 7.8 symbols/min [2025-10-21T21:48:05.425158] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:48:05.461264] [DEBUG] [LOCAL ] VRE: Loaded 35362 existing records from primary storage. [2025-10-21T21:48:05.461540] [INFO ] [MAIN ] VRE: Loaded 35362 existing records. [2025-10-21T21:48:05.638618] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:48:05.638836] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-10-21T21:48:05.638919] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-10-21T21:48:05.639137] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-10-21T21:48:05.639206] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-10-21T21:48:05.745933] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-21T21:48:05.751845] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-10-21T21:48:06.000790] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:48:06.550999] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-10-21T21:48:06.777354] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-21T21:48:07.351056] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-10. [2025-10-21T21:48:07.853559] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T21:48:07.973515] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-21T21:48:07.975011] [INFO ] [REMOTE ] VPV: Full fetch complete (8887 records). [2025-10-21T21:48:07.975100] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-10-21T21:48:08.154592] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-10-21T21:48:08.369069] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-10-21T21:48:08.369149] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-10-21T21:48:08.369395] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-10-21T21:48:08.369434] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-10-21T21:48:08.369958] [DEBUG] [LOCAL ] VPV: Trimmed 8887 records to 5414 (keeping 200 days of data) [2025-10-21T21:48:08.401838] [DEBUG] [LOCAL ] VPV: Primary data saved (5414 records). [2025-10-21T21:48:08.401947] [INFO ] [MAIN ] VPV: Full history saved. [2025-10-21T21:48:08.402034] [INFO ] [MAIN ] Update Progress: 2243/2366 symbols completed. VPV took 22.9s. Estimated remaining: 15m 48s. Rate: 7.8 symbols/min [2025-10-21T21:48:08.570708] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:48:08.629425] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-21T21:48:08.629785] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-10-21T21:48:08.862835] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:48:08.863081] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-10-21T21:48:08.863158] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-10-21T21:48:08.863408] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-10-21T21:48:08.863470] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-10-21T21:48:08.960477] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-10-21T21:48:09.251981] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:48:09.751011] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-10-21T21:48:09.781744] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T21:48:10.346705] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T21:48:10.551045] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-10-21T21:48:11.351013] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-10-21T21:48:11.542589] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T21:48:12.131973] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-21T21:48:12.150993] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-10-21T21:48:12.577067] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-21T21:48:12.951083] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-10-21T21:48:13.468722] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T21:48:13.751020] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-10-21T21:48:13.937479] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-21T21:48:14.551048] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-10-21T21:48:14.899360] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-21T21:48:15.351005] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-10-21T21:48:16.119118] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-21T21:48:16.150987] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-10-21T21:48:16.673915] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-21T21:48:16.951035] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-10. [2025-10-21T21:48:17.751000] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-10-21T21:48:17.869494] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T21:48:17.872559] [INFO ] [REMOTE ] VPG: Full fetch complete (23085 records). [2025-10-21T21:48:17.872696] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-10-21T21:48:18.013580] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-21T21:48:18.287105] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-10-21T21:48:18.287189] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-10-21T21:48:18.287796] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-10-21T21:48:18.287859] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-10-21T21:48:18.288544] [DEBUG] [LOCAL ] VPG: Trimmed 23085 records to 16982 (keeping 200 days of data) [2025-10-21T21:48:18.385883] [DEBUG] [LOCAL ] VPG: Primary data saved (16982 records). [2025-10-21T21:48:18.386014] [INFO ] [MAIN ] VPG: Full history saved. [2025-10-21T21:48:18.386089] [INFO ] [MAIN ] Update Progress: 2244/2366 symbols completed. VPG took 35.3s. Estimated remaining: 15m 40s. Rate: 7.8 symbols/min [2025-10-21T21:48:18.553440] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-10-21T21:48:18.554992] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:48:18.568029] [DEBUG] [LOCAL ] VRTS: Loaded 9391 existing records from primary storage. [2025-10-21T21:48:18.568287] [INFO ] [MAIN ] VRTS: Loaded 9391 existing records. [2025-10-21T21:48:18.747209] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:48:18.747410] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-10-21T21:48:18.747456] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-10-21T21:48:18.747608] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-10-21T21:48:18.747702] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-10-21T21:48:19.114430] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:48:19.351034] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-10. [2025-10-21T21:48:19.987063] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T21:48:20.156687] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-10-21T21:48:20.175146] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-21T21:48:20.343140] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-21T21:48:20.350217] [INFO ] [REMOTE ] VOYA: Full fetch complete (61646 records). [2025-10-21T21:48:20.350389] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-10-21T21:48:20.743013] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-10-21T21:48:20.743125] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-10-21T21:48:20.744432] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-10-21T21:48:20.744500] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-10-21T21:48:20.746067] [DEBUG] [LOCAL ] VOYA: Trimmed 61646 records to 41929 (keeping 200 days of data) [2025-10-21T21:48:20.951040] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-10-21T21:48:20.998151] [DEBUG] [LOCAL ] VOYA: Primary data saved (41929 records). [2025-10-21T21:48:20.998284] [INFO ] [MAIN ] VOYA: Full history saved. [2025-10-21T21:48:20.998362] [INFO ] [MAIN ] Update Progress: 2245/2366 symbols completed. VOYA took 38.0s. Estimated remaining: 15m 32s. Rate: 7.8 symbols/min [2025-10-21T21:48:21.170017] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:48:21.220071] [DEBUG] [LOCAL ] VSCO: Loaded 52717 existing records from primary storage. [2025-10-21T21:48:21.220369] [INFO ] [MAIN ] VSCO: Loaded 52717 existing records. [2025-10-21T21:48:21.397793] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:48:21.397967] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-10-21T21:48:21.398014] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-10-21T21:48:21.398190] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-10-21T21:48:21.398227] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-10-21T21:48:21.754609] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T21:48:21.760848] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-10-21T21:48:21.790800] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:48:22.442248] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-21T21:48:22.551003] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-10-21T21:48:23.242767] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-21T21:48:23.296980] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-21T21:48:23.350999] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-10-21T21:48:24.151040] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-10-21T21:48:24.951021] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-10-21T21:48:25.080764] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-21T21:48:25.379663] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-21T21:48:25.573026] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T21:48:25.751046] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-10-21T21:48:26.551112] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-10-21T21:48:27.268433] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:48:27.351061] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-10-21T21:48:28.109686] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-21T21:48:28.159390] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-10-21T21:48:28.179370] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T21:48:28.883229] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T21:48:28.951089] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-10-21T21:48:29.751087] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-10-21T21:48:30.551004] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-10. [2025-10-21T21:48:30.821565] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T21:48:31.351038] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-10-21T21:48:31.861446] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-21T21:48:31.867056] [INFO ] [REMOTE ] VRE: Full fetch complete (48645 records). [2025-10-21T21:48:31.867170] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-10-21T21:48:32.156303] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-10-21T21:48:32.275280] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-10-21T21:48:32.275380] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-10-21T21:48:32.276502] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-10-21T21:48:32.276565] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-10-21T21:48:32.277753] [DEBUG] [LOCAL ] VRE: Trimmed 48645 records to 35322 (keeping 200 days of data) [2025-10-21T21:48:32.499227] [DEBUG] [LOCAL ] VRE: Primary data saved (35322 records). [2025-10-21T21:48:32.499364] [INFO ] [MAIN ] VRE: Full history saved. [2025-10-21T21:48:32.499776] [INFO ] [MAIN ] Update Progress: 2246/2366 symbols completed. VRE took 27.2s. Estimated remaining: 15m 25s. Rate: 7.8 symbols/min [2025-10-21T21:48:32.699341] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:48:32.701414] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-21T21:48:32.758302] [DEBUG] [LOCAL ] VSH: Loaded 48263 existing records from primary storage. [2025-10-21T21:48:32.758600] [INFO ] [MAIN ] VSH: Loaded 48263 existing records. [2025-10-21T21:48:32.940706] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:48:32.941024] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-10-21T21:48:32.941143] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-10-21T21:48:32.941353] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-10-21T21:48:32.941425] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-10-21T21:48:32.956190] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-10-21T21:48:33.306068] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-21T21:48:33.443569] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:48:33.490965] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-21T21:48:33.751105] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-10-21T21:48:34.551029] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-10-21T21:48:35.351033] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-10-21T21:48:35.463104] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T21:48:35.537897] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-21T21:48:35.849445] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-21T21:48:36.151080] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-10-21T21:48:36.290705] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-21T21:48:36.951022] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-10-21T21:48:37.740600] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T21:48:37.756361] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T21:48:37.756412] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-10-21T21:48:38.551062] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-10-21T21:48:39.213221] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-21T21:48:39.351012] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-10-21T21:48:40.151031] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-10-21T21:48:40.646925] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-21T21:48:40.700039] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-21T21:48:40.951065] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-10. [2025-10-21T21:48:41.002116] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T21:48:41.591675] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-21T21:48:41.593386] [INFO ] [REMOTE ] VRTS: Full fetch complete (11755 records). [2025-10-21T21:48:41.593453] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-10-21T21:48:41.756438] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-10-21T21:48:41.982818] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-10-21T21:48:41.982894] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-10-21T21:48:41.983162] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-10-21T21:48:41.983199] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-10-21T21:48:41.983661] [DEBUG] [LOCAL ] VRTS: Trimmed 11755 records to 9391 (keeping 200 days of data) [2025-10-21T21:48:42.041254] [DEBUG] [LOCAL ] VRTS: Primary data saved (9391 records). [2025-10-21T21:48:42.041386] [INFO ] [MAIN ] VRTS: Full history saved. [2025-10-21T21:48:42.041464] [INFO ] [MAIN ] Update Progress: 2247/2366 symbols completed. VRTS took 23.7s. Estimated remaining: 15m 17s. Rate: 7.8 symbols/min [2025-10-21T21:48:42.206597] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:48:42.257800] [DEBUG] [LOCAL ] VST: Loaded 53709 existing records from primary storage. [2025-10-21T21:48:42.258112] [INFO ] [MAIN ] VST: Loaded 53709 existing records. [2025-10-21T21:48:42.433448] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:48:42.433669] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-10-21T21:48:42.433731] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-10-21T21:48:42.433959] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-10-21T21:48:42.434016] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-10-21T21:48:42.556137] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-10-21T21:48:42.809052] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:48:43.351020] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-10-21T21:48:43.654723] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T21:48:44.151024] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-10-21T21:48:44.894548] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-21T21:48:44.950985] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-10-21T21:48:45.647077] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-10-21T21:48:45.751002] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-10-21T21:48:45.836570] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T21:48:46.551023] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-10-21T21:48:47.351069] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-10-21T21:48:47.524952] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T21:48:47.565175] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-21T21:48:47.834087] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T21:48:48.151068] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-10-21T21:48:48.951084] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-10-21T21:48:49.751077] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-10. [2025-10-21T21:48:49.906599] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-10-21T21:48:50.496222] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T21:48:50.550981] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-10-21T21:48:50.605245] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-21T21:48:51.351045] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-10-21T21:48:51.417733] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T21:48:51.425976] [INFO ] [REMOTE ] VSCO: Full fetch complete (76432 records). [2025-10-21T21:48:51.426099] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-10-21T21:48:51.818834] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-10-21T21:48:51.818910] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-10-21T21:48:51.820298] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-10-21T21:48:51.820360] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-10-21T21:48:51.822136] [DEBUG] [LOCAL ] VSCO: Trimmed 76432 records to 52708 (keeping 200 days of data) [2025-10-21T21:48:52.130466] [DEBUG] [LOCAL ] VSCO: Primary data saved (52708 records). [2025-10-21T21:48:52.130774] [INFO ] [MAIN ] VSCO: Full history saved. [2025-10-21T21:48:52.130929] [INFO ] [MAIN ] Update Progress: 2248/2366 symbols completed. VSCO took 31.1s. Estimated remaining: 15m 10s. Rate: 7.8 symbols/min [2025-10-21T21:48:52.163614] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-10-21T21:48:52.311542] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:48:52.345387] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T21:48:52.393442] [DEBUG] [LOCAL ] VSTS: Loaded 48911 existing records from primary storage. [2025-10-21T21:48:52.393758] [INFO ] [MAIN ] VSTS: Loaded 48911 existing records. [2025-10-21T21:48:52.572596] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:48:52.572817] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-10-21T21:48:52.572863] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-10-21T21:48:52.573057] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-10-21T21:48:52.573112] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-10-21T21:48:52.926413] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:48:52.950977] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-10-21T21:48:53.750995] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-10-21T21:48:53.914356] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-21T21:48:54.551020] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-10. [2025-10-21T21:48:54.777329] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T21:48:54.818383] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-21T21:48:55.351026] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-10-21T21:48:55.448887] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T21:48:56.151089] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-10-21T21:48:56.847207] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T21:48:56.951078] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-10-21T21:48:57.211033] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-21T21:48:57.219568] [INFO ] [REMOTE ] VRT: Full fetch complete (77932 records). [2025-10-21T21:48:57.219802] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-10-21T21:48:57.617196] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-10-21T21:48:57.617378] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-10-21T21:48:57.618839] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-10-21T21:48:57.619018] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-10-21T21:48:57.646089] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-21T21:48:57.655351] [DEBUG] [LOCAL ] VRT: Trimmed 77932 records to 53753 (keeping 200 days of data) [2025-10-21T21:48:57.752302] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-10-21T21:48:57.994199] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-10-21T21:48:57.994459] [INFO ] [MAIN ] VRT: Full history saved. [2025-10-21T21:48:57.995304] [INFO ] [MAIN ] Update Progress: 2249/2366 symbols completed. VRT took 49.6s. Estimated remaining: 15m 2s. Rate: 7.8 symbols/min [2025-10-21T21:48:58.173144] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:48:58.203489] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T21:48:58.246550] [DEBUG] [LOCAL ] VTEX: Loaded 42953 existing records from primary storage. [2025-10-21T21:48:58.246849] [INFO ] [MAIN ] VTEX: Loaded 42953 existing records. [2025-10-21T21:48:58.434682] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:48:58.434913] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-10-21T21:48:58.434961] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-10-21T21:48:58.435140] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-10-21T21:48:58.435179] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-10-21T21:48:58.556184] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-10. [2025-10-21T21:48:58.801564] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:48:59.351072] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-10-21T21:49:00.031988] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-21T21:49:00.150999] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-10-21T21:49:00.256932] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-21T21:49:00.265317] [INFO ] [REMOTE ] VSH: Full fetch complete (70944 records). [2025-10-21T21:49:00.265513] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-10-21T21:49:00.674416] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-10-21T21:49:00.674607] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-10-21T21:49:00.676526] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-10-21T21:49:00.676627] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-10-21T21:49:00.706628] [DEBUG] [LOCAL ] VSH: Trimmed 70944 records to 48240 (keeping 200 days of data) [2025-10-21T21:49:00.709773] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T21:49:00.955715] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-10-21T21:49:01.037699] [DEBUG] [LOCAL ] VSH: Primary data saved (48240 records). [2025-10-21T21:49:01.037926] [INFO ] [MAIN ] VSH: Full history saved. [2025-10-21T21:49:01.038419] [INFO ] [MAIN ] Update Progress: 2250/2366 symbols completed. VSH took 28.5s. Estimated remaining: 14m 54s. Rate: 7.8 symbols/min [2025-10-21T21:49:01.231093] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:49:01.283133] [DEBUG] [LOCAL ] VTLE: Loaded 47796 existing records from primary storage. [2025-10-21T21:49:01.283525] [INFO ] [MAIN ] VTLE: Loaded 47796 existing records. [2025-10-21T21:49:01.465059] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:49:01.465337] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-10-21T21:49:01.465390] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-10-21T21:49:01.465846] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-10-21T21:49:01.465903] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-10-21T21:49:01.758365] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-10-21T21:49:01.866756] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:49:02.255484] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-21T21:49:02.551044] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-10-21T21:49:02.936222] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-21T21:49:03.351039] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-10-21T21:49:03.421974] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-21T21:49:03.729692] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-21T21:49:04.151055] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-10-21T21:49:04.951032] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-10-21T21:49:05.521819] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-21T21:49:05.588891] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-21T21:49:05.751024] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-10-21T21:49:06.428525] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T21:49:06.551055] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-10-21T21:49:07.305357] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T21:49:07.351033] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-10-21T21:49:08.151032] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-10-21T21:49:08.347775] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-21T21:49:08.893718] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T21:49:08.950981] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-10-21T21:49:09.751024] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-10-21T21:49:10.408387] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-21T21:49:10.479349] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T21:49:10.551021] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-10-21T21:49:11.351003] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-10-21T21:49:11.405328] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T21:49:12.151013] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-10-21T21:49:12.205790] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-21T21:49:12.914866] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T21:49:12.950999] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-10-21T21:49:13.751073] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-10-21T21:49:14.410694] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T21:49:14.425877] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-21T21:49:14.551056] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-10. [2025-10-21T21:49:15.350998] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-10-21T21:49:15.511613] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T21:49:15.748377] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T21:49:15.755832] [INFO ] [REMOTE ] VSTS: Full fetch complete (69763 records). [2025-10-21T21:49:15.755931] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-10-21T21:49:16.149374] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-10-21T21:49:16.149467] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-10-21T21:49:16.150684] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-10-21T21:49:16.150745] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-10-21T21:49:16.151051] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-10-21T21:49:16.153118] [DEBUG] [LOCAL ] VSTS: Trimmed 69763 records to 48872 (keeping 200 days of data) [2025-10-21T21:49:16.421575] [DEBUG] [LOCAL ] VSTS: Primary data saved (48872 records). [2025-10-21T21:49:16.421757] [INFO ] [MAIN ] VSTS: Full history saved. [2025-10-21T21:49:16.421849] [INFO ] [MAIN ] Update Progress: 2251/2366 symbols completed. VSTS took 24.3s. Estimated remaining: 14m 47s. Rate: 7.8 symbols/min [2025-10-21T21:49:16.590284] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:49:16.608032] [DEBUG] [LOCAL ] VTMX: Loaded 17621 existing records from primary storage. [2025-10-21T21:49:16.608265] [INFO ] [MAIN ] VTMX: Loaded 17621 existing records. [2025-10-21T21:49:16.782524] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:49:16.782786] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-10-21T21:49:16.782834] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-10-21T21:49:16.783012] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-10-21T21:49:16.783067] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-10-21T21:49:16.963747] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-10-21T21:49:17.138225] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:49:17.624152] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-21T21:49:17.751017] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-10. [2025-10-21T21:49:17.822847] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T21:49:18.462772] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T21:49:18.471442] [INFO ] [REMOTE ] VST: Full fetch complete (77888 records). [2025-10-21T21:49:18.471688] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-10-21T21:49:18.562457] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-10-21T21:49:18.743943] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T21:49:18.926032] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-10-21T21:49:18.926343] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-10-21T21:49:18.927599] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-10-21T21:49:18.927703] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-10-21T21:49:18.929134] [DEBUG] [LOCAL ] VST: Trimmed 77888 records to 53709 (keeping 200 days of data) [2025-10-21T21:49:19.268525] [DEBUG] [LOCAL ] VST: Primary data saved (53709 records). [2025-10-21T21:49:19.268715] [INFO ] [MAIN ] VST: Full history saved. [2025-10-21T21:49:19.269276] [INFO ] [MAIN ] Update Progress: 2252/2366 symbols completed. VST took 37.2s. Estimated remaining: 14m 39s. Rate: 7.8 symbols/min [2025-10-21T21:49:19.359556] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-10-21T21:49:19.441381] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:49:19.451868] [DEBUG] [LOCAL ] VTN: Loaded 7075 existing records from primary storage. [2025-10-21T21:49:19.452090] [INFO ] [MAIN ] VTN: Loaded 7075 existing records. [2025-10-21T21:49:19.642090] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:49:19.642365] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-10-21T21:49:19.642413] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-10-21T21:49:19.642711] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-10-21T21:49:19.642770] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-10-21T21:49:20.002179] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:49:20.151069] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-10-21T21:49:20.300241] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T21:49:20.437488] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-21T21:49:20.951047] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-10-21T21:49:21.721027] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-21T21:49:21.751013] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-10-21T21:49:22.551067] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-10-21T21:49:22.809778] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T21:49:22.841050] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-21T21:49:23.351043] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-10-21T21:49:24.151036] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-10-21T21:49:24.214439] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T21:49:24.951031] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-10-21T21:49:25.021343] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-21T21:49:25.064116] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-21T21:49:25.708376] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T21:49:25.751051] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-10-21T21:49:26.462863] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-21T21:49:26.551014] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-10-21T21:49:27.351012] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-10-21T21:49:27.571600] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-21T21:49:28.093446] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-21T21:49:28.151042] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-10-21T21:49:28.951044] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-10-21T21:49:29.692325] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-21T21:49:29.751013] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-10. [2025-10-21T21:49:30.026784] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-21T21:49:30.551063] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-10-21T21:49:31.233501] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T21:49:31.240338] [INFO ] [REMOTE ] VTEX: Full fetch complete (60996 records). [2025-10-21T21:49:31.240477] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-10-21T21:49:31.351837] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-10-21T21:49:31.413597] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-21T21:49:31.652913] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-10-21T21:49:31.652998] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-10-21T21:49:31.654104] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-10-21T21:49:31.654165] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-10-21T21:49:31.655334] [DEBUG] [LOCAL ] VTEX: Trimmed 60996 records to 42894 (keeping 200 days of data) [2025-10-21T21:49:31.898118] [DEBUG] [LOCAL ] VTEX: Primary data saved (42894 records). [2025-10-21T21:49:31.898279] [INFO ] [MAIN ] VTEX: Full history saved. [2025-10-21T21:49:31.898912] [INFO ] [MAIN ] Update Progress: 2253/2366 symbols completed. VTEX took 33.9s. Estimated remaining: 14m 31s. Rate: 7.8 symbols/min [2025-10-21T21:49:32.078106] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:49:32.099052] [DEBUG] [LOCAL ] VTOL: Loaded 19532 existing records from primary storage. [2025-10-21T21:49:32.099318] [INFO ] [MAIN ] VTOL: Loaded 19532 existing records. [2025-10-21T21:49:32.164746] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-10-21T21:49:32.285432] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:49:32.285703] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-10-21T21:49:32.285762] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-10-21T21:49:32.285971] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-10-21T21:49:32.286028] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-10-21T21:49:32.651609] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:49:32.868756] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:49:32.950984] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-10. [2025-10-21T21:49:33.214540] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-21T21:49:33.751060] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-10-21T21:49:34.528888] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T21:49:34.536089] [INFO ] [REMOTE ] VTLE: Full fetch complete (68443 records). [2025-10-21T21:49:34.536243] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-10-21T21:49:34.558150] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-10-21T21:49:34.876629] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-21T21:49:34.969782] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-10-21T21:49:34.969872] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-10-21T21:49:34.971262] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-10-21T21:49:34.971328] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-10-21T21:49:34.972819] [DEBUG] [LOCAL ] VTLE: Trimmed 68443 records to 47663 (keeping 200 days of data) [2025-10-21T21:49:35.255881] [DEBUG] [LOCAL ] VTLE: Primary data saved (47663 records). [2025-10-21T21:49:35.256039] [INFO ] [MAIN ] VTLE: Full history saved. [2025-10-21T21:49:35.256381] [INFO ] [MAIN ] Update Progress: 2254/2366 symbols completed. VTLE took 34.2s. Estimated remaining: 14m 23s. Rate: 7.8 symbols/min [2025-10-21T21:49:35.356292] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-10-21T21:49:35.459632] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:49:35.469836] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-21T21:49:35.521802] [DEBUG] [LOCAL ] VTR: Loaded 52720 existing records from primary storage. [2025-10-21T21:49:35.522169] [INFO ] [MAIN ] VTR: Loaded 52720 existing records. [2025-10-21T21:49:35.730046] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:49:35.730295] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-10-21T21:49:35.730369] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-10-21T21:49:35.730611] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-10-21T21:49:35.730736] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-10-21T21:49:36.157956] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:49:36.154430] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-10-21T21:49:36.170516] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-21T21:49:36.951028] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-10-21T21:49:37.107621] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-21T21:49:37.751076] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-10-21T21:49:38.465091] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T21:49:38.550995] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-10-21T21:49:38.792669] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T21:49:39.351014] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-10-21T21:49:40.150993] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-10-21T21:49:40.189108] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T21:49:40.309877] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T21:49:40.764054] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-21T21:49:40.951021] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-10-21T21:49:41.751038] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-10-21T21:49:42.050565] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-21T21:49:42.434009] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-21T21:49:42.551037] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-10-21T21:49:43.351024] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-10-21T21:49:44.151077] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-10. [2025-10-21T21:49:44.383720] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T21:49:44.424942] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T21:49:44.951093] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-10-21T21:49:45.133397] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T21:49:45.138336] [INFO ] [REMOTE ] VTMX: Full fetch complete (25656 records). [2025-10-21T21:49:45.138543] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-10-21T21:49:45.607253] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-10-21T21:49:45.607400] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-10-21T21:49:45.608331] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-10-21T21:49:45.608399] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-10-21T21:49:45.609325] [DEBUG] [LOCAL ] VTMX: Trimmed 25656 records to 17484 (keeping 200 days of data) [2025-10-21T21:49:45.716043] [DEBUG] [LOCAL ] VTMX: Primary data saved (17484 records). [2025-10-21T21:49:45.716173] [INFO ] [MAIN ] VTMX: Full history saved. [2025-10-21T21:49:45.716250] [INFO ] [MAIN ] Update Progress: 2255/2366 symbols completed. VTMX took 29.3s. Estimated remaining: 14m 16s. Rate: 7.8 symbols/min [2025-10-21T21:49:45.756233] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-10-21T21:49:45.784907] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-21T21:49:45.906330] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:49:45.935576] [DEBUG] [LOCAL ] VTS: Loaded 29986 existing records from primary storage. [2025-10-21T21:49:45.935860] [INFO ] [MAIN ] VTS: Loaded 29986 existing records. [2025-10-21T21:49:46.112063] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:49:46.112249] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-10-21T21:49:46.112308] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-10-21T21:49:46.112501] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-10-21T21:49:46.112538] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-10-21T21:49:46.464427] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:49:46.550986] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-10-21T21:49:46.850879] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-21T21:49:47.351041] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-10-21T21:49:47.732181] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-21T21:49:48.141477] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T21:49:48.150998] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-10-21T21:49:48.951093] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-10-21T21:49:48.953286] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-21T21:49:49.751044] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-10. [2025-10-21T21:49:50.417792] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T21:49:50.420217] [INFO ] [REMOTE ] VTN: Full fetch complete (10826 records). [2025-10-21T21:49:50.420572] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-10-21T21:49:50.551970] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-10-21T21:49:50.792678] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-10-21T21:49:50.792840] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-10-21T21:49:50.793210] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-10-21T21:49:50.793363] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-10-21T21:49:50.794067] [DEBUG] [LOCAL ] VTN: Trimmed 10826 records to 7086 (keeping 200 days of data) [2025-10-21T21:49:50.836419] [DEBUG] [LOCAL ] VTN: Primary data saved (7086 records). [2025-10-21T21:49:50.836557] [INFO ] [MAIN ] VTN: Full history saved. [2025-10-21T21:49:50.836662] [INFO ] [MAIN ] Update Progress: 2256/2366 symbols completed. VTN took 31.6s. Estimated remaining: 14m 8s. Rate: 7.8 symbols/min [2025-10-21T21:49:51.012305] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:49:51.046378] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-21T21:49:51.084864] [DEBUG] [LOCAL ] VVR: Loaded 31242 existing records from primary storage. [2025-10-21T21:49:51.085141] [INFO ] [MAIN ] VVR: Loaded 31242 existing records. [2025-10-21T21:49:51.266812] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:49:51.267027] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-10-21T21:49:51.267074] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-10-21T21:49:51.267255] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-10-21T21:49:51.267294] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-10-21T21:49:51.358676] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-10-21T21:49:51.614296] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T21:49:51.650905] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:49:52.151013] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-10-21T21:49:52.951066] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-10-21T21:49:53.297924] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T21:49:53.541137] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T21:49:53.751018] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-10-21T21:49:54.267550] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T21:49:54.551019] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-10-21T21:49:55.351029] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-10-21T21:49:55.373313] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-21T21:49:55.566031] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T21:49:56.151008] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-10-21T21:49:56.715572] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T21:49:56.792608] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-21T21:49:56.951002] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-10-21T21:49:57.751058] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-10-21T21:49:57.996126] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T21:49:58.551074] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-10-21T21:49:58.836932] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-21T21:49:59.351010] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-10-21T21:49:59.525794] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-21T21:50:00.151024] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-10. [2025-10-21T21:50:00.950992] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-10-21T21:50:01.086506] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T21:50:01.089409] [INFO ] [REMOTE ] VTOL: Full fetch complete (26366 records). [2025-10-21T21:50:01.089482] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-10-21T21:50:01.464081] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-10-21T21:50:01.464256] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-10-21T21:50:01.464842] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-10-21T21:50:01.464921] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-10-21T21:50:01.465744] [DEBUG] [LOCAL ] VTOL: Trimmed 26366 records to 19443 (keeping 200 days of data) [2025-10-21T21:50:01.584770] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-21T21:50:01.625290] [DEBUG] [LOCAL ] VTOL: Primary data saved (19443 records). [2025-10-21T21:50:01.625436] [INFO ] [MAIN ] VTOL: Full history saved. [2025-10-21T21:50:01.625518] [INFO ] [MAIN ] Update Progress: 2257/2366 symbols completed. VTOL took 29.7s. Estimated remaining: 14m 0s. Rate: 7.8 symbols/min [2025-10-21T21:50:01.756247] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-10-21T21:50:01.801406] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:50:01.847945] [DEBUG] [LOCAL ] VVV: Loaded 50231 existing records from primary storage. [2025-10-21T21:50:01.848258] [INFO ] [MAIN ] VVV: Loaded 50231 existing records. [2025-10-21T21:50:02.040026] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:50:02.040215] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-10-21T21:50:02.040262] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-10-21T21:50:02.040448] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-10-21T21:50:02.040503] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-10-21T21:50:02.419056] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-21T21:50:02.491821] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:50:02.550982] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-10-21T21:50:03.242414] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T21:50:03.351050] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-10-21T21:50:03.805356] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T21:50:04.151056] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-10-21T21:50:04.762781] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-21T21:50:04.951075] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-10-21T21:50:05.751047] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-10-21T21:50:05.754447] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-21T21:50:06.349398] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-21T21:50:06.551034] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-10-21T21:50:07.351077] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-10-21T21:50:07.404038] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T21:50:07.767433] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T21:50:08.151060] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-10-21T21:50:08.951038] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-10-21T21:50:09.173703] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T21:50:09.616811] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-21T21:50:09.751047] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-10. [2025-10-21T21:50:10.188852] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T21:50:10.444726] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T21:50:10.452802] [INFO ] [REMOTE ] VTR: Full fetch complete (76477 records). [2025-10-21T21:50:10.452933] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-10-21T21:50:10.552421] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-10-21T21:50:10.846629] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-10-21T21:50:10.846748] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-10-21T21:50:10.847984] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-10-21T21:50:10.848046] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-10-21T21:50:10.849468] [DEBUG] [LOCAL ] VTR: Trimmed 76477 records to 52712 (keeping 200 days of data) [2025-10-21T21:50:11.168269] [DEBUG] [LOCAL ] VTR: Primary data saved (52712 records). [2025-10-21T21:50:11.168401] [INFO ] [MAIN ] VTR: Full history saved. [2025-10-21T21:50:11.168476] [INFO ] [MAIN ] Update Progress: 2258/2366 symbols completed. VTR took 35.9s. Estimated remaining: 13m 53s. Rate: 7.8 symbols/min [2025-10-21T21:50:11.333552] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:50:11.355123] [DEBUG] [LOCAL ] VVX: Loaded 23053 existing records from primary storage. [2025-10-21T21:50:11.354616] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-10-21T21:50:11.356136] [INFO ] [MAIN ] VVX: Loaded 23053 existing records. [2025-10-21T21:50:11.536309] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:50:11.536528] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-10-21T21:50:11.536585] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-10-21T21:50:11.536777] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-10-21T21:50:11.536834] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-10-21T21:50:11.888030] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:50:11.920208] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-21T21:50:12.151050] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-10-21T21:50:12.742743] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T21:50:12.951015] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-10. [2025-10-21T21:50:13.750989] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-10-21T21:50:13.915204] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T21:50:14.114203] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T21:50:14.118898] [INFO ] [REMOTE ] VTS: Full fetch complete (41614 records). [2025-10-21T21:50:14.118986] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-10-21T21:50:14.489532] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-10-21T21:50:14.489629] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-10-21T21:50:14.490487] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-10-21T21:50:14.490532] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-10-21T21:50:14.491436] [DEBUG] [LOCAL ] VTS: Trimmed 41614 records to 29970 (keeping 200 days of data) [2025-10-21T21:50:14.551734] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-10-21T21:50:14.672351] [DEBUG] [LOCAL ] VTS: Primary data saved (29970 records). [2025-10-21T21:50:14.672476] [INFO ] [MAIN ] VTS: Full history saved. [2025-10-21T21:50:14.672549] [INFO ] [MAIN ] Update Progress: 2259/2366 symbols completed. VTS took 29.0s. Estimated remaining: 13m 45s. Rate: 7.8 symbols/min [2025-10-21T21:50:14.843055] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:50:14.858924] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-21T21:50:14.908076] [DEBUG] [LOCAL ] VYX: Loaded 48363 existing records from primary storage. [2025-10-21T21:50:14.908461] [INFO ] [MAIN ] VYX: Loaded 48363 existing records. [2025-10-21T21:50:15.084268] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:50:15.084507] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-10-21T21:50:15.084562] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-10-21T21:50:15.084960] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-10-21T21:50:15.085016] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-10-21T21:50:15.356237] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-10-21T21:50:15.446452] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:50:16.150995] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-10-21T21:50:16.290746] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-21T21:50:16.351202] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-21T21:50:16.951020] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-10-21T21:50:17.750999] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-10-21T21:50:17.838611] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T21:50:18.246193] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-21T21:50:18.471001] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-21T21:50:18.551006] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-10-21T21:50:19.351059] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-10-21T21:50:19.944683] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T21:50:20.151076] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-10-21T21:50:20.338864] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-21T21:50:20.951021] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-10-21T21:50:21.751076] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-10-21T21:50:21.901346] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-21T21:50:22.495248] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T21:50:22.550986] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-10-21T21:50:23.142284] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-21T21:50:23.351065] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-10-21T21:50:24.118992] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T21:50:24.150992] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-10-21T21:50:24.647190] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-21T21:50:24.951022] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-10-21T21:50:25.751101] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-10-21T21:50:25.841240] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T21:50:26.551020] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-10. [2025-10-21T21:50:26.617691] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T21:50:26.800188] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-21T21:50:27.351029] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-10-21T21:50:27.924419] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-21T21:50:27.931504] [INFO ] [REMOTE ] VVR: Full fetch complete (46823 records). [2025-10-21T21:50:27.931627] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-10-21T21:50:28.154025] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-10. [2025-10-21T21:50:28.367151] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-10-21T21:50:28.367269] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-10-21T21:50:28.368819] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-10-21T21:50:28.368901] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-10-21T21:50:28.370215] [DEBUG] [LOCAL ] VVR: Trimmed 46823 records to 31317 (keeping 200 days of data) [2025-10-21T21:50:28.551532] [DEBUG] [LOCAL ] VVR: Primary data saved (31317 records). [2025-10-21T21:50:28.551702] [INFO ] [MAIN ] VVR: Full history saved. [2025-10-21T21:50:28.551796] [INFO ] [MAIN ] Update Progress: 2260/2366 symbols completed. VVR took 37.7s. Estimated remaining: 13m 37s. Rate: 7.8 symbols/min [2025-10-21T21:50:28.719854] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:50:28.769020] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-21T21:50:28.769334] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-10-21T21:50:28.950275] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:50:28.950521] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-10-21T21:50:28.950569] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-10-21T21:50:28.950804] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-10-21T21:50:28.950861] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-10-21T21:50:28.971950] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-10-21T21:50:29.361304] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T21:50:29.401032] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:50:29.751067] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-10-21T21:50:29.910153] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-21T21:50:29.918444] [INFO ] [REMOTE ] VVV: Full fetch complete (72465 records). [2025-10-21T21:50:29.918618] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-10-21T21:50:30.045123] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-21T21:50:30.342683] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-10-21T21:50:30.342769] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-10-21T21:50:30.343925] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-10-21T21:50:30.343985] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-10-21T21:50:30.345259] [DEBUG] [LOCAL ] VVV: Trimmed 72465 records to 50174 (keeping 200 days of data) [2025-10-21T21:50:30.557711] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-10-21T21:50:30.643577] [DEBUG] [LOCAL ] VVV: Primary data saved (50174 records). [2025-10-21T21:50:30.643750] [INFO ] [MAIN ] VVV: Full history saved. [2025-10-21T21:50:30.644419] [INFO ] [MAIN ] Update Progress: 2261/2366 symbols completed. VVV took 29.0s. Estimated remaining: 13m 29s. Rate: 7.8 symbols/min [2025-10-21T21:50:30.814868] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:50:30.866456] [DEBUG] [LOCAL ] W: Loaded 53421 existing records from primary storage. [2025-10-21T21:50:30.866791] [INFO ] [MAIN ] W: Loaded 53421 existing records. [2025-10-21T21:50:31.043351] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:50:31.043553] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-10-21T21:50:31.043618] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-10-21T21:50:31.043829] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-10-21T21:50:31.043878] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-10-21T21:50:31.351911] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-10-21T21:50:31.413242] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:50:31.439007] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T21:50:31.590505] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-21T21:50:32.151090] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-10-21T21:50:32.951039] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-10-21T21:50:33.751058] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-10-21T21:50:33.786840] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T21:50:33.860715] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-10-21T21:50:34.552078] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-10-21T21:50:34.551988] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T21:50:34.855046] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T21:50:35.351042] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-10-21T21:50:36.150995] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-10-21T21:50:36.349227] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-21T21:50:36.951095] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-10-21T21:50:37.220681] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-21T21:50:37.605981] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-21T21:50:37.751092] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-10-21T21:50:38.551093] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-10-21T21:50:38.805726] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T21:50:39.351068] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-10-21T21:50:39.919460] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-21T21:50:40.042812] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-21T21:50:40.150977] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-10-21T21:50:40.951048] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-10-21T21:50:41.301561] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-21T21:50:41.751058] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-10. [2025-10-21T21:50:42.546057] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-21T21:50:42.556268] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-10-21T21:50:42.634264] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:50:42.687473] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-21T21:50:42.691008] [INFO ] [REMOTE ] VVX: Full fetch complete (33063 records). [2025-10-21T21:50:42.691079] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-10-21T21:50:43.058473] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-10-21T21:50:43.058547] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-10-21T21:50:43.059526] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-10-21T21:50:43.059587] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-10-21T21:50:43.060397] [DEBUG] [LOCAL ] VVX: Trimmed 33063 records to 23041 (keeping 200 days of data) [2025-10-21T21:50:43.191069] [DEBUG] [LOCAL ] VVX: Primary data saved (23041 records). [2025-10-21T21:50:43.191192] [INFO ] [MAIN ] VVX: Full history saved. [2025-10-21T21:50:43.191268] [INFO ] [MAIN ] Update Progress: 2262/2366 symbols completed. VVX took 32.0s. Estimated remaining: 13m 22s. Rate: 7.8 symbols/min [2025-10-21T21:50:43.356102] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-10-21T21:50:43.358711] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:50:43.400694] [DEBUG] [LOCAL ] WAB: Loaded 43863 existing records from primary storage. [2025-10-21T21:50:43.401009] [INFO ] [MAIN ] WAB: Loaded 43863 existing records. [2025-10-21T21:50:43.576889] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:50:43.577085] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-10-21T21:50:43.577131] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-10-21T21:50:43.577315] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-10-21T21:50:43.577356] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-10-21T21:50:43.924877] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:50:44.151009] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-10-21T21:50:44.554309] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-21T21:50:44.878418] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:50:44.950998] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-10. [2025-10-21T21:50:45.751097] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-10-21T21:50:46.348111] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-21T21:50:46.356042] [INFO ] [REMOTE ] VYX: Full fetch complete (70227 records). [2025-10-21T21:50:46.356154] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-10-21T21:50:46.555782] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-10-21T21:50:46.757337] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-10-21T21:50:46.768000] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-10-21T21:50:46.774413] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-10-21T21:50:46.774509] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-10-21T21:50:46.790709] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-21T21:50:46.790867] [DEBUG] [LOCAL ] VYX: Trimmed 70227 records to 48341 (keeping 200 days of data) [2025-10-21T21:50:47.123097] [DEBUG] [LOCAL ] VYX: Primary data saved (48341 records). [2025-10-21T21:50:47.123514] [INFO ] [MAIN ] VYX: Full history saved. [2025-10-21T21:50:47.124152] [INFO ] [MAIN ] Update Progress: 2263/2366 symbols completed. VYX took 32.5s. Estimated remaining: 13m 14s. Rate: 7.8 symbols/min [2025-10-21T21:50:47.127113] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-21T21:50:47.315054] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:50:47.356162] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-10-21T21:50:47.359392] [DEBUG] [LOCAL ] WAL: Loaded 45683 existing records from primary storage. [2025-10-21T21:50:47.359783] [INFO ] [MAIN ] WAL: Loaded 45683 existing records. [2025-10-21T21:50:47.545601] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:50:47.545864] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-10-21T21:50:47.545910] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-10-21T21:50:47.546120] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-10-21T21:50:47.546176] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-10-21T21:50:47.919207] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:50:47.952754] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T21:50:48.151033] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-10-21T21:50:48.951008] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-10-21T21:50:49.042100] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T21:50:49.504428] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T21:50:49.751032] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-10-21T21:50:50.551077] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-10-21T21:50:50.973238] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-21T21:50:51.305859] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T21:50:51.350999] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-10-21T21:50:52.151020] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-10-21T21:50:52.299514] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T21:50:52.950999] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-10-21T21:50:53.143565] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-21T21:50:53.750992] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-10-21T21:50:53.909785] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-21T21:50:54.551039] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-10-21T21:50:54.795833] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T21:50:55.351001] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-10-21T21:50:55.719251] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-21T21:50:56.151001] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-10-21T21:50:56.442279] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-21T21:50:56.951078] [INFO ] [REMOTE ] W: Fetching primary data for 2025-10. [2025-10-21T21:50:57.619931] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-21T21:50:57.751002] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-10-21T21:50:57.916034] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T21:50:58.551018] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-10-21T21:50:58.604080] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-21T21:50:58.613551] [INFO ] [REMOTE ] W: Full fetch complete (77514 records). [2025-10-21T21:50:58.613794] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-10-21T21:50:59.005013] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-10-21T21:50:59.005117] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-10-21T21:50:59.006330] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-10-21T21:50:59.006396] [DEBUG] [LOCAL ] W: Saving primary data. [2025-10-21T21:50:59.007903] [DEBUG] [LOCAL ] W: Trimmed 77514 records to 53408 (keeping 200 days of data) [2025-10-21T21:50:59.317438] [DEBUG] [LOCAL ] W: Primary data saved (53408 records). [2025-10-21T21:50:59.317571] [INFO ] [MAIN ] W: Full history saved. [2025-10-21T21:50:59.318238] [INFO ] [MAIN ] Update Progress: 2264/2366 symbols completed. W took 28.7s. Estimated remaining: 13m 6s. Rate: 7.8 symbols/min [2025-10-21T21:50:59.362160] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-10-21T21:50:59.491586] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:50:59.530619] [DEBUG] [LOCAL ] WAT: Loaded 35792 existing records from primary storage. [2025-10-21T21:50:59.530954] [INFO ] [MAIN ] WAT: Loaded 35792 existing records. [2025-10-21T21:50:59.710533] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:50:59.710753] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-10-21T21:50:59.710805] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-10-21T21:50:59.711077] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-10-21T21:50:59.711135] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-10-21T21:51:00.081366] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:00.106463] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T21:51:00.150983] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-10-21T21:51:00.183439] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-21T21:51:00.951034] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-10-21T21:51:01.236098] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T21:51:01.646527] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-21T21:51:01.751066] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-10-21T21:51:02.551134] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-10-21T21:51:03.189503] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T21:51:03.330679] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-21T21:51:03.351024] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-10-21T21:51:04.151094] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-10-21T21:51:04.236945] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T21:51:04.699502] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T21:51:04.951082] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-10. [2025-10-21T21:51:05.669435] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T21:51:05.678226] [INFO ] [REMOTE ] VZ: Full fetch complete (77971 records). [2025-10-21T21:51:05.678345] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-10-21T21:51:05.754092] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-10-21T21:51:06.111886] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-10-21T21:51:06.111993] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-10-21T21:51:06.113305] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-10-21T21:51:06.113401] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-10-21T21:51:06.115635] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-21T21:51:06.126391] [DEBUG] [LOCAL ] VZ: Trimmed 77971 records to 53791 (keeping 200 days of data) [2025-10-21T21:51:06.458689] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-10-21T21:51:06.458823] [INFO ] [MAIN ] VZ: Full history saved. [2025-10-21T21:51:06.459442] [INFO ] [MAIN ] Update Progress: 2265/2366 symbols completed. VZ took 37.9s. Estimated remaining: 12m 59s. Rate: 7.8 symbols/min [2025-10-21T21:51:06.556452] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-10-21T21:51:06.628443] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:51:06.628571] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-10-21T21:51:06.628625] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-10-21T21:51:06.628785] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-10-21T21:51:06.628842] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-21T21:51:06.628886] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-21T21:51:06.628919] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-10-21T21:51:06.975753] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:07.351081] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-10-21T21:51:07.445562] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T21:51:08.151056] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-10-21T21:51:08.252344] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T21:51:08.363626] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:51:08.363977] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-10-21T21:51:08.364062] [FATAL] [REMOTE ] WBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:51:08.364137] [FATAL] [MAIN ] WBI: Failed to fetch primary data. [2025-10-21T21:51:08.364200] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:51:08.364270] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-10-21T21:51:08.364334] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-10-21T21:51:08.364370] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-10-21T21:51:08.364408] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-10-21T21:51:08.364453] [INFO ] [MAIN ] Update Progress: 2266/2366 symbols completed. WBI took 1.9s. Estimated remaining: 12m 51s. Rate: 7.8 symbols/min [2025-10-21T21:51:08.544114] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:51:08.563608] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-21T21:51:08.612606] [DEBUG] [LOCAL ] WBS: Loaded 48845 existing records from primary storage. [2025-10-21T21:51:08.612904] [INFO ] [MAIN ] WBS: Loaded 48845 existing records. [2025-10-21T21:51:08.790839] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:51:08.791053] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-10-21T21:51:08.791100] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-10-21T21:51:08.791304] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-10-21T21:51:08.791360] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-10-21T21:51:08.958339] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-10-21T21:51:09.145206] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:09.751076] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-10-21T21:51:10.551003] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-10-21T21:51:10.624268] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T21:51:11.351051] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-10-21T21:51:11.398370] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-21T21:51:11.774064] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-21T21:51:12.151060] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-10. [2025-10-21T21:51:12.845203] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-21T21:51:12.951021] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-10-21T21:51:13.751059] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-10-21T21:51:13.892200] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-21T21:51:13.900675] [INFO ] [REMOTE ] WAL: Full fetch complete (67276 records). [2025-10-21T21:51:13.900807] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-10-21T21:51:14.328716] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-10-21T21:51:14.329311] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-10-21T21:51:14.330182] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T21:51:14.331333] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-10-21T21:51:14.339087] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-10-21T21:51:14.340264] [DEBUG] [LOCAL ] WAL: Trimmed 67276 records to 45675 (keeping 200 days of data) [2025-10-21T21:51:14.551227] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-10. [2025-10-21T21:51:14.614772] [DEBUG] [LOCAL ] WAL: Primary data saved (45675 records). [2025-10-21T21:51:14.614894] [INFO ] [MAIN ] WAL: Full history saved. [2025-10-21T21:51:14.614968] [INFO ] [MAIN ] Update Progress: 2267/2366 symbols completed. WAL took 27.5s. Estimated remaining: 12m 43s. Rate: 7.8 symbols/min [2025-10-21T21:51:14.784203] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:51:14.795816] [DEBUG] [LOCAL ] WBX: Loaded 10196 existing records from primary storage. [2025-10-21T21:51:14.796031] [INFO ] [MAIN ] WBX: Loaded 10196 existing records. [2025-10-21T21:51:14.975891] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:51:14.976156] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-10-21T21:51:14.976217] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-10-21T21:51:14.976461] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-10-21T21:51:14.976517] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-10-21T21:51:15.361911] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-10-21T21:51:15.368919] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:15.386700] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-21T21:51:15.401475] [INFO ] [REMOTE ] WAB: Full fetch complete (64386 records). [2025-10-21T21:51:15.414932] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-10-21T21:51:15.416232] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T21:51:15.799786] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-10-21T21:51:15.799860] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-10-21T21:51:15.800899] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-10-21T21:51:15.800959] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-10-21T21:51:15.802102] [DEBUG] [LOCAL ] WAB: Trimmed 64386 records to 43805 (keeping 200 days of data) [2025-10-21T21:51:16.063044] [DEBUG] [LOCAL ] WAB: Primary data saved (43805 records). [2025-10-21T21:51:16.063165] [INFO ] [MAIN ] WAB: Full history saved. [2025-10-21T21:51:16.063831] [INFO ] [MAIN ] Update Progress: 2268/2366 symbols completed. WAB took 32.9s. Estimated remaining: 12m 35s. Rate: 7.8 symbols/min [2025-10-21T21:51:16.160337] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-10-21T21:51:16.233604] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:51:16.272530] [DEBUG] [LOCAL ] WCC: Loaded 38838 existing records from primary storage. [2025-10-21T21:51:16.272843] [INFO ] [MAIN ] WCC: Loaded 38838 existing records. [2025-10-21T21:51:16.447820] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:51:16.448015] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-10-21T21:51:16.448061] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-10-21T21:51:16.448245] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-10-21T21:51:16.448282] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-10-21T21:51:16.797405] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T21:51:16.838541] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:16.951010] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-10-21T21:51:17.610883] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T21:51:17.751102] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-10-21T21:51:17.848959] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T21:51:18.551056] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-10-21T21:51:18.916784] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T21:51:19.351075] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-10-21T21:51:20.151043] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-10-21T21:51:20.221037] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T21:51:20.561957] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-21T21:51:20.951039] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-10-21T21:51:21.732283] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-21T21:51:21.750980] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-10-21T21:51:21.913958] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-21T21:51:22.550996] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-10-21T21:51:23.253576] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-21T21:51:23.351022] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-10-21T21:51:24.151020] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-10-21T21:51:24.365637] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-21T21:51:24.367581] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-21T21:51:24.951048] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-10-21T21:51:25.364799] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-21T21:51:25.751019] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-10-21T21:51:26.551013] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-10-21T21:51:26.625273] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T21:51:26.910200] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-21T21:51:27.351049] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-10-21T21:51:28.077279] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-21T21:51:28.150988] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-10-21T21:51:28.436434] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-21T21:51:28.951062] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-10-21T21:51:28.975881] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-21T21:51:29.751123] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-10-21T21:51:30.477109] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T21:51:30.551017] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-10-21T21:51:31.351018] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-10. [2025-10-21T21:51:31.454224] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T21:51:32.068395] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-21T21:51:32.074840] [INFO ] [REMOTE ] WAT: Full fetch complete (50771 records). [2025-10-21T21:51:32.075011] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-10-21T21:51:32.156109] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-10-21T21:51:32.482007] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T21:51:32.509082] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-10-21T21:51:32.509187] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-10-21T21:51:32.510658] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-10-21T21:51:32.510755] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-10-21T21:51:32.512147] [DEBUG] [LOCAL ] WAT: Trimmed 50771 records to 35721 (keeping 200 days of data) [2025-10-21T21:51:32.728288] [DEBUG] [LOCAL ] WAT: Primary data saved (35721 records). [2025-10-21T21:51:32.728453] [INFO ] [MAIN ] WAT: Full history saved. [2025-10-21T21:51:32.728987] [INFO ] [MAIN ] Update Progress: 2269/2366 symbols completed. WAT took 33.4s. Estimated remaining: 12m 28s. Rate: 7.8 symbols/min [2025-10-21T21:51:32.896247] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:51:32.944208] [DEBUG] [LOCAL ] WCN: Loaded 47917 existing records from primary storage. [2025-10-21T21:51:32.944501] [INFO ] [MAIN ] WCN: Loaded 47917 existing records. [2025-10-21T21:51:32.957042] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-10-21T21:51:33.121824] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:51:33.122040] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-10-21T21:51:33.122105] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-10-21T21:51:33.122305] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-10-21T21:51:33.122345] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-10-21T21:51:33.476963] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:33.751024] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-10-21T21:51:33.810800] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T21:51:34.375068] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-21T21:51:34.551008] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-10-21T21:51:34.750115] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T21:51:35.351148] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-10-21T21:51:36.113098] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-21T21:51:36.151011] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-10-21T21:51:36.837917] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T21:51:36.951035] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-10-21T21:51:37.751004] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-10-21T21:51:37.832473] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T21:51:38.112462] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-21T21:51:38.371187] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-21T21:51:38.551079] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-10-21T21:51:39.351041] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-10-21T21:51:40.023431] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T21:51:40.151040] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-10-21T21:51:40.951058] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-10. [2025-10-21T21:51:41.039774] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T21:51:41.623576] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-21T21:51:41.625435] [INFO ] [REMOTE ] WBX: Full fetch complete (21986 records). [2025-10-21T21:51:41.625506] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-10-21T21:51:41.755726] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-10-21T21:51:42.004890] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-10-21T21:51:42.005035] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-10-21T21:51:42.005570] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-10-21T21:51:42.005662] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-10-21T21:51:42.006400] [DEBUG] [LOCAL ] WBX: Trimmed 21986 records to 10081 (keeping 200 days of data) [2025-10-21T21:51:42.087111] [DEBUG] [LOCAL ] WBX: Primary data saved (10081 records). [2025-10-21T21:51:42.089024] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T21:51:42.087573] [INFO ] [MAIN ] WBX: Full history saved. [2025-10-21T21:51:42.099088] [INFO ] [MAIN ] Update Progress: 2270/2366 symbols completed. WBX took 27.5s. Estimated remaining: 12m 20s. Rate: 7.8 symbols/min [2025-10-21T21:51:42.267558] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:51:42.289325] [DEBUG] [LOCAL ] WD: Loaded 22815 existing records from primary storage. [2025-10-21T21:51:42.289548] [INFO ] [MAIN ] WD: Loaded 22815 existing records. [2025-10-21T21:51:42.464639] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:51:42.464919] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-10-21T21:51:42.464981] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-10-21T21:51:42.465145] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-10-21T21:51:42.465183] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-10-21T21:51:42.556224] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-10-21T21:51:42.818441] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:43.350995] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-10-21T21:51:43.528755] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T21:51:44.077222] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:51:44.150982] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-10. [2025-10-21T21:51:44.951053] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-10-21T21:51:45.172636] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T21:51:45.570885] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T21:51:45.576201] [INFO ] [REMOTE ] WCC: Full fetch complete (57229 records). [2025-10-21T21:51:45.576288] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-10-21T21:51:45.751008] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-10. [2025-10-21T21:51:45.972810] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-10-21T21:51:45.972932] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-10-21T21:51:45.973996] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-10-21T21:51:45.974076] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-10-21T21:51:45.986377] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-21T21:51:45.990633] [DEBUG] [LOCAL ] WCC: Trimmed 57229 records to 38619 (keeping 200 days of data) [2025-10-21T21:51:46.225267] [DEBUG] [LOCAL ] WCC: Primary data saved (38619 records). [2025-10-21T21:51:46.225418] [INFO ] [MAIN ] WCC: Full history saved. [2025-10-21T21:51:46.225915] [INFO ] [MAIN ] Update Progress: 2271/2366 symbols completed. WCC took 30.2s. Estimated remaining: 12m 12s. Rate: 7.8 symbols/min [2025-10-21T21:51:46.390544] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:51:46.409493] [DEBUG] [LOCAL ] WDH: Loaded 18081 existing records from primary storage. [2025-10-21T21:51:46.409745] [INFO ] [MAIN ] WDH: Loaded 18081 existing records. [2025-10-21T21:51:46.556269] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-10-21T21:51:46.583558] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:51:46.583862] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-10-21T21:51:46.583916] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-10-21T21:51:46.584086] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-10-21T21:51:46.584140] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-10-21T21:51:46.930592] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:47.351007] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-10-21T21:51:47.431988] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T21:51:47.439852] [INFO ] [REMOTE ] WBS: Full fetch complete (70370 records). [2025-10-21T21:51:47.439985] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-10-21T21:51:47.828200] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-10-21T21:51:47.833436] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-10-21T21:51:47.840329] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-10-21T21:51:47.842256] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-10-21T21:51:47.843555] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-21T21:51:47.849565] [DEBUG] [LOCAL ] WBS: Trimmed 70370 records to 48842 (keeping 200 days of data) [2025-10-21T21:51:48.130510] [DEBUG] [LOCAL ] WBS: Primary data saved (48842 records). [2025-10-21T21:51:48.130632] [INFO ] [MAIN ] WBS: Full history saved. [2025-10-21T21:51:48.131284] [INFO ] [MAIN ] Update Progress: 2272/2366 symbols completed. WBS took 39.8s. Estimated remaining: 12m 4s. Rate: 7.8 symbols/min [2025-10-21T21:51:48.160466] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-10-21T21:51:48.300142] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:51:48.322485] [DEBUG] [LOCAL ] WDI: Loaded 21311 existing records from primary storage. [2025-10-21T21:51:48.322740] [INFO ] [MAIN ] WDI: Loaded 21311 existing records. [2025-10-21T21:51:48.495859] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:51:48.496052] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-10-21T21:51:48.496098] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-10-21T21:51:48.496331] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-10-21T21:51:48.496386] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-10-21T21:51:48.847319] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:51:48.951027] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-10-21T21:51:49.020126] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-21T21:51:49.386622] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T21:51:49.751012] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-10-21T21:51:50.013674] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-21T21:51:50.551022] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-10-21T21:51:51.077061] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-21T21:51:51.350997] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-10-21T21:51:51.421927] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-21T21:51:52.151023] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-10-21T21:51:52.951096] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-10-21T21:51:53.158363] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T21:51:53.399739] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-21T21:51:53.751046] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-10-21T21:51:53.997785] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T21:51:54.551004] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-10-21T21:51:54.935520] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T21:51:55.354664] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-10-21T21:51:55.357794] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-21T21:51:56.151019] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-10-21T21:51:56.951029] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-10-21T21:51:57.074348] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-21T21:51:57.219439] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-21T21:51:57.751108] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-10-21T21:51:57.920569] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-21T21:51:58.551082] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-10-21T21:51:58.822715] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-21T21:51:59.351076] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-10-21T21:52:00.151046] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-10-21T21:52:00.250626] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T21:52:00.268822] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-21T21:52:00.951018] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-10-21T21:52:01.330995] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T21:52:01.750994] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-10-21T21:52:01.855269] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-21T21:52:02.480702] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-21T21:52:02.550996] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-10-21T21:52:03.351045] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-10-21T21:52:03.606993] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-21T21:52:04.151009] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-10. [2025-10-21T21:52:04.201576] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T21:52:04.951023] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-10-21T21:52:05.751058] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-10-21T21:52:05.950767] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-21T21:52:05.958611] [INFO ] [REMOTE ] WCN: Full fetch complete (69463 records). [2025-10-21T21:52:05.958771] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-10-21T21:52:06.131354] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T21:52:06.370628] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-10-21T21:52:06.370758] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-10-21T21:52:06.371951] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-10-21T21:52:06.372014] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-10-21T21:52:06.373391] [DEBUG] [LOCAL ] WCN: Trimmed 69463 records to 47894 (keeping 200 days of data) [2025-10-21T21:52:06.557080] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-10-21T21:52:06.598381] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-21T21:52:06.678005] [DEBUG] [LOCAL ] WCN: Primary data saved (47894 records). [2025-10-21T21:52:06.678134] [INFO ] [MAIN ] WCN: Full history saved. [2025-10-21T21:52:06.678791] [INFO ] [MAIN ] Update Progress: 2273/2366 symbols completed. WCN took 33.9s. Estimated remaining: 11m 57s. Rate: 7.8 symbols/min [2025-10-21T21:52:06.842828] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:52:06.885253] [DEBUG] [LOCAL ] WDS: Loaded 43142 existing records from primary storage. [2025-10-21T21:52:06.885532] [INFO ] [MAIN ] WDS: Loaded 43142 existing records. [2025-10-21T21:52:07.058787] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:52:07.058985] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-10-21T21:52:07.059033] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-10-21T21:52:07.059263] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-10-21T21:52:07.059320] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-10-21T21:52:07.356196] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-10-21T21:52:07.408945] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:52:07.699213] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-21T21:52:08.151003] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-10-21T21:52:08.514917] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T21:52:08.892632] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T21:52:08.951024] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-10-21T21:52:09.750993] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-10-21T21:52:10.123381] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T21:52:10.551056] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-10-21T21:52:11.119639] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T21:52:11.351003] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-10-21T21:52:11.600041] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-21T21:52:12.151029] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-10. [2025-10-21T21:52:12.661231] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T21:52:12.951005] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-10-21T21:52:13.167173] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T21:52:13.171380] [INFO ] [REMOTE ] WD: Full fetch complete (33101 records). [2025-10-21T21:52:13.171476] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-10-21T21:52:13.546903] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-10-21T21:52:13.546986] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-10-21T21:52:13.547675] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-10-21T21:52:13.547737] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-10-21T21:52:13.548440] [DEBUG] [LOCAL ] WD: Trimmed 33101 records to 22704 (keeping 200 days of data) [2025-10-21T21:52:13.688845] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-21T21:52:13.697893] [DEBUG] [LOCAL ] WD: Primary data saved (22704 records). [2025-10-21T21:52:13.701676] [INFO ] [MAIN ] WD: Full history saved. [2025-10-21T21:52:13.702097] [INFO ] [MAIN ] Update Progress: 2274/2366 symbols completed. WD took 31.6s. Estimated remaining: 11m 49s. Rate: 7.8 symbols/min [2025-10-21T21:52:13.756273] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-10. [2025-10-21T21:52:13.870271] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:52:13.880343] [DEBUG] [LOCAL ] WEA: Loaded 7826 existing records from primary storage. [2025-10-21T21:52:13.880625] [INFO ] [MAIN ] WEA: Loaded 7826 existing records. [2025-10-21T21:52:14.074146] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:52:14.074337] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-10-21T21:52:14.074383] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-10-21T21:52:14.074521] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-10-21T21:52:14.074556] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-10-21T21:52:14.420716] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:52:14.550983] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-10-21T21:52:14.828383] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T21:52:14.832110] [INFO ] [REMOTE ] WDI: Full fetch complete (30325 records). [2025-10-21T21:52:14.832185] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-10-21T21:52:15.199732] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-10-21T21:52:15.199810] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-10-21T21:52:15.200389] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-10-21T21:52:15.200426] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-10-21T21:52:15.201122] [DEBUG] [LOCAL ] WDI: Trimmed 30325 records to 21320 (keeping 200 days of data) [2025-10-21T21:52:15.294533] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-21T21:52:15.337895] [DEBUG] [LOCAL ] WDI: Primary data saved (21320 records). [2025-10-21T21:52:15.338010] [INFO ] [MAIN ] WDI: Full history saved. [2025-10-21T21:52:15.338090] [INFO ] [MAIN ] Update Progress: 2275/2366 symbols completed. WDI took 27.2s. Estimated remaining: 11m 41s. Rate: 7.8 symbols/min [2025-10-21T21:52:15.356264] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-10-21T21:52:15.509280] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:52:15.548536] [DEBUG] [LOCAL ] WEAV: Loaded 42365 existing records from primary storage. [2025-10-21T21:52:15.548859] [INFO ] [MAIN ] WEAV: Loaded 42365 existing records. [2025-10-21T21:52:15.724882] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:52:15.725114] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-10-21T21:52:15.725174] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-10-21T21:52:15.725345] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-10-21T21:52:15.725383] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-10-21T21:52:16.070495] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:52:16.150980] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-10-21T21:52:16.951004] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-10-21T21:52:17.092200] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T21:52:17.542824] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-21T21:52:17.674912] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:52:17.751014] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-10-21T21:52:18.551125] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-10-21T21:52:19.190807] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T21:52:19.351053] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-10-21T21:52:19.937472] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T21:52:20.151059] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-10-21T21:52:20.192351] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-21T21:52:20.951058] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-10-21T21:52:21.751058] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-10-21T21:52:21.814549] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T21:52:22.302541] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-21T21:52:22.372199] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-21T21:52:22.551147] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-10. [2025-10-21T21:52:23.351034] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-10-21T21:52:23.723047] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T21:52:23.729105] [INFO ] [REMOTE ] WDH: Full fetch complete (23905 records). [2025-10-21T21:52:23.729281] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-10-21T21:52:24.153421] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-10-21T21:52:24.200065] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-10-21T21:52:24.200939] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T21:52:24.201209] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-10-21T21:52:24.205750] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-10-21T21:52:24.206952] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-10-21T21:52:24.207960] [DEBUG] [LOCAL ] WDH: Trimmed 23905 records to 18141 (keeping 200 days of data) [2025-10-21T21:52:24.364785] [DEBUG] [LOCAL ] WDH: Primary data saved (18141 records). [2025-10-21T21:52:24.364944] [INFO ] [MAIN ] WDH: Full history saved. [2025-10-21T21:52:24.365065] [INFO ] [MAIN ] Update Progress: 2276/2366 symbols completed. WDH took 38.1s. Estimated remaining: 11m 34s. Rate: 7.8 symbols/min [2025-10-21T21:52:24.647515] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:52:24.720609] [DEBUG] [LOCAL ] WEC: Loaded 52188 existing records from primary storage. [2025-10-21T21:52:24.721110] [INFO ] [MAIN ] WEC: Loaded 52188 existing records. [2025-10-21T21:52:24.961237] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-10-21T21:52:24.984611] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:52:24.985005] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-10-21T21:52:24.985077] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-10-21T21:52:24.985369] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-10-21T21:52:24.985444] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-10-21T21:52:25.365796] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:52:25.751031] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-10-21T21:52:25.795248] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T21:52:26.551015] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-10-21T21:52:26.576138] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T21:52:27.145334] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T21:52:27.336423] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-21T21:52:27.350979] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-10-21T21:52:28.132269] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T21:52:28.151001] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-10-21T21:52:28.761954] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-21T21:52:28.951005] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-10-21T21:52:29.751068] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-10-21T21:52:30.458680] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-21T21:52:30.551034] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-10-21T21:52:30.762582] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T21:52:31.351094] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-10-21T21:52:32.093445] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-21T21:52:32.151025] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-10-21T21:52:32.951089] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-10-21T21:52:33.152620] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T21:52:33.693054] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-21T21:52:33.751099] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-10-21T21:52:34.509901] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-21T21:52:34.551047] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-10. [2025-10-21T21:52:35.176358] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T21:52:35.298575] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-21T21:52:35.300516] [INFO ] [REMOTE ] WEA: Full fetch complete (10133 records). [2025-10-21T21:52:35.300586] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-10-21T21:52:35.356223] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-10-21T21:52:35.684338] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-10-21T21:52:35.684414] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-10-21T21:52:35.684676] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-10-21T21:52:35.684736] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-10-21T21:52:35.685152] [DEBUG] [LOCAL ] WEA: Trimmed 10133 records to 7901 (keeping 200 days of data) [2025-10-21T21:52:35.730715] [DEBUG] [LOCAL ] WEA: Primary data saved (7901 records). [2025-10-21T21:52:35.730823] [INFO ] [MAIN ] WEA: Full history saved. [2025-10-21T21:52:35.730899] [INFO ] [MAIN ] Update Progress: 2277/2366 symbols completed. WEA took 22.0s. Estimated remaining: 11m 26s. Rate: 7.8 symbols/min [2025-10-21T21:52:36.151108] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-10-21T21:52:36.951129] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-10-21T21:52:37.124328] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T21:52:37.542858] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T21:52:37.751079] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-10-21T21:52:38.475610] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:52:38.550982] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-10. [2025-10-21T21:52:39.292267] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-21T21:52:39.351037] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-10-21T21:52:39.687782] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-21T21:52:39.694461] [INFO ] [REMOTE ] WDS: Full fetch complete (64157 records). [2025-10-21T21:52:39.694599] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-10-21T21:52:40.076461] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-10-21T21:52:40.076543] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-10-21T21:52:40.077683] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-10-21T21:52:40.077746] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-10-21T21:52:40.078990] [DEBUG] [LOCAL ] WDS: Trimmed 64157 records to 43057 (keeping 200 days of data) [2025-10-21T21:52:40.166239] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-10-21T21:52:40.337621] [DEBUG] [LOCAL ] WDS: Primary data saved (43057 records). [2025-10-21T21:52:40.337786] [INFO ] [MAIN ] WDS: Full history saved. [2025-10-21T21:52:40.338313] [INFO ] [MAIN ] Update Progress: 2278/2366 symbols completed. WDS took 33.7s. Estimated remaining: 11m 18s. Rate: 7.8 symbols/min [2025-10-21T21:52:41.020616] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T21:52:41.031189] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-10-21T21:52:41.727238] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-21T21:52:41.751008] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-10-21T21:52:42.805943] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-21T21:52:42.817295] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-10-21T21:52:43.330222] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T21:52:43.350978] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-10-21T21:52:44.830623] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-21T21:52:44.842950] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-10-21T21:52:44.964853] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-21T21:52:44.974343] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-10. [2025-10-21T21:52:46.655282] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T21:52:46.662518] [INFO ] [REMOTE ] WEAV: Full fetch complete (61829 records). [2025-10-21T21:52:46.662628] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-10-21T21:52:47.057874] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-10-21T21:52:47.058052] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-10-21T21:52:47.059193] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-10-21T21:52:47.059274] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-10-21T21:52:47.088555] [DEBUG] [LOCAL ] WEAV: Trimmed 61829 records to 42398 (keeping 200 days of data) [2025-10-21T21:52:47.090581] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-21T21:52:47.102903] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-10. [2025-10-21T21:52:47.339252] [DEBUG] [LOCAL ] WEAV: Primary data saved (42398 records). [2025-10-21T21:52:47.339374] [INFO ] [MAIN ] WEAV: Full history saved. [2025-10-21T21:52:47.339988] [INFO ] [MAIN ] Update Progress: 2279/2366 symbols completed. WEAV took 32.0s. Estimated remaining: 11m 10s. Rate: 7.8 symbols/min [2025-10-21T21:52:47.866095] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-21T21:52:47.874178] [INFO ] [REMOTE ] WEC: Full fetch complete (75886 records). [2025-10-21T21:52:47.874290] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-10-21T21:52:48.267523] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-10-21T21:52:48.267599] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-10-21T21:52:48.268895] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-10-21T21:52:48.268958] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-10-21T21:52:48.270261] [DEBUG] [LOCAL ] WEC: Trimmed 75886 records to 52175 (keeping 200 days of data) [2025-10-21T21:52:48.589908] [DEBUG] [LOCAL ] WEC: Primary data saved (52175 records). [2025-10-21T21:52:48.590089] [INFO ] [MAIN ] WEC: Full history saved. [2025-10-21T21:52:48.590597] [INFO ] [MAIN ] Update Progress: 2280/2366 symbols completed. WEC took 24.2s. Estimated remaining: 11m 3s. Rate: 7.8 symbols/min [2025-10-21T21:52:49.245012] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:52:49.304736] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:52:49.309081] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:52:49.327580] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:52:49.343081] [DEBUG] [LOCAL ] WF: Loaded 10893 existing records from primary storage. [2025-10-21T21:52:49.343420] [INFO ] [MAIN ] WF: Loaded 10893 existing records. [2025-10-21T21:52:49.515859] [DEBUG] [LOCAL ] WEX: Loaded 32742 existing records from primary storage. [2025-10-21T21:52:49.589795] [DEBUG] [LOCAL ] WELL: Loaded 52322 existing records from primary storage. [2025-10-21T21:52:49.588857] [INFO ] [MAIN ] WEX: Loaded 32742 existing records. [2025-10-21T21:52:49.580266] [DEBUG] [LOCAL ] WES: Loaded 48673 existing records from primary storage. [2025-10-21T21:52:49.596385] [INFO ] [MAIN ] WELL: Loaded 52322 existing records. [2025-10-21T21:52:49.627581] [INFO ] [MAIN ] WES: Loaded 48673 existing records. [2025-10-21T21:52:49.776940] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:52:49.895186] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-10-21T21:52:49.931747] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-10-21T21:52:49.962182] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-10-21T21:52:50.016003] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-10-21T21:52:50.073915] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:52:50.084773] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-10-21T21:52:50.161457] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-10-21T21:52:50.194527] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-10-21T21:52:50.205746] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:52:50.211595] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-10-21T21:52:50.235718] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-10-21T21:52:50.258412] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-10-21T21:52:50.298107] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:52:50.322970] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-10-21T21:52:50.323067] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-10-21T21:52:50.331169] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-10-21T21:52:50.349277] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-10-21T21:52:50.457563] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-10-21T21:52:50.473689] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-10-21T21:52:51.209838] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:52:51.266292] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-10-21T21:52:51.526231] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:52:51.569822] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:52:51.566886] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-10-21T21:52:51.573969] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-10-21T21:52:51.661404] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:52:51.661715] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-10-21T21:52:52.472548] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-21T21:52:52.475742] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-10-21T21:52:52.905897] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-21T21:52:52.913082] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-10-21T21:52:53.254737] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-21T21:52:53.265502] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-10-21T21:52:53.343606] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-21T21:52:53.360325] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-10-21T21:52:53.361067] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T21:52:53.364880] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-10-21T21:52:53.846634] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-21T21:52:53.849698] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-10-21T21:52:54.381293] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-21T21:52:54.551025] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-10-21T21:52:54.589933] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-21T21:52:54.781683] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-21T21:52:55.033924] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-21T21:52:55.351118] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-10-21T21:52:56.151010] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-10-21T21:52:56.238831] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T21:52:56.846887] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-21T21:52:56.951067] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-10-21T21:52:57.751070] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-10-21T21:52:57.889910] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T21:52:58.551095] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-10-21T21:52:58.996032] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-21T21:52:59.191191] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-21T21:52:59.331265] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-21T21:52:59.351002] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-10-21T21:53:00.151032] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-10-21T21:53:00.951103] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-10-21T21:53:01.220500] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-21T21:53:01.751055] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-10-21T21:53:01.762882] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T21:53:01.969749] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-21T21:53:02.551041] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-10-21T21:53:02.923765] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-21T21:53:03.351065] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-10-21T21:53:04.151063] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-10-21T21:53:04.367140] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T21:53:04.865285] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T21:53:04.951009] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-10-21T21:53:05.192627] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T21:53:05.751079] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-10-21T21:53:06.422675] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-21T21:53:06.551058] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-10-21T21:53:06.599859] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-21T21:53:07.351077] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-10-21T21:53:07.905922] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-21T21:53:08.151063] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-10-21T21:53:08.951009] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-10-21T21:53:09.112902] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-21T21:53:09.113155] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T21:53:09.751027] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-10. [2025-10-21T21:53:10.525092] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T21:53:10.541060] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T21:53:10.543208] [INFO ] [REMOTE ] WF: Full fetch complete (16104 records). [2025-10-21T21:53:10.543358] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-10-21T21:53:10.556335] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-10-21T21:53:10.933999] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-10-21T21:53:10.934106] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-10-21T21:53:10.934710] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-10-21T21:53:10.934783] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-10-21T21:53:10.935632] [DEBUG] [LOCAL ] WF: Trimmed 16104 records to 10842 (keeping 200 days of data) [2025-10-21T21:53:11.008635] [DEBUG] [LOCAL ] WF: Primary data saved (10842 records). [2025-10-21T21:53:11.008856] [INFO ] [MAIN ] WF: Full history saved. [2025-10-21T21:53:11.008964] [INFO ] [MAIN ] Update Progress: 2281/2366 symbols completed. WF took 22.4s. Estimated remaining: 10m 55s. Rate: 7.8 symbols/min [2025-10-21T21:53:11.188352] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:53:11.247576] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-21T21:53:11.248340] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-10-21T21:53:11.357013] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-10-21T21:53:11.444414] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:53:11.444715] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-10-21T21:53:11.444776] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-10-21T21:53:11.445100] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-10-21T21:53:11.445160] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-10-21T21:53:11.851001] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:53:12.151009] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-10-21T21:53:12.184888] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T21:53:12.728118] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T21:53:12.951024] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-10-21T21:53:13.751023] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-10-21T21:53:13.958496] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T21:53:14.551045] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-10-21T21:53:15.031519] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-21T21:53:15.231163] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T21:53:15.351046] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-10-21T21:53:15.803478] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-21T21:53:16.151027] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-10. [2025-10-21T21:53:16.951057] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-10-21T21:53:17.157309] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T21:53:17.204459] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-21T21:53:17.209074] [INFO ] [REMOTE ] WEX: Full fetch complete (50421 records). [2025-10-21T21:53:17.209186] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-10-21T21:53:17.600479] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-10-21T21:53:17.600551] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-10-21T21:53:17.601763] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-10-21T21:53:17.601845] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-10-21T21:53:17.602868] [DEBUG] [LOCAL ] WEX: Trimmed 50421 records to 32548 (keeping 200 days of data) [2025-10-21T21:53:17.751235] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-10-21T21:53:17.795855] [DEBUG] [LOCAL ] WEX: Primary data saved (32548 records). [2025-10-21T21:53:17.795953] [INFO ] [MAIN ] WEX: Full history saved. [2025-10-21T21:53:17.796025] [INFO ] [MAIN ] Update Progress: 2282/2366 symbols completed. WEX took 29.2s. Estimated remaining: 10m 48s. Rate: 7.8 symbols/min [2025-10-21T21:53:17.963558] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:53:17.986749] [DEBUG] [LOCAL ] WFG: Loaded 24746 existing records from primary storage. [2025-10-21T21:53:17.986989] [INFO ] [MAIN ] WFG: Loaded 24746 existing records. [2025-10-21T21:53:18.187364] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:53:18.187613] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-10-21T21:53:18.187715] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-10-21T21:53:18.187932] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-10-21T21:53:18.187986] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-10-21T21:53:18.555446] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:53:18.555560] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-10-21T21:53:18.590903] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T21:53:19.351082] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-10-21T21:53:19.946551] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-21T21:53:20.151133] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-10-21T21:53:20.238816] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-21T21:53:20.485287] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-21T21:53:20.951024] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-10. [2025-10-21T21:53:21.751059] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-10. [2025-10-21T21:53:22.447061] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-21T21:53:22.484953] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-21T21:53:22.493750] [INFO ] [REMOTE ] WES: Full fetch complete (70640 records). [2025-10-21T21:53:22.493931] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-10-21T21:53:22.558400] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-10-21T21:53:22.773446] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-21T21:53:22.852633] [INFO ] [REMOTE ] WELL: Full fetch complete (75994 records). [2025-10-21T21:53:22.868414] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-10-21T21:53:23.026219] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-10-21T21:53:23.037766] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-10-21T21:53:23.059913] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-10-21T21:53:23.062742] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-10-21T21:53:23.124451] [DEBUG] [LOCAL ] WES: Trimmed 70640 records to 48732 (keeping 200 days of data) [2025-10-21T21:53:23.356604] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-10-21T21:53:23.602327] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-10-21T21:53:23.602766] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-10-21T21:53:23.612963] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-10-21T21:53:23.613054] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-10-21T21:53:23.645851] [DEBUG] [LOCAL ] WELL: Trimmed 75994 records to 52310 (keeping 200 days of data) [2025-10-21T21:53:23.815792] [DEBUG] [LOCAL ] WES: Primary data saved (48732 records). [2025-10-21T21:53:23.838679] [INFO ] [MAIN ] WES: Full history saved. [2025-10-21T21:53:23.839572] [INFO ] [MAIN ] Update Progress: 2283/2366 symbols completed. WES took 35.2s. Estimated remaining: 10m 40s. Rate: 7.8 symbols/min [2025-10-21T21:53:24.191611] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:53:24.239110] [DEBUG] [LOCAL ] WELL: Primary data saved (52310 records). [2025-10-21T21:53:24.239264] [INFO ] [MAIN ] WELL: Full history saved. [2025-10-21T21:53:24.240032] [INFO ] [MAIN ] Update Progress: 2284/2366 symbols completed. WELL took 35.6s. Estimated remaining: 10m 32s. Rate: 7.8 symbols/min [2025-10-21T21:53:24.454692] [DEBUG] [LOCAL ] WGO: Loaded 37980 existing records from primary storage. [2025-10-21T21:53:24.473922] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:53:24.474109] [INFO ] [MAIN ] WGO: Loaded 37980 existing records. [2025-10-21T21:53:24.661426] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:53:24.661853] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-10-21T21:53:24.662248] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-10-21T21:53:24.663285] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-10-21T21:53:24.663375] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-10-21T21:53:24.908229] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T21:53:24.947026] [DEBUG] [LOCAL ] WH: Loaded 45259 existing records from primary storage. [2025-10-21T21:53:24.939932] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-10-21T21:53:24.976405] [INFO ] [MAIN ] WH: Loaded 45259 existing records. [2025-10-21T21:53:25.196948] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-21T21:53:25.275354] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:53:25.291584] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-10-21T21:53:25.353978] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:53:25.354244] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-10-21T21:53:25.354295] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-10-21T21:53:25.354566] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-10-21T21:53:25.354623] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-10-21T21:53:25.713200] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:53:25.751058] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-10-21T21:53:26.255911] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-21T21:53:26.551030] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-10-21T21:53:26.956115] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T21:53:27.288998] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-21T21:53:27.350990] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-10-21T21:53:28.151060] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-10-21T21:53:28.406160] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-21T21:53:28.878809] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-21T21:53:28.950992] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-10-21T21:53:29.656784] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T21:53:29.751014] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-10-21T21:53:30.516359] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-21T21:53:30.551079] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-10-21T21:53:31.351118] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-10-21T21:53:32.036584] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-21T21:53:32.151035] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-10-21T21:53:32.221462] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T21:53:32.951081] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-10-21T21:53:33.042562] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-21T21:53:33.751114] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-10-21T21:53:34.140833] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-21T21:53:34.216161] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-21T21:53:34.551095] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-10-21T21:53:34.956513] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-21T21:53:35.351096] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-10-21T21:53:35.835236] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-21T21:53:36.151030] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-10-21T21:53:36.951049] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-10-21T21:53:37.172013] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-21T21:53:37.480157] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T21:53:37.751073] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-10. [2025-10-21T21:53:38.135261] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-21T21:53:38.143402] [INFO ] [REMOTE ] WFC: Full fetch complete (77926 records). [2025-10-21T21:53:38.143516] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-10-21T21:53:38.559243] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-10-21T21:53:38.563029] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-10-21T21:53:38.577511] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-10-21T21:53:38.585785] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-10-21T21:53:38.589502] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-10-21T21:53:38.591928] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T21:53:38.603036] [DEBUG] [LOCAL ] WFC: Trimmed 77926 records to 53748 (keeping 200 days of data) [2025-10-21T21:53:38.922567] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-10-21T21:53:38.922724] [INFO ] [MAIN ] WFC: Full history saved. [2025-10-21T21:53:38.923170] [INFO ] [MAIN ] Update Progress: 2285/2366 symbols completed. WFC took 27.9s. Estimated remaining: 10m 24s. Rate: 7.8 symbols/min [2025-10-21T21:53:39.088691] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:53:39.126946] [DEBUG] [LOCAL ] WHD: Loaded 40110 existing records from primary storage. [2025-10-21T21:53:39.127240] [INFO ] [MAIN ] WHD: Loaded 40110 existing records. [2025-10-21T21:53:39.305536] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:53:39.305781] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-10-21T21:53:39.305848] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-10-21T21:53:39.306050] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-10-21T21:53:39.306089] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-10-21T21:53:39.359012] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-10-21T21:53:39.657627] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:53:39.693381] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T21:53:40.151039] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-10-21T21:53:40.928763] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T21:53:40.950985] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-10-21T21:53:41.660447] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T21:53:41.751091] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-10-21T21:53:42.551041] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-10-21T21:53:42.661853] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-21T21:53:42.796237] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T21:53:43.351080] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-10-21T21:53:43.954134] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-21T21:53:44.151016] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-10-21T21:53:44.951058] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-10-21T21:53:45.179786] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-21T21:53:45.383363] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-21T21:53:45.751050] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-10-21T21:53:46.509995] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T21:53:46.550981] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-10-21T21:53:47.351027] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-10-21T21:53:47.420317] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-21T21:53:48.142343] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-21T21:53:48.151432] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-10-21T21:53:48.868051] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T21:53:48.950982] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-10-21T21:53:49.694362] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-21T21:53:49.750994] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-10-21T21:53:50.369103] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T21:53:50.550994] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-10-21T21:53:51.218861] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-21T21:53:51.351035] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-10-21T21:53:51.984798] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T21:53:52.151026] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-10. [2025-10-21T21:53:52.512746] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-21T21:53:52.951037] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-10. [2025-10-21T21:53:53.615173] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T21:53:53.622199] [INFO ] [REMOTE ] WH: Full fetch complete (65528 records). [2025-10-21T21:53:53.622334] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-10-21T21:53:53.761282] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-10. [2025-10-21T21:53:54.011709] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-10-21T21:53:54.011816] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-10-21T21:53:54.012946] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-10-21T21:53:54.013084] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-10-21T21:53:54.014342] [DEBUG] [LOCAL ] WH: Trimmed 65528 records to 45230 (keeping 200 days of data) [2025-10-21T21:53:54.116023] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-21T21:53:54.152013] [INFO ] [REMOTE ] WFG: Full fetch complete (36414 records). [2025-10-21T21:53:54.159709] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-10-21T21:53:54.555734] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-10-21T21:53:54.697113] [DEBUG] [LOCAL ] WH: Primary data saved (45230 records). [2025-10-21T21:53:54.697234] [INFO ] [MAIN ] WH: Full history saved. [2025-10-21T21:53:54.697341] [INFO ] [MAIN ] Update Progress: 2286/2366 symbols completed. WH took 30.5s. Estimated remaining: 10m 17s. Rate: 7.8 symbols/min [2025-10-21T21:53:54.697712] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-10-21T21:53:54.697799] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-10-21T21:53:54.732683] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-10-21T21:53:54.758813] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-10-21T21:53:54.808613] [DEBUG] [LOCAL ] WFG: Trimmed 36414 records to 24602 (keeping 200 days of data) [2025-10-21T21:53:54.986323] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:53:55.052183] [DEBUG] [LOCAL ] WHG: Loaded 3075 existing records from primary storage. [2025-10-21T21:53:55.058816] [DEBUG] [LOCAL ] WFG: Primary data saved (24602 records). [2025-10-21T21:53:55.059244] [INFO ] [MAIN ] WHG: Loaded 3075 existing records. [2025-10-21T21:53:55.059061] [INFO ] [MAIN ] WFG: Full history saved. [2025-10-21T21:53:55.101369] [INFO ] [MAIN ] Update Progress: 2287/2366 symbols completed. WFG took 37.3s. Estimated remaining: 10m 9s. Rate: 7.8 symbols/min [2025-10-21T21:53:55.347467] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:53:55.351442] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-10-21T21:53:55.351718] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-10-21T21:53:55.367698] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-10-21T21:53:55.381680] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-10-21T21:53:55.475140] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:53:55.510683] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-21T21:53:55.561965] [INFO ] [REMOTE ] WGO: Full fetch complete (56993 records). [2025-10-21T21:53:55.562239] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-10-21T21:53:56.077841] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:53:56.118759] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-10-21T21:53:56.099208] [DEBUG] [LOCAL ] WHR: Loaded 48938 existing records from primary storage. [2025-10-21T21:53:56.130740] [INFO ] [MAIN ] WHR: Loaded 48938 existing records. [2025-10-21T21:53:56.378118] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-10-21T21:53:56.383738] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-10-21T21:53:56.390205] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-10-21T21:53:56.390306] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-10-21T21:53:56.447606] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-21T21:53:56.490002] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-10-21T21:53:56.491677] [DEBUG] [LOCAL ] WGO: Trimmed 56993 records to 37930 (keeping 200 days of data) [2025-10-21T21:53:56.497052] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:53:56.498777] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-10-21T21:53:56.499002] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-10-21T21:53:56.499445] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-10-21T21:53:56.499506] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-10-21T21:53:56.672830] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T21:53:56.956374] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-10-21T21:53:57.117942] [DEBUG] [LOCAL ] WGO: Primary data saved (37930 records). [2025-10-21T21:53:57.133477] [INFO ] [MAIN ] WGO: Full history saved. [2025-10-21T21:53:57.134341] [INFO ] [MAIN ] Update Progress: 2288/2366 symbols completed. WGO took 33.2s. Estimated remaining: 10m 1s. Rate: 7.8 symbols/min [2025-10-21T21:53:57.139849] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:53:57.307146] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:53:57.315806] [DEBUG] [LOCAL ] WIA: Loaded 5002 existing records from primary storage. [2025-10-21T21:53:57.316024] [INFO ] [MAIN ] WIA: Loaded 5002 existing records. [2025-10-21T21:53:57.494477] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:53:57.494691] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-10-21T21:53:57.494748] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-10-21T21:53:57.494906] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-10-21T21:53:57.494961] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-10-21T21:53:57.599090] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-21T21:53:57.752553] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-10-21T21:53:57.869824] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:53:57.933873] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T21:53:58.162475] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-21T21:53:58.551075] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-10-21T21:53:59.124667] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-21T21:53:59.351048] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-10-21T21:53:59.947850] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-21T21:54:00.151059] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-10-21T21:54:00.951047] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-10-21T21:54:01.466790] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-21T21:54:01.636402] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-21T21:54:01.751055] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-10-21T21:54:02.551083] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-10-21T21:54:03.333406] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-21T21:54:03.350978] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-10. [2025-10-21T21:54:04.151070] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-10-21T21:54:04.179808] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-21T21:54:04.824136] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T21:54:04.825240] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-21T21:54:04.834471] [INFO ] [REMOTE ] WHD: Full fetch complete (57882 records). [2025-10-21T21:54:04.834637] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-10-21T21:54:04.956168] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-10-21T21:54:05.258679] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-10-21T21:54:05.258846] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-10-21T21:54:05.261035] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-10-21T21:54:05.261123] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-10-21T21:54:05.262965] [DEBUG] [LOCAL ] WHD: Trimmed 57882 records to 39984 (keeping 200 days of data) [2025-10-21T21:54:05.528015] [DEBUG] [LOCAL ] WHD: Primary data saved (39984 records). [2025-10-21T21:54:05.528228] [INFO ] [MAIN ] WHD: Full history saved. [2025-10-21T21:54:05.528866] [INFO ] [MAIN ] Update Progress: 2289/2366 symbols completed. WHD took 26.6s. Estimated remaining: 9m 53s. Rate: 7.8 symbols/min [2025-10-21T21:54:05.740600] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-21T21:54:05.753987] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-10-21T21:54:05.780029] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:54:05.794994] [DEBUG] [LOCAL ] WINN: Loaded 11461 existing records from primary storage. [2025-10-21T21:54:05.795322] [INFO ] [MAIN ] WINN: Loaded 11461 existing records. [2025-10-21T21:54:05.985244] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:54:05.985563] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-10-21T21:54:05.985617] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-10-21T21:54:05.985854] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-10-21T21:54:05.985907] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-10-21T21:54:06.364236] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:54:06.551039] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-10-21T21:54:07.113377] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-21T21:54:07.351050] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-10-21T21:54:07.517208] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-21T21:54:08.011130] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-21T21:54:08.151053] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-10-21T21:54:08.621431] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-21T21:54:08.951094] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-10-21T21:54:09.751099] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-10-21T21:54:10.257391] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-21T21:54:10.551058] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-10. [2025-10-21T21:54:10.802287] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T21:54:10.893919] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-21T21:54:10.894670] [INFO ] [REMOTE ] WHG: Full fetch complete (4398 records). [2025-10-21T21:54:10.894739] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-10-21T21:54:11.259177] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-10-21T21:54:11.259256] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-10-21T21:54:11.259410] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-10-21T21:54:11.259471] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-10-21T21:54:11.259861] [DEBUG] [LOCAL ] WHG: Trimmed 4398 records to 3061 (keeping 200 days of data) [2025-10-21T21:54:11.278268] [DEBUG] [LOCAL ] WHG: Primary data saved (3061 records). [2025-10-21T21:54:11.278367] [INFO ] [MAIN ] WHG: Full history saved. [2025-10-21T21:54:11.278442] [INFO ] [MAIN ] Update Progress: 2290/2366 symbols completed. WHG took 16.6s. Estimated remaining: 9m 46s. Rate: 7.8 symbols/min [2025-10-21T21:54:11.356217] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-10-21T21:54:11.458887] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:54:11.507115] [DEBUG] [LOCAL ] WIT: Loaded 52534 existing records from primary storage. [2025-10-21T21:54:11.507420] [INFO ] [MAIN ] WIT: Loaded 52534 existing records. [2025-10-21T21:54:11.683257] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:54:11.683467] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-10-21T21:54:11.683515] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-10-21T21:54:11.683775] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-10-21T21:54:11.683835] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-10-21T21:54:12.042154] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:54:12.048031] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-21T21:54:12.150996] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-10-21T21:54:12.951036] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-10-21T21:54:13.751015] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-10-21T21:54:13.866977] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-21T21:54:13.915535] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-21T21:54:14.551060] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-10-21T21:54:15.348255] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T21:54:15.351057] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-10-21T21:54:15.715282] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-21T21:54:16.151068] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-10-21T21:54:16.951107] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-10-21T21:54:16.988394] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-21T21:54:17.574081] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-21T21:54:17.756086] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-10-21T21:54:17.777507] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-21T21:54:18.337435] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-21T21:54:18.551128] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-10-21T21:54:19.351121] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-10-21T21:54:20.151088] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-10-21T21:54:20.304458] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T21:54:20.324801] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T21:54:20.518418] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-21T21:54:20.951070] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-10-21T21:54:21.751072] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-10-21T21:54:22.551069] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-10-21T21:54:22.692889] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T21:54:23.145221] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-21T21:54:23.351053] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-10-21T21:54:23.598540] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-21T21:54:23.978975] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-21T21:54:24.151075] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-10-21T21:54:24.951080] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-10-21T21:54:25.751056] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-10-21T21:54:25.796695] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-21T21:54:25.920850] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-21T21:54:26.551070] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-10-21T21:54:27.167594] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-21T21:54:27.351098] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-10-21T21:54:27.541597] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-21T21:54:27.964705] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-21T21:54:28.151055] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-10-21T21:54:28.931714] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-21T21:54:28.950999] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-10-21T21:54:29.741584] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-21T21:54:29.750975] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-10-21T21:54:30.497362] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-21T21:54:30.550999] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-10. [2025-10-21T21:54:31.332373] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-21T21:54:31.334592] [INFO ] [REMOTE ] WINN: Full fetch complete (17372 records). [2025-10-21T21:54:31.334698] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-10-21T21:54:31.356399] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-10. [2025-10-21T21:54:31.723270] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-10-21T21:54:31.723353] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-10-21T21:54:31.723745] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-10-21T21:54:31.723805] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-10-21T21:54:31.724332] [DEBUG] [LOCAL ] WINN: Trimmed 17372 records to 11361 (keeping 200 days of data) [2025-10-21T21:54:31.791604] [DEBUG] [LOCAL ] WINN: Primary data saved (11361 records). [2025-10-21T21:54:31.791765] [INFO ] [MAIN ] WINN: Full history saved. [2025-10-21T21:54:31.791851] [INFO ] [MAIN ] Update Progress: 2291/2366 symbols completed. WINN took 26.3s. Estimated remaining: 9m 38s. Rate: 7.8 symbols/min [2025-10-21T21:54:31.968709] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:54:31.988334] [DEBUG] [LOCAL ] WIW: Loaded 20283 existing records from primary storage. [2025-10-21T21:54:31.988597] [INFO ] [MAIN ] WIW: Loaded 20283 existing records. [2025-10-21T21:54:32.099601] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T21:54:32.116898] [INFO ] [REMOTE ] WIA: Full fetch complete (7202 records). [2025-10-21T21:54:32.127223] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-10-21T21:54:32.156284] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-10-21T21:54:32.204253] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:54:32.216155] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-10-21T21:54:32.249391] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-10-21T21:54:32.295268] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-10-21T21:54:32.306023] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-10-21T21:54:32.832930] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-10-21T21:54:32.858175] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-10-21T21:54:32.861257] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-10-21T21:54:32.861662] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-10-21T21:54:32.877852] [DEBUG] [LOCAL ] WIA: Trimmed 7202 records to 5024 (keeping 200 days of data) [2025-10-21T21:54:32.964741] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-10-21T21:54:32.964677] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:54:32.974487] [DEBUG] [LOCAL ] WIA: Primary data saved (5024 records). [2025-10-21T21:54:32.974572] [INFO ] [MAIN ] WIA: Full history saved. [2025-10-21T21:54:32.974667] [INFO ] [MAIN ] Update Progress: 2292/2366 symbols completed. WIA took 35.8s. Estimated remaining: 9m 30s. Rate: 7.8 symbols/min [2025-10-21T21:54:33.148401] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:54:33.183212] [DEBUG] [LOCAL ] WK: Loaded 37168 existing records from primary storage. [2025-10-21T21:54:33.183483] [INFO ] [MAIN ] WK: Loaded 37168 existing records. [2025-10-21T21:54:33.361906] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:54:33.362109] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-10-21T21:54:33.362155] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-10-21T21:54:33.362348] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-10-21T21:54:33.362403] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-10-21T21:54:33.716924] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:54:33.750983] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-10-21T21:54:33.959529] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-21T21:54:34.551016] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-10-21T21:54:34.737770] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T21:54:35.150087] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T21:54:35.351026] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-10-21T21:54:35.576595] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T21:54:36.151043] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-10. [2025-10-21T21:54:36.865240] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T21:54:36.951000] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-10-21T21:54:37.735703] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-21T21:54:37.743439] [INFO ] [REMOTE ] WHR: Full fetch complete (69627 records). [2025-10-21T21:54:37.743606] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-10-21T21:54:37.757102] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-10-21T21:54:38.136095] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-10-21T21:54:38.136240] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-10-21T21:54:38.137455] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-10-21T21:54:38.137519] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-10-21T21:54:38.138890] [DEBUG] [LOCAL ] WHR: Trimmed 69627 records to 48906 (keeping 200 days of data) [2025-10-21T21:54:38.439402] [DEBUG] [LOCAL ] WHR: Primary data saved (48906 records). [2025-10-21T21:54:38.439723] [INFO ] [MAIN ] WHR: Full history saved. [2025-10-21T21:54:38.439826] [INFO ] [MAIN ] Update Progress: 2293/2366 symbols completed. WHR took 43.3s. Estimated remaining: 9m 23s. Rate: 7.8 symbols/min [2025-10-21T21:54:38.493078] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T21:54:38.559663] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-10-21T21:54:38.642835] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:54:38.675983] [DEBUG] [LOCAL ] WKC: Loaded 34592 existing records from primary storage. [2025-10-21T21:54:38.676268] [INFO ] [MAIN ] WKC: Loaded 34592 existing records. [2025-10-21T21:54:38.850241] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:54:38.850448] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-10-21T21:54:38.850494] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-10-21T21:54:38.850754] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-10-21T21:54:38.850810] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-10-21T21:54:39.206200] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:54:39.351016] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-10-21T21:54:39.435717] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-21T21:54:40.156268] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-10-21T21:54:40.174071] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T21:54:40.750417] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T21:54:40.951033] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-10-21T21:54:41.751005] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-10-21T21:54:42.023342] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-21T21:54:42.437611] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-21T21:54:42.551020] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-10-21T21:54:42.641125] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-21T21:54:43.351007] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-10-21T21:54:43.895183] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-21T21:54:44.151035] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-10-21T21:54:44.731754] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-21T21:54:44.950988] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-10-21T21:54:45.591960] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-21T21:54:45.751073] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-10-21T21:54:46.485561] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-21T21:54:46.550977] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-10-21T21:54:47.307782] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-21T21:54:47.350980] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-10-21T21:54:47.966807] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-21T21:54:48.150980] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-10-21T21:54:48.783531] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-21T21:54:48.951018] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-10. [2025-10-21T21:54:49.519217] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T21:54:49.751011] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-10-21T21:54:50.374493] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-21T21:54:50.380528] [INFO ] [REMOTE ] WK: Full fetch complete (53545 records). [2025-10-21T21:54:50.380621] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-10-21T21:54:50.553542] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-10-21T21:54:50.685218] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-21T21:54:50.775306] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-10-21T21:54:50.775376] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-10-21T21:54:50.776391] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-10-21T21:54:50.776452] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-10-21T21:54:50.777445] [DEBUG] [LOCAL ] WK: Trimmed 53545 records to 37158 (keeping 200 days of data) [2025-10-21T21:54:50.994531] [DEBUG] [LOCAL ] WK: Primary data saved (37158 records). [2025-10-21T21:54:50.994706] [INFO ] [MAIN ] WK: Full history saved. [2025-10-21T21:54:50.995253] [INFO ] [MAIN ] Update Progress: 2294/2366 symbols completed. WK took 18.0s. Estimated remaining: 9m 15s. Rate: 7.8 symbols/min [2025-10-21T21:54:51.170899] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:54:51.212666] [DEBUG] [LOCAL ] WLK: Loaded 45903 existing records from primary storage. [2025-10-21T21:54:51.212951] [INFO ] [MAIN ] WLK: Loaded 45903 existing records. [2025-10-21T21:54:51.352907] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-10-21T21:54:51.387132] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:54:51.387328] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-10-21T21:54:51.387377] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-10-21T21:54:51.387560] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-10-21T21:54:51.387601] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-10-21T21:54:51.739400] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:54:52.151035] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-10-21T21:54:52.230303] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T21:54:52.778807] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T21:54:52.951097] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-10-21T21:54:53.587454] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-21T21:54:53.751041] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-10-21T21:54:54.048549] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T21:54:54.551025] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-10-21T21:54:55.288876] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T21:54:55.350980] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-10-21T21:54:56.027811] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T21:54:56.151012] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-10-21T21:54:56.419359] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-21T21:54:56.950996] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-10-21T21:54:57.751006] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-10-21T21:54:57.981702] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-21T21:54:58.430859] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-21T21:54:58.550991] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-10. [2025-10-21T21:54:59.351021] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-10-21T21:54:59.439265] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T21:54:59.741014] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-21T21:54:59.745897] [INFO ] [REMOTE ] WKC: Full fetch complete (50030 records). [2025-10-21T21:54:59.745989] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-10-21T21:55:00.133950] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-10-21T21:55:00.134044] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-10-21T21:55:00.135050] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-10-21T21:55:00.135109] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-10-21T21:55:00.136119] [DEBUG] [LOCAL ] WKC: Trimmed 50030 records to 34474 (keeping 200 days of data) [2025-10-21T21:55:00.189668] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-10. [2025-10-21T21:55:00.349082] [DEBUG] [LOCAL ] WKC: Primary data saved (34474 records). [2025-10-21T21:55:00.349210] [INFO ] [MAIN ] WKC: Full history saved. [2025-10-21T21:55:00.349287] [INFO ] [MAIN ] Update Progress: 2295/2366 symbols completed. WKC took 21.9s. Estimated remaining: 9m 7s. Rate: 7.8 symbols/min [2025-10-21T21:55:00.527767] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:00.534539] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-21T21:55:00.546441] [DEBUG] [LOCAL ] WLKP: Loaded 7204 existing records from primary storage. [2025-10-21T21:55:00.546667] [INFO ] [MAIN ] WLKP: Loaded 7204 existing records. [2025-10-21T21:55:00.719181] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:55:00.719423] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-10-21T21:55:00.719497] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-10-21T21:55:00.719759] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-10-21T21:55:00.719837] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-10-21T21:55:00.963018] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-10-21T21:55:01.082055] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:01.751054] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-10-21T21:55:01.974408] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-21T21:55:01.984762] [INFO ] [REMOTE ] WIT: Full fetch complete (76014 records). [2025-10-21T21:55:01.984950] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-10-21T21:55:02.401307] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-10-21T21:55:02.401520] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-10-21T21:55:02.403067] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-10-21T21:55:02.403245] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-10-21T21:55:02.405279] [DEBUG] [LOCAL ] WIT: Trimmed 76014 records to 52532 (keeping 200 days of data) [2025-10-21T21:55:02.511825] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-21T21:55:02.589916] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-10-21T21:55:02.697391] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T21:55:02.792067] [DEBUG] [LOCAL ] WIT: Primary data saved (52532 records). [2025-10-21T21:55:02.792215] [INFO ] [MAIN ] WIT: Full history saved. [2025-10-21T21:55:02.792300] [INFO ] [MAIN ] Update Progress: 2296/2366 symbols completed. WIT took 51.5s. Estimated remaining: 8m 60s. Rate: 7.8 symbols/min [2025-10-21T21:55:02.971217] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:02.971389] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-10-21T21:55:02.971427] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-10-21T21:55:02.971538] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-10-21T21:55:02.971581] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-21T21:55:02.971622] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-21T21:55:02.971687] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-10-21T21:55:03.339479] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:03.350991] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-10-21T21:55:03.716890] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-21T21:55:03.733827] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-21T21:55:04.151046] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-10-21T21:55:04.890509] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-21T21:55:04.951051] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-10-21T21:55:05.502856] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-21T21:55:05.751033] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-10-21T21:55:06.519839] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-21T21:55:06.550992] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-10-21T21:55:07.354913] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-10-21T21:55:07.356517] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-21T21:55:07.698985] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-21T21:55:08.151036] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-10-21T21:55:08.519337] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-21T21:55:08.951074] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-10-21T21:55:09.386097] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-21T21:55:09.751031] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-10-21T21:55:10.551080] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-10-21T21:55:10.805987] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-21T21:55:11.351004] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-10-21T21:55:11.362162] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-21T21:55:12.151009] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-10-21T21:55:12.507735] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T21:55:12.951030] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-10-21T21:55:13.751016] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-10-21T21:55:13.914799] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-21T21:55:14.021385] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T21:55:14.157743] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-21T21:55:14.551045] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-10-21T21:55:15.282669] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-21T21:55:15.351012] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-10. [2025-10-21T21:55:16.151033] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-10-21T21:55:16.266603] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-21T21:55:16.269940] [INFO ] [REMOTE ] WIW: Full fetch complete (29254 records). [2025-10-21T21:55:16.270022] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-10-21T21:55:16.647792] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-10-21T21:55:16.647864] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-10-21T21:55:16.648456] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-10-21T21:55:16.648495] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-10-21T21:55:16.649307] [DEBUG] [LOCAL ] WIW: Trimmed 29254 records to 20275 (keeping 200 days of data) [2025-10-21T21:55:16.769909] [DEBUG] [LOCAL ] WIW: Primary data saved (20275 records). [2025-10-21T21:55:16.770057] [INFO ] [MAIN ] WIW: Full history saved. [2025-10-21T21:55:16.770144] [INFO ] [MAIN ] Update Progress: 2297/2366 symbols completed. WIW took 45.0s. Estimated remaining: 8m 52s. Rate: 7.8 symbols/min [2025-10-21T21:55:16.942470] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:16.951029] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-10-21T21:55:16.976425] [DEBUG] [LOCAL ] WLY: Loaded 29783 existing records from primary storage. [2025-10-21T21:55:16.976804] [INFO ] [MAIN ] WLY: Loaded 29783 existing records. [2025-10-21T21:55:17.163393] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:55:17.163688] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-10-21T21:55:17.163750] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-10-21T21:55:17.163998] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-10-21T21:55:17.164055] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-10-21T21:55:17.417850] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-21T21:55:17.526880] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:17.751038] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-10-21T21:55:17.921676] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-21T21:55:18.127174] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-21T21:55:18.551095] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-10-21T21:55:19.351049] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-10-21T21:55:19.788183] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-21T21:55:19.810454] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T21:55:20.151116] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-10-21T21:55:20.925557] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T21:55:20.951055] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-10. [2025-10-21T21:55:21.631952] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-21T21:55:21.633768] [INFO ] [REMOTE ] WLKP: Full fetch complete (10046 records). [2025-10-21T21:55:21.633833] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-10-21T21:55:21.756211] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-10-21T21:55:21.991803] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-10-21T21:55:21.991874] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-10-21T21:55:21.992101] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-10-21T21:55:21.992142] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-10-21T21:55:21.992545] [DEBUG] [LOCAL ] WLKP: Trimmed 10046 records to 7223 (keeping 200 days of data) [2025-10-21T21:55:22.034842] [DEBUG] [LOCAL ] WLKP: Primary data saved (7223 records). [2025-10-21T21:55:22.034932] [INFO ] [MAIN ] WLKP: Full history saved. [2025-10-21T21:55:22.035005] [INFO ] [MAIN ] Update Progress: 2298/2366 symbols completed. WLKP took 21.7s. Estimated remaining: 8m 44s. Rate: 7.8 symbols/min [2025-10-21T21:55:22.204966] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:22.253398] [DEBUG] [LOCAL ] WM: Loaded 50913 existing records from primary storage. [2025-10-21T21:55:22.253707] [INFO ] [MAIN ] WM: Loaded 50913 existing records. [2025-10-21T21:55:22.324411] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-21T21:55:22.438992] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:55:22.439192] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-10-21T21:55:22.439240] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-10-21T21:55:22.439475] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-10-21T21:55:22.439531] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-10-21T21:55:22.556166] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-10-21T21:55:22.800415] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:22.997749] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-21T21:55:23.351021] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-10-21T21:55:24.151047] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-10. [2025-10-21T21:55:24.549083] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-21T21:55:24.550101] [INFO ] [REMOTE ] WLTG: Full fetch complete (1664 records). [2025-10-21T21:55:24.550177] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-10-21T21:55:24.745511] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T21:55:24.745752] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:55:24.745807] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:55:24.745852] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-10-21T21:55:24.745969] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-10-21T21:55:24.746047] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-10-21T21:55:24.746140] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-10-21T21:55:24.746251] [INFO ] [MAIN ] Update Progress: 2299/2366 symbols completed. WLTG took 22.0s. Estimated remaining: 8m 36s. Rate: 7.8 symbols/min [2025-10-21T21:55:24.929868] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:24.957179] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-10-21T21:55:24.981112] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-21T21:55:24.981482] [INFO ] [MAIN ] WMB: Loaded 53672 existing records. [2025-10-21T21:55:25.159018] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:55:25.159235] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-10-21T21:55:25.159296] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-10-21T21:55:25.159711] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-10-21T21:55:25.159768] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-10-21T21:55:25.517738] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:25.545245] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-21T21:55:25.751030] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-10-21T21:55:26.413476] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T21:55:26.551005] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-10-21T21:55:27.269989] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:55:27.351021] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-10-21T21:55:27.874689] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-21T21:55:28.151026] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-10-21T21:55:28.951099] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-10-21T21:55:29.043581] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-21T21:55:29.207471] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-21T21:55:29.751024] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-10-21T21:55:30.551022] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-10-21T21:55:30.759951] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-21T21:55:30.792524] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-21T21:55:31.351052] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-10-21T21:55:32.150997] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-10-21T21:55:32.316812] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-21T21:55:32.527635] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-21T21:55:32.951033] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-10-21T21:55:33.751021] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-10-21T21:55:34.034724] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-21T21:55:34.551031] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-10-21T21:55:34.780127] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T21:55:35.351076] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-10-21T21:55:35.393262] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-21T21:55:35.900758] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-21T21:55:36.151054] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-10-21T21:55:36.951074] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-10-21T21:55:37.289320] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-21T21:55:37.549785] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T21:55:37.751029] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-10-21T21:55:38.551073] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-10. [2025-10-21T21:55:38.945990] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-21T21:55:39.037699] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T21:55:39.351037] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-10-21T21:55:40.053370] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-21T21:55:40.060732] [INFO ] [REMOTE ] WLK: Full fetch complete (64005 records). [2025-10-21T21:55:40.060846] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-10-21T21:55:40.157724] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-10-21T21:55:40.450681] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-10-21T21:55:40.450780] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-10-21T21:55:40.451906] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-10-21T21:55:40.451970] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-10-21T21:55:40.453266] [DEBUG] [LOCAL ] WLK: Trimmed 64005 records to 45878 (keeping 200 days of data) [2025-10-21T21:55:40.731501] [DEBUG] [LOCAL ] WLK: Primary data saved (45878 records). [2025-10-21T21:55:40.731635] [INFO ] [MAIN ] WLK: Full history saved. [2025-10-21T21:55:40.732533] [INFO ] [MAIN ] Update Progress: 2300/2366 symbols completed. WLK took 49.7s. Estimated remaining: 8m 29s. Rate: 7.8 symbols/min [2025-10-21T21:55:40.899717] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:40.916956] [DEBUG] [LOCAL ] WMK: Loaded 14754 existing records from primary storage. [2025-10-21T21:55:40.917185] [INFO ] [MAIN ] WMK: Loaded 14754 existing records. [2025-10-21T21:55:40.970558] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-10-21T21:55:41.095979] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:55:41.096310] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-10-21T21:55:41.096380] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-10-21T21:55:41.096584] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-10-21T21:55:41.096724] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-10-21T21:55:41.415546] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-21T21:55:41.604277] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:41.751012] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-10-21T21:55:41.975559] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-21T21:55:42.188147] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-21T21:55:42.551083] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-10-21T21:55:43.351034] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-10-21T21:55:43.406873] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T21:55:43.407149] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T21:55:44.151019] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-10-21T21:55:44.951000] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-10-21T21:55:44.970003] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-21T21:55:45.231481] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T21:55:45.751030] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-10-21T21:55:46.185855] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-21T21:55:46.551026] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-10. [2025-10-21T21:55:47.351031] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-10-21T21:55:47.800217] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-21T21:55:47.805198] [INFO ] [REMOTE ] WLY: Full fetch complete (42911 records). [2025-10-21T21:55:47.805292] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-10-21T21:55:48.151494] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-10-21T21:55:48.219802] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-10-21T21:55:48.219987] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-10-21T21:55:48.220887] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-10-21T21:55:48.221051] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-10-21T21:55:48.254729] [DEBUG] [LOCAL ] WLY: Trimmed 42911 records to 29776 (keeping 200 days of data) [2025-10-21T21:55:48.256702] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-21T21:55:48.453749] [DEBUG] [LOCAL ] WLY: Primary data saved (29776 records). [2025-10-21T21:55:48.453882] [INFO ] [MAIN ] WLY: Full history saved. [2025-10-21T21:55:48.454504] [INFO ] [MAIN ] Update Progress: 2301/2366 symbols completed. WLY took 31.7s. Estimated remaining: 8m 21s. Rate: 7.8 symbols/min [2025-10-21T21:55:48.635099] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:48.676862] [DEBUG] [LOCAL ] WMS: Loaded 39655 existing records from primary storage. [2025-10-21T21:55:48.677183] [INFO ] [MAIN ] WMS: Loaded 39655 existing records. [2025-10-21T21:55:48.863603] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:55:48.863818] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-10-21T21:55:48.863892] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-10-21T21:55:48.864142] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-10-21T21:55:48.864199] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-10-21T21:55:48.961006] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-10-21T21:55:49.243922] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:49.257828] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-21T21:55:49.304447] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-21T21:55:49.751021] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-10-21T21:55:50.551012] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-10-21T21:55:50.862764] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-21T21:55:51.008121] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-21T21:55:51.351003] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-10-21T21:55:52.151047] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-10-21T21:55:52.455783] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-21T21:55:52.951054] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-10. [2025-10-21T21:55:53.381787] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-21T21:55:53.478963] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-21T21:55:53.652022] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T21:55:53.661582] [INFO ] [REMOTE ] WMB: Full fetch complete (77851 records). [2025-10-21T21:55:53.661795] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-10-21T21:55:53.756160] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-10. [2025-10-21T21:55:54.065300] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-10-21T21:55:54.065416] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-10-21T21:55:54.066705] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-10-21T21:55:54.066780] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-10-21T21:55:54.068802] [DEBUG] [LOCAL ] WMB: Trimmed 77851 records to 53672 (keeping 200 days of data) [2025-10-21T21:55:54.307926] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-21T21:55:54.329417] [INFO ] [REMOTE ] WM: Full fetch complete (73829 records). [2025-10-21T21:55:54.330773] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-10-21T21:55:54.560715] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-10-21T21:55:54.807682] [DEBUG] [LOCAL ] WMB: Primary data saved (53672 records). [2025-10-21T21:55:54.810870] [INFO ] [MAIN ] WMB: Full history saved. [2025-10-21T21:55:54.810984] [INFO ] [MAIN ] Update Progress: 2302/2366 symbols completed. WMB took 30.1s. Estimated remaining: 8m 14s. Rate: 7.8 symbols/min [2025-10-21T21:55:54.940626] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-10-21T21:55:54.951689] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-10-21T21:55:54.953056] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-10-21T21:55:54.953137] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-10-21T21:55:55.006398] [DEBUG] [LOCAL ] WM: Trimmed 73829 records to 50876 (keeping 200 days of data) [2025-10-21T21:55:55.025131] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:55.312411] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-21T21:55:55.312870] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-10-21T21:55:55.381561] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-10-21T21:55:55.494238] [DEBUG] [LOCAL ] WM: Primary data saved (50876 records). [2025-10-21T21:55:55.497894] [INFO ] [MAIN ] WM: Full history saved. [2025-10-21T21:55:55.498788] [INFO ] [MAIN ] Update Progress: 2303/2366 symbols completed. WM took 33.5s. Estimated remaining: 8m 6s. Rate: 7.8 symbols/min [2025-10-21T21:55:55.654704] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:55:55.681987] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-10-21T21:55:55.682242] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-10-21T21:55:55.698977] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-10-21T21:55:55.699077] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-10-21T21:55:55.716266] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-21T21:55:55.870083] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:55:56.157056] [DEBUG] [LOCAL ] WNC: Loaded 38400 existing records from primary storage. [2025-10-21T21:55:56.163981] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:56.164442] [INFO ] [MAIN ] WNC: Loaded 38400 existing records. [2025-10-21T21:55:56.155967] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-10-21T21:55:56.344706] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:55:56.344898] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-10-21T21:55:56.344946] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-10-21T21:55:56.345189] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-10-21T21:55:56.345246] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-10-21T21:55:56.722254] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:55:56.944219] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T21:55:56.951839] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-10-21T21:55:57.286532] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-21T21:55:57.751073] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-10-21T21:55:58.484353] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-21T21:55:58.551052] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-10-21T21:55:59.351043] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-10-21T21:56:00.151012] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-10-21T21:56:00.227980] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-21T21:56:00.262174] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T21:56:00.905816] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-21T21:56:00.950988] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-10-21T21:56:01.285496] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-21T21:56:01.751094] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-10-21T21:56:02.556113] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-10-21T21:56:02.566352] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-21T21:56:03.351036] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-10-21T21:56:03.415015] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T21:56:04.151049] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-10-21T21:56:04.203258] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-21T21:56:04.951037] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-10-21T21:56:05.074616] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-10-21T21:56:05.534931] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-21T21:56:05.656181] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-21T21:56:05.750992] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-10-21T21:56:06.550985] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-10-21T21:56:06.823937] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-21T21:56:07.351025] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-10. [2025-10-21T21:56:08.061131] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-21T21:56:08.150974] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-10-21T21:56:08.240539] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-21T21:56:08.244197] [INFO ] [REMOTE ] WMK: Full fetch complete (20047 records). [2025-10-21T21:56:08.244287] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-10-21T21:56:08.612500] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-10-21T21:56:08.612572] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-10-21T21:56:08.613015] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-10-21T21:56:08.613074] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-10-21T21:56:08.613606] [DEBUG] [LOCAL ] WMK: Trimmed 20047 records to 14738 (keeping 200 days of data) [2025-10-21T21:56:08.700220] [DEBUG] [LOCAL ] WMK: Primary data saved (14738 records). [2025-10-21T21:56:08.700346] [INFO ] [MAIN ] WMK: Full history saved. [2025-10-21T21:56:08.700423] [INFO ] [MAIN ] Update Progress: 2304/2366 symbols completed. WMK took 28.0s. Estimated remaining: 7m 58s. Rate: 7.8 symbols/min [2025-10-21T21:56:08.866866] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:56:08.919522] [DEBUG] [LOCAL ] WOLF: Loaded 53128 existing records from primary storage. [2025-10-21T21:56:08.919909] [INFO ] [MAIN ] WOLF: Loaded 53128 existing records. [2025-10-21T21:56:08.956233] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-10-21T21:56:09.098512] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:56:09.098717] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-10-21T21:56:09.098772] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-10-21T21:56:09.098952] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-10-21T21:56:09.098992] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-10-21T21:56:09.480617] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:56:09.580894] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-21T21:56:09.751061] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-10-21T21:56:10.551079] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-10-21T21:56:11.260802] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T21:56:11.350988] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-10-21T21:56:11.483705] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-21T21:56:11.536013] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-21T21:56:12.151006] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-10-21T21:56:12.951004] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-10-21T21:56:12.990532] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-21T21:56:13.751118] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-10-21T21:56:13.796089] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-21T21:56:14.551058] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-10-21T21:56:15.351094] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-10-21T21:56:15.406957] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-21T21:56:15.546208] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-21T21:56:16.006193] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T21:56:16.151028] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-10-21T21:56:16.951016] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-10-21T21:56:17.406904] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-21T21:56:17.573393] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-21T21:56:17.751028] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-10-21T21:56:18.550991] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-10. [2025-10-21T21:56:19.269967] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-21T21:56:19.350983] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-10-21T21:56:19.458410] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-21T21:56:19.818161] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-21T21:56:19.823912] [INFO ] [REMOTE ] WNC: Full fetch complete (57804 records). [2025-10-21T21:56:19.824018] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-10-21T21:56:20.159674] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-10. [2025-10-21T21:56:20.215622] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-10-21T21:56:20.215732] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-10-21T21:56:20.216803] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-10-21T21:56:20.216864] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-10-21T21:56:20.218132] [DEBUG] [LOCAL ] WNC: Trimmed 57804 records to 38268 (keeping 200 days of data) [2025-10-21T21:56:20.451350] [DEBUG] [LOCAL ] WNC: Primary data saved (38268 records). [2025-10-21T21:56:20.451513] [INFO ] [MAIN ] WNC: Full history saved. [2025-10-21T21:56:20.451600] [INFO ] [MAIN ] Update Progress: 2305/2366 symbols completed. WNC took 25.0s. Estimated remaining: 7m 50s. Rate: 7.8 symbols/min [2025-10-21T21:56:20.621095] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:56:20.644049] [DEBUG] [LOCAL ] WOR: Loaded 23740 existing records from primary storage. [2025-10-21T21:56:20.644313] [INFO ] [MAIN ] WOR: Loaded 23740 existing records. [2025-10-21T21:56:20.826055] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:56:20.826312] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-10-21T21:56:20.826361] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-10-21T21:56:20.826520] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-10-21T21:56:20.826558] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-10-21T21:56:20.956118] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-10-21T21:56:21.189990] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:56:21.681092] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T21:56:21.687348] [INFO ] [REMOTE ] WMS: Full fetch complete (57113 records). [2025-10-21T21:56:21.687473] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-10-21T21:56:21.756112] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-10-21T21:56:22.122209] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-10-21T21:56:22.122466] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-10-21T21:56:22.123993] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-10-21T21:56:22.125668] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-10-21T21:56:22.125760] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-10-21T21:56:22.137822] [DEBUG] [LOCAL ] WMS: Trimmed 57113 records to 39604 (keeping 200 days of data) [2025-10-21T21:56:22.393777] [DEBUG] [LOCAL ] WMS: Primary data saved (39604 records). [2025-10-21T21:56:22.393921] [INFO ] [MAIN ] WMS: Full history saved. [2025-10-21T21:56:22.394692] [INFO ] [MAIN ] Update Progress: 2306/2366 symbols completed. WMS took 33.9s. Estimated remaining: 7m 43s. Rate: 7.8 symbols/min [2025-10-21T21:56:22.551768] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-10-21T21:56:22.573948] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:56:22.606412] [DEBUG] [LOCAL ] WOW: Loaded 31259 existing records from primary storage. [2025-10-21T21:56:22.606687] [INFO ] [MAIN ] WOW: Loaded 31259 existing records. [2025-10-21T21:56:22.793707] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:56:22.793917] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-10-21T21:56:22.793979] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-10-21T21:56:22.794209] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-10-21T21:56:22.794276] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-10-21T21:56:23.152548] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T21:56:23.186474] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:56:23.349774] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-21T21:56:23.360092] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-10-21T21:56:24.150995] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-10-21T21:56:24.176322] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-21T21:56:24.731009] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-21T21:56:24.951026] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-10-21T21:56:25.370924] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T21:56:25.751038] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-10-21T21:56:26.551027] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-10-21T21:56:27.138811] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T21:56:27.351004] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-10-21T21:56:27.450055] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-21T21:56:28.151025] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-10-21T21:56:28.373040] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-21T21:56:28.701774] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-21T21:56:28.951010] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-10-21T21:56:29.176405] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T21:56:29.751042] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-10-21T21:56:30.551036] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-10-21T21:56:30.948373] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T21:56:31.351021] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-10-21T21:56:31.535219] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-10-21T21:56:31.755865] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-21T21:56:32.151040] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-10-21T21:56:32.447230] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-21T21:56:32.951030] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-10-21T21:56:33.508231] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-21T21:56:33.755023] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-10-21T21:56:33.758974] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-21T21:56:34.551020] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-10-21T21:56:35.351017] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-10-21T21:56:35.659210] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-21T21:56:35.940796] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-21T21:56:36.151043] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-10-21T21:56:36.951069] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-10. [2025-10-21T21:56:37.231174] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-21T21:56:37.653116] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T21:56:37.661612] [INFO ] [REMOTE ] WMT: Full fetch complete (77980 records). [2025-10-21T21:56:37.661793] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-10-21T21:56:37.780265] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-10-21T21:56:37.872973] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-10-21T21:56:38.099955] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-10-21T21:56:38.100034] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-10-21T21:56:38.101251] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-10-21T21:56:38.101314] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-10-21T21:56:38.102736] [DEBUG] [LOCAL ] WMT: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-21T21:56:38.430612] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-10-21T21:56:38.430817] [INFO ] [MAIN ] WMT: Full history saved. [2025-10-21T21:56:38.430903] [INFO ] [MAIN ] Update Progress: 2307/2366 symbols completed. WMT took 43.6s. Estimated remaining: 7m 35s. Rate: 7.8 symbols/min [2025-10-21T21:56:38.556210] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-10-21T21:56:38.604029] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:56:38.648477] [DEBUG] [LOCAL ] WPC: Loaded 48228 existing records from primary storage. [2025-10-21T21:56:38.648799] [INFO ] [MAIN ] WPC: Loaded 48228 existing records. [2025-10-21T21:56:38.827092] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:56:38.827344] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-10-21T21:56:38.827461] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-10-21T21:56:38.827727] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-10-21T21:56:38.827783] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-10-21T21:56:38.960423] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-21T21:56:39.196302] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:56:39.351026] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-10-21T21:56:39.895737] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T21:56:40.151050] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-10-21T21:56:40.548881] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-21T21:56:40.951027] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-10. [2025-10-21T21:56:41.733821] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T21:56:41.750985] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-10-21T21:56:42.117686] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-21T21:56:42.121584] [INFO ] [REMOTE ] WOR: Full fetch complete (36299 records). [2025-10-21T21:56:42.121747] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-10-21T21:56:42.484258] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-10-21T21:56:42.484333] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-10-21T21:56:42.485000] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-10-21T21:56:42.485060] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-10-21T21:56:42.485811] [DEBUG] [LOCAL ] WOR: Trimmed 36299 records to 23644 (keeping 200 days of data) [2025-10-21T21:56:42.575363] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-10-21T21:56:42.630863] [DEBUG] [LOCAL ] WOR: Primary data saved (23644 records). [2025-10-21T21:56:42.630996] [INFO ] [MAIN ] WOR: Full history saved. [2025-10-21T21:56:42.631090] [INFO ] [MAIN ] Update Progress: 2308/2366 symbols completed. WOR took 22.2s. Estimated remaining: 7m 27s. Rate: 7.8 symbols/min [2025-10-21T21:56:42.796516] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:56:42.845358] [DEBUG] [LOCAL ] WPM: Loaded 52786 existing records from primary storage. [2025-10-21T21:56:42.845683] [INFO ] [MAIN ] WPM: Loaded 52786 existing records. [2025-10-21T21:56:43.019001] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:56:43.019191] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-10-21T21:56:43.019268] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-10-21T21:56:43.019474] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-10-21T21:56:43.019512] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-10-21T21:56:43.351352] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-10-21T21:56:43.383669] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-21T21:56:43.423545] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:56:44.151063] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-10-21T21:56:44.951006] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-10. [2025-10-21T21:56:45.140009] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T21:56:45.303986] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-21T21:56:45.750987] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-10-21T21:56:46.028891] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T21:56:46.084792] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T21:56:46.093059] [INFO ] [REMOTE ] WOW: Full fetch complete (42910 records). [2025-10-21T21:56:46.093251] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-10-21T21:56:46.489622] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-10-21T21:56:46.489751] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-10-21T21:56:46.490671] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-10-21T21:56:46.490733] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-10-21T21:56:46.491793] [DEBUG] [LOCAL ] WOW: Trimmed 42910 records to 31132 (keeping 200 days of data) [2025-10-21T21:56:46.568580] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-10-21T21:56:46.660372] [DEBUG] [LOCAL ] WOW: Primary data saved (31132 records). [2025-10-21T21:56:46.660502] [INFO ] [MAIN ] WOW: Full history saved. [2025-10-21T21:56:46.661055] [INFO ] [MAIN ] Update Progress: 2309/2366 symbols completed. WOW took 24.3s. Estimated remaining: 7m 19s. Rate: 7.8 symbols/min [2025-10-21T21:56:46.832317] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:56:46.866193] [DEBUG] [LOCAL ] WPP: Loaded 34370 existing records from primary storage. [2025-10-21T21:56:46.866453] [INFO ] [MAIN ] WPP: Loaded 34370 existing records. [2025-10-21T21:56:47.043138] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:56:47.043404] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-10-21T21:56:47.043560] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-10-21T21:56:47.043848] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-10-21T21:56:47.043916] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-10-21T21:56:47.364563] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-10-21T21:56:47.428429] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:56:47.431335] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-21T21:56:48.151015] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-10-21T21:56:48.817378] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-21T21:56:48.950992] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-10-21T21:56:49.111521] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T21:56:49.540416] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-21T21:56:49.750977] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-10-21T21:56:50.551062] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-10-21T21:56:51.124600] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-21T21:56:51.351069] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-10-21T21:56:51.404919] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-21T21:56:52.151029] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-10-21T21:56:52.337771] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:56:52.385404] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-21T21:56:52.951020] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-10-21T21:56:53.751016] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-10. [2025-10-21T21:56:54.000203] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-21T21:56:54.428909] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-21T21:56:54.551068] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-10-21T21:56:55.351048] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-10-21T21:56:56.006379] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-21T21:56:56.088307] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-10 (2.34 seconds). [2025-10-21T21:56:56.096492] [INFO ] [REMOTE ] WOLF: Full fetch complete (77256 records). [2025-10-21T21:56:56.096628] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-10-21T21:56:56.162125] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-10-21T21:56:56.487319] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-10-21T21:56:56.487396] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-10-21T21:56:56.488623] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-10-21T21:56:56.488732] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-10-21T21:56:56.490131] [DEBUG] [LOCAL ] WOLF: Trimmed 77256 records to 53084 (keeping 200 days of data) [2025-10-21T21:56:56.792129] [DEBUG] [LOCAL ] WOLF: Primary data saved (53084 records). [2025-10-21T21:56:56.792263] [INFO ] [MAIN ] WOLF: Full history saved. [2025-10-21T21:56:56.792822] [INFO ] [MAIN ] Update Progress: 2310/2366 symbols completed. WOLF took 48.1s. Estimated remaining: 7m 12s. Rate: 7.8 symbols/min [2025-10-21T21:56:56.956971] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-10-21T21:56:56.976565] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:56:57.026005] [DEBUG] [LOCAL ] WRB: Loaded 50781 existing records from primary storage. [2025-10-21T21:56:57.026321] [INFO ] [MAIN ] WRB: Loaded 50781 existing records. [2025-10-21T21:56:57.207977] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:56:57.208266] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-10-21T21:56:57.208344] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-10-21T21:56:57.208720] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-10-21T21:56:57.208791] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-10-21T21:56:57.602097] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-21T21:56:57.607917] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:56:57.637430] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-21T21:56:57.751007] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-10-21T21:56:58.342958] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-21T21:56:58.551053] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-10-21T21:56:59.154391] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T21:56:59.351015] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-10-21T21:57:00.151053] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-10-21T21:57:00.217918] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T21:57:00.742520] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-21T21:57:00.951055] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-10-21T21:57:01.751020] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-10-21T21:57:02.159362] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-21T21:57:02.551017] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-10-21T21:57:02.744474] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T21:57:03.351030] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-10-21T21:57:03.424387] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T21:57:04.151012] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-10-21T21:57:04.392200] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-21T21:57:04.956240] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-10-21T21:57:04.974244] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-21T21:57:05.632596] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T21:57:05.751035] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-10-21T21:57:06.551063] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-10-21T21:57:06.692563] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-21T21:57:07.351005] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-10-21T21:57:07.454929] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T21:57:08.014017] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-21T21:57:08.151044] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-10. [2025-10-21T21:57:08.951028] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-10-21T21:57:09.162371] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-21T21:57:09.674882] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-21T21:57:09.681118] [INFO ] [REMOTE ] WPP: Full fetch complete (47640 records). [2025-10-21T21:57:09.681213] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-10-21T21:57:09.756114] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-10. [2025-10-21T21:57:10.055446] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-10-21T21:57:10.055520] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-10-21T21:57:10.056417] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-10-21T21:57:10.056477] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-10-21T21:57:10.057484] [DEBUG] [LOCAL ] WPP: Trimmed 47640 records to 34389 (keeping 200 days of data) [2025-10-21T21:57:10.263945] [DEBUG] [LOCAL ] WPP: Primary data saved (34389 records). [2025-10-21T21:57:10.264132] [INFO ] [MAIN ] WPP: Full history saved. [2025-10-21T21:57:10.264445] [INFO ] [MAIN ] Update Progress: 2311/2366 symbols completed. WPP took 23.6s. Estimated remaining: 7m 4s. Rate: 7.8 symbols/min [2025-10-21T21:57:10.437433] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:57:10.488493] [DEBUG] [LOCAL ] WRBY: Loaded 50728 existing records from primary storage. [2025-10-21T21:57:10.489017] [INFO ] [MAIN ] WRBY: Loaded 50728 existing records. [2025-10-21T21:57:10.553455] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-10-21T21:57:10.672771] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:57:10.673113] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-10-21T21:57:10.673331] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-10-21T21:57:10.683869] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-10-21T21:57:10.702146] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-10-21T21:57:10.784477] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T21:57:11.065703] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:57:11.350993] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-10-21T21:57:11.429518] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T21:57:11.436778] [INFO ] [REMOTE ] WPC: Full fetch complete (70511 records). [2025-10-21T21:57:11.436884] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-10-21T21:57:11.850377] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-10-21T21:57:11.850458] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-10-21T21:57:11.851605] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-10-21T21:57:11.851691] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-10-21T21:57:11.852994] [DEBUG] [LOCAL ] WPC: Trimmed 70511 records to 48169 (keeping 200 days of data) [2025-10-21T21:57:12.144749] [DEBUG] [LOCAL ] WPC: Primary data saved (48169 records). [2025-10-21T21:57:12.144908] [INFO ] [MAIN ] WPC: Full history saved. [2025-10-21T21:57:12.144996] [INFO ] [MAIN ] Update Progress: 2312/2366 symbols completed. WPC took 33.7s. Estimated remaining: 6m 56s. Rate: 7.8 symbols/min [2025-10-21T21:57:12.156519] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-10-21T21:57:12.318986] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:57:12.346182] [DEBUG] [LOCAL ] WS: Loaded 23540 existing records from primary storage. [2025-10-21T21:57:12.347135] [INFO ] [MAIN ] WS: Loaded 23540 existing records. [2025-10-21T21:57:12.529352] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:57:12.529809] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-10-21T21:57:12.529922] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-10-21T21:57:12.530575] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-10-21T21:57:12.530684] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-10-21T21:57:12.705518] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-21T21:57:12.941174] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:57:12.951030] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-10-21T21:57:13.041940] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T21:57:13.751082] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-10-21T21:57:13.990153] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T21:57:14.550997] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-10-21T21:57:14.949132] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-21T21:57:15.299062] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T21:57:15.351011] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-10-21T21:57:16.151026] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-10-21T21:57:16.256709] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-21T21:57:16.951069] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-10-21T21:57:17.080764] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-21T21:57:17.347129] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-21T21:57:17.751041] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-10-21T21:57:18.552884] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T21:57:18.551282] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-10-21T21:57:18.871407] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T21:57:19.351056] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-10-21T21:57:20.151030] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-10-21T21:57:20.287737] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T21:57:20.652123] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T21:57:20.951015] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-10-21T21:57:21.751100] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-10-21T21:57:22.058743] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T21:57:22.194189] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-21T21:57:22.551016] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-10. [2025-10-21T21:57:23.351041] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-10-21T21:57:23.500181] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-21T21:57:24.151093] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-10-21T21:57:24.480457] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-21T21:57:24.489214] [INFO ] [REMOTE ] WPM: Full fetch complete (76377 records). [2025-10-21T21:57:24.489380] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-10-21T21:57:24.931634] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-10-21T21:57:24.932036] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-10-21T21:57:24.933430] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-10-21T21:57:24.933696] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-10-21T21:57:24.935387] [DEBUG] [LOCAL ] WPM: Trimmed 76377 records to 52787 (keeping 200 days of data) [2025-10-21T21:57:24.989775] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-10-21T21:57:25.046479] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-21T21:57:25.205419] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-21T21:57:25.324683] [DEBUG] [LOCAL ] WPM: Primary data saved (52787 records). [2025-10-21T21:57:25.324825] [INFO ] [MAIN ] WPM: Full history saved. [2025-10-21T21:57:25.325416] [INFO ] [MAIN ] Update Progress: 2313/2366 symbols completed. WPM took 42.7s. Estimated remaining: 6m 49s. Rate: 7.8 symbols/min [2025-10-21T21:57:25.497089] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:57:25.551476] [DEBUG] [LOCAL ] WSM: Loaded 48892 existing records from primary storage. [2025-10-21T21:57:25.551805] [INFO ] [MAIN ] WSM: Loaded 48892 existing records. [2025-10-21T21:57:25.729758] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:57:25.729964] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-10-21T21:57:25.730010] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-10-21T21:57:25.730213] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-10-21T21:57:25.730268] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-10-21T21:57:25.761233] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-10-21T21:57:26.082381] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:57:26.550987] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-10-21T21:57:26.739964] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-21T21:57:27.220402] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-21T21:57:27.351054] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-10-21T21:57:28.024241] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T21:57:28.151053] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-10-21T21:57:28.503085] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T21:57:28.951037] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-10-21T21:57:29.751036] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-10-21T21:57:29.800035] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-21T21:57:29.993627] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-21T21:57:30.178084] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-21T21:57:30.551024] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-10. [2025-10-21T21:57:31.255730] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-21T21:57:31.264259] [INFO ] [REMOTE ] WRB: Full fetch complete (73828 records). [2025-10-21T21:57:31.264425] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-10-21T21:57:31.356239] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-10-21T21:57:31.706665] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-10-21T21:57:31.706775] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-10-21T21:57:31.708052] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-10-21T21:57:31.708114] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-10-21T21:57:31.709491] [DEBUG] [LOCAL ] WRB: Trimmed 73828 records to 50782 (keeping 200 days of data) [2025-10-21T21:57:32.018152] [DEBUG] [LOCAL ] WRB: Primary data saved (50782 records). [2025-10-21T21:57:32.018286] [INFO ] [MAIN ] WRB: Full history saved. [2025-10-21T21:57:32.018842] [INFO ] [MAIN ] Update Progress: 2314/2366 symbols completed. WRB took 35.2s. Estimated remaining: 6m 41s. Rate: 7.8 symbols/min [2025-10-21T21:57:32.161135] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-10-21T21:57:32.185597] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:57:32.214951] [DEBUG] [LOCAL ] WSO: Loaded 25899 existing records from primary storage. [2025-10-21T21:57:32.215230] [INFO ] [MAIN ] WSO: Loaded 25899 existing records. [2025-10-21T21:57:32.387420] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:57:32.387620] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-10-21T21:57:32.387715] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-10-21T21:57:32.387900] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-10-21T21:57:32.387938] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-10-21T21:57:32.737492] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:57:32.951049] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-10-21T21:57:33.044043] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-21T21:57:33.751041] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-10-21T21:57:33.993402] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-21T21:57:34.162820] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-21T21:57:34.551035] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-10-21T21:57:35.247284] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T21:57:35.351008] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-10-21T21:57:35.410438] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-21T21:57:36.151059] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-10-21T21:57:36.951025] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-10-21T21:57:37.050982] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T21:57:37.275017] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-21T21:57:37.751081] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-10. [2025-10-21T21:57:38.551037] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-10-21T21:57:38.784970] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-21T21:57:39.351061] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-10-21T21:57:39.426988] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-21T21:57:39.435179] [INFO ] [REMOTE ] WRBY: Full fetch complete (73683 records). [2025-10-21T21:57:39.435339] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-10-21T21:57:39.839877] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-10-21T21:57:39.840043] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-10-21T21:57:39.841248] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-10-21T21:57:39.841328] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-10-21T21:57:39.855482] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-21T21:57:39.861257] [DEBUG] [LOCAL ] WRBY: Trimmed 73683 records to 50694 (keeping 200 days of data) [2025-10-21T21:57:40.152572] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-10-21T21:57:40.152688] [DEBUG] [LOCAL ] WRBY: Primary data saved (50694 records). [2025-10-21T21:57:40.152838] [INFO ] [MAIN ] WRBY: Full history saved. [2025-10-21T21:57:40.153405] [INFO ] [MAIN ] Update Progress: 2315/2366 symbols completed. WRBY took 29.9s. Estimated remaining: 6m 33s. Rate: 7.8 symbols/min [2025-10-21T21:57:40.327360] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:57:40.351271] [DEBUG] [LOCAL ] WSR: Loaded 22806 existing records from primary storage. [2025-10-21T21:57:40.351517] [INFO ] [MAIN ] WSR: Loaded 22806 existing records. [2025-10-21T21:57:40.537141] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:57:40.537342] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-10-21T21:57:40.537389] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-10-21T21:57:40.537581] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-10-21T21:57:40.537637] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-10-21T21:57:40.915697] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:57:40.950995] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-10-21T21:57:41.142277] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-21T21:57:41.454169] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-21T21:57:41.751028] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-10. [2025-10-21T21:57:41.985501] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-21T21:57:42.551095] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-10-21T21:57:42.986669] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T21:57:42.990610] [INFO ] [REMOTE ] WS: Full fetch complete (35593 records). [2025-10-21T21:57:42.990732] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-10-21T21:57:43.355776] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-10-21T21:57:43.370100] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-10-21T21:57:43.370191] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-10-21T21:57:43.370925] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-10-21T21:57:43.371089] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-10-21T21:57:43.372013] [DEBUG] [LOCAL ] WS: Trimmed 35593 records to 23498 (keeping 200 days of data) [2025-10-21T21:57:43.512867] [DEBUG] [LOCAL ] WS: Primary data saved (23498 records). [2025-10-21T21:57:43.513064] [INFO ] [MAIN ] WS: Full history saved. [2025-10-21T21:57:43.513162] [INFO ] [MAIN ] Update Progress: 2316/2366 symbols completed. WS took 31.4s. Estimated remaining: 6m 26s. Rate: 7.8 symbols/min [2025-10-21T21:57:43.682933] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:57:43.697551] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-21T21:57:43.734726] [DEBUG] [LOCAL ] WST: Loaded 36673 existing records from primary storage. [2025-10-21T21:57:43.735033] [INFO ] [MAIN ] WST: Loaded 36673 existing records. [2025-10-21T21:57:43.913793] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:57:43.914024] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-10-21T21:57:43.914093] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-10-21T21:57:43.914300] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-10-21T21:57:43.914339] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-10-21T21:57:44.156227] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-10-21T21:57:44.268474] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:57:44.951044] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-10-21T21:57:45.209233] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T21:57:45.274006] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-21T21:57:45.751087] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-10-21T21:57:46.016854] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-21T21:57:46.551037] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-10-21T21:57:47.350999] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-10-21T21:57:47.561398] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-21T21:57:47.607863] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T21:57:48.150989] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-10-21T21:57:48.562526] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-21T21:57:48.951024] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-10-21T21:57:49.380499] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-21T21:57:49.751097] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-10-21T21:57:50.108308] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-21T21:57:50.550996] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-10-21T21:57:50.946142] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T21:57:51.351060] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-10-21T21:57:51.957915] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-21T21:57:52.151009] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-10-21T21:57:52.754158] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-21T21:57:52.956229] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-10-21T21:57:52.966376] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-21T21:57:53.751036] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-10. [2025-10-21T21:57:54.551091] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-10-21T21:57:54.614486] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-21T21:57:54.947876] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-21T21:57:54.953077] [INFO ] [REMOTE ] WSO: Full fetch complete (35776 records). [2025-10-21T21:57:54.953215] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-10-21T21:57:55.335627] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-10-21T21:57:55.335749] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-10-21T21:57:55.336694] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-10-21T21:57:55.336778] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-10-21T21:57:55.337569] [DEBUG] [LOCAL ] WSO: Trimmed 35776 records to 25862 (keeping 200 days of data) [2025-10-21T21:57:55.392942] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-10-21T21:57:55.509729] [DEBUG] [LOCAL ] WSO: Primary data saved (25862 records). [2025-10-21T21:57:55.509873] [INFO ] [MAIN ] WSO: Full history saved. [2025-10-21T21:57:55.509963] [INFO ] [MAIN ] Update Progress: 2317/2366 symbols completed. WSO took 23.5s. Estimated remaining: 6m 18s. Rate: 7.8 symbols/min [2025-10-21T21:57:55.653073] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-21T21:57:56.151057] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-10-21T21:57:56.951104] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-10-21T21:57:57.086261] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-21T21:57:57.237062] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T21:57:57.751092] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-10-21T21:57:58.551127] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-10-21T21:57:58.729719] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T21:57:59.351081] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-10-21T21:57:59.602723] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-21T21:57:59.629746] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-21T21:57:59.727278] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-21T21:58:00.151074] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-10. [2025-10-21T21:58:00.951047] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-10. [2025-10-21T21:58:01.219550] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-21T21:58:01.223502] [INFO ] [REMOTE ] WSR: Full fetch complete (32699 records). [2025-10-21T21:58:01.223601] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-10-21T21:58:01.633461] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-10-21T21:58:01.633561] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-10-21T21:58:01.634324] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-10-21T21:58:01.634451] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-10-21T21:58:01.635326] [DEBUG] [LOCAL ] WSR: Trimmed 32699 records to 22702 (keeping 200 days of data) [2025-10-21T21:58:01.741563] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-21T21:58:01.752623] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-10-21T21:58:01.756253] [INFO ] [REMOTE ] WSM: Full fetch complete (71392 records). [2025-10-21T21:58:01.756725] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-10-21T21:58:02.132148] [DEBUG] [LOCAL ] WSR: Primary data saved (22702 records). [2025-10-21T21:58:02.132331] [INFO ] [MAIN ] WSR: Full history saved. [2025-10-21T21:58:02.132487] [INFO ] [MAIN ] Update Progress: 2318/2366 symbols completed. WSR took 22.0s. Estimated remaining: 6m 10s. Rate: 7.8 symbols/min [2025-10-21T21:58:02.225335] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-10-21T21:58:02.225428] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-10-21T21:58:02.226639] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-10-21T21:58:02.226721] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-10-21T21:58:02.228349] [DEBUG] [LOCAL ] WSM: Trimmed 71392 records to 48798 (keeping 200 days of data) [2025-10-21T21:58:02.527500] [DEBUG] [LOCAL ] WSM: Primary data saved (48798 records). [2025-10-21T21:58:02.527624] [INFO ] [MAIN ] WSM: Full history saved. [2025-10-21T21:58:02.528309] [INFO ] [MAIN ] Update Progress: 2319/2366 symbols completed. WSM took 37.2s. Estimated remaining: 6m 2s. Rate: 7.8 symbols/min [2025-10-21T21:58:03.248283] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-21T21:58:03.256738] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-10-21T21:58:04.824169] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-21T21:58:04.832085] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-10-21T21:58:06.345524] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T21:58:06.354198] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-10-21T21:58:07.731042] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-21T21:58:07.739018] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-10-21T21:58:08.372222] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-21T21:58:08.379803] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-10. [2025-10-21T21:58:08.980628] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-21T21:58:08.987390] [INFO ] [REMOTE ] WST: Full fetch complete (54406 records). [2025-10-21T21:58:08.987581] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-10-21T21:58:09.377678] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-10-21T21:58:09.377816] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-10-21T21:58:09.378890] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-10-21T21:58:09.378952] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-10-21T21:58:09.380075] [DEBUG] [LOCAL ] WST: Trimmed 54406 records to 36665 (keeping 200 days of data) [2025-10-21T21:58:09.604819] [DEBUG] [LOCAL ] WST: Primary data saved (36665 records). [2025-10-21T21:58:09.604959] [INFO ] [MAIN ] WST: Full history saved. [2025-10-21T21:58:09.605037] [INFO ] [MAIN ] Update Progress: 2320/2366 symbols completed. WST took 26.1s. Estimated remaining: 5m 55s. Rate: 7.8 symbols/min [2025-10-21T21:58:10.327606] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:58:10.335293] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:58:10.372264] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:58:10.388405] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-10-21T21:58:10.390537] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-10-21T21:58:10.390313] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:58:10.391127] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-10-21T21:58:10.391185] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-21T21:58:10.391295] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-21T21:58:10.391350] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-10-21T21:58:10.753050] [DEBUG] [LOCAL ] WTI: Loaded 44707 existing records from primary storage. [2025-10-21T21:58:10.757504] [DEBUG] [LOCAL ] WT: Loaded 48165 existing records from primary storage. [2025-10-21T21:58:10.758985] [INFO ] [MAIN ] WT: Loaded 48165 existing records. [2025-10-21T21:58:10.758298] [INFO ] [MAIN ] WTI: Loaded 44707 existing records. [2025-10-21T21:58:11.037636] [DEBUG] [LOCAL ] WTRG: Loaded 50966 existing records from primary storage. [2025-10-21T21:58:11.087308] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:58:11.106615] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-10-21T21:58:11.100128] [INFO ] [MAIN ] WTRG: Loaded 50966 existing records. [2025-10-21T21:58:11.372257] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:58:11.334386] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:58:11.383334] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-10-21T21:58:11.397771] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-10-21T21:58:11.383239] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-10-21T21:58:11.410120] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-10-21T21:58:11.406036] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-10-21T21:58:11.410422] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-10-21T21:58:11.415892] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-10-21T21:58:11.445635] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-10-21T21:58:11.650434] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:58:11.710533] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-21T21:58:11.710918] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-10-21T21:58:11.738404] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-10-21T21:58:11.769945] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-10-21T21:58:11.810278] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-10-21T21:58:11.810871] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-10-21T21:58:12.371023] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:58:12.408329] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-10-21T21:58:12.424032] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-21T21:58:12.452977] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-10-21T21:58:12.494082] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:58:12.512486] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-10-21T21:58:12.670061] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:58:12.670370] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-10-21T21:58:13.063631] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-21T21:58:13.065087] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-10-21T21:58:13.477757] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-21T21:58:13.478843] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-10-21T21:58:13.925836] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:58:13.939883] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-10-21T21:58:13.943484] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-21T21:58:13.944381] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-10-21T21:58:14.206167] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-21T21:58:14.374348] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-21T21:58:14.425698] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-21T21:58:14.551031] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-10-21T21:58:15.107229] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-21T21:58:15.351021] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-10-21T21:58:15.921434] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-21T21:58:16.151004] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-10-21T21:58:16.532041] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-21T21:58:16.951089] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-10-21T21:58:17.751087] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-10-21T21:58:18.550995] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-10-21T21:58:18.732961] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-21T21:58:19.039498] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-10-21T21:58:19.074632] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-21T21:58:19.343729] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-21T21:58:19.353360] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-10-21T21:58:20.151125] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-10-21T21:58:20.951007] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-10-21T21:58:21.064958] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-21T21:58:21.626610] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-21T21:58:21.654866] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-21T21:58:21.751026] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-10. [2025-10-21T21:58:22.182618] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-21T21:58:22.183916] [INFO ] [REMOTE ] WTM: Full fetch complete (2759 records). [2025-10-21T21:58:22.183982] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-10-21T21:58:22.377395] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-21T21:58:22.377575] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-10-21T21:58:22.377710] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-10-21T21:58:22.377785] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-10-21T21:58:22.377848] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-10-21T21:58:22.377884] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-10-21T21:58:22.377923] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-10-21T21:58:22.377982] [INFO ] [MAIN ] Update Progress: 2321/2366 symbols completed. WTM took 12.8s. Estimated remaining: 5m 47s. Rate: 7.8 symbols/min [2025-10-21T21:58:22.553595] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:58:22.553678] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-10-21T21:58:22.571909] [DEBUG] [LOCAL ] WTS: Loaded 17355 existing records from primary storage. [2025-10-21T21:58:22.572155] [INFO ] [MAIN ] WTS: Loaded 17355 existing records. [2025-10-21T21:58:22.748420] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:58:22.748705] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-10-21T21:58:22.748761] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-10-21T21:58:22.748957] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-10-21T21:58:22.749021] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-10-21T21:58:23.100998] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:58:23.350998] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-10-21T21:58:24.151074] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-10-21T21:58:24.279192] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T21:58:24.348043] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-21T21:58:24.951035] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-10-21T21:58:25.751129] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-10-21T21:58:25.832330] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-21T21:58:26.551041] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-10-21T21:58:26.672491] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T21:58:26.735010] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T21:58:27.351032] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-10-21T21:58:28.151034] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-10-21T21:58:28.340270] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-21T21:58:28.452849] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T21:58:28.951073] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-10-21T21:58:29.347201] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-21T21:58:29.751029] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-10-21T21:58:30.281012] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-21T21:58:30.551021] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-10-21T21:58:31.283312] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-21T21:58:31.356803] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-10-21T21:58:31.369946] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-21T21:58:32.151017] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-10-21T21:58:32.359614] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T21:58:32.951088] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-10-21T21:58:33.563914] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-21T21:58:33.751024] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-10-21T21:58:34.551001] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-10-21T21:58:34.652755] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-21T21:58:34.717136] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-21T21:58:35.351020] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-10-21T21:58:36.150999] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-10-21T21:58:36.267303] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-21T21:58:36.394855] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-21T21:58:36.951091] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-10-21T21:58:37.675838] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-21T21:58:37.750998] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-10. [2025-10-21T21:58:38.042682] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-21T21:58:38.551032] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-10-21T21:58:39.114535] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-21T21:58:39.121911] [INFO ] [REMOTE ] WTI: Full fetch complete (63938 records). [2025-10-21T21:58:39.122021] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-10-21T21:58:39.356156] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-10-21T21:58:39.505584] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-10-21T21:58:39.505691] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-10-21T21:58:39.506821] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-10-21T21:58:39.506880] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-10-21T21:58:39.508047] [DEBUG] [LOCAL ] WTI: Trimmed 63938 records to 44703 (keeping 200 days of data) [2025-10-21T21:58:39.758890] [DEBUG] [LOCAL ] WTI: Primary data saved (44703 records). [2025-10-21T21:58:39.759008] [INFO ] [MAIN ] WTI: Full history saved. [2025-10-21T21:58:39.759082] [INFO ] [MAIN ] Update Progress: 2322/2366 symbols completed. WTI took 30.1s. Estimated remaining: 5m 39s. Rate: 7.8 symbols/min [2025-10-21T21:58:39.928509] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:58:39.967914] [DEBUG] [LOCAL ] WTTR: Loaded 44633 existing records from primary storage. [2025-10-21T21:58:39.968202] [INFO ] [MAIN ] WTTR: Loaded 44633 existing records. [2025-10-21T21:58:40.155310] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:58:40.151815] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-10-21T21:58:40.156300] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-10-21T21:58:40.156475] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-10-21T21:58:40.156800] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-10-21T21:58:40.157048] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-10-21T21:58:40.348744] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-21T21:58:40.558739] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:58:40.811579] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T21:58:40.951007] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-10-21T21:58:41.065745] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-21T21:58:41.751076] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-10. [2025-10-21T21:58:42.551434] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-10-21T21:58:42.551601] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-21T21:58:42.565705] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-21T21:58:42.569871] [INFO ] [REMOTE ] WTS: Full fetch complete (25642 records). [2025-10-21T21:58:42.569952] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-10-21T21:58:42.929005] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-10-21T21:58:42.929107] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-10-21T21:58:42.929603] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-10-21T21:58:42.929666] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-10-21T21:58:42.930273] [DEBUG] [LOCAL ] WTS: Trimmed 25642 records to 17270 (keeping 200 days of data) [2025-10-21T21:58:43.039121] [DEBUG] [LOCAL ] WTS: Primary data saved (17270 records). [2025-10-21T21:58:43.039266] [INFO ] [MAIN ] WTS: Full history saved. [2025-10-21T21:58:43.039345] [INFO ] [MAIN ] Update Progress: 2323/2366 symbols completed. WTS took 20.7s. Estimated remaining: 5m 32s. Rate: 7.8 symbols/min [2025-10-21T21:58:43.206879] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:58:43.255890] [DEBUG] [LOCAL ] WU: Loaded 53492 existing records from primary storage. [2025-10-21T21:58:43.256215] [INFO ] [MAIN ] WU: Loaded 53492 existing records. [2025-10-21T21:58:43.356989] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-10. [2025-10-21T21:58:43.437535] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:58:43.437780] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-10-21T21:58:43.437829] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-10-21T21:58:43.438015] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-10-21T21:58:43.438054] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-10-21T21:58:43.786047] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:58:44.073694] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-21T21:58:44.151027] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-10-21T21:58:44.950991] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-10-21T21:58:45.046399] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-21T21:58:45.054876] [INFO ] [REMOTE ] WT: Full fetch complete (69805 records). [2025-10-21T21:58:45.055052] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-10-21T21:58:45.460683] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-10-21T21:58:45.460867] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-10-21T21:58:45.462111] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-10-21T21:58:45.462174] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-10-21T21:58:45.463455] [DEBUG] [LOCAL ] WT: Trimmed 69805 records to 48173 (keeping 200 days of data) [2025-10-21T21:58:45.780082] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-21T21:58:45.769353] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-10-21T21:58:45.796266] [DEBUG] [LOCAL ] WT: Primary data saved (48173 records). [2025-10-21T21:58:45.796469] [INFO ] [MAIN ] WT: Full history saved. [2025-10-21T21:58:45.797844] [INFO ] [MAIN ] Update Progress: 2324/2366 symbols completed. WT took 36.2s. Estimated remaining: 5m 24s. Rate: 7.8 symbols/min [2025-10-21T21:58:45.967842] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:58:46.014821] [DEBUG] [LOCAL ] WWW: Loaded 49279 existing records from primary storage. [2025-10-21T21:58:46.015134] [INFO ] [MAIN ] WWW: Loaded 49279 existing records. [2025-10-21T21:58:46.189127] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:58:46.189333] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-10-21T21:58:46.189380] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-10-21T21:58:46.189567] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-10-21T21:58:46.189604] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-10-21T21:58:46.551580] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-10-21T21:58:46.551372] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:58:46.592830] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T21:58:47.351064] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-10-21T21:58:47.677147] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-21T21:58:48.151022] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-10-21T21:58:48.250169] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-21T21:58:48.876054] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-21T21:58:48.951049] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-10-21T21:58:49.651399] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-21T21:58:49.751002] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-10-21T21:58:50.553395] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-10-21T21:58:50.559721] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-21T21:58:50.974443] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-21T21:58:51.351081] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-10-21T21:58:52.151098] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-10-21T21:58:52.306252] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-21T21:58:52.591500] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-21T21:58:52.951075] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-10-21T21:58:53.751067] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-10-21T21:58:53.792194] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-21T21:58:54.550996] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-10-21T21:58:54.868176] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T21:58:55.351053] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-10-21T21:58:55.467408] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T21:58:56.151050] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-10-21T21:58:56.315196] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-21T21:58:56.950989] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-10-21T21:58:57.022175] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-21T21:58:57.751443] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-10-21T21:58:57.757434] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-21T21:58:58.550987] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-10. [2025-10-21T21:58:58.662156] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-21T21:58:59.351069] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-10-21T21:58:59.564007] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-21T21:59:00.151002] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-10-21T21:59:00.219238] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-21T21:59:00.227208] [INFO ] [REMOTE ] WTRG: Full fetch complete (73880 records). [2025-10-21T21:59:00.227337] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-10-21T21:59:00.616238] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-10-21T21:59:00.616543] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-10-21T21:59:00.618377] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-10-21T21:59:00.618444] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-10-21T21:59:00.619854] [DEBUG] [LOCAL ] WTRG: Trimmed 73880 records to 50964 (keeping 200 days of data) [2025-10-21T21:59:00.941880] [DEBUG] [LOCAL ] WTRG: Primary data saved (50964 records). [2025-10-21T21:59:00.942054] [INFO ] [MAIN ] WTRG: Full history saved. [2025-10-21T21:59:00.942185] [INFO ] [MAIN ] Update Progress: 2325/2366 symbols completed. WTRG took 51.3s. Estimated remaining: 5m 16s. Rate: 7.8 symbols/min [2025-10-21T21:59:00.966733] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-10-21T21:59:01.117575] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:01.145018] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-21T21:59:01.199116] [DEBUG] [LOCAL ] WY: Loaded 53216 existing records from primary storage. [2025-10-21T21:59:01.199449] [INFO ] [MAIN ] WY: Loaded 53216 existing records. [2025-10-21T21:59:01.370488] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:59:01.370763] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-10-21T21:59:01.370815] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-10-21T21:59:01.371235] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-10-21T21:59:01.371293] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-10-21T21:59:01.754553] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-10-21T21:59:01.788481] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:02.081544] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-21T21:59:02.551060] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-10-21T21:59:02.596061] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T21:59:03.351012] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-10-21T21:59:03.430222] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T21:59:04.151001] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-10-21T21:59:04.661807] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-21T21:59:04.951089] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-10-21T21:59:05.009463] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-21T21:59:05.751014] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-10-21T21:59:05.934230] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-21T21:59:06.551064] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-10-21T21:59:06.813272] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-21T21:59:07.351028] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-10-21T21:59:07.450150] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-21T21:59:08.150995] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-10-21T21:59:08.429791] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-21T21:59:08.951045] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-10-21T21:59:09.093490] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T21:59:09.751099] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-10. [2025-10-21T21:59:10.078415] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-21T21:59:10.551045] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-10. [2025-10-21T21:59:10.655680] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-21T21:59:11.351051] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-10. [2025-10-21T21:59:11.614268] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-21T21:59:11.625197] [INFO ] [REMOTE ] WU: Full fetch complete (77515 records). [2025-10-21T21:59:11.625384] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-10-21T21:59:12.074102] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-10-21T21:59:12.074271] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-10-21T21:59:12.075732] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-10-21T21:59:12.075835] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-10-21T21:59:12.095322] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-21T21:59:12.103018] [INFO ] [REMOTE ] WTTR: Full fetch complete (65532 records). [2025-10-21T21:59:12.103147] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-10-21T21:59:12.103385] [DEBUG] [LOCAL ] WU: Trimmed 77515 records to 53494 (keeping 200 days of data) [2025-10-21T21:59:12.225867] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-10-21T21:59:12.841618] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-10-21T21:59:12.841864] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-10-21T21:59:12.841772] [DEBUG] [LOCAL ] WU: Primary data saved (53494 records). [2025-10-21T21:59:12.843241] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-10-21T21:59:12.842036] [INFO ] [MAIN ] WU: Full history saved. [2025-10-21T21:59:12.843400] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-10-21T21:59:12.844308] [INFO ] [MAIN ] Update Progress: 2326/2366 symbols completed. WU took 29.8s. Estimated remaining: 5m 9s. Rate: 7.8 symbols/min [2025-10-21T21:59:12.921137] [DEBUG] [LOCAL ] WTTR: Trimmed 65532 records to 44583 (keeping 200 days of data) [2025-10-21T21:59:13.104009] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:13.144282] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-21T21:59:13.155827] [INFO ] [REMOTE ] WWW: Full fetch complete (70639 records). [2025-10-21T21:59:13.156363] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-10-21T21:59:13.334194] [DEBUG] [LOCAL ] XFLT: Loaded 29989 existing records from primary storage. [2025-10-21T21:59:13.381378] [INFO ] [MAIN ] XFLT: Loaded 29989 existing records. [2025-10-21T21:59:13.782593] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:59:13.798670] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-10-21T21:59:13.805499] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-10-21T21:59:13.868880] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-10-21T21:59:13.876078] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-10-21T21:59:13.957437] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-10-21T21:59:13.965533] [DEBUG] [LOCAL ] WTTR: Primary data saved (44583 records). [2025-10-21T21:59:13.963598] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-10-21T21:59:13.965761] [INFO ] [MAIN ] WTTR: Full history saved. [2025-10-21T21:59:13.973744] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-10-21T21:59:13.974509] [INFO ] [MAIN ] Update Progress: 2327/2366 symbols completed. WTTR took 34.2s. Estimated remaining: 5m 1s. Rate: 7.8 symbols/min [2025-10-21T21:59:14.035756] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-10-21T21:59:14.242059] [DEBUG] [LOCAL ] WWW: Trimmed 70639 records to 49270 (keeping 200 days of data) [2025-10-21T21:59:14.506927] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:14.699520] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:14.704758] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-10-21T21:59:14.739492] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-21T21:59:14.764945] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-10-21T21:59:14.820770] [DEBUG] [LOCAL ] XHR: Loaded 43474 existing records from primary storage. [2025-10-21T21:59:14.834787] [INFO ] [MAIN ] XHR: Loaded 43474 existing records. [2025-10-21T21:59:14.890712] [DEBUG] [LOCAL ] WWW: Primary data saved (49270 records). [2025-10-21T21:59:14.916710] [INFO ] [MAIN ] WWW: Full history saved. [2025-10-21T21:59:14.923162] [INFO ] [MAIN ] Update Progress: 2328/2366 symbols completed. WWW took 29.1s. Estimated remaining: 4m 53s. Rate: 7.8 symbols/min [2025-10-21T21:59:15.150345] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:59:15.169056] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-10-21T21:59:15.182839] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-10-21T21:59:15.200324] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:15.200508] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-10-21T21:59:15.200599] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-10-21T21:59:15.200553] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-10-21T21:59:15.200887] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-10-21T21:59:15.201017] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-10-21T21:59:15.232300] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-21T21:59:15.264142] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-21T21:59:15.275605] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-10-21T21:59:15.833739] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:15.834085] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-10-21T21:59:15.910093] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:15.910350] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-10-21T21:59:16.134000] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-21T21:59:16.134177] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-10-21T21:59:16.134271] [FATAL] [REMOTE ] XIFR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T21:59:16.134318] [FATAL] [MAIN ] XIFR: Failed to fetch primary data. [2025-10-21T21:59:16.134349] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T21:59:16.134420] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-10-21T21:59:16.134477] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-10-21T21:59:16.134511] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-10-21T21:59:16.134549] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-10-21T21:59:16.134592] [INFO ] [MAIN ] Update Progress: 2329/2366 symbols completed. XIFR took 1.2s. Estimated remaining: 4m 45s. Rate: 7.8 symbols/min [2025-10-21T21:59:16.300905] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T21:59:16.332178] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:16.332884] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-10-21T21:59:16.386743] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-21T21:59:16.387041] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-10-21T21:59:16.566105] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:59:16.566350] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-10-21T21:59:16.566446] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-10-21T21:59:16.566745] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-10-21T21:59:16.566808] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-10-21T21:59:16.949518] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-21T21:59:16.953845] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:16.964387] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-10-21T21:59:17.104378] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-21T21:59:17.287051] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T21:59:17.751052] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-10-21T21:59:18.551084] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-10-21T21:59:19.140048] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-21T21:59:19.351041] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-10-21T21:59:19.433353] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-21T21:59:20.151095] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-10-21T21:59:20.498773] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-21T21:59:20.900436] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-21T21:59:20.950982] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-10-21T21:59:21.479149] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T21:59:21.751083] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-10-21T21:59:22.551340] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-21T21:59:22.560104] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-10-21T21:59:23.351052] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-10-21T21:59:23.491750] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T21:59:24.151093] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-10-21T21:59:24.862101] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-21T21:59:24.927504] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-21T21:59:24.950984] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-10-21T21:59:25.751012] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-10-21T21:59:25.982197] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T21:59:26.537009] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T21:59:26.550987] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-10-21T21:59:26.782822] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T21:59:27.351077] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-10-21T21:59:27.721170] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-21T21:59:28.151066] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-10-21T21:59:28.951075] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-10-21T21:59:29.438947] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-21T21:59:29.699529] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-21T21:59:29.751016] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-10-21T21:59:30.551056] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-10-21T21:59:30.885282] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-21T21:59:31.351054] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-10-21T21:59:32.027281] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T21:59:32.116196] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T21:59:32.150986] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-10. [2025-10-21T21:59:32.188518] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-21T21:59:32.420531] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-10-21T21:59:32.428808] [INFO ] [REMOTE ] WY: Full fetch complete (77036 records). [2025-10-21T21:59:32.428920] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-10-21T21:59:32.813272] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-10-21T21:59:32.813352] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-10-21T21:59:32.814451] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-10-21T21:59:32.814513] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-10-21T21:59:32.815851] [DEBUG] [LOCAL ] WY: Trimmed 77036 records to 53215 (keeping 200 days of data) [2025-10-21T21:59:32.984884] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-10-21T21:59:33.130059] [DEBUG] [LOCAL ] WY: Primary data saved (53215 records). [2025-10-21T21:59:33.130182] [INFO ] [MAIN ] WY: Full history saved. [2025-10-21T21:59:33.130256] [INFO ] [MAIN ] Update Progress: 2330/2366 symbols completed. WY took 32.2s. Estimated remaining: 4m 38s. Rate: 7.8 symbols/min [2025-10-21T21:59:33.295510] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:33.328194] [DEBUG] [LOCAL ] XPER: Loaded 30766 existing records from primary storage. [2025-10-21T21:59:33.328448] [INFO ] [MAIN ] XPER: Loaded 30766 existing records. [2025-10-21T21:59:33.503827] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:59:33.504023] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-10-21T21:59:33.504078] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-10-21T21:59:33.504282] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-10-21T21:59:33.504348] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-10-21T21:59:33.756191] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-10-21T21:59:33.850542] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:34.551048] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-10-21T21:59:34.935203] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-21T21:59:35.360288] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-10-21T21:59:35.379522] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-10-21T21:59:35.724290] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T21:59:36.151005] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-10-21T21:59:36.368735] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-21T21:59:36.951049] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-10-21T21:59:37.751040] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-10-21T21:59:38.320160] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-21T21:59:38.551853] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-10-21T21:59:38.558700] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-21T21:59:39.038523] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-21T21:59:39.351039] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-10-21T21:59:39.895635] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-21T21:59:40.151082] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-10. [2025-10-21T21:59:40.951026] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-10. [2025-10-21T21:59:41.390293] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-21T21:59:41.395341] [INFO ] [REMOTE ] XFLT: Full fetch complete (44038 records). [2025-10-21T21:59:41.395435] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-10-21T21:59:41.754259] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-10-21T21:59:41.786017] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-10-21T21:59:41.786125] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-10-21T21:59:41.788277] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-10-21T21:59:41.788405] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-10-21T21:59:41.801913] [DEBUG] [LOCAL ] XFLT: Trimmed 44038 records to 30047 (keeping 200 days of data) [2025-10-21T21:59:41.824349] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-21T21:59:42.007345] [DEBUG] [LOCAL ] XFLT: Primary data saved (30047 records). [2025-10-21T21:59:42.007475] [INFO ] [MAIN ] XFLT: Full history saved. [2025-10-21T21:59:42.007551] [INFO ] [MAIN ] Update Progress: 2331/2366 symbols completed. XFLT took 29.2s. Estimated remaining: 4m 30s. Rate: 7.8 symbols/min [2025-10-21T21:59:42.180070] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:42.231450] [DEBUG] [LOCAL ] XPEV: Loaded 53624 existing records from primary storage. [2025-10-21T21:59:42.231787] [INFO ] [MAIN ] XPEV: Loaded 53624 existing records. [2025-10-21T21:59:42.424296] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:59:42.426043] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-21T21:59:42.431793] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-10-21T21:59:42.432484] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-10-21T21:59:42.432754] [INFO ] [REMOTE ] XHR: Full fetch complete (61815 records). [2025-10-21T21:59:42.432864] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-10-21T21:59:42.433047] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-10-21T21:59:42.433317] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-10-21T21:59:42.572768] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-10-21T21:59:43.183462] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:43.224401] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-10-21T21:59:43.224516] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-10-21T21:59:43.232054] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-10-21T21:59:43.241223] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-10-21T21:59:43.242410] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-21T21:59:43.249944] [DEBUG] [LOCAL ] XHR: Trimmed 61815 records to 43423 (keeping 200 days of data) [2025-10-21T21:59:43.360933] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-10-21T21:59:43.531587] [DEBUG] [LOCAL ] XHR: Primary data saved (43423 records). [2025-10-21T21:59:43.531751] [INFO ] [MAIN ] XHR: Full history saved. [2025-10-21T21:59:43.531840] [INFO ] [MAIN ] Update Progress: 2332/2366 symbols completed. XHR took 29.5s. Estimated remaining: 4m 22s. Rate: 7.8 symbols/min [2025-10-21T21:59:43.701587] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:43.745934] [DEBUG] [LOCAL ] XPO: Loaded 47569 existing records from primary storage. [2025-10-21T21:59:43.746227] [INFO ] [MAIN ] XPO: Loaded 47569 existing records. [2025-10-21T21:59:43.944551] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:59:43.944762] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-10-21T21:59:43.944830] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-10-21T21:59:43.945016] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-10-21T21:59:43.945057] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-10-21T21:59:44.162681] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-10-21T21:59:44.317586] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:44.951065] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-10-21T21:59:45.042316] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-21T21:59:45.224062] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-21T21:59:45.495083] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-21T21:59:45.750990] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-10-21T21:59:46.551054] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-10-21T21:59:46.668537] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-21T21:59:47.134199] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-21T21:59:47.350996] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-10-21T21:59:48.151024] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-10-21T21:59:48.598335] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-21T21:59:48.854307] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-21T21:59:48.951054] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-10-21T21:59:49.401035] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-21T21:59:49.751006] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-10-21T21:59:49.847461] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-21T21:59:50.551031] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-10. [2025-10-21T21:59:51.245433] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T21:59:51.254171] [INFO ] [REMOTE ] XOM: Full fetch complete (77973 records). [2025-10-21T21:59:51.254330] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-10-21T21:59:51.353347] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-10-21T21:59:51.691421] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-21T21:59:51.691513] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-10-21T21:59:51.701347] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-10-21T21:59:51.703226] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-10-21T21:59:51.703319] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-10-21T21:59:51.705093] [DEBUG] [LOCAL ] XOM: Trimmed 77973 records to 53793 (keeping 200 days of data) [2025-10-21T21:59:52.061899] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-10-21T21:59:52.062027] [INFO ] [MAIN ] XOM: Full history saved. [2025-10-21T21:59:52.063090] [INFO ] [MAIN ] Update Progress: 2333/2366 symbols completed. XOM took 35.9s. Estimated remaining: 4m 14s. Rate: 7.8 symbols/min [2025-10-21T21:59:52.156106] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-10-21T21:59:52.255515] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:52.292752] [DEBUG] [LOCAL ] XPOF: Loaded 37197 existing records from primary storage. [2025-10-21T21:59:52.293028] [INFO ] [MAIN ] XPOF: Loaded 37197 existing records. [2025-10-21T21:59:52.501939] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T21:59:52.502237] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-10-21T21:59:52.502316] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-10-21T21:59:52.502557] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-10-21T21:59:52.502679] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-10-21T21:59:52.605008] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-21T21:59:52.927919] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T21:59:52.950984] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-10-21T21:59:53.751031] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-10-21T21:59:54.267096] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-21T21:59:54.374310] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-10-21T21:59:54.551029] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-10-21T21:59:55.167094] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-21T21:59:55.351007] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-10-21T21:59:56.151015] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-10-21T21:59:56.519605] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T21:59:56.854347] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-21T21:59:56.950994] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-10-21T21:59:57.751010] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-10. [2025-10-21T21:59:58.031147] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-21T21:59:58.551062] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-10-21T21:59:59.088310] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T21:59:59.094246] [INFO ] [REMOTE ] XPER: Full fetch complete (43732 records). [2025-10-21T21:59:59.094465] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-10-21T21:59:59.310206] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-21T21:59:59.356778] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-10-21T21:59:59.528441] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-10-21T21:59:59.528520] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-10-21T21:59:59.529501] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-10-21T21:59:59.529565] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-10-21T21:59:59.530549] [DEBUG] [LOCAL ] XPER: Trimmed 43732 records to 30741 (keeping 200 days of data) [2025-10-21T21:59:59.709746] [DEBUG] [LOCAL ] XPER: Primary data saved (30741 records). [2025-10-21T21:59:59.709883] [INFO ] [MAIN ] XPER: Full history saved. [2025-10-21T21:59:59.709965] [INFO ] [MAIN ] Update Progress: 2334/2366 symbols completed. XPER took 26.6s. Estimated remaining: 4m 7s. Rate: 7.8 symbols/min [2025-10-21T21:59:59.894194] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T21:59:59.935215] [DEBUG] [LOCAL ] XPRO: Loaded 45873 existing records from primary storage. [2025-10-21T21:59:59.935467] [INFO ] [MAIN ] XPRO: Loaded 45873 existing records. [2025-10-21T22:00:00.119993] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:00:00.120274] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-10-21T22:00:00.120479] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-10-21T22:00:00.129971] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-10-21T22:00:00.143454] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-10-21T22:00:00.191505] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T22:00:00.177258] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-10-21T22:00:00.537092] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:00:00.696550] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-21T22:00:00.951026] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-10-21T22:00:01.751041] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-10-21T22:00:02.295533] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-21T22:00:02.551110] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-10-21T22:00:02.760591] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-21T22:00:02.977998] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-21T22:00:03.351109] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-10-21T22:00:04.148038] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-21T22:00:04.158420] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-10-21T22:00:04.951054] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-10-21T22:00:05.699949] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-21T22:00:05.750982] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-10-21T22:00:05.940970] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-21T22:00:06.551011] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-10-21T22:00:06.742703] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-21T22:00:07.351013] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-10-21T22:00:07.884156] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-21T22:00:08.105462] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T22:00:08.150981] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-10-21T22:00:08.951048] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-10-21T22:00:09.055459] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-21T22:00:09.694580] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-21T22:00:09.751068] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-10-21T22:00:10.091728] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-21T22:00:10.551062] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-10-21T22:00:11.351004] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-10-21T22:00:11.801361] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-21T22:00:12.151019] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-10-21T22:00:12.373119] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-21T22:00:12.775200] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-21T22:00:12.951063] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-10. [2025-10-21T22:00:13.716258] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-21T22:00:13.750990] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-10-21T22:00:14.539699] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-21T22:00:14.549344] [INFO ] [REMOTE ] XPO: Full fetch complete (69654 records). [2025-10-21T22:00:14.549498] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-10-21T22:00:14.561849] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-10-21T22:00:14.957396] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-10-21T22:00:14.957529] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-10-21T22:00:14.959030] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-10-21T22:00:14.959134] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-10-21T22:00:14.961084] [DEBUG] [LOCAL ] XPO: Trimmed 69654 records to 47511 (keeping 200 days of data) [2025-10-21T22:00:15.264782] [DEBUG] [LOCAL ] XPO: Primary data saved (47511 records). [2025-10-21T22:00:15.264912] [INFO ] [MAIN ] XPO: Full history saved. [2025-10-21T22:00:15.265497] [INFO ] [MAIN ] Update Progress: 2335/2366 symbols completed. XPO took 31.7s. Estimated remaining: 3m 59s. Rate: 7.8 symbols/min [2025-10-21T22:00:15.356169] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-10-21T22:00:15.445488] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:00:15.472248] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-21T22:00:15.506362] [DEBUG] [LOCAL ] XYF: Loaded 27638 existing records from primary storage. [2025-10-21T22:00:15.506616] [INFO ] [MAIN ] XYF: Loaded 27638 existing records. [2025-10-21T22:00:15.692958] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:00:15.693194] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-10-21T22:00:15.693248] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-10-21T22:00:15.693523] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-10-21T22:00:15.693581] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-10-21T22:00:16.046051] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:00:16.150993] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-10-21T22:00:16.741245] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-21T22:00:16.951000] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-10-21T22:00:16.996772] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-21T22:00:17.093835] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-21T22:00:17.751853] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-10-21T22:00:17.754691] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-21T22:00:18.551023] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-10-21T22:00:19.351031] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-10-21T22:00:19.686301] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T22:00:19.873793] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-21T22:00:20.150991] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-10. [2025-10-21T22:00:20.951037] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-10-21T22:00:21.014011] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-21T22:00:21.751049] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-10-21T22:00:22.093676] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-21T22:00:22.424217] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-21T22:00:22.432990] [INFO ] [REMOTE ] XPEV: Full fetch complete (77774 records). [2025-10-21T22:00:22.433121] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-10-21T22:00:22.556204] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-10-21T22:00:22.824538] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-10-21T22:00:22.824714] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-10-21T22:00:22.826145] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-10-21T22:00:22.826251] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-10-21T22:00:22.828121] [DEBUG] [LOCAL ] XPEV: Trimmed 77774 records to 53619 (keeping 200 days of data) [2025-10-21T22:00:23.077528] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-21T22:00:23.198779] [DEBUG] [LOCAL ] XPEV: Primary data saved (53619 records). [2025-10-21T22:00:23.198911] [INFO ] [MAIN ] XPEV: Full history saved. [2025-10-21T22:00:23.199668] [INFO ] [MAIN ] Update Progress: 2336/2366 symbols completed. XPEV took 41.2s. Estimated remaining: 3m 51s. Rate: 7.8 symbols/min [2025-10-21T22:00:23.352856] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-10-21T22:00:23.382680] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:00:23.431187] [DEBUG] [LOCAL ] XYL: Loaded 47669 existing records from primary storage. [2025-10-21T22:00:23.431475] [INFO ] [MAIN ] XYL: Loaded 47669 existing records. [2025-10-21T22:00:23.609593] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:00:23.609869] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-10-21T22:00:23.609948] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-10-21T22:00:23.610263] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-10-21T22:00:23.610321] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-10-21T22:00:23.724845] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-21T22:00:23.984029] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:00:24.151060] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-10-21T22:00:24.526607] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-21T22:00:24.951108] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-10-21T22:00:25.109716] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T22:00:25.751025] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-10. [2025-10-21T22:00:26.342831] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-21T22:00:26.551026] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-10-21T22:00:26.883435] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T22:00:26.889019] [INFO ] [REMOTE ] XPOF: Full fetch complete (52931 records). [2025-10-21T22:00:26.889115] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-10-21T22:00:27.275117] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-10-21T22:00:27.275195] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-10-21T22:00:27.276227] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-10-21T22:00:27.276322] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-10-21T22:00:27.277322] [DEBUG] [LOCAL ] XPOF: Trimmed 52931 records to 37043 (keeping 200 days of data) [2025-10-21T22:00:27.356705] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-10-21T22:00:27.494551] [DEBUG] [LOCAL ] XPOF: Primary data saved (37043 records). [2025-10-21T22:00:27.494721] [INFO ] [MAIN ] XPOF: Full history saved. [2025-10-21T22:00:27.495339] [INFO ] [MAIN ] Update Progress: 2337/2366 symbols completed. XPOF took 35.4s. Estimated remaining: 3m 44s. Rate: 7.8 symbols/min [2025-10-21T22:00:27.663416] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:00:27.663583] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-10-21T22:00:27.663620] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-10-21T22:00:27.663751] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-10-21T22:00:27.663792] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-21T22:00:27.663832] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-21T22:00:27.663863] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-10-21T22:00:28.028793] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:00:28.151013] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-10-21T22:00:28.275826] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-21T22:00:28.300418] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-21T22:00:28.951018] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-10. [2025-10-21T22:00:29.093354] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-21T22:00:29.751019] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-10-21T22:00:30.556100] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-10-21T22:00:30.568495] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-21T22:00:30.576150] [INFO ] [REMOTE ] XPRO: Full fetch complete (66418 records). [2025-10-21T22:00:30.576255] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-10-21T22:00:30.955496] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-10-21T22:00:30.955575] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-10-21T22:00:30.956714] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-10-21T22:00:30.956775] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-10-21T22:00:30.957987] [DEBUG] [LOCAL ] XPRO: Trimmed 66418 records to 45822 (keeping 200 days of data) [2025-10-21T22:00:31.218424] [DEBUG] [LOCAL ] XPRO: Primary data saved (45822 records). [2025-10-21T22:00:31.218560] [INFO ] [MAIN ] XPRO: Full history saved. [2025-10-21T22:00:31.218669] [INFO ] [MAIN ] Update Progress: 2338/2366 symbols completed. XPRO took 31.5s. Estimated remaining: 3m 36s. Rate: 7.8 symbols/min [2025-10-21T22:00:31.361430] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-10-21T22:00:31.393832] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:00:31.427444] [DEBUG] [LOCAL ] YALA: Loaded 36606 existing records from primary storage. [2025-10-21T22:00:31.427738] [INFO ] [MAIN ] YALA: Loaded 36606 existing records. [2025-10-21T22:00:31.610754] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:00:31.610995] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-10-21T22:00:31.611105] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-10-21T22:00:31.611282] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-10-21T22:00:31.611331] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-10-21T22:00:32.010410] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:00:32.012615] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-21T22:00:32.150981] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-10-21T22:00:32.412510] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-21T22:00:32.760525] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T22:00:32.951073] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-10-21T22:00:33.751077] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-10-21T22:00:34.154489] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-21T22:00:34.422632] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-21T22:00:34.550998] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-10-21T22:00:35.351013] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-10-21T22:00:35.479788] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T22:00:36.029230] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T22:00:36.150982] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-10-21T22:00:36.951097] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-10-21T22:00:37.029772] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-21T22:00:37.712739] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-21T22:00:37.736900] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-21T22:00:37.750985] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-10-21T22:00:38.551032] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-10-21T22:00:38.735085] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-21T22:00:39.351035] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-10. [2025-10-21T22:00:40.151037] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-10-21T22:00:40.279602] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-21T22:00:40.315287] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-21T22:00:40.319146] [INFO ] [REMOTE ] XYF: Full fetch complete (33639 records). [2025-10-21T22:00:40.319252] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-10-21T22:00:40.696825] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-10-21T22:00:40.696904] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-10-21T22:00:40.697638] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-10-21T22:00:40.697732] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-10-21T22:00:40.698474] [DEBUG] [LOCAL ] XYF: Trimmed 33639 records to 27523 (keeping 200 days of data) [2025-10-21T22:00:40.863904] [DEBUG] [LOCAL ] XYF: Primary data saved (27523 records). [2025-10-21T22:00:40.864023] [INFO ] [MAIN ] XYF: Full history saved. [2025-10-21T22:00:40.864512] [INFO ] [MAIN ] Update Progress: 2339/2366 symbols completed. XYF took 25.6s. Estimated remaining: 3m 28s. Rate: 7.8 symbols/min [2025-10-21T22:00:40.956251] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-10-21T22:00:41.035214] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:00:41.076775] [DEBUG] [LOCAL ] YELP: Loaded 45389 existing records from primary storage. [2025-10-21T22:00:41.077058] [INFO ] [MAIN ] YELP: Loaded 45389 existing records. [2025-10-21T22:00:41.251125] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:00:41.251445] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-10-21T22:00:41.251503] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-10-21T22:00:41.251936] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-10-21T22:00:41.252060] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-10-21T22:00:41.374219] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-21T22:00:41.638923] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:00:41.750984] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-10-21T22:00:42.551007] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-10-21T22:00:43.215091] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-21T22:00:43.350992] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-10-21T22:00:43.434490] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-21T22:00:44.151023] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-10-21T22:00:44.245754] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-21T22:00:44.911748] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T22:00:44.950982] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-10-21T22:00:45.751030] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-10-21T22:00:46.000593] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T22:00:46.551009] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-10-21T22:00:46.631198] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-21T22:00:47.063419] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-21T22:00:47.351002] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-10-21T22:00:48.151037] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-10-21T22:00:48.961053] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-10-21T22:00:48.983294] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-21T22:00:49.112922] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-21T22:00:49.751054] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-10-21T22:00:49.813533] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-21T22:00:50.512888] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-21T22:00:50.551005] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-10-21T22:00:51.351064] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-10-21T22:00:51.523920] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-21T22:00:51.839757] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-21T22:00:52.151032] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-10-21T22:00:52.684188] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-21T22:00:52.951045] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-10-21T22:00:53.751020] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-10-21T22:00:53.820635] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T22:00:54.551067] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-10. [2025-10-21T22:00:55.222073] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T22:00:55.257957] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T22:00:55.265728] [INFO ] [REMOTE ] XYL: Full fetch complete (70036 records). [2025-10-21T22:00:55.294738] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-10-21T22:00:55.297496] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-21T22:00:55.360951] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-10-21T22:00:55.698738] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-10-21T22:00:55.698822] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-10-21T22:00:55.699970] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-10-21T22:00:55.700033] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-10-21T22:00:55.701410] [DEBUG] [LOCAL ] XYL: Trimmed 70036 records to 47603 (keeping 200 days of data) [2025-10-21T22:00:55.990415] [DEBUG] [LOCAL ] XYL: Primary data saved (47603 records). [2025-10-21T22:00:55.990536] [INFO ] [MAIN ] XYL: Full history saved. [2025-10-21T22:00:55.991099] [INFO ] [MAIN ] Update Progress: 2340/2366 symbols completed. XYL took 32.8s. Estimated remaining: 3m 21s. Rate: 7.8 symbols/min [2025-10-21T22:00:56.158188] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:00:56.156170] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-10-21T22:00:56.208882] [DEBUG] [LOCAL ] YETI: Loaded 52543 existing records from primary storage. [2025-10-21T22:00:56.209185] [INFO ] [MAIN ] YETI: Loaded 52543 existing records. [2025-10-21T22:00:56.394943] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:00:56.395944] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-10-21T22:00:56.396001] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-10-21T22:00:56.396667] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-10-21T22:00:56.396724] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-10-21T22:00:56.798753] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:00:56.800282] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T22:00:56.951000] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-10-21T22:00:57.751050] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-10. [2025-10-21T22:00:58.398410] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-21T22:00:58.550995] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-10. [2025-10-21T22:00:58.590910] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-21T22:00:58.854744] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-21T22:00:58.859679] [INFO ] [REMOTE ] YALA: Full fetch complete (47080 records). [2025-10-21T22:00:58.859776] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-10-21T22:00:59.041785] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-21T22:00:59.110810] [INFO ] [REMOTE ] XYZ: Full fetch complete (74023 records). [2025-10-21T22:00:59.129635] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-10-21T22:00:59.356394] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-10-21T22:00:59.505130] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-10-21T22:00:59.525627] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-21T22:00:59.525745] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-10-21T22:00:59.528311] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-10-21T22:00:59.526432] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-10-21T22:00:59.528455] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-10-21T22:00:59.528577] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-10-21T22:00:59.528700] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-10-21T22:00:59.529076] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-10-21T22:00:59.529136] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-10-21T22:00:59.529179] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-10-21T22:00:59.529484] [INFO ] [MAIN ] Update Progress: 2341/2366 symbols completed. XYZ took 32.0s. Estimated remaining: 3m 13s. Rate: 7.8 symbols/min [2025-10-21T22:00:59.632788] [DEBUG] [LOCAL ] YALA: Trimmed 47080 records to 36483 (keeping 200 days of data) [2025-10-21T22:00:59.790835] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:00:59.944001] [DEBUG] [LOCAL ] YEXT: Loaded 43147 existing records from primary storage. [2025-10-21T22:00:59.958102] [DEBUG] [LOCAL ] YALA: Primary data saved (36483 records). [2025-10-21T22:00:59.958383] [INFO ] [MAIN ] YALA: Full history saved. [2025-10-21T22:00:59.958709] [INFO ] [MAIN ] Update Progress: 2342/2366 symbols completed. YALA took 28.7s. Estimated remaining: 3m 5s. Rate: 7.8 symbols/min [2025-10-21T22:00:59.958887] [INFO ] [MAIN ] YEXT: Loaded 43147 existing records. [2025-10-21T22:01:00.153924] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-10-21T22:01:00.350205] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:01:00.360790] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-10-21T22:01:00.365995] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-10-21T22:01:00.384380] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-10-21T22:01:00.395769] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-10-21T22:01:00.499799] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:01:00.819512] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:01:00.839007] [DEBUG] [LOCAL ] YMM: Loaded 52587 existing records from primary storage. [2025-10-21T22:01:00.839563] [INFO ] [MAIN ] YMM: Loaded 52587 existing records. [2025-10-21T22:01:00.957830] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-10-21T22:01:01.029185] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:01:01.041300] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-10-21T22:01:01.046601] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-10-21T22:01:01.069074] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-10-21T22:01:01.069144] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-10-21T22:01:01.130464] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-21T22:01:01.460417] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:01:01.751012] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-10-21T22:01:01.933051] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T22:01:02.550983] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-10-21T22:01:02.618812] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-21T22:01:03.256874] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-21T22:01:03.351003] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-10-21T22:01:04.151060] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-10-21T22:01:04.267427] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-21T22:01:04.951035] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-10-21T22:01:05.130038] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-21T22:01:05.345141] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-21T22:01:05.751035] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-10-21T22:01:06.551027] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-10-21T22:01:06.654232] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-21T22:01:07.341841] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-21T22:01:07.351266] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-10-21T22:01:08.151049] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-10-21T22:01:08.391826] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T22:01:08.911632] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-21T22:01:08.951014] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-10-21T22:01:09.638784] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-21T22:01:09.751061] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-10-21T22:01:10.551045] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-10-21T22:01:10.890090] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T22:01:11.351006] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-10-21T22:01:11.440853] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-21T22:01:11.861982] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T22:01:12.151044] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-10-21T22:01:12.951000] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-10-21T22:01:13.128001] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T22:01:13.751106] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-10-21T22:01:13.928590] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-21T22:01:14.476752] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-21T22:01:14.551011] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-10-21T22:01:15.333311] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-21T22:01:15.350994] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-10-21T22:01:15.748928] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-21T22:01:16.151081] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-10-21T22:01:16.951099] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-10-21T22:01:17.093317] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-21T22:01:17.751113] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-10-21T22:01:17.980798] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-21T22:01:18.551021] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-10-21T22:01:18.725095] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-21T22:01:19.213634] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-21T22:01:19.351031] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-10-21T22:01:20.150990] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-10-21T22:01:20.361368] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-21T22:01:20.890006] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T22:01:20.951022] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-10-21T22:01:21.751050] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-10-21T22:01:22.032760] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T22:01:22.551013] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-10. [2025-10-21T22:01:22.691762] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-21T22:01:23.351070] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-10. [2025-10-21T22:01:23.421287] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-21T22:01:24.122885] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-21T22:01:24.130119] [INFO ] [REMOTE ] YELP: Full fetch complete (64732 records). [2025-10-21T22:01:24.130231] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-10-21T22:01:24.161704] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-10-21T22:01:24.518082] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-10-21T22:01:24.518160] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-10-21T22:01:24.519295] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-10-21T22:01:24.519355] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-10-21T22:01:24.520560] [DEBUG] [LOCAL ] YELP: Trimmed 64732 records to 45259 (keeping 200 days of data) [2025-10-21T22:01:24.783353] [DEBUG] [LOCAL ] YELP: Primary data saved (45259 records). [2025-10-21T22:01:24.783607] [INFO ] [MAIN ] YELP: Full history saved. [2025-10-21T22:01:24.784262] [INFO ] [MAIN ] Update Progress: 2343/2366 symbols completed. YELP took 43.9s. Estimated remaining: 2m 57s. Rate: 7.8 symbols/min [2025-10-21T22:01:24.951820] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-10. [2025-10-21T22:01:24.954454] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:01:24.978982] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-21T22:01:24.987577] [INFO ] [REMOTE ] YETI: Full fetch complete (75506 records). [2025-10-21T22:01:24.987782] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-10-21T22:01:25.288685] [DEBUG] [LOCAL ] YOU: Loaded 49573 existing records from primary storage. [2025-10-21T22:01:25.305329] [INFO ] [MAIN ] YOU: Loaded 49573 existing records. [2025-10-21T22:01:25.604442] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-10-21T22:01:25.604241] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:01:25.604619] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-10-21T22:01:25.604786] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-10-21T22:01:25.606143] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-10-21T22:01:25.606231] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-21T22:01:25.606361] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-10-21T22:01:25.606611] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-10-21T22:01:25.606712] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-10-21T22:01:25.709482] [DEBUG] [LOCAL ] YETI: Trimmed 75506 records to 52528 (keeping 200 days of data) [2025-10-21T22:01:26.174745] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:01:26.210283] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-10-21T22:01:26.285047] [DEBUG] [LOCAL ] YETI: Primary data saved (52528 records). [2025-10-21T22:01:26.285370] [INFO ] [MAIN ] YETI: Full history saved. [2025-10-21T22:01:26.286009] [INFO ] [MAIN ] Update Progress: 2344/2366 symbols completed. YETI took 30.3s. Estimated remaining: 2m 50s. Rate: 7.8 symbols/min [2025-10-21T22:01:26.507734] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-10-21T22:01:26.510108] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:01:26.548294] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T22:01:26.554696] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-10-21T22:01:26.556684] [INFO ] [REMOTE ] YEXT: Full fetch complete (63166 records). [2025-10-21T22:01:26.556849] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-10-21T22:01:26.903594] [DEBUG] [LOCAL ] YPF: Loaded 50760 existing records from primary storage. [2025-10-21T22:01:26.904343] [INFO ] [MAIN ] YPF: Loaded 50760 existing records. [2025-10-21T22:01:27.128252] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-10-21T22:01:27.141186] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-10-21T22:01:27.152967] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-10-21T22:01:27.183385] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-10-21T22:01:27.183272] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:01:27.183771] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-10-21T22:01:27.183826] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-10-21T22:01:27.184121] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-10-21T22:01:27.184227] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-10-21T22:01:27.265090] [DEBUG] [LOCAL ] YEXT: Trimmed 63166 records to 43105 (keeping 200 days of data) [2025-10-21T22:01:27.648314] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:01:27.654631] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-10-21T22:01:27.800403] [DEBUG] [LOCAL ] YEXT: Primary data saved (43105 records). [2025-10-21T22:01:27.800554] [INFO ] [MAIN ] YEXT: Full history saved. [2025-10-21T22:01:27.801497] [INFO ] [MAIN ] Update Progress: 2345/2366 symbols completed. YEXT took 28.3s. Estimated remaining: 2m 42s. Rate: 7.8 symbols/min [2025-10-21T22:01:27.997886] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:01:28.003751] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-21T22:01:28.024579] [DEBUG] [LOCAL ] YRD: Loaded 11354 existing records from primary storage. [2025-10-21T22:01:28.024875] [INFO ] [MAIN ] YRD: Loaded 11354 existing records. [2025-10-21T22:01:28.162326] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-10-21T22:01:28.209163] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:01:28.209416] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-10-21T22:01:28.209491] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-10-21T22:01:28.209764] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-10-21T22:01:28.209827] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-10-21T22:01:28.575208] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:01:28.603822] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-21T22:01:28.950991] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-10. [2025-10-21T22:01:29.436074] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-21T22:01:29.667638] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T22:01:29.750986] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-10-21T22:01:30.551016] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-10-21T22:01:30.659808] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-21T22:01:30.667861] [INFO ] [REMOTE ] YMM: Full fetch complete (76457 records). [2025-10-21T22:01:30.668015] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-10-21T22:01:31.065021] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-10-21T22:01:31.065201] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-10-21T22:01:31.066558] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-10-21T22:01:31.066673] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-10-21T22:01:31.068248] [DEBUG] [LOCAL ] YMM: Trimmed 76457 records to 52583 (keeping 200 days of data) [2025-10-21T22:01:31.353848] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-10-21T22:01:31.428929] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-21T22:01:31.454991] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-21T22:01:31.457613] [DEBUG] [LOCAL ] YMM: Primary data saved (52583 records). [2025-10-21T22:01:31.461026] [INFO ] [MAIN ] YMM: Full history saved. [2025-10-21T22:01:31.461109] [INFO ] [MAIN ] Update Progress: 2346/2366 symbols completed. YMM took 31.5s. Estimated remaining: 2m 34s. Rate: 7.8 symbols/min [2025-10-21T22:01:31.629013] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:01:31.654054] [DEBUG] [LOCAL ] YSG: Loaded 25657 existing records from primary storage. [2025-10-21T22:01:31.654308] [INFO ] [MAIN ] YSG: Loaded 25657 existing records. [2025-10-21T22:01:31.831962] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:01:31.832157] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-10-21T22:01:31.832203] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-10-21T22:01:31.832370] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-10-21T22:01:31.832407] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-10-21T22:01:32.156181] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-10-21T22:01:32.196105] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:01:32.951091] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-10-21T22:01:33.349443] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-21T22:01:33.751006] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-10-21T22:01:33.812309] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T22:01:34.078358] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-21T22:01:34.551020] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-10-21T22:01:35.196632] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-21T22:01:35.351005] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-10-21T22:01:35.552833] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T22:01:36.151016] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-10-21T22:01:36.451201] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-21T22:01:36.951028] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-10-21T22:01:37.751021] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-10-21T22:01:37.927844] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-21T22:01:38.048367] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-21T22:01:38.551000] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-10-21T22:01:38.591774] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-21T22:01:39.351072] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-10-21T22:01:39.373803] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-21T22:01:40.151043] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-10-21T22:01:40.514106] [DEBUG] [REMOTE ] YOU: Error fetching primary data for 2025-06: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-21T22:01:40.514283] [WARN ] [REMOTE ] YOU: No data returned for month 2025-06 [2025-10-21T22:01:40.514407] [FATAL] [REMOTE ] YOU: API call failed - aborting fetch to avoid wasting further API calls [2025-10-21T22:01:40.514531] [FATAL] [MAIN ] YOU: Failed to fetch primary data. [2025-10-21T22:01:40.514694] [WARN ] [MAIN ] YOU: Deleting existing primary and derivative data due to fetch failure. [2025-10-21T22:01:40.514822] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-10-21T22:01:40.514932] [DEBUG] [LOCAL ] YOU: No primary data file found to delete. [2025-10-21T22:01:40.514997] [INFO ] [LOCAL ] YOU: Starting deletion of derivative data. [2025-10-21T22:01:40.515870] [DEBUG] [LOCAL ] YOU: Deleted derivative data file. [2025-10-21T22:01:40.515942] [INFO ] [MAIN ] Update Progress: 2347/2366 symbols completed. YOU took 15.7s. Estimated remaining: 2m 26s. Rate: 7.8 symbols/min [2025-10-21T22:01:40.683508] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:01:40.736555] [DEBUG] [LOCAL ] YUM: Loaded 51173 existing records from primary storage. [2025-10-21T22:01:40.736891] [INFO ] [MAIN ] YUM: Loaded 51173 existing records. [2025-10-21T22:01:40.914125] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:01:40.914383] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-10-21T22:01:40.914440] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-10-21T22:01:40.914639] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-10-21T22:01:40.914737] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-10-21T22:01:40.956502] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-10-21T22:01:41.276376] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-21T22:01:41.322724] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:01:41.750996] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-10-21T22:01:42.550998] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-10-21T22:01:42.815805] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T22:01:43.351005] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-10-21T22:01:43.418282] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-21T22:01:43.552962] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T22:01:44.151031] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-10-21T22:01:44.921603] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-21T22:01:44.950974] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-10-21T22:01:45.180111] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-21T22:01:45.750982] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-10-21T22:01:45.793503] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-21T22:01:46.551073] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-10-21T22:01:47.189785] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-21T22:01:47.350994] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-10-21T22:01:47.363185] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T22:01:48.151000] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-10-21T22:01:48.382798] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-21T22:01:48.951030] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-10-21T22:01:49.750996] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-10-21T22:01:49.953458] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T22:01:50.551071] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-10. [2025-10-21T22:01:50.617279] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-21T22:01:50.637880] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-21T22:01:51.351000] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-10-21T22:01:51.385510] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-21T22:01:51.387820] [INFO ] [REMOTE ] YRD: Full fetch complete (18957 records). [2025-10-21T22:01:51.387890] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-10-21T22:01:51.753503] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-10-21T22:01:51.753575] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-10-21T22:01:51.753975] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-10-21T22:01:51.754048] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-10-21T22:01:51.754619] [DEBUG] [LOCAL ] YRD: Trimmed 18957 records to 11290 (keeping 200 days of data) [2025-10-21T22:01:51.820149] [DEBUG] [LOCAL ] YRD: Primary data saved (11290 records). [2025-10-21T22:01:51.820271] [INFO ] [MAIN ] YRD: Full history saved. [2025-10-21T22:01:51.820349] [INFO ] [MAIN ] Update Progress: 2348/2366 symbols completed. YRD took 24.0s. Estimated remaining: 2m 19s. Rate: 7.8 symbols/min [2025-10-21T22:01:51.991974] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:01:52.042087] [DEBUG] [LOCAL ] YUMC: Loaded 52595 existing records from primary storage. [2025-10-21T22:01:52.042408] [INFO ] [MAIN ] YUMC: Loaded 52595 existing records. [2025-10-21T22:01:52.156309] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-10-21T22:01:52.224900] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:01:52.225093] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-10-21T22:01:52.225140] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-10-21T22:01:52.225323] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-10-21T22:01:52.225363] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-10-21T22:01:52.578100] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:01:52.951006] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-10-21T22:01:53.276267] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-21T22:01:53.642628] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-21T22:01:53.751014] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-10-21T22:01:54.551074] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-10-21T22:01:54.678120] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-21T22:01:55.246278] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-21T22:01:55.351006] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-10-21T22:01:56.151011] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-10-21T22:01:56.396468] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T22:01:56.951002] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-10-21T22:01:57.030081] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-21T22:01:57.095630] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-21T22:01:57.751110] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-10-21T22:01:58.551037] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-10-21T22:01:58.777493] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-21T22:01:59.362343] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-10-21T22:01:59.365202] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-21T22:01:59.657134] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-21T22:02:00.151014] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-10. [2025-10-21T22:02:00.951076] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-10-21T22:02:01.362761] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-21T22:02:01.408230] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-21T22:02:01.412581] [INFO ] [REMOTE ] YSG: Full fetch complete (32502 records). [2025-10-21T22:02:01.412684] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-10-21T22:02:01.753094] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-10-21T22:02:01.784276] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-10-21T22:02:01.784333] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-10-21T22:02:01.785307] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-10-21T22:02:01.785369] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-10-21T22:02:01.786174] [DEBUG] [LOCAL ] YSG: Trimmed 32502 records to 25683 (keeping 200 days of data) [2025-10-21T22:02:01.931478] [DEBUG] [LOCAL ] YSG: Primary data saved (25683 records). [2025-10-21T22:02:01.931602] [INFO ] [MAIN ] YSG: Full history saved. [2025-10-21T22:02:01.931699] [INFO ] [MAIN ] Update Progress: 2349/2366 symbols completed. YSG took 30.5s. Estimated remaining: 2m 11s. Rate: 7.8 symbols/min [2025-10-21T22:02:02.104686] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:02:02.153963] [DEBUG] [LOCAL ] ZBH: Loaded 50791 existing records from primary storage. [2025-10-21T22:02:02.154276] [INFO ] [MAIN ] ZBH: Loaded 50791 existing records. [2025-10-21T22:02:02.332542] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:02:02.332887] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-10-21T22:02:02.333067] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-10-21T22:02:02.333386] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-10-21T22:02:02.333446] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-10-21T22:02:02.460299] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-21T22:02:02.556277] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-10-21T22:02:02.721857] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:02:03.351063] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-10-21T22:02:03.763016] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-21T22:02:04.151073] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-10-21T22:02:04.359207] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-21T22:02:04.951055] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-10-21T22:02:05.188061] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-21T22:02:05.751038] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-10. [2025-10-21T22:02:05.805388] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-21T22:02:06.551073] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-10-21T22:02:06.851402] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-21T22:02:07.224281] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-21T22:02:07.233226] [INFO ] [REMOTE ] YPF: Full fetch complete (73875 records). [2025-10-21T22:02:07.233408] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-10-21T22:02:07.358228] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-10-21T22:02:07.681720] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-10-21T22:02:07.681841] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-10-21T22:02:07.683163] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-10-21T22:02:07.683228] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-10-21T22:02:07.684703] [DEBUG] [LOCAL ] YPF: Trimmed 73875 records to 50761 (keeping 200 days of data) [2025-10-21T22:02:07.990916] [DEBUG] [LOCAL ] YPF: Primary data saved (50761 records). [2025-10-21T22:02:07.991047] [INFO ] [MAIN ] YPF: Full history saved. [2025-10-21T22:02:07.991792] [INFO ] [MAIN ] Update Progress: 2350/2366 symbols completed. YPF took 41.7s. Estimated remaining: 2m 3s. Rate: 7.8 symbols/min [2025-10-21T22:02:08.160155] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-10-21T22:02:08.163104] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:02:08.185252] [DEBUG] [LOCAL ] ZEPP: Loaded 19430 existing records from primary storage. [2025-10-21T22:02:08.185509] [INFO ] [MAIN ] ZEPP: Loaded 19430 existing records. [2025-10-21T22:02:08.373744] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:02:08.392231] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-10-21T22:02:08.392324] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-10-21T22:02:08.394559] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-10-21T22:02:08.394490] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-21T22:02:08.394793] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-10-21T22:02:08.761914] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:02:08.810109] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T22:02:08.951042] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-10. [2025-10-21T22:02:09.688911] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-21T22:02:09.697186] [INFO ] [REMOTE ] YUM: Full fetch complete (74688 records). [2025-10-21T22:02:09.697317] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-10-21T22:02:09.756147] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-10-21T22:02:10.118748] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-10-21T22:02:10.118900] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-10-21T22:02:10.120245] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-10-21T22:02:10.120309] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-10-21T22:02:10.150425] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-21T22:02:10.148879] [DEBUG] [LOCAL ] YUM: Trimmed 74688 records to 51171 (keeping 200 days of data) [2025-10-21T22:02:10.482173] [DEBUG] [LOCAL ] YUM: Primary data saved (51171 records). [2025-10-21T22:02:10.482299] [INFO ] [MAIN ] YUM: Full history saved. [2025-10-21T22:02:10.482902] [INFO ] [MAIN ] Update Progress: 2351/2366 symbols completed. YUM took 30.0s. Estimated remaining: 1m 56s. Rate: 7.8 symbols/min [2025-10-21T22:02:10.557552] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-10-21T22:02:10.658009] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:02:10.710704] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-21T22:02:10.710993] [INFO ] [MAIN ] ZETA: Loaded 53618 existing records. [2025-10-21T22:02:10.889960] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:02:10.890170] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-10-21T22:02:10.890221] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-10-21T22:02:10.890405] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-10-21T22:02:10.890443] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-10-21T22:02:11.249817] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:02:11.350988] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-10-21T22:02:11.624976] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-21T22:02:12.151035] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-10-21T22:02:12.404496] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-21T22:02:12.699684] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-21T22:02:12.951023] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-10-21T22:02:13.454844] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-21T22:02:13.662739] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-21T22:02:13.751042] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-10-21T22:02:14.551089] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-10-21T22:02:15.137559] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-21T22:02:15.351043] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-10-21T22:02:16.013055] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-10-21T22:02:16.151019] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-10-21T22:02:16.779562] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-21T22:02:16.951052] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-10-21T22:02:17.514787] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-21T22:02:17.751045] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-10-21T22:02:18.181682] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-21T22:02:18.551122] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-10-21T22:02:19.351017] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-10-21T22:02:19.607236] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-21T22:02:20.151035] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-10-21T22:02:20.751807] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-21T22:02:20.823226] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-21T22:02:20.875225] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-21T22:02:20.951017] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-10-21T22:02:21.548049] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-21T22:02:21.751049] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-10-21T22:02:22.551030] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-10-21T22:02:23.351030] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-10-21T22:02:23.644676] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-21T22:02:24.073846] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-21T22:02:24.151103] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-10-21T22:02:24.951024] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-10-21T22:02:25.069454] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-21T22:02:25.751054] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-10. [2025-10-21T22:02:26.310139] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-21T22:02:26.429256] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-21T22:02:26.551024] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-10-21T22:02:27.093834] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T22:02:27.102471] [INFO ] [REMOTE ] YUMC: Full fetch complete (76459 records). [2025-10-21T22:02:27.102637] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-10-21T22:02:27.356240] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-10-21T22:02:27.500111] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-10-21T22:02:27.500194] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-10-21T22:02:27.501436] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-10-21T22:02:27.501499] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-10-21T22:02:27.502990] [DEBUG] [LOCAL ] YUMC: Trimmed 76459 records to 52586 (keeping 200 days of data) [2025-10-21T22:02:27.829911] [DEBUG] [LOCAL ] YUMC: Primary data saved (52586 records). [2025-10-21T22:02:27.830043] [INFO ] [MAIN ] YUMC: Full history saved. [2025-10-21T22:02:27.830622] [INFO ] [MAIN ] Update Progress: 2352/2366 symbols completed. YUMC took 36.0s. Estimated remaining: 1m 48s. Rate: 7.8 symbols/min [2025-10-21T22:02:28.001629] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:02:28.042211] [DEBUG] [LOCAL ] ZGN: Loaded 40935 existing records from primary storage. [2025-10-21T22:02:28.042493] [INFO ] [MAIN ] ZGN: Loaded 40935 existing records. [2025-10-21T22:02:28.156258] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-10-21T22:02:28.230693] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:02:28.230895] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-10-21T22:02:28.230963] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-10-21T22:02:28.231139] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-10-21T22:02:28.231177] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-10-21T22:02:28.613410] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:02:28.807876] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-21T22:02:28.951052] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-10. [2025-10-21T22:02:29.121069] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-21T22:02:29.751127] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-10-21T22:02:30.006581] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-21T22:02:30.083048] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-21T22:02:30.086828] [INFO ] [REMOTE ] ZEPP: Full fetch complete (21100 records). [2025-10-21T22:02:30.086906] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-10-21T22:02:30.454756] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-10-21T22:02:30.454861] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-10-21T22:02:30.455465] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-10-21T22:02:30.455531] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-10-21T22:02:30.456452] [DEBUG] [LOCAL ] ZEPP: Trimmed 21100 records to 19519 (keeping 200 days of data) [2025-10-21T22:02:30.554699] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-10-21T22:02:30.572743] [DEBUG] [LOCAL ] ZEPP: Primary data saved (19519 records). [2025-10-21T22:02:30.572886] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-10-21T22:02:30.572965] [INFO ] [MAIN ] Update Progress: 2353/2366 symbols completed. ZEPP took 22.6s. Estimated remaining: 1m 40s. Rate: 7.8 symbols/min [2025-10-21T22:02:30.754124] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:02:30.777341] [DEBUG] [LOCAL ] ZH: Loaded 24968 existing records from primary storage. [2025-10-21T22:02:30.777592] [INFO ] [MAIN ] ZH: Loaded 24968 existing records. [2025-10-21T22:02:30.954120] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:02:30.954319] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-10-21T22:02:30.954365] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-10-21T22:02:30.954529] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-10-21T22:02:30.954568] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-10-21T22:02:31.317212] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:02:31.351174] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-21T22:02:31.351264] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-10-21T22:02:32.026090] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-21T22:02:32.151019] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-10-21T22:02:32.634610] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-21T22:02:32.951104] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-10-21T22:02:33.694078] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T22:02:33.751020] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-10-21T22:02:34.284452] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-21T22:02:34.551078] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-10-21T22:02:34.888547] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-21T22:02:35.351025] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-10-21T22:02:36.068258] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-21T22:02:36.150993] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-10-21T22:02:36.951005] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-10-21T22:02:37.008916] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-21T22:02:37.440425] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-21T22:02:37.751037] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-10-21T22:02:38.551087] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-10-21T22:02:39.351089] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-10-21T22:02:39.615515] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-21T22:02:40.114388] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-21T22:02:40.151030] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-10-21T22:02:40.209998] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (3.26 seconds). [2025-10-21T22:02:40.355915] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-21T22:02:40.951032] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-10-21T22:02:41.369333] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-21T22:02:41.751074] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-10-21T22:02:42.379479] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-21T22:02:42.551057] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-10-21T22:02:43.147327] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-21T22:02:43.350981] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-10-21T22:02:43.741494] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-21T22:02:44.123076] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-21T22:02:44.150989] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-10. [2025-10-21T22:02:44.840628] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-21T22:02:44.848250] [INFO ] [REMOTE ] ZBH: Full fetch complete (73929 records). [2025-10-21T22:02:44.848410] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-10-21T22:02:44.951586] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-10-21T22:02:45.242676] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-10-21T22:02:45.242749] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-10-21T22:02:45.243933] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-10-21T22:02:45.243993] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-10-21T22:02:45.245331] [DEBUG] [LOCAL ] ZBH: Trimmed 73929 records to 50718 (keeping 200 days of data) [2025-10-21T22:02:45.570916] [DEBUG] [LOCAL ] ZBH: Primary data saved (50718 records). [2025-10-21T22:02:45.571102] [INFO ] [MAIN ] ZBH: Full history saved. [2025-10-21T22:02:45.571234] [INFO ] [MAIN ] Update Progress: 2354/2366 symbols completed. ZBH took 43.6s. Estimated remaining: 1m 33s. Rate: 7.8 symbols/min [2025-10-21T22:02:45.741741] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:02:45.751020] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-10. [2025-10-21T22:02:45.796794] [DEBUG] [LOCAL ] ZIM: Loaded 53475 existing records from primary storage. [2025-10-21T22:02:45.797287] [INFO ] [MAIN ] ZIM: Loaded 53475 existing records. [2025-10-21T22:02:45.976788] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:02:45.977042] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-10-21T22:02:45.977098] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-10-21T22:02:45.977295] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-10-21T22:02:45.977352] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-10-21T22:02:46.354038] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:02:46.371261] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-21T22:02:46.551104] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-10-21T22:02:47.351166] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-10-21T22:02:47.944540] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-21T22:02:47.952839] [INFO ] [REMOTE ] ZETA: Full fetch complete (77733 records). [2025-10-21T22:02:47.952948] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-10-21T22:02:48.178604] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-10-21T22:02:48.356677] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-10-21T22:02:48.356772] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-10-21T22:02:48.358183] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-10-21T22:02:48.358249] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-10-21T22:02:48.359671] [DEBUG] [LOCAL ] ZETA: Trimmed 77733 records to 53618 (keeping 200 days of data) [2025-10-21T22:02:48.586360] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-21T22:02:48.701796] [DEBUG] [LOCAL ] ZETA: Primary data saved (53618 records). [2025-10-21T22:02:48.701918] [INFO ] [MAIN ] ZETA: Full history saved. [2025-10-21T22:02:48.702547] [INFO ] [MAIN ] Update Progress: 2355/2366 symbols completed. ZETA took 38.2s. Estimated remaining: 1m 25s. Rate: 7.8 symbols/min [2025-10-21T22:02:48.883912] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:02:48.903141] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-21T22:02:48.947746] [DEBUG] [LOCAL ] ZIP: Loaded 43557 existing records from primary storage. [2025-10-21T22:02:48.948016] [INFO ] [MAIN ] ZIP: Loaded 43557 existing records. [2025-10-21T22:02:48.959022] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-10-21T22:02:49.124892] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:02:49.125089] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-10-21T22:02:49.125136] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-10-21T22:02:49.125365] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-10-21T22:02:49.125423] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-10-21T22:02:49.494482] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:02:49.750991] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-10-21T22:02:49.789959] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-21T22:02:50.551103] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-10-21T22:02:50.772851] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-21T22:02:51.062202] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-21T22:02:51.350996] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-10-21T22:02:51.800926] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-21T22:02:52.151029] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-10-21T22:02:52.951107] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-10. [2025-10-21T22:02:53.422236] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-21T22:02:53.751071] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-10-21T22:02:53.785141] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-10-21T22:02:53.933916] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-21T22:02:53.937299] [INFO ] [REMOTE ] ZH: Full fetch complete (39747 records). [2025-10-21T22:02:53.937433] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-10-21T22:02:54.309078] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-10-21T22:02:54.309143] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-10-21T22:02:54.309983] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-10-21T22:02:54.310044] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-10-21T22:02:54.310903] [DEBUG] [LOCAL ] ZH: Trimmed 39747 records to 24749 (keeping 200 days of data) [2025-10-21T22:02:54.442562] [DEBUG] [LOCAL ] ZH: Primary data saved (24749 records). [2025-10-21T22:02:54.442718] [INFO ] [MAIN ] ZH: Full history saved. [2025-10-21T22:02:54.442807] [INFO ] [MAIN ] Update Progress: 2356/2366 symbols completed. ZH took 23.9s. Estimated remaining: 1m 17s. Rate: 7.8 symbols/min [2025-10-21T22:02:54.556206] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-10-21T22:02:54.610752] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:02:54.648085] [DEBUG] [LOCAL ] ZK: Loaded 39023 existing records from primary storage. [2025-10-21T22:02:54.648363] [INFO ] [MAIN ] ZK: Loaded 39023 existing records. [2025-10-21T22:02:54.824751] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:02:54.824981] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-10-21T22:02:54.825026] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-10-21T22:02:54.825192] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-10-21T22:02:54.825228] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-10-21T22:02:55.185602] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:02:55.209120] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-21T22:02:55.351040] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-10-21T22:02:55.806435] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-21T22:02:56.151014] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-10-21T22:02:56.951037] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-10-21T22:02:57.573573] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-21T22:02:57.604902] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-21T22:02:57.751036] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-10-21T22:02:58.090810] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-21T22:02:58.551090] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-10-21T22:02:59.291819] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-21T22:02:59.351011] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-10-21T22:02:59.989892] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-21T22:03:00.151026] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-10. [2025-10-21T22:03:00.951081] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-10-21T22:03:01.104927] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-21T22:03:01.610814] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-21T22:03:01.617917] [INFO ] [REMOTE ] ZGN: Full fetch complete (58767 records). [2025-10-21T22:03:01.618086] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-10-21T22:03:01.757463] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-10-21T22:03:02.071101] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-10-21T22:03:02.071182] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-10-21T22:03:02.072324] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-10-21T22:03:02.072387] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-10-21T22:03:02.073706] [DEBUG] [LOCAL ] ZGN: Trimmed 58767 records to 40965 (keeping 200 days of data) [2025-10-21T22:03:02.318519] [DEBUG] [LOCAL ] ZGN: Primary data saved (40965 records). [2025-10-21T22:03:02.318636] [INFO ] [MAIN ] ZGN: Full history saved. [2025-10-21T22:03:02.319314] [INFO ] [MAIN ] Update Progress: 2357/2366 symbols completed. ZGN took 34.5s. Estimated remaining: 1m 9s. Rate: 7.8 symbols/min [2025-10-21T22:03:02.546856] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-21T22:03:02.555923] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-10-21T22:03:03.069419] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-21T22:03:03.350997] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-10-21T22:03:04.151069] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-10-21T22:03:04.644447] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-21T22:03:04.834695] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-21T22:03:04.950999] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-10-21T22:03:05.751059] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-10-21T22:03:05.786934] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-21T22:03:06.551065] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-10-21T22:03:07.179320] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-21T22:03:07.347589] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-21T22:03:07.355920] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-10-21T22:03:07.917867] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-21T22:03:08.151013] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-10-21T22:03:08.951085] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-10-21T22:03:09.422458] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-21T22:03:09.650495] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-21T22:03:09.751065] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-10-21T22:03:10.293406] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-21T22:03:10.551102] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-10-21T22:03:11.351078] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-10-21T22:03:12.026673] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-21T22:03:12.089571] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-21T22:03:12.150985] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-10-21T22:03:12.881675] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-21T22:03:12.951034] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-10. [2025-10-21T22:03:13.751081] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-10-21T22:03:14.125324] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-21T22:03:14.402690] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-21T22:03:14.410237] [INFO ] [REMOTE ] ZIP: Full fetch complete (60680 records). [2025-10-21T22:03:14.410399] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-10-21T22:03:14.556270] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-10. [2025-10-21T22:03:14.846445] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-10-21T22:03:14.846573] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-10-21T22:03:14.847775] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-10-21T22:03:14.847947] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-10-21T22:03:14.849322] [DEBUG] [LOCAL ] ZIP: Trimmed 60680 records to 43531 (keeping 200 days of data) [2025-10-21T22:03:15.076879] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-21T22:03:15.138625] [DEBUG] [LOCAL ] ZIP: Primary data saved (43531 records). [2025-10-21T22:03:15.138794] [INFO ] [MAIN ] ZIP: Full history saved. [2025-10-21T22:03:15.139337] [INFO ] [MAIN ] Update Progress: 2358/2366 symbols completed. ZIP took 26.4s. Estimated remaining: 1m 2s. Rate: 7.8 symbols/min [2025-10-21T22:03:15.351071] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-10. [2025-10-21T22:03:16.413215] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-21T22:03:16.419579] [INFO ] [REMOTE ] ZK: Full fetch complete (56975 records). [2025-10-21T22:03:16.419737] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-10-21T22:03:16.833536] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-21T22:03:16.860100] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-10-21T22:03:16.860275] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-10-21T22:03:16.861670] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-10-21T22:03:16.861755] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-10-21T22:03:16.862003] [INFO ] [REMOTE ] ZIM: Full fetch complete (77591 records). [2025-10-21T22:03:16.862084] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-10-21T22:03:16.935332] [DEBUG] [LOCAL ] ZK: Trimmed 56975 records to 39001 (keeping 200 days of data) [2025-10-21T22:03:17.496838] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-10-21T22:03:17.502493] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-10-21T22:03:17.504138] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-10-21T22:03:17.504225] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-10-21T22:03:17.502590] [DEBUG] [LOCAL ] ZK: Primary data saved (39001 records). [2025-10-21T22:03:17.504554] [INFO ] [MAIN ] ZK: Full history saved. [2025-10-21T22:03:17.505215] [INFO ] [MAIN ] Update Progress: 2359/2366 symbols completed. ZK took 23.1s. Estimated remaining: 54.0s. Rate: 7.8 symbols/min [2025-10-21T22:03:17.506543] [DEBUG] [LOCAL ] ZIM: Trimmed 77591 records to 53470 (keeping 200 days of data) [2025-10-21T22:03:17.825763] [DEBUG] [LOCAL ] ZIM: Primary data saved (53470 records). [2025-10-21T22:03:17.825899] [INFO ] [MAIN ] ZIM: Full history saved. [2025-10-21T22:03:17.825977] [INFO ] [MAIN ] Update Progress: 2360/2366 symbols completed. ZIM took 32.3s. Estimated remaining: 46.3s. Rate: 7.8 symbols/min [2025-10-21T22:03:18.522026] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:03:18.523736] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:03:18.532475] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:03:18.558466] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:03:18.571233] [DEBUG] [LOCAL ] ZKH: Loaded 7399 existing records from primary storage. [2025-10-21T22:03:18.571696] [INFO ] [MAIN ] ZKH: Loaded 7399 existing records. [2025-10-21T22:03:18.632211] [DEBUG] [LOCAL ] ZTR: Loaded 16614 existing records from primary storage. [2025-10-21T22:03:18.664325] [INFO ] [MAIN ] ZTR: Loaded 16614 existing records. [2025-10-21T22:03:18.856328] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:03:18.905727] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-10-21T22:03:18.909636] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-10-21T22:03:18.928822] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-10-21T22:03:18.957939] [DEBUG] [LOCAL ] ZTO: Loaded 49462 existing records from primary storage. [2025-10-21T22:03:18.955828] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-10-21T22:03:19.007343] [INFO ] [MAIN ] ZTO: Loaded 49462 existing records. [2025-10-21T22:03:19.016218] [DEBUG] [LOCAL ] ZTS: Loaded 53138 existing records from primary storage. [2025-10-21T22:03:19.047789] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:03:19.150518] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-10-21T22:03:19.150729] [INFO ] [MAIN ] ZTS: Loaded 53138 existing records. [2025-10-21T22:03:19.171635] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-10-21T22:03:19.249004] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-10-21T22:03:19.298794] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-10-21T22:03:19.843746] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:03:19.881164] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:03:19.954476] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-10-21T22:03:19.954347] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-10-21T22:03:19.964042] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-10-21T22:03:19.977965] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-10-21T22:03:20.001998] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-10-21T22:03:20.049013] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-10-21T22:03:20.048943] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-10-21T22:03:20.091732] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-10-21T22:03:20.271110] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:03:20.383605] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:03:20.375317] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-10-21T22:03:20.435445] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-10-21T22:03:20.907890] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:03:20.927453] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-10-21T22:03:20.927196] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:03:20.928511] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-10-21T22:03:21.268210] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-21T22:03:21.270432] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-10-21T22:03:21.784824] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-21T22:03:21.790439] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-10-21T22:03:22.134066] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-21T22:03:22.136988] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-10-21T22:03:22.398874] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-21T22:03:22.409114] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-10-21T22:03:22.643950] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-21T22:03:22.646731] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-10-21T22:03:22.725962] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-21T22:03:22.844732] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-21T22:03:23.240365] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-21T22:03:23.351086] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-10-21T22:03:23.779716] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-21T22:03:23.837919] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-21T22:03:24.151122] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-10-21T22:03:24.951036] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-10-21T22:03:25.751062] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-10-21T22:03:25.991690] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-21T22:03:26.325001] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-21T22:03:26.503880] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T22:03:26.550983] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-10-21T22:03:27.351101] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-10-21T22:03:28.151041] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-10-21T22:03:28.341052] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-21T22:03:28.472573] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-21T22:03:28.951038] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-10-21T22:03:29.749516] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-21T22:03:29.754374] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-10-21T22:03:29.884946] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-21T22:03:30.383682] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-21T22:03:30.551016] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-10-21T22:03:31.351027] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-10-21T22:03:31.384137] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-21T22:03:32.111195] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-21T22:03:32.151008] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-10-21T22:03:32.951053] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-10-21T22:03:33.751020] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-10-21T22:03:33.934358] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-21T22:03:34.319905] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-21T22:03:34.550999] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-10. [2025-10-21T22:03:34.893798] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-21T22:03:34.909162] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-21T22:03:34.910360] [INFO ] [REMOTE ] ZKH: Full fetch complete (11814 records). [2025-10-21T22:03:34.910428] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-10-21T22:03:35.282602] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-10-21T22:03:35.282707] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-10-21T22:03:35.283017] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-10-21T22:03:35.283058] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-10-21T22:03:35.283529] [DEBUG] [LOCAL ] ZKH: Trimmed 11814 records to 7360 (keeping 200 days of data) [2025-10-21T22:03:35.327179] [DEBUG] [LOCAL ] ZKH: Primary data saved (7360 records). [2025-10-21T22:03:35.327337] [INFO ] [MAIN ] ZKH: Full history saved. [2025-10-21T22:03:35.327440] [INFO ] [MAIN ] Update Progress: 2361/2366 symbols completed. ZKH took 17.5s. Estimated remaining: 38.6s. Rate: 7.8 symbols/min [2025-10-21T22:03:35.357289] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-10-21T22:03:35.498435] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:03:35.530616] [DEBUG] [LOCAL ] ZVIA: Loaded 35831 existing records from primary storage. [2025-10-21T22:03:35.530909] [INFO ] [MAIN ] ZVIA: Loaded 35831 existing records. [2025-10-21T22:03:35.704145] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:03:35.704332] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-10-21T22:03:35.704393] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-10-21T22:03:35.704758] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-10-21T22:03:35.704824] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-10-21T22:03:36.066882] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:03:36.068784] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-21T22:03:36.151198] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-10-21T22:03:36.951039] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-10-21T22:03:37.756489] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-10-21T22:03:37.770342] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-21T22:03:38.556147] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-10-21T22:03:38.580381] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-21T22:03:38.906865] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-21T22:03:39.351090] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-10-21T22:03:40.036746] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-21T22:03:40.066958] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-21T22:03:40.151032] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-10-21T22:03:40.951051] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-10-21T22:03:41.751041] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-10-21T22:03:41.829894] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-21T22:03:42.550996] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-10-21T22:03:42.714444] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-21T22:03:42.868066] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-21T22:03:43.351038] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-10-21T22:03:44.151009] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-10-21T22:03:44.240553] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-21T22:03:44.413211] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-21T22:03:44.951084] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-10. [2025-10-21T22:03:45.661083] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-21T22:03:45.664135] [INFO ] [REMOTE ] ZTR: Full fetch complete (26812 records). [2025-10-21T22:03:45.664205] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-10-21T22:03:45.755030] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-10-21T22:03:46.077166] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-10-21T22:03:46.077358] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-10-21T22:03:46.078093] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-10-21T22:03:46.078171] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-10-21T22:03:46.079187] [DEBUG] [LOCAL ] ZTR: Trimmed 26812 records to 16602 (keeping 200 days of data) [2025-10-21T22:03:46.200309] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-21T22:03:46.215940] [DEBUG] [LOCAL ] ZTR: Primary data saved (16602 records). [2025-10-21T22:03:46.216234] [INFO ] [MAIN ] ZTR: Full history saved. [2025-10-21T22:03:46.216327] [INFO ] [MAIN ] Update Progress: 2362/2366 symbols completed. ZTR took 28.4s. Estimated remaining: 30.9s. Rate: 7.8 symbols/min [2025-10-21T22:03:46.384941] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-10-13 to 2025-10-21. [2025-10-21T22:03:46.422567] [DEBUG] [LOCAL ] ZWS: Loaded 42373 existing records from primary storage. [2025-10-21T22:03:46.422903] [INFO ] [MAIN ] ZWS: Loaded 42373 existing records. [2025-10-21T22:03:46.564061] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-10-21T22:03:46.605557] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-04-03, but need from 2025-01-03 for 200 day retention. Performing full refresh. [2025-10-21T22:03:46.606090] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-10-21T22:03:46.606206] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-10-21T22:03:46.606563] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-10-21T22:03:46.606610] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-10-21T22:03:46.935007] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-21T22:03:46.996715] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2025-01-03 to 2025-10-21 (requires 10 months of data pull). [2025-10-21T22:03:47.351083] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-10-21T22:03:48.151075] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-10-21T22:03:48.445949] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-21T22:03:48.794971] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-21T22:03:48.950994] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-10-21T22:03:49.554193] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-21T22:03:49.751029] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-10-21T22:03:50.384702] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-21T22:03:50.551086] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-10-21T22:03:51.296166] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-21T22:03:51.350994] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-10-21T22:03:52.064488] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-21T22:03:52.150996] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-10-21T22:03:52.951078] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-10. [2025-10-21T22:03:53.301282] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-21T22:03:53.690532] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T22:03:53.751089] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-10-21T22:03:54.559896] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-10-21T22:03:54.562078] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-21T22:03:54.569859] [INFO ] [REMOTE ] ZTO: Full fetch complete (72802 records). [2025-10-21T22:03:54.569978] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-10-21T22:03:54.971697] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-10-21T22:03:54.971790] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-10-21T22:03:54.973205] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-10-21T22:03:54.973277] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-10-21T22:03:54.974717] [DEBUG] [LOCAL ] ZTO: Trimmed 72802 records to 49407 (keeping 200 days of data) [2025-10-21T22:03:55.278917] [DEBUG] [LOCAL ] ZTO: Primary data saved (49407 records). [2025-10-21T22:03:55.279244] [INFO ] [MAIN ] ZTO: Full history saved. [2025-10-21T22:03:55.279622] [INFO ] [MAIN ] Update Progress: 2363/2366 symbols completed. ZTO took 37.4s. Estimated remaining: 23.1s. Rate: 7.8 symbols/min [2025-10-21T22:03:55.302870] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-21T22:03:55.351003] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-10-21T22:03:55.698677] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-21T22:03:56.151041] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-10. [2025-10-21T22:03:56.899722] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-21T22:03:56.950988] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-10-21T22:03:57.486918] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-21T22:03:57.492842] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52665 records). [2025-10-21T22:03:57.492975] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-10-21T22:03:57.764736] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-10. [2025-10-21T22:03:57.901845] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-10-21T22:03:57.901929] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-10-21T22:03:57.903077] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-10-21T22:03:57.903139] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-10-21T22:03:57.904144] [DEBUG] [LOCAL ] ZVIA: Trimmed 52665 records to 35811 (keeping 200 days of data) [2025-10-21T22:03:58.101953] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35811 records). [2025-10-21T22:03:58.102085] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-10-21T22:03:58.102684] [INFO ] [MAIN ] Update Progress: 2364/2366 symbols completed. ZVIA took 22.8s. Estimated remaining: 15.4s. Rate: 7.8 symbols/min [2025-10-21T22:03:58.278513] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-21T22:03:58.287823] [INFO ] [REMOTE ] ZTS: Full fetch complete (76886 records). [2025-10-21T22:03:58.287977] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-10-21T22:03:58.693374] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-21T22:03:58.720629] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-10-21T22:03:58.720736] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-10-21T22:03:58.722305] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-10-21T22:03:58.722386] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-10-21T22:03:58.722857] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-10-21T22:03:58.724461] [DEBUG] [LOCAL ] ZTS: Trimmed 76886 records to 53131 (keeping 200 days of data) [2025-10-21T22:03:59.043024] [DEBUG] [LOCAL ] ZTS: Primary data saved (53131 records). [2025-10-21T22:03:59.043155] [INFO ] [MAIN ] ZTS: Full history saved. [2025-10-21T22:03:59.043231] [INFO ] [MAIN ] Update Progress: 2365/2366 symbols completed. ZTS took 41.2s. Estimated remaining: 7.7s. Rate: 7.8 symbols/min [2025-10-21T22:04:00.460987] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-21T22:04:00.471236] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-10-21T22:04:01.826518] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-21T22:04:01.834836] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-10-21T22:04:03.243783] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-21T22:04:03.251445] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-10-21T22:04:04.916994] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-21T22:04:04.927790] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-10-21T22:04:06.467107] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-21T22:04:06.476324] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-10-21T22:04:07.795436] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-21T22:04:07.804727] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-10. [2025-10-21T22:04:09.404919] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-21T22:04:09.411496] [INFO ] [REMOTE ] ZWS: Full fetch complete (62042 records). [2025-10-21T22:04:09.411615] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-10-21T22:04:09.816922] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-10-21T22:04:09.817019] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-10-21T22:04:09.818326] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-10-21T22:04:09.818393] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-10-21T22:04:09.819777] [DEBUG] [LOCAL ] ZWS: Trimmed 62042 records to 42220 (keeping 200 days of data) [2025-10-21T22:04:10.098383] [DEBUG] [LOCAL ] ZWS: Primary data saved (42220 records). [2025-10-21T22:04:10.098508] [INFO ] [MAIN ] ZWS: Full history saved. [2025-10-21T22:04:10.099129] [INFO ] [MAIN ] Update Progress: 2366/2366 symbols completed. ZWS took 23.9s. Estimated remaining: 0.0s. Rate: 7.8 symbols/min [2025-10-21T22:04:10.099969] [INFO ] [MAIN ] Parallel update completed in 5h 4m 6s [2025-10-21T22:04:10.100048] [WARN ] [MAIN ] Failed symbols (309): AAM, AAMI, A, AAUC, AAT, ABG, ACA, ACHR, ACR, AD... [2025-10-21T22:04:10.100118] [INFO ] [MAIN ] Update success rate: 86.9% (2057/2366 symbols) [2025-10-21T22:04:10.822202] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2057/2366 @ 86.94%)' [2025-10-21T22:04:10.822590] [INFO ] [MAIN ] Primary update successful. Now generating derivatives... [2025-10-21T22:04:10.822690] [INFO ] [MAIN ] Refreshing symbols list before derivative generation... [2025-10-21T22:04:10.822763] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-21T22:04:10.822878] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-21T22:04:10.822965] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-21T22:04:12.345344] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-21T22:04:12.345478] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-21T22:04:12.345730] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-21T22:04:12.346258] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-21T22:04:12.346314] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-21T22:04:12.346346] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-21T22:04:12.346403] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-21T22:04:12.346434] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-21T22:04:12.346462] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-21T22:04:12.346884] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-21T22:04:12.346937] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-21T22:04:12.347114] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-21T22:04:12.347146] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-21T22:04:12.347221] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-21T22:04:12.347261] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-21T22:04:12.378085] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-21T22:04:12.401009] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-21T22:04:12.401070] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-21T22:04:12.401103] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-21T22:04:12.401131] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-21T22:04:12.401183] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-10-21T22:04:12.401213] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-10-21T22:04:12.401246] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-10-21T22:04:12.402307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-10-21T22:04:12.402405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-10-21T22:04:12.402510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-10-21T22:04:12.402637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-10-21T22:04:12.402775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-10-21T22:04:12.402867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-10-21T22:04:12.402960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-10-21T22:04:12.403031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-10-21T22:04:12.403152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-10-21T22:04:12.403247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-10-21T22:04:12.403332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-10-21T22:04:12.403421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-10-21T22:04:12.403516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-10-21T22:04:12.403601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-10-21T22:04:12.403695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-10-21T22:04:12.403789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-10-21T22:04:12.403859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-10-21T22:04:12.403944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-10-21T22:04:12.404070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-10-21T22:04:12.404206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-10-21T22:04:12.404312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-10-21T22:04:12.404384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-10-21T22:04:12.404471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-10-21T22:04:12.404564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-10-21T22:04:12.404670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-10-21T22:04:12.404782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-10-21T22:04:12.404886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-10-21T22:04:12.404953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-10-21T22:04:12.405032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-10-21T22:04:12.405114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-10-21T22:04:12.405226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-10-21T22:04:12.405333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-10-21T22:04:12.405410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-10-21T22:04:12.405493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-10-21T22:04:12.405582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-10-21T22:04:12.405677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-10-21T22:04:12.405789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-10-21T22:04:12.405878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-10-21T22:04:12.405963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-10-21T22:04:12.406054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-10-21T22:04:12.406143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-10-21T22:04:12.406234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-10-21T22:04:12.406333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-10-21T22:04:12.406432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-10-21T22:04:12.406502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-10-21T22:04:12.406585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-10-21T22:04:12.406745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-10-21T22:04:12.406851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-10-21T22:04:12.406946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-10-21T22:04:12.407020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-10-21T22:04:12.407104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-10-21T22:04:12.407207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-10-21T22:04:12.407298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-10-21T22:04:12.407383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-10-21T22:04:12.407545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-10-21T22:04:12.407636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-10-21T22:04:12.407786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-10-21T22:04:12.407860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-10-21T22:04:12.407927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-10-21T22:04:12.408007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-10-21T22:04:12.408085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-10-21T22:04:12.408194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-10-21T22:04:12.408280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-10-21T22:04:12.408363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-10-21T22:04:12.408454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-10-21T22:04:12.408562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-10-21T22:04:12.408703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-10-21T22:04:12.408836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-10-21T22:04:12.408953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-10-21T22:04:12.409022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-10-21T22:04:12.409089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-10-21T22:04:12.409155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-10-21T22:04:12.409218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-10-21T22:04:12.409296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-10-21T22:04:12.409361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-10-21T22:04:12.409448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-10-21T22:04:12.409535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-10-21T22:04:12.409672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-10-21T22:04:12.409789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-10-21T22:04:12.409861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-10-21T22:04:12.409925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-10-21T22:04:12.409990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-10-21T22:04:12.410051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-10-21T22:04:12.410114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-10-21T22:04:12.410192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-10-21T22:04:12.410255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-10-21T22:04:12.410317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-10-21T22:04:12.410381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-10-21T22:04:12.410443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-10-21T22:04:12.410519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-10-21T22:04:12.410581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-10-21T22:04:12.410723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-10-21T22:04:12.410819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-10-21T22:04:12.410886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-10-21T22:04:12.410960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-10-21T22:04:12.411024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-10-21T22:04:12.411109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-10-21T22:04:12.411197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-10-21T22:04:12.411264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-10-21T22:04:12.411331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-10-21T22:04:12.411410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-10-21T22:04:12.411472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-10-21T22:04:12.411550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-10-21T22:04:12.411678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-10-21T22:04:12.411802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-10-21T22:04:12.411907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-10-21T22:04:12.411974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-10-21T22:04:12.412041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-10-21T22:04:12.412111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-10-21T22:04:12.412203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-10-21T22:04:12.412319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-10-21T22:04:12.412410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-10-21T22:04:12.412479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-10-21T22:04:12.412559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-10-21T22:04:12.412634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-10-21T22:04:12.412759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-10-21T22:04:12.412873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-10-21T22:04:12.412965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-10-21T22:04:12.413065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-10-21T22:04:12.413156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-10-21T22:04:12.413237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-10-21T22:04:12.413307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-10-21T22:04:12.413372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-10-21T22:04:12.413441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-10-21T22:04:12.413532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-10-21T22:04:12.413598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-10-21T22:04:12.413691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-10-21T22:04:12.413783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-10-21T22:04:12.413866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-10-21T22:04:12.413985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-10-21T22:04:12.414073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-10-21T22:04:12.414142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-10-21T22:04:12.414260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-10-21T22:04:12.414351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-10-21T22:04:12.414436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-10-21T22:04:12.414534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-10-21T22:04:12.414601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-10-21T22:04:12.414710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-10-21T22:04:12.414799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-10-21T22:04:12.414865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-10-21T22:04:12.414931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-10-21T22:04:12.415011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-10-21T22:04:12.415112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-10-21T22:04:12.415183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-10-21T22:04:12.415255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-10-21T22:04:12.415320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-10-21T22:04:12.415384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-10-21T22:04:12.415448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-10-21T22:04:12.415510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-10-21T22:04:12.415574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-10-21T22:04:12.415637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-10-21T22:04:12.415766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-10-21T22:04:12.415851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-10-21T22:04:12.415914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-10-21T22:04:12.415978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-10-21T22:04:12.416042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-10-21T22:04:12.416145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-10-21T22:04:12.416249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-10-21T22:04:12.416315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-10-21T22:04:12.416396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-10-21T22:04:12.416484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-10-21T22:04:12.416565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-10-21T22:04:12.416781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-10-21T22:04:12.416891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-10-21T22:04:12.416957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-10-21T22:04:12.417026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-10-21T22:04:12.417090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-10-21T22:04:12.417184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-10-21T22:04:12.417284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-10-21T22:04:12.417355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-10-21T22:04:12.417441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-10-21T22:04:12.417538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-10-21T22:04:12.417619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-10-21T22:04:12.417756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-10-21T22:04:12.417845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-10-21T22:04:12.417930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-10-21T22:04:12.417994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-10-21T22:04:12.418059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-10-21T22:04:12.418133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-10-21T22:04:12.418299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-10-21T22:04:12.418410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-10-21T22:04:12.418516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-10-21T22:04:12.418603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-10-21T22:04:12.418719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-10-21T22:04:12.418818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-10-21T22:04:12.418884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-10-21T22:04:12.418949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-10-21T22:04:12.419026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-10-21T22:04:12.419090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-10-21T22:04:12.419152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-10-21T22:04:12.419213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-10-21T22:04:12.419274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-10-21T22:04:12.419350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-10-21T22:04:12.419468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-10-21T22:04:12.419537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-10-21T22:04:12.419613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-10-21T22:04:12.419757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-10-21T22:04:12.419847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-10-21T22:04:12.419926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-10-21T22:04:12.420001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-10-21T22:04:12.420069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-10-21T22:04:12.420145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-10-21T22:04:12.420226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-10-21T22:04:12.420360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-10-21T22:04:12.420449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-10-21T22:04:12.420566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-10-21T22:04:12.420633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-10-21T22:04:12.420760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-10-21T22:04:12.420840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-10-21T22:04:12.420914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-10-21T22:04:12.420997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-10-21T22:04:12.421103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-10-21T22:04:12.421179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-10-21T22:04:12.421251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-10-21T22:04:12.421324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-10-21T22:04:12.421389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-10-21T22:04:12.421453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-10-21T22:04:12.421558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-10-21T22:04:12.421693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-10-21T22:04:12.421796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-10-21T22:04:12.421882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-10-21T22:04:12.421953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-10-21T22:04:12.422019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-10-21T22:04:12.422096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-10-21T22:04:12.422166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-10-21T22:04:12.422228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-10-21T22:04:12.422300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-10-21T22:04:12.422386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-10-21T22:04:12.422487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-10-21T22:04:12.422559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-10-21T22:04:12.422682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-10-21T22:04:12.422784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-10-21T22:04:12.422857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-10-21T22:04:12.422940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-10-21T22:04:12.423008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-10-21T22:04:12.423112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-10-21T22:04:12.423202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-10-21T22:04:12.423303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-10-21T22:04:12.423394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-10-21T22:04:12.423467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-10-21T22:04:12.423534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-10-21T22:04:12.423599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-10-21T22:04:12.423720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-10-21T22:04:12.423818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-10-21T22:04:12.423887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-10-21T22:04:12.423969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-10-21T22:04:12.424074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-10-21T22:04:12.424148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-10-21T22:04:12.424214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-10-21T22:04:12.424290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-10-21T22:04:12.424353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-10-21T22:04:12.424432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-10-21T22:04:12.424513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-10-21T22:04:12.424581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-10-21T22:04:12.424921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-10-21T22:04:12.425024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-10-21T22:04:12.425112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-10-21T22:04:12.425183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-10-21T22:04:12.425250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-10-21T22:04:12.425319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-10-21T22:04:12.425390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-10-21T22:04:12.425459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-10-21T22:04:12.425522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-10-21T22:04:12.425587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-10-21T22:04:12.425682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-10-21T22:04:12.425777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-10-21T22:04:12.425849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-10-21T22:04:12.425963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-10-21T22:04:12.426058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-10-21T22:04:12.426128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-10-21T22:04:12.426194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-10-21T22:04:12.426259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-10-21T22:04:12.426323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-10-21T22:04:12.426404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-10-21T22:04:12.426527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-10-21T22:04:12.426605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-10-21T22:04:12.426708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-10-21T22:04:12.426828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-10-21T22:04:12.426937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-10-21T22:04:12.427063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-10-21T22:04:12.427151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-10-21T22:04:12.427217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-10-21T22:04:12.427319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-10-21T22:04:12.427412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-10-21T22:04:12.427481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-10-21T22:04:12.427558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-10-21T22:04:12.427627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-10-21T22:04:12.427772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-10-21T22:04:12.427859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-10-21T22:04:12.427925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-10-21T22:04:12.427993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-10-21T22:04:12.428101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-10-21T22:04:12.428191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-10-21T22:04:12.428314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-10-21T22:04:12.428383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-10-21T22:04:12.428480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-10-21T22:04:12.428567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-10-21T22:04:12.428793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-10-21T22:04:12.428889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-10-21T22:04:12.428966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-10-21T22:04:12.429030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-10-21T22:04:12.429096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-10-21T22:04:12.429223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-10-21T22:04:12.429307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-10-21T22:04:12.429376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-10-21T22:04:12.429481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-10-21T22:04:12.429573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-10-21T22:04:12.429675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-10-21T22:04:12.429784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-10-21T22:04:12.429853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-10-21T22:04:12.429928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-10-21T22:04:12.430003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-10-21T22:04:12.430076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-10-21T22:04:12.430151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-10-21T22:04:12.430249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-10-21T22:04:12.430356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-10-21T22:04:12.430507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-10-21T22:04:12.430588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-10-21T22:04:12.430682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-10-21T22:04:12.430788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-10-21T22:04:12.430872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-10-21T22:04:12.430937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-10-21T22:04:12.431000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-10-21T22:04:12.431071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-10-21T22:04:12.431139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-10-21T22:04:12.431202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-10-21T22:04:12.431268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-10-21T22:04:12.431373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-10-21T22:04:12.431470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-10-21T22:04:12.431543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-10-21T22:04:12.431623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-10-21T22:04:12.431736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-10-21T22:04:12.431814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-10-21T22:04:12.431880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-10-21T22:04:12.431959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-10-21T22:04:12.432048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-10-21T22:04:12.432137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-10-21T22:04:12.432202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-10-21T22:04:12.432295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-10-21T22:04:12.432432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-10-21T22:04:12.432522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APAM.csv [2025-10-21T22:04:12.432588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-10-21T22:04:12.432683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-10-21T22:04:12.432791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETSY.csv [2025-10-21T22:04:12.432901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-10-21T22:04:12.433017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-10-21T22:04:12.433090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-10-21T22:04:12.433155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-10-21T22:04:12.433240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-10-21T22:04:12.433343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-10-21T22:04:12.433407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-10-21T22:04:12.433494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-10-21T22:04:12.433587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-10-21T22:04:12.433799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-10-21T22:04:12.433938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-10-21T22:04:12.434005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-10-21T22:04:12.434070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-10-21T22:04:12.434148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-10-21T22:04:12.434211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-10-21T22:04:12.434273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-10-21T22:04:12.434336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-10-21T22:04:12.434414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-10-21T22:04:12.434480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-10-21T22:04:12.434555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-10-21T22:04:12.434690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-10-21T22:04:12.434783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-10-21T22:04:12.434864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-10-21T22:04:12.434942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-10-21T22:04:12.435006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-10-21T22:04:12.435082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-10-21T22:04:12.435143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-10-21T22:04:12.435205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-10-21T22:04:12.435270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-10-21T22:04:12.435335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-10-21T22:04:12.435428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-10-21T22:04:12.435530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-10-21T22:04:12.435595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-10-21T22:04:12.435714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-10-21T22:04:12.435817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-10-21T22:04:12.435897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-10-21T22:04:12.435961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-10-21T22:04:12.436037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-10-21T22:04:12.436112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-10-21T22:04:12.436176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-10-21T22:04:12.436265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-10-21T22:04:12.436366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-10-21T22:04:12.436459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-10-21T22:04:12.436535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-10-21T22:04:12.436598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-10-21T22:04:12.436700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-10-21T22:04:12.436813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-10-21T22:04:12.436894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-10-21T22:04:12.436960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-10-21T22:04:12.437038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-10-21T22:04:12.437101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-10-21T22:04:12.437177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-10-21T22:04:12.437252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-10-21T22:04:12.437314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-10-21T22:04:12.437376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-10-21T22:04:12.437439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-10-21T22:04:12.437509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-10-21T22:04:12.437587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-10-21T22:04:12.437770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-10-21T22:04:12.437903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-10-21T22:04:12.437995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-10-21T22:04:12.438067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-10-21T22:04:12.438148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-10-21T22:04:12.438211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-10-21T22:04:12.438278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-10-21T22:04:12.438344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-10-21T22:04:12.438409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-10-21T22:04:12.438477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-10-21T22:04:12.438542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-10-21T22:04:12.438617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-10-21T22:04:12.438719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-10-21T22:04:12.438816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-10-21T22:04:12.438942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-10-21T22:04:12.439036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-10-21T22:04:12.439106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-10-21T22:04:12.439172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-10-21T22:04:12.439249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-10-21T22:04:12.439329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-10-21T22:04:12.439393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-10-21T22:04:12.439461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-10-21T22:04:12.439526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-10-21T22:04:12.439588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-10-21T22:04:12.439686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-10-21T22:04:12.439784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-10-21T22:04:12.439853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-10-21T22:04:12.439927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-10-21T22:04:12.440040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-10-21T22:04:12.440136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-10-21T22:04:12.440226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-10-21T22:04:12.440295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-10-21T22:04:12.440359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-10-21T22:04:12.440424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-10-21T22:04:12.440490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-10-21T22:04:12.440551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-10-21T22:04:12.440623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-10-21T22:04:12.440745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-10-21T22:04:12.440822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-10-21T22:04:12.440901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-10-21T22:04:12.440977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-10-21T22:04:12.441038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-10-21T22:04:12.441151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-10-21T22:04:12.441240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-10-21T22:04:12.441314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-10-21T22:04:12.441382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-10-21T22:04:12.441448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-10-21T22:04:12.441514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-10-21T22:04:12.441580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-10-21T22:04:12.441755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-10-21T22:04:12.441850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-10-21T22:04:12.441931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-10-21T22:04:12.441995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-10-21T22:04:12.442072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-10-21T22:04:12.442153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-10-21T22:04:12.442274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-10-21T22:04:12.442349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-10-21T22:04:12.442412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-10-21T22:04:12.442477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-10-21T22:04:12.442543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-10-21T22:04:12.442623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-10-21T22:04:12.442728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-10-21T22:04:12.442806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-10-21T22:04:12.442876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-10-21T22:04:12.442954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-10-21T22:04:12.443019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-10-21T22:04:12.443096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-10-21T22:04:12.443174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-10-21T22:04:12.443288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-10-21T22:04:12.443434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-10-21T22:04:12.443557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-10-21T22:04:12.443710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-10-21T22:04:12.443820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-10-21T22:04:12.443940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-10-21T22:04:12.444068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-10-21T22:04:12.444164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-10-21T22:04:12.444270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-10-21T22:04:12.444388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-10-21T22:04:12.444504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-10-21T22:04:12.444592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-10-21T22:04:12.444742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-10-21T22:04:12.444859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-10-21T22:04:12.444949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-10-21T22:04:12.445031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-10-21T22:04:12.445114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-10-21T22:04:12.445257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-10-21T22:04:12.445367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-10-21T22:04:12.445450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-10-21T22:04:12.445546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-10-21T22:04:12.445627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-10-21T22:04:12.445766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-10-21T22:04:12.445875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-10-21T22:04:12.445974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-10-21T22:04:12.446061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-10-21T22:04:12.446169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-10-21T22:04:12.446293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-10-21T22:04:12.446395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-10-21T22:04:12.446477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-10-21T22:04:12.446570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-10-21T22:04:12.446810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-10-21T22:04:12.446955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-10-21T22:04:12.447039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-10-21T22:04:12.447149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-10-21T22:04:12.447276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-10-21T22:04:12.447400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-10-21T22:04:12.447498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-10-21T22:04:12.447588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-10-21T22:04:12.447731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-10-21T22:04:12.447838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-10-21T22:04:12.447923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-10-21T22:04:12.448025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-10-21T22:04:12.448139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-10-21T22:04:12.448261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-10-21T22:04:12.448373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-10-21T22:04:12.448481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-10-21T22:04:12.448563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-10-21T22:04:12.448671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-10-21T22:04:12.448801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-10-21T22:04:12.448910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-10-21T22:04:12.449010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-10-21T22:04:12.449106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-10-21T22:04:12.449250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-10-21T22:04:12.449388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-10-21T22:04:12.449522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-10-21T22:04:12.449689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-10-21T22:04:12.449838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-10-21T22:04:12.449984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-10-21T22:04:12.450132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-10-21T22:04:12.450286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-10-21T22:04:12.450418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-10-21T22:04:12.450564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-10-21T22:04:12.450728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-10-21T22:04:12.450860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-10-21T22:04:12.450994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-10-21T22:04:12.451139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-10-21T22:04:12.451275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-10-21T22:04:12.451428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-10-21T22:04:12.451559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-10-21T22:04:12.451719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-10-21T22:04:12.451849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-10-21T22:04:12.451980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-10-21T22:04:12.452102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-10-21T22:04:12.452247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-10-21T22:04:12.452373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-10-21T22:04:12.452524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-10-21T22:04:12.452697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-10-21T22:04:12.452825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-10-21T22:04:12.452937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-10-21T22:04:12.453058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-10-21T22:04:12.453162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-10-21T22:04:12.453289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-10-21T22:04:12.453388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-10-21T22:04:12.453476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-10-21T22:04:12.453576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-10-21T22:04:12.453734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-10-21T22:04:12.453857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-10-21T22:04:12.454012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-10-21T22:04:12.454129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-10-21T22:04:12.454273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-10-21T22:04:12.454384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-10-21T22:04:12.454503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-10-21T22:04:12.454606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-10-21T22:04:12.454872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-10-21T22:04:12.454974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-10-21T22:04:12.455058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-10-21T22:04:12.455171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-10-21T22:04:12.455299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-10-21T22:04:12.455386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-10-21T22:04:12.455469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-10-21T22:04:12.455579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-10-21T22:04:12.455727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-10-21T22:04:12.455836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-10-21T22:04:12.456024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-10-21T22:04:12.456156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-10-21T22:04:12.456267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-10-21T22:04:12.456352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-10-21T22:04:12.456436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-10-21T22:04:12.456517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-10-21T22:04:12.456598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-10-21T22:04:12.456728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-10-21T22:04:12.456840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-10-21T22:04:12.456942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-10-21T22:04:12.457045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-10-21T22:04:12.457133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-10-21T22:04:12.457285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-10-21T22:04:12.457392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-10-21T22:04:12.457494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-10-21T22:04:12.457578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-10-21T22:04:12.457752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-10-21T22:04:12.457874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-10-21T22:04:12.457980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-10-21T22:04:12.458062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-10-21T22:04:12.458153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-10-21T22:04:12.458271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-10-21T22:04:12.458397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-10-21T22:04:12.458535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-10-21T22:04:12.458622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-10-21T22:04:12.458782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-10-21T22:04:12.458876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-10-21T22:04:12.458956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-10-21T22:04:12.459037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-10-21T22:04:12.459126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-10-21T22:04:12.459259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-10-21T22:04:12.459371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-10-21T22:04:12.459481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-10-21T22:04:12.459565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-10-21T22:04:12.459684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-10-21T22:04:12.459794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-10-21T22:04:12.459888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-10-21T22:04:12.459990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-10-21T22:04:12.460081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-10-21T22:04:12.460199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-10-21T22:04:12.460308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-10-21T22:04:12.460389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-10-21T22:04:12.460470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-10-21T22:04:12.460553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-10-21T22:04:12.460668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-10-21T22:04:12.460827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-10-21T22:04:12.460932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-10-21T22:04:12.461011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-10-21T22:04:12.461108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-10-21T22:04:12.461217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-10-21T22:04:12.461308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-10-21T22:04:12.461404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-10-21T22:04:12.461483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-10-21T22:04:12.461570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-10-21T22:04:12.461691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-10-21T22:04:12.461841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-10-21T22:04:12.461934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-10-21T22:04:12.462028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-10-21T22:04:12.462109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-10-21T22:04:12.462219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-10-21T22:04:12.462357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-10-21T22:04:12.462463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-10-21T22:04:12.462543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-10-21T22:04:12.462630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-10-21T22:04:12.462904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-10-21T22:04:12.463017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-10-21T22:04:12.463102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-10-21T22:04:12.463218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-10-21T22:04:12.463316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-10-21T22:04:12.463419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-10-21T22:04:12.463521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-10-21T22:04:12.463604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-10-21T22:04:12.463750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-10-21T22:04:12.463852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-10-21T22:04:12.463932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-10-21T22:04:12.464025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-10-21T22:04:12.464107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-10-21T22:04:12.464242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-10-21T22:04:12.464339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-10-21T22:04:12.464422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-10-21T22:04:12.464504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-10-21T22:04:12.464608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-10-21T22:04:12.464750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-10-21T22:04:12.464845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-10-21T22:04:12.464926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-10-21T22:04:12.465006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-10-21T22:04:12.465091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-10-21T22:04:12.465218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-10-21T22:04:12.465338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-10-21T22:04:12.465428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-10-21T22:04:12.465528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-10-21T22:04:12.465626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-10-21T22:04:12.465784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-10-21T22:04:12.465907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-10-21T22:04:12.465999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-10-21T22:04:12.466134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-10-21T22:04:12.466271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-10-21T22:04:12.466376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-10-21T22:04:12.466461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-10-21T22:04:12.466545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-10-21T22:04:12.466628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-10-21T22:04:12.466775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-10-21T22:04:12.466869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-10-21T22:04:12.466972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-10-21T22:04:12.467058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-10-21T22:04:12.467153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-10-21T22:04:12.467261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-10-21T22:04:12.467367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-10-21T22:04:12.467478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-10-21T22:04:12.467564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-10-21T22:04:12.467844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-10-21T22:04:12.468230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-10-21T22:04:12.468402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-10-21T22:04:12.468556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-10-21T22:04:12.468724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-10-21T22:04:12.468820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-10-21T22:04:12.468945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-10-21T22:04:12.469037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-10-21T22:04:12.469112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-10-21T22:04:12.469214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-10-21T22:04:12.469281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-10-21T22:04:12.469345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-10-21T22:04:12.469408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-10-21T22:04:12.469474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-10-21T22:04:12.469539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-10-21T22:04:12.469625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-10-21T22:04:12.469798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-10-21T22:04:12.469877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-10-21T22:04:12.469944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-10-21T22:04:12.470017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-10-21T22:04:12.470086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-10-21T22:04:12.470174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-10-21T22:04:12.470256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-10-21T22:04:12.470349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-10-21T22:04:12.470421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-10-21T22:04:12.470485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-10-21T22:04:12.470553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-10-21T22:04:12.470623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-10-21T22:04:12.470878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-10-21T22:04:12.470956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-10-21T22:04:12.471024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-10-21T22:04:12.471088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-10-21T22:04:12.471153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-10-21T22:04:12.471230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-10-21T22:04:12.471297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-10-21T22:04:12.471359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-10-21T22:04:12.471421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-10-21T22:04:12.471485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-10-21T22:04:12.471554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-10-21T22:04:12.471629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-10-21T22:04:12.471764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-10-21T22:04:12.471855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-10-21T22:04:12.471934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-10-21T22:04:12.471999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-10-21T22:04:12.472084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-10-21T22:04:12.472194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-10-21T22:04:12.472265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-10-21T22:04:12.472336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-10-21T22:04:12.472400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-10-21T22:04:12.472460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-10-21T22:04:12.472522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-10-21T22:04:12.472585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-10-21T22:04:12.472682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-10-21T22:04:12.472774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-10-21T22:04:12.472841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-10-21T22:04:12.472906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-10-21T22:04:12.472982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-10-21T22:04:12.473045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-10-21T22:04:12.473108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-10-21T22:04:12.473180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-10-21T22:04:12.473243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-10-21T22:04:12.473324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-10-21T22:04:12.473411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-10-21T22:04:12.473478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-10-21T22:04:12.473542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-10-21T22:04:12.473618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-10-21T22:04:12.473739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-10-21T22:04:12.473829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-10-21T22:04:12.473898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-10-21T22:04:12.473965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-10-21T22:04:12.474029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-10-21T22:04:12.474089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-10-21T22:04:12.474179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-10-21T22:04:12.474249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-10-21T22:04:12.474316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-10-21T22:04:12.474395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-10-21T22:04:12.474474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-10-21T22:04:12.474537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-10-21T22:04:12.474604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-10-21T22:04:12.474708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-10-21T22:04:12.474810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-10-21T22:04:12.474877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-10-21T22:04:12.474942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-10-21T22:04:12.475009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-10-21T22:04:12.475087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-10-21T22:04:12.475150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-10-21T22:04:12.475227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-10-21T22:04:12.475344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-10-21T22:04:12.475424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-10-21T22:04:12.475489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-10-21T22:04:12.475557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-10-21T22:04:12.475623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-10-21T22:04:12.475732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-10-21T22:04:12.475815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-10-21T22:04:12.475882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-10-21T22:04:12.475946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-10-21T22:04:12.476010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-10-21T22:04:12.476076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-10-21T22:04:12.476146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-10-21T22:04:12.476226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-10-21T22:04:12.476310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-10-21T22:04:12.476399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-10-21T22:04:12.476482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-10-21T22:04:12.476559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-10-21T22:04:12.476623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-10-21T22:04:12.476745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-10-21T22:04:12.476827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-10-21T22:04:12.476909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-10-21T22:04:12.476988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-10-21T22:04:12.477052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-10-21T22:04:12.477117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-10-21T22:04:12.477179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-10-21T22:04:12.477242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-10-21T22:04:12.477320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-10-21T22:04:12.477398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-10-21T22:04:12.477474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-10-21T22:04:12.477540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-10-21T22:04:12.477617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-10-21T22:04:12.477748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-10-21T22:04:12.477854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-10-21T22:04:12.477933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-10-21T22:04:12.477998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-10-21T22:04:12.478074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-10-21T22:04:12.478139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-10-21T22:04:12.478218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-10-21T22:04:12.478290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-10-21T22:04:12.478382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-10-21T22:04:12.478447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-10-21T22:04:12.478511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-10-21T22:04:12.478585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-10-21T22:04:12.478813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-10-21T22:04:12.478925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-10-21T22:04:12.478994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-10-21T22:04:12.479058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-10-21T22:04:12.479121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-10-21T22:04:12.479192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-10-21T22:04:12.479260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-10-21T22:04:12.479324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-10-21T22:04:12.479386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-10-21T22:04:12.479453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-10-21T22:04:12.479531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-10-21T22:04:12.479607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-10-21T22:04:12.479713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-10-21T22:04:12.479801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-10-21T22:04:12.479865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-10-21T22:04:12.479928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-10-21T22:04:12.479991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-10-21T22:04:12.480054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-10-21T22:04:12.480121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-10-21T22:04:12.480193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-10-21T22:04:12.480256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-10-21T22:04:12.480333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-10-21T22:04:12.480395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-10-21T22:04:12.480471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-10-21T22:04:12.480543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-10-21T22:04:12.480607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-10-21T22:04:12.480704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-10-21T22:04:12.480799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-10-21T22:04:12.480920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-10-21T22:04:12.480992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-10-21T22:04:12.481056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-10-21T22:04:12.481154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-10-21T22:04:12.481254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-10-21T22:04:12.481323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-10-21T22:04:12.481402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-10-21T22:04:12.481466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-10-21T22:04:12.481527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-10-21T22:04:12.481587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-10-21T22:04:12.481680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-10-21T22:04:12.481792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-10-21T22:04:12.481857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-10-21T22:04:12.481936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-10-21T22:04:12.482013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-10-21T22:04:12.482100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-10-21T22:04:12.482171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-10-21T22:04:12.482243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-10-21T22:04:12.482307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-10-21T22:04:12.482372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-10-21T22:04:12.482447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-10-21T22:04:12.482509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-10-21T22:04:12.482570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-10-21T22:04:12.482632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-10-21T22:04:12.482744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-10-21T22:04:12.482815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-10-21T22:04:12.482882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-10-21T22:04:12.482949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-10-21T22:04:12.483017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-10-21T22:04:12.483087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-10-21T22:04:12.483169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-10-21T22:04:12.483256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-10-21T22:04:12.483338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-10-21T22:04:12.483405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-10-21T22:04:12.483469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-10-21T22:04:12.483538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-10-21T22:04:12.483613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-10-21T22:04:12.483727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-10-21T22:04:12.483811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-10-21T22:04:12.483877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-10-21T22:04:12.483954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-10-21T22:04:12.484030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-10-21T22:04:12.484094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-10-21T22:04:12.484167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-10-21T22:04:12.484242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-10-21T22:04:12.484315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-10-21T22:04:12.484381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-10-21T22:04:12.484444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-10-21T22:04:12.484521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-10-21T22:04:12.484592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-10-21T22:04:12.484703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-10-21T22:04:12.484823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-10-21T22:04:12.484892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-10-21T22:04:12.484956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-10-21T22:04:12.485028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-10-21T22:04:12.485091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-10-21T22:04:12.485167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-10-21T22:04:12.485231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-10-21T22:04:12.485308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-10-21T22:04:12.485372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-10-21T22:04:12.485448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-10-21T22:04:12.485511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-10-21T22:04:12.485587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-10-21T22:04:12.485703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-10-21T22:04:12.485798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-10-21T22:04:12.485877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-10-21T22:04:12.485956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-10-21T22:04:12.486021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-10-21T22:04:12.486095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-10-21T22:04:12.486155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-10-21T22:04:12.486216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-10-21T22:04:12.486321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-10-21T22:04:12.486407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-10-21T22:04:12.486472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-10-21T22:04:12.486537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-10-21T22:04:12.486601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-10-21T22:04:12.486809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-10-21T22:04:12.486902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-10-21T22:04:12.486972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-10-21T22:04:12.487038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-10-21T22:04:12.487101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-10-21T22:04:12.487179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-10-21T22:04:12.487241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-10-21T22:04:12.487319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-10-21T22:04:12.487383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-10-21T22:04:12.487462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-10-21T22:04:12.487549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-10-21T22:04:12.487615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-10-21T22:04:12.487732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-10-21T22:04:12.487812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-10-21T22:04:12.487878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-10-21T22:04:12.487947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-10-21T22:04:12.488028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-10-21T22:04:12.488095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-10-21T22:04:12.488158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-10-21T22:04:12.488221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-10-21T22:04:12.488282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-10-21T22:04:12.488346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-10-21T22:04:12.488408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-10-21T22:04:12.488470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-10-21T22:04:12.488548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-10-21T22:04:12.488611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-10-21T22:04:12.488714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-10-21T22:04:12.488816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-10-21T22:04:12.488882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-10-21T22:04:12.488945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-10-21T22:04:12.489008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-10-21T22:04:12.489070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-10-21T22:04:12.489146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-10-21T22:04:12.489213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-10-21T22:04:12.489277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-10-21T22:04:12.489338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-10-21T22:04:12.489400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-10-21T22:04:12.489483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-10-21T22:04:12.489559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-10-21T22:04:12.489634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-10-21T22:04:12.489757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-10-21T22:04:12.489827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-10-21T22:04:12.489890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-10-21T22:04:12.489952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-10-21T22:04:12.490011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-10-21T22:04:12.490081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-10-21T22:04:12.490142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-10-21T22:04:12.490203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-10-21T22:04:12.490277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-10-21T22:04:12.490339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-10-21T22:04:12.490414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-10-21T22:04:12.490476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-10-21T22:04:12.490552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-10-21T22:04:12.490613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-10-21T22:04:12.490712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-10-21T22:04:12.490799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-10-21T22:04:12.490886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-10-21T22:04:12.490951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-10-21T22:04:12.491028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-10-21T22:04:12.491110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-10-21T22:04:12.491172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-10-21T22:04:12.491244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-10-21T22:04:12.491320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-10-21T22:04:12.491383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-10-21T22:04:12.491455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-10-21T22:04:12.491524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-10-21T22:04:12.491633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-10-21T22:04:12.491759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-10-21T22:04:12.491828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-10-21T22:04:12.491895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-10-21T22:04:12.491975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-10-21T22:04:12.492044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-10-21T22:04:12.492107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-10-21T22:04:12.492185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-10-21T22:04:12.492252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-10-21T22:04:12.492319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-10-21T22:04:12.492381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-10-21T22:04:12.492445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-10-21T22:04:12.492507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-10-21T22:04:12.492585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-10-21T22:04:12.492694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-10-21T22:04:12.492792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-10-21T22:04:12.492860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-10-21T22:04:12.492924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-10-21T22:04:12.493007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-10-21T22:04:12.493071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-10-21T22:04:12.493148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-10-21T22:04:12.493227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-10-21T22:04:12.493291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-10-21T22:04:12.493353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-10-21T22:04:12.493422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-10-21T22:04:12.493486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-10-21T22:04:12.493547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-10-21T22:04:12.493629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-10-21T22:04:12.493749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-10-21T22:04:12.493830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-10-21T22:04:12.493911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-10-21T22:04:12.493981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-10-21T22:04:12.494044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-10-21T22:04:12.494110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-10-21T22:04:12.494172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-10-21T22:04:12.494249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-10-21T22:04:12.494313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-10-21T22:04:12.494389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-10-21T22:04:12.494466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-10-21T22:04:12.494530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-10-21T22:04:12.494608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-10-21T22:04:12.494842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-10-21T22:04:12.494944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-10-21T22:04:12.495025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-10-21T22:04:12.495089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-10-21T22:04:12.495152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-10-21T22:04:12.495229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-10-21T22:04:12.495309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-10-21T22:04:12.495373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-10-21T22:04:12.495443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-10-21T22:04:12.495512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-10-21T22:04:12.495574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-10-21T22:04:12.495673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-10-21T22:04:12.495778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-10-21T22:04:12.495844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-10-21T22:04:12.495915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-10-21T22:04:12.495978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-10-21T22:04:12.496047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-10-21T22:04:12.496122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-10-21T22:04:12.496186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-10-21T22:04:12.496262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-10-21T22:04:12.496440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-10-21T22:04:12.496514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-10-21T22:04:12.496576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-10-21T22:04:12.496638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-10-21T22:04:12.496785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-10-21T22:04:12.496874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-10-21T22:04:12.496953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-10-21T22:04:12.497022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-10-21T22:04:12.497097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-10-21T22:04:12.497161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-10-21T22:04:12.497270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-10-21T22:04:12.497341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-10-21T22:04:12.497414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-10-21T22:04:12.497489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-10-21T22:04:12.497551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-10-21T22:04:12.497621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-10-21T22:04:12.497740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-10-21T22:04:12.497821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-10-21T22:04:12.497886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-10-21T22:04:12.497948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-10-21T22:04:12.498010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-10-21T22:04:12.498074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-10-21T22:04:12.498136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-10-21T22:04:12.498233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-10-21T22:04:12.498319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-10-21T22:04:12.498400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-10-21T22:04:12.498465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-10-21T22:04:12.498543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-10-21T22:04:12.498614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-10-21T22:04:12.498717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-10-21T22:04:12.498797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-10-21T22:04:12.498860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-10-21T22:04:12.498922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-10-21T22:04:12.498986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-10-21T22:04:12.499047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-10-21T22:04:12.499148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-10-21T22:04:12.499235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-10-21T22:04:12.499298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-10-21T22:04:12.499360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-10-21T22:04:12.499433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-10-21T22:04:12.499496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-10-21T22:04:12.499558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-10-21T22:04:12.499627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-10-21T22:04:12.499758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-10-21T22:04:12.499846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-10-21T22:04:12.499913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-10-21T22:04:12.499988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-10-21T22:04:12.500062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-10-21T22:04:12.500134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-10-21T22:04:12.500195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-10-21T22:04:12.500254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-10-21T22:04:12.500334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-10-21T22:04:12.500413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-10-21T22:04:12.500492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-10-21T22:04:12.500570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-10-21T22:04:12.500639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-10-21T22:04:12.500757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-10-21T22:04:12.500843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-10-21T22:04:12.500935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-10-21T22:04:12.501001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-10-21T22:04:12.501081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-10-21T22:04:12.501148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-10-21T22:04:12.501210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-10-21T22:04:12.501289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-10-21T22:04:12.501374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-10-21T22:04:12.501439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-10-21T22:04:12.501500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-10-21T22:04:12.501578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-10-21T22:04:12.501694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-10-21T22:04:12.501799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-10-21T22:04:12.501869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-10-21T22:04:12.501934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-10-21T22:04:12.502005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-10-21T22:04:12.502069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-10-21T22:04:12.502144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-10-21T22:04:12.502221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-10-21T22:04:12.502293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-10-21T22:04:12.502445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-10-21T22:04:12.502509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-10-21T22:04:12.502574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-10-21T22:04:12.502783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-10-21T22:04:12.502937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-10-21T22:04:12.503041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-10-21T22:04:12.503109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-10-21T22:04:12.503175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-10-21T22:04:12.503240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-10-21T22:04:12.503305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-10-21T22:04:12.503368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-10-21T22:04:12.503434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-10-21T22:04:12.503495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-10-21T22:04:12.503572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-10-21T22:04:12.503673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-10-21T22:04:12.503779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-10-21T22:04:12.503848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-10-21T22:04:12.503927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-10-21T22:04:12.504009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-10-21T22:04:12.504074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-10-21T22:04:12.504141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-10-21T22:04:12.504207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-10-21T22:04:12.504275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-10-21T22:04:12.504340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-10-21T22:04:12.504406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-10-21T22:04:12.504468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-10-21T22:04:12.504532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-10-21T22:04:12.504606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-10-21T22:04:12.504709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-10-21T22:04:12.504799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-10-21T22:04:12.504878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-10-21T22:04:12.504941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCD.csv [2025-10-21T22:04:12.505003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-10-21T22:04:12.505065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-10-21T22:04:12.505125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-10-21T22:04:12.505200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-10-21T22:04:12.505275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-10-21T22:04:12.505345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-10-21T22:04:12.505405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-10-21T22:04:12.505466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-10-21T22:04:12.505526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-10-21T22:04:12.505593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-10-21T22:04:12.505700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-10-21T22:04:12.505793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-10-21T22:04:12.505858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-10-21T22:04:12.505935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-10-21T22:04:12.505996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-10-21T22:04:12.506057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-10-21T22:04:12.506125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-10-21T22:04:12.506187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-10-21T22:04:12.506300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-10-21T22:04:12.506362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-10-21T22:04:12.506423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-10-21T22:04:12.506483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-10-21T22:04:12.506544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-10-21T22:04:12.506619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-10-21T22:04:12.506729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-10-21T22:04:12.506808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-10-21T22:04:12.506879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-10-21T22:04:12.506940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-10-21T22:04:12.507001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-10-21T22:04:12.507061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-10-21T22:04:12.507126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-10-21T22:04:12.507199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-10-21T22:04:12.507260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-10-21T22:04:12.507319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-10-21T22:04:12.507382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-10-21T22:04:12.507450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-10-21T22:04:12.507511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-10-21T22:04:12.507570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-10-21T22:04:12.507679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-10-21T22:04:12.507788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-10-21T22:04:12.507852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-10-21T22:04:12.507913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-10-21T22:04:12.507974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-10-21T22:04:12.508078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-10-21T22:04:12.508159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-10-21T22:04:12.508230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-10-21T22:04:12.508309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-10-21T22:04:12.508370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-10-21T22:04:12.508437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-10-21T22:04:12.508500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-10-21T22:04:12.508575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-10-21T22:04:12.508672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-10-21T22:04:12.508769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-10-21T22:04:12.508834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-10-21T22:04:12.508899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-10-21T22:04:12.508959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-10-21T22:04:12.509017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-10-21T22:04:12.509076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-10-21T22:04:12.509136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-10-21T22:04:12.509211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-10-21T22:04:12.509280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-10-21T22:04:12.509342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-10-21T22:04:12.509418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-10-21T22:04:12.509495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-10-21T22:04:12.509559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-10-21T22:04:12.509623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-10-21T22:04:12.509734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-10-21T22:04:12.509813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-10-21T22:04:12.509892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-10-21T22:04:12.509958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-10-21T22:04:12.510022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-10-21T22:04:12.510099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-10-21T22:04:12.510180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-10-21T22:04:12.510242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-10-21T22:04:12.510318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-10-21T22:04:12.510386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-10-21T22:04:12.510451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-10-21T22:04:12.510516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-10-21T22:04:12.510584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-10-21T22:04:12.510791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-10-21T22:04:12.510884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-10-21T22:04:12.510952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-10-21T22:04:12.511031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-10-21T22:04:12.511096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-10-21T22:04:12.511174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-10-21T22:04:12.511238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-10-21T22:04:12.511310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-10-21T22:04:12.511388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-10-21T22:04:12.511465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-10-21T22:04:12.511531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-10-21T22:04:12.511597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-10-21T22:04:12.511687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-10-21T22:04:12.511783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-10-21T22:04:12.511850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-10-21T22:04:12.511916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-10-21T22:04:12.511993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-10-21T22:04:12.512067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-10-21T22:04:12.512136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-10-21T22:04:12.512198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-10-21T22:04:12.512260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-10-21T22:04:12.512322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-10-21T22:04:12.512388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-10-21T22:04:12.512462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-10-21T22:04:12.512523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-10-21T22:04:12.512590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-10-21T22:04:12.512706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-10-21T22:04:12.512851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-10-21T22:04:12.512921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-10-21T22:04:12.513000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-10-21T22:04:12.513064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-10-21T22:04:12.513128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-10-21T22:04:12.513189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-10-21T22:04:12.513252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-10-21T22:04:12.513328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-10-21T22:04:12.513435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-10-21T22:04:12.513508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-10-21T22:04:12.513575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-10-21T22:04:12.513682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-10-21T22:04:12.513781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-10-21T22:04:12.513850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-10-21T22:04:12.513916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-10-21T22:04:12.513977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-10-21T22:04:12.514055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-10-21T22:04:12.514125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-10-21T22:04:12.514195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-10-21T22:04:12.514275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-10-21T22:04:12.514347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-10-21T22:04:12.514413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-10-21T22:04:12.514478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-10-21T22:04:12.514543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-10-21T22:04:12.514605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-10-21T22:04:12.514696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-10-21T22:04:12.514786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-10-21T22:04:12.514864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-10-21T22:04:12.514928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-10-21T22:04:12.514995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-10-21T22:04:12.515059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-10-21T22:04:12.515123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-10-21T22:04:12.515186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-10-21T22:04:12.515263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-10-21T22:04:12.515324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-10-21T22:04:12.515400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-10-21T22:04:12.515475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-10-21T22:04:12.515537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TCBX.csv [2025-10-21T22:04:12.515605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-10-21T22:04:12.515708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-10-21T22:04:12.515796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-10-21T22:04:12.515872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-10-21T22:04:12.515954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-10-21T22:04:12.516030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-10-21T22:04:12.516094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-10-21T22:04:12.516171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-10-21T22:04:12.516239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-10-21T22:04:12.516315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-10-21T22:04:12.516380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-10-21T22:04:12.516456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-10-21T22:04:12.516519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-10-21T22:04:12.516580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-10-21T22:04:12.516663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-10-21T22:04:12.516755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-10-21T22:04:12.516835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-10-21T22:04:12.516898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-10-21T22:04:12.516967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-10-21T22:04:12.517046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-10-21T22:04:12.517127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-10-21T22:04:12.517189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-10-21T22:04:12.517252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-10-21T22:04:12.517314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-10-21T22:04:12.517375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-10-21T22:04:12.517437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-10-21T22:04:12.517499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-10-21T22:04:12.517558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-10-21T22:04:12.517632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-10-21T22:04:12.517792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-10-21T22:04:12.517863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-10-21T22:04:12.517937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-10-21T22:04:12.518014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-10-21T22:04:12.518076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-10-21T22:04:12.518137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-10-21T22:04:12.518204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-10-21T22:04:12.518284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-10-21T22:04:12.518344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-10-21T22:04:12.518406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-10-21T22:04:12.518466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-10-21T22:04:12.518540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-10-21T22:04:12.518781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-10-21T22:04:12.518884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-10-21T22:04:12.518950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-10-21T22:04:12.519013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-10-21T22:04:12.519090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-10-21T22:04:12.519167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-10-21T22:04:12.519228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-10-21T22:04:12.519291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-10-21T22:04:12.519351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-10-21T22:04:12.519411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-10-21T22:04:12.519474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-10-21T22:04:12.519535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPKI.csv [2025-10-21T22:04:12.519610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-10-21T22:04:12.519709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-10-21T22:04:12.519805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-10-21T22:04:12.519883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-10-21T22:04:12.519984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-10-21T22:04:12.520065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-10-21T22:04:12.520147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-10-21T22:04:12.520231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-10-21T22:04:12.520308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-10-21T22:04:12.520372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-10-21T22:04:12.520449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-10-21T22:04:12.520514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-10-21T22:04:12.520576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-10-21T22:04:12.520687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-10-21T22:04:12.520778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-10-21T22:04:12.520846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-10-21T22:04:12.520908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-10-21T22:04:12.520971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-10-21T22:04:12.521031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-10-21T22:04:12.521091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-10-21T22:04:12.521165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-10-21T22:04:12.521226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-10-21T22:04:12.521310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-10-21T22:04:12.521387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-10-21T22:04:12.521447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-10-21T22:04:12.521545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-10-21T22:04:12.521607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-10-21T22:04:12.521726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-10-21T22:04:12.521827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-10-21T22:04:12.521894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-10-21T22:04:12.521966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-10-21T22:04:12.522029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-10-21T22:04:12.522093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-10-21T22:04:12.522170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-10-21T22:04:12.522245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-10-21T22:04:12.522322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-10-21T22:04:12.522396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-10-21T22:04:12.522458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-10-21T22:04:12.522521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-10-21T22:04:12.522589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-10-21T22:04:12.522680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-10-21T22:04:12.522783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-10-21T22:04:12.522871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-10-21T22:04:12.522959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-10-21T22:04:12.523025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-10-21T22:04:12.523099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-10-21T22:04:12.523163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-10-21T22:04:12.523227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-10-21T22:04:12.523288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-10-21T22:04:12.523349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-10-21T22:04:12.523411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-10-21T22:04:12.523486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-10-21T22:04:12.523549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-10-21T22:04:12.523611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-10-21T22:04:12.523709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-10-21T22:04:12.523804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-10-21T22:04:12.523869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-10-21T22:04:12.523934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-10-21T22:04:12.523997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-10-21T22:04:12.524100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-10-21T22:04:12.524170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-10-21T22:04:12.524250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-10-21T22:04:12.524330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-10-21T22:04:12.524424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-10-21T22:04:12.524498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-10-21T22:04:12.524562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-10-21T22:04:12.524634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-10-21T22:04:12.524759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-10-21T22:04:12.524834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-10-21T22:04:12.524913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-10-21T22:04:12.524977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-10-21T22:04:12.525059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-10-21T22:04:12.525136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-10-21T22:04:12.525205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-10-21T22:04:12.525267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-10-21T22:04:12.525328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-10-21T22:04:12.525389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-10-21T22:04:12.525458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-10-21T22:04:12.525519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-10-21T22:04:12.525591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-10-21T22:04:12.525694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-10-21T22:04:12.525782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-10-21T22:04:12.525860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-10-21T22:04:12.525923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-10-21T22:04:12.525999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-10-21T22:04:12.526061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-10-21T22:04:12.526137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-10-21T22:04:12.526240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-10-21T22:04:12.526329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-10-21T22:04:12.526396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-10-21T22:04:12.526471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-10-21T22:04:12.526547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-10-21T22:04:12.526632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-10-21T22:04:12.526852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-10-21T22:04:12.526924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-10-21T22:04:12.526986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-10-21T22:04:12.527047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-10-21T22:04:12.527130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-10-21T22:04:12.527221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-10-21T22:04:12.527301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-10-21T22:04:12.527367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-10-21T22:04:12.527439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-10-21T22:04:12.527499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-10-21T22:04:12.527560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-10-21T22:04:12.527624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-10-21T22:04:12.527765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-10-21T22:04:12.527848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-10-21T22:04:12.527919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-10-21T22:04:12.527981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-10-21T22:04:12.528059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-10-21T22:04:12.528134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-10-21T22:04:12.528208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-10-21T22:04:12.528270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-10-21T22:04:12.528332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-10-21T22:04:12.528394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-10-21T22:04:12.528459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-10-21T22:04:12.528524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-10-21T22:04:12.528585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-10-21T22:04:12.528682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-10-21T22:04:12.528838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-10-21T22:04:12.528910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-10-21T22:04:12.528990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-10-21T22:04:12.529053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-10-21T22:04:12.529119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-10-21T22:04:12.529183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-10-21T22:04:12.529246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-10-21T22:04:12.529305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-10-21T22:04:12.529382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-10-21T22:04:12.529476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-10-21T22:04:12.529564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-10-21T22:04:12.529697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-10-21T22:04:12.529787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-10-21T22:04:12.529854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-10-21T22:04:12.529919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-10-21T22:04:12.529990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-10-21T22:04:12.530051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-10-21T22:04:12.530115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-10-21T22:04:12.530179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-10-21T22:04:12.530244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-10-21T22:04:12.530308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-10-21T22:04:12.530371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-10-21T22:04:12.530450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-10-21T22:04:12.530513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-10-21T22:04:12.530577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-10-21T22:04:12.530638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-10-21T22:04:12.530754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-10-21T22:04:12.530841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-10-21T22:04:12.530914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-10-21T22:04:12.530992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-10-21T22:04:12.531060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-10-21T22:04:12.531123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-10-21T22:04:12.531199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-10-21T22:04:12.531267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-10-21T22:04:12.531329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-10-21T22:04:12.531406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-10-21T22:04:12.531464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-10-21T22:04:12.531527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-10-21T22:04:12.531610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-10-21T22:04:12.531718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-10-21T22:04:12.531806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOA.csv [2025-10-21T22:04:12.531870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-10-21T22:04:12.531945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-10-21T22:04:12.532007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-10-21T22:04:12.532067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-10-21T22:04:12.532128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-10-21T22:04:12.532201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-10-21T22:04:12.532262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-10-21T22:04:12.532327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-10-21T22:04:12.532388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-10-21T22:04:12.532447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-10-21T22:04:12.532515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-10-21T22:04:12.532588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-10-21T22:04:12.532675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-10-21T22:04:12.532771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-10-21T22:04:12.532846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-10-21T22:04:12.532910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-10-21T22:04:12.532982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-10-21T22:04:12.533041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-10-21T22:04:12.533105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-10-21T22:04:12.533166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-10-21T22:04:12.533240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-10-21T22:04:12.533317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-10-21T22:04:12.533378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-10-21T22:04:12.533444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-10-21T22:04:12.533506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-10-21T22:04:12.533566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-10-21T22:04:12.533668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-10-21T22:04:12.533766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-10-21T22:04:12.533837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-10-21T22:04:12.533902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-10-21T22:04:12.533962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-10-21T22:04:12.534053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-10-21T22:04:12.534113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-10-21T22:04:12.534172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-10-21T22:04:12.534247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-10-21T22:04:12.534314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-10-21T22:04:12.534379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-10-21T22:04:12.534440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-10-21T22:04:12.534507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-10-21T22:04:12.534570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-10-21T22:04:12.534788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-10-21T22:04:12.534900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-10-21T22:04:12.534981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-10-21T22:04:12.535044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-10-21T22:04:12.535108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-10-21T22:04:12.535174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-10-21T22:04:12.535240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-10-21T22:04:12.535306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-10-21T22:04:12.535372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-10-21T22:04:12.535437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-10-21T22:04:12.535510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-10-21T22:04:12.535574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-10-21T22:04:12.535676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-10-21T22:04:12.535767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-10-21T22:04:12.535833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-10-21T22:04:12.535903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-10-21T22:04:12.535967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-10-21T22:04:12.536032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-10-21T22:04:12.536096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-10-21T22:04:12.536157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-10-21T22:04:12.536220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-10-21T22:04:12.536292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-10-21T22:04:12.536372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-10-21T22:04:12.536437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-10-21T22:04:12.536502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-10-21T22:04:12.536566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-10-21T22:04:12.536669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-10-21T22:04:12.536765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-10-21T22:04:12.536845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-10-21T22:04:12.536909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-10-21T22:04:12.536972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-10-21T22:04:12.537046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-10-21T22:04:12.537121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-10-21T22:04:12.537191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-10-21T22:04:12.537270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-10-21T22:04:12.537338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-10-21T22:04:12.537400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-10-21T22:04:12.537465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-10-21T22:04:12.537533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-10-21T22:04:12.537609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-10-21T22:04:12.537749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-10-21T22:04:12.537835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-10-21T22:04:12.537911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-10-21T22:04:12.537986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-10-21T22:04:12.538049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-10-21T22:04:12.538111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-10-21T22:04:12.538173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-10-21T22:04:12.538250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-10-21T22:04:12.538311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-10-21T22:04:12.538387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-10-21T22:04:12.538447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-10-21T22:04:12.538509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-10-21T22:04:12.538571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-10-21T22:04:12.538671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-10-21T22:04:12.538779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-10-21T22:04:12.538843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-10-21T22:04:12.538907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-10-21T22:04:12.538983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-10-21T22:04:12.539063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-10-21T22:04:12.539126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-10-21T22:04:12.539188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-10-21T22:04:12.539249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-10-21T22:04:12.539317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-10-21T22:04:12.539392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-10-21T22:04:12.539454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-10-21T22:04:12.539517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-10-21T22:04:12.539596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-10-21T22:04:12.539683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-10-21T22:04:12.539772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-10-21T22:04:12.539837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-10-21T22:04:12.539912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-10-21T22:04:12.539980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-10-21T22:04:12.540093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-10-21T22:04:12.540165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-10-21T22:04:12.540234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-10-21T22:04:12.540298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-10-21T22:04:12.540360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-10-21T22:04:12.540420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-10-21T22:04:12.540496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-10-21T22:04:12.540557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-10-21T22:04:12.540629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-10-21T22:04:12.540755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-10-21T22:04:12.540842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-10-21T22:04:12.540906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-10-21T22:04:12.540981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-10-21T22:04:12.541043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-10-21T22:04:12.541105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-10-21T22:04:12.541167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-10-21T22:04:12.541229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-10-21T22:04:12.541307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-10-21T22:04:12.541367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-10-21T22:04:12.541447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-10-21T22:04:12.541508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-10-21T22:04:12.541581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-10-21T22:04:12.541671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-10-21T22:04:12.541762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-10-21T22:04:12.541842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-10-21T22:04:12.541911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-10-21T22:04:12.541973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-10-21T22:04:12.542033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-10-21T22:04:12.542093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-10-21T22:04:12.542154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-10-21T22:04:12.542226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-10-21T22:04:12.542308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-10-21T22:04:12.542384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-10-21T22:04:12.542444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-10-21T22:04:12.542503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-10-21T22:04:12.542578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-10-21T22:04:12.542639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-10-21T22:04:12.542921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-10-21T22:04:12.543005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-10-21T22:04:12.543071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-10-21T22:04:12.543134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-10-21T22:04:12.543199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-10-21T22:04:12.543260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-10-21T22:04:12.543323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-10-21T22:04:12.543400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-10-21T22:04:12.543465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-10-21T22:04:12.543532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-10-21T22:04:12.543608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-10-21T22:04:12.543699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-10-21T22:04:12.543802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-10-21T22:04:12.543869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-10-21T22:04:12.543948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-10-21T22:04:12.544010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-10-21T22:04:12.544085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-10-21T22:04:12.544148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-10-21T22:04:12.544235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-10-21T22:04:12.544299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-10-21T22:04:12.544360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-10-21T22:04:12.544429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-10-21T22:04:12.544491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-10-21T22:04:12.544554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-10-21T22:04:12.544617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-10-21T22:04:12.544746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-10-21T22:04:12.544840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-10-21T22:04:12.544911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-10-21T22:04:12.544975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-10-21T22:04:12.545049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-10-21T22:04:12.545117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-10-21T22:04:12.545180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-10-21T22:04:12.545245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-10-21T22:04:12.545330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-10-21T22:04:12.545449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-10-21T22:04:12.545523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-10-21T22:04:12.545605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-10-21T22:04:12.545729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-10-21T22:04:12.545822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-10-21T22:04:12.545889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-10-21T22:04:12.545951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-10-21T22:04:12.546014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-10-21T22:04:12.546077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-10-21T22:04:12.546189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-10-21T22:04:12.546253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-10-21T22:04:12.546315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-10-21T22:04:12.546379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-10-21T22:04:12.546441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-10-21T22:04:12.546510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-10-21T22:04:12.546572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-10-21T22:04:12.546674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-10-21T22:04:12.546775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-10-21T22:04:12.546856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-10-21T22:04:12.546919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-10-21T22:04:12.546983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-10-21T22:04:12.547068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-10-21T22:04:12.547136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-10-21T22:04:12.547205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-10-21T22:04:12.547267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-10-21T22:04:12.547344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-10-21T22:04:12.547407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-10-21T22:04:12.547468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-10-21T22:04:12.547543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-10-21T22:04:12.547604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-10-21T22:04:12.547717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-10-21T22:04:12.547828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-10-21T22:04:12.547904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-10-21T22:04:12.547989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-10-21T22:04:12.548052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-10-21T22:04:12.548126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-10-21T22:04:12.548188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-10-21T22:04:12.548251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-10-21T22:04:12.548312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-10-21T22:04:12.548388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-10-21T22:04:12.548449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-10-21T22:04:12.548510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-10-21T22:04:12.548585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-10-21T22:04:12.548692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-10-21T22:04:12.548800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-10-21T22:04:12.548881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-10-21T22:04:12.548948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-10-21T22:04:12.549025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-10-21T22:04:12.549085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-10-21T22:04:12.549160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-10-21T22:04:12.549222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-10-21T22:04:12.549289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-10-21T22:04:12.549350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-10-21T22:04:12.549410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-10-21T22:04:12.549469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-10-21T22:04:12.549534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-10-21T22:04:12.549594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-10-21T22:04:12.549706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-10-21T22:04:12.549810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-10-21T22:04:12.549873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-10-21T22:04:12.549936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-10-21T22:04:12.549997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-10-21T22:04:12.550057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-10-21T22:04:12.550116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-10-21T22:04:12.550208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-10-21T22:04:12.550269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-10-21T22:04:12.550328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-10-21T22:04:12.550394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-10-21T22:04:12.550456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-10-21T22:04:12.550533] [INFO ] [LOCAL ] Deleted 1763 derivative data files. [2025-10-21T22:04:12.550564] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-10-21T22:04:12.552877] [INFO ] [LOCAL ] Found 2057 symbols with primary data. [2025-10-21T22:04:12.553149] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2057 symbols [2025-10-21T22:04:12.553555] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:12.553958] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:12.554681] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:12.582948] [DEBUG] [LOCAL ] AB: Loaded 24859 existing records from primary storage. [2025-10-21T22:04:12.595187] [INFO ] [MAIN ] AB: Loaded 24859 primary data records. [2025-10-21T22:04:12.773626] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-21T22:04:12.757501] [DEBUG] [LOCAL ] AAP: Loaded 51758 existing records from primary storage. [2025-10-21T22:04:12.826545] [INFO ] [MAIN ] AAP: Loaded 51758 primary data records. [2025-10-21T22:04:12.821010] [INFO ] [MAIN ] AA: Loaded 53622 primary data records. [2025-10-21T22:04:13.578876] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:13.579837] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 24859 primary records. [2025-10-21T22:04:13.579928] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-10-21T22:04:13.597793] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-10-21T22:04:13.598239] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-10-21T22:04:13.599916] [INFO ] [MAIN ] Derivative Progress: 1/2057 symbols completed. AB took 1.0s. Estimated remaining: 35m 53s. Rate: 57.3 symbols/min [2025-10-21T22:04:13.600271] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:13.621235] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:13.634003] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53622 primary records. [2025-10-21T22:04:13.634444] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:13.634235] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-10-21T22:04:13.635299] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 51758 primary records. [2025-10-21T22:04:13.635537] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-10-21T22:04:13.662695] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-10-21T22:04:13.665832] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-10-21T22:04:13.666862] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-10-21T22:04:13.668860] [INFO ] [MAIN ] Derivative Progress: 2/2057 symbols completed. AA took 1.1s. Estimated remaining: 19m 7s. Rate: 107.5 symbols/min [2025-10-21T22:04:13.669064] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:13.669381] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-10-21T22:04:13.671860] [INFO ] [MAIN ] Derivative Progress: 3/2057 symbols completed. AAP took 1.1s. Estimated remaining: 12m 46s. Rate: 160.9 symbols/min [2025-10-21T22:04:13.672169] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:13.718548] [DEBUG] [LOCAL ] ABBV: Loaded 53682 existing records from primary storage. [2025-10-21T22:04:13.718891] [INFO ] [MAIN ] ABBV: Loaded 53682 primary data records. [2025-10-21T22:04:13.845285] [DEBUG] [LOCAL ] ABCB: Loaded 30362 existing records from primary storage. [2025-10-21T22:04:13.845542] [INFO ] [MAIN ] ABCB: Loaded 30362 primary data records. [2025-10-21T22:04:14.036212] [DEBUG] [LOCAL ] ABEV: Loaded 53287 existing records from primary storage. [2025-10-21T22:04:14.094195] [INFO ] [MAIN ] ABEV: Loaded 53287 primary data records. [2025-10-21T22:04:14.725480] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:14.731346] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:14.732159] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30362 primary records. [2025-10-21T22:04:14.732926] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53682 primary records. [2025-10-21T22:04:14.733066] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-10-21T22:04:14.733469] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-10-21T22:04:14.759247] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-10-21T22:04:14.759516] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-10-21T22:04:14.762098] [INFO ] [MAIN ] Derivative Progress: 4/2057 symbols completed. ABBV took 1.2s. Estimated remaining: 18m 54s. Rate: 108.6 symbols/min [2025-10-21T22:04:14.764848] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:14.769251] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-10-21T22:04:14.769617] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-10-21T22:04:14.771701] [INFO ] [MAIN ] Derivative Progress: 5/2057 symbols completed. ABCB took 1.1s. Estimated remaining: 15m 11s. Rate: 135.2 symbols/min [2025-10-21T22:04:14.771868] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:14.791751] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:14.792507] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53287 primary records. [2025-10-21T22:04:14.792715] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-10-21T22:04:14.820715] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-10-21T22:04:14.820909] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-10-21T22:04:14.835825] [INFO ] [MAIN ] Derivative Progress: 6/2057 symbols completed. ABEV took 1.2s. Estimated remaining: 13m 0s. Rate: 157.7 symbols/min [2025-10-21T22:04:14.836207] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:14.847714] [DEBUG] [LOCAL ] ABM: Loaded 32115 existing records from primary storage. [2025-10-21T22:04:14.847815] [INFO ] [MAIN ] ABM: Loaded 32115 primary data records. [2025-10-21T22:04:15.013755] [DEBUG] [LOCAL ] ABR: Loaded 51919 existing records from primary storage. [2025-10-21T22:04:15.052995] [INFO ] [MAIN ] ABR: Loaded 51919 primary data records. [2025-10-21T22:04:15.498227] [DEBUG] [LOCAL ] ABT: Loaded 53623 existing records from primary storage. [2025-10-21T22:04:15.499044] [INFO ] [MAIN ] ABT: Loaded 53623 primary data records. [2025-10-21T22:04:15.856607] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:15.857805] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32115 primary records. [2025-10-21T22:04:15.858198] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-10-21T22:04:15.880776] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-10-21T22:04:15.880960] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-10-21T22:04:15.883125] [INFO ] [MAIN ] Derivative Progress: 7/2057 symbols completed. ABM took 1.1s. Estimated remaining: 16m 15s. Rate: 126.1 symbols/min [2025-10-21T22:04:15.883417] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:15.898037] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:15.898839] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 51919 primary records. [2025-10-21T22:04:15.898930] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-10-21T22:04:15.915452] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-10-21T22:04:15.917983] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-10-21T22:04:15.920469] [INFO ] [MAIN ] Derivative Progress: 8/2057 symbols completed. ABR took 1.1s. Estimated remaining: 14m 23s. Rate: 142.5 symbols/min [2025-10-21T22:04:15.920740] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:15.935167] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:04:15.935997] [INFO ] [MAIN ] ABT: Generated 1793 derivative records from 53623 primary records. [2025-10-21T22:04:15.936058] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-10-21T22:04:15.952055] [DEBUG] [LOCAL ] ABT: Derivative data saved (1793 records). [2025-10-21T22:04:15.952334] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-10-21T22:04:15.954308] [INFO ] [MAIN ] Derivative Progress: 9/2057 symbols completed. ABT took 1.1s. Estimated remaining: 12m 54s. Rate: 158.8 symbols/min [2025-10-21T22:04:15.963611] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:15.994770] [DEBUG] [LOCAL ] ACEL: Loaded 26474 existing records from primary storage. [2025-10-21T22:04:15.995464] [DEBUG] [LOCAL ] ACCO: Loaded 36747 existing records from primary storage. [2025-10-21T22:04:15.995879] [INFO ] [MAIN ] ACEL: Loaded 26474 primary data records. [2025-10-21T22:04:15.995987] [INFO ] [MAIN ] ACCO: Loaded 36747 primary data records. [2025-10-21T22:04:16.525984] [DEBUG] [LOCAL ] ACI: Loaded 53286 existing records from primary storage. [2025-10-21T22:04:16.639884] [INFO ] [MAIN ] ACI: Loaded 53286 primary data records. [2025-10-21T22:04:16.978070] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:16.981965] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 36747 primary records. [2025-10-21T22:04:16.982351] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-10-21T22:04:17.005624] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:17.009473] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 26474 primary records. [2025-10-21T22:04:17.014346] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-10-21T22:04:17.014839] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-10-21T22:04:17.016947] [INFO ] [MAIN ] Derivative Progress: 10/2057 symbols completed. ACCO took 1.1s. Estimated remaining: 15m 14s. Rate: 134.4 symbols/min [2025-10-21T22:04:17.017196] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:17.012772] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-10-21T22:04:17.036738] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-10-21T22:04:17.037618] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-10-21T22:04:17.039902] [INFO ] [MAIN ] Derivative Progress: 11/2057 symbols completed. ACEL took 1.1s. Estimated remaining: 13m 55s. Rate: 147.1 symbols/min [2025-10-21T22:04:17.040849] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:17.055151] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:17.056047] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53286 primary records. [2025-10-21T22:04:17.056198] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-10-21T22:04:17.076667] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-10-21T22:04:17.076994] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-10-21T22:04:17.079326] [INFO ] [MAIN ] Derivative Progress: 12/2057 symbols completed. ACI took 1.1s. Estimated remaining: 12m 51s. Rate: 159.1 symbols/min [2025-10-21T22:04:17.079538] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:17.131427] [DEBUG] [LOCAL ] ACM: Loaded 42827 existing records from primary storage. [2025-10-21T22:04:17.131738] [INFO ] [MAIN ] ACM: Loaded 42827 primary data records. [2025-10-21T22:04:17.242134] [DEBUG] [LOCAL ] ACN: Loaded 53440 existing records from primary storage. [2025-10-21T22:04:17.263247] [DEBUG] [LOCAL ] ACP: Loaded 31078 existing records from primary storage. [2025-10-21T22:04:17.262471] [INFO ] [MAIN ] ACN: Loaded 53440 primary data records. [2025-10-21T22:04:17.268891] [INFO ] [MAIN ] ACP: Loaded 31078 primary data records. [2025-10-21T22:04:18.143840] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:18.145139] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 42827 primary records. [2025-10-21T22:04:18.145510] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-10-21T22:04:18.163820] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-10-21T22:04:18.167340] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-10-21T22:04:18.176963] [INFO ] [MAIN ] Derivative Progress: 13/2057 symbols completed. ACM took 1.2s. Estimated remaining: 14m 44s. Rate: 138.7 symbols/min [2025-10-21T22:04:18.194282] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:18.195280] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53440 primary records. [2025-10-21T22:04:18.194627] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:18.195892] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 31078 primary records. [2025-10-21T22:04:18.196020] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-10-21T22:04:18.195968] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-10-21T22:04:18.224463] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-10-21T22:04:18.225738] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-10-21T22:04:18.225815] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-10-21T22:04:18.227712] [INFO ] [MAIN ] Derivative Progress: 14/2057 symbols completed. ACP took 1.1s. Estimated remaining: 13m 48s. Rate: 148.0 symbols/min [2025-10-21T22:04:18.227807] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-10-21T22:04:18.229828] [INFO ] [MAIN ] Derivative Progress: 15/2057 symbols completed. ACN took 1.2s. Estimated remaining: 12m 53s. Rate: 158.5 symbols/min [2025-10-21T22:04:18.230141] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:18.230188] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:18.230248] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:18.241763] [DEBUG] [LOCAL ] ACV: Loaded 7423 existing records from primary storage. [2025-10-21T22:04:18.242000] [INFO ] [MAIN ] ACV: Loaded 7423 primary data records. [2025-10-21T22:04:18.588071] [DEBUG] [LOCAL ] ACVA: Loaded 49262 existing records from primary storage. [2025-10-21T22:04:18.601193] [INFO ] [MAIN ] ACVA: Loaded 49262 primary data records. [2025-10-21T22:04:18.512327] [DEBUG] [LOCAL ] ADC: Loaded 46430 existing records from primary storage. [2025-10-21T22:04:18.601950] [INFO ] [MAIN ] ADC: Loaded 46430 primary data records. [2025-10-21T22:04:19.240941] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:19.242408] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 7423 primary records. [2025-10-21T22:04:19.242937] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-10-21T22:04:19.260638] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-10-21T22:04:19.261001] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-10-21T22:04:19.262801] [INFO ] [MAIN ] Derivative Progress: 16/2057 symbols completed. ACV took 1.0s. Estimated remaining: 14m 16s. Rate: 143.1 symbols/min [2025-10-21T22:04:19.262969] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:19.282736] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:04:19.291605] [INFO ] [MAIN ] ACVA: Generated 1793 derivative records from 49262 primary records. [2025-10-21T22:04:19.297375] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-10-21T22:04:19.297242] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:19.298266] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46430 primary records. [2025-10-21T22:04:19.298738] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-10-21T22:04:19.324821] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-10-21T22:04:19.339929] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-10-21T22:04:19.344313] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1793 records). [2025-10-21T22:04:19.344404] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-10-21T22:04:19.342911] [INFO ] [MAIN ] Derivative Progress: 17/2057 symbols completed. ADC took 1.1s. Estimated remaining: 13m 35s. Rate: 150.2 symbols/min [2025-10-21T22:04:19.347439] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:19.348747] [INFO ] [MAIN ] Derivative Progress: 18/2057 symbols completed. ACVA took 1.1s. Estimated remaining: 12m 50s. Rate: 158.9 symbols/min [2025-10-21T22:04:19.348863] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:19.371271] [DEBUG] [LOCAL ] ADCT: Loaded 35445 existing records from primary storage. [2025-10-21T22:04:19.371521] [INFO ] [MAIN ] ADCT: Loaded 35445 primary data records. [2025-10-21T22:04:19.756291] [DEBUG] [LOCAL ] ADM: Loaded 53400 existing records from primary storage. [2025-10-21T22:04:19.757614] [DEBUG] [LOCAL ] ADT: Loaded 53436 existing records from primary storage. [2025-10-21T22:04:19.758620] [INFO ] [MAIN ] ADM: Loaded 53400 primary data records. [2025-10-21T22:04:19.758775] [INFO ] [MAIN ] ADT: Loaded 53436 primary data records. [2025-10-21T22:04:20.484529] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:20.486055] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 35445 primary records. [2025-10-21T22:04:20.487944] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-10-21T22:04:20.511607] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-10-21T22:04:20.512229] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-10-21T22:04:20.515031] [INFO ] [MAIN ] Derivative Progress: 19/2057 symbols completed. ADCT took 1.3s. Estimated remaining: 14m 14s. Rate: 143.2 symbols/min [2025-10-21T22:04:20.515919] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:20.549508] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:20.550078] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:20.551050] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53436 primary records. [2025-10-21T22:04:20.551183] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-10-21T22:04:20.552438] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53400 primary records. [2025-10-21T22:04:20.552860] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-10-21T22:04:20.568524] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-10-21T22:04:20.582529] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-10-21T22:04:20.585699] [INFO ] [MAIN ] Derivative Progress: 20/2057 symbols completed. ADT took 1.2s. Estimated remaining: 13m 38s. Rate: 149.4 symbols/min [2025-10-21T22:04:20.591554] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:20.593084] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-10-21T22:04:20.593162] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-10-21T22:04:20.595401] [INFO ] [MAIN ] Derivative Progress: 21/2057 symbols completed. ADM took 1.2s. Estimated remaining: 12m 60s. Rate: 156.7 symbols/min [2025-10-21T22:04:20.595708] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:20.606043] [DEBUG] [LOCAL ] ADX: Loaded 27734 existing records from primary storage. [2025-10-21T22:04:20.607443] [INFO ] [MAIN ] ADX: Loaded 27734 primary data records. [2025-10-21T22:04:20.719063] [DEBUG] [LOCAL ] AEFC: Loaded 7734 existing records from primary storage. [2025-10-21T22:04:20.724776] [INFO ] [MAIN ] AEFC: Loaded 7734 primary data records. [2025-10-21T22:04:21.237038] [DEBUG] [LOCAL ] AEE: Loaded 50107 existing records from primary storage. [2025-10-21T22:04:21.238120] [INFO ] [MAIN ] AEE: Loaded 50107 primary data records. [2025-10-21T22:04:21.577071] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:21.579376] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 27734 primary records. [2025-10-21T22:04:21.580605] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-10-21T22:04:21.614568] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:21.615878] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 7734 primary records. [2025-10-21T22:04:21.616118] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-10-21T22:04:21.613981] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-10-21T22:04:21.616945] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-10-21T22:04:21.619471] [INFO ] [MAIN ] Derivative Progress: 22/2057 symbols completed. ADX took 1.1s. Estimated remaining: 13m 59s. Rate: 145.6 symbols/min [2025-10-21T22:04:21.628392] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:21.635990] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-10-21T22:04:21.637049] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-10-21T22:04:21.639633] [INFO ] [MAIN ] Derivative Progress: 23/2057 symbols completed. AEFC took 1.0s. Estimated remaining: 13m 24s. Rate: 151.9 symbols/min [2025-10-21T22:04:21.640850] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:21.655868] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:21.656592] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50107 primary records. [2025-10-21T22:04:21.656871] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-10-21T22:04:21.675744] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-10-21T22:04:21.675962] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-10-21T22:04:21.678637] [INFO ] [MAIN ] Derivative Progress: 24/2057 symbols completed. AEE took 1.1s. Estimated remaining: 12m 53s. Rate: 157.8 symbols/min [2025-10-21T22:04:21.678937] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:21.714879] [DEBUG] [LOCAL ] AEG: Loaded 49601 existing records from primary storage. [2025-10-21T22:04:21.715018] [INFO ] [MAIN ] AEG: Loaded 49601 primary data records. [2025-10-21T22:04:21.907816] [DEBUG] [LOCAL ] AEM: Loaded 53477 existing records from primary storage. [2025-10-21T22:04:21.945198] [INFO ] [MAIN ] AEM: Loaded 53477 primary data records. [2025-10-21T22:04:22.120163] [DEBUG] [LOCAL ] AEO: Loaded 53564 existing records from primary storage. [2025-10-21T22:04:22.137096] [INFO ] [MAIN ] AEO: Loaded 53564 primary data records. [2025-10-21T22:04:22.739026] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:22.741013] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49601 primary records. [2025-10-21T22:04:22.741109] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-10-21T22:04:22.759054] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-10-21T22:04:22.759407] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-10-21T22:04:22.761832] [INFO ] [MAIN ] Derivative Progress: 25/2057 symbols completed. AEG took 1.1s. Estimated remaining: 13m 50s. Rate: 146.9 symbols/min [2025-10-21T22:04:22.762375] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:22.784211] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:22.792930] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53477 primary records. [2025-10-21T22:04:22.797938] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-10-21T22:04:22.799511] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:22.816011] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-10-21T22:04:22.816171] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-10-21T22:04:22.809153] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53564 primary records. [2025-10-21T22:04:22.816366] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-10-21T22:04:22.818315] [INFO ] [MAIN ] Derivative Progress: 26/2057 symbols completed. AEM took 1.2s. Estimated remaining: 13m 22s. Rate: 152.0 symbols/min [2025-10-21T22:04:22.818913] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:22.836075] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-10-21T22:04:22.849805] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-10-21T22:04:22.852852] [INFO ] [MAIN ] Derivative Progress: 27/2057 symbols completed. AEO took 1.2s. Estimated remaining: 12m 54s. Rate: 157.3 symbols/min [2025-10-21T22:04:22.853092] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:22.877468] [DEBUG] [LOCAL ] AES: Loaded 53665 existing records from primary storage. [2025-10-21T22:04:22.882666] [INFO ] [MAIN ] AES: Loaded 53665 primary data records. [2025-10-21T22:04:22.882405] [DEBUG] [LOCAL ] AFB: Loaded 11097 existing records from primary storage. [2025-10-21T22:04:22.882899] [INFO ] [MAIN ] AFB: Loaded 11097 primary data records. [2025-10-21T22:04:23.180241] [DEBUG] [LOCAL ] AESI: Loaded 49822 existing records from primary storage. [2025-10-21T22:04:23.215230] [INFO ] [MAIN ] AESI: Loaded 49822 primary data records. [2025-10-21T22:04:23.875266] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:23.876618] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53665 primary records. [2025-10-21T22:04:23.876873] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-10-21T22:04:23.895346] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-10-21T22:04:23.907592] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-10-21T22:04:23.908373] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:23.910908] [INFO ] [MAIN ] Derivative Progress: 28/2057 symbols completed. AES took 1.1s. Estimated remaining: 13m 43s. Rate: 147.9 symbols/min [2025-10-21T22:04:23.911848] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11097 primary records. [2025-10-21T22:04:23.911956] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-10-21T22:04:23.929273] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-10-21T22:04:23.929362] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-10-21T22:04:23.931421] [INFO ] [MAIN ] Derivative Progress: 29/2057 symbols completed. AFB took 1.1s. Estimated remaining: 13m 16s. Rate: 152.9 symbols/min [2025-10-21T22:04:23.944997] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:23.945517] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49822 primary records. [2025-10-21T22:04:23.945574] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-10-21T22:04:23.960773] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-10-21T22:04:23.960831] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-10-21T22:04:23.963261] [INFO ] [MAIN ] Derivative Progress: 30/2057 symbols completed. AESI took 1.1s. Estimated remaining: 12m 51s. Rate: 157.8 symbols/min [2025-10-21T22:04:23.963840] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:23.963896] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:23.963793] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:23.968275] [DEBUG] [LOCAL ] AFGD: Loaded 1769 existing records from primary storage. [2025-10-21T22:04:23.968545] [INFO ] [MAIN ] AFGD: Loaded 1769 primary data records. [2025-10-21T22:04:24.048114] [DEBUG] [LOCAL ] AFGB: Loaded 2236 existing records from primary storage. [2025-10-21T22:04:24.058757] [INFO ] [MAIN ] AFGB: Loaded 2236 primary data records. [2025-10-21T22:04:24.416344] [DEBUG] [LOCAL ] AFG: Loaded 31884 existing records from primary storage. [2025-10-21T22:04:24.427718] [INFO ] [MAIN ] AFG: Loaded 31884 primary data records. [2025-10-21T22:04:24.947865] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-21T22:04:24.949528] [INFO ] [MAIN ] AFGD: Generated 1792 derivative records from 1769 primary records. [2025-10-21T22:04:24.949788] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-10-21T22:04:24.965363] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1792 records). [2025-10-21T22:04:24.965520] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-10-21T22:04:24.967501] [INFO ] [MAIN ] Derivative Progress: 31/2057 symbols completed. AFGD took 1.0s. Estimated remaining: 13m 31s. Rate: 149.8 symbols/min [2025-10-21T22:04:24.968592] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:24.985788] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:24.986667] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2236 primary records. [2025-10-21T22:04:24.987012] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-10-21T22:04:24.990565] [DEBUG] [LOCAL ] AFGE: Loaded 2292 existing records from primary storage. [2025-10-21T22:04:24.990889] [INFO ] [MAIN ] AFGE: Loaded 2292 primary data records. [2025-10-21T22:04:25.070306] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-10-21T22:04:25.083075] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-10-21T22:04:25.102793] [INFO ] [MAIN ] Derivative Progress: 32/2057 symbols completed. AFGB took 1.1s. Estimated remaining: 13m 14s. Rate: 153.0 symbols/min [2025-10-21T22:04:25.114842] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:25.159224] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:25.207571] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 31884 primary records. [2025-10-21T22:04:25.213681] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-10-21T22:04:25.350804] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-10-21T22:04:25.351627] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-10-21T22:04:25.354216] [INFO ] [MAIN ] Derivative Progress: 33/2057 symbols completed. AFG took 1.4s. Estimated remaining: 13m 5s. Rate: 154.7 symbols/min [2025-10-21T22:04:25.354897] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:25.428610] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:04:25.429474] [INFO ] [MAIN ] AFGE: Generated 1793 derivative records from 2292 primary records. [2025-10-21T22:04:25.430721] [DEBUG] [LOCAL ] AFL: Loaded 53177 existing records from primary storage. [2025-10-21T22:04:25.431343] [INFO ] [MAIN ] AFL: Loaded 53177 primary data records. [2025-10-21T22:04:25.431141] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-10-21T22:04:25.562265] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1793 records). [2025-10-21T22:04:25.574832] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-10-21T22:04:25.553413] [DEBUG] [LOCAL ] AGCO: Loaded 42188 existing records from primary storage. [2025-10-21T22:04:25.575177] [INFO ] [MAIN ] AGCO: Loaded 42188 primary data records. [2025-10-21T22:04:25.577327] [INFO ] [MAIN ] Derivative Progress: 34/2057 symbols completed. AFGE took 0.6s. Estimated remaining: 12m 55s. Rate: 156.6 symbols/min [2025-10-21T22:04:25.577543] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:26.000407] [DEBUG] [LOCAL ] AGD: Loaded 19315 existing records from primary storage. [2025-10-21T22:04:26.006433] [INFO ] [MAIN ] AGD: Loaded 19315 primary data records. [2025-10-21T22:04:26.441051] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:26.443457] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53177 primary records. [2025-10-21T22:04:26.443628] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-10-21T22:04:26.460405] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-10-21T22:04:26.460778] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-10-21T22:04:26.463756] [INFO ] [MAIN ] Derivative Progress: 35/2057 symbols completed. AFL took 1.3s. Estimated remaining: 13m 24s. Rate: 151.0 symbols/min [2025-10-21T22:04:26.465476] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:26.484626] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:26.486176] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42188 primary records. [2025-10-21T22:04:26.486328] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-10-21T22:04:26.503219] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-10-21T22:04:26.503392] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-10-21T22:04:26.506068] [INFO ] [MAIN ] Derivative Progress: 36/2057 symbols completed. AGCO took 1.2s. Estimated remaining: 13m 3s. Rate: 154.8 symbols/min [2025-10-21T22:04:26.507019] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:26.521923] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:26.522667] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 19315 primary records. [2025-10-21T22:04:26.522772] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-10-21T22:04:26.539522] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-10-21T22:04:26.539780] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-10-21T22:04:26.542413] [INFO ] [MAIN ] Derivative Progress: 37/2057 symbols completed. AGD took 1.0s. Estimated remaining: 12m 44s. Rate: 158.7 symbols/min [2025-10-21T22:04:26.542725] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:26.592353] [DEBUG] [LOCAL ] AGI: Loaded 53423 existing records from primary storage. [2025-10-21T22:04:26.592582] [INFO ] [MAIN ] AGI: Loaded 53423 primary data records. [2025-10-21T22:04:26.629554] [DEBUG] [LOCAL ] AGM: Loaded 10663 existing records from primary storage. [2025-10-21T22:04:26.670456] [INFO ] [MAIN ] AGM: Loaded 10663 primary data records. [2025-10-21T22:04:26.706764] [DEBUG] [LOCAL ] AGL: Loaded 52587 existing records from primary storage. [2025-10-21T22:04:26.750336] [INFO ] [MAIN ] AGL: Loaded 52587 primary data records. [2025-10-21T22:04:27.529321] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:27.530214] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53423 primary records. [2025-10-21T22:04:27.531214] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-10-21T22:04:27.555407] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:27.559700] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52587 primary records. [2025-10-21T22:04:27.562903] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-10-21T22:04:27.571993] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-10-21T22:04:27.576671] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-10-21T22:04:27.577082] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:27.577912] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 10663 primary records. [2025-10-21T22:04:27.587418] [INFO ] [MAIN ] Derivative Progress: 38/2057 symbols completed. AGI took 1.1s. Estimated remaining: 13m 19s. Rate: 151.7 symbols/min [2025-10-21T22:04:27.587588] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-10-21T22:04:27.592754] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:27.602434] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-10-21T22:04:27.602604] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-10-21T22:04:27.610050] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-10-21T22:04:27.610176] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-10-21T22:04:27.612208] [INFO ] [MAIN ] Derivative Progress: 39/2057 symbols completed. AGL took 1.1s. Estimated remaining: 12m 59s. Rate: 155.4 symbols/min [2025-10-21T22:04:27.614572] [INFO ] [MAIN ] Derivative Progress: 40/2057 symbols completed. AGM took 1.1s. Estimated remaining: 12m 39s. Rate: 159.3 symbols/min [2025-10-21T22:04:27.614716] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:27.614522] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:27.649857] [DEBUG] [LOCAL ] AGO: Loaded 27763 existing records from primary storage. [2025-10-21T22:04:27.657027] [INFO ] [MAIN ] AGO: Loaded 27763 primary data records. [2025-10-21T22:04:27.781314] [DEBUG] [LOCAL ] AGX: Loaded 32682 existing records from primary storage. [2025-10-21T22:04:27.782040] [INFO ] [MAIN ] AGX: Loaded 32682 primary data records. [2025-10-21T22:04:27.781966] [DEBUG] [LOCAL ] AGRO: Loaded 32640 existing records from primary storage. [2025-10-21T22:04:27.782209] [INFO ] [MAIN ] AGRO: Loaded 32640 primary data records. [2025-10-21T22:04:28.618914] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:28.619686] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 27763 primary records. [2025-10-21T22:04:28.619781] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-10-21T22:04:28.638990] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-10-21T22:04:28.639132] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-10-21T22:04:28.641012] [INFO ] [MAIN ] Derivative Progress: 41/2057 symbols completed. AGO took 1.0s. Estimated remaining: 13m 11s. Rate: 152.9 symbols/min [2025-10-21T22:04:28.641323] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:28.654761] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:28.655409] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 32640 primary records. [2025-10-21T22:04:28.655483] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-10-21T22:04:28.674186] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-10-21T22:04:28.674472] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-10-21T22:04:28.676546] [INFO ] [MAIN ] Derivative Progress: 42/2057 symbols completed. AGRO took 1.1s. Estimated remaining: 12m 54s. Rate: 156.3 symbols/min [2025-10-21T22:04:28.676812] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:28.691218] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:28.692001] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 32682 primary records. [2025-10-21T22:04:28.692185] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-10-21T22:04:28.709345] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-10-21T22:04:28.709435] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-10-21T22:04:28.712133] [INFO ] [MAIN ] Derivative Progress: 43/2057 symbols completed. AGX took 1.1s. Estimated remaining: 12m 37s. Rate: 159.7 symbols/min [2025-10-21T22:04:28.738443] [DEBUG] [LOCAL ] AHH: Loaded 40272 existing records from primary storage. [2025-10-21T22:04:28.738574] [INFO ] [MAIN ] AHH: Loaded 40272 primary data records. [2025-10-21T22:04:28.894609] [DEBUG] [LOCAL ] AHR: Loaded 48969 existing records from primary storage. [2025-10-21T22:04:28.916048] [INFO ] [MAIN ] AHR: Loaded 48969 primary data records. [2025-10-21T22:04:29.377455] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:29.378168] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 40272 primary records. [2025-10-21T22:04:29.378345] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-10-21T22:04:29.393830] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-10-21T22:04:29.393973] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-10-21T22:04:29.396556] [INFO ] [MAIN ] Derivative Progress: 44/2057 symbols completed. AHH took 0.8s. Estimated remaining: 12m 51s. Rate: 156.7 symbols/min [2025-10-21T22:04:29.410568] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:29.411212] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 48969 primary records. [2025-10-21T22:04:29.411275] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-10-21T22:04:29.426173] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-10-21T22:04:29.426231] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-10-21T22:04:29.428281] [INFO ] [MAIN ] Derivative Progress: 45/2057 symbols completed. AHR took 0.8s. Estimated remaining: 12m 35s. Rate: 160.0 symbols/min [2025-10-21T22:04:29.428796] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:29.428729] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:29.428996] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:29.438700] [DEBUG] [LOCAL ] AHT: Loaded 6381 existing records from primary storage. [2025-10-21T22:04:29.438837] [INFO ] [MAIN ] AHT: Loaded 6381 primary data records. [2025-10-21T22:04:29.804171] [DEBUG] [LOCAL ] AIG: Loaded 53461 existing records from primary storage. [2025-10-21T22:04:29.818953] [INFO ] [MAIN ] AIG: Loaded 53461 primary data records. [2025-10-21T22:04:29.858460] [DEBUG] [LOCAL ] AI: Loaded 53765 existing records from primary storage. [2025-10-21T22:04:29.865639] [INFO ] [MAIN ] AI: Loaded 53765 primary data records. [2025-10-21T22:04:30.326566] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:30.327559] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 6381 primary records. [2025-10-21T22:04:30.445764] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-10-21T22:04:30.463952] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-10-21T22:04:30.464887] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-10-21T22:04:30.467284] [INFO ] [MAIN ] Derivative Progress: 46/2057 symbols completed. AHT took 1.0s. Estimated remaining: 13m 3s. Rate: 154.1 symbols/min [2025-10-21T22:04:30.467772] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:30.488780] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:30.489508] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53461 primary records. [2025-10-21T22:04:30.489749] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-10-21T22:04:30.533755] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-10-21T22:04:30.534095] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:30.534867] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53765 primary records. [2025-10-21T22:04:30.534193] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-10-21T22:04:30.536831] [INFO ] [MAIN ] Derivative Progress: 47/2057 symbols completed. AIG took 1.1s. Estimated remaining: 12m 49s. Rate: 156.8 symbols/min [2025-10-21T22:04:30.537489] [DEBUG] [LOCAL ] AIN: Loaded 24431 existing records from primary storage. [2025-10-21T22:04:30.537900] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:30.537688] [INFO ] [MAIN ] AIN: Loaded 24431 primary data records. [2025-10-21T22:04:30.537590] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-10-21T22:04:30.597634] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-10-21T22:04:30.622966] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-10-21T22:04:30.642544] [INFO ] [MAIN ] Derivative Progress: 48/2057 symbols completed. AI took 1.2s. Estimated remaining: 12m 37s. Rate: 159.2 symbols/min [2025-10-21T22:04:30.653539] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:30.670619] [DEBUG] [LOCAL ] AIO: Loaded 13039 existing records from primary storage. [2025-10-21T22:04:30.681517] [INFO ] [MAIN ] AIO: Loaded 13039 primary data records. [2025-10-21T22:04:31.195751] [DEBUG] [LOCAL ] AIV: Loaded 41856 existing records from primary storage. [2025-10-21T22:04:31.196693] [INFO ] [MAIN ] AIV: Loaded 41856 primary data records. [2025-10-21T22:04:31.579248] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:31.580230] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24431 primary records. [2025-10-21T22:04:31.580426] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-10-21T22:04:31.608738] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-10-21T22:04:31.614310] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:31.615262] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13039 primary records. [2025-10-21T22:04:31.614588] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-10-21T22:04:31.615383] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-10-21T22:04:31.617934] [INFO ] [MAIN ] Derivative Progress: 49/2057 symbols completed. AIN took 1.2s. Estimated remaining: 13m 1s. Rate: 154.2 symbols/min [2025-10-21T22:04:31.618120] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:31.632977] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-10-21T22:04:31.633369] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-10-21T22:04:31.636410] [INFO ] [MAIN ] Derivative Progress: 50/2057 symbols completed. AIO took 1.1s. Estimated remaining: 12m 46s. Rate: 157.2 symbols/min [2025-10-21T22:04:31.636763] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:31.643691] [DEBUG] [LOCAL ] AIZN: Loaded 3846 existing records from primary storage. [2025-10-21T22:04:31.643984] [INFO ] [MAIN ] AIZN: Loaded 3846 primary data records. [2025-10-21T22:04:31.786290] [DEBUG] [LOCAL ] AIZ: Loaded 29391 existing records from primary storage. [2025-10-21T22:04:31.796988] [INFO ] [MAIN ] AIZ: Loaded 29391 primary data records. [2025-10-21T22:04:31.802328] [DEBUG] [MAIN ] AIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:31.821844] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 41856 primary records. [2025-10-21T22:04:31.830502] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-10-21T22:04:32.089307] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-10-21T22:04:32.092948] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-10-21T22:04:32.095264] [INFO ] [MAIN ] Derivative Progress: 51/2057 symbols completed. AIV took 1.4s. Estimated remaining: 12m 49s. Rate: 156.6 symbols/min [2025-10-21T22:04:32.101932] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:32.329612] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:32.330783] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 3846 primary records. [2025-10-21T22:04:32.330918] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-10-21T22:04:32.346685] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-10-21T22:04:32.358995] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-10-21T22:04:32.362202] [INFO ] [MAIN ] Derivative Progress: 52/2057 symbols completed. AIZN took 0.7s. Estimated remaining: 12m 44s. Rate: 157.5 symbols/min [2025-10-21T22:04:32.362591] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:32.363816] [DEBUG] [LOCAL ] AJG: Loaded 46428 existing records from primary storage. [2025-10-21T22:04:32.363922] [INFO ] [MAIN ] AJG: Loaded 46428 primary data records. [2025-10-21T22:04:32.483478] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:32.506151] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 29391 primary records. [2025-10-21T22:04:32.523343] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-10-21T22:04:32.689796] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-10-21T22:04:32.690025] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-10-21T22:04:32.692339] [INFO ] [MAIN ] Derivative Progress: 53/2057 symbols completed. AIZ took 1.1s. Estimated remaining: 12m 41s. Rate: 157.9 symbols/min [2025-10-21T22:04:32.693143] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:32.727814] [DEBUG] [LOCAL ] AKR: Loaded 46115 existing records from primary storage. [2025-10-21T22:04:32.729523] [INFO ] [MAIN ] AKR: Loaded 46115 primary data records. [2025-10-21T22:04:32.822262] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:32.845361] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 46428 primary records. [2025-10-21T22:04:32.857058] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-10-21T22:04:32.958438] [DEBUG] [LOCAL ] AL: Loaded 44794 existing records from primary storage. [2025-10-21T22:04:32.971041] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-10-21T22:04:33.072292] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-10-21T22:04:32.971170] [INFO ] [MAIN ] AL: Loaded 44794 primary data records. [2025-10-21T22:04:33.087305] [INFO ] [MAIN ] Derivative Progress: 54/2057 symbols completed. AJG took 1.0s. Estimated remaining: 12m 42s. Rate: 157.8 symbols/min [2025-10-21T22:04:33.123702] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:33.445033] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:33.446617] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 46115 primary records. [2025-10-21T22:04:33.446978] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-10-21T22:04:33.449752] [DEBUG] [LOCAL ] ALB: Loaded 53366 existing records from primary storage. [2025-10-21T22:04:33.458226] [INFO ] [MAIN ] ALB: Loaded 53366 primary data records. [2025-10-21T22:04:33.479078] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-10-21T22:04:33.499291] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-10-21T22:04:33.501749] [INFO ] [MAIN ] Derivative Progress: 55/2057 symbols completed. AKR took 1.1s. Estimated remaining: 12m 43s. Rate: 157.5 symbols/min [2025-10-21T22:04:33.507064] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:33.627950] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:04:33.661334] [INFO ] [MAIN ] AL: Generated 1793 derivative records from 44794 primary records. [2025-10-21T22:04:33.753682] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-10-21T22:04:33.844111] [DEBUG] [LOCAL ] AL: Derivative data saved (1793 records). [2025-10-21T22:04:33.844814] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-10-21T22:04:33.847354] [INFO ] [MAIN ] Derivative Progress: 56/2057 symbols completed. AL took 1.2s. Estimated remaining: 12m 41s. Rate: 157.8 symbols/min [2025-10-21T22:04:33.848959] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:33.867266] [DEBUG] [LOCAL ] ALC: Loaded 51216 existing records from primary storage. [2025-10-21T22:04:33.868427] [INFO ] [MAIN ] ALC: Loaded 51216 primary data records. [2025-10-21T22:04:34.192493] [DEBUG] [LOCAL ] ALE: Loaded 32060 existing records from primary storage. [2025-10-21T22:04:34.194780] [INFO ] [MAIN ] ALE: Loaded 32060 primary data records. [2025-10-21T22:04:34.315361] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:34.325172] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53366 primary records. [2025-10-21T22:04:34.335838] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-10-21T22:04:34.538677] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-10-21T22:04:34.540190] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-10-21T22:04:34.542881] [INFO ] [MAIN ] Derivative Progress: 57/2057 symbols completed. ALB took 1.4s. Estimated remaining: 12m 52s. Rate: 155.5 symbols/min [2025-10-21T22:04:34.543272] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:34.561994] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:34.562930] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 51216 primary records. [2025-10-21T22:04:34.563124] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-10-21T22:04:34.589201] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-10-21T22:04:34.589971] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-10-21T22:04:34.592762] [INFO ] [MAIN ] Derivative Progress: 58/2057 symbols completed. ALC took 1.1s. Estimated remaining: 12m 40s. Rate: 157.9 symbols/min [2025-10-21T22:04:34.605784] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:34.606302] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 32060 primary records. [2025-10-21T22:04:34.606359] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-10-21T22:04:34.630950] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-10-21T22:04:34.631035] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-10-21T22:04:34.634119] [INFO ] [MAIN ] Derivative Progress: 59/2057 symbols completed. ALE took 0.8s. Estimated remaining: 12m 28s. Rate: 160.3 symbols/min [2025-10-21T22:04:34.634867] [DEBUG] [LOCAL ] ALEX: Loaded 30881 existing records from primary storage. [2025-10-21T22:04:34.635010] [INFO ] [MAIN ] ALEX: Loaded 30881 primary data records. [2025-10-21T22:04:34.973857] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:34.974516] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 30881 primary records. [2025-10-21T22:04:34.974578] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-10-21T22:04:34.989900] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-10-21T22:04:34.989999] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-10-21T22:04:34.992071] [INFO ] [MAIN ] Derivative Progress: 60/2057 symbols completed. ALEX took 0.4s. Estimated remaining: 12m 27s. Rate: 160.4 symbols/min [2025-10-21T22:04:34.993033] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:34.992970] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:34.992880] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:35.007573] [DEBUG] [LOCAL ] ALG: Loaded 9723 existing records from primary storage. [2025-10-21T22:04:35.007814] [INFO ] [MAIN ] ALG: Loaded 9723 primary data records. [2025-10-21T22:04:35.361411] [DEBUG] [LOCAL ] ALIT: Loaded 52785 existing records from primary storage. [2025-10-21T22:04:35.362112] [INFO ] [MAIN ] ALIT: Loaded 52785 primary data records. [2025-10-21T22:04:35.362923] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-21T22:04:35.370690] [INFO ] [MAIN ] ALK: Loaded 53087 primary data records. [2025-10-21T22:04:36.017256] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:36.018259] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 9723 primary records. [2025-10-21T22:04:36.018400] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-10-21T22:04:36.037141] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-10-21T22:04:36.037612] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-10-21T22:04:36.040221] [INFO ] [MAIN ] Derivative Progress: 61/2057 symbols completed. ALG took 1.0s. Estimated remaining: 12m 49s. Rate: 155.8 symbols/min [2025-10-21T22:04:36.040771] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:36.060521] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:36.068818] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52785 primary records. [2025-10-21T22:04:36.073558] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-10-21T22:04:36.074128] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:36.086127] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53087 primary records. [2025-10-21T22:04:36.089711] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-10-21T22:04:36.090321] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-10-21T22:04:36.090723] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-10-21T22:04:36.095148] [INFO ] [MAIN ] Derivative Progress: 62/2057 symbols completed. ALIT took 1.1s. Estimated remaining: 12m 38s. Rate: 158.0 symbols/min [2025-10-21T22:04:36.102393] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:36.110538] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-10-21T22:04:36.110707] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-10-21T22:04:36.112997] [INFO ] [MAIN ] Derivative Progress: 63/2057 symbols completed. ALK took 1.1s. Estimated remaining: 12m 26s. Rate: 160.4 symbols/min [2025-10-21T22:04:36.113242] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:36.149515] [DEBUG] [LOCAL ] ALL: Loaded 49648 existing records from primary storage. [2025-10-21T22:04:36.149845] [INFO ] [MAIN ] ALL: Loaded 49648 primary data records. [2025-10-21T22:04:36.291113] [DEBUG] [LOCAL ] ALLE: Loaded 43990 existing records from primary storage. [2025-10-21T22:04:36.291742] [INFO ] [MAIN ] ALLE: Loaded 43990 primary data records. [2025-10-21T22:04:36.476939] [DEBUG] [LOCAL ] ALLY: Loaded 53223 existing records from primary storage. [2025-10-21T22:04:36.495186] [INFO ] [MAIN ] ALLY: Loaded 53223 primary data records. [2025-10-21T22:04:37.161117] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:37.161967] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 49648 primary records. [2025-10-21T22:04:37.163370] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-10-21T22:04:37.181884] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-10-21T22:04:37.182029] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-10-21T22:04:37.184792] [INFO ] [MAIN ] Derivative Progress: 64/2057 symbols completed. ALL took 1.1s. Estimated remaining: 12m 47s. Rate: 155.9 symbols/min [2025-10-21T22:04:37.185101] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:37.199208] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:37.199901] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 43990 primary records. [2025-10-21T22:04:37.200096] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-10-21T22:04:37.234724] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-10-21T22:04:37.235042] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-10-21T22:04:37.235358] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:37.238011] [INFO ] [MAIN ] Derivative Progress: 65/2057 symbols completed. ALLE took 1.1s. Estimated remaining: 12m 37s. Rate: 158.0 symbols/min [2025-10-21T22:04:37.239161] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53223 primary records. [2025-10-21T22:04:37.239263] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-10-21T22:04:37.240128] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:37.257276] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-10-21T22:04:37.257483] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-10-21T22:04:37.259933] [INFO ] [MAIN ] Derivative Progress: 66/2057 symbols completed. ALLY took 1.1s. Estimated remaining: 12m 25s. Rate: 160.3 symbols/min [2025-10-21T22:04:37.260253] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:37.292142] [DEBUG] [LOCAL ] ALTG: Loaded 23188 existing records from primary storage. [2025-10-21T22:04:37.292308] [INFO ] [MAIN ] ALTG: Loaded 23188 primary data records. [2025-10-21T22:04:37.291302] [DEBUG] [LOCAL ] ALUR: Loaded 9307 existing records from primary storage. [2025-10-21T22:04:37.292572] [INFO ] [MAIN ] ALUR: Loaded 9307 primary data records. [2025-10-21T22:04:37.449410] [DEBUG] [LOCAL ] ALSN: Loaded 43269 existing records from primary storage. [2025-10-21T22:04:37.472850] [INFO ] [MAIN ] ALSN: Loaded 43269 primary data records. [2025-10-21T22:04:38.246511] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:38.247310] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 23188 primary records. [2025-10-21T22:04:38.247503] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-10-21T22:04:38.264229] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-10-21T22:04:38.264428] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-10-21T22:04:38.268252] [INFO ] [MAIN ] Derivative Progress: 67/2057 symbols completed. ALTG took 1.0s. Estimated remaining: 12m 44s. Rate: 156.3 symbols/min [2025-10-21T22:04:38.268710] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:38.281949] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:38.282600] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 9307 primary records. [2025-10-21T22:04:38.282707] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-10-21T22:04:38.298773] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-10-21T22:04:38.298878] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-10-21T22:04:38.301994] [INFO ] [MAIN ] Derivative Progress: 68/2057 symbols completed. ALUR took 1.0s. Estimated remaining: 12m 33s. Rate: 158.5 symbols/min [2025-10-21T22:04:38.303017] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:38.317284] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:38.318089] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43269 primary records. [2025-10-21T22:04:38.318278] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-10-21T22:04:38.336526] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-10-21T22:04:38.336915] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-10-21T22:04:38.342879] [INFO ] [MAIN ] Derivative Progress: 69/2057 symbols completed. ALSN took 1.2s. Estimated remaining: 12m 23s. Rate: 160.5 symbols/min [2025-10-21T22:04:38.343263] [DEBUG] [LOCAL ] ALX: Loaded 7228 existing records from primary storage. [2025-10-21T22:04:38.343356] [INFO ] [MAIN ] ALX: Loaded 7228 primary data records. [2025-10-21T22:04:38.364254] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:38.493250] [DEBUG] [LOCAL ] ALV: Loaded 42182 existing records from primary storage. [2025-10-21T22:04:38.521322] [INFO ] [MAIN ] ALV: Loaded 42182 primary data records. [2025-10-21T22:04:38.889598] [DEBUG] [LOCAL ] AM: Loaded 51857 existing records from primary storage. [2025-10-21T22:04:39.009345] [INFO ] [MAIN ] AM: Loaded 51857 primary data records. [2025-10-21T22:04:39.334148] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:39.335176] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 7228 primary records. [2025-10-21T22:04:39.335666] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-10-21T22:04:39.353857] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-10-21T22:04:39.354073] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-10-21T22:04:39.356093] [INFO ] [MAIN ] Derivative Progress: 70/2057 symbols completed. ALX took 1.1s. Estimated remaining: 12m 41s. Rate: 156.7 symbols/min [2025-10-21T22:04:39.356329] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:39.370362] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:39.371126] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42182 primary records. [2025-10-21T22:04:39.371312] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-10-21T22:04:39.387584] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-10-21T22:04:39.387971] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-10-21T22:04:39.389959] [INFO ] [MAIN ] Derivative Progress: 71/2057 symbols completed. ALV took 1.1s. Estimated remaining: 12m 31s. Rate: 158.7 symbols/min [2025-10-21T22:04:39.390214] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:39.407139] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:39.408037] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 51857 primary records. [2025-10-21T22:04:39.416665] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-10-21T22:04:39.432791] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-10-21T22:04:39.433763] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-10-21T22:04:39.446766] [INFO ] [MAIN ] Derivative Progress: 72/2057 symbols completed. AM took 1.1s. Estimated remaining: 12m 21s. Rate: 160.6 symbols/min [2025-10-21T22:04:39.447034] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:39.448209] [DEBUG] [LOCAL ] AMBC: Loaded 36048 existing records from primary storage. [2025-10-21T22:04:39.448431] [INFO ] [MAIN ] AMBC: Loaded 36048 primary data records. [2025-10-21T22:04:39.639988] [DEBUG] [LOCAL ] AMBP: Loaded 44418 existing records from primary storage. [2025-10-21T22:04:39.672769] [INFO ] [MAIN ] AMBP: Loaded 44418 primary data records. [2025-10-21T22:04:39.950733] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-21T22:04:39.951534] [INFO ] [MAIN ] AMC: Loaded 53766 primary data records. [2025-10-21T22:04:40.498086] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:40.499888] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 36048 primary records. [2025-10-21T22:04:40.500329] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-10-21T22:04:40.535513] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-10-21T22:04:40.536019] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-10-21T22:04:40.539223] [INFO ] [MAIN ] Derivative Progress: 73/2057 symbols completed. AMBC took 1.2s. Estimated remaining: 12m 41s. Rate: 156.5 symbols/min [2025-10-21T22:04:40.540175] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:40.541244] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 44418 primary records. [2025-10-21T22:04:40.541348] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-10-21T22:04:40.560053] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-10-21T22:04:40.572439] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-10-21T22:04:40.572376] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:40.574402] [INFO ] [MAIN ] Derivative Progress: 74/2057 symbols completed. AMBP took 1.2s. Estimated remaining: 12m 31s. Rate: 158.5 symbols/min [2025-10-21T22:04:40.575237] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53766 primary records. [2025-10-21T22:04:40.575300] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-10-21T22:04:40.590184] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-10-21T22:04:40.590239] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-10-21T22:04:40.592910] [INFO ] [MAIN ] Derivative Progress: 75/2057 symbols completed. AMC took 1.1s. Estimated remaining: 12m 21s. Rate: 160.5 symbols/min [2025-10-21T22:04:40.593493] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:40.593415] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:40.593858] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:40.617028] [DEBUG] [LOCAL ] AMG: Loaded 20131 existing records from primary storage. [2025-10-21T22:04:40.617230] [INFO ] [MAIN ] AMG: Loaded 20131 primary data records. [2025-10-21T22:04:40.840161] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-21T22:04:40.840530] [INFO ] [MAIN ] AMCR: Loaded 53670 primary data records. [2025-10-21T22:04:41.048128] [DEBUG] [LOCAL ] AME: Loaded 48489 existing records from primary storage. [2025-10-21T22:04:41.059240] [INFO ] [MAIN ] AME: Loaded 48489 primary data records. [2025-10-21T22:04:41.662205] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:41.664093] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20131 primary records. [2025-10-21T22:04:41.665837] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-10-21T22:04:41.685755] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-10-21T22:04:41.686313] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-10-21T22:04:41.688459] [INFO ] [MAIN ] Derivative Progress: 76/2057 symbols completed. AMG took 1.1s. Estimated remaining: 12m 39s. Rate: 156.5 symbols/min [2025-10-21T22:04:41.689260] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:41.723857] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:41.723419] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:41.726064] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48489 primary records. [2025-10-21T22:04:41.726248] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-10-21T22:04:41.725143] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53670 primary records. [2025-10-21T22:04:41.726392] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-10-21T22:04:41.764185] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-10-21T22:04:41.764370] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-10-21T22:04:41.767213] [INFO ] [MAIN ] Derivative Progress: 77/2057 symbols completed. AME took 1.2s. Estimated remaining: 12m 31s. Rate: 158.1 symbols/min [2025-10-21T22:04:41.770374] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:41.770475] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-10-21T22:04:41.771013] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-10-21T22:04:41.772853] [INFO ] [MAIN ] Derivative Progress: 78/2057 symbols completed. AMCR took 1.2s. Estimated remaining: 12m 21s. Rate: 160.2 symbols/min [2025-10-21T22:04:41.773213] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:41.786421] [DEBUG] [LOCAL ] AMP: Loaded 31914 existing records from primary storage. [2025-10-21T22:04:41.786872] [INFO ] [MAIN ] AMP: Loaded 31914 primary data records. [2025-10-21T22:04:42.136339] [DEBUG] [LOCAL ] AMPY: Loaded 39389 existing records from primary storage. [2025-10-21T22:04:42.141793] [INFO ] [MAIN ] AMPY: Loaded 39389 primary data records. [2025-10-21T22:04:42.254152] [DEBUG] [LOCAL ] AMPX: Loaded 52398 existing records from primary storage. [2025-10-21T22:04:42.271238] [INFO ] [MAIN ] AMPX: Loaded 52398 primary data records. [2025-10-21T22:04:42.800465] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:04:42.802170] [INFO ] [MAIN ] AMP: Generated 1793 derivative records from 31914 primary records. [2025-10-21T22:04:42.802473] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-10-21T22:04:42.842555] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:42.842823] [DEBUG] [LOCAL ] AMP: Derivative data saved (1793 records). [2025-10-21T22:04:42.843190] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-10-21T22:04:42.847595] [INFO ] [MAIN ] Derivative Progress: 79/2057 symbols completed. AMP took 1.2s. Estimated remaining: 12m 39s. Rate: 156.5 symbols/min [2025-10-21T22:04:42.844001] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 39389 primary records. [2025-10-21T22:04:42.848040] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-10-21T22:04:42.848207] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:42.870040] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-10-21T22:04:42.870977] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-10-21T22:04:42.873151] [INFO ] [MAIN ] Derivative Progress: 80/2057 symbols completed. AMPY took 1.1s. Estimated remaining: 12m 29s. Rate: 158.3 symbols/min [2025-10-21T22:04:42.873388] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:42.888850] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:42.889906] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52398 primary records. [2025-10-21T22:04:42.890160] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-10-21T22:04:42.915698] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-10-21T22:04:42.915921] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-10-21T22:04:42.918759] [INFO ] [MAIN ] Derivative Progress: 81/2057 symbols completed. AMPX took 1.1s. Estimated remaining: 12m 21s. Rate: 160.0 symbols/min [2025-10-21T22:04:42.919027] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:42.940521] [DEBUG] [LOCAL ] AMR: Loaded 28870 existing records from primary storage. [2025-10-21T22:04:42.940930] [INFO ] [MAIN ] AMR: Loaded 28870 primary data records. [2025-10-21T22:04:43.059944] [DEBUG] [LOCAL ] AMRC: Loaded 38589 existing records from primary storage. [2025-10-21T22:04:43.065812] [INFO ] [MAIN ] AMRC: Loaded 38589 primary data records. [2025-10-21T22:04:43.483601] [DEBUG] [LOCAL ] AMT: Loaded 52448 existing records from primary storage. [2025-10-21T22:04:43.625315] [INFO ] [MAIN ] AMT: Loaded 52448 primary data records. [2025-10-21T22:04:43.996730] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:43.998613] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 28870 primary records. [2025-10-21T22:04:43.999203] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-10-21T22:04:44.018475] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-10-21T22:04:44.018805] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-10-21T22:04:44.021494] [INFO ] [MAIN ] Derivative Progress: 82/2057 symbols completed. AMR took 1.2s. Estimated remaining: 12m 38s. Rate: 156.3 symbols/min [2025-10-21T22:04:44.034605] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:44.034162] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:44.035541] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38589 primary records. [2025-10-21T22:04:44.037169] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-10-21T22:04:44.057830] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-10-21T22:04:44.057963] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-10-21T22:04:44.060202] [INFO ] [MAIN ] Derivative Progress: 83/2057 symbols completed. AMRC took 1.2s. Estimated remaining: 12m 29s. Rate: 158.1 symbols/min [2025-10-21T22:04:44.060540] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:44.074243] [DEBUG] [LOCAL ] AMTD: Loaded 3827 existing records from primary storage. [2025-10-21T22:04:44.089346] [INFO ] [MAIN ] AMTD: Loaded 3827 primary data records. [2025-10-21T22:04:44.095246] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:44.094883] [DEBUG] [LOCAL ] AMTB: Loaded 20430 existing records from primary storage. [2025-10-21T22:04:44.116395] [INFO ] [MAIN ] AMTB: Loaded 20430 primary data records. [2025-10-21T22:04:44.117318] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52448 primary records. [2025-10-21T22:04:44.147785] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-10-21T22:04:44.316905] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-10-21T22:04:44.317844] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-10-21T22:04:44.341541] [INFO ] [MAIN ] Derivative Progress: 84/2057 symbols completed. AMT took 1.4s. Estimated remaining: 12m 27s. Rate: 158.5 symbols/min [2025-10-21T22:04:44.385769] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:44.741833] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:04:44.742554] [INFO ] [MAIN ] AMTD: Generated 1793 derivative records from 3827 primary records. [2025-10-21T22:04:44.742670] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-10-21T22:04:44.759689] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1793 records). [2025-10-21T22:04:44.759945] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-10-21T22:04:44.788950] [INFO ] [MAIN ] Derivative Progress: 85/2057 symbols completed. AMTD took 0.7s. Estimated remaining: 12m 28s. Rate: 158.2 symbols/min [2025-10-21T22:04:44.789209] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:44.789685] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:44.790761] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20430 primary records. [2025-10-21T22:04:44.791853] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-10-21T22:04:44.791750] [DEBUG] [LOCAL ] AMTM: Loaded 50302 existing records from primary storage. [2025-10-21T22:04:44.792797] [INFO ] [MAIN ] AMTM: Loaded 50302 primary data records. [2025-10-21T22:04:44.862326] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-10-21T22:04:44.862447] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-10-21T22:04:44.869963] [INFO ] [MAIN ] Derivative Progress: 86/2057 symbols completed. AMTB took 0.8s. Estimated remaining: 12m 21s. Rate: 159.7 symbols/min [2025-10-21T22:04:44.879162] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:44.896518] [DEBUG] [LOCAL ] AMWL: Loaded 9764 existing records from primary storage. [2025-10-21T22:04:44.921291] [INFO ] [MAIN ] AMWL: Loaded 9764 primary data records. [2025-10-21T22:04:45.463579] [DEBUG] [LOCAL ] AMX: Loaded 49203 existing records from primary storage. [2025-10-21T22:04:45.464266] [INFO ] [MAIN ] AMX: Loaded 49203 primary data records. [2025-10-21T22:04:45.829265] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:45.832246] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50302 primary records. [2025-10-21T22:04:45.832944] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-10-21T22:04:45.850040] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-10-21T22:04:45.863264] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-10-21T22:04:45.865512] [INFO ] [MAIN ] Derivative Progress: 87/2057 symbols completed. AMTM took 1.5s. Estimated remaining: 12m 34s. Rate: 156.7 symbols/min [2025-10-21T22:04:45.865959] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:45.865833] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:45.867638] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 9764 primary records. [2025-10-21T22:04:45.867892] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-10-21T22:04:45.884056] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-10-21T22:04:45.885122] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-10-21T22:04:45.887428] [INFO ] [MAIN ] Derivative Progress: 88/2057 symbols completed. AMWL took 1.1s. Estimated remaining: 12m 26s. Rate: 158.4 symbols/min [2025-10-21T22:04:45.902289] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:45.903059] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49203 primary records. [2025-10-21T22:04:45.910992] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-10-21T22:04:45.936012] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-10-21T22:04:45.936130] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-10-21T22:04:45.938064] [INFO ] [MAIN ] Derivative Progress: 89/2057 symbols completed. AMX took 1.1s. Estimated remaining: 12m 18s. Rate: 160.0 symbols/min [2025-10-21T22:04:45.939077] [DEBUG] [LOCAL ] AN: Loaded 31126 existing records from primary storage. [2025-10-21T22:04:45.939146] [INFO ] [MAIN ] AN: Loaded 31126 primary data records. [2025-10-21T22:04:46.242750] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:46.243349] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 31126 primary records. [2025-10-21T22:04:46.243410] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-10-21T22:04:46.258339] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-10-21T22:04:46.258395] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-10-21T22:04:46.260466] [INFO ] [MAIN ] Derivative Progress: 90/2057 symbols completed. AN took 0.4s. Estimated remaining: 12m 17s. Rate: 160.2 symbols/min [2025-10-21T22:04:46.261212] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:46.261339] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:46.261124] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:46.282521] [DEBUG] [LOCAL ] ANRO: Loaded 19651 existing records from primary storage. [2025-10-21T22:04:46.282804] [INFO ] [MAIN ] ANRO: Loaded 19651 primary data records. [2025-10-21T22:04:46.638803] [DEBUG] [LOCAL ] ANF: Loaded 52051 existing records from primary storage. [2025-10-21T22:04:46.639089] [INFO ] [MAIN ] ANF: Loaded 52051 primary data records. [2025-10-21T22:04:46.661327] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-21T22:04:46.677240] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-10-21T22:04:47.274691] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:47.276072] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 19651 primary records. [2025-10-21T22:04:47.276390] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-10-21T22:04:47.293399] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-10-21T22:04:47.293870] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-10-21T22:04:47.296248] [INFO ] [MAIN ] Derivative Progress: 91/2057 symbols completed. ANRO took 1.0s. Estimated remaining: 12m 31s. Rate: 157.2 symbols/min [2025-10-21T22:04:47.296504] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:47.315054] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:47.316214] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52051 primary records. [2025-10-21T22:04:47.316431] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-10-21T22:04:47.348914] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-10-21T22:04:47.354460] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:47.354681] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-10-21T22:04:47.357512] [INFO ] [MAIN ] Derivative Progress: 92/2057 symbols completed. ANF took 1.1s. Estimated remaining: 12m 23s. Rate: 158.6 symbols/min [2025-10-21T22:04:47.355500] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-10-21T22:04:47.357800] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:47.358036] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-10-21T22:04:47.367752] [DEBUG] [LOCAL ] ANVS: Loaded 23984 existing records from primary storage. [2025-10-21T22:04:47.367997] [INFO ] [MAIN ] ANVS: Loaded 23984 primary data records. [2025-10-21T22:04:47.419854] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-10-21T22:04:47.432529] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-10-21T22:04:47.461746] [INFO ] [MAIN ] Derivative Progress: 93/2057 symbols completed. ANET took 1.2s. Estimated remaining: 12m 17s. Rate: 159.8 symbols/min [2025-10-21T22:04:47.485586] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:47.596134] [DEBUG] [LOCAL ] AOD: Loaded 30971 existing records from primary storage. [2025-10-21T22:04:47.608292] [INFO ] [MAIN ] AOD: Loaded 30971 primary data records. [2025-10-21T22:04:47.678388] [DEBUG] [LOCAL ] AOMR: Loaded 16383 existing records from primary storage. [2025-10-21T22:04:47.787187] [INFO ] [MAIN ] AOMR: Loaded 16383 primary data records. [2025-10-21T22:04:48.379468] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:48.380796] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23984 primary records. [2025-10-21T22:04:48.380882] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-10-21T22:04:48.398089] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-10-21T22:04:48.398675] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-10-21T22:04:48.400828] [INFO ] [MAIN ] Derivative Progress: 94/2057 symbols completed. ANVS took 1.1s. Estimated remaining: 12m 29s. Rate: 157.3 symbols/min [2025-10-21T22:04:48.400994] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:48.419389] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:48.422413] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30971 primary records. [2025-10-21T22:04:48.422739] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-10-21T22:04:48.443560] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:48.444272] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 16383 primary records. [2025-10-21T22:04:48.448018] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-10-21T22:04:48.453484] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-10-21T22:04:48.453725] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-10-21T22:04:48.463757] [INFO ] [MAIN ] Derivative Progress: 95/2057 symbols completed. AOD took 1.1s. Estimated remaining: 12m 22s. Rate: 158.7 symbols/min [2025-10-21T22:04:48.463977] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:48.482848] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-10-21T22:04:48.483076] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-10-21T22:04:48.485059] [INFO ] [MAIN ] Derivative Progress: 96/2057 symbols completed. AOMR took 1.0s. Estimated remaining: 12m 14s. Rate: 160.3 symbols/min [2025-10-21T22:04:48.485388] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:48.510278] [DEBUG] [LOCAL ] AON: Loaded 45103 existing records from primary storage. [2025-10-21T22:04:48.510585] [INFO ] [MAIN ] AON: Loaded 45103 primary data records. [2025-10-21T22:04:48.591333] [DEBUG] [LOCAL ] AORT: Loaded 28922 existing records from primary storage. [2025-10-21T22:04:48.608487] [INFO ] [MAIN ] AORT: Loaded 28922 primary data records. [2025-10-21T22:04:49.028978] [DEBUG] [LOCAL ] AOS: Loaded 48651 existing records from primary storage. [2025-10-21T22:04:49.139474] [INFO ] [MAIN ] AOS: Loaded 48651 primary data records. [2025-10-21T22:04:49.531458] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:49.531091] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:49.532386] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45103 primary records. [2025-10-21T22:04:49.533167] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 28922 primary records. [2025-10-21T22:04:49.533471] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-10-21T22:04:49.533365] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-10-21T22:04:49.588967] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:49.593306] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 48651 primary records. [2025-10-21T22:04:49.593895] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-10-21T22:04:49.599720] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-10-21T22:04:49.595940] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-10-21T22:04:49.599911] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-10-21T22:04:49.602100] [INFO ] [MAIN ] Derivative Progress: 97/2057 symbols completed. AORT took 1.1s. Estimated remaining: 12m 29s. Rate: 157.1 symbols/min [2025-10-21T22:04:49.602296] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:49.602389] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-10-21T22:04:49.604690] [INFO ] [MAIN ] Derivative Progress: 98/2057 symbols completed. AON took 1.2s. Estimated remaining: 12m 21s. Rate: 158.7 symbols/min [2025-10-21T22:04:49.605385] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:49.630010] [DEBUG] [LOCAL ] AP: Loaded 7409 existing records from primary storage. [2025-10-21T22:04:49.630090] [INFO ] [MAIN ] AP: Loaded 7409 primary data records. [2025-10-21T22:04:49.629753] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-10-21T22:04:49.655767] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-10-21T22:04:49.673768] [INFO ] [MAIN ] Derivative Progress: 99/2057 symbols completed. AOS took 1.2s. Estimated remaining: 12m 14s. Rate: 160.0 symbols/min [2025-10-21T22:04:49.674001] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:49.958032] [DEBUG] [LOCAL ] APAM: Loaded 35815 existing records from primary storage. [2025-10-21T22:04:49.959183] [INFO ] [MAIN ] APAM: Loaded 35815 primary data records. [2025-10-21T22:04:50.087839] [DEBUG] [LOCAL ] APD: Loaded 45477 existing records from primary storage. [2025-10-21T22:04:50.091402] [INFO ] [MAIN ] APD: Loaded 45477 primary data records. [2025-10-21T22:04:50.610763] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:04:50.612242] [INFO ] [MAIN ] AP: Generated 1793 derivative records from 7409 primary records. [2025-10-21T22:04:50.613228] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-10-21T22:04:50.630410] [DEBUG] [LOCAL ] AP: Derivative data saved (1793 records). [2025-10-21T22:04:50.630525] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-10-21T22:04:50.632671] [INFO ] [MAIN ] Derivative Progress: 100/2057 symbols completed. AP took 1.0s. Estimated remaining: 12m 25s. Rate: 157.6 symbols/min [2025-10-21T22:04:50.633058] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:50.656127] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:50.657126] [INFO ] [MAIN ] APAM: Generated 1794 derivative records from 35815 primary records. [2025-10-21T22:04:50.660150] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-10-21T22:04:50.700744] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:50.701717] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45477 primary records. [2025-10-21T22:04:50.701872] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-10-21T22:04:50.719126] [DEBUG] [LOCAL ] APAM: Derivative data saved (1794 records). [2025-10-21T22:04:50.735424] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-10-21T22:04:50.734348] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-10-21T22:04:50.738150] [INFO ] [MAIN ] Derivative Progress: 101/2057 symbols completed. APAM took 1.1s. Estimated remaining: 12m 20s. Rate: 158.7 symbols/min [2025-10-21T22:04:50.738356] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:50.738553] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-10-21T22:04:50.740969] [INFO ] [MAIN ] Derivative Progress: 102/2057 symbols completed. APD took 1.1s. Estimated remaining: 12m 12s. Rate: 160.3 symbols/min [2025-10-21T22:04:50.741254] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:50.741969] [DEBUG] [LOCAL ] APG: Loaded 50625 existing records from primary storage. [2025-10-21T22:04:50.742454] [INFO ] [MAIN ] APG: Loaded 50625 primary data records. [2025-10-21T22:04:51.100772] [DEBUG] [LOCAL ] APO: Loaded 53390 existing records from primary storage. [2025-10-21T22:04:51.101268] [INFO ] [MAIN ] APO: Loaded 53390 primary data records. [2025-10-21T22:04:51.102208] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-21T22:04:51.148199] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-10-21T22:04:51.262254] [DEBUG] [MAIN ] APG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:51.309982] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50625 primary records. [2025-10-21T22:04:51.364119] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-10-21T22:04:51.632196] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-10-21T22:04:51.643394] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-10-21T22:04:51.650921] [INFO ] [MAIN ] Derivative Progress: 103/2057 symbols completed. APG took 1.0s. Estimated remaining: 12m 22s. Rate: 158.1 symbols/min [2025-10-21T22:04:51.879752] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:51.880790] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53390 primary records. [2025-10-21T22:04:51.880884] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-10-21T22:04:51.898417] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-10-21T22:04:51.899302] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-10-21T22:04:51.901989] [INFO ] [MAIN ] Derivative Progress: 104/2057 symbols completed. APO took 1.2s. Estimated remaining: 12m 19s. Rate: 158.6 symbols/min [2025-10-21T22:04:51.914707] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:51.915275] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-10-21T22:04:51.915335] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-10-21T22:04:51.931051] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-10-21T22:04:51.931110] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-10-21T22:04:51.933288] [INFO ] [MAIN ] Derivative Progress: 105/2057 symbols completed. APH took 1.2s. Estimated remaining: 12m 12s. Rate: 160.0 symbols/min [2025-10-21T22:04:51.933832] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:51.933777] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:51.934592] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:51.945686] [DEBUG] [LOCAL ] APOS: Loaded 7132 existing records from primary storage. [2025-10-21T22:04:51.945875] [INFO ] [MAIN ] APOS: Loaded 7132 primary data records. [2025-10-21T22:04:52.284383] [DEBUG] [LOCAL ] APTV: Loaded 51874 existing records from primary storage. [2025-10-21T22:04:52.285596] [INFO ] [MAIN ] APTV: Loaded 51874 primary data records. [2025-10-21T22:04:52.375771] [DEBUG] [LOCAL ] AQN: Loaded 51684 existing records from primary storage. [2025-10-21T22:04:52.389281] [INFO ] [MAIN ] AQN: Loaded 51684 primary data records. [2025-10-21T22:04:52.996375] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:52.998092] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7132 primary records. [2025-10-21T22:04:52.999326] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-10-21T22:04:53.018203] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-10-21T22:04:53.018634] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-10-21T22:04:53.020876] [INFO ] [MAIN ] Derivative Progress: 106/2057 symbols completed. APOS took 1.1s. Estimated remaining: 12m 25s. Rate: 157.2 symbols/min [2025-10-21T22:04:53.021703] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:53.032864] [DEBUG] [LOCAL ] AQNB: Loaded 3940 existing records from primary storage. [2025-10-21T22:04:53.033213] [INFO ] [MAIN ] AQNB: Loaded 3940 primary data records. [2025-10-21T22:04:53.086866] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:53.124359] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 51874 primary records. [2025-10-21T22:04:53.132958] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-10-21T22:04:53.210765] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-10-21T22:04:53.235806] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-10-21T22:04:53.251854] [INFO ] [MAIN ] Derivative Progress: 107/2057 symbols completed. APTV took 1.3s. Estimated remaining: 12m 22s. Rate: 157.7 symbols/min [2025-10-21T22:04:53.278116] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:53.278628] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:53.285356] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51684 primary records. [2025-10-21T22:04:53.412936] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-10-21T22:04:53.432812] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-10-21T22:04:53.432907] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-10-21T22:04:53.435286] [INFO ] [MAIN ] Derivative Progress: 108/2057 symbols completed. AQN took 1.5s. Estimated remaining: 12m 18s. Rate: 158.5 symbols/min [2025-10-21T22:04:53.435540] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:53.467909] [DEBUG] [LOCAL ] ARDC: Loaded 15258 existing records from primary storage. [2025-10-21T22:04:53.468203] [INFO ] [MAIN ] ARDC: Loaded 15258 primary data records. [2025-10-21T22:04:53.494015] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:53.505397] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 3940 primary records. [2025-10-21T22:04:53.515674] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-10-21T22:04:53.605527] [DEBUG] [LOCAL ] AR: Loaded 53590 existing records from primary storage. [2025-10-21T22:04:53.621810] [INFO ] [MAIN ] AR: Loaded 53590 primary data records. [2025-10-21T22:04:53.629397] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-10-21T22:04:53.635287] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-10-21T22:04:53.662162] [INFO ] [MAIN ] Derivative Progress: 109/2057 symbols completed. AQNB took 0.6s. Estimated remaining: 12m 15s. Rate: 159.1 symbols/min [2025-10-21T22:04:53.721850] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:54.229063] [DEBUG] [LOCAL ] ARDT: Loaded 27405 existing records from primary storage. [2025-10-21T22:04:54.230170] [INFO ] [MAIN ] ARDT: Loaded 27405 primary data records. [2025-10-21T22:04:54.558399] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:54.559244] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 15258 primary records. [2025-10-21T22:04:54.559442] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-10-21T22:04:54.578790] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-10-21T22:04:54.579472] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-10-21T22:04:54.589628] [INFO ] [MAIN ] Derivative Progress: 110/2057 symbols completed. ARDC took 1.2s. Estimated remaining: 12m 24s. Rate: 157.0 symbols/min [2025-10-21T22:04:54.594794] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:54.595212] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:54.595970] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53590 primary records. [2025-10-21T22:04:54.596434] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-10-21T22:04:54.613229] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-10-21T22:04:54.613353] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-10-21T22:04:54.615360] [INFO ] [MAIN ] Derivative Progress: 111/2057 symbols completed. AR took 1.3s. Estimated remaining: 12m 17s. Rate: 158.3 symbols/min [2025-10-21T22:04:54.615541] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:54.642131] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:54.642987] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 27405 primary records. [2025-10-21T22:04:54.643253] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-10-21T22:04:54.679435] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-10-21T22:04:54.679633] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-10-21T22:04:54.682151] [INFO ] [MAIN ] Derivative Progress: 112/2057 symbols completed. ARDT took 1.0s. Estimated remaining: 12m 12s. Rate: 159.5 symbols/min [2025-10-21T22:04:54.682459] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:54.712431] [DEBUG] [LOCAL ] ARES: Loaded 49679 existing records from primary storage. [2025-10-21T22:04:54.712723] [INFO ] [MAIN ] ARES: Loaded 49679 primary data records. [2025-10-21T22:04:54.713340] [DEBUG] [LOCAL ] ARLO: Loaded 43536 existing records from primary storage. [2025-10-21T22:04:54.744084] [INFO ] [MAIN ] ARLO: Loaded 43536 primary data records. [2025-10-21T22:04:55.227999] [DEBUG] [LOCAL ] AS: Loaded 53198 existing records from primary storage. [2025-10-21T22:04:55.340577] [INFO ] [MAIN ] AS: Loaded 53198 primary data records. [2025-10-21T22:04:55.724449] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:04:55.724112] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:55.725268] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 43536 primary records. [2025-10-21T22:04:55.725886] [INFO ] [MAIN ] ARES: Generated 1793 derivative records from 49679 primary records. [2025-10-21T22:04:55.725993] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-10-21T22:04:55.726073] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-10-21T22:04:55.751031] [DEBUG] [LOCAL ] ARES: Derivative data saved (1793 records). [2025-10-21T22:04:55.752618] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-10-21T22:04:55.757468] [INFO ] [MAIN ] Derivative Progress: 113/2057 symbols completed. ARES took 1.2s. Estimated remaining: 12m 23s. Rate: 156.9 symbols/min [2025-10-21T22:04:55.762175] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:55.762457] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-10-21T22:04:55.763055] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-10-21T22:04:55.764982] [INFO ] [MAIN ] Derivative Progress: 114/2057 symbols completed. ARLO took 1.1s. Estimated remaining: 12m 16s. Rate: 158.3 symbols/min [2025-10-21T22:04:55.765396] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:55.781760] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:55.786526] [INFO ] [MAIN ] AS: Generated 1794 derivative records from 53198 primary records. [2025-10-21T22:04:55.786621] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-10-21T22:04:55.803091] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-10-21T22:04:55.803587] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-10-21T22:04:55.811313] [INFO ] [MAIN ] Derivative Progress: 115/2057 symbols completed. AS took 1.1s. Estimated remaining: 12m 11s. Rate: 159.5 symbols/min [2025-10-21T22:04:55.812115] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:55.812451] [DEBUG] [LOCAL ] ASA: Loaded 15663 existing records from primary storage. [2025-10-21T22:04:55.813032] [INFO ] [MAIN ] ASA: Loaded 15663 primary data records. [2025-10-21T22:04:56.151228] [DEBUG] [LOCAL ] ASAN: Loaded 52732 existing records from primary storage. [2025-10-21T22:04:56.151490] [INFO ] [MAIN ] ASAN: Loaded 52732 primary data records. [2025-10-21T22:04:56.287374] [DEBUG] [LOCAL ] ASB: Loaded 49698 existing records from primary storage. [2025-10-21T22:04:56.298925] [INFO ] [MAIN ] ASB: Loaded 49698 primary data records. [2025-10-21T22:04:56.786065] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:56.788423] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 15663 primary records. [2025-10-21T22:04:56.789049] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-10-21T22:04:56.807451] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-10-21T22:04:56.807822] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-10-21T22:04:56.810693] [INFO ] [MAIN ] Derivative Progress: 116/2057 symbols completed. ASA took 1.0s. Estimated remaining: 12m 21s. Rate: 157.3 symbols/min [2025-10-21T22:04:56.811202] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:56.823315] [DEBUG] [LOCAL ] ASBA: Loaded 3501 existing records from primary storage. [2025-10-21T22:04:56.837015] [INFO ] [MAIN ] ASBA: Loaded 3501 primary data records. [2025-10-21T22:04:56.843209] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:56.856857] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52732 primary records. [2025-10-21T22:04:56.857016] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-10-21T22:04:56.986306] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-10-21T22:04:56.992917] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:56.987372] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-10-21T22:04:57.033368] [INFO ] [MAIN ] Derivative Progress: 117/2057 symbols completed. ASAN took 1.3s. Estimated remaining: 12m 18s. Rate: 157.8 symbols/min [2025-10-21T22:04:57.027808] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49698 primary records. [2025-10-21T22:04:57.041452] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-10-21T22:04:57.047246] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:57.210103] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-10-21T22:04:57.210790] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-10-21T22:04:57.213478] [INFO ] [MAIN ] Derivative Progress: 118/2057 symbols completed. ASB took 1.4s. Estimated remaining: 12m 14s. Rate: 158.5 symbols/min [2025-10-21T22:04:57.235669] [DEBUG] [LOCAL ] ASG: Loaded 19380 existing records from primary storage. [2025-10-21T22:04:57.236083] [INFO ] [MAIN ] ASG: Loaded 19380 primary data records. [2025-10-21T22:04:57.391129] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:57.417137] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3501 primary records. [2025-10-21T22:04:57.426726] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-10-21T22:04:57.465211] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-10-21T22:04:57.641234] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-10-21T22:04:57.656800] [INFO ] [MAIN ] Derivative Progress: 119/2057 symbols completed. ASBA took 0.8s. Estimated remaining: 12m 15s. Rate: 158.3 symbols/min [2025-10-21T22:04:57.692496] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:57.693364] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 19380 primary records. [2025-10-21T22:04:57.693433] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-10-21T22:04:57.710205] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-10-21T22:04:57.710287] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-10-21T22:04:57.713870] [INFO ] [MAIN ] Derivative Progress: 120/2057 symbols completed. ASG took 0.7s. Estimated remaining: 12m 9s. Rate: 159.4 symbols/min [2025-10-21T22:04:57.714769] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:57.714592] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:57.714878] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:57.763765] [DEBUG] [LOCAL ] ASGI: Loaded 23005 existing records from primary storage. [2025-10-21T22:04:57.764630] [INFO ] [MAIN ] ASGI: Loaded 23005 primary data records. [2025-10-21T22:04:57.764332] [DEBUG] [LOCAL ] ASIX: Loaded 23106 existing records from primary storage. [2025-10-21T22:04:57.764944] [INFO ] [MAIN ] ASIX: Loaded 23106 primary data records. [2025-10-21T22:04:57.977121] [DEBUG] [LOCAL ] ASGN: Loaded 36654 existing records from primary storage. [2025-10-21T22:04:58.028439] [INFO ] [MAIN ] ASGN: Loaded 36654 primary data records. [2025-10-21T22:04:58.763929] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:58.765428] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 23106 primary records. [2025-10-21T22:04:58.774004] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-10-21T22:04:58.794317] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:58.799155] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-10-21T22:04:58.799429] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-10-21T22:04:58.800465] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 23005 primary records. [2025-10-21T22:04:58.802791] [INFO ] [MAIN ] Derivative Progress: 121/2057 symbols completed. ASIX took 1.1s. Estimated remaining: 12m 20s. Rate: 157.0 symbols/min [2025-10-21T22:04:58.803251] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-10-21T22:04:58.803093] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:58.827469] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:58.835531] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36654 primary records. [2025-10-21T22:04:58.835712] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-10-21T22:04:58.835816] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-10-21T22:04:58.837090] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-10-21T22:04:58.850783] [INFO ] [MAIN ] Derivative Progress: 122/2057 symbols completed. ASGI took 1.1s. Estimated remaining: 12m 14s. Rate: 158.1 symbols/min [2025-10-21T22:04:58.853675] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:58.856499] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-10-21T22:04:58.856777] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-10-21T22:04:58.859319] [INFO ] [MAIN ] Derivative Progress: 123/2057 symbols completed. ASGN took 1.1s. Estimated remaining: 12m 8s. Rate: 159.4 symbols/min [2025-10-21T22:04:58.859516] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:58.870518] [DEBUG] [LOCAL ] ASR: Loaded 9484 existing records from primary storage. [2025-10-21T22:04:58.870694] [INFO ] [MAIN ] ASR: Loaded 9484 primary data records. [2025-10-21T22:04:59.070129] [DEBUG] [LOCAL ] ASPN: Loaded 49890 existing records from primary storage. [2025-10-21T22:04:59.094784] [INFO ] [MAIN ] ASPN: Loaded 49890 primary data records. [2025-10-21T22:04:59.314809] [DEBUG] [LOCAL ] ASX: Loaded 52881 existing records from primary storage. [2025-10-21T22:04:59.320227] [INFO ] [MAIN ] ASX: Loaded 52881 primary data records. [2025-10-21T22:04:59.943078] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:59.944776] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9484 primary records. [2025-10-21T22:04:59.944968] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-10-21T22:04:59.963586] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-10-21T22:04:59.964022] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-10-21T22:04:59.968410] [INFO ] [MAIN ] Derivative Progress: 124/2057 symbols completed. ASR took 1.1s. Estimated remaining: 12m 19s. Rate: 156.9 symbols/min [2025-10-21T22:04:59.968595] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:04:59.987025] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:04:59.989557] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49890 primary records. [2025-10-21T22:04:59.990449] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-10-21T22:05:00.019432] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:00.020483] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52881 primary records. [2025-10-21T22:05:00.020616] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-10-21T22:05:00.022477] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-10-21T22:05:00.023589] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-10-21T22:05:00.026689] [INFO ] [MAIN ] Derivative Progress: 125/2057 symbols completed. ASPN took 1.2s. Estimated remaining: 12m 14s. Rate: 158.0 symbols/min [2025-10-21T22:05:00.050218] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:00.053437] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-10-21T22:05:00.053582] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-10-21T22:05:00.055871] [INFO ] [MAIN ] Derivative Progress: 126/2057 symbols completed. ASX took 1.2s. Estimated remaining: 12m 8s. Rate: 159.1 symbols/min [2025-10-21T22:05:00.056254] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:00.071210] [DEBUG] [LOCAL ] ATEN: Loaded 37831 existing records from primary storage. [2025-10-21T22:05:00.071637] [INFO ] [MAIN ] ATEN: Loaded 37831 primary data records. [2025-10-21T22:05:00.403884] [DEBUG] [LOCAL ] ATHM: Loaded 31322 existing records from primary storage. [2025-10-21T22:05:00.419236] [INFO ] [MAIN ] ATHM: Loaded 31322 primary data records. [2025-10-21T22:05:00.479315] [DEBUG] [LOCAL ] ATGE: Loaded 30618 existing records from primary storage. [2025-10-21T22:05:00.518782] [INFO ] [MAIN ] ATGE: Loaded 30618 primary data records. [2025-10-21T22:05:01.075282] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:01.076105] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 37831 primary records. [2025-10-21T22:05:01.076269] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-10-21T22:05:01.095337] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-10-21T22:05:01.095696] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-10-21T22:05:01.097889] [INFO ] [MAIN ] Derivative Progress: 127/2057 symbols completed. ATEN took 1.1s. Estimated remaining: 12m 18s. Rate: 157.0 symbols/min [2025-10-21T22:05:01.098328] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:01.111230] [DEBUG] [LOCAL ] ATHS: Loaded 6564 existing records from primary storage. [2025-10-21T22:05:01.123834] [INFO ] [MAIN ] ATHS: Loaded 6564 primary data records. [2025-10-21T22:05:01.124223] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:01.161006] [INFO ] [MAIN ] ATHM: Generated 1793 derivative records from 31322 primary records. [2025-10-21T22:05:01.180345] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-10-21T22:05:01.262589] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1793 records). [2025-10-21T22:05:01.273289] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-10-21T22:05:01.323870] [INFO ] [MAIN ] Derivative Progress: 128/2057 symbols completed. ATHM took 1.3s. Estimated remaining: 12m 15s. Rate: 157.5 symbols/min [2025-10-21T22:05:01.440913] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:01.455128] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:01.454894] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 30618 primary records. [2025-10-21T22:05:01.455686] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-10-21T22:05:01.476696] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-10-21T22:05:01.477016] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-10-21T22:05:01.479952] [INFO ] [MAIN ] Derivative Progress: 129/2057 symbols completed. ATGE took 1.4s. Estimated remaining: 12m 11s. Rate: 158.2 symbols/min [2025-10-21T22:05:01.480352] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:01.519271] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:01.527241] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 6564 primary records. [2025-10-21T22:05:01.527388] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-10-21T22:05:01.558616] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-10-21T22:05:01.568818] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-10-21T22:05:01.569921] [DEBUG] [LOCAL ] ATI: Loaded 51304 existing records from primary storage. [2025-10-21T22:05:01.572437] [INFO ] [MAIN ] ATI: Loaded 51304 primary data records. [2025-10-21T22:05:01.572323] [INFO ] [MAIN ] Derivative Progress: 130/2057 symbols completed. ATHS took 0.5s. Estimated remaining: 12m 7s. Rate: 159.1 symbols/min [2025-10-21T22:05:01.572757] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:01.610300] [DEBUG] [LOCAL ] ATKR: Loaded 34887 existing records from primary storage. [2025-10-21T22:05:01.616383] [INFO ] [MAIN ] ATKR: Loaded 34887 primary data records. [2025-10-21T22:05:02.250744] [DEBUG] [LOCAL ] ATMU: Loaded 38780 existing records from primary storage. [2025-10-21T22:05:02.251440] [INFO ] [MAIN ] ATMU: Loaded 38780 primary data records. [2025-10-21T22:05:02.588911] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:02.591008] [INFO ] [MAIN ] ATI: Generated 1793 derivative records from 51304 primary records. [2025-10-21T22:05:02.591394] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-10-21T22:05:02.606294] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:02.614170] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 34887 primary records. [2025-10-21T22:05:02.618394] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-10-21T22:05:02.623200] [DEBUG] [LOCAL ] ATI: Derivative data saved (1793 records). [2025-10-21T22:05:02.623297] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-10-21T22:05:02.632417] [INFO ] [MAIN ] Derivative Progress: 131/2057 symbols completed. ATI took 1.2s. Estimated remaining: 12m 16s. Rate: 157.0 symbols/min [2025-10-21T22:05:02.633706] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:02.643477] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-10-21T22:05:02.643974] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-10-21T22:05:02.646274] [INFO ] [MAIN ] Derivative Progress: 132/2057 symbols completed. ATKR took 1.2s. Estimated remaining: 12m 11s. Rate: 158.1 symbols/min [2025-10-21T22:05:02.646474] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:02.666208] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:02.666890] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 38780 primary records. [2025-10-21T22:05:02.667103] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-10-21T22:05:02.699462] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-10-21T22:05:02.699743] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-10-21T22:05:02.701956] [INFO ] [MAIN ] Derivative Progress: 133/2057 symbols completed. ATMU took 1.1s. Estimated remaining: 12m 5s. Rate: 159.1 symbols/min [2025-10-21T22:05:02.716083] [DEBUG] [LOCAL ] ATO: Loaded 41624 existing records from primary storage. [2025-10-21T22:05:02.716557] [INFO ] [MAIN ] ATO: Loaded 41624 primary data records. [2025-10-21T22:05:02.808073] [DEBUG] [LOCAL ] ATR: Loaded 30495 existing records from primary storage. [2025-10-21T22:05:02.828029] [INFO ] [MAIN ] ATR: Loaded 30495 primary data records. [2025-10-21T22:05:03.458531] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:03.459446] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 41624 primary records. [2025-10-21T22:05:03.459615] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-10-21T22:05:03.478836] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-10-21T22:05:03.479829] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-10-21T22:05:03.482756] [INFO ] [MAIN ] Derivative Progress: 134/2057 symbols completed. ATO took 0.8s. Estimated remaining: 12m 11s. Rate: 157.9 symbols/min [2025-10-21T22:05:03.497223] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:03.498103] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30495 primary records. [2025-10-21T22:05:03.498195] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-10-21T22:05:03.518793] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-10-21T22:05:03.518957] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-10-21T22:05:03.522163] [INFO ] [MAIN ] Derivative Progress: 135/2057 symbols completed. ATR took 0.9s. Estimated remaining: 12m 6s. Rate: 158.9 symbols/min [2025-10-21T22:05:03.522731] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:03.522805] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:03.522988] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:03.550015] [DEBUG] [LOCAL ] ATS: Loaded 17169 existing records from primary storage. [2025-10-21T22:05:03.550190] [INFO ] [MAIN ] ATS: Loaded 17169 primary data records. [2025-10-21T22:05:03.810350] [DEBUG] [LOCAL ] AU: Loaded 53089 existing records from primary storage. [2025-10-21T22:05:03.798043] [DEBUG] [LOCAL ] ATUS: Loaded 49928 existing records from primary storage. [2025-10-21T22:05:03.820918] [INFO ] [MAIN ] ATUS: Loaded 49928 primary data records. [2025-10-21T22:05:03.821011] [INFO ] [MAIN ] AU: Loaded 53089 primary data records. [2025-10-21T22:05:04.746166] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:04.746970] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 17169 primary records. [2025-10-21T22:05:04.747243] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-10-21T22:05:04.763514] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-10-21T22:05:04.764705] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-10-21T22:05:04.767565] [INFO ] [MAIN ] Derivative Progress: 136/2057 symbols completed. ATS took 1.2s. Estimated remaining: 12m 18s. Rate: 156.3 symbols/min [2025-10-21T22:05:04.767977] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:04.802596] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:04.802924] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:04.804216] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49928 primary records. [2025-10-21T22:05:04.804356] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-10-21T22:05:04.803619] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 53089 primary records. [2025-10-21T22:05:04.804992] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-10-21T22:05:04.835764] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-10-21T22:05:04.837046] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-10-21T22:05:04.836901] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-10-21T22:05:04.839173] [INFO ] [MAIN ] Derivative Progress: 137/2057 symbols completed. AU took 1.3s. Estimated remaining: 12m 13s. Rate: 157.2 symbols/min [2025-10-21T22:05:04.837165] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-10-21T22:05:04.849248] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:04.851571] [INFO ] [MAIN ] Derivative Progress: 138/2057 symbols completed. ATUS took 1.3s. Estimated remaining: 12m 7s. Rate: 158.3 symbols/min [2025-10-21T22:05:04.851919] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:04.872103] [DEBUG] [LOCAL ] AUNA: Loaded 5226 existing records from primary storage. [2025-10-21T22:05:04.873202] [INFO ] [MAIN ] AUNA: Loaded 5226 primary data records. [2025-10-21T22:05:04.895042] [DEBUG] [LOCAL ] AUB: Loaded 45881 existing records from primary storage. [2025-10-21T22:05:04.905664] [INFO ] [MAIN ] AUB: Loaded 45881 primary data records. [2025-10-21T22:05:05.500187] [DEBUG] [LOCAL ] AVA: Loaded 38417 existing records from primary storage. [2025-10-21T22:05:05.517037] [INFO ] [MAIN ] AVA: Loaded 38417 primary data records. [2025-10-21T22:05:05.840042] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:05.840997] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 5226 primary records. [2025-10-21T22:05:05.853928] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-10-21T22:05:05.855304] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:05.865705] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 45881 primary records. [2025-10-21T22:05:05.869184] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-10-21T22:05:05.869507] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-10-21T22:05:05.870148] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-10-21T22:05:05.872714] [INFO ] [MAIN ] Derivative Progress: 139/2057 symbols completed. AUNA took 1.0s. Estimated remaining: 12m 16s. Rate: 156.4 symbols/min [2025-10-21T22:05:05.873153] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:05.888314] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-10-21T22:05:05.888635] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-10-21T22:05:05.891170] [INFO ] [MAIN ] Derivative Progress: 140/2057 symbols completed. AUB took 1.1s. Estimated remaining: 12m 10s. Rate: 157.5 symbols/min [2025-10-21T22:05:05.891365] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:05.907552] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:05.908291] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 38417 primary records. [2025-10-21T22:05:05.908424] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-10-21T22:05:05.929982] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-10-21T22:05:05.930219] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-10-21T22:05:05.932244] [INFO ] [MAIN ] Derivative Progress: 141/2057 symbols completed. AVA took 1.1s. Estimated remaining: 12m 5s. Rate: 158.5 symbols/min [2025-10-21T22:05:05.940055] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:05.940397] [DEBUG] [LOCAL ] AVD: Loaded 21426 existing records from primary storage. [2025-10-21T22:05:05.940898] [INFO ] [MAIN ] AVD: Loaded 21426 primary data records. [2025-10-21T22:05:06.088138] [DEBUG] [LOCAL ] AVB: Loaded 42231 existing records from primary storage. [2025-10-21T22:05:06.100041] [DEBUG] [LOCAL ] AVK: Loaded 18704 existing records from primary storage. [2025-10-21T22:05:06.110434] [INFO ] [MAIN ] AVK: Loaded 18704 primary data records. [2025-10-21T22:05:06.105246] [INFO ] [MAIN ] AVB: Loaded 42231 primary data records. [2025-10-21T22:05:06.961327] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:06.962138] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 21426 primary records. [2025-10-21T22:05:06.962474] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-10-21T22:05:06.979560] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-10-21T22:05:06.981605] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-10-21T22:05:06.985108] [INFO ] [MAIN ] Derivative Progress: 142/2057 symbols completed. AVD took 1.1s. Estimated remaining: 12m 14s. Rate: 156.5 symbols/min [2025-10-21T22:05:06.985997] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:07.012439] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:07.013699] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 42231 primary records. [2025-10-21T22:05:07.012981] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:07.014350] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18704 primary records. [2025-10-21T22:05:07.014525] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-10-21T22:05:07.014862] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-10-21T22:05:07.037989] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-10-21T22:05:07.038990] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-10-21T22:05:07.041250] [INFO ] [MAIN ] Derivative Progress: 143/2057 symbols completed. AVK took 1.1s. Estimated remaining: 12m 9s. Rate: 157.5 symbols/min [2025-10-21T22:05:07.046844] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:07.048017] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-10-21T22:05:07.048596] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-10-21T22:05:07.051024] [INFO ] [MAIN ] Derivative Progress: 144/2057 symbols completed. AVB took 1.2s. Estimated remaining: 12m 4s. Rate: 158.5 symbols/min [2025-10-21T22:05:07.051271] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:07.076295] [DEBUG] [LOCAL ] AVNS: Loaded 33563 existing records from primary storage. [2025-10-21T22:05:07.076556] [INFO ] [MAIN ] AVNS: Loaded 33563 primary data records. [2025-10-21T22:05:07.215878] [DEBUG] [LOCAL ] AVNT: Loaded 38781 existing records from primary storage. [2025-10-21T22:05:07.231700] [INFO ] [MAIN ] AVNT: Loaded 38781 primary data records. [2025-10-21T22:05:07.503100] [DEBUG] [LOCAL ] AVTR: Loaded 53572 existing records from primary storage. [2025-10-21T22:05:07.521837] [INFO ] [MAIN ] AVTR: Loaded 53572 primary data records. [2025-10-21T22:05:08.099826] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:08.101016] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33563 primary records. [2025-10-21T22:05:08.101209] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-10-21T22:05:08.121242] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-10-21T22:05:08.121724] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-10-21T22:05:08.131844] [INFO ] [MAIN ] Derivative Progress: 145/2057 symbols completed. AVNS took 1.1s. Estimated remaining: 12m 13s. Rate: 156.5 symbols/min [2025-10-21T22:05:08.136595] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:08.138159] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:08.138983] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 38781 primary records. [2025-10-21T22:05:08.140004] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-10-21T22:05:08.161335] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-10-21T22:05:08.161481] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-10-21T22:05:08.163474] [INFO ] [MAIN ] Derivative Progress: 146/2057 symbols completed. AVNT took 1.1s. Estimated remaining: 12m 8s. Rate: 157.5 symbols/min [2025-10-21T22:05:08.171370] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:08.177703] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:08.178461] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53572 primary records. [2025-10-21T22:05:08.178639] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-10-21T22:05:08.204007] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-10-21T22:05:08.204174] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-10-21T22:05:08.206228] [INFO ] [MAIN ] Derivative Progress: 147/2057 symbols completed. AVTR took 1.2s. Estimated remaining: 12m 3s. Rate: 158.5 symbols/min [2025-10-21T22:05:08.206447] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:08.225549] [DEBUG] [LOCAL ] AVY: Loaded 38140 existing records from primary storage. [2025-10-21T22:05:08.225784] [INFO ] [MAIN ] AVY: Loaded 38140 primary data records. [2025-10-21T22:05:08.310783] [DEBUG] [LOCAL ] AWF: Loaded 24135 existing records from primary storage. [2025-10-21T22:05:08.327984] [INFO ] [MAIN ] AWF: Loaded 24135 primary data records. [2025-10-21T22:05:08.517412] [DEBUG] [LOCAL ] AWI: Loaded 25268 existing records from primary storage. [2025-10-21T22:05:08.534698] [INFO ] [MAIN ] AWI: Loaded 25268 primary data records. [2025-10-21T22:05:09.188908] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:09.190140] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 38140 primary records. [2025-10-21T22:05:09.190503] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-10-21T22:05:09.208807] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-10-21T22:05:09.209054] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-10-21T22:05:09.211295] [INFO ] [MAIN ] Derivative Progress: 148/2057 symbols completed. AVY took 1.1s. Estimated remaining: 12m 11s. Rate: 156.7 symbols/min [2025-10-21T22:05:09.227934] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:09.230470] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24135 primary records. [2025-10-21T22:05:09.231174] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-10-21T22:05:09.257881] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:09.260401] [INFO ] [MAIN ] AWI: Generated 1793 derivative records from 25268 primary records. [2025-10-21T22:05:09.260749] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-10-21T22:05:09.261036] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-10-21T22:05:09.261820] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-10-21T22:05:09.264411] [INFO ] [MAIN ] Derivative Progress: 149/2057 symbols completed. AWF took 1.1s. Estimated remaining: 12m 6s. Rate: 157.6 symbols/min [2025-10-21T22:05:09.279604] [DEBUG] [LOCAL ] AWI: Derivative data saved (1793 records). [2025-10-21T22:05:09.279720] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-10-21T22:05:09.281843] [INFO ] [MAIN ] Derivative Progress: 150/2057 symbols completed. AWI took 1.1s. Estimated remaining: 12m 1s. Rate: 158.6 symbols/min [2025-10-21T22:05:09.282223] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:09.282433] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:09.282319] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:09.317560] [DEBUG] [LOCAL ] AWR: Loaded 22805 existing records from primary storage. [2025-10-21T22:05:09.327757] [INFO ] [MAIN ] AWR: Loaded 22805 primary data records. [2025-10-21T22:05:09.350461] [DEBUG] [LOCAL ] AWP: Loaded 21668 existing records from primary storage. [2025-10-21T22:05:09.378505] [INFO ] [MAIN ] AWP: Loaded 21668 primary data records. [2025-10-21T22:05:09.542474] [DEBUG] [LOCAL ] AWK: Loaded 48465 existing records from primary storage. [2025-10-21T22:05:09.628227] [INFO ] [MAIN ] AWK: Loaded 48465 primary data records. [2025-10-21T22:05:10.348391] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:10.351667] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22805 primary records. [2025-10-21T22:05:10.352200] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-10-21T22:05:10.366163] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:10.376146] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 21668 primary records. [2025-10-21T22:05:10.390368] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-10-21T22:05:10.390509] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-10-21T22:05:10.390763] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-10-21T22:05:10.406626] [INFO ] [MAIN ] Derivative Progress: 151/2057 symbols completed. AWR took 1.1s. Estimated remaining: 12m 10s. Rate: 156.6 symbols/min [2025-10-21T22:05:10.407790] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:10.408060] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:10.409452] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48465 primary records. [2025-10-21T22:05:10.409724] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-10-21T22:05:10.425489] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-10-21T22:05:10.426043] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-10-21T22:05:10.428694] [INFO ] [MAIN ] Derivative Progress: 152/2057 symbols completed. AWP took 1.1s. Estimated remaining: 12m 5s. Rate: 157.6 symbols/min [2025-10-21T22:05:10.437458] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:10.445759] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-10-21T22:05:10.445995] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-10-21T22:05:10.448358] [INFO ] [MAIN ] Derivative Progress: 153/2057 symbols completed. AWK took 1.2s. Estimated remaining: 12m 0s. Rate: 158.6 symbols/min [2025-10-21T22:05:10.448673] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:10.462886] [DEBUG] [LOCAL ] AXR: Loaded 2916 existing records from primary storage. [2025-10-21T22:05:10.463069] [INFO ] [MAIN ] AXR: Loaded 2916 primary data records. [2025-10-21T22:05:10.554685] [DEBUG] [LOCAL ] AX: Loaded 27940 existing records from primary storage. [2025-10-21T22:05:10.576422] [INFO ] [MAIN ] AX: Loaded 27940 primary data records. [2025-10-21T22:05:10.984363] [DEBUG] [LOCAL ] AXP: Loaded 53161 existing records from primary storage. [2025-10-21T22:05:11.101206] [INFO ] [MAIN ] AXP: Loaded 53161 primary data records. [2025-10-21T22:05:11.444238] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:11.445690] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:11.445418] [INFO ] [MAIN ] AXR: Generated 1794 derivative records from 2916 primary records. [2025-10-21T22:05:11.446359] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 27940 primary records. [2025-10-21T22:05:11.445817] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-10-21T22:05:11.446446] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-10-21T22:05:11.470040] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-10-21T22:05:11.475833] [DEBUG] [LOCAL ] AXR: Derivative data saved (1794 records). [2025-10-21T22:05:11.475948] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-10-21T22:05:11.478500] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-10-21T22:05:11.478402] [INFO ] [MAIN ] Derivative Progress: 154/2057 symbols completed. AX took 1.1s. Estimated remaining: 12m 8s. Rate: 156.8 symbols/min [2025-10-21T22:05:11.481184] [INFO ] [MAIN ] Derivative Progress: 155/2057 symbols completed. AXR took 1.0s. Estimated remaining: 12m 3s. Rate: 157.8 symbols/min [2025-10-21T22:05:11.481273] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:11.481119] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:11.500597] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:11.501287] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53161 primary records. [2025-10-21T22:05:11.501468] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-10-21T22:05:11.519809] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-10-21T22:05:11.520019] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-10-21T22:05:11.523014] [INFO ] [MAIN ] Derivative Progress: 156/2057 symbols completed. AXP took 1.1s. Estimated remaining: 11m 59s. Rate: 158.7 symbols/min [2025-10-21T22:05:11.523269] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:11.561460] [DEBUG] [LOCAL ] AXS: Loaded 38784 existing records from primary storage. [2025-10-21T22:05:11.562241] [INFO ] [MAIN ] AXS: Loaded 38784 primary data records. [2025-10-21T22:05:11.675890] [DEBUG] [LOCAL ] AXTA: Loaded 52287 existing records from primary storage. [2025-10-21T22:05:11.682051] [DEBUG] [LOCAL ] AYI: Loaded 24331 existing records from primary storage. [2025-10-21T22:05:11.692622] [INFO ] [MAIN ] AXTA: Loaded 52287 primary data records. [2025-10-21T22:05:11.692845] [INFO ] [MAIN ] AYI: Loaded 24331 primary data records. [2025-10-21T22:05:12.568792] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:12.569776] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38784 primary records. [2025-10-21T22:05:12.569994] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-10-21T22:05:12.589836] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-10-21T22:05:12.590752] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-10-21T22:05:12.593004] [INFO ] [MAIN ] Derivative Progress: 157/2057 symbols completed. AXS took 1.1s. Estimated remaining: 12m 7s. Rate: 156.9 symbols/min [2025-10-21T22:05:12.606292] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:12.606724] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:12.607807] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52287 primary records. [2025-10-21T22:05:12.607947] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-10-21T22:05:12.632711] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:12.634795] [INFO ] [MAIN ] AYI: Generated 1793 derivative records from 24331 primary records. [2025-10-21T22:05:12.635763] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-10-21T22:05:12.638665] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-10-21T22:05:12.638966] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-10-21T22:05:12.641372] [INFO ] [MAIN ] Derivative Progress: 158/2057 symbols completed. AXTA took 1.2s. Estimated remaining: 12m 2s. Rate: 157.8 symbols/min [2025-10-21T22:05:12.651029] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:12.658042] [DEBUG] [LOCAL ] AYI: Derivative data saved (1793 records). [2025-10-21T22:05:12.663438] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-10-21T22:05:12.666108] [INFO ] [MAIN ] Derivative Progress: 159/2057 symbols completed. AYI took 1.1s. Estimated remaining: 11m 58s. Rate: 158.7 symbols/min [2025-10-21T22:05:12.666441] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:12.678835] [DEBUG] [LOCAL ] AZZ: Loaded 22911 existing records from primary storage. [2025-10-21T22:05:12.678995] [INFO ] [MAIN ] AZZ: Loaded 22911 primary data records. [2025-10-21T22:05:13.052765] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-21T22:05:13.053630] [INFO ] [MAIN ] BA: Loaded 53790 primary data records. [2025-10-21T22:05:13.061624] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-21T22:05:13.094696] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-10-21T22:05:13.713519] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:13.715531] [INFO ] [MAIN ] AZZ: Generated 1793 derivative records from 22911 primary records. [2025-10-21T22:05:13.718284] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-10-21T22:05:13.741162] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1793 records). [2025-10-21T22:05:13.741574] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-10-21T22:05:13.745450] [INFO ] [MAIN ] Derivative Progress: 160/2057 symbols completed. AZZ took 1.1s. Estimated remaining: 12m 6s. Rate: 156.9 symbols/min [2025-10-21T22:05:13.746722] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:13.762233] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:13.763062] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-10-21T22:05:13.763225] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-10-21T22:05:13.799367] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:13.799487] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-10-21T22:05:13.799727] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-10-21T22:05:13.802302] [INFO ] [MAIN ] Derivative Progress: 161/2057 symbols completed. BABA took 1.1s. Estimated remaining: 12m 1s. Rate: 157.7 symbols/min [2025-10-21T22:05:13.802502] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:13.803867] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53790 primary records. [2025-10-21T22:05:13.804045] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-10-21T22:05:13.837552] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-10-21T22:05:13.837906] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-10-21T22:05:13.840522] [INFO ] [MAIN ] Derivative Progress: 162/2057 symbols completed. BA took 1.2s. Estimated remaining: 11m 57s. Rate: 158.6 symbols/min [2025-10-21T22:05:13.840932] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:13.861984] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-21T22:05:13.862251] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-10-21T22:05:14.108939] [DEBUG] [LOCAL ] BAH: Loaded 51653 existing records from primary storage. [2025-10-21T22:05:14.247555] [INFO ] [MAIN ] BAH: Loaded 51653 primary data records. [2025-10-21T22:05:14.256964] [DEBUG] [LOCAL ] BAK: Loaded 39479 existing records from primary storage. [2025-10-21T22:05:14.293600] [INFO ] [MAIN ] BAK: Loaded 39479 primary data records. [2025-10-21T22:05:14.930875] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:14.932720] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-10-21T22:05:14.932955] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-10-21T22:05:14.955554] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-10-21T22:05:14.968288] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-10-21T22:05:14.971099] [INFO ] [MAIN ] Derivative Progress: 163/2057 symbols completed. BAC took 1.2s. Estimated remaining: 12m 5s. Rate: 156.7 symbols/min [2025-10-21T22:05:14.968539] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:14.972291] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51653 primary records. [2025-10-21T22:05:14.972595] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-10-21T22:05:14.989485] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-10-21T22:05:14.989607] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-10-21T22:05:14.991706] [INFO ] [MAIN ] Derivative Progress: 164/2057 symbols completed. BAH took 1.2s. Estimated remaining: 12m 1s. Rate: 157.6 symbols/min [2025-10-21T22:05:15.007593] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:15.008231] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 39479 primary records. [2025-10-21T22:05:15.008293] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-10-21T22:05:15.025974] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-10-21T22:05:15.026058] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-10-21T22:05:15.028794] [INFO ] [MAIN ] Derivative Progress: 165/2057 symbols completed. BAK took 1.2s. Estimated remaining: 11m 56s. Rate: 158.5 symbols/min [2025-10-21T22:05:15.029177] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:15.029278] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:15.029367] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:15.123000] [DEBUG] [LOCAL ] BALL: Loaded 51939 existing records from primary storage. [2025-10-21T22:05:15.137635] [INFO ] [MAIN ] BALL: Loaded 51939 primary data records. [2025-10-21T22:05:15.139116] [DEBUG] [LOCAL ] BANC: Loaded 51384 existing records from primary storage. [2025-10-21T22:05:15.139229] [INFO ] [MAIN ] BANC: Loaded 51384 primary data records. [2025-10-21T22:05:15.187520] [DEBUG] [LOCAL ] BAM: Loaded 52090 existing records from primary storage. [2025-10-21T22:05:15.231505] [INFO ] [MAIN ] BAM: Loaded 52090 primary data records. [2025-10-21T22:05:16.140384] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:16.149360] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51939 primary records. [2025-10-21T22:05:16.155261] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-10-21T22:05:16.155160] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:16.157919] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51384 primary records. [2025-10-21T22:05:16.158927] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-10-21T22:05:16.176672] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-10-21T22:05:16.184063] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-10-21T22:05:16.200042] [INFO ] [MAIN ] Derivative Progress: 166/2057 symbols completed. BALL took 1.2s. Estimated remaining: 12m 5s. Rate: 156.5 symbols/min [2025-10-21T22:05:16.203462] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:16.203137] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:16.206793] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52090 primary records. [2025-10-21T22:05:16.209037] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-10-21T22:05:16.209150] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-10-21T22:05:16.212079] [INFO ] [MAIN ] Derivative Progress: 167/2057 symbols completed. BANC took 1.2s. Estimated remaining: 12m 0s. Rate: 157.4 symbols/min [2025-10-21T22:05:16.212257] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:16.212727] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-10-21T22:05:16.232531] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-10-21T22:05:16.232911] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-10-21T22:05:16.235516] [INFO ] [MAIN ] Derivative Progress: 168/2057 symbols completed. BAM took 1.2s. Estimated remaining: 11m 56s. Rate: 158.3 symbols/min [2025-10-21T22:05:16.236052] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:16.282717] [DEBUG] [LOCAL ] BAP: Loaded 25766 existing records from primary storage. [2025-10-21T22:05:16.283971] [INFO ] [MAIN ] BAP: Loaded 25766 primary data records. [2025-10-21T22:05:16.283793] [DEBUG] [LOCAL ] BARK: Loaded 38230 existing records from primary storage. [2025-10-21T22:05:16.284155] [INFO ] [MAIN ] BARK: Loaded 38230 primary data records. [2025-10-21T22:05:16.976998] [DEBUG] [LOCAL ] BAX: Loaded 53537 existing records from primary storage. [2025-10-21T22:05:16.977985] [INFO ] [MAIN ] BAX: Loaded 53537 primary data records. [2025-10-21T22:05:17.311108] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:17.317543] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 25766 primary records. [2025-10-21T22:05:17.316880] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:17.317689] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-10-21T22:05:17.318931] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38230 primary records. [2025-10-21T22:05:17.319252] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-10-21T22:05:17.345443] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-10-21T22:05:17.349918] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-10-21T22:05:17.350014] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-10-21T22:05:17.352839] [INFO ] [MAIN ] Derivative Progress: 169/2057 symbols completed. BARK took 1.1s. Estimated remaining: 12m 4s. Rate: 156.5 symbols/min [2025-10-21T22:05:17.353000] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:17.348745] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-10-21T22:05:17.356268] [INFO ] [MAIN ] Derivative Progress: 170/2057 symbols completed. BAP took 1.2s. Estimated remaining: 11m 59s. Rate: 157.4 symbols/min [2025-10-21T22:05:17.357397] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:17.371847] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:17.372437] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53537 primary records. [2025-10-21T22:05:17.373153] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-10-21T22:05:17.393924] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-10-21T22:05:17.394307] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-10-21T22:05:17.397026] [INFO ] [MAIN ] Derivative Progress: 171/2057 symbols completed. BAX took 1.2s. Estimated remaining: 11m 55s. Rate: 158.2 symbols/min [2025-10-21T22:05:17.397494] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:17.452494] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-21T22:05:17.468710] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-10-21T22:05:17.506347] [DEBUG] [LOCAL ] BB: Loaded 52882 existing records from primary storage. [2025-10-21T22:05:17.550262] [INFO ] [MAIN ] BB: Loaded 52882 primary data records. [2025-10-21T22:05:17.684058] [DEBUG] [LOCAL ] BBAR: Loaded 42660 existing records from primary storage. [2025-10-21T22:05:17.722500] [INFO ] [MAIN ] BBAR: Loaded 42660 primary data records. [2025-10-21T22:05:18.459732] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:18.460861] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-10-21T22:05:18.461713] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-10-21T22:05:18.479151] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-10-21T22:05:18.479312] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-10-21T22:05:18.481140] [INFO ] [MAIN ] Derivative Progress: 172/2057 symbols completed. BBAI took 1.1s. Estimated remaining: 12m 3s. Rate: 156.5 symbols/min [2025-10-21T22:05:18.481410] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:18.495905] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:18.496761] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52882 primary records. [2025-10-21T22:05:18.496980] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-10-21T22:05:18.523567] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-10-21T22:05:18.529426] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-10-21T22:05:18.529345] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:18.531882] [INFO ] [MAIN ] Derivative Progress: 173/2057 symbols completed. BB took 1.2s. Estimated remaining: 11m 59s. Rate: 157.3 symbols/min [2025-10-21T22:05:18.532990] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:18.532810] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 42660 primary records. [2025-10-21T22:05:18.533121] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-10-21T22:05:18.564252] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-10-21T22:05:18.564544] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-10-21T22:05:18.567567] [INFO ] [MAIN ] Derivative Progress: 174/2057 symbols completed. BBAR took 1.2s. Estimated remaining: 11m 54s. Rate: 158.1 symbols/min [2025-10-21T22:05:18.567915] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:18.600755] [DEBUG] [LOCAL ] BBDO: Loaded 4986 existing records from primary storage. [2025-10-21T22:05:18.597521] [DEBUG] [LOCAL ] BBD: Loaded 53271 existing records from primary storage. [2025-10-21T22:05:18.600955] [INFO ] [MAIN ] BBD: Loaded 53271 primary data records. [2025-10-21T22:05:18.601109] [INFO ] [MAIN ] BBDO: Loaded 4986 primary data records. [2025-10-21T22:05:18.813986] [DEBUG] [LOCAL ] BBDC: Loaded 32985 existing records from primary storage. [2025-10-21T22:05:18.817715] [INFO ] [MAIN ] BBDC: Loaded 32985 primary data records. [2025-10-21T22:05:19.521035] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:19.529412] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53271 primary records. [2025-10-21T22:05:19.529509] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-10-21T22:05:19.542818] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:19.552400] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-10-21T22:05:19.551266] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 4986 primary records. [2025-10-21T22:05:19.552528] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-10-21T22:05:19.553195] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-10-21T22:05:19.560967] [INFO ] [MAIN ] Derivative Progress: 175/2057 symbols completed. BBD took 1.1s. Estimated remaining: 12m 1s. Rate: 156.7 symbols/min [2025-10-21T22:05:19.561121] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:19.576124] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-10-21T22:05:19.581598] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-10-21T22:05:19.581416] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:19.583951] [INFO ] [MAIN ] Derivative Progress: 176/2057 symbols completed. BBDO took 1.0s. Estimated remaining: 11m 56s. Rate: 157.5 symbols/min [2025-10-21T22:05:19.584178] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:19.585010] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 32985 primary records. [2025-10-21T22:05:19.585302] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-10-21T22:05:19.607284] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-10-21T22:05:19.607473] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-10-21T22:05:19.610431] [INFO ] [MAIN ] Derivative Progress: 177/2057 symbols completed. BBDC took 1.1s. Estimated remaining: 11m 52s. Rate: 158.4 symbols/min [2025-10-21T22:05:19.610668] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:19.616216] [DEBUG] [LOCAL ] BBU: Loaded 5757 existing records from primary storage. [2025-10-21T22:05:19.616529] [INFO ] [MAIN ] BBU: Loaded 5757 primary data records. [2025-10-21T22:05:19.653527] [DEBUG] [LOCAL ] BBN: Loaded 17941 existing records from primary storage. [2025-10-21T22:05:19.688360] [INFO ] [MAIN ] BBN: Loaded 17941 primary data records. [2025-10-21T22:05:19.828697] [DEBUG] [LOCAL ] BBUC: Loaded 13958 existing records from primary storage. [2025-10-21T22:05:19.839237] [INFO ] [MAIN ] BBUC: Loaded 13958 primary data records. [2025-10-21T22:05:20.597346] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:20.598221] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 5757 primary records. [2025-10-21T22:05:20.598418] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-10-21T22:05:20.629547] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-10-21T22:05:20.630043] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:20.630166] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-10-21T22:05:20.630899] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 17941 primary records. [2025-10-21T22:05:20.631144] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-10-21T22:05:20.640288] [INFO ] [MAIN ] Derivative Progress: 178/2057 symbols completed. BBU took 1.1s. Estimated remaining: 11m 59s. Rate: 156.9 symbols/min [2025-10-21T22:05:20.646257] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:20.657266] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13958 primary records. [2025-10-21T22:05:20.663427] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-10-21T22:05:20.665567] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-10-21T22:05:20.665819] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-10-21T22:05:20.668385] [INFO ] [MAIN ] Derivative Progress: 179/2057 symbols completed. BBN took 1.1s. Estimated remaining: 11m 55s. Rate: 157.7 symbols/min [2025-10-21T22:05:20.682255] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-10-21T22:05:20.682312] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-10-21T22:05:20.684578] [INFO ] [MAIN ] Derivative Progress: 180/2057 symbols completed. BBUC took 1.1s. Estimated remaining: 11m 50s. Rate: 158.5 symbols/min [2025-10-21T22:05:20.684991] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:20.684940] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:20.685100] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:20.714042] [DEBUG] [LOCAL ] BBW: Loaded 27246 existing records from primary storage. [2025-10-21T22:05:20.723555] [INFO ] [MAIN ] BBW: Loaded 27246 primary data records. [2025-10-21T22:05:20.856089] [DEBUG] [LOCAL ] BBVA: Loaded 49122 existing records from primary storage. [2025-10-21T22:05:20.866868] [INFO ] [MAIN ] BBVA: Loaded 49122 primary data records. [2025-10-21T22:05:20.968346] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-21T22:05:21.102555] [INFO ] [MAIN ] BBWI: Loaded 53591 primary data records. [2025-10-21T22:05:21.673386] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:21.674421] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 27246 primary records. [2025-10-21T22:05:21.674522] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-10-21T22:05:21.692756] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-10-21T22:05:21.693462] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-10-21T22:05:21.695467] [INFO ] [MAIN ] Derivative Progress: 181/2057 symbols completed. BBW took 1.0s. Estimated remaining: 11m 57s. Rate: 157.1 symbols/min [2025-10-21T22:05:21.695877] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:21.709803] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:21.710616] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49122 primary records. [2025-10-21T22:05:21.710835] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-10-21T22:05:21.743429] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-10-21T22:05:21.743810] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-10-21T22:05:21.747192] [INFO ] [MAIN ] Derivative Progress: 182/2057 symbols completed. BBVA took 1.1s. Estimated remaining: 11m 53s. Rate: 157.8 symbols/min [2025-10-21T22:05:21.747608] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:21.747901] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:21.748666] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53591 primary records. [2025-10-21T22:05:21.749103] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-10-21T22:05:21.774526] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-10-21T22:05:21.774695] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-10-21T22:05:21.777109] [INFO ] [MAIN ] Derivative Progress: 183/2057 symbols completed. BBWI took 1.1s. Estimated remaining: 11m 49s. Rate: 158.6 symbols/min [2025-10-21T22:05:21.777408] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:21.793148] [DEBUG] [LOCAL ] BC: Loaded 43912 existing records from primary storage. [2025-10-21T22:05:21.793305] [INFO ] [MAIN ] BC: Loaded 43912 primary data records. [2025-10-21T22:05:21.932525] [DEBUG] [LOCAL ] BCAT: Loaded 34272 existing records from primary storage. [2025-10-21T22:05:21.932768] [INFO ] [MAIN ] BCAT: Loaded 34272 primary data records. [2025-10-21T22:05:22.032361] [DEBUG] [LOCAL ] BCC: Loaded 28741 existing records from primary storage. [2025-10-21T22:05:22.066232] [INFO ] [MAIN ] BCC: Loaded 28741 primary data records. [2025-10-21T22:05:22.796496] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:22.797377] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34272 primary records. [2025-10-21T22:05:22.797609] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-10-21T22:05:22.821638] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:22.839966] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 43912 primary records. [2025-10-21T22:05:22.841260] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:22.840987] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-10-21T22:05:22.843397] [INFO ] [MAIN ] BCC: Generated 1793 derivative records from 28741 primary records. [2025-10-21T22:05:22.845838] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-10-21T22:05:22.852924] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-10-21T22:05:22.859766] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-10-21T22:05:22.862331] [INFO ] [MAIN ] Derivative Progress: 184/2057 symbols completed. BCAT took 1.1s. Estimated remaining: 11m 56s. Rate: 157.0 symbols/min [2025-10-21T22:05:22.863485] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-10-21T22:05:22.863686] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:22.863841] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-10-21T22:05:22.865774] [INFO ] [MAIN ] Derivative Progress: 185/2057 symbols completed. BC took 1.2s. Estimated remaining: 11m 51s. Rate: 157.9 symbols/min [2025-10-21T22:05:22.866423] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:22.883056] [DEBUG] [LOCAL ] BCC: Derivative data saved (1793 records). [2025-10-21T22:05:22.883373] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-10-21T22:05:22.886450] [INFO ] [MAIN ] Derivative Progress: 186/2057 symbols completed. BCC took 1.1s. Estimated remaining: 11m 47s. Rate: 158.7 symbols/min [2025-10-21T22:05:22.886689] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:22.930387] [DEBUG] [LOCAL ] BCH: Loaded 30256 existing records from primary storage. [2025-10-21T22:05:22.929378] [DEBUG] [LOCAL ] BCO: Loaded 25135 existing records from primary storage. [2025-10-21T22:05:22.930548] [INFO ] [MAIN ] BCO: Loaded 25135 primary data records. [2025-10-21T22:05:22.951394] [INFO ] [MAIN ] BCH: Loaded 30256 primary data records. [2025-10-21T22:05:23.384734] [DEBUG] [LOCAL ] BCE: Loaded 52267 existing records from primary storage. [2025-10-21T22:05:23.406543] [INFO ] [MAIN ] BCE: Loaded 52267 primary data records. [2025-10-21T22:05:23.920457] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:23.921921] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 25135 primary records. [2025-10-21T22:05:23.929940] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-10-21T22:05:23.936185] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:23.952745] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-10-21T22:05:23.948365] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 30256 primary records. [2025-10-21T22:05:23.952896] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-10-21T22:05:23.953291] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-10-21T22:05:23.955898] [INFO ] [MAIN ] Derivative Progress: 187/2057 symbols completed. BCO took 1.1s. Estimated remaining: 11m 54s. Rate: 157.1 symbols/min [2025-10-21T22:05:23.956069] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:23.974292] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-10-21T22:05:23.974572] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-10-21T22:05:23.977564] [INFO ] [MAIN ] Derivative Progress: 188/2057 symbols completed. BCH took 1.1s. Estimated remaining: 11m 50s. Rate: 157.9 symbols/min [2025-10-21T22:05:23.979239] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:23.993172] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:23.993946] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52267 primary records. [2025-10-21T22:05:23.994060] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-10-21T22:05:24.011882] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-10-21T22:05:24.012071] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-10-21T22:05:24.015020] [INFO ] [MAIN ] Derivative Progress: 189/2057 symbols completed. BCE took 1.2s. Estimated remaining: 11m 46s. Rate: 158.7 symbols/min [2025-10-21T22:05:24.015370] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:24.055738] [DEBUG] [LOCAL ] BCSF: Loaded 28246 existing records from primary storage. [2025-10-21T22:05:24.055992] [INFO ] [MAIN ] BCSF: Loaded 28246 primary data records. [2025-10-21T22:05:24.144912] [DEBUG] [LOCAL ] BCX: Loaded 22127 existing records from primary storage. [2025-10-21T22:05:24.177818] [INFO ] [MAIN ] BCX: Loaded 22127 primary data records. [2025-10-21T22:05:24.192558] [DEBUG] [LOCAL ] BCS: Loaded 53441 existing records from primary storage. [2025-10-21T22:05:24.245306] [INFO ] [MAIN ] BCS: Loaded 53441 primary data records. [2025-10-21T22:05:25.005396] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:25.006469] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 28246 primary records. [2025-10-21T22:05:25.006848] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-10-21T22:05:25.020107] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:25.027995] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 22127 primary records. [2025-10-21T22:05:25.028267] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-10-21T22:05:25.036514] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-10-21T22:05:25.036709] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-10-21T22:05:25.038533] [INFO ] [MAIN ] Derivative Progress: 190/2057 symbols completed. BCSF took 1.1s. Estimated remaining: 11m 52s. Rate: 157.3 symbols/min [2025-10-21T22:05:25.047225] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:25.068994] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-10-21T22:05:25.067972] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:25.069820] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53441 primary records. [2025-10-21T22:05:25.069907] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-10-21T22:05:25.072689] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-10-21T22:05:25.072613] [INFO ] [MAIN ] Derivative Progress: 191/2057 symbols completed. BCX took 1.1s. Estimated remaining: 11m 48s. Rate: 158.0 symbols/min [2025-10-21T22:05:25.073217] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:25.094967] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-10-21T22:05:25.095088] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-10-21T22:05:25.097531] [INFO ] [MAIN ] Derivative Progress: 192/2057 symbols completed. BCS took 1.1s. Estimated remaining: 11m 45s. Rate: 158.8 symbols/min [2025-10-21T22:05:25.097796] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:25.108565] [DEBUG] [LOCAL ] BDC: Loaded 24193 existing records from primary storage. [2025-10-21T22:05:25.108794] [INFO ] [MAIN ] BDC: Loaded 24193 primary data records. [2025-10-21T22:05:25.244302] [DEBUG] [LOCAL ] BDJ: Loaded 29386 existing records from primary storage. [2025-10-21T22:05:25.244883] [INFO ] [MAIN ] BDJ: Loaded 29386 primary data records. [2025-10-21T22:05:25.580404] [DEBUG] [LOCAL ] BDN: Loaded 47633 existing records from primary storage. [2025-10-21T22:05:25.590875] [INFO ] [MAIN ] BDN: Loaded 47633 primary data records. [2025-10-21T22:05:26.130226] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:26.131397] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 24193 primary records. [2025-10-21T22:05:26.131613] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-10-21T22:05:26.163799] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-10-21T22:05:26.164537] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:26.164250] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-10-21T22:05:26.167593] [INFO ] [MAIN ] Derivative Progress: 193/2057 symbols completed. BDC took 1.1s. Estimated remaining: 11m 51s. Rate: 157.3 symbols/min [2025-10-21T22:05:26.165380] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29386 primary records. [2025-10-21T22:05:26.168031] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-10-21T22:05:26.183712] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-10-21T22:05:26.183872] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-10-21T22:05:26.186083] [INFO ] [MAIN ] Derivative Progress: 194/2057 symbols completed. BDJ took 1.1s. Estimated remaining: 11m 47s. Rate: 158.1 symbols/min [2025-10-21T22:05:26.200555] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:26.201084] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47633 primary records. [2025-10-21T22:05:26.201142] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-10-21T22:05:26.215558] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-10-21T22:05:26.215616] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-10-21T22:05:26.218882] [INFO ] [MAIN ] Derivative Progress: 195/2057 symbols completed. BDN took 1.1s. Estimated remaining: 11m 43s. Rate: 158.8 symbols/min [2025-10-21T22:05:26.219243] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:26.219378] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:26.219340] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:26.296603] [DEBUG] [LOCAL ] BEN: Loaded 53118 existing records from primary storage. [2025-10-21T22:05:26.296764] [INFO ] [MAIN ] BEN: Loaded 53118 primary data records. [2025-10-21T22:05:26.442473] [DEBUG] [LOCAL ] BEKE: Loaded 53198 existing records from primary storage. [2025-10-21T22:05:26.452922] [INFO ] [MAIN ] BEKE: Loaded 53198 primary data records. [2025-10-21T22:05:26.436620] [DEBUG] [LOCAL ] BDX: Loaded 52157 existing records from primary storage. [2025-10-21T22:05:26.471192] [INFO ] [MAIN ] BDX: Loaded 52157 primary data records. [2025-10-21T22:05:27.263028] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:27.264128] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53118 primary records. [2025-10-21T22:05:27.264399] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-10-21T22:05:27.280828] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-10-21T22:05:27.281005] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-10-21T22:05:27.284022] [INFO ] [MAIN ] Derivative Progress: 196/2057 symbols completed. BEN took 1.1s. Estimated remaining: 11m 50s. Rate: 157.4 symbols/min [2025-10-21T22:05:27.285200] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:27.315974] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:27.316380] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:27.317257] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53198 primary records. [2025-10-21T22:05:27.318099] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52157 primary records. [2025-10-21T22:05:27.318184] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-10-21T22:05:27.318339] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-10-21T22:05:27.351748] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-10-21T22:05:27.351845] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-10-21T22:05:27.349081] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-10-21T22:05:27.354817] [INFO ] [MAIN ] Derivative Progress: 197/2057 symbols completed. BEKE took 1.1s. Estimated remaining: 11m 46s. Rate: 158.0 symbols/min [2025-10-21T22:05:27.355087] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-10-21T22:05:27.370825] [INFO ] [MAIN ] Derivative Progress: 198/2057 symbols completed. BDX took 1.1s. Estimated remaining: 11m 42s. Rate: 158.8 symbols/min [2025-10-21T22:05:27.370689] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:27.371534] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:27.389099] [DEBUG] [LOCAL ] BEP: Loaded 38965 existing records from primary storage. [2025-10-21T22:05:27.391822] [DEBUG] [LOCAL ] BEPH: Loaded 4924 existing records from primary storage. [2025-10-21T22:05:27.389293] [INFO ] [MAIN ] BEP: Loaded 38965 primary data records. [2025-10-21T22:05:27.392098] [INFO ] [MAIN ] BEPH: Loaded 4924 primary data records. [2025-10-21T22:05:27.867717] [DEBUG] [LOCAL ] BEPC: Loaded 46391 existing records from primary storage. [2025-10-21T22:05:27.881556] [INFO ] [MAIN ] BEPC: Loaded 46391 primary data records. [2025-10-21T22:05:28.367602] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:28.368397] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:28.369165] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38965 primary records. [2025-10-21T22:05:28.369868] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 4924 primary records. [2025-10-21T22:05:28.369989] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-10-21T22:05:28.370081] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-10-21T22:05:28.399313] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-10-21T22:05:28.400983] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-10-21T22:05:28.404061] [INFO ] [MAIN ] Derivative Progress: 199/2057 symbols completed. BEPH took 1.0s. Estimated remaining: 11m 48s. Rate: 157.4 symbols/min [2025-10-21T22:05:28.404405] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:28.402185] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-10-21T22:05:28.405315] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-10-21T22:05:28.407584] [INFO ] [MAIN ] Derivative Progress: 200/2057 symbols completed. BEP took 1.1s. Estimated remaining: 11m 44s. Rate: 158.2 symbols/min [2025-10-21T22:05:28.408072] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:28.413296] [DEBUG] [LOCAL ] BEPI: Loaded 3587 existing records from primary storage. [2025-10-21T22:05:28.414282] [INFO ] [MAIN ] BEPI: Loaded 3587 primary data records. [2025-10-21T22:05:28.437732] [DEBUG] [LOCAL ] BEPJ: Loaded 3070 existing records from primary storage. [2025-10-21T22:05:28.472807] [INFO ] [MAIN ] BEPJ: Loaded 3070 primary data records. [2025-10-21T22:05:28.583434] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:28.618335] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46391 primary records. [2025-10-21T22:05:28.628685] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-10-21T22:05:29.029609] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-10-21T22:05:29.037687] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-10-21T22:05:29.040512] [INFO ] [MAIN ] Derivative Progress: 201/2057 symbols completed. BEPC took 1.7s. Estimated remaining: 11m 46s. Rate: 157.7 symbols/min [2025-10-21T22:05:29.040796] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:29.065980] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:29.066952] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3587 primary records. [2025-10-21T22:05:29.067062] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-10-21T22:05:29.091048] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-10-21T22:05:29.092492] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-10-21T22:05:29.094775] [INFO ] [MAIN ] Derivative Progress: 202/2057 symbols completed. BEPI took 0.7s. Estimated remaining: 11m 43s. Rate: 158.3 symbols/min [2025-10-21T22:05:29.095695] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:29.106872] [DEBUG] [LOCAL ] BFAM: Loaded 33837 existing records from primary storage. [2025-10-21T22:05:29.119386] [INFO ] [MAIN ] BFAM: Loaded 33837 primary data records. [2025-10-21T22:05:29.140864] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:29.157167] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3070 primary records. [2025-10-21T22:05:29.185728] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-10-21T22:05:29.237221] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-10-21T22:05:29.243028] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-10-21T22:05:29.256806] [INFO ] [MAIN ] Derivative Progress: 203/2057 symbols completed. BEPJ took 0.8s. Estimated remaining: 11m 41s. Rate: 158.8 symbols/min [2025-10-21T22:05:29.262794] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:29.456851] [DEBUG] [LOCAL ] BFH: Loaded 41425 existing records from primary storage. [2025-10-21T22:05:29.461991] [INFO ] [MAIN ] BFH: Loaded 41425 primary data records. [2025-10-21T22:05:29.462386] [DEBUG] [LOCAL ] BFK: Loaded 13822 existing records from primary storage. [2025-10-21T22:05:29.493449] [INFO ] [MAIN ] BFK: Loaded 13822 primary data records. [2025-10-21T22:05:30.107422] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:30.108491] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 33837 primary records. [2025-10-21T22:05:30.108875] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-10-21T22:05:30.128168] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-10-21T22:05:30.129408] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-10-21T22:05:30.132243] [INFO ] [MAIN ] Derivative Progress: 204/2057 symbols completed. BFAM took 1.1s. Estimated remaining: 11m 45s. Rate: 157.8 symbols/min [2025-10-21T22:05:30.133098] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:30.148045] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:30.149723] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 41425 primary records. [2025-10-21T22:05:30.150220] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-10-21T22:05:30.178049] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:30.183372] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13822 primary records. [2025-10-21T22:05:30.183860] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-10-21T22:05:30.186020] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-10-21T22:05:30.186217] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-10-21T22:05:30.189176] [INFO ] [MAIN ] Derivative Progress: 205/2057 symbols completed. BFH took 1.1s. Estimated remaining: 11m 41s. Rate: 158.4 symbols/min [2025-10-21T22:05:30.200111] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:30.204271] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-10-21T22:05:30.204466] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-10-21T22:05:30.207373] [INFO ] [MAIN ] Derivative Progress: 206/2057 symbols completed. BFK took 0.9s. Estimated remaining: 11m 38s. Rate: 159.2 symbols/min [2025-10-21T22:05:30.207819] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:30.229802] [DEBUG] [LOCAL ] BFS: Loaded 9585 existing records from primary storage. [2025-10-21T22:05:30.229932] [INFO ] [MAIN ] BFS: Loaded 9585 primary data records. [2025-10-21T22:05:30.350436] [DEBUG] [LOCAL ] BFLY: Loaded 51859 existing records from primary storage. [2025-10-21T22:05:30.367039] [INFO ] [MAIN ] BFLY: Loaded 51859 primary data records. [2025-10-21T22:05:30.753069] [DEBUG] [LOCAL ] BG: Loaded 50586 existing records from primary storage. [2025-10-21T22:05:30.865895] [INFO ] [MAIN ] BG: Loaded 50586 primary data records. [2025-10-21T22:05:31.184732] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:31.186531] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9585 primary records. [2025-10-21T22:05:31.186780] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-10-21T22:05:31.206520] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-10-21T22:05:31.214461] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-10-21T22:05:31.220785] [INFO ] [MAIN ] Derivative Progress: 207/2057 symbols completed. BFS took 1.0s. Estimated remaining: 11m 43s. Rate: 157.9 symbols/min [2025-10-21T22:05:31.222240] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:31.223144] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:31.224008] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51859 primary records. [2025-10-21T22:05:31.224150] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-10-21T22:05:31.244327] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-10-21T22:05:31.248547] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-10-21T22:05:31.263828] [INFO ] [MAIN ] Derivative Progress: 208/2057 symbols completed. BFLY took 1.1s. Estimated remaining: 11m 40s. Rate: 158.6 symbols/min [2025-10-21T22:05:31.264232] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:31.265015] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50586 primary records. [2025-10-21T22:05:31.265282] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-10-21T22:05:31.280280] [DEBUG] [LOCAL ] BGB: Loaded 17799 existing records from primary storage. [2025-10-21T22:05:31.284437] [INFO ] [MAIN ] BGB: Loaded 17799 primary data records. [2025-10-21T22:05:31.317978] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-10-21T22:05:31.318056] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-10-21T22:05:31.320400] [INFO ] [MAIN ] Derivative Progress: 209/2057 symbols completed. BG took 1.1s. Estimated remaining: 11m 36s. Rate: 159.2 symbols/min [2025-10-21T22:05:31.619088] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:31.619714] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17799 primary records. [2025-10-21T22:05:31.619775] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-10-21T22:05:31.635860] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-10-21T22:05:31.635915] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-10-21T22:05:31.637939] [INFO ] [MAIN ] Derivative Progress: 210/2057 symbols completed. BGB took 0.4s. Estimated remaining: 11m 36s. Rate: 159.3 symbols/min [2025-10-21T22:05:31.638534] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:31.638474] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:31.639315] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:31.658903] [DEBUG] [LOCAL ] BGR: Loaded 13494 existing records from primary storage. [2025-10-21T22:05:31.659046] [INFO ] [MAIN ] BGR: Loaded 13494 primary data records. [2025-10-21T22:05:31.766296] [DEBUG] [LOCAL ] BGH: Loaded 17232 existing records from primary storage. [2025-10-21T22:05:31.769723] [INFO ] [MAIN ] BGH: Loaded 17232 primary data records. [2025-10-21T22:05:32.117540] [DEBUG] [LOCAL ] BGS: Loaded 50552 existing records from primary storage. [2025-10-21T22:05:32.128921] [INFO ] [MAIN ] BGS: Loaded 50552 primary data records. [2025-10-21T22:05:32.607295] [DEBUG] [MAIN ] BGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:32.608136] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13494 primary records. [2025-10-21T22:05:32.608928] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-10-21T22:05:32.625634] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-10-21T22:05:32.626405] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-10-21T22:05:32.629817] [INFO ] [MAIN ] Derivative Progress: 211/2057 symbols completed. BGR took 1.0s. Estimated remaining: 11m 41s. Rate: 158.1 symbols/min [2025-10-21T22:05:32.630877] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:32.644768] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:32.645497] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 17232 primary records. [2025-10-21T22:05:32.645584] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-10-21T22:05:32.667147] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-10-21T22:05:32.667320] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-10-21T22:05:32.669577] [INFO ] [MAIN ] Derivative Progress: 212/2057 symbols completed. BGH took 1.0s. Estimated remaining: 11m 37s. Rate: 158.8 symbols/min [2025-10-21T22:05:32.669819] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:32.682807] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:32.683740] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50552 primary records. [2025-10-21T22:05:32.683895] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-10-21T22:05:32.690416] [DEBUG] [LOCAL ] BGT: Loaded 16274 existing records from primary storage. [2025-10-21T22:05:32.690601] [INFO ] [MAIN ] BGT: Loaded 16274 primary data records. [2025-10-21T22:05:32.782277] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-10-21T22:05:32.804689] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-10-21T22:05:32.802466] [DEBUG] [LOCAL ] BGX: Loaded 11249 existing records from primary storage. [2025-10-21T22:05:32.813270] [INFO ] [MAIN ] BGX: Loaded 11249 primary data records. [2025-10-21T22:05:32.816103] [INFO ] [MAIN ] Derivative Progress: 213/2057 symbols completed. BGS took 1.2s. Estimated remaining: 11m 35s. Rate: 159.2 symbols/min [2025-10-21T22:05:32.816275] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:33.141815] [DEBUG] [LOCAL ] BGY: Loaded 21500 existing records from primary storage. [2025-10-21T22:05:33.173681] [INFO ] [MAIN ] BGY: Loaded 21500 primary data records. [2025-10-21T22:05:33.672263] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:33.673588] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16274 primary records. [2025-10-21T22:05:33.673959] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-10-21T22:05:33.689898] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-10-21T22:05:33.691906] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-10-21T22:05:33.694004] [INFO ] [MAIN ] Derivative Progress: 214/2057 symbols completed. BGT took 1.1s. Estimated remaining: 11m 39s. Rate: 158.2 symbols/min [2025-10-21T22:05:33.694393] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:33.710422] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:33.711401] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 11249 primary records. [2025-10-21T22:05:33.711749] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-10-21T22:05:33.729135] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-10-21T22:05:33.729862] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-10-21T22:05:33.734149] [INFO ] [MAIN ] Derivative Progress: 215/2057 symbols completed. BGX took 1.1s. Estimated remaining: 11m 36s. Rate: 158.9 symbols/min [2025-10-21T22:05:33.734704] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:33.749364] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:33.750213] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 21500 primary records. [2025-10-21T22:05:33.760260] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-10-21T22:05:33.782552] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-10-21T22:05:33.795896] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-10-21T22:05:33.798563] [INFO ] [MAIN ] Derivative Progress: 216/2057 symbols completed. BGY took 1.0s. Estimated remaining: 11m 32s. Rate: 159.5 symbols/min [2025-10-21T22:05:33.798844] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:33.800383] [DEBUG] [LOCAL ] BHC: Loaded 46640 existing records from primary storage. [2025-10-21T22:05:33.800777] [INFO ] [MAIN ] BHC: Loaded 46640 primary data records. [2025-10-21T22:05:33.845108] [DEBUG] [LOCAL ] BHE: Loaded 23786 existing records from primary storage. [2025-10-21T22:05:33.883803] [INFO ] [MAIN ] BHE: Loaded 23786 primary data records. [2025-10-21T22:05:34.106936] [DEBUG] [LOCAL ] BHK: Loaded 23875 existing records from primary storage. [2025-10-21T22:05:34.117529] [INFO ] [MAIN ] BHK: Loaded 23875 primary data records. [2025-10-21T22:05:34.736451] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:34.737588] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46640 primary records. [2025-10-21T22:05:34.737863] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-10-21T22:05:34.761908] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:34.764962] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 23786 primary records. [2025-10-21T22:05:34.765314] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-10-21T22:05:34.767115] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-10-21T22:05:34.767328] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-10-21T22:05:34.771066] [INFO ] [MAIN ] Derivative Progress: 217/2057 symbols completed. BHC took 1.1s. Estimated remaining: 11m 37s. Rate: 158.4 symbols/min [2025-10-21T22:05:34.772004] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:34.798381] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-10-21T22:05:34.803838] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-10-21T22:05:34.806740] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:34.806342] [INFO ] [MAIN ] Derivative Progress: 218/2057 symbols completed. BHE took 1.1s. Estimated remaining: 11m 34s. Rate: 159.0 symbols/min [2025-10-21T22:05:34.806940] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:34.808079] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 23875 primary records. [2025-10-21T22:05:34.808328] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-10-21T22:05:34.827626] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-10-21T22:05:34.827930] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-10-21T22:05:34.832208] [INFO ] [MAIN ] Derivative Progress: 219/2057 symbols completed. BHK took 1.0s. Estimated remaining: 11m 31s. Rate: 159.7 symbols/min [2025-10-21T22:05:34.832706] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:34.909238] [DEBUG] [LOCAL ] BHP: Loaded 53368 existing records from primary storage. [2025-10-21T22:05:34.922319] [INFO ] [MAIN ] BHP: Loaded 53368 primary data records. [2025-10-21T22:05:34.923147] [DEBUG] [LOCAL ] BHVN: Loaded 50631 existing records from primary storage. [2025-10-21T22:05:34.954379] [INFO ] [MAIN ] BHVN: Loaded 50631 primary data records. [2025-10-21T22:05:35.148268] [DEBUG] [LOCAL ] BILL: Loaded 52510 existing records from primary storage. [2025-10-21T22:05:35.177734] [INFO ] [MAIN ] BILL: Loaded 52510 primary data records. [2025-10-21T22:05:35.903144] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:35.908586] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:35.909477] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53368 primary records. [2025-10-21T22:05:35.910843] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-10-21T22:05:35.910604] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 50631 primary records. [2025-10-21T22:05:35.911780] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-10-21T22:05:35.929849] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-10-21T22:05:35.938772] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-10-21T22:05:35.945852] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-10-21T22:05:35.947973] [INFO ] [MAIN ] Derivative Progress: 220/2057 symbols completed. BHP took 1.2s. Estimated remaining: 11m 36s. Rate: 158.3 symbols/min [2025-10-21T22:05:35.955935] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:35.948179] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-10-21T22:05:35.968758] [INFO ] [MAIN ] Derivative Progress: 221/2057 symbols completed. BHVN took 1.2s. Estimated remaining: 11m 33s. Rate: 159.0 symbols/min [2025-10-21T22:05:35.969197] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:35.970337] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:35.971072] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52510 primary records. [2025-10-21T22:05:35.971195] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-10-21T22:05:35.987240] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-10-21T22:05:35.987375] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-10-21T22:05:35.989827] [INFO ] [MAIN ] Derivative Progress: 222/2057 symbols completed. BILL took 1.2s. Estimated remaining: 11m 30s. Rate: 159.6 symbols/min [2025-10-21T22:05:35.990033] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:36.007813] [DEBUG] [LOCAL ] BIO: Loaded 23888 existing records from primary storage. [2025-10-21T22:05:36.007954] [INFO ] [MAIN ] BIO: Loaded 23888 primary data records. [2025-10-21T22:05:36.229030] [DEBUG] [LOCAL ] BIP: Loaded 39061 existing records from primary storage. [2025-10-21T22:05:36.328976] [INFO ] [MAIN ] BIP: Loaded 39061 primary data records. [2025-10-21T22:05:36.334757] [DEBUG] [LOCAL ] BIPC: Loaded 41184 existing records from primary storage. [2025-10-21T22:05:36.375207] [INFO ] [MAIN ] BIPC: Loaded 41184 primary data records. [2025-10-21T22:05:36.963677] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:36.964764] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 23888 primary records. [2025-10-21T22:05:36.964942] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-10-21T22:05:36.982314] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-10-21T22:05:36.982423] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-10-21T22:05:36.984748] [INFO ] [MAIN ] Derivative Progress: 223/2057 symbols completed. BIO took 1.0s. Estimated remaining: 11m 34s. Rate: 158.5 symbols/min [2025-10-21T22:05:37.002976] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:37.003911] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39061 primary records. [2025-10-21T22:05:37.004055] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-10-21T22:05:37.022488] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-10-21T22:05:37.022629] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-10-21T22:05:37.024748] [INFO ] [MAIN ] Derivative Progress: 224/2057 symbols completed. BIP took 1.1s. Estimated remaining: 11m 31s. Rate: 159.1 symbols/min [2025-10-21T22:05:37.037385] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:37.038024] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41184 primary records. [2025-10-21T22:05:37.038088] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-10-21T22:05:37.053051] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-10-21T22:05:37.053142] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-10-21T22:05:37.055621] [INFO ] [MAIN ] Derivative Progress: 225/2057 symbols completed. BIPC took 1.1s. Estimated remaining: 11m 28s. Rate: 159.8 symbols/min [2025-10-21T22:05:37.056255] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:37.056191] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:37.056524] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:37.068984] [DEBUG] [LOCAL ] BIPI: Loaded 2845 existing records from primary storage. [2025-10-21T22:05:37.066936] [DEBUG] [LOCAL ] BIPJ: Loaded 3124 existing records from primary storage. [2025-10-21T22:05:37.069208] [INFO ] [MAIN ] BIPI: Loaded 2845 primary data records. [2025-10-21T22:05:37.069338] [INFO ] [MAIN ] BIPJ: Loaded 3124 primary data records. [2025-10-21T22:05:37.066716] [DEBUG] [LOCAL ] BIPH: Loaded 2375 existing records from primary storage. [2025-10-21T22:05:37.110958] [INFO ] [MAIN ] BIPH: Loaded 2375 primary data records. [2025-10-21T22:05:38.028977] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:38.030844] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2375 primary records. [2025-10-21T22:05:38.043951] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-10-21T22:05:38.052627] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:38.058382] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:38.059621] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 2845 primary records. [2025-10-21T22:05:38.060366] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 3124 primary records. [2025-10-21T22:05:38.060758] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-10-21T22:05:38.060837] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-10-21T22:05:38.082019] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-10-21T22:05:38.091260] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-10-21T22:05:38.095899] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-10-21T22:05:38.098710] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-10-21T22:05:38.101141] [INFO ] [MAIN ] Derivative Progress: 226/2057 symbols completed. BIPI took 1.0s. Estimated remaining: 11m 33s. Rate: 158.5 symbols/min [2025-10-21T22:05:38.104876] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:38.107639] [INFO ] [MAIN ] Derivative Progress: 227/2057 symbols completed. BIPH took 1.0s. Estimated remaining: 11m 30s. Rate: 159.2 symbols/min [2025-10-21T22:05:38.107962] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:38.108418] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-10-21T22:05:38.108875] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-10-21T22:05:38.111234] [INFO ] [MAIN ] Derivative Progress: 228/2057 symbols completed. BIPJ took 1.1s. Estimated remaining: 11m 26s. Rate: 159.9 symbols/min [2025-10-21T22:05:38.111457] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:38.155794] [DEBUG] [LOCAL ] BIT: Loaded 23895 existing records from primary storage. [2025-10-21T22:05:38.155979] [INFO ] [MAIN ] BIT: Loaded 23895 primary data records. [2025-10-21T22:05:38.289589] [DEBUG] [LOCAL ] BIRK: Loaded 51192 existing records from primary storage. [2025-10-21T22:05:38.301093] [INFO ] [MAIN ] BIRK: Loaded 51192 primary data records. [2025-10-21T22:05:38.606898] [DEBUG] [LOCAL ] BJ: Loaded 51545 existing records from primary storage. [2025-10-21T22:05:38.611699] [INFO ] [MAIN ] BJ: Loaded 51545 primary data records. [2025-10-21T22:05:39.151220] [DEBUG] [MAIN ] BIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:39.152466] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 23895 primary records. [2025-10-21T22:05:39.152582] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-10-21T22:05:39.177856] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-10-21T22:05:39.178227] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-10-21T22:05:39.180565] [INFO ] [MAIN ] Derivative Progress: 229/2057 symbols completed. BIT took 1.1s. Estimated remaining: 11m 32s. Rate: 158.6 symbols/min [2025-10-21T22:05:39.181055] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:39.196542] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:39.198027] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 51192 primary records. [2025-10-21T22:05:39.198902] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-10-21T22:05:39.224695] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:39.230476] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51545 primary records. [2025-10-21T22:05:39.232154] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-10-21T22:05:39.234079] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-10-21T22:05:39.243363] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-10-21T22:05:39.248031] [INFO ] [MAIN ] Derivative Progress: 230/2057 symbols completed. BIRK took 1.1s. Estimated remaining: 11m 29s. Rate: 159.2 symbols/min [2025-10-21T22:05:39.251136] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:39.256752] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-10-21T22:05:39.256971] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-10-21T22:05:39.259735] [INFO ] [MAIN ] Derivative Progress: 231/2057 symbols completed. BJ took 1.1s. Estimated remaining: 11m 25s. Rate: 159.8 symbols/min [2025-10-21T22:05:39.260090] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:39.306386] [DEBUG] [LOCAL ] BK: Loaded 53546 existing records from primary storage. [2025-10-21T22:05:39.318229] [INFO ] [MAIN ] BK: Loaded 53546 primary data records. [2025-10-21T22:05:39.468498] [DEBUG] [LOCAL ] BKD: Loaded 50448 existing records from primary storage. [2025-10-21T22:05:39.462073] [DEBUG] [LOCAL ] BKE: Loaded 33720 existing records from primary storage. [2025-10-21T22:05:39.473786] [INFO ] [MAIN ] BKD: Loaded 50448 primary data records. [2025-10-21T22:05:39.479177] [INFO ] [MAIN ] BKE: Loaded 33720 primary data records. [2025-10-21T22:05:40.340954] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:40.343228] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53546 primary records. [2025-10-21T22:05:40.345063] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-10-21T22:05:40.371413] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:40.377282] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50448 primary records. [2025-10-21T22:05:40.377393] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-10-21T22:05:40.378354] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-10-21T22:05:40.379241] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-10-21T22:05:40.381875] [INFO ] [MAIN ] Derivative Progress: 232/2057 symbols completed. BK took 1.2s. Estimated remaining: 11m 31s. Rate: 158.5 symbols/min [2025-10-21T22:05:40.383338] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:40.411667] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-10-21T22:05:40.412162] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-10-21T22:05:40.415295] [INFO ] [MAIN ] Derivative Progress: 233/2057 symbols completed. BKD took 1.2s. Estimated remaining: 11m 28s. Rate: 159.1 symbols/min [2025-10-21T22:05:40.412485] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:40.415508] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:40.416457] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 33720 primary records. [2025-10-21T22:05:40.417037] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-10-21T22:05:40.437192] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-10-21T22:05:40.437526] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-10-21T22:05:40.440385] [INFO ] [MAIN ] Derivative Progress: 234/2057 symbols completed. BKE took 1.2s. Estimated remaining: 11m 25s. Rate: 159.7 symbols/min [2025-10-21T22:05:40.440676] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:40.468113] [DEBUG] [LOCAL ] BKN: Loaded 7286 existing records from primary storage. [2025-10-21T22:05:40.468246] [INFO ] [MAIN ] BKN: Loaded 7286 primary data records. [2025-10-21T22:05:40.600314] [DEBUG] [LOCAL ] BKKT: Loaded 37205 existing records from primary storage. [2025-10-21T22:05:40.600504] [INFO ] [MAIN ] BKKT: Loaded 37205 primary data records. [2025-10-21T22:05:40.599693] [DEBUG] [LOCAL ] BKH: Loaded 37390 existing records from primary storage. [2025-10-21T22:05:40.617044] [INFO ] [MAIN ] BKH: Loaded 37390 primary data records. [2025-10-21T22:05:41.493533] [DEBUG] [MAIN ] BKN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:41.494278] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7286 primary records. [2025-10-21T22:05:41.494446] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-10-21T22:05:41.512754] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-10-21T22:05:41.513118] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-10-21T22:05:41.527447] [INFO ] [MAIN ] Derivative Progress: 235/2057 symbols completed. BKN took 1.1s. Estimated remaining: 11m 30s. Rate: 158.5 symbols/min [2025-10-21T22:05:41.528126] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:41.528007] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:41.529306] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 37390 primary records. [2025-10-21T22:05:41.529396] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-10-21T22:05:41.548959] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-10-21T22:05:41.556705] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-10-21T22:05:41.564545] [INFO ] [MAIN ] Derivative Progress: 236/2057 symbols completed. BKH took 1.2s. Estimated remaining: 11m 27s. Rate: 159.1 symbols/min [2025-10-21T22:05:41.564752] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:41.565194] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:41.566305] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 37205 primary records. [2025-10-21T22:05:41.566384] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-10-21T22:05:41.583995] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-10-21T22:05:41.584158] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-10-21T22:05:41.586661] [INFO ] [MAIN ] Derivative Progress: 237/2057 symbols completed. BKKT took 1.2s. Estimated remaining: 11m 24s. Rate: 159.7 symbols/min [2025-10-21T22:05:41.590415] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:41.606953] [DEBUG] [LOCAL ] BKT: Loaded 12824 existing records from primary storage. [2025-10-21T22:05:41.607160] [INFO ] [MAIN ] BKT: Loaded 12824 primary data records. [2025-10-21T22:05:41.756673] [DEBUG] [LOCAL ] BKSY: Loaded 48901 existing records from primary storage. [2025-10-21T22:05:41.771973] [INFO ] [MAIN ] BKSY: Loaded 48901 primary data records. [2025-10-21T22:05:42.063044] [DEBUG] [LOCAL ] BKU: Loaded 42187 existing records from primary storage. [2025-10-21T22:05:42.069355] [INFO ] [MAIN ] BKU: Loaded 42187 primary data records. [2025-10-21T22:05:42.585315] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:42.586925] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 12824 primary records. [2025-10-21T22:05:42.587513] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-10-21T22:05:42.618852] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-10-21T22:05:42.619532] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-10-21T22:05:42.619441] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:42.622020] [INFO ] [MAIN ] Derivative Progress: 238/2057 symbols completed. BKT took 1.1s. Estimated remaining: 11m 28s. Rate: 158.5 symbols/min [2025-10-21T22:05:42.623549] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48901 primary records. [2025-10-21T22:05:42.623780] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-10-21T22:05:42.641887] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-10-21T22:05:42.641981] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-10-21T22:05:42.645127] [INFO ] [MAIN ] Derivative Progress: 239/2057 symbols completed. BKSY took 1.1s. Estimated remaining: 11m 25s. Rate: 159.2 symbols/min [2025-10-21T22:05:42.657801] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:42.658399] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 42187 primary records. [2025-10-21T22:05:42.658457] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-10-21T22:05:42.673333] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-10-21T22:05:42.673392] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-10-21T22:05:42.676991] [INFO ] [MAIN ] Derivative Progress: 240/2057 symbols completed. BKU took 1.1s. Estimated remaining: 11m 22s. Rate: 159.8 symbols/min [2025-10-21T22:05:42.677388] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:42.677616] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:42.677550] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:42.732020] [DEBUG] [LOCAL ] BKV: Loaded 29490 existing records from primary storage. [2025-10-21T22:05:42.732188] [INFO ] [MAIN ] BKV: Loaded 29490 primary data records. [2025-10-21T22:05:42.732690] [DEBUG] [LOCAL ] BLD: Loaded 27198 existing records from primary storage. [2025-10-21T22:05:42.744177] [INFO ] [MAIN ] BLD: Loaded 27198 primary data records. [2025-10-21T22:05:42.891541] [DEBUG] [LOCAL ] BLCO: Loaded 35044 existing records from primary storage. [2025-10-21T22:05:42.903983] [INFO ] [MAIN ] BLCO: Loaded 35044 primary data records. [2025-10-21T22:05:43.733919] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:43.735081] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 29490 primary records. [2025-10-21T22:05:43.735416] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-10-21T22:05:43.755479] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-10-21T22:05:43.755636] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-10-21T22:05:43.757587] [INFO ] [MAIN ] Derivative Progress: 241/2057 symbols completed. BKV took 1.1s. Estimated remaining: 11m 27s. Rate: 158.5 symbols/min [2025-10-21T22:05:43.758283] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:43.776615] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:43.779363] [INFO ] [MAIN ] BLD: Generated 1793 derivative records from 27198 primary records. [2025-10-21T22:05:43.779634] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-10-21T22:05:43.802393] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:43.809397] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 35044 primary records. [2025-10-21T22:05:43.810915] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-10-21T22:05:43.810829] [DEBUG] [LOCAL ] BLD: Derivative data saved (1793 records). [2025-10-21T22:05:43.811794] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-10-21T22:05:43.815048] [INFO ] [MAIN ] Derivative Progress: 242/2057 symbols completed. BLD took 1.1s. Estimated remaining: 11m 24s. Rate: 159.1 symbols/min [2025-10-21T22:05:43.823789] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:43.831568] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-10-21T22:05:43.831892] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-10-21T22:05:43.834573] [INFO ] [MAIN ] Derivative Progress: 243/2057 symbols completed. BLCO took 1.2s. Estimated remaining: 11m 21s. Rate: 159.7 symbols/min [2025-10-21T22:05:43.834784] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:43.860798] [DEBUG] [LOCAL ] BLE: Loaded 13755 existing records from primary storage. [2025-10-21T22:05:43.861023] [INFO ] [MAIN ] BLE: Loaded 13755 primary data records. [2025-10-21T22:05:43.984394] [DEBUG] [LOCAL ] BLDR: Loaded 51874 existing records from primary storage. [2025-10-21T22:05:43.984560] [INFO ] [MAIN ] BLDR: Loaded 51874 primary data records. [2025-10-21T22:05:44.186699] [DEBUG] [LOCAL ] BLK: Loaded 34328 existing records from primary storage. [2025-10-21T22:05:44.303424] [INFO ] [MAIN ] BLK: Loaded 34328 primary data records. [2025-10-21T22:05:44.820735] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:44.821663] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 13755 primary records. [2025-10-21T22:05:44.821764] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-10-21T22:05:44.839916] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-10-21T22:05:44.840085] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-10-21T22:05:44.854624] [INFO ] [MAIN ] Derivative Progress: 244/2057 symbols completed. BLE took 1.0s. Estimated remaining: 11m 26s. Rate: 158.6 symbols/min [2025-10-21T22:05:44.855295] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:44.855400] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:44.856328] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51874 primary records. [2025-10-21T22:05:44.856422] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-10-21T22:05:44.886571] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:44.887994] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-10-21T22:05:44.888876] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-10-21T22:05:44.888730] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 34328 primary records. [2025-10-21T22:05:44.894570] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-10-21T22:05:44.894447] [INFO ] [MAIN ] Derivative Progress: 245/2057 symbols completed. BLDR took 1.1s. Estimated remaining: 11m 23s. Rate: 159.2 symbols/min [2025-10-21T22:05:44.894746] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:44.911430] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-10-21T22:05:44.922010] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-10-21T22:05:44.924793] [INFO ] [MAIN ] Derivative Progress: 246/2057 symbols completed. BLK took 1.1s. Estimated remaining: 11m 20s. Rate: 159.8 symbols/min [2025-10-21T22:05:44.928097] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:44.935870] [DEBUG] [LOCAL ] BLW: Loaded 13120 existing records from primary storage. [2025-10-21T22:05:44.936087] [INFO ] [MAIN ] BLW: Loaded 13120 primary data records. [2025-10-21T22:05:45.027374] [DEBUG] [LOCAL ] BLND: Loaded 49223 existing records from primary storage. [2025-10-21T22:05:45.039440] [INFO ] [MAIN ] BLND: Loaded 49223 primary data records. [2025-10-21T22:05:45.067076] [DEBUG] [LOCAL ] BLX: Loaded 15521 existing records from primary storage. [2025-10-21T22:05:45.067259] [INFO ] [MAIN ] BLX: Loaded 15521 primary data records. [2025-10-21T22:05:45.907156] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:45.915702] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 13120 primary records. [2025-10-21T22:05:45.921340] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:45.921155] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-10-21T22:05:45.922623] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 15521 primary records. [2025-10-21T22:05:45.930636] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-10-21T22:05:45.939887] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-10-21T22:05:45.940281] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-10-21T22:05:45.942523] [INFO ] [MAIN ] Derivative Progress: 247/2057 symbols completed. BLW took 1.0s. Estimated remaining: 11m 24s. Rate: 158.7 symbols/min [2025-10-21T22:05:45.949600] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:45.971250] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:45.970970] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-10-21T22:05:45.971469] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-10-21T22:05:45.972176] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49223 primary records. [2025-10-21T22:05:45.972362] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-10-21T22:05:45.986152] [INFO ] [MAIN ] Derivative Progress: 248/2057 symbols completed. BLX took 1.1s. Estimated remaining: 11m 22s. Rate: 159.3 symbols/min [2025-10-21T22:05:45.990386] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-10-21T22:05:45.990556] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-10-21T22:05:45.990688] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:45.993584] [INFO ] [MAIN ] Derivative Progress: 249/2057 symbols completed. BLND took 1.1s. Estimated remaining: 11m 18s. Rate: 159.9 symbols/min [2025-10-21T22:05:45.993921] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:46.006623] [DEBUG] [LOCAL ] BME: Loaded 11279 existing records from primary storage. [2025-10-21T22:05:46.006791] [INFO ] [MAIN ] BME: Loaded 11279 primary data records. [2025-10-21T22:05:46.144351] [DEBUG] [LOCAL ] BMEZ: Loaded 25212 existing records from primary storage. [2025-10-21T22:05:46.144892] [DEBUG] [LOCAL ] BMA: Loaded 36526 existing records from primary storage. [2025-10-21T22:05:46.145178] [INFO ] [MAIN ] BMEZ: Loaded 25212 primary data records. [2025-10-21T22:05:46.167138] [INFO ] [MAIN ] BMA: Loaded 36526 primary data records. [2025-10-21T22:05:46.973609] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:46.975406] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 11279 primary records. [2025-10-21T22:05:46.975528] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-10-21T22:05:47.000512] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:47.006820] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 25212 primary records. [2025-10-21T22:05:47.008050] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-10-21T22:05:47.021860] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-10-21T22:05:47.037164] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-10-21T22:05:47.024440] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-10-21T22:05:47.039302] [INFO ] [MAIN ] Derivative Progress: 250/2057 symbols completed. BME took 1.0s. Estimated remaining: 11m 23s. Rate: 158.8 symbols/min [2025-10-21T22:05:47.039418] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-10-21T22:05:47.047533] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:47.047908] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:47.048072] [INFO ] [MAIN ] Derivative Progress: 251/2057 symbols completed. BMEZ took 1.1s. Estimated remaining: 11m 20s. Rate: 159.4 symbols/min [2025-10-21T22:05:47.049369] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:47.049266] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 36526 primary records. [2025-10-21T22:05:47.050034] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-10-21T22:05:47.070314] [DEBUG] [LOCAL ] BMN: Loaded 2581 existing records from primary storage. [2025-10-21T22:05:47.070489] [INFO ] [MAIN ] BMN: Loaded 2581 primary data records. [2025-10-21T22:05:47.067637] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-10-21T22:05:47.083475] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-10-21T22:05:47.108718] [INFO ] [MAIN ] Derivative Progress: 252/2057 symbols completed. BMA took 1.2s. Estimated remaining: 11m 17s. Rate: 159.9 symbols/min [2025-10-21T22:05:47.114129] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:47.256991] [DEBUG] [LOCAL ] BMI: Loaded 24889 existing records from primary storage. [2025-10-21T22:05:47.379777] [INFO ] [MAIN ] BMI: Loaded 24889 primary data records. [2025-10-21T22:05:47.765430] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-21T22:05:47.765982] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-10-21T22:05:47.962992] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:48.083114] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2581 primary records. [2025-10-21T22:05:48.084047] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-10-21T22:05:48.099140] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-10-21T22:05:48.100475] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-10-21T22:05:48.102776] [INFO ] [MAIN ] Derivative Progress: 253/2057 symbols completed. BMN took 1.1s. Estimated remaining: 11m 21s. Rate: 158.9 symbols/min [2025-10-21T22:05:48.121294] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:48.122016] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 24889 primary records. [2025-10-21T22:05:48.122293] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-10-21T22:05:48.139989] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-10-21T22:05:48.140731] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-10-21T22:05:48.143818] [INFO ] [MAIN ] Derivative Progress: 254/2057 symbols completed. BMI took 1.1s. Estimated remaining: 11m 19s. Rate: 159.4 symbols/min [2025-10-21T22:05:48.156369] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:48.157020] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-10-21T22:05:48.157087] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-10-21T22:05:48.171928] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-10-21T22:05:48.171984] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-10-21T22:05:48.174944] [INFO ] [MAIN ] Derivative Progress: 255/2057 symbols completed. BMY took 1.1s. Estimated remaining: 11m 16s. Rate: 160.0 symbols/min [2025-10-21T22:05:48.175678] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:48.175486] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:48.175554] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:48.184561] [DEBUG] [LOCAL ] BNH: Loaded 4741 existing records from primary storage. [2025-10-21T22:05:48.184815] [INFO ] [MAIN ] BNH: Loaded 4741 primary data records. [2025-10-21T22:05:48.379613] [DEBUG] [LOCAL ] BNED: Loaded 28324 existing records from primary storage. [2025-10-21T22:05:48.400150] [INFO ] [MAIN ] BNED: Loaded 28324 primary data records. [2025-10-21T22:05:48.623934] [DEBUG] [LOCAL ] BN: Loaded 52984 existing records from primary storage. [2025-10-21T22:05:48.641054] [INFO ] [MAIN ] BN: Loaded 52984 primary data records. [2025-10-21T22:05:49.238033] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:49.240880] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 4741 primary records. [2025-10-21T22:05:49.241469] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-10-21T22:05:49.259511] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-10-21T22:05:49.259753] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-10-21T22:05:49.262148] [INFO ] [MAIN ] Derivative Progress: 256/2057 symbols completed. BNH took 1.1s. Estimated remaining: 11m 20s. Rate: 158.8 symbols/min [2025-10-21T22:05:49.262864] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:49.269976] [DEBUG] [LOCAL ] BNJ: Loaded 2517 existing records from primary storage. [2025-10-21T22:05:49.270366] [INFO ] [MAIN ] BNJ: Loaded 2517 primary data records. [2025-10-21T22:05:49.367808] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:49.388529] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 28324 primary records. [2025-10-21T22:05:49.401420] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-10-21T22:05:49.405936] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:49.406877] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 52984 primary records. [2025-10-21T22:05:49.419853] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-10-21T22:05:49.517629] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-10-21T22:05:49.512388] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-10-21T22:05:49.621426] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-10-21T22:05:49.621332] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-10-21T22:05:49.629074] [INFO ] [MAIN ] Derivative Progress: 257/2057 symbols completed. BN took 1.5s. Estimated remaining: 11m 20s. Rate: 158.8 symbols/min [2025-10-21T22:05:49.640397] [INFO ] [MAIN ] Derivative Progress: 258/2057 symbols completed. BNED took 1.5s. Estimated remaining: 11m 17s. Rate: 159.4 symbols/min [2025-10-21T22:05:49.637803] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:49.640834] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:49.668153] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:49.668804] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2517 primary records. [2025-10-21T22:05:49.668874] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-10-21T22:05:49.682704] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-10-21T22:05:49.682854] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-10-21T22:05:49.685402] [INFO ] [MAIN ] Derivative Progress: 259/2057 symbols completed. BNJ took 0.4s. Estimated remaining: 11m 14s. Rate: 160.0 symbols/min [2025-10-21T22:05:49.695579] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:49.713291] [DEBUG] [LOCAL ] BNT: Loaded 3550 existing records from primary storage. [2025-10-21T22:05:49.713476] [INFO ] [MAIN ] BNT: Loaded 3550 primary data records. [2025-10-21T22:05:49.850078] [DEBUG] [LOCAL ] BNS: Loaded 51426 existing records from primary storage. [2025-10-21T22:05:49.862116] [DEBUG] [LOCAL ] BNL: Loaded 47118 existing records from primary storage. [2025-10-21T22:05:49.855873] [INFO ] [MAIN ] BNS: Loaded 51426 primary data records. [2025-10-21T22:05:49.877622] [INFO ] [MAIN ] BNL: Loaded 47118 primary data records. [2025-10-21T22:05:50.701219] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:50.701992] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3550 primary records. [2025-10-21T22:05:50.702248] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-10-21T22:05:50.717074] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-10-21T22:05:50.717473] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-10-21T22:05:50.719433] [INFO ] [MAIN ] Derivative Progress: 260/2057 symbols completed. BNT took 1.0s. Estimated remaining: 11m 18s. Rate: 158.9 symbols/min [2025-10-21T22:05:50.719822] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:50.737096] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:50.741691] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 47118 primary records. [2025-10-21T22:05:50.741893] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-10-21T22:05:50.758234] [DEBUG] [LOCAL ] BNY: Loaded 7268 existing records from primary storage. [2025-10-21T22:05:50.758942] [INFO ] [MAIN ] BNY: Loaded 7268 primary data records. [2025-10-21T22:05:50.810717] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:50.810354] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-10-21T22:05:50.817841] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-10-21T22:05:50.818627] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51426 primary records. [2025-10-21T22:05:50.821809] [INFO ] [MAIN ] Derivative Progress: 261/2057 symbols completed. BNL took 1.2s. Estimated remaining: 11m 16s. Rate: 159.4 symbols/min [2025-10-21T22:05:50.827066] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-10-21T22:05:50.849293] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:50.939971] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-10-21T22:05:50.955288] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-10-21T22:05:51.103157] [INFO ] [MAIN ] Derivative Progress: 262/2057 symbols completed. BNS took 1.5s. Estimated remaining: 11m 15s. Rate: 159.5 symbols/min [2025-10-21T22:05:51.116719] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:51.124551] [DEBUG] [LOCAL ] BOC: Loaded 18280 existing records from primary storage. [2025-10-21T22:05:51.125258] [INFO ] [MAIN ] BOC: Loaded 18280 primary data records. [2025-10-21T22:05:51.472685] [DEBUG] [LOCAL ] BOH: Loaded 30727 existing records from primary storage. [2025-10-21T22:05:51.472969] [INFO ] [MAIN ] BOH: Loaded 30727 primary data records. [2025-10-21T22:05:51.620538] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:51.670377] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7268 primary records. [2025-10-21T22:05:51.776718] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-10-21T22:05:51.803328] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-10-21T22:05:51.805271] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-10-21T22:05:51.808429] [INFO ] [MAIN ] Derivative Progress: 263/2057 symbols completed. BNY took 1.1s. Estimated remaining: 11m 17s. Rate: 159.0 symbols/min [2025-10-21T22:05:51.809426] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:51.823882] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:51.825585] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18280 primary records. [2025-10-21T22:05:51.825791] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-10-21T22:05:51.842515] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-10-21T22:05:51.842755] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-10-21T22:05:51.845503] [INFO ] [MAIN ] Derivative Progress: 264/2057 symbols completed. BOC took 1.0s. Estimated remaining: 11m 14s. Rate: 159.5 symbols/min [2025-10-21T22:05:51.845897] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:51.872212] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:51.873086] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 30727 primary records. [2025-10-21T22:05:51.873222] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-10-21T22:05:51.889668] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-10-21T22:05:51.899501] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-10-21T22:05:51.903428] [INFO ] [MAIN ] Derivative Progress: 265/2057 symbols completed. BOH took 0.8s. Estimated remaining: 11m 12s. Rate: 160.0 symbols/min [2025-10-21T22:05:51.904366] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:51.904158] [DEBUG] [LOCAL ] BOND: Loaded 32458 existing records from primary storage. [2025-10-21T22:05:51.904902] [INFO ] [MAIN ] BOND: Loaded 32458 primary data records. [2025-10-21T22:05:52.086973] [DEBUG] [LOCAL ] BOOT: Loaded 39541 existing records from primary storage. [2025-10-21T22:05:52.127073] [INFO ] [MAIN ] BOOT: Loaded 39541 primary data records. [2025-10-21T22:05:52.380342] [DEBUG] [LOCAL ] BORR: Loaded 51097 existing records from primary storage. [2025-10-21T22:05:52.404134] [INFO ] [MAIN ] BORR: Loaded 51097 primary data records. [2025-10-21T22:05:52.934931] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:52.936278] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32458 primary records. [2025-10-21T22:05:52.936850] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-10-21T22:05:52.956622] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-10-21T22:05:52.957573] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-10-21T22:05:52.960098] [INFO ] [MAIN ] Derivative Progress: 266/2057 symbols completed. BOND took 1.2s. Estimated remaining: 11m 16s. Rate: 159.0 symbols/min [2025-10-21T22:05:52.960719] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:52.974766] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:52.975410] [INFO ] [MAIN ] BOOT: Generated 1793 derivative records from 39541 primary records. [2025-10-21T22:05:52.975550] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-10-21T22:05:52.996478] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1793 records). [2025-10-21T22:05:52.997958] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-10-21T22:05:53.000291] [INFO ] [MAIN ] Derivative Progress: 267/2057 symbols completed. BOOT took 1.2s. Estimated remaining: 11m 13s. Rate: 159.5 symbols/min [2025-10-21T22:05:53.000736] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:53.019502] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:53.020209] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51097 primary records. [2025-10-21T22:05:53.020318] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-10-21T22:05:53.043022] [DEBUG] [LOCAL ] BOW: Loaded 22908 existing records from primary storage. [2025-10-21T22:05:53.043128] [INFO ] [MAIN ] BOW: Loaded 22908 primary data records. [2025-10-21T22:05:53.067397] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-10-21T22:05:53.085327] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-10-21T22:05:53.105823] [INFO ] [MAIN ] Derivative Progress: 268/2057 symbols completed. BORR took 1.2s. Estimated remaining: 11m 11s. Rate: 159.9 symbols/min [2025-10-21T22:05:53.393801] [DEBUG] [LOCAL ] BOX: Loaded 50139 existing records from primary storage. [2025-10-21T22:05:53.394043] [INFO ] [MAIN ] BOX: Loaded 50139 primary data records. [2025-10-21T22:05:53.704036] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:53.705097] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 22908 primary records. [2025-10-21T22:05:53.705324] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-10-21T22:05:53.721090] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-10-21T22:05:53.721249] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-10-21T22:05:53.723448] [INFO ] [MAIN ] Derivative Progress: 269/2057 symbols completed. BOW took 0.8s. Estimated remaining: 11m 12s. Rate: 159.5 symbols/min [2025-10-21T22:05:53.742204] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:53.742746] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50139 primary records. [2025-10-21T22:05:53.742805] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-10-21T22:05:53.757308] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-10-21T22:05:53.757364] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-10-21T22:05:53.760141] [INFO ] [MAIN ] Derivative Progress: 270/2057 symbols completed. BOX took 0.8s. Estimated remaining: 11m 10s. Rate: 160.1 symbols/min [2025-10-21T22:05:53.760565] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:53.760487] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:53.760731] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:53.807614] [DEBUG] [LOCAL ] BR: Loaded 34606 existing records from primary storage. [2025-10-21T22:05:53.808140] [INFO ] [MAIN ] BR: Loaded 34606 primary data records. [2025-10-21T22:05:53.968902] [DEBUG] [LOCAL ] BP: Loaded 53706 existing records from primary storage. [2025-10-21T22:05:53.980527] [DEBUG] [LOCAL ] BRBR: Loaded 51828 existing records from primary storage. [2025-10-21T22:05:53.985781] [INFO ] [MAIN ] BRBR: Loaded 51828 primary data records. [2025-10-21T22:05:54.008336] [INFO ] [MAIN ] BP: Loaded 53706 primary data records. [2025-10-21T22:05:54.763840] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:54.765079] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34606 primary records. [2025-10-21T22:05:54.765271] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-10-21T22:05:54.782551] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-10-21T22:05:54.784443] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-10-21T22:05:54.787892] [INFO ] [MAIN ] Derivative Progress: 271/2057 symbols completed. BR took 1.0s. Estimated remaining: 11m 14s. Rate: 159.0 symbols/min [2025-10-21T22:05:54.788317] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:54.802782] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:54.803725] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53706 primary records. [2025-10-21T22:05:54.804846] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-10-21T22:05:54.839425] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-10-21T22:05:54.840028] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-10-21T22:05:54.843043] [INFO ] [MAIN ] Derivative Progress: 272/2057 symbols completed. BP took 1.1s. Estimated remaining: 11m 11s. Rate: 159.5 symbols/min [2025-10-21T22:05:54.840337] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:05:54.843306] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:54.844156] [INFO ] [MAIN ] BRBR: Generated 1793 derivative records from 51828 primary records. [2025-10-21T22:05:54.851303] [DEBUG] [LOCAL ] BRC: Loaded 18420 existing records from primary storage. [2025-10-21T22:05:54.851407] [INFO ] [MAIN ] BRC: Loaded 18420 primary data records. [2025-10-21T22:05:54.850981] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-10-21T22:05:54.935466] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1793 records). [2025-10-21T22:05:54.952489] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-10-21T22:05:54.974139] [INFO ] [MAIN ] Derivative Progress: 273/2057 symbols completed. BRBR took 1.2s. Estimated remaining: 11m 9s. Rate: 159.9 symbols/min [2025-10-21T22:05:54.974374] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:55.220286] [DEBUG] [LOCAL ] BRCC: Loaded 40061 existing records from primary storage. [2025-10-21T22:05:55.220530] [INFO ] [MAIN ] BRCC: Loaded 40061 primary data records. [2025-10-21T22:05:55.555012] [DEBUG] [LOCAL ] BRO: Loaded 52096 existing records from primary storage. [2025-10-21T22:05:55.555670] [INFO ] [MAIN ] BRO: Loaded 52096 primary data records. [2025-10-21T22:05:55.717527] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:55.734327] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 18420 primary records. [2025-10-21T22:05:55.778947] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-10-21T22:05:55.932884] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-10-21T22:05:55.934328] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-10-21T22:05:55.937712] [INFO ] [MAIN ] Derivative Progress: 274/2057 symbols completed. BRC took 1.1s. Estimated remaining: 11m 13s. Rate: 159.0 symbols/min [2025-10-21T22:05:55.938625] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:55.958994] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:55.960021] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40061 primary records. [2025-10-21T22:05:55.960397] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-10-21T22:05:55.987925] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-10-21T22:05:55.988138] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-10-21T22:05:55.991561] [INFO ] [MAIN ] Derivative Progress: 275/2057 symbols completed. BRCC took 1.1s. Estimated remaining: 11m 10s. Rate: 159.5 symbols/min [2025-10-21T22:05:55.991889] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:56.034329] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:56.035164] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 52096 primary records. [2025-10-21T22:05:56.035317] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-10-21T22:05:56.056467] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-10-21T22:05:56.056733] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-10-21T22:05:56.082768] [INFO ] [MAIN ] Derivative Progress: 276/2057 symbols completed. BRO took 1.1s. Estimated remaining: 11m 8s. Rate: 160.0 symbols/min [2025-10-21T22:05:56.085165] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:56.095292] [DEBUG] [LOCAL ] BROS: Loaded 53301 existing records from primary storage. [2025-10-21T22:05:56.095774] [INFO ] [MAIN ] BROS: Loaded 53301 primary data records. [2025-10-21T22:05:56.169308] [DEBUG] [LOCAL ] BRT: Loaded 5264 existing records from primary storage. [2025-10-21T22:05:56.235212] [DEBUG] [LOCAL ] BRSP: Loaded 36602 existing records from primary storage. [2025-10-21T22:05:56.235376] [INFO ] [MAIN ] BRT: Loaded 5264 primary data records. [2025-10-21T22:05:56.259679] [INFO ] [MAIN ] BRSP: Loaded 36602 primary data records. [2025-10-21T22:05:57.238939] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:57.239783] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53301 primary records. [2025-10-21T22:05:57.240068] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-10-21T22:05:57.259681] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-10-21T22:05:57.260596] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-10-21T22:05:57.263443] [INFO ] [MAIN ] Derivative Progress: 277/2057 symbols completed. BROS took 1.3s. Estimated remaining: 11m 13s. Rate: 158.7 symbols/min [2025-10-21T22:05:57.263703] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:57.288435] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:57.288967] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:57.289752] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36602 primary records. [2025-10-21T22:05:57.289907] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-10-21T22:05:57.290475] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 5264 primary records. [2025-10-21T22:05:57.291296] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-10-21T22:05:57.316217] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-10-21T22:05:57.319411] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-10-21T22:05:57.320111] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-10-21T22:05:57.322867] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-10-21T22:05:57.322685] [INFO ] [MAIN ] Derivative Progress: 278/2057 symbols completed. BRSP took 1.3s. Estimated remaining: 11m 10s. Rate: 159.2 symbols/min [2025-10-21T22:05:57.325693] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:57.325861] [INFO ] [MAIN ] Derivative Progress: 279/2057 symbols completed. BRT took 1.2s. Estimated remaining: 11m 8s. Rate: 159.8 symbols/min [2025-10-21T22:05:57.326344] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:57.341289] [DEBUG] [LOCAL ] BRW: Loaded 21018 existing records from primary storage. [2025-10-21T22:05:57.341480] [INFO ] [MAIN ] BRW: Loaded 21018 primary data records. [2025-10-21T22:05:57.661628] [DEBUG] [LOCAL ] BSAC: Loaded 32912 existing records from primary storage. [2025-10-21T22:05:57.672620] [INFO ] [MAIN ] BSAC: Loaded 32912 primary data records. [2025-10-21T22:05:57.745425] [DEBUG] [LOCAL ] BRX: Loaded 51823 existing records from primary storage. [2025-10-21T22:05:57.766063] [INFO ] [MAIN ] BRX: Loaded 51823 primary data records. [2025-10-21T22:05:58.301891] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:58.303759] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 21018 primary records. [2025-10-21T22:05:58.303991] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-10-21T22:05:58.321157] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-10-21T22:05:58.321315] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-10-21T22:05:58.323920] [INFO ] [MAIN ] Derivative Progress: 280/2057 symbols completed. BRW took 1.1s. Estimated remaining: 11m 11s. Rate: 158.8 symbols/min [2025-10-21T22:05:58.324330] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:58.342528] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:58.343327] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 32912 primary records. [2025-10-21T22:05:58.343549] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-10-21T22:05:58.362203] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-10-21T22:05:58.371701] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-10-21T22:05:58.374079] [INFO ] [MAIN ] Derivative Progress: 281/2057 symbols completed. BSAC took 1.0s. Estimated remaining: 11m 9s. Rate: 159.3 symbols/min [2025-10-21T22:05:58.386797] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:58.387075] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:58.388179] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51823 primary records. [2025-10-21T22:05:58.388241] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-10-21T22:05:58.417804] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-10-21T22:05:58.420368] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-10-21T22:05:58.420268] [DEBUG] [LOCAL ] BSBR: Loaded 35863 existing records from primary storage. [2025-10-21T22:05:58.423218] [INFO ] [MAIN ] Derivative Progress: 282/2057 symbols completed. BRX took 1.1s. Estimated remaining: 11m 6s. Rate: 159.8 symbols/min [2025-10-21T22:05:58.423601] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:58.423500] [INFO ] [MAIN ] BSBR: Loaded 35863 primary data records. [2025-10-21T22:05:58.473951] [DEBUG] [LOCAL ] BSL: Loaded 8084 existing records from primary storage. [2025-10-21T22:05:58.497363] [INFO ] [MAIN ] BSL: Loaded 8084 primary data records. [2025-10-21T22:05:58.719354] [DEBUG] [LOCAL ] BSM: Loaded 32421 existing records from primary storage. [2025-10-21T22:05:58.936258] [INFO ] [MAIN ] BSM: Loaded 32421 primary data records. [2025-10-21T22:05:59.446740] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:59.447865] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35863 primary records. [2025-10-21T22:05:59.447958] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-10-21T22:05:59.462131] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:59.471279] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8084 primary records. [2025-10-21T22:05:59.474709] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-10-21T22:05:59.479443] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-10-21T22:05:59.479706] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-10-21T22:05:59.482216] [INFO ] [MAIN ] Derivative Progress: 283/2057 symbols completed. BSBR took 1.2s. Estimated remaining: 11m 10s. Rate: 158.8 symbols/min [2025-10-21T22:05:59.498664] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-10-21T22:05:59.498863] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-10-21T22:05:59.501863] [INFO ] [MAIN ] Derivative Progress: 284/2057 symbols completed. BSL took 1.1s. Estimated remaining: 11m 8s. Rate: 159.3 symbols/min [2025-10-21T22:05:59.517253] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:05:59.517824] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32421 primary records. [2025-10-21T22:05:59.517884] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-10-21T22:05:59.533219] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-10-21T22:05:59.533277] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-10-21T22:05:59.536007] [INFO ] [MAIN ] Derivative Progress: 285/2057 symbols completed. BSM took 1.1s. Estimated remaining: 11m 5s. Rate: 159.8 symbols/min [2025-10-21T22:05:59.536450] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:59.536864] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:59.537156] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:05:59.561507] [DEBUG] [LOCAL ] BST: Loaded 18592 existing records from primary storage. [2025-10-21T22:05:59.561716] [INFO ] [MAIN ] BST: Loaded 18592 primary data records. [2025-10-21T22:05:59.627552] [DEBUG] [LOCAL ] BSTZ: Loaded 24579 existing records from primary storage. [2025-10-21T22:05:59.642310] [INFO ] [MAIN ] BSTZ: Loaded 24579 primary data records. [2025-10-21T22:06:00.054400] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-21T22:06:00.075108] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-10-21T22:06:00.595509] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:00.596916] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 18592 primary records. [2025-10-21T22:06:00.598234] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-10-21T22:06:00.618390] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-10-21T22:06:00.618668] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-10-21T22:06:00.621130] [INFO ] [MAIN ] Derivative Progress: 286/2057 symbols completed. BST took 1.1s. Estimated remaining: 11m 9s. Rate: 158.8 symbols/min [2025-10-21T22:06:00.634121] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:00.636072] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:00.637161] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 24579 primary records. [2025-10-21T22:06:00.637512] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-10-21T22:06:00.658308] [DEBUG] [LOCAL ] BTA: Loaded 5770 existing records from primary storage. [2025-10-21T22:06:00.662870] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-10-21T22:06:00.663082] [INFO ] [MAIN ] BTA: Loaded 5770 primary data records. [2025-10-21T22:06:00.668490] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-10-21T22:06:00.678238] [INFO ] [MAIN ] Derivative Progress: 287/2057 symbols completed. BSTZ took 1.1s. Estimated remaining: 11m 7s. Rate: 159.3 symbols/min [2025-10-21T22:06:00.688238] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:00.809573] [DEBUG] [LOCAL ] BTO: Loaded 8841 existing records from primary storage. [2025-10-21T22:06:00.820461] [INFO ] [MAIN ] BTO: Loaded 8841 primary data records. [2025-10-21T22:06:00.841812] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:00.903850] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-10-21T22:06:00.961949] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-10-21T22:06:01.178737] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-10-21T22:06:01.204870] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-10-21T22:06:01.215368] [INFO ] [MAIN ] Derivative Progress: 288/2057 symbols completed. BSX took 1.7s. Estimated remaining: 11m 7s. Rate: 159.0 symbols/min [2025-10-21T22:06:01.215750] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:01.423530] [DEBUG] [LOCAL ] BTT: Loaded 15421 existing records from primary storage. [2025-10-21T22:06:01.424383] [INFO ] [MAIN ] BTT: Loaded 15421 primary data records. [2025-10-21T22:06:01.600402] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:01.742162] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5770 primary records. [2025-10-21T22:06:01.743129] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-10-21T22:06:01.772088] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:01.773935] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-10-21T22:06:01.774142] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-10-21T22:06:01.777093] [INFO ] [MAIN ] Derivative Progress: 289/2057 symbols completed. BTA took 1.1s. Estimated remaining: 11m 8s. Rate: 158.8 symbols/min [2025-10-21T22:06:01.774839] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 8841 primary records. [2025-10-21T22:06:01.777577] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:01.777845] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-10-21T22:06:01.795713] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-10-21T22:06:01.795930] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-10-21T22:06:01.798618] [INFO ] [MAIN ] Derivative Progress: 290/2057 symbols completed. BTO took 1.1s. Estimated remaining: 11m 6s. Rate: 159.3 symbols/min [2025-10-21T22:06:01.799248] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:01.818676] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:01.819380] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 15421 primary records. [2025-10-21T22:06:01.824824] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-10-21T22:06:01.853544] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-10-21T22:06:01.863226] [DEBUG] [LOCAL ] BTZ: Loaded 22540 existing records from primary storage. [2025-10-21T22:06:01.862818] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-10-21T22:06:01.866192] [INFO ] [MAIN ] Derivative Progress: 291/2057 symbols completed. BTT took 0.7s. Estimated remaining: 11m 3s. Rate: 159.7 symbols/min [2025-10-21T22:06:01.866406] [INFO ] [MAIN ] BTZ: Loaded 22540 primary data records. [2025-10-21T22:06:01.866617] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:01.987696] [DEBUG] [LOCAL ] BTU: Loaded 53337 existing records from primary storage. [2025-10-21T22:06:01.988211] [INFO ] [MAIN ] BTU: Loaded 53337 primary data records. [2025-10-21T22:06:02.544158] [DEBUG] [LOCAL ] BUD: Loaded 52604 existing records from primary storage. [2025-10-21T22:06:02.545275] [INFO ] [MAIN ] BUD: Loaded 52604 primary data records. [2025-10-21T22:06:02.866562] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:02.869122] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 22540 primary records. [2025-10-21T22:06:02.869852] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-10-21T22:06:02.893625] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-10-21T22:06:02.902302] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-10-21T22:06:02.905442] [INFO ] [MAIN ] Derivative Progress: 292/2057 symbols completed. BTZ took 1.1s. Estimated remaining: 11m 7s. Rate: 158.8 symbols/min [2025-10-21T22:06:02.911693] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:02.912516] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:02.914120] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53337 primary records. [2025-10-21T22:06:02.914266] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-10-21T22:06:02.933002] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-10-21T22:06:02.936266] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-10-21T22:06:02.939902] [INFO ] [MAIN ] Derivative Progress: 293/2057 symbols completed. BTU took 1.2s. Estimated remaining: 11m 5s. Rate: 159.3 symbols/min [2025-10-21T22:06:02.943104] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:02.949129] [DEBUG] [LOCAL ] BUI: Loaded 11926 existing records from primary storage. [2025-10-21T22:06:02.949777] [INFO ] [MAIN ] BUI: Loaded 11926 primary data records. [2025-10-21T22:06:03.002066] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:03.023280] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52604 primary records. [2025-10-21T22:06:03.038471] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-10-21T22:06:03.191756] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-10-21T22:06:03.192019] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-10-21T22:06:03.394943] [INFO ] [MAIN ] Derivative Progress: 294/2057 symbols completed. BUD took 1.5s. Estimated remaining: 11m 5s. Rate: 159.1 symbols/min [2025-10-21T22:06:03.411975] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:03.414015] [DEBUG] [LOCAL ] BUR: Loaded 45478 existing records from primary storage. [2025-10-21T22:06:03.414472] [INFO ] [MAIN ] BUR: Loaded 45478 primary data records. [2025-10-21T22:06:03.775584] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:03.779369] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11926 primary records. [2025-10-21T22:06:03.778342] [DEBUG] [LOCAL ] BURL: Loaded 45509 existing records from primary storage. [2025-10-21T22:06:03.779633] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-10-21T22:06:03.779811] [INFO ] [MAIN ] BURL: Loaded 45509 primary data records. [2025-10-21T22:06:03.886814] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-10-21T22:06:03.905542] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-10-21T22:06:03.908074] [INFO ] [MAIN ] Derivative Progress: 295/2057 symbols completed. BUI took 1.0s. Estimated remaining: 11m 5s. Rate: 159.0 symbols/min [2025-10-21T22:06:03.908471] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:04.113846] [DEBUG] [LOCAL ] BUXX: Loaded 15430 existing records from primary storage. [2025-10-21T22:06:04.114550] [INFO ] [MAIN ] BUXX: Loaded 15430 primary data records. [2025-10-21T22:06:04.171129] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:04.220471] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45478 primary records. [2025-10-21T22:06:04.231937] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-10-21T22:06:04.448439] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-10-21T22:06:04.449533] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-10-21T22:06:04.452280] [INFO ] [MAIN ] Derivative Progress: 296/2057 symbols completed. BUR took 1.5s. Estimated remaining: 11m 6s. Rate: 158.7 symbols/min [2025-10-21T22:06:04.452542] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:04.472924] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:04.473841] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 45509 primary records. [2025-10-21T22:06:04.474097] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-10-21T22:06:04.492804] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-10-21T22:06:04.501991] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-10-21T22:06:04.504629] [INFO ] [MAIN ] Derivative Progress: 297/2057 symbols completed. BURL took 1.1s. Estimated remaining: 11m 3s. Rate: 159.2 symbols/min [2025-10-21T22:06:04.505105] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:04.534106] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:04.535835] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15430 primary records. [2025-10-21T22:06:04.536521] [DEBUG] [LOCAL ] BV: Loaded 38499 existing records from primary storage. [2025-10-21T22:06:04.536026] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-10-21T22:06:04.536893] [INFO ] [MAIN ] BV: Loaded 38499 primary data records. [2025-10-21T22:06:04.606733] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-10-21T22:06:04.615410] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-10-21T22:06:04.618113] [INFO ] [MAIN ] Derivative Progress: 298/2057 symbols completed. BUXX took 0.7s. Estimated remaining: 11m 1s. Rate: 159.6 symbols/min [2025-10-21T22:06:04.880525] [DEBUG] [LOCAL ] BW: Loaded 40403 existing records from primary storage. [2025-10-21T22:06:04.881458] [INFO ] [MAIN ] BW: Loaded 40403 primary data records. [2025-10-21T22:06:05.207473] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:05.208373] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38499 primary records. [2025-10-21T22:06:05.208451] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-10-21T22:06:05.225308] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-10-21T22:06:05.225592] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-10-21T22:06:05.227965] [INFO ] [MAIN ] Derivative Progress: 299/2057 symbols completed. BV took 0.8s. Estimated remaining: 11m 2s. Rate: 159.2 symbols/min [2025-10-21T22:06:05.244450] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:05.245069] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 40403 primary records. [2025-10-21T22:06:05.245130] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-10-21T22:06:05.264170] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-10-21T22:06:05.264325] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-10-21T22:06:05.266905] [INFO ] [MAIN ] Derivative Progress: 300/2057 symbols completed. BW took 0.8s. Estimated remaining: 11m 0s. Rate: 159.7 symbols/min [2025-10-21T22:06:05.267773] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:05.268286] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:05.268234] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:05.288699] [DEBUG] [LOCAL ] BWG: Loaded 12632 existing records from primary storage. [2025-10-21T22:06:05.287257] [DEBUG] [LOCAL ] BWMX: Loaded 7868 existing records from primary storage. [2025-10-21T22:06:05.289031] [INFO ] [MAIN ] BWMX: Loaded 7868 primary data records. [2025-10-21T22:06:05.288981] [INFO ] [MAIN ] BWG: Loaded 12632 primary data records. [2025-10-21T22:06:05.706281] [DEBUG] [LOCAL ] BWA: Loaded 52084 existing records from primary storage. [2025-10-21T22:06:05.782876] [INFO ] [MAIN ] BWA: Loaded 52084 primary data records. [2025-10-21T22:06:06.343220] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:06.344569] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12632 primary records. [2025-10-21T22:06:06.344835] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-10-21T22:06:06.374392] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:06.375918] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7868 primary records. [2025-10-21T22:06:06.376945] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-10-21T22:06:06.378445] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-10-21T22:06:06.378698] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-10-21T22:06:06.382200] [INFO ] [MAIN ] Derivative Progress: 301/2057 symbols completed. BWG took 1.1s. Estimated remaining: 11m 4s. Rate: 158.7 symbols/min [2025-10-21T22:06:06.389446] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:06.402254] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-10-21T22:06:06.402502] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-10-21T22:06:06.405075] [INFO ] [MAIN ] Derivative Progress: 302/2057 symbols completed. BWMX took 1.1s. Estimated remaining: 11m 2s. Rate: 159.2 symbols/min [2025-10-21T22:06:06.408194] [DEBUG] [LOCAL ] BWNB: Loaded 4079 existing records from primary storage. [2025-10-21T22:06:06.408525] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:06.408678] [INFO ] [MAIN ] BWNB: Loaded 4079 primary data records. [2025-10-21T22:06:06.509017] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:06.528579] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52084 primary records. [2025-10-21T22:06:06.528831] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-10-21T22:06:06.640390] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-10-21T22:06:06.706836] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-10-21T22:06:06.752187] [INFO ] [MAIN ] Derivative Progress: 303/2057 symbols completed. BWA took 1.5s. Estimated remaining: 11m 1s. Rate: 159.2 symbols/min [2025-10-21T22:06:06.761165] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:06.785603] [DEBUG] [LOCAL ] BWXT: Loaded 47258 existing records from primary storage. [2025-10-21T22:06:06.787274] [INFO ] [MAIN ] BWXT: Loaded 47258 primary data records. [2025-10-21T22:06:07.132287] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-21T22:06:07.132800] [INFO ] [MAIN ] BX: Loaded 53483 primary data records. [2025-10-21T22:06:07.203448] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:07.218634] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4079 primary records. [2025-10-21T22:06:07.219183] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-10-21T22:06:07.341261] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-10-21T22:06:07.364460] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-10-21T22:06:07.534041] [INFO ] [MAIN ] Derivative Progress: 304/2057 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 3s. Rate: 158.6 symbols/min [2025-10-21T22:06:07.534880] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:07.560290] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:07.561893] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 47258 primary records. [2025-10-21T22:06:07.562323] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-10-21T22:06:07.568287] [DEBUG] [LOCAL ] BXC: Loaded 13531 existing records from primary storage. [2025-10-21T22:06:07.568720] [INFO ] [MAIN ] BXC: Loaded 13531 primary data records. [2025-10-21T22:06:07.673212] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-10-21T22:06:07.689975] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-10-21T22:06:07.703740] [INFO ] [MAIN ] Derivative Progress: 305/2057 symbols completed. BWXT took 1.3s. Estimated remaining: 11m 1s. Rate: 158.9 symbols/min [2025-10-21T22:06:07.720499] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:07.903438] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:07.904831] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53483 primary records. [2025-10-21T22:06:07.904970] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-10-21T22:06:07.923054] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-10-21T22:06:07.924509] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-10-21T22:06:07.927385] [INFO ] [MAIN ] Derivative Progress: 306/2057 symbols completed. BX took 1.2s. Estimated remaining: 11m 0s. Rate: 159.1 symbols/min [2025-10-21T22:06:07.927753] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:07.972004] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:07.972564] [DEBUG] [LOCAL ] BXMX: Loaded 19175 existing records from primary storage. [2025-10-21T22:06:07.985439] [INFO ] [MAIN ] BXMX: Loaded 19175 primary data records. [2025-10-21T22:06:07.986293] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13531 primary records. [2025-10-21T22:06:07.998309] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-10-21T22:06:08.031587] [DEBUG] [LOCAL ] BXMT: Loaded 47278 existing records from primary storage. [2025-10-21T22:06:08.074616] [INFO ] [MAIN ] BXMT: Loaded 47278 primary data records. [2025-10-21T22:06:08.189830] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-10-21T22:06:08.242853] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-10-21T22:06:08.265223] [INFO ] [MAIN ] Derivative Progress: 307/2057 symbols completed. BXC took 0.7s. Estimated remaining: 10m 60s. Rate: 159.2 symbols/min [2025-10-21T22:06:08.273255] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:08.678882] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:08.680012] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19175 primary records. [2025-10-21T22:06:08.680847] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-10-21T22:06:08.712856] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-10-21T22:06:08.714078] [DEBUG] [LOCAL ] BXP: Loaded 49875 existing records from primary storage. [2025-10-21T22:06:08.715019] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-10-21T22:06:08.718712] [INFO ] [MAIN ] Derivative Progress: 308/2057 symbols completed. BXMX took 0.8s. Estimated remaining: 10m 60s. Rate: 159.1 symbols/min [2025-10-21T22:06:08.719008] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:08.719279] [INFO ] [MAIN ] BXP: Loaded 49875 primary data records. [2025-10-21T22:06:08.764888] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:08.799440] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47278 primary records. [2025-10-21T22:06:08.811855] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-10-21T22:06:08.914606] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-10-21T22:06:08.954418] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-10-21T22:06:08.957247] [INFO ] [MAIN ] Derivative Progress: 309/2057 symbols completed. BXMT took 1.2s. Estimated remaining: 10m 58s. Rate: 159.3 symbols/min [2025-10-21T22:06:09.082598] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:09.110514] [DEBUG] [LOCAL ] BXSL: Loaded 48203 existing records from primary storage. [2025-10-21T22:06:09.110863] [INFO ] [MAIN ] BXSL: Loaded 48203 primary data records. [2025-10-21T22:06:09.150504] [DEBUG] [LOCAL ] BY: Loaded 21802 existing records from primary storage. [2025-10-21T22:06:09.175232] [INFO ] [MAIN ] BY: Loaded 21802 primary data records. [2025-10-21T22:06:09.395834] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:09.608493] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49875 primary records. [2025-10-21T22:06:09.750700] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-10-21T22:06:09.778431] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-10-21T22:06:09.779625] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-10-21T22:06:09.783024] [INFO ] [MAIN ] Derivative Progress: 310/2057 symbols completed. BXP took 1.5s. Estimated remaining: 11m 1s. Rate: 158.7 symbols/min [2025-10-21T22:06:09.784110] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:09.813557] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:09.827339] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 48203 primary records. [2025-10-21T22:06:09.827443] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-10-21T22:06:09.827798] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:09.839874] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21802 primary records. [2025-10-21T22:06:09.840043] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-10-21T22:06:09.866947] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-10-21T22:06:09.870766] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-10-21T22:06:09.874687] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-10-21T22:06:09.874544] [INFO ] [MAIN ] Derivative Progress: 311/2057 symbols completed. BXSL took 1.2s. Estimated remaining: 10m 59s. Rate: 159.1 symbols/min [2025-10-21T22:06:09.875055] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:09.874911] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-10-21T22:06:09.878356] [INFO ] [MAIN ] Derivative Progress: 312/2057 symbols completed. BY took 0.8s. Estimated remaining: 10m 56s. Rate: 159.6 symbols/min [2025-10-21T22:06:09.878743] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:09.894875] [DEBUG] [LOCAL ] BYD: Loaded 44943 existing records from primary storage. [2025-10-21T22:06:09.895109] [INFO ] [MAIN ] BYD: Loaded 44943 primary data records. [2025-10-21T22:06:10.005625] [DEBUG] [LOCAL ] BYM: Loaded 11430 existing records from primary storage. [2025-10-21T22:06:10.009407] [INFO ] [MAIN ] BYM: Loaded 11430 primary data records. [2025-10-21T22:06:10.390166] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-21T22:06:10.415136] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-10-21T22:06:10.860828] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:10.870890] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 44943 primary records. [2025-10-21T22:06:10.876287] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-10-21T22:06:10.876216] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:10.878345] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 11430 primary records. [2025-10-21T22:06:10.885525] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-10-21T22:06:10.894363] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-10-21T22:06:10.894816] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-10-21T22:06:10.908180] [INFO ] [MAIN ] Derivative Progress: 313/2057 symbols completed. BYD took 1.1s. Estimated remaining: 10m 59s. Rate: 158.7 symbols/min [2025-10-21T22:06:10.913955] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-10-21T22:06:10.915593] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-10-21T22:06:10.917843] [INFO ] [MAIN ] Derivative Progress: 314/2057 symbols completed. BYM took 1.0s. Estimated remaining: 10m 57s. Rate: 159.2 symbols/min [2025-10-21T22:06:10.935975] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:10.936757] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-10-21T22:06:10.936828] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-10-21T22:06:10.958484] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-10-21T22:06:10.958591] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-10-21T22:06:10.961519] [INFO ] [MAIN ] Derivative Progress: 315/2057 symbols completed. C took 1.1s. Estimated remaining: 10m 55s. Rate: 159.6 symbols/min [2025-10-21T22:06:10.961957] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:10.962051] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:10.962152] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:11.004975] [DEBUG] [LOCAL ] CABO: Loaded 16710 existing records from primary storage. [2025-10-21T22:06:11.005602] [DEBUG] [LOCAL ] CACI: Loaded 22510 existing records from primary storage. [2025-10-21T22:06:11.005785] [INFO ] [MAIN ] CABO: Loaded 16710 primary data records. [2025-10-21T22:06:11.006365] [DEBUG] [LOCAL ] CAAP: Loaded 19895 existing records from primary storage. [2025-10-21T22:06:11.005852] [INFO ] [MAIN ] CACI: Loaded 22510 primary data records. [2025-10-21T22:06:11.006675] [INFO ] [MAIN ] CAAP: Loaded 19895 primary data records. [2025-10-21T22:06:11.995900] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:11.999842] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 22510 primary records. [2025-10-21T22:06:12.000061] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-10-21T22:06:12.027400] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:12.030250] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 16710 primary records. [2025-10-21T22:06:12.030335] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-10-21T22:06:12.031012] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-10-21T22:06:12.045899] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-10-21T22:06:12.055294] [INFO ] [MAIN ] Derivative Progress: 316/2057 symbols completed. CACI took 1.1s. Estimated remaining: 10m 58s. Rate: 158.7 symbols/min [2025-10-21T22:06:12.059594] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:12.056901] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:12.063699] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-10-21T22:06:12.064623] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19895 primary records. [2025-10-21T22:06:12.064846] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-10-21T22:06:12.064761] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-10-21T22:06:12.067556] [INFO ] [MAIN ] Derivative Progress: 317/2057 symbols completed. CABO took 1.1s. Estimated remaining: 10m 56s. Rate: 159.1 symbols/min [2025-10-21T22:06:12.068551] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:12.086500] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-10-21T22:06:12.086709] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-10-21T22:06:12.089406] [INFO ] [MAIN ] Derivative Progress: 318/2057 symbols completed. CAAP took 1.1s. Estimated remaining: 10m 54s. Rate: 159.6 symbols/min [2025-10-21T22:06:12.089741] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:12.092547] [DEBUG] [LOCAL ] CAF: Loaded 3490 existing records from primary storage. [2025-10-21T22:06:12.093216] [INFO ] [MAIN ] CAF: Loaded 3490 primary data records. [2025-10-21T22:06:12.435387] [DEBUG] [LOCAL ] CADE: Loaded 49677 existing records from primary storage. [2025-10-21T22:06:12.436916] [INFO ] [MAIN ] CADE: Loaded 49677 primary data records. [2025-10-21T22:06:12.563333] [DEBUG] [LOCAL ] CAG: Loaded 53666 existing records from primary storage. [2025-10-21T22:06:12.569279] [INFO ] [MAIN ] CAG: Loaded 53666 primary data records. [2025-10-21T22:06:12.914678] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:12.952406] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3490 primary records. [2025-10-21T22:06:13.056486] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-10-21T22:06:13.081974] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-10-21T22:06:13.082439] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-10-21T22:06:13.085365] [INFO ] [MAIN ] Derivative Progress: 319/2057 symbols completed. CAF took 1.0s. Estimated remaining: 10m 57s. Rate: 158.8 symbols/min [2025-10-21T22:06:13.085622] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:13.104458] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:13.105340] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 49677 primary records. [2025-10-21T22:06:13.105597] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-10-21T22:06:13.122294] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-10-21T22:06:13.122543] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-10-21T22:06:13.124591] [INFO ] [MAIN ] Derivative Progress: 320/2057 symbols completed. CADE took 1.1s. Estimated remaining: 10m 54s. Rate: 159.2 symbols/min [2025-10-21T22:06:13.126459] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:13.141038] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:13.141773] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53666 primary records. [2025-10-21T22:06:13.141944] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-10-21T22:06:13.171076] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-10-21T22:06:13.171251] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-10-21T22:06:13.175828] [INFO ] [MAIN ] Derivative Progress: 321/2057 symbols completed. CAG took 1.1s. Estimated remaining: 10m 52s. Rate: 159.7 symbols/min [2025-10-21T22:06:13.176184] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:13.204139] [DEBUG] [LOCAL ] CAH: Loaded 51443 existing records from primary storage. [2025-10-21T22:06:13.204562] [INFO ] [MAIN ] CAH: Loaded 51443 primary data records. [2025-10-21T22:06:13.362057] [DEBUG] [LOCAL ] CAL: Loaded 42780 existing records from primary storage. [2025-10-21T22:06:13.393824] [INFO ] [MAIN ] CAL: Loaded 42780 primary data records. [2025-10-21T22:06:13.435321] [DEBUG] [LOCAL ] CALX: Loaded 37319 existing records from primary storage. [2025-10-21T22:06:13.462699] [INFO ] [MAIN ] CALX: Loaded 37319 primary data records. [2025-10-21T22:06:14.187227] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:14.188103] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51443 primary records. [2025-10-21T22:06:14.188187] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-10-21T22:06:14.210462] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-10-21T22:06:14.210706] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-10-21T22:06:14.214555] [INFO ] [MAIN ] Derivative Progress: 322/2057 symbols completed. CAH took 1.1s. Estimated remaining: 10m 56s. Rate: 158.8 symbols/min [2025-10-21T22:06:14.214799] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:14.232358] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:14.241126] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 42780 primary records. [2025-10-21T22:06:14.246556] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-10-21T22:06:14.246497] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:14.247900] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 37319 primary records. [2025-10-21T22:06:14.248249] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-10-21T22:06:14.263817] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-10-21T22:06:14.279703] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-10-21T22:06:14.286221] [INFO ] [MAIN ] Derivative Progress: 323/2057 symbols completed. CAL took 1.2s. Estimated remaining: 10m 54s. Rate: 159.2 symbols/min [2025-10-21T22:06:14.287781] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:14.289999] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-10-21T22:06:14.290140] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-10-21T22:06:14.292544] [INFO ] [MAIN ] Derivative Progress: 324/2057 symbols completed. CALX took 1.1s. Estimated remaining: 10m 51s. Rate: 159.7 symbols/min [2025-10-21T22:06:14.292796] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:14.304826] [DEBUG] [LOCAL ] CANG: Loaded 27080 existing records from primary storage. [2025-10-21T22:06:14.305009] [INFO ] [MAIN ] CANG: Loaded 27080 primary data records. [2025-10-21T22:06:14.371015] [DEBUG] [LOCAL ] CAPL: Loaded 5485 existing records from primary storage. [2025-10-21T22:06:14.382749] [INFO ] [MAIN ] CAPL: Loaded 5485 primary data records. [2025-10-21T22:06:14.954361] [DEBUG] [LOCAL ] CARR: Loaded 53603 existing records from primary storage. [2025-10-21T22:06:14.954686] [INFO ] [MAIN ] CARR: Loaded 53603 primary data records. [2025-10-21T22:06:15.363173] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:15.364789] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 27080 primary records. [2025-10-21T22:06:15.365036] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-10-21T22:06:15.384753] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-10-21T22:06:15.385545] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-10-21T22:06:15.400252] [INFO ] [MAIN ] Derivative Progress: 325/2057 symbols completed. CANG took 1.2s. Estimated remaining: 10m 55s. Rate: 158.7 symbols/min [2025-10-21T22:06:15.400844] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:15.402244] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5485 primary records. [2025-10-21T22:06:15.400989] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:15.402474] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-10-21T22:06:15.425020] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-10-21T22:06:15.425418] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-10-21T22:06:15.428233] [INFO ] [MAIN ] Derivative Progress: 326/2057 symbols completed. CAPL took 1.1s. Estimated remaining: 10m 52s. Rate: 159.2 symbols/min [2025-10-21T22:06:15.428805] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:15.440639] [DEBUG] [LOCAL ] CATO: Loaded 6616 existing records from primary storage. [2025-10-21T22:06:15.448831] [INFO ] [MAIN ] CATO: Loaded 6616 primary data records. [2025-10-21T22:06:15.491017] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:15.534709] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53603 primary records. [2025-10-21T22:06:15.547166] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-10-21T22:06:15.640597] [DEBUG] [LOCAL ] CAT: Loaded 52953 existing records from primary storage. [2025-10-21T22:06:15.680513] [INFO ] [MAIN ] CAT: Loaded 52953 primary data records. [2025-10-21T22:06:15.809236] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-10-21T22:06:15.834419] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-10-21T22:06:15.846107] [INFO ] [MAIN ] Derivative Progress: 327/2057 symbols completed. CARR took 1.6s. Estimated remaining: 10m 52s. Rate: 159.1 symbols/min [2025-10-21T22:06:15.866526] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:16.181747] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:16.197025] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 6616 primary records. [2025-10-21T22:06:16.198420] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-10-21T22:06:16.200995] [DEBUG] [LOCAL ] CAVA: Loaded 53551 existing records from primary storage. [2025-10-21T22:06:16.213980] [INFO ] [MAIN ] CAVA: Loaded 53551 primary data records. [2025-10-21T22:06:16.217319] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-10-21T22:06:16.217583] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-10-21T22:06:16.220341] [INFO ] [MAIN ] Derivative Progress: 328/2057 symbols completed. CATO took 0.8s. Estimated remaining: 10m 52s. Rate: 159.1 symbols/min [2025-10-21T22:06:16.359735] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:16.370903] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52953 primary records. [2025-10-21T22:06:16.383669] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-10-21T22:06:16.551198] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-10-21T22:06:16.551353] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-10-21T22:06:16.555073] [INFO ] [MAIN ] Derivative Progress: 329/2057 symbols completed. CAT took 1.2s. Estimated remaining: 10m 51s. Rate: 159.2 symbols/min [2025-10-21T22:06:16.575425] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:16.576057] [INFO ] [MAIN ] CAVA: Generated 1793 derivative records from 53551 primary records. [2025-10-21T22:06:16.576118] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-10-21T22:06:16.590964] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1793 records). [2025-10-21T22:06:16.591023] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-10-21T22:06:16.593170] [INFO ] [MAIN ] Derivative Progress: 330/2057 symbols completed. CAVA took 0.7s. Estimated remaining: 10m 49s. Rate: 159.6 symbols/min [2025-10-21T22:06:16.593528] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:16.593627] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:16.593933] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:16.599680] [DEBUG] [LOCAL ] CBNA: Loaded 2888 existing records from primary storage. [2025-10-21T22:06:16.600001] [INFO ] [MAIN ] CBNA: Loaded 2888 primary data records. [2025-10-21T22:06:16.935198] [DEBUG] [LOCAL ] CBRE: Loaded 50283 existing records from primary storage. [2025-10-21T22:06:16.936058] [INFO ] [MAIN ] CBRE: Loaded 50283 primary data records. [2025-10-21T22:06:17.020805] [DEBUG] [LOCAL ] CB: Loaded 49973 existing records from primary storage. [2025-10-21T22:06:17.028518] [INFO ] [MAIN ] CB: Loaded 49973 primary data records. [2025-10-21T22:06:17.625031] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:17.627590] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2888 primary records. [2025-10-21T22:06:17.628528] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-10-21T22:06:17.645415] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-10-21T22:06:17.645767] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-10-21T22:06:17.648327] [INFO ] [MAIN ] Derivative Progress: 331/2057 symbols completed. CBNA took 1.1s. Estimated remaining: 10m 52s. Rate: 158.8 symbols/min [2025-10-21T22:06:17.649096] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:17.666130] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:17.666838] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50283 primary records. [2025-10-21T22:06:17.666954] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-10-21T22:06:17.685951] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-10-21T22:06:17.686298] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-10-21T22:06:17.690110] [INFO ] [MAIN ] Derivative Progress: 332/2057 symbols completed. CBRE took 1.1s. Estimated remaining: 10m 50s. Rate: 159.2 symbols/min [2025-10-21T22:06:17.702748] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:17.703273] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:17.704110] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 49973 primary records. [2025-10-21T22:06:17.712141] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-10-21T22:06:17.731710] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-10-21T22:06:17.741461] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-10-21T22:06:17.749109] [DEBUG] [LOCAL ] CBT: Loaded 31053 existing records from primary storage. [2025-10-21T22:06:17.748144] [INFO ] [MAIN ] Derivative Progress: 333/2057 symbols completed. CB took 1.2s. Estimated remaining: 10m 48s. Rate: 159.6 symbols/min [2025-10-21T22:06:17.749325] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:17.749469] [INFO ] [MAIN ] CBT: Loaded 31053 primary data records. [2025-10-21T22:06:17.823219] [DEBUG] [LOCAL ] CBU: Loaded 22773 existing records from primary storage. [2025-10-21T22:06:17.850376] [INFO ] [MAIN ] CBU: Loaded 22773 primary data records. [2025-10-21T22:06:18.204057] [DEBUG] [LOCAL ] CBZ: Loaded 34322 existing records from primary storage. [2025-10-21T22:06:18.208261] [INFO ] [MAIN ] CBZ: Loaded 34322 primary data records. [2025-10-21T22:06:18.739508] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:18.741077] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 31053 primary records. [2025-10-21T22:06:18.741391] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-10-21T22:06:18.758310] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-10-21T22:06:18.758728] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-10-21T22:06:18.761069] [INFO ] [MAIN ] Derivative Progress: 334/2057 symbols completed. CBT took 1.1s. Estimated remaining: 10m 51s. Rate: 158.8 symbols/min [2025-10-21T22:06:18.762125] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:18.778769] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:18.779628] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22773 primary records. [2025-10-21T22:06:18.779864] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-10-21T22:06:18.795477] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-10-21T22:06:18.795596] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-10-21T22:06:18.798041] [INFO ] [MAIN ] Derivative Progress: 335/2057 symbols completed. CBU took 1.1s. Estimated remaining: 10m 49s. Rate: 159.2 symbols/min [2025-10-21T22:06:18.798249] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:18.817839] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:18.818894] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 34322 primary records. [2025-10-21T22:06:18.819028] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-10-21T22:06:18.849893] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-10-21T22:06:18.850152] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-10-21T22:06:18.854117] [INFO ] [MAIN ] Derivative Progress: 336/2057 symbols completed. CBZ took 1.1s. Estimated remaining: 10m 47s. Rate: 159.6 symbols/min [2025-10-21T22:06:18.854466] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:18.887527] [DEBUG] [LOCAL ] CC: Loaded 53021 existing records from primary storage. [2025-10-21T22:06:18.887946] [INFO ] [MAIN ] CC: Loaded 53021 primary data records. [2025-10-21T22:06:19.013390] [DEBUG] [LOCAL ] CCIF: Loaded 15216 existing records from primary storage. [2025-10-21T22:06:19.017814] [DEBUG] [LOCAL ] CCI: Loaded 53111 existing records from primary storage. [2025-10-21T22:06:19.016825] [INFO ] [MAIN ] CCIF: Loaded 15216 primary data records. [2025-10-21T22:06:19.050841] [INFO ] [MAIN ] CCI: Loaded 53111 primary data records. [2025-10-21T22:06:19.915559] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:19.916378] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53021 primary records. [2025-10-21T22:06:19.916848] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-10-21T22:06:19.934046] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-10-21T22:06:19.935174] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-10-21T22:06:19.937445] [INFO ] [MAIN ] Derivative Progress: 337/2057 symbols completed. CC took 1.2s. Estimated remaining: 10m 50s. Rate: 158.7 symbols/min [2025-10-21T22:06:19.938497] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:19.953119] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:19.955124] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15216 primary records. [2025-10-21T22:06:19.955300] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-10-21T22:06:19.972469] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-10-21T22:06:19.985072] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-10-21T22:06:19.987820] [INFO ] [MAIN ] Derivative Progress: 338/2057 symbols completed. CCIF took 1.1s. Estimated remaining: 10m 48s. Rate: 159.1 symbols/min [2025-10-21T22:06:19.988718] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:19.989496] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:19.990338] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53111 primary records. [2025-10-21T22:06:19.990399] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-10-21T22:06:20.007046] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-10-21T22:06:20.007240] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-10-21T22:06:20.009777] [INFO ] [MAIN ] Derivative Progress: 339/2057 symbols completed. CCI took 1.2s. Estimated remaining: 10m 46s. Rate: 159.6 symbols/min [2025-10-21T22:06:20.010280] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:20.056742] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-21T22:06:20.056937] [INFO ] [MAIN ] CCJ: Loaded 53690 primary data records. [2025-10-21T22:06:20.162538] [DEBUG] [LOCAL ] CCK: Loaded 46497 existing records from primary storage. [2025-10-21T22:06:20.173994] [INFO ] [MAIN ] CCK: Loaded 46497 primary data records. [2025-10-21T22:06:20.380435] [DEBUG] [LOCAL ] CCO: Loaded 48523 existing records from primary storage. [2025-10-21T22:06:20.385952] [INFO ] [MAIN ] CCO: Loaded 48523 primary data records. [2025-10-21T22:06:21.040051] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:21.041544] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53690 primary records. [2025-10-21T22:06:21.041906] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-10-21T22:06:21.056270] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:21.065691] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46497 primary records. [2025-10-21T22:06:21.070145] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-10-21T22:06:21.073954] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-10-21T22:06:21.075036] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-10-21T22:06:21.078254] [INFO ] [MAIN ] Derivative Progress: 340/2057 symbols completed. CCJ took 1.1s. Estimated remaining: 10m 49s. Rate: 158.7 symbols/min [2025-10-21T22:06:21.086463] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:21.109077] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-10-21T22:06:21.109797] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-10-21T22:06:21.109703] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:21.112342] [INFO ] [MAIN ] Derivative Progress: 341/2057 symbols completed. CCK took 1.1s. Estimated remaining: 10m 47s. Rate: 159.1 symbols/min [2025-10-21T22:06:21.115748] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:21.115613] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 48523 primary records. [2025-10-21T22:06:21.116487] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-10-21T22:06:21.130683] [DEBUG] [LOCAL ] CCRD: Loaded 9582 existing records from primary storage. [2025-10-21T22:06:21.137475] [INFO ] [MAIN ] CCRD: Loaded 9582 primary data records. [2025-10-21T22:06:21.137794] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-10-21T22:06:21.138038] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-10-21T22:06:21.141788] [INFO ] [MAIN ] Derivative Progress: 342/2057 symbols completed. CCO took 1.1s. Estimated remaining: 10m 45s. Rate: 159.6 symbols/min [2025-10-21T22:06:21.153689] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:21.325818] [DEBUG] [LOCAL ] CCU: Loaded 21804 existing records from primary storage. [2025-10-21T22:06:21.347626] [INFO ] [MAIN ] CCU: Loaded 21804 primary data records. [2025-10-21T22:06:21.371151] [DEBUG] [LOCAL ] CCS: Loaded 30011 existing records from primary storage. [2025-10-21T22:06:21.383415] [INFO ] [MAIN ] CCS: Loaded 30011 primary data records. [2025-10-21T22:06:22.178269] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:22.180481] [INFO ] [MAIN ] CCRD: Generated 1793 derivative records from 9582 primary records. [2025-10-21T22:06:22.180792] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-10-21T22:06:22.203187] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1793 records). [2025-10-21T22:06:22.203573] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-10-21T22:06:22.206336] [INFO ] [MAIN ] Derivative Progress: 343/2057 symbols completed. CCRD took 1.1s. Estimated remaining: 10m 48s. Rate: 158.7 symbols/min [2025-10-21T22:06:22.226872] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:22.228275] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 21804 primary records. [2025-10-21T22:06:22.228731] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-10-21T22:06:22.253886] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:22.257864] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-10-21T22:06:22.258450] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30011 primary records. [2025-10-21T22:06:22.258545] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-10-21T22:06:22.258625] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-10-21T22:06:22.261409] [INFO ] [MAIN ] Derivative Progress: 344/2057 symbols completed. CCU took 1.1s. Estimated remaining: 10m 46s. Rate: 159.1 symbols/min [2025-10-21T22:06:22.276254] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-10-21T22:06:22.276313] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-10-21T22:06:22.278961] [INFO ] [MAIN ] Derivative Progress: 345/2057 symbols completed. CCS took 1.2s. Estimated remaining: 10m 44s. Rate: 159.6 symbols/min [2025-10-21T22:06:22.279525] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:22.279620] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:22.279925] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:22.292345] [DEBUG] [LOCAL ] CDLR: Loaded 10233 existing records from primary storage. [2025-10-21T22:06:22.292539] [INFO ] [MAIN ] CDLR: Loaded 10233 primary data records. [2025-10-21T22:06:22.642361] [DEBUG] [LOCAL ] CDP: Loaded 42295 existing records from primary storage. [2025-10-21T22:06:22.644088] [INFO ] [MAIN ] CDP: Loaded 42295 primary data records. [2025-10-21T22:06:22.643431] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-21T22:06:22.650337] [INFO ] [MAIN ] CDE: Loaded 53644 primary data records. [2025-10-21T22:06:23.283925] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:23.284926] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 10233 primary records. [2025-10-21T22:06:23.286563] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-10-21T22:06:23.303413] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-10-21T22:06:23.303498] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-10-21T22:06:23.305875] [INFO ] [MAIN ] Derivative Progress: 346/2057 symbols completed. CDLR took 1.0s. Estimated remaining: 10m 47s. Rate: 158.8 symbols/min [2025-10-21T22:06:23.306234] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:23.342337] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:23.350014] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42295 primary records. [2025-10-21T22:06:23.350515] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:23.351673] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53644 primary records. [2025-10-21T22:06:23.350905] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-10-21T22:06:23.351923] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-10-21T22:06:23.383809] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-10-21T22:06:23.388407] [DEBUG] [LOCAL ] CDRE: Loaded 24817 existing records from primary storage. [2025-10-21T22:06:23.392556] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-10-21T22:06:23.394768] [INFO ] [MAIN ] Derivative Progress: 347/2057 symbols completed. CDP took 1.1s. Estimated remaining: 10m 45s. Rate: 159.1 symbols/min [2025-10-21T22:06:23.392486] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-10-21T22:06:23.395014] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-10-21T22:06:23.394945] [INFO ] [MAIN ] CDRE: Loaded 24817 primary data records. [2025-10-21T22:06:23.403478] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:23.403564] [INFO ] [MAIN ] Derivative Progress: 348/2057 symbols completed. CDE took 1.1s. Estimated remaining: 10m 43s. Rate: 159.6 symbols/min [2025-10-21T22:06:23.429379] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:23.516329] [DEBUG] [LOCAL ] CEE: Loaded 5247 existing records from primary storage. [2025-10-21T22:06:23.532120] [INFO ] [MAIN ] CEE: Loaded 5247 primary data records. [2025-10-21T22:06:23.889152] [DEBUG] [LOCAL ] CE: Loaded 51289 existing records from primary storage. [2025-10-21T22:06:23.913938] [INFO ] [MAIN ] CE: Loaded 51289 primary data records. [2025-10-21T22:06:24.414427] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:24.415810] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 24817 primary records. [2025-10-21T22:06:24.415927] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-10-21T22:06:24.449745] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-10-21T22:06:24.450167] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-10-21T22:06:24.450066] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:24.453516] [INFO ] [MAIN ] Derivative Progress: 349/2057 symbols completed. CDRE took 1.1s. Estimated remaining: 10m 46s. Rate: 158.8 symbols/min [2025-10-21T22:06:24.451250] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 5247 primary records. [2025-10-21T22:06:24.454061] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-10-21T22:06:24.454009] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:24.471594] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-10-21T22:06:24.471870] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-10-21T22:06:24.474676] [INFO ] [MAIN ] Derivative Progress: 350/2057 symbols completed. CEE took 1.0s. Estimated remaining: 10m 43s. Rate: 159.2 symbols/min [2025-10-21T22:06:24.474890] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:24.492745] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:24.493727] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51289 primary records. [2025-10-21T22:06:24.501345] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-10-21T22:06:24.530822] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-10-21T22:06:24.531003] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-10-21T22:06:24.531914] [DEBUG] [LOCAL ] CEPU: Loaded 27014 existing records from primary storage. [2025-10-21T22:06:24.534438] [INFO ] [MAIN ] Derivative Progress: 351/2057 symbols completed. CE took 1.1s. Estimated remaining: 10m 41s. Rate: 159.6 symbols/min [2025-10-21T22:06:24.534829] [INFO ] [MAIN ] CEPU: Loaded 27014 primary data records. [2025-10-21T22:06:24.535048] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:24.884410] [DEBUG] [LOCAL ] CF: Loaded 52111 existing records from primary storage. [2025-10-21T22:06:24.884873] [INFO ] [MAIN ] CF: Loaded 52111 primary data records. [2025-10-21T22:06:25.044000] [DEBUG] [LOCAL ] CFG: Loaded 53623 existing records from primary storage. [2025-10-21T22:06:25.060017] [INFO ] [MAIN ] CFG: Loaded 53623 primary data records. [2025-10-21T22:06:25.627167] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:25.636790] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 27014 primary records. [2025-10-21T22:06:25.637246] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-10-21T22:06:25.655236] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-10-21T22:06:25.655395] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-10-21T22:06:25.657804] [INFO ] [MAIN ] Derivative Progress: 352/2057 symbols completed. CEPU took 1.2s. Estimated remaining: 10m 45s. Rate: 158.7 symbols/min [2025-10-21T22:06:25.658330] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:25.678919] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:25.679758] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52111 primary records. [2025-10-21T22:06:25.679958] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-10-21T22:06:25.706524] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-10-21T22:06:25.706861] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-10-21T22:06:25.709431] [INFO ] [MAIN ] Derivative Progress: 353/2057 symbols completed. CF took 1.2s. Estimated remaining: 10m 43s. Rate: 159.1 symbols/min [2025-10-21T22:06:25.709681] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:25.726536] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:25.736566] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53623 primary records. [2025-10-21T22:06:25.737907] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-10-21T22:06:25.746793] [DEBUG] [LOCAL ] CFR: Loaded 32535 existing records from primary storage. [2025-10-21T22:06:25.750948] [INFO ] [MAIN ] CFR: Loaded 32535 primary data records. [2025-10-21T22:06:25.755177] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-10-21T22:06:25.760433] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-10-21T22:06:25.763502] [INFO ] [MAIN ] Derivative Progress: 354/2057 symbols completed. CFG took 1.2s. Estimated remaining: 10m 41s. Rate: 159.4 symbols/min [2025-10-21T22:06:25.770846] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:25.863677] [DEBUG] [LOCAL ] CGV: Loaded 1377 existing records from primary storage. [2025-10-21T22:06:25.909700] [INFO ] [MAIN ] CGV: Loaded 1377 primary data records. [2025-10-21T22:06:25.922278] [DEBUG] [LOCAL ] CGAU: Loaded 43896 existing records from primary storage. [2025-10-21T22:06:25.937933] [INFO ] [MAIN ] CGAU: Loaded 43896 primary data records. [2025-10-21T22:06:26.754490] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:26.755971] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 32535 primary records. [2025-10-21T22:06:26.756178] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-10-21T22:06:26.773357] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-10-21T22:06:26.773573] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-10-21T22:06:26.775991] [INFO ] [MAIN ] Derivative Progress: 355/2057 symbols completed. CFR took 1.1s. Estimated remaining: 10m 44s. Rate: 158.7 symbols/min [2025-10-21T22:06:26.776130] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:26.795906] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:26.810998] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 43896 primary records. [2025-10-21T22:06:26.811150] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-10-21T22:06:26.811996] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:26.825595] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1377 primary records. [2025-10-21T22:06:26.832425] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-10-21T22:06:26.834122] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-10-21T22:06:26.834528] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-10-21T22:06:26.837811] [INFO ] [MAIN ] Derivative Progress: 356/2057 symbols completed. CGAU took 1.1s. Estimated remaining: 10m 42s. Rate: 159.1 symbols/min [2025-10-21T22:06:26.837966] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:26.861729] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-10-21T22:06:26.862338] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-10-21T22:06:26.862200] [DEBUG] [LOCAL ] CHCT: Loaded 24339 existing records from primary storage. [2025-10-21T22:06:26.864988] [INFO ] [MAIN ] Derivative Progress: 357/2057 symbols completed. CGV took 1.1s. Estimated remaining: 10m 40s. Rate: 159.5 symbols/min [2025-10-21T22:06:26.865235] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:26.865495] [INFO ] [MAIN ] CHCT: Loaded 24339 primary data records. [2025-10-21T22:06:27.078598] [DEBUG] [LOCAL ] CHE: Loaded 15306 existing records from primary storage. [2025-10-21T22:06:27.179252] [INFO ] [MAIN ] CHE: Loaded 15306 primary data records. [2025-10-21T22:06:27.274836] [DEBUG] [LOCAL ] CHD: Loaded 52328 existing records from primary storage. [2025-10-21T22:06:27.303697] [INFO ] [MAIN ] CHD: Loaded 52328 primary data records. [2025-10-21T22:06:27.879675] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:27.882257] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24339 primary records. [2025-10-21T22:06:27.882727] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-10-21T22:06:27.900767] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-10-21T22:06:27.901150] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-10-21T22:06:27.903572] [INFO ] [MAIN ] Derivative Progress: 358/2057 symbols completed. CHCT took 1.1s. Estimated remaining: 10m 42s. Rate: 158.7 symbols/min [2025-10-21T22:06:27.924511] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:27.925479] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 15306 primary records. [2025-10-21T22:06:27.937990] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-10-21T22:06:27.938193] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:27.939878] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 52328 primary records. [2025-10-21T22:06:27.939959] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-10-21T22:06:27.968825] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-10-21T22:06:27.969290] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-10-21T22:06:27.971743] [INFO ] [MAIN ] Derivative Progress: 359/2057 symbols completed. CHE took 1.1s. Estimated remaining: 10m 41s. Rate: 159.1 symbols/min [2025-10-21T22:06:27.974255] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-10-21T22:06:27.974578] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-10-21T22:06:27.977206] [INFO ] [MAIN ] Derivative Progress: 360/2057 symbols completed. CHD took 1.1s. Estimated remaining: 10m 38s. Rate: 159.5 symbols/min [2025-10-21T22:06:27.977573] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:27.978003] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:27.977720] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:27.987808] [DEBUG] [LOCAL ] CHN: Loaded 4994 existing records from primary storage. [2025-10-21T22:06:27.993569] [INFO ] [MAIN ] CHN: Loaded 4994 primary data records. [2025-10-21T22:06:28.086476] [DEBUG] [LOCAL ] CHMI: Loaded 21355 existing records from primary storage. [2025-10-21T22:06:28.112045] [INFO ] [MAIN ] CHMI: Loaded 21355 primary data records. [2025-10-21T22:06:28.452135] [DEBUG] [LOCAL ] CHH: Loaded 32272 existing records from primary storage. [2025-10-21T22:06:28.457814] [INFO ] [MAIN ] CHH: Loaded 32272 primary data records. [2025-10-21T22:06:29.015096] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:29.020109] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4994 primary records. [2025-10-21T22:06:29.020600] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-10-21T22:06:29.046007] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:29.054674] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 21355 primary records. [2025-10-21T22:06:29.055271] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-10-21T22:06:29.058542] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-10-21T22:06:29.070954] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-10-21T22:06:29.075910] [INFO ] [MAIN ] Derivative Progress: 361/2057 symbols completed. CHN took 1.1s. Estimated remaining: 10m 41s. Rate: 158.7 symbols/min [2025-10-21T22:06:29.078170] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-10-21T22:06:29.079114] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-10-21T22:06:29.079303] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:29.083116] [INFO ] [MAIN ] Derivative Progress: 362/2057 symbols completed. CHMI took 1.1s. Estimated remaining: 10m 39s. Rate: 159.1 symbols/min [2025-10-21T22:06:29.083518] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:29.103889] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:29.105020] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32272 primary records. [2025-10-21T22:06:29.105267] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-10-21T22:06:29.137116] [DEBUG] [LOCAL ] CHT: Loaded 19274 existing records from primary storage. [2025-10-21T22:06:29.148117] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-10-21T22:06:29.147401] [INFO ] [MAIN ] CHT: Loaded 19274 primary data records. [2025-10-21T22:06:29.148385] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-10-21T22:06:29.162445] [INFO ] [MAIN ] Derivative Progress: 363/2057 symbols completed. CHH took 1.2s. Estimated remaining: 10m 38s. Rate: 159.4 symbols/min [2025-10-21T22:06:29.206319] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:29.292888] [DEBUG] [LOCAL ] CHPT: Loaded 47136 existing records from primary storage. [2025-10-21T22:06:29.327715] [INFO ] [MAIN ] CHPT: Loaded 47136 primary data records. [2025-10-21T22:06:29.834418] [DEBUG] [LOCAL ] CHWY: Loaded 53656 existing records from primary storage. [2025-10-21T22:06:29.834769] [INFO ] [MAIN ] CHWY: Loaded 53656 primary data records. [2025-10-21T22:06:30.055064] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:30.148529] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19274 primary records. [2025-10-21T22:06:30.149515] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-10-21T22:06:30.167267] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-10-21T22:06:30.167442] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-10-21T22:06:30.170563] [INFO ] [MAIN ] Derivative Progress: 364/2057 symbols completed. CHT took 1.1s. Estimated remaining: 10m 40s. Rate: 158.7 symbols/min [2025-10-21T22:06:30.171097] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:30.186778] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:30.188186] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 47136 primary records. [2025-10-21T22:06:30.188430] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-10-21T22:06:30.204514] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-10-21T22:06:30.204718] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-10-21T22:06:30.207291] [INFO ] [MAIN ] Derivative Progress: 365/2057 symbols completed. CHPT took 1.1s. Estimated remaining: 10m 38s. Rate: 159.1 symbols/min [2025-10-21T22:06:30.207470] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:30.229901] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:30.230743] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53656 primary records. [2025-10-21T22:06:30.230851] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-10-21T22:06:30.255999] [DEBUG] [LOCAL ] CIA: Loaded 16533 existing records from primary storage. [2025-10-21T22:06:30.260821] [INFO ] [MAIN ] CIA: Loaded 16533 primary data records. [2025-10-21T22:06:30.264369] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-10-21T22:06:30.285029] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-10-21T22:06:30.302489] [INFO ] [MAIN ] Derivative Progress: 366/2057 symbols completed. CHWY took 1.1s. Estimated remaining: 10m 36s. Rate: 159.4 symbols/min [2025-10-21T22:06:30.379719] [DEBUG] [LOCAL ] CI: Loaded 49617 existing records from primary storage. [2025-10-21T22:06:30.360744] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:30.379851] [INFO ] [MAIN ] CI: Loaded 49617 primary data records. [2025-10-21T22:06:30.924270] [DEBUG] [LOCAL ] CIEN: Loaded 52126 existing records from primary storage. [2025-10-21T22:06:30.925084] [INFO ] [MAIN ] CIEN: Loaded 52126 primary data records. [2025-10-21T22:06:31.067053] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:31.118585] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16533 primary records. [2025-10-21T22:06:31.119015] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-10-21T22:06:31.261164] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-10-21T22:06:31.262121] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-10-21T22:06:31.265713] [INFO ] [MAIN ] Derivative Progress: 367/2057 symbols completed. CIA took 1.1s. Estimated remaining: 10m 39s. Rate: 158.7 symbols/min [2025-10-21T22:06:31.266535] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:31.281191] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:31.282174] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49617 primary records. [2025-10-21T22:06:31.282556] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-10-21T22:06:31.298608] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-10-21T22:06:31.298787] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-10-21T22:06:31.301547] [INFO ] [MAIN ] Derivative Progress: 368/2057 symbols completed. CI took 1.1s. Estimated remaining: 10m 37s. Rate: 159.1 symbols/min [2025-10-21T22:06:31.302943] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:31.343706] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:31.343490] [DEBUG] [LOCAL ] CII: Loaded 15235 existing records from primary storage. [2025-10-21T22:06:31.343833] [INFO ] [MAIN ] CII: Loaded 15235 primary data records. [2025-10-21T22:06:31.344455] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52126 primary records. [2025-10-21T22:06:31.380840] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-10-21T22:06:31.476775] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-10-21T22:06:31.472073] [DEBUG] [LOCAL ] CIG: Loaded 44458 existing records from primary storage. [2025-10-21T22:06:31.477073] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-10-21T22:06:31.477492] [INFO ] [MAIN ] CIG: Loaded 44458 primary data records. [2025-10-21T22:06:31.479881] [INFO ] [MAIN ] Derivative Progress: 369/2057 symbols completed. CIEN took 1.1s. Estimated remaining: 10m 36s. Rate: 159.4 symbols/min [2025-10-21T22:06:31.495829] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:32.042046] [DEBUG] [LOCAL ] CIM: Loaded 37513 existing records from primary storage. [2025-10-21T22:06:32.042792] [INFO ] [MAIN ] CIM: Loaded 37513 primary data records. [2025-10-21T22:06:32.076002] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:32.119158] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15235 primary records. [2025-10-21T22:06:32.119414] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-10-21T22:06:32.174312] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-10-21T22:06:32.184798] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-10-21T22:06:32.215819] [INFO ] [MAIN ] Derivative Progress: 370/2057 symbols completed. CII took 0.9s. Estimated remaining: 10m 37s. Rate: 159.0 symbols/min [2025-10-21T22:06:32.216012] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:32.375762] [DEBUG] [LOCAL ] CIMN: Loaded 2746 existing records from primary storage. [2025-10-21T22:06:32.376044] [INFO ] [MAIN ] CIMN: Loaded 2746 primary data records. [2025-10-21T22:06:32.411210] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:32.412438] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 44458 primary records. [2025-10-21T22:06:32.446725] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-10-21T22:06:32.534562] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-10-21T22:06:32.540508] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-10-21T22:06:32.543092] [INFO ] [MAIN ] Derivative Progress: 371/2057 symbols completed. CIG took 1.3s. Estimated remaining: 10m 36s. Rate: 159.0 symbols/min [2025-10-21T22:06:32.546383] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:32.739562] [DEBUG] [LOCAL ] CINT: Loaded 20318 existing records from primary storage. [2025-10-21T22:06:32.776704] [INFO ] [MAIN ] CINT: Loaded 20318 primary data records. [2025-10-21T22:06:32.905844] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:32.909915] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37513 primary records. [2025-10-21T22:06:32.915733] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-10-21T22:06:33.125005] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-10-21T22:06:33.125756] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-10-21T22:06:33.128100] [INFO ] [MAIN ] Derivative Progress: 372/2057 symbols completed. CIM took 1.6s. Estimated remaining: 10m 37s. Rate: 158.8 symbols/min [2025-10-21T22:06:33.128410] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:33.150680] [DEBUG] [MAIN ] CIMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:33.151640] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2746 primary records. [2025-10-21T22:06:33.152969] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-10-21T22:06:33.177711] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-10-21T22:06:33.178400] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-10-21T22:06:33.181131] [INFO ] [MAIN ] Derivative Progress: 373/2057 symbols completed. CIMN took 1.0s. Estimated remaining: 10m 35s. Rate: 159.1 symbols/min [2025-10-21T22:06:33.190884] [DEBUG] [LOCAL ] CIO: Loaded 21132 existing records from primary storage. [2025-10-21T22:06:33.191197] [INFO ] [MAIN ] CIO: Loaded 21132 primary data records. [2025-10-21T22:06:33.321329] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:33.324517] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 20318 primary records. [2025-10-21T22:06:33.330260] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-10-21T22:06:33.418148] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-10-21T22:06:33.418324] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-10-21T22:06:33.548985] [INFO ] [MAIN ] Derivative Progress: 374/2057 symbols completed. CINT took 1.0s. Estimated remaining: 10m 34s. Rate: 159.2 symbols/min [2025-10-21T22:06:33.617165] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:33.617789] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 21132 primary records. [2025-10-21T22:06:33.617851] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-10-21T22:06:33.631979] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-10-21T22:06:33.632036] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-10-21T22:06:33.636865] [INFO ] [MAIN ] Derivative Progress: 375/2057 symbols completed. CIO took 0.5s. Estimated remaining: 10m 33s. Rate: 159.5 symbols/min [2025-10-21T22:06:33.637335] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:33.637438] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:33.637556] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:33.667814] [DEBUG] [LOCAL ] CION: Loaded 28277 existing records from primary storage. [2025-10-21T22:06:33.668091] [INFO ] [MAIN ] CION: Loaded 28277 primary data records. [2025-10-21T22:06:33.898262] [DEBUG] [LOCAL ] CIVI: Loaded 52734 existing records from primary storage. [2025-10-21T22:06:34.012300] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-21T22:06:34.040639] [INFO ] [MAIN ] CIVI: Loaded 52734 primary data records. [2025-10-21T22:06:34.048961] [INFO ] [MAIN ] CL: Loaded 53649 primary data records. [2025-10-21T22:06:34.661253] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:34.662432] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 28277 primary records. [2025-10-21T22:06:34.662729] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-10-21T22:06:34.679376] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-10-21T22:06:34.679868] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-10-21T22:06:34.683036] [INFO ] [MAIN ] Derivative Progress: 376/2057 symbols completed. CION took 1.0s. Estimated remaining: 10m 35s. Rate: 158.7 symbols/min [2025-10-21T22:06:34.683571] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:34.725397] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:34.725033] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:34.726187] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53649 primary records. [2025-10-21T22:06:34.726312] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-10-21T22:06:34.727262] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52734 primary records. [2025-10-21T22:06:34.727597] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-10-21T22:06:34.767435] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-10-21T22:06:34.768686] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-10-21T22:06:34.769803] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-10-21T22:06:34.770464] [DEBUG] [LOCAL ] CLB: Loaded 33495 existing records from primary storage. [2025-10-21T22:06:34.773188] [INFO ] [MAIN ] Derivative Progress: 377/2057 symbols completed. CL took 1.1s. Estimated remaining: 10m 34s. Rate: 159.0 symbols/min [2025-10-21T22:06:34.773397] [INFO ] [MAIN ] CLB: Loaded 33495 primary data records. [2025-10-21T22:06:34.773518] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-10-21T22:06:34.773332] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:34.787969] [INFO ] [MAIN ] Derivative Progress: 378/2057 symbols completed. CIVI took 1.2s. Estimated remaining: 10m 32s. Rate: 159.5 symbols/min [2025-10-21T22:06:34.813685] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:34.920018] [DEBUG] [LOCAL ] CLCO: Loaded 13154 existing records from primary storage. [2025-10-21T22:06:34.946444] [INFO ] [MAIN ] CLCO: Loaded 13154 primary data records. [2025-10-21T22:06:35.139799] [DEBUG] [LOCAL ] CLDT: Loaded 25283 existing records from primary storage. [2025-10-21T22:06:35.173541] [INFO ] [MAIN ] CLDT: Loaded 25283 primary data records. [2025-10-21T22:06:35.758410] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:35.759959] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33495 primary records. [2025-10-21T22:06:35.760288] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-10-21T22:06:35.778184] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-10-21T22:06:35.778374] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-10-21T22:06:35.781429] [INFO ] [MAIN ] Derivative Progress: 379/2057 symbols completed. CLB took 1.1s. Estimated remaining: 10m 34s. Rate: 158.8 symbols/min [2025-10-21T22:06:35.781619] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:35.798763] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:35.799494] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 13154 primary records. [2025-10-21T22:06:35.799715] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-10-21T22:06:35.815176] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-10-21T22:06:35.815441] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-10-21T22:06:35.817963] [INFO ] [MAIN ] Derivative Progress: 380/2057 symbols completed. CLCO took 1.0s. Estimated remaining: 10m 32s. Rate: 159.1 symbols/min [2025-10-21T22:06:35.818143] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:35.835018] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:35.835744] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 25283 primary records. [2025-10-21T22:06:35.835855] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-10-21T22:06:35.873479] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-10-21T22:06:35.873788] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-10-21T22:06:35.877067] [INFO ] [MAIN ] Derivative Progress: 381/2057 symbols completed. CLDT took 1.1s. Estimated remaining: 10m 30s. Rate: 159.5 symbols/min [2025-10-21T22:06:35.877453] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:35.891793] [DEBUG] [LOCAL ] CLH: Loaded 27711 existing records from primary storage. [2025-10-21T22:06:35.892077] [INFO ] [MAIN ] CLH: Loaded 27711 primary data records. [2025-10-21T22:06:35.978302] [DEBUG] [LOCAL ] CLPR: Loaded 10065 existing records from primary storage. [2025-10-21T22:06:35.991231] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-21T22:06:35.996738] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-10-21T22:06:36.007513] [INFO ] [MAIN ] CLPR: Loaded 10065 primary data records. [2025-10-21T22:06:36.892316] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:36.893874] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 27711 primary records. [2025-10-21T22:06:36.893974] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-10-21T22:06:36.911064] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-10-21T22:06:36.911251] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-10-21T22:06:36.913586] [INFO ] [MAIN ] Derivative Progress: 382/2057 symbols completed. CLH took 1.1s. Estimated remaining: 10m 33s. Rate: 158.8 symbols/min [2025-10-21T22:06:36.918798] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:36.945557] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:36.946046] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:36.947368] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-10-21T22:06:36.946800] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 10065 primary records. [2025-10-21T22:06:36.947690] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-10-21T22:06:36.947755] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-10-21T22:06:36.977686] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-10-21T22:06:36.978686] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-10-21T22:06:36.978884] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-10-21T22:06:36.978995] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-10-21T22:06:36.981607] [INFO ] [MAIN ] Derivative Progress: 383/2057 symbols completed. CLF took 1.2s. Estimated remaining: 10m 31s. Rate: 159.1 symbols/min [2025-10-21T22:06:36.984114] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:36.984175] [INFO ] [MAIN ] Derivative Progress: 384/2057 symbols completed. CLPR took 1.1s. Estimated remaining: 10m 29s. Rate: 159.5 symbols/min [2025-10-21T22:06:36.984381] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:37.018466] [DEBUG] [LOCAL ] CLW: Loaded 21289 existing records from primary storage. [2025-10-21T22:06:37.018594] [INFO ] [MAIN ] CLW: Loaded 21289 primary data records. [2025-10-21T22:06:37.154093] [DEBUG] [LOCAL ] CLS: Loaded 53563 existing records from primary storage. [2025-10-21T22:06:37.165100] [INFO ] [MAIN ] CLS: Loaded 53563 primary data records. [2025-10-21T22:06:37.278670] [DEBUG] [LOCAL ] CLVT: Loaded 51913 existing records from primary storage. [2025-10-21T22:06:37.437625] [INFO ] [MAIN ] CLVT: Loaded 51913 primary data records. [2025-10-21T22:06:38.028613] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:38.029811] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 21289 primary records. [2025-10-21T22:06:38.030079] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-10-21T22:06:38.043954] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:38.045156] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53563 primary records. [2025-10-21T22:06:38.045553] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-10-21T22:06:38.063087] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-10-21T22:06:38.063277] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-10-21T22:06:38.065374] [INFO ] [MAIN ] Derivative Progress: 385/2057 symbols completed. CLW took 1.1s. Estimated remaining: 10m 32s. Rate: 158.7 symbols/min [2025-10-21T22:06:38.065562] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:38.097549] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-10-21T22:06:38.097878] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-10-21T22:06:38.098174] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:38.102164] [INFO ] [MAIN ] Derivative Progress: 386/2057 symbols completed. CLS took 1.2s. Estimated remaining: 10m 30s. Rate: 159.1 symbols/min [2025-10-21T22:06:38.103227] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 51913 primary records. [2025-10-21T22:06:38.103531] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-10-21T22:06:38.103735] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:38.121099] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-10-21T22:06:38.121290] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-10-21T22:06:38.124112] [INFO ] [MAIN ] Derivative Progress: 387/2057 symbols completed. CLVT took 1.1s. Estimated remaining: 10m 28s. Rate: 159.5 symbols/min [2025-10-21T22:06:38.124380] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:38.173711] [DEBUG] [LOCAL ] CLX: Loaded 51811 existing records from primary storage. [2025-10-21T22:06:38.174069] [INFO ] [MAIN ] CLX: Loaded 51811 primary data records. [2025-10-21T22:06:38.300026] [DEBUG] [LOCAL ] CM: Loaded 48468 existing records from primary storage. [2025-10-21T22:06:38.317911] [INFO ] [MAIN ] CM: Loaded 48468 primary data records. [2025-10-21T22:06:38.345821] [DEBUG] [LOCAL ] CMA: Loaded 50177 existing records from primary storage. [2025-10-21T22:06:38.409661] [INFO ] [MAIN ] CMA: Loaded 50177 primary data records. [2025-10-21T22:06:39.201149] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:39.202259] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51811 primary records. [2025-10-21T22:06:39.202586] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-10-21T22:06:39.223141] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-10-21T22:06:39.224288] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-10-21T22:06:39.227864] [INFO ] [MAIN ] Derivative Progress: 388/2057 symbols completed. CLX took 1.2s. Estimated remaining: 10m 31s. Rate: 158.7 symbols/min [2025-10-21T22:06:39.242563] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:39.243329] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48468 primary records. [2025-10-21T22:06:39.243679] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-10-21T22:06:39.259702] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-10-21T22:06:39.259918] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-10-21T22:06:39.262591] [INFO ] [MAIN ] Derivative Progress: 389/2057 symbols completed. CM took 1.2s. Estimated remaining: 10m 29s. Rate: 159.1 symbols/min [2025-10-21T22:06:39.282871] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:39.283810] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 50177 primary records. [2025-10-21T22:06:39.283882] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-10-21T22:06:39.299747] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-10-21T22:06:39.299844] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-10-21T22:06:39.302590] [INFO ] [MAIN ] Derivative Progress: 390/2057 symbols completed. CMA took 1.2s. Estimated remaining: 10m 27s. Rate: 159.5 symbols/min [2025-10-21T22:06:39.303328] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:39.303399] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:39.303256] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:39.311851] [DEBUG] [LOCAL ] CMCM: Loaded 4857 existing records from primary storage. [2025-10-21T22:06:39.312158] [INFO ] [MAIN ] CMCM: Loaded 4857 primary data records. [2025-10-21T22:06:39.675219] [DEBUG] [LOCAL ] CMC: Loaded 45567 existing records from primary storage. [2025-10-21T22:06:39.674383] [DEBUG] [LOCAL ] CMBT: Loaded 27244 existing records from primary storage. [2025-10-21T22:06:39.675390] [INFO ] [MAIN ] CMBT: Loaded 27244 primary data records. [2025-10-21T22:06:39.675583] [INFO ] [MAIN ] CMC: Loaded 45567 primary data records. [2025-10-21T22:06:40.359762] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:40.361397] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4857 primary records. [2025-10-21T22:06:40.361882] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-10-21T22:06:40.380616] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-10-21T22:06:40.381187] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-10-21T22:06:40.385618] [INFO ] [MAIN ] Derivative Progress: 391/2057 symbols completed. CMCM took 1.1s. Estimated remaining: 10m 30s. Rate: 158.7 symbols/min [2025-10-21T22:06:40.386025] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:40.427219] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:40.427440] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:40.429354] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45567 primary records. [2025-10-21T22:06:40.428358] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 27244 primary records. [2025-10-21T22:06:40.429743] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-10-21T22:06:40.441512] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-10-21T22:06:40.464738] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-10-21T22:06:40.464852] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-10-21T22:06:40.468464] [INFO ] [MAIN ] Derivative Progress: 392/2057 symbols completed. CMBT took 1.2s. Estimated remaining: 10m 28s. Rate: 159.0 symbols/min [2025-10-21T22:06:40.472314] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:40.476460] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-10-21T22:06:40.476698] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-10-21T22:06:40.479200] [INFO ] [MAIN ] Derivative Progress: 393/2057 symbols completed. CMC took 1.2s. Estimated remaining: 10m 26s. Rate: 159.4 symbols/min [2025-10-21T22:06:40.479349] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:40.494604] [DEBUG] [LOCAL ] CMI: Loaded 41706 existing records from primary storage. [2025-10-21T22:06:40.494906] [INFO ] [MAIN ] CMI: Loaded 41706 primary data records. [2025-10-21T22:06:40.860949] [DEBUG] [LOCAL ] CMP: Loaded 35783 existing records from primary storage. [2025-10-21T22:06:40.872615] [INFO ] [MAIN ] CMP: Loaded 35783 primary data records. [2025-10-21T22:06:40.873972] [DEBUG] [LOCAL ] CMPO: Loaded 38539 existing records from primary storage. [2025-10-21T22:06:40.889690] [INFO ] [MAIN ] CMPO: Loaded 38539 primary data records. [2025-10-21T22:06:41.582066] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:41.584690] [INFO ] [MAIN ] CMI: Generated 1793 derivative records from 41706 primary records. [2025-10-21T22:06:41.585039] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-10-21T22:06:41.603846] [DEBUG] [LOCAL ] CMI: Derivative data saved (1793 records). [2025-10-21T22:06:41.603984] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-10-21T22:06:41.607769] [INFO ] [MAIN ] Derivative Progress: 394/2057 symbols completed. CMI took 1.2s. Estimated remaining: 10m 29s. Rate: 158.6 symbols/min [2025-10-21T22:06:41.608572] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:41.629884] [DEBUG] [LOCAL ] CMSA: Loaded 3497 existing records from primary storage. [2025-10-21T22:06:41.636263] [INFO ] [MAIN ] CMSA: Loaded 3497 primary data records. [2025-10-21T22:06:41.636120] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:41.650549] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 35783 primary records. [2025-10-21T22:06:41.690811] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-10-21T22:06:41.822893] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-10-21T22:06:41.822796] [DEBUG] [MAIN ] CMPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:41.833370] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-10-21T22:06:41.856856] [INFO ] [MAIN ] CMPO: Generated 1794 derivative records from 38539 primary records. [2025-10-21T22:06:41.892427] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-10-21T22:06:41.892302] [INFO ] [MAIN ] Derivative Progress: 395/2057 symbols completed. CMP took 1.4s. Estimated remaining: 10m 28s. Rate: 158.7 symbols/min [2025-10-21T22:06:42.019593] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:42.040897] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1794 records). [2025-10-21T22:06:42.041438] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-10-21T22:06:42.049503] [DEBUG] [LOCAL ] CMSC: Loaded 4835 existing records from primary storage. [2025-10-21T22:06:42.049748] [INFO ] [MAIN ] CMSC: Loaded 4835 primary data records. [2025-10-21T22:06:42.045460] [INFO ] [MAIN ] Derivative Progress: 396/2057 symbols completed. CMPO took 1.6s. Estimated remaining: 10m 27s. Rate: 158.9 symbols/min [2025-10-21T22:06:42.093717] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:42.244066] [DEBUG] [LOCAL ] CMSD: Loaded 7668 existing records from primary storage. [2025-10-21T22:06:42.363695] [INFO ] [MAIN ] CMSD: Loaded 7668 primary data records. [2025-10-21T22:06:42.461767] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:42.481903] [INFO ] [MAIN ] CMSA: Generated 1794 derivative records from 3497 primary records. [2025-10-21T22:06:42.486113] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-10-21T22:06:42.579531] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1794 records). [2025-10-21T22:06:42.579983] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-10-21T22:06:42.695398] [INFO ] [MAIN ] Derivative Progress: 397/2057 symbols completed. CMSA took 1.1s. Estimated remaining: 10m 28s. Rate: 158.6 symbols/min [2025-10-21T22:06:42.695948] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:42.733853] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:42.735051] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 4835 primary records. [2025-10-21T22:06:42.735301] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-10-21T22:06:42.767631] [DEBUG] [LOCAL ] CMTG: Loaded 35328 existing records from primary storage. [2025-10-21T22:06:42.770992] [INFO ] [MAIN ] CMTG: Loaded 35328 primary data records. [2025-10-21T22:06:42.771052] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-10-21T22:06:42.782726] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-10-21T22:06:42.809566] [INFO ] [MAIN ] Derivative Progress: 398/2057 symbols completed. CMSC took 0.8s. Estimated remaining: 10m 26s. Rate: 158.9 symbols/min [2025-10-21T22:06:42.816859] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:42.913917] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:42.941041] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 7668 primary records. [2025-10-21T22:06:42.941145] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-10-21T22:06:43.074905] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-10-21T22:06:43.100859] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-10-21T22:06:43.113129] [INFO ] [MAIN ] Derivative Progress: 399/2057 symbols completed. CMSD took 1.0s. Estimated remaining: 10m 26s. Rate: 159.0 symbols/min [2025-10-21T22:06:43.113375] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:43.125475] [DEBUG] [LOCAL ] CNA: Loaded 32604 existing records from primary storage. [2025-10-21T22:06:43.125800] [INFO ] [MAIN ] CNA: Loaded 32604 primary data records. [2025-10-21T22:06:43.475790] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-21T22:06:43.476467] [INFO ] [MAIN ] CNC: Loaded 53779 primary data records. [2025-10-21T22:06:43.476242] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:43.498414] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 35328 primary records. [2025-10-21T22:06:43.513893] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-10-21T22:06:43.620709] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-10-21T22:06:43.639203] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-10-21T22:06:43.674084] [INFO ] [MAIN ] Derivative Progress: 400/2057 symbols completed. CMTG took 1.0s. Estimated remaining: 10m 26s. Rate: 158.8 symbols/min [2025-10-21T22:06:43.678972] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:43.848967] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:43.854405] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32604 primary records. [2025-10-21T22:06:43.854954] [DEBUG] [LOCAL ] CNF: Loaded 10592 existing records from primary storage. [2025-10-21T22:06:43.854671] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-10-21T22:06:43.855691] [INFO ] [MAIN ] CNF: Loaded 10592 primary data records. [2025-10-21T22:06:43.952351] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-10-21T22:06:43.973361] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-10-21T22:06:43.975787] [INFO ] [MAIN ] Derivative Progress: 401/2057 symbols completed. CNA took 1.2s. Estimated remaining: 10m 25s. Rate: 158.9 symbols/min [2025-10-21T22:06:43.992580] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:44.184914] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:44.186241] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53779 primary records. [2025-10-21T22:06:44.186375] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-10-21T22:06:44.203515] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-10-21T22:06:44.203605] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-10-21T22:06:44.205972] [INFO ] [MAIN ] Derivative Progress: 402/2057 symbols completed. CNC took 1.1s. Estimated remaining: 10m 24s. Rate: 159.0 symbols/min [2025-10-21T22:06:44.207313] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:44.240216] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:44.240858] [INFO ] [MAIN ] CNF: Generated 1793 derivative records from 10592 primary records. [2025-10-21T22:06:44.241021] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-10-21T22:06:44.256508] [DEBUG] [LOCAL ] CNF: Derivative data saved (1793 records). [2025-10-21T22:06:44.274075] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-10-21T22:06:44.276892] [INFO ] [MAIN ] Derivative Progress: 403/2057 symbols completed. CNF took 0.6s. Estimated remaining: 10m 23s. Rate: 159.4 symbols/min [2025-10-21T22:06:44.278267] [DEBUG] [LOCAL ] CNH: Loaded 53547 existing records from primary storage. [2025-10-21T22:06:44.292194] [INFO ] [MAIN ] CNH: Loaded 53547 primary data records. [2025-10-21T22:06:44.435134] [DEBUG] [LOCAL ] CNI: Loaded 51658 existing records from primary storage. [2025-10-21T22:06:44.463256] [INFO ] [MAIN ] CNI: Loaded 51658 primary data records. [2025-10-21T22:06:44.910562] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:44.911301] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53547 primary records. [2025-10-21T22:06:44.911462] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-10-21T22:06:44.927862] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-10-21T22:06:44.928038] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-10-21T22:06:44.930204] [INFO ] [MAIN ] Derivative Progress: 404/2057 symbols completed. CNH took 0.9s. Estimated remaining: 10m 23s. Rate: 159.1 symbols/min [2025-10-21T22:06:44.945497] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:44.946149] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51658 primary records. [2025-10-21T22:06:44.946209] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-10-21T22:06:44.960978] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-10-21T22:06:44.961031] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-10-21T22:06:44.963987] [INFO ] [MAIN ] Derivative Progress: 405/2057 symbols completed. CNI took 0.8s. Estimated remaining: 10m 22s. Rate: 159.4 symbols/min [2025-10-21T22:06:44.964484] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:44.964615] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:44.964820] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:45.023441] [DEBUG] [LOCAL ] CNMD: Loaded 32081 existing records from primary storage. [2025-10-21T22:06:45.023635] [INFO ] [MAIN ] CNMD: Loaded 32081 primary data records. [2025-10-21T22:06:45.138013] [DEBUG] [LOCAL ] CNM: Loaded 51017 existing records from primary storage. [2025-10-21T22:06:45.154832] [INFO ] [MAIN ] CNM: Loaded 51017 primary data records. [2025-10-21T22:06:45.182392] [DEBUG] [LOCAL ] CNK: Loaded 52908 existing records from primary storage. [2025-10-21T22:06:45.288583] [INFO ] [MAIN ] CNK: Loaded 52908 primary data records. [2025-10-21T22:06:46.021776] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:46.023525] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32081 primary records. [2025-10-21T22:06:46.023929] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-10-21T22:06:46.042806] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-10-21T22:06:46.043213] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-10-21T22:06:46.045056] [INFO ] [MAIN ] Derivative Progress: 406/2057 symbols completed. CNMD took 1.1s. Estimated remaining: 10m 24s. Rate: 158.7 symbols/min [2025-10-21T22:06:46.045420] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:46.058904] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:46.059467] [INFO ] [MAIN ] CNM: Generated 1793 derivative records from 51017 primary records. [2025-10-21T22:06:46.059608] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-10-21T22:06:46.075733] [DEBUG] [LOCAL ] CNM: Derivative data saved (1793 records). [2025-10-21T22:06:46.076911] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-10-21T22:06:46.079928] [INFO ] [MAIN ] Derivative Progress: 407/2057 symbols completed. CNM took 1.1s. Estimated remaining: 10m 22s. Rate: 159.1 symbols/min [2025-10-21T22:06:46.080087] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:46.095889] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:46.096619] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52908 primary records. [2025-10-21T22:06:46.096716] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-10-21T22:06:46.122106] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-10-21T22:06:46.122264] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-10-21T22:06:46.126152] [INFO ] [MAIN ] Derivative Progress: 408/2057 symbols completed. CNK took 1.2s. Estimated remaining: 10m 21s. Rate: 159.4 symbols/min [2025-10-21T22:06:46.126569] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:46.148859] [DEBUG] [LOCAL ] CNNE: Loaded 35869 existing records from primary storage. [2025-10-21T22:06:46.149129] [INFO ] [MAIN ] CNNE: Loaded 35869 primary data records. [2025-10-21T22:06:46.266829] [DEBUG] [LOCAL ] CNO: Loaded 40420 existing records from primary storage. [2025-10-21T22:06:46.288205] [INFO ] [MAIN ] CNO: Loaded 40420 primary data records. [2025-10-21T22:06:46.629338] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-10-21T22:06:46.665083] [INFO ] [MAIN ] CNQ: Loaded 53582 primary data records. [2025-10-21T22:06:47.139059] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:47.140132] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 35869 primary records. [2025-10-21T22:06:47.140586] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-10-21T22:06:47.159745] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-10-21T22:06:47.160105] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-10-21T22:06:47.162628] [INFO ] [MAIN ] Derivative Progress: 409/2057 symbols completed. CNNE took 1.1s. Estimated remaining: 10m 23s. Rate: 158.7 symbols/min [2025-10-21T22:06:47.163084] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:47.181521] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:47.182360] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 40420 primary records. [2025-10-21T22:06:47.182585] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-10-21T22:06:47.217858] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:47.218637] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53582 primary records. [2025-10-21T22:06:47.218831] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-10-21T22:06:47.217578] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-10-21T22:06:47.219464] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-10-21T22:06:47.222105] [INFO ] [MAIN ] Derivative Progress: 410/2057 symbols completed. CNO took 1.1s. Estimated remaining: 10m 21s. Rate: 159.0 symbols/min [2025-10-21T22:06:47.222627] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:47.251047] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-10-21T22:06:47.251351] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-10-21T22:06:47.254971] [INFO ] [MAIN ] Derivative Progress: 411/2057 symbols completed. CNQ took 1.1s. Estimated remaining: 10m 20s. Rate: 159.4 symbols/min [2025-10-21T22:06:47.255371] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:47.279811] [DEBUG] [LOCAL ] CNX: Loaded 51346 existing records from primary storage. [2025-10-21T22:06:47.280241] [INFO ] [MAIN ] CNX: Loaded 51346 primary data records. [2025-10-21T22:06:47.476912] [DEBUG] [LOCAL ] CODI: Loaded 41906 existing records from primary storage. [2025-10-21T22:06:47.484935] [INFO ] [MAIN ] CODI: Loaded 41906 primary data records. [2025-10-21T22:06:47.728881] [DEBUG] [LOCAL ] COHR: Loaded 53377 existing records from primary storage. [2025-10-21T22:06:47.779760] [INFO ] [MAIN ] COHR: Loaded 53377 primary data records. [2025-10-21T22:06:48.299163] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:48.300011] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51346 primary records. [2025-10-21T22:06:48.300110] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-10-21T22:06:48.318919] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-10-21T22:06:48.319133] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-10-21T22:06:48.321550] [INFO ] [MAIN ] Derivative Progress: 412/2057 symbols completed. CNX took 1.2s. Estimated remaining: 10m 22s. Rate: 158.7 symbols/min [2025-10-21T22:06:48.333932] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:48.334775] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:48.335789] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 41906 primary records. [2025-10-21T22:06:48.335938] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-10-21T22:06:48.353866] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-10-21T22:06:48.354092] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-10-21T22:06:48.357113] [INFO ] [MAIN ] Derivative Progress: 413/2057 symbols completed. CODI took 1.1s. Estimated remaining: 10m 20s. Rate: 159.0 symbols/min [2025-10-21T22:06:48.357343] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:48.371246] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:48.372344] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53377 primary records. [2025-10-21T22:06:48.372597] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-10-21T22:06:48.394044] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-10-21T22:06:48.394254] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-10-21T22:06:48.411151] [INFO ] [MAIN ] Derivative Progress: 414/2057 symbols completed. COHR took 1.2s. Estimated remaining: 10m 19s. Rate: 159.4 symbols/min [2025-10-21T22:06:48.411673] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:48.433733] [DEBUG] [LOCAL ] COMP: Loaded 53404 existing records from primary storage. [2025-10-21T22:06:48.433881] [INFO ] [MAIN ] COMP: Loaded 53404 primary data records. [2025-10-21T22:06:48.604130] [DEBUG] [LOCAL ] COOK: Loaded 24899 existing records from primary storage. [2025-10-21T22:06:48.633522] [DEBUG] [LOCAL ] CON: Loaded 38811 existing records from primary storage. [2025-10-21T22:06:48.632265] [INFO ] [MAIN ] COOK: Loaded 24899 primary data records. [2025-10-21T22:06:48.666939] [INFO ] [MAIN ] CON: Loaded 38811 primary data records. [2025-10-21T22:06:49.602796] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:49.604577] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53404 primary records. [2025-10-21T22:06:49.604838] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-10-21T22:06:49.625539] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-10-21T22:06:49.626049] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-10-21T22:06:49.628564] [INFO ] [MAIN ] Derivative Progress: 415/2057 symbols completed. COMP took 1.3s. Estimated remaining: 10m 21s. Rate: 158.5 symbols/min [2025-10-21T22:06:49.629489] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:49.660746] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:49.662578] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24899 primary records. [2025-10-21T22:06:49.662786] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-10-21T22:06:49.677607] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:49.679253] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38811 primary records. [2025-10-21T22:06:49.689396] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-10-21T22:06:49.698319] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-10-21T22:06:49.708790] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-10-21T22:06:49.730157] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-10-21T22:06:49.733932] [INFO ] [MAIN ] Derivative Progress: 416/2057 symbols completed. COOK took 1.3s. Estimated remaining: 10m 20s. Rate: 158.8 symbols/min [2025-10-21T22:06:49.734113] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-10-21T22:06:49.737063] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:49.737234] [INFO ] [MAIN ] Derivative Progress: 417/2057 symbols completed. CON took 1.4s. Estimated remaining: 10m 18s. Rate: 159.2 symbols/min [2025-10-21T22:06:49.737922] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:49.762098] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-21T22:06:49.762518] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-10-21T22:06:50.154285] [DEBUG] [LOCAL ] COR: Loaded 46340 existing records from primary storage. [2025-10-21T22:06:50.155008] [INFO ] [MAIN ] COR: Loaded 46340 primary data records. [2025-10-21T22:06:50.155896] [DEBUG] [LOCAL ] CP: Loaded 53233 existing records from primary storage. [2025-10-21T22:06:50.156049] [INFO ] [MAIN ] CP: Loaded 53233 primary data records. [2025-10-21T22:06:50.804140] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:50.805427] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-10-21T22:06:50.805620] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-10-21T22:06:50.823874] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-10-21T22:06:50.824402] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-10-21T22:06:50.827328] [INFO ] [MAIN ] Derivative Progress: 418/2057 symbols completed. COP took 1.2s. Estimated remaining: 10m 21s. Rate: 158.5 symbols/min [2025-10-21T22:06:50.849475] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:50.850379] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53233 primary records. [2025-10-21T22:06:50.850666] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-10-21T22:06:50.863743] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:50.864735] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 46340 primary records. [2025-10-21T22:06:50.864822] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-10-21T22:06:50.880607] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-10-21T22:06:50.888925] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-10-21T22:06:50.894329] [INFO ] [MAIN ] Derivative Progress: 419/2057 symbols completed. CP took 1.2s. Estimated remaining: 10m 19s. Rate: 158.8 symbols/min [2025-10-21T22:06:50.898817] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-10-21T22:06:50.898898] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-10-21T22:06:50.901044] [INFO ] [MAIN ] Derivative Progress: 420/2057 symbols completed. COR took 1.2s. Estimated remaining: 10m 17s. Rate: 159.1 symbols/min [2025-10-21T22:06:50.901490] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:50.901672] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:50.901591] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:50.919456] [DEBUG] [LOCAL ] CPK: Loaded 13991 existing records from primary storage. [2025-10-21T22:06:50.919672] [INFO ] [MAIN ] CPK: Loaded 13991 primary data records. [2025-10-21T22:06:51.053869] [DEBUG] [LOCAL ] CPAY: Loaded 30239 existing records from primary storage. [2025-10-21T22:06:51.065007] [INFO ] [MAIN ] CPAY: Loaded 30239 primary data records. [2025-10-21T22:06:51.201825] [DEBUG] [LOCAL ] CPNG: Loaded 53679 existing records from primary storage. [2025-10-21T22:06:51.248747] [INFO ] [MAIN ] CPNG: Loaded 53679 primary data records. [2025-10-21T22:06:51.991933] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:51.993016] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13991 primary records. [2025-10-21T22:06:51.994895] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-10-21T22:06:52.012155] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-10-21T22:06:52.019877] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-10-21T22:06:52.025841] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:52.028551] [INFO ] [MAIN ] Derivative Progress: 421/2057 symbols completed. CPK took 1.1s. Estimated remaining: 10m 20s. Rate: 158.4 symbols/min [2025-10-21T22:06:52.029505] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:52.029360] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 30239 primary records. [2025-10-21T22:06:52.030939] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-10-21T22:06:52.044014] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:52.044727] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53679 primary records. [2025-10-21T22:06:52.044953] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-10-21T22:06:52.060440] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-10-21T22:06:52.067856] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-10-21T22:06:52.075277] [INFO ] [MAIN ] Derivative Progress: 422/2057 symbols completed. CPAY took 1.2s. Estimated remaining: 10m 18s. Rate: 158.7 symbols/min [2025-10-21T22:06:52.078303] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:52.078218] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-10-21T22:06:52.078607] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-10-21T22:06:52.081316] [INFO ] [MAIN ] Derivative Progress: 423/2057 symbols completed. CPNG took 1.2s. Estimated remaining: 10m 16s. Rate: 159.1 symbols/min [2025-10-21T22:06:52.081493] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:52.119673] [DEBUG] [LOCAL ] CPS: Loaded 24974 existing records from primary storage. [2025-10-21T22:06:52.119979] [INFO ] [MAIN ] CPS: Loaded 24974 primary data records. [2025-10-21T22:06:52.212470] [DEBUG] [LOCAL ] CPRI: Loaded 52438 existing records from primary storage. [2025-10-21T22:06:52.247474] [INFO ] [MAIN ] CPRI: Loaded 52438 primary data records. [2025-10-21T22:06:52.406432] [DEBUG] [LOCAL ] CPT: Loaded 44521 existing records from primary storage. [2025-10-21T22:06:52.451548] [INFO ] [MAIN ] CPT: Loaded 44521 primary data records. [2025-10-21T22:06:53.105764] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:53.107505] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 24974 primary records. [2025-10-21T22:06:53.107777] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-10-21T22:06:53.106616] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:53.109263] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52438 primary records. [2025-10-21T22:06:53.109858] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-10-21T22:06:53.126041] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-10-21T22:06:53.126531] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-10-21T22:06:53.129230] [INFO ] [MAIN ] Derivative Progress: 424/2057 symbols completed. CPS took 1.1s. Estimated remaining: 10m 18s. Rate: 158.4 symbols/min [2025-10-21T22:06:53.145044] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-10-21T22:06:53.138298] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:53.145334] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-10-21T22:06:53.150319] [INFO ] [MAIN ] Derivative Progress: 425/2057 symbols completed. CPRI took 1.1s. Estimated remaining: 10m 17s. Rate: 158.8 symbols/min [2025-10-21T22:06:53.151726] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:53.167380] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:53.168179] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44521 primary records. [2025-10-21T22:06:53.168308] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-10-21T22:06:53.184734] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-10-21T22:06:53.190985] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-10-21T22:06:53.193793] [INFO ] [MAIN ] Derivative Progress: 426/2057 symbols completed. CPT took 1.1s. Estimated remaining: 10m 15s. Rate: 159.1 symbols/min [2025-10-21T22:06:53.198333] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:53.215875] [DEBUG] [LOCAL ] CR: Loaded 23996 existing records from primary storage. [2025-10-21T22:06:53.216445] [INFO ] [MAIN ] CR: Loaded 23996 primary data records. [2025-10-21T22:06:53.216301] [DEBUG] [LOCAL ] CQP: Loaded 18719 existing records from primary storage. [2025-10-21T22:06:53.216751] [INFO ] [MAIN ] CQP: Loaded 18719 primary data records. [2025-10-21T22:06:53.905837] [DEBUG] [LOCAL ] CRBG: Loaded 52602 existing records from primary storage. [2025-10-21T22:06:53.920289] [INFO ] [MAIN ] CRBG: Loaded 52602 primary data records. [2025-10-21T22:06:54.247348] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:54.248991] [INFO ] [MAIN ] CR: Generated 1793 derivative records from 23996 primary records. [2025-10-21T22:06:54.249174] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-10-21T22:06:54.269038] [DEBUG] [LOCAL ] CR: Derivative data saved (1793 records). [2025-10-21T22:06:54.269261] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-10-21T22:06:54.271433] [INFO ] [MAIN ] Derivative Progress: 427/2057 symbols completed. CR took 1.1s. Estimated remaining: 10m 17s. Rate: 158.4 symbols/min [2025-10-21T22:06:54.272171] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:54.285462] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:54.286169] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 18719 primary records. [2025-10-21T22:06:54.286327] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-10-21T22:06:54.305081] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-10-21T22:06:54.305357] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-10-21T22:06:54.307892] [INFO ] [MAIN ] Derivative Progress: 428/2057 symbols completed. CQP took 1.2s. Estimated remaining: 10m 16s. Rate: 158.8 symbols/min [2025-10-21T22:06:54.308167] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:54.324796] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:54.325519] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52602 primary records. [2025-10-21T22:06:54.325669] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-10-21T22:06:54.351331] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-10-21T22:06:54.352380] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-10-21T22:06:54.368536] [INFO ] [MAIN ] Derivative Progress: 429/2057 symbols completed. CRBG took 1.2s. Estimated remaining: 10m 14s. Rate: 159.1 symbols/min [2025-10-21T22:06:54.368832] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:54.370962] [DEBUG] [LOCAL ] CRC: Loaded 44159 existing records from primary storage. [2025-10-21T22:06:54.371442] [INFO ] [MAIN ] CRC: Loaded 44159 primary data records. [2025-10-21T22:06:54.545603] [DEBUG] [LOCAL ] CRGY: Loaded 52503 existing records from primary storage. [2025-10-21T22:06:54.566957] [INFO ] [MAIN ] CRGY: Loaded 52503 primary data records. [2025-10-21T22:06:54.897427] [DEBUG] [LOCAL ] CRH: Loaded 53435 existing records from primary storage. [2025-10-21T22:06:54.927556] [INFO ] [MAIN ] CRH: Loaded 53435 primary data records. [2025-10-21T22:06:55.369972] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:55.371304] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44159 primary records. [2025-10-21T22:06:55.371770] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-10-21T22:06:55.392047] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-10-21T22:06:55.392455] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-10-21T22:06:55.395229] [INFO ] [MAIN ] Derivative Progress: 430/2057 symbols completed. CRC took 1.1s. Estimated remaining: 10m 16s. Rate: 158.4 symbols/min [2025-10-21T22:06:55.395525] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:55.409064] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:55.410112] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52503 primary records. [2025-10-21T22:06:55.410436] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-10-21T22:06:55.427622] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-10-21T22:06:55.427930] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-10-21T22:06:55.431027] [INFO ] [MAIN ] Derivative Progress: 431/2057 symbols completed. CRGY took 1.1s. Estimated remaining: 10m 14s. Rate: 158.8 symbols/min [2025-10-21T22:06:55.431336] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:55.448206] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:55.448950] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53435 primary records. [2025-10-21T22:06:55.449011] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-10-21T22:06:55.464782] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-10-21T22:06:55.464952] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-10-21T22:06:55.467637] [INFO ] [MAIN ] Derivative Progress: 432/2057 symbols completed. CRH took 1.1s. Estimated remaining: 10m 13s. Rate: 159.1 symbols/min [2025-10-21T22:06:55.467839] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:55.515953] [DEBUG] [LOCAL ] CRI: Loaded 49512 existing records from primary storage. [2025-10-21T22:06:55.516281] [INFO ] [MAIN ] CRI: Loaded 49512 primary data records. [2025-10-21T22:06:55.651404] [DEBUG] [LOCAL ] CRK: Loaded 52233 existing records from primary storage. [2025-10-21T22:06:55.662314] [INFO ] [MAIN ] CRK: Loaded 52233 primary data records. [2025-10-21T22:06:55.794983] [DEBUG] [LOCAL ] CRL: Loaded 42659 existing records from primary storage. [2025-10-21T22:06:55.948252] [INFO ] [MAIN ] CRL: Loaded 42659 primary data records. [2025-10-21T22:06:56.556900] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:56.558921] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49512 primary records. [2025-10-21T22:06:56.559016] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-10-21T22:06:56.598581] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-10-21T22:06:56.598756] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-10-21T22:06:56.601155] [INFO ] [MAIN ] Derivative Progress: 433/2057 symbols completed. CRI took 1.2s. Estimated remaining: 10m 15s. Rate: 158.4 symbols/min [2025-10-21T22:06:56.598505] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:56.602273] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52233 primary records. [2025-10-21T22:06:56.602427] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-10-21T22:06:56.615359] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:56.623448] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 42659 primary records. [2025-10-21T22:06:56.627283] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-10-21T22:06:56.631547] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-10-21T22:06:56.631916] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-10-21T22:06:56.635528] [INFO ] [MAIN ] Derivative Progress: 434/2057 symbols completed. CRK took 1.2s. Estimated remaining: 10m 14s. Rate: 158.7 symbols/min [2025-10-21T22:06:56.650201] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-10-21T22:06:56.650281] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-10-21T22:06:56.653047] [INFO ] [MAIN ] Derivative Progress: 435/2057 symbols completed. CRL took 1.2s. Estimated remaining: 10m 12s. Rate: 159.0 symbols/min [2025-10-21T22:06:56.653522] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:56.653620] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:56.653464] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:56.662606] [DEBUG] [LOCAL ] CRT: Loaded 4791 existing records from primary storage. [2025-10-21T22:06:56.662881] [INFO ] [MAIN ] CRT: Loaded 4791 primary data records. [2025-10-21T22:06:57.043972] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-21T22:06:57.046067] [DEBUG] [LOCAL ] CRS: Loaded 43115 existing records from primary storage. [2025-10-21T22:06:57.047152] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-10-21T22:06:57.047447] [INFO ] [MAIN ] CRS: Loaded 43115 primary data records. [2025-10-21T22:06:57.720531] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:57.721832] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4791 primary records. [2025-10-21T22:06:57.722513] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-10-21T22:06:57.743792] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-10-21T22:06:57.744107] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-10-21T22:06:57.746718] [INFO ] [MAIN ] Derivative Progress: 436/2057 symbols completed. CRT took 1.1s. Estimated remaining: 10m 14s. Rate: 158.4 symbols/min [2025-10-21T22:06:57.746890] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:57.769221] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:57.770033] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-10-21T22:06:57.770120] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-10-21T22:06:57.787372] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-10-21T22:06:57.787543] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-10-21T22:06:57.789676] [INFO ] [MAIN ] Derivative Progress: 437/2057 symbols completed. CRM took 1.1s. Estimated remaining: 10m 13s. Rate: 158.7 symbols/min [2025-10-21T22:06:57.789963] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:57.821675] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:57.822610] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43115 primary records. [2025-10-21T22:06:57.822836] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-10-21T22:06:57.852780] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-10-21T22:06:57.853320] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-10-21T22:06:57.859102] [INFO ] [MAIN ] Derivative Progress: 438/2057 symbols completed. CRS took 1.2s. Estimated remaining: 10m 11s. Rate: 159.0 symbols/min [2025-10-21T22:06:57.866110] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:57.868353] [DEBUG] [LOCAL ] CSAN: Loaded 42270 existing records from primary storage. [2025-10-21T22:06:57.868585] [INFO ] [MAIN ] CSAN: Loaded 42270 primary data records. [2025-10-21T22:06:57.970713] [DEBUG] [LOCAL ] CSL: Loaded 31256 existing records from primary storage. [2025-10-21T22:06:57.994743] [INFO ] [MAIN ] CSL: Loaded 31256 primary data records. [2025-10-21T22:06:58.084512] [DEBUG] [LOCAL ] CSR: Loaded 13477 existing records from primary storage. [2025-10-21T22:06:58.126722] [INFO ] [MAIN ] CSR: Loaded 13477 primary data records. [2025-10-21T22:06:58.852911] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:58.855450] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42270 primary records. [2025-10-21T22:06:58.855854] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-10-21T22:06:58.885095] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-10-21T22:06:58.885547] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-10-21T22:06:58.885460] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:06:58.888478] [INFO ] [MAIN ] CSL: Generated 1793 derivative records from 31256 primary records. [2025-10-21T22:06:58.887713] [INFO ] [MAIN ] Derivative Progress: 439/2057 symbols completed. CSAN took 1.1s. Estimated remaining: 10m 13s. Rate: 158.4 symbols/min [2025-10-21T22:06:58.888829] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:58.889819] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-10-21T22:06:58.907794] [DEBUG] [LOCAL ] CSL: Derivative data saved (1793 records). [2025-10-21T22:06:58.908031] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-10-21T22:06:58.910676] [INFO ] [MAIN ] Derivative Progress: 440/2057 symbols completed. CSL took 1.1s. Estimated remaining: 10m 11s. Rate: 158.7 symbols/min [2025-10-21T22:06:58.923904] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:58.923807] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:06:58.925204] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 13477 primary records. [2025-10-21T22:06:58.925389] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-10-21T22:06:58.942637] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-10-21T22:06:58.942870] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-10-21T22:06:58.948318] [INFO ] [MAIN ] Derivative Progress: 441/2057 symbols completed. CSR took 1.1s. Estimated remaining: 10m 10s. Rate: 159.0 symbols/min [2025-10-21T22:06:58.948682] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:06:58.966116] [DEBUG] [LOCAL ] CSV: Loaded 12501 existing records from primary storage. [2025-10-21T22:06:58.966390] [INFO ] [MAIN ] CSV: Loaded 12501 primary data records. [2025-10-21T22:06:59.058268] [DEBUG] [LOCAL ] CTBB: Loaded 6539 existing records from primary storage. [2025-10-21T22:06:59.098912] [INFO ] [MAIN ] CTBB: Loaded 6539 primary data records. [2025-10-21T22:06:59.137991] [DEBUG] [LOCAL ] CSTM: Loaded 47446 existing records from primary storage. [2025-10-21T22:06:59.157301] [INFO ] [MAIN ] CSTM: Loaded 47446 primary data records. [2025-10-21T22:07:00.038198] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:00.040425] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 12501 primary records. [2025-10-21T22:07:00.040603] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-10-21T22:07:00.070618] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:00.075329] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 6539 primary records. [2025-10-21T22:07:00.077407] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-10-21T22:07:00.079371] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-10-21T22:07:00.090348] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-10-21T22:07:00.112324] [INFO ] [MAIN ] Derivative Progress: 442/2057 symbols completed. CSV took 1.2s. Estimated remaining: 10m 12s. Rate: 158.3 symbols/min [2025-10-21T22:07:00.109591] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:00.113693] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47446 primary records. [2025-10-21T22:07:00.115135] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-10-21T22:07:00.117580] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-10-21T22:07:00.117900] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-10-21T22:07:00.113580] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:00.135814] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-10-21T22:07:00.131413] [INFO ] [MAIN ] Derivative Progress: 443/2057 symbols completed. CTBB took 1.2s. Estimated remaining: 10m 11s. Rate: 158.6 symbols/min [2025-10-21T22:07:00.136050] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:00.136160] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-10-21T22:07:00.139118] [INFO ] [MAIN ] Derivative Progress: 444/2057 symbols completed. CSTM took 1.3s. Estimated remaining: 10m 9s. Rate: 159.0 symbols/min [2025-10-21T22:07:00.139429] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:00.159839] [DEBUG] [LOCAL ] CTDD: Loaded 5258 existing records from primary storage. [2025-10-21T22:07:00.160596] [INFO ] [MAIN ] CTDD: Loaded 5258 primary data records. [2025-10-21T22:07:00.279700] [DEBUG] [LOCAL ] CTO: Loaded 27425 existing records from primary storage. [2025-10-21T22:07:00.279984] [INFO ] [MAIN ] CTO: Loaded 27425 primary data records. [2025-10-21T22:07:00.651794] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-21T22:07:00.662327] [INFO ] [MAIN ] CTRA: Loaded 53647 primary data records. [2025-10-21T22:07:01.209404] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:01.213212] [INFO ] [MAIN ] CTDD: Generated 1794 derivative records from 5258 primary records. [2025-10-21T22:07:01.213515] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-10-21T22:07:01.241902] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1794 records). [2025-10-21T22:07:01.242237] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-10-21T22:07:01.244494] [INFO ] [MAIN ] Derivative Progress: 445/2057 symbols completed. CTDD took 1.1s. Estimated remaining: 10m 11s. Rate: 158.3 symbols/min [2025-10-21T22:07:01.241841] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:01.244763] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:01.246148] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 27425 primary records. [2025-10-21T22:07:01.246368] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-10-21T22:07:01.265339] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-10-21T22:07:01.265675] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-10-21T22:07:01.275763] [INFO ] [MAIN ] Derivative Progress: 446/2057 symbols completed. CTO took 1.1s. Estimated remaining: 10m 9s. Rate: 158.6 symbols/min [2025-10-21T22:07:01.280753] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:01.281163] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:01.282071] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53647 primary records. [2025-10-21T22:07:01.282550] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-10-21T22:07:01.298805] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-10-21T22:07:01.299005] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-10-21T22:07:01.301956] [INFO ] [MAIN ] Derivative Progress: 447/2057 symbols completed. CTRA took 1.2s. Estimated remaining: 10m 8s. Rate: 158.9 symbols/min [2025-10-21T22:07:01.302218] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:01.354257] [DEBUG] [LOCAL ] CTS: Loaded 19552 existing records from primary storage. [2025-10-21T22:07:01.367544] [DEBUG] [LOCAL ] CTRE: Loaded 49466 existing records from primary storage. [2025-10-21T22:07:01.367679] [INFO ] [MAIN ] CTS: Loaded 19552 primary data records. [2025-10-21T22:07:01.367846] [INFO ] [MAIN ] CTRE: Loaded 49466 primary data records. [2025-10-21T22:07:01.368382] [DEBUG] [LOCAL ] CTRI: Loaded 40676 existing records from primary storage. [2025-10-21T22:07:01.379968] [INFO ] [MAIN ] CTRI: Loaded 40676 primary data records. [2025-10-21T22:07:02.372597] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:02.386332] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49466 primary records. [2025-10-21T22:07:02.386442] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-10-21T22:07:02.403615] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:02.419383] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-10-21T22:07:02.418311] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:02.420376] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19552 primary records. [2025-10-21T22:07:02.420460] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-10-21T22:07:02.421175] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 40676 primary records. [2025-10-21T22:07:02.424514] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-10-21T22:07:02.424715] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-10-21T22:07:02.424409] [INFO ] [MAIN ] Derivative Progress: 448/2057 symbols completed. CTRE took 1.2s. Estimated remaining: 10m 10s. Rate: 158.2 symbols/min [2025-10-21T22:07:02.454465] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-10-21T22:07:02.457455] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-10-21T22:07:02.457634] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-10-21T22:07:02.457556] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-10-21T22:07:02.459710] [INFO ] [MAIN ] Derivative Progress: 449/2057 symbols completed. CTRI took 1.2s. Estimated remaining: 10m 8s. Rate: 158.6 symbols/min [2025-10-21T22:07:02.463049] [INFO ] [MAIN ] Derivative Progress: 450/2057 symbols completed. CTS took 1.2s. Estimated remaining: 10m 7s. Rate: 158.9 symbols/min [2025-10-21T22:07:02.463472] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:02.463585] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:02.463709] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:02.495605] [DEBUG] [LOCAL ] CUBI: Loaded 27119 existing records from primary storage. [2025-10-21T22:07:02.509510] [INFO ] [MAIN ] CUBI: Loaded 27119 primary data records. [2025-10-21T22:07:02.687951] [DEBUG] [LOCAL ] CTVA: Loaded 53305 existing records from primary storage. [2025-10-21T22:07:02.698427] [INFO ] [MAIN ] CTVA: Loaded 53305 primary data records. [2025-10-21T22:07:02.771492] [DEBUG] [LOCAL ] CUK: Loaded 51065 existing records from primary storage. [2025-10-21T22:07:02.781870] [INFO ] [MAIN ] CUK: Loaded 51065 primary data records. [2025-10-21T22:07:03.496497] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:03.498604] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27119 primary records. [2025-10-21T22:07:03.498928] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-10-21T22:07:03.519917] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-10-21T22:07:03.531992] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-10-21T22:07:03.534302] [INFO ] [MAIN ] Derivative Progress: 451/2057 symbols completed. CUBI took 1.1s. Estimated remaining: 10m 9s. Rate: 158.3 symbols/min [2025-10-21T22:07:03.534722] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:03.535577] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:03.535471] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53305 primary records. [2025-10-21T22:07:03.549016] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-10-21T22:07:03.548965] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:03.549927] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51065 primary records. [2025-10-21T22:07:03.550773] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-10-21T22:07:03.580101] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-10-21T22:07:03.583435] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-10-21T22:07:03.583384] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-10-21T22:07:03.583683] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-10-21T22:07:03.586502] [INFO ] [MAIN ] Derivative Progress: 452/2057 symbols completed. CTVA took 1.1s. Estimated remaining: 10m 7s. Rate: 158.6 symbols/min [2025-10-21T22:07:03.589627] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:03.589796] [INFO ] [MAIN ] Derivative Progress: 453/2057 symbols completed. CUK took 1.1s. Estimated remaining: 10m 6s. Rate: 158.9 symbols/min [2025-10-21T22:07:03.590201] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:03.625755] [DEBUG] [LOCAL ] CURB: Loaded 32813 existing records from primary storage. [2025-10-21T22:07:03.625992] [INFO ] [MAIN ] CURB: Loaded 32813 primary data records. [2025-10-21T22:07:03.700547] [DEBUG] [LOCAL ] CURV: Loaded 27190 existing records from primary storage. [2025-10-21T22:07:03.718000] [INFO ] [MAIN ] CURV: Loaded 27190 primary data records. [2025-10-21T22:07:04.064957] [DEBUG] [LOCAL ] CVE: Loaded 53567 existing records from primary storage. [2025-10-21T22:07:04.071115] [INFO ] [MAIN ] CVE: Loaded 53567 primary data records. [2025-10-21T22:07:04.623668] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:04.625039] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 32813 primary records. [2025-10-21T22:07:04.625443] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-10-21T22:07:04.643104] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-10-21T22:07:04.643328] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-10-21T22:07:04.645541] [INFO ] [MAIN ] Derivative Progress: 454/2057 symbols completed. CURB took 1.1s. Estimated remaining: 10m 8s. Rate: 158.3 symbols/min [2025-10-21T22:07:04.646710] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:04.665613] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:04.666504] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 27190 primary records. [2025-10-21T22:07:04.666893] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-10-21T22:07:04.692338] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-10-21T22:07:04.692537] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-10-21T22:07:04.695380] [INFO ] [MAIN ] Derivative Progress: 455/2057 symbols completed. CURV took 1.1s. Estimated remaining: 10m 6s. Rate: 158.6 symbols/min [2025-10-21T22:07:04.708914] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:04.715510] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:04.715132] [DEBUG] [LOCAL ] CVEO: Loaded 15250 existing records from primary storage. [2025-10-21T22:07:04.716394] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53567 primary records. [2025-10-21T22:07:04.716920] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-10-21T22:07:04.717109] [INFO ] [MAIN ] CVEO: Loaded 15250 primary data records. [2025-10-21T22:07:04.777382] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-10-21T22:07:04.803761] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-10-21T22:07:04.818461] [INFO ] [MAIN ] Derivative Progress: 456/2057 symbols completed. CVE took 1.2s. Estimated remaining: 10m 5s. Rate: 158.8 symbols/min [2025-10-21T22:07:04.823896] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:05.054075] [DEBUG] [LOCAL ] CVLG: Loaded 15331 existing records from primary storage. [2025-10-21T22:07:05.068313] [INFO ] [MAIN ] CVLG: Loaded 15331 primary data records. [2025-10-21T22:07:05.082985] [DEBUG] [LOCAL ] CVI: Loaded 46730 existing records from primary storage. [2025-10-21T22:07:05.117888] [INFO ] [MAIN ] CVI: Loaded 46730 primary data records. [2025-10-21T22:07:05.714630] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:05.716718] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15250 primary records. [2025-10-21T22:07:05.717203] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-10-21T22:07:05.734304] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-10-21T22:07:05.734572] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-10-21T22:07:05.736928] [INFO ] [MAIN ] Derivative Progress: 457/2057 symbols completed. CVEO took 1.1s. Estimated remaining: 10m 6s. Rate: 158.3 symbols/min [2025-10-21T22:07:05.737202] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:05.757547] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:05.759121] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46730 primary records. [2025-10-21T22:07:05.760606] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-10-21T22:07:05.789284] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-10-21T22:07:05.789706] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-10-21T22:07:05.789554] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:05.792003] [INFO ] [MAIN ] Derivative Progress: 458/2057 symbols completed. CVI took 1.1s. Estimated remaining: 10m 5s. Rate: 158.6 symbols/min [2025-10-21T22:07:05.792221] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:05.793158] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15331 primary records. [2025-10-21T22:07:05.793783] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-10-21T22:07:05.822912] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-10-21T22:07:05.823033] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-10-21T22:07:05.825830] [INFO ] [MAIN ] Derivative Progress: 459/2057 symbols completed. CVLG took 1.0s. Estimated remaining: 10m 3s. Rate: 158.9 symbols/min [2025-10-21T22:07:05.826065] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:05.844412] [DEBUG] [LOCAL ] CVNA: Loaded 52839 existing records from primary storage. [2025-10-21T22:07:05.844582] [INFO ] [MAIN ] CVNA: Loaded 52839 primary data records. [2025-10-21T22:07:06.211544] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-21T22:07:06.229289] [INFO ] [MAIN ] CVS: Loaded 53694 primary data records. [2025-10-21T22:07:06.263575] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-21T22:07:06.301352] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-10-21T22:07:06.877569] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:06.879163] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 52839 primary records. [2025-10-21T22:07:06.879973] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-10-21T22:07:06.897800] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-10-21T22:07:06.899447] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-10-21T22:07:06.902480] [INFO ] [MAIN ] Derivative Progress: 460/2057 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 5s. Rate: 158.3 symbols/min [2025-10-21T22:07:06.902635] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:06.921314] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:06.922336] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53694 primary records. [2025-10-21T22:07:06.922610] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-10-21T22:07:06.966445] [DEBUG] [LOCAL ] CW: Loaded 21993 existing records from primary storage. [2025-10-21T22:07:06.952927] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-10-21T22:07:06.966608] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-10-21T22:07:06.967228] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:06.966936] [INFO ] [MAIN ] CW: Loaded 21993 primary data records. [2025-10-21T22:07:06.969268] [INFO ] [MAIN ] Derivative Progress: 461/2057 symbols completed. CVS took 1.2s. Estimated remaining: 10m 4s. Rate: 158.6 symbols/min [2025-10-21T22:07:06.970135] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-10-21T22:07:06.970388] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:06.981902] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-10-21T22:07:07.079162] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-10-21T22:07:07.089974] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-10-21T22:07:07.093063] [INFO ] [MAIN ] Derivative Progress: 462/2057 symbols completed. CVX took 1.3s. Estimated remaining: 10m 3s. Rate: 158.8 symbols/min [2025-10-21T22:07:07.098974] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:07.333387] [DEBUG] [LOCAL ] CWAN: Loaded 52682 existing records from primary storage. [2025-10-21T22:07:07.333772] [INFO ] [MAIN ] CWAN: Loaded 52682 primary data records. [2025-10-21T22:07:07.468198] [DEBUG] [LOCAL ] CWEN: Loaded 45297 existing records from primary storage. [2025-10-21T22:07:07.473844] [INFO ] [MAIN ] CWEN: Loaded 45297 primary data records. [2025-10-21T22:07:07.575069] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:07:07.725426] [INFO ] [MAIN ] CW: Generated 1793 derivative records from 21993 primary records. [2025-10-21T22:07:07.748159] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-10-21T22:07:07.855282] [DEBUG] [LOCAL ] CW: Derivative data saved (1793 records). [2025-10-21T22:07:07.861129] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-10-21T22:07:07.863300] [INFO ] [MAIN ] Derivative Progress: 463/2057 symbols completed. CW took 1.0s. Estimated remaining: 10m 4s. Rate: 158.5 symbols/min [2025-10-21T22:07:08.043712] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:08.044452] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52682 primary records. [2025-10-21T22:07:08.044551] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-10-21T22:07:08.061627] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-10-21T22:07:08.061734] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-10-21T22:07:08.063742] [INFO ] [MAIN ] Derivative Progress: 464/2057 symbols completed. CWAN took 1.1s. Estimated remaining: 10m 3s. Rate: 158.6 symbols/min [2025-10-21T22:07:08.078985] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:08.079505] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45297 primary records. [2025-10-21T22:07:08.079563] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-10-21T22:07:08.094306] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-10-21T22:07:08.094361] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-10-21T22:07:08.096357] [INFO ] [MAIN ] Derivative Progress: 465/2057 symbols completed. CWEN took 1.0s. Estimated remaining: 10m 1s. Rate: 158.9 symbols/min [2025-10-21T22:07:08.096885] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:08.096822] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:08.097252] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:08.106822] [DEBUG] [LOCAL ] CXE: Loaded 6372 existing records from primary storage. [2025-10-21T22:07:08.107119] [INFO ] [MAIN ] CXE: Loaded 6372 primary data records. [2025-10-21T22:07:08.463586] [DEBUG] [LOCAL ] CWK: Loaded 49650 existing records from primary storage. [2025-10-21T22:07:08.467092] [INFO ] [MAIN ] CWK: Loaded 49650 primary data records. [2025-10-21T22:07:08.466829] [DEBUG] [LOCAL ] CX: Loaded 52833 existing records from primary storage. [2025-10-21T22:07:08.467396] [INFO ] [MAIN ] CX: Loaded 52833 primary data records. [2025-10-21T22:07:09.089560] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:09.091220] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 6372 primary records. [2025-10-21T22:07:09.091980] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-10-21T22:07:09.108301] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-10-21T22:07:09.108466] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-10-21T22:07:09.110748] [INFO ] [MAIN ] Derivative Progress: 466/2057 symbols completed. CXE took 1.0s. Estimated remaining: 10m 3s. Rate: 158.4 symbols/min [2025-10-21T22:07:09.111349] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:09.121365] [DEBUG] [LOCAL ] CXH: Loaded 4418 existing records from primary storage. [2025-10-21T22:07:09.121794] [INFO ] [MAIN ] CXH: Loaded 4418 primary data records. [2025-10-21T22:07:09.201110] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:09.220264] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52833 primary records. [2025-10-21T22:07:09.231285] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-10-21T22:07:09.262770] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:09.272852] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49650 primary records. [2025-10-21T22:07:09.273189] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-10-21T22:07:09.362447] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-10-21T22:07:09.366337] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-10-21T22:07:09.361374] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-10-21T22:07:09.406917] [INFO ] [MAIN ] Derivative Progress: 467/2057 symbols completed. CWK took 1.3s. Estimated remaining: 10m 2s. Rate: 158.4 symbols/min [2025-10-21T22:07:09.404234] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-10-21T22:07:09.477341] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:09.488328] [INFO ] [MAIN ] Derivative Progress: 468/2057 symbols completed. CX took 1.4s. Estimated remaining: 10m 1s. Rate: 158.7 symbols/min [2025-10-21T22:07:09.489747] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:09.535847] [DEBUG] [LOCAL ] CXT: Loaded 30841 existing records from primary storage. [2025-10-21T22:07:09.536782] [INFO ] [MAIN ] CXT: Loaded 30841 primary data records. [2025-10-21T22:07:09.587156] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:07:09.618972] [INFO ] [MAIN ] CXH: Generated 1793 derivative records from 4418 primary records. [2025-10-21T22:07:09.619915] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-10-21T22:07:09.646759] [DEBUG] [LOCAL ] CXM: Loaded 47468 existing records from primary storage. [2025-10-21T22:07:09.652299] [INFO ] [MAIN ] CXM: Loaded 47468 primary data records. [2025-10-21T22:07:09.681701] [DEBUG] [LOCAL ] CXH: Derivative data saved (1793 records). [2025-10-21T22:07:09.689418] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-10-21T22:07:09.714577] [INFO ] [MAIN ] Derivative Progress: 469/2057 symbols completed. CXH took 0.6s. Estimated remaining: 9m 60s. Rate: 158.8 symbols/min [2025-10-21T22:07:09.738599] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:10.240298] [DEBUG] [LOCAL ] CXW: Loaded 43650 existing records from primary storage. [2025-10-21T22:07:10.240861] [INFO ] [MAIN ] CXW: Loaded 43650 primary data records. [2025-10-21T22:07:10.375757] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:10.415344] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30841 primary records. [2025-10-21T22:07:10.571466] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-10-21T22:07:10.571880] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:10.573517] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47468 primary records. [2025-10-21T22:07:10.573670] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-10-21T22:07:10.607047] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-10-21T22:07:10.612050] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-10-21T22:07:10.611504] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-10-21T22:07:10.612348] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-10-21T22:07:10.614811] [INFO ] [MAIN ] Derivative Progress: 470/2057 symbols completed. CXM took 1.1s. Estimated remaining: 10m 1s. Rate: 158.4 symbols/min [2025-10-21T22:07:10.615144] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:10.617658] [INFO ] [MAIN ] Derivative Progress: 471/2057 symbols completed. CXT took 1.1s. Estimated remaining: 9m 60s. Rate: 158.7 symbols/min [2025-10-21T22:07:10.618471] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:10.642247] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:10.643031] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 43650 primary records. [2025-10-21T22:07:10.643179] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-10-21T22:07:10.669629] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-10-21T22:07:10.669783] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-10-21T22:07:10.672439] [INFO ] [MAIN ] Derivative Progress: 472/2057 symbols completed. CXW took 0.9s. Estimated remaining: 9m 58s. Rate: 159.0 symbols/min [2025-10-21T22:07:10.672734] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:10.702002] [DEBUG] [LOCAL ] CYH: Loaded 47712 existing records from primary storage. [2025-10-21T22:07:10.702281] [INFO ] [MAIN ] CYH: Loaded 47712 primary data records. [2025-10-21T22:07:10.835843] [DEBUG] [LOCAL ] DAC: Loaded 12508 existing records from primary storage. [2025-10-21T22:07:10.836037] [INFO ] [MAIN ] DAC: Loaded 12508 primary data records. [2025-10-21T22:07:10.836795] [DEBUG] [LOCAL ] D: Loaded 53649 existing records from primary storage. [2025-10-21T22:07:10.862710] [INFO ] [MAIN ] D: Loaded 53649 primary data records. [2025-10-21T22:07:11.674911] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:11.673775] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:11.676025] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 47712 primary records. [2025-10-21T22:07:11.676706] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-10-21T22:07:11.678209] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12508 primary records. [2025-10-21T22:07:11.686834] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-10-21T22:07:11.704512] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-10-21T22:07:11.707078] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-10-21T22:07:11.712617] [INFO ] [MAIN ] Derivative Progress: 473/2057 symbols completed. CYH took 1.1s. Estimated remaining: 9m 60s. Rate: 158.4 symbols/min [2025-10-21T22:07:11.713930] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:11.714051] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-10-21T22:07:11.714619] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-10-21T22:07:11.729086] [INFO ] [MAIN ] Derivative Progress: 474/2057 symbols completed. DAC took 1.1s. Estimated remaining: 9m 58s. Rate: 158.7 symbols/min [2025-10-21T22:07:11.729886] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:11.729683] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:11.730665] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53649 primary records. [2025-10-21T22:07:11.730921] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-10-21T22:07:11.747233] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-10-21T22:07:11.747517] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-10-21T22:07:11.750893] [INFO ] [MAIN ] Derivative Progress: 475/2057 symbols completed. D took 1.1s. Estimated remaining: 9m 57s. Rate: 159.0 symbols/min [2025-10-21T22:07:11.751376] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:11.796288] [DEBUG] [LOCAL ] DAO: Loaded 19753 existing records from primary storage. [2025-10-21T22:07:11.812114] [INFO ] [MAIN ] DAO: Loaded 19753 primary data records. [2025-10-21T22:07:11.840392] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-21T22:07:11.885098] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-10-21T22:07:11.865588] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-10-21T22:07:11.906054] [INFO ] [MAIN ] DAN: Loaded 49394 primary data records. [2025-10-21T22:07:12.799689] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:12.800753] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 19753 primary records. [2025-10-21T22:07:12.801250] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-10-21T22:07:12.820120] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-10-21T22:07:12.821855] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-10-21T22:07:12.831206] [INFO ] [MAIN ] Derivative Progress: 476/2057 symbols completed. DAO took 1.1s. Estimated remaining: 9m 59s. Rate: 158.4 symbols/min [2025-10-21T22:07:12.831347] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:12.836856] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:12.845528] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-10-21T22:07:12.850523] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-10-21T22:07:12.850911] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:12.852503] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49394 primary records. [2025-10-21T22:07:12.852918] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-10-21T22:07:12.868993] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-10-21T22:07:12.869143] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-10-21T22:07:12.872186] [INFO ] [MAIN ] Derivative Progress: 477/2057 symbols completed. DAL took 1.2s. Estimated remaining: 9m 57s. Rate: 158.7 symbols/min [2025-10-21T22:07:12.883327] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:12.887996] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-10-21T22:07:12.888093] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-10-21T22:07:12.891801] [INFO ] [MAIN ] Derivative Progress: 478/2057 symbols completed. DAN took 1.2s. Estimated remaining: 9m 56s. Rate: 159.0 symbols/min [2025-10-21T22:07:12.936174] [DEBUG] [LOCAL ] DAR: Loaded 52006 existing records from primary storage. [2025-10-21T22:07:12.936351] [INFO ] [MAIN ] DAR: Loaded 52006 primary data records. [2025-10-21T22:07:13.087787] [DEBUG] [LOCAL ] DAVA: Loaded 41991 existing records from primary storage. [2025-10-21T22:07:13.108463] [INFO ] [MAIN ] DAVA: Loaded 41991 primary data records. [2025-10-21T22:07:13.562137] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:13.563012] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 52006 primary records. [2025-10-21T22:07:13.563224] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-10-21T22:07:13.579510] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-10-21T22:07:13.579707] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-10-21T22:07:13.582557] [INFO ] [MAIN ] Derivative Progress: 479/2057 symbols completed. DAR took 0.8s. Estimated remaining: 9m 56s. Rate: 158.8 symbols/min [2025-10-21T22:07:13.597165] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:13.597808] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 41991 primary records. [2025-10-21T22:07:13.597869] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-10-21T22:07:13.613012] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-10-21T22:07:13.613072] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-10-21T22:07:13.615417] [INFO ] [MAIN ] Derivative Progress: 480/2057 symbols completed. DAVA took 0.7s. Estimated remaining: 9m 55s. Rate: 159.1 symbols/min [2025-10-21T22:07:13.616006] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:13.616074] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:13.616548] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:13.681267] [DEBUG] [LOCAL ] DBI: Loaded 43510 existing records from primary storage. [2025-10-21T22:07:13.694896] [INFO ] [MAIN ] DBI: Loaded 43510 primary data records. [2025-10-21T22:07:13.726278] [DEBUG] [LOCAL ] DAY: Loaded 49140 existing records from primary storage. [2025-10-21T22:07:13.767238] [INFO ] [MAIN ] DAY: Loaded 49140 primary data records. [2025-10-21T22:07:13.827108] [DEBUG] [LOCAL ] DB: Loaded 52474 existing records from primary storage. [2025-10-21T22:07:13.837773] [INFO ] [MAIN ] DB: Loaded 52474 primary data records. [2025-10-21T22:07:14.748623] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:14.749984] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 43510 primary records. [2025-10-21T22:07:14.750305] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-10-21T22:07:14.772153] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-10-21T22:07:14.772688] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-10-21T22:07:14.775073] [INFO ] [MAIN ] Derivative Progress: 481/2057 symbols completed. DBI took 1.2s. Estimated remaining: 9m 57s. Rate: 158.4 symbols/min [2025-10-21T22:07:14.775389] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:14.793182] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:14.794376] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 49140 primary records. [2025-10-21T22:07:14.797144] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-10-21T22:07:14.812281] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:14.816905] [DEBUG] [LOCAL ] DBL: Loaded 9364 existing records from primary storage. [2025-10-21T22:07:14.829337] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52474 primary records. [2025-10-21T22:07:14.834186] [INFO ] [MAIN ] DBL: Loaded 9364 primary data records. [2025-10-21T22:07:14.833985] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-10-21T22:07:14.845694] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-10-21T22:07:14.834410] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-10-21T22:07:14.880664] [INFO ] [MAIN ] Derivative Progress: 482/2057 symbols completed. DAY took 1.3s. Estimated remaining: 9m 56s. Rate: 158.6 symbols/min [2025-10-21T22:07:14.901263] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:14.979025] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-10-21T22:07:15.005313] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-10-21T22:07:15.016703] [INFO ] [MAIN ] Derivative Progress: 483/2057 symbols completed. DB took 1.4s. Estimated remaining: 9m 55s. Rate: 158.8 symbols/min [2025-10-21T22:07:15.033283] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:15.196531] [DEBUG] [LOCAL ] DBRG: Loaded 49982 existing records from primary storage. [2025-10-21T22:07:15.196851] [INFO ] [MAIN ] DBRG: Loaded 49982 primary data records. [2025-10-21T22:07:15.290906] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:15.323200] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9364 primary records. [2025-10-21T22:07:15.324815] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-10-21T22:07:15.335754] [DEBUG] [LOCAL ] DCI: Loaded 36912 existing records from primary storage. [2025-10-21T22:07:15.346929] [INFO ] [MAIN ] DCI: Loaded 36912 primary data records. [2025-10-21T22:07:15.583795] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-10-21T22:07:15.607320] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-10-21T22:07:15.609263] [INFO ] [MAIN ] Derivative Progress: 484/2057 symbols completed. DBL took 0.8s. Estimated remaining: 9m 55s. Rate: 158.6 symbols/min [2025-10-21T22:07:15.614927] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:15.731953] [DEBUG] [LOCAL ] DCO: Loaded 14899 existing records from primary storage. [2025-10-21T22:07:15.873969] [INFO ] [MAIN ] DCO: Loaded 14899 primary data records. [2025-10-21T22:07:16.211064] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:16.212909] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49982 primary records. [2025-10-21T22:07:16.213225] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-10-21T22:07:16.233455] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-10-21T22:07:16.233607] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-10-21T22:07:16.236798] [INFO ] [MAIN ] Derivative Progress: 485/2057 symbols completed. DBRG took 1.3s. Estimated remaining: 9m 55s. Rate: 158.4 symbols/min [2025-10-21T22:07:16.237369] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:16.251082] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:16.253202] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 36912 primary records. [2025-10-21T22:07:16.253380] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-10-21T22:07:16.270414] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-10-21T22:07:16.270914] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-10-21T22:07:16.272896] [INFO ] [MAIN ] Derivative Progress: 486/2057 symbols completed. DCI took 1.2s. Estimated remaining: 9m 54s. Rate: 158.7 symbols/min [2025-10-21T22:07:16.273377] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:16.290258] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:16.291030] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 14899 primary records. [2025-10-21T22:07:16.291352] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-10-21T22:07:16.320227] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-10-21T22:07:16.320411] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-10-21T22:07:16.322958] [INFO ] [MAIN ] Derivative Progress: 487/2057 symbols completed. DCO took 0.7s. Estimated remaining: 9m 52s. Rate: 159.0 symbols/min [2025-10-21T22:07:16.324053] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:16.343045] [DEBUG] [LOCAL ] DD: Loaded 52933 existing records from primary storage. [2025-10-21T22:07:16.343445] [INFO ] [MAIN ] DD: Loaded 52933 primary data records. [2025-10-21T22:07:16.491869] [DEBUG] [LOCAL ] DDD: Loaded 50947 existing records from primary storage. [2025-10-21T22:07:16.510711] [INFO ] [MAIN ] DDD: Loaded 50947 primary data records. [2025-10-21T22:07:16.675360] [DEBUG] [LOCAL ] DDL: Loaded 37279 existing records from primary storage. [2025-10-21T22:07:16.816583] [INFO ] [MAIN ] DDL: Loaded 37279 primary data records. [2025-10-21T22:07:17.381279] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:17.382391] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52933 primary records. [2025-10-21T22:07:17.382595] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-10-21T22:07:17.399819] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-10-21T22:07:17.399981] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-10-21T22:07:17.401794] [INFO ] [MAIN ] Derivative Progress: 488/2057 symbols completed. DD took 1.2s. Estimated remaining: 9m 54s. Rate: 158.4 symbols/min [2025-10-21T22:07:17.402445] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:17.421223] [DEBUG] [MAIN ] DDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:17.422233] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50947 primary records. [2025-10-21T22:07:17.425199] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-10-21T22:07:17.450788] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-10-21T22:07:17.458775] [DEBUG] [LOCAL ] DDS: Loaded 12448 existing records from primary storage. [2025-10-21T22:07:17.463937] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:17.463683] [INFO ] [MAIN ] DDS: Loaded 12448 primary data records. [2025-10-21T22:07:17.464103] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-10-21T22:07:17.483942] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 37279 primary records. [2025-10-21T22:07:17.478078] [INFO ] [MAIN ] Derivative Progress: 489/2057 symbols completed. DDD took 1.2s. Estimated remaining: 9m 53s. Rate: 158.7 symbols/min [2025-10-21T22:07:17.489628] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-10-21T22:07:17.495331] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:17.595432] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-10-21T22:07:17.599023] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-10-21T22:07:17.602525] [INFO ] [MAIN ] Derivative Progress: 490/2057 symbols completed. DDL took 1.3s. Estimated remaining: 9m 52s. Rate: 158.9 symbols/min [2025-10-21T22:07:17.602811] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:17.838705] [DEBUG] [LOCAL ] DE: Loaded 47547 existing records from primary storage. [2025-10-21T22:07:17.839125] [INFO ] [MAIN ] DE: Loaded 47547 primary data records. [2025-10-21T22:07:17.984105] [DEBUG] [LOCAL ] DEI: Loaded 48305 existing records from primary storage. [2025-10-21T22:07:17.995119] [INFO ] [MAIN ] DEI: Loaded 48305 primary data records. [2025-10-21T22:07:18.306227] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:07:18.313779] [INFO ] [MAIN ] DDS: Generated 1793 derivative records from 12448 primary records. [2025-10-21T22:07:18.332685] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-10-21T22:07:18.367897] [DEBUG] [LOCAL ] DDS: Derivative data saved (1793 records). [2025-10-21T22:07:18.379886] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-10-21T22:07:18.382108] [INFO ] [MAIN ] Derivative Progress: 491/2057 symbols completed. DDS took 1.0s. Estimated remaining: 9m 53s. Rate: 158.5 symbols/min [2025-10-21T22:07:18.394023] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:18.614755] [DEBUG] [LOCAL ] DFH: Loaded 31847 existing records from primary storage. [2025-10-21T22:07:18.615180] [INFO ] [MAIN ] DFH: Loaded 31847 primary data records. [2025-10-21T22:07:18.659994] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:18.666795] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47547 primary records. [2025-10-21T22:07:18.674163] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-10-21T22:07:18.743548] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-10-21T22:07:18.751130] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-10-21T22:07:18.756726] [INFO ] [MAIN ] Derivative Progress: 492/2057 symbols completed. DE took 1.3s. Estimated remaining: 9m 52s. Rate: 158.5 symbols/min [2025-10-21T22:07:18.756924] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:18.961217] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:18.962013] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48305 primary records. [2025-10-21T22:07:18.962134] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-10-21T22:07:18.991398] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-10-21T22:07:18.991686] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-10-21T22:07:18.995421] [INFO ] [MAIN ] Derivative Progress: 493/2057 symbols completed. DEI took 1.4s. Estimated remaining: 9m 51s. Rate: 158.7 symbols/min [2025-10-21T22:07:18.996127] [DEBUG] [LOCAL ] DFIN: Loaded 22406 existing records from primary storage. [2025-10-21T22:07:18.997187] [INFO ] [MAIN ] DFIN: Loaded 22406 primary data records. [2025-10-21T22:07:19.299628] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:19.300301] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 31847 primary records. [2025-10-21T22:07:19.300959] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-10-21T22:07:19.318561] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-10-21T22:07:19.319017] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-10-21T22:07:19.321061] [INFO ] [MAIN ] Derivative Progress: 494/2057 symbols completed. DFH took 0.9s. Estimated remaining: 9m 51s. Rate: 158.7 symbols/min [2025-10-21T22:07:19.339999] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:07:19.340594] [INFO ] [MAIN ] DFIN: Generated 1793 derivative records from 22406 primary records. [2025-10-21T22:07:19.340676] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-10-21T22:07:19.355564] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1793 records). [2025-10-21T22:07:19.355622] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-10-21T22:07:19.357851] [INFO ] [MAIN ] Derivative Progress: 495/2057 symbols completed. DFIN took 0.6s. Estimated remaining: 9m 49s. Rate: 159.0 symbols/min [2025-10-21T22:07:19.358697] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:19.358617] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:19.358537] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:19.371604] [DEBUG] [LOCAL ] DFP: Loaded 11074 existing records from primary storage. [2025-10-21T22:07:19.371896] [INFO ] [MAIN ] DFP: Loaded 11074 primary data records. [2025-10-21T22:07:19.731606] [DEBUG] [LOCAL ] DG: Loaded 53258 existing records from primary storage. [2025-10-21T22:07:19.731989] [INFO ] [MAIN ] DG: Loaded 53258 primary data records. [2025-10-21T22:07:19.732817] [DEBUG] [LOCAL ] DHI: Loaded 53364 existing records from primary storage. [2025-10-21T22:07:19.767961] [INFO ] [MAIN ] DHI: Loaded 53364 primary data records. [2025-10-21T22:07:20.426601] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:20.427690] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11074 primary records. [2025-10-21T22:07:20.427911] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-10-21T22:07:20.448904] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-10-21T22:07:20.449285] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-10-21T22:07:20.452691] [INFO ] [MAIN ] Derivative Progress: 496/2057 symbols completed. DFP took 1.1s. Estimated remaining: 9m 51s. Rate: 158.4 symbols/min [2025-10-21T22:07:20.467191] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:20.468305] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:20.469409] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53258 primary records. [2025-10-21T22:07:20.469735] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-10-21T22:07:20.492275] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:20.500099] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-10-21T22:07:20.500868] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53364 primary records. [2025-10-21T22:07:20.501055] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-10-21T22:07:20.501195] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-10-21T22:07:20.503141] [INFO ] [MAIN ] Derivative Progress: 497/2057 symbols completed. DG took 1.1s. Estimated remaining: 9m 50s. Rate: 158.7 symbols/min [2025-10-21T22:07:20.504077] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:20.520164] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-10-21T22:07:20.520389] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-10-21T22:07:20.522847] [INFO ] [MAIN ] Derivative Progress: 498/2057 symbols completed. DHI took 1.2s. Estimated remaining: 9m 48s. Rate: 159.0 symbols/min [2025-10-21T22:07:20.523031] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:20.620322] [DEBUG] [LOCAL ] DHR: Loaded 53381 existing records from primary storage. [2025-10-21T22:07:20.618406] [DEBUG] [LOCAL ] DIN: Loaded 36831 existing records from primary storage. [2025-10-21T22:07:20.619134] [DEBUG] [LOCAL ] DINO: Loaded 52837 existing records from primary storage. [2025-10-21T22:07:20.620775] [INFO ] [MAIN ] DINO: Loaded 52837 primary data records. [2025-10-21T22:07:20.620686] [INFO ] [MAIN ] DIN: Loaded 36831 primary data records. [2025-10-21T22:07:20.621065] [INFO ] [MAIN ] DHR: Loaded 53381 primary data records. [2025-10-21T22:07:21.559521] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:21.568883] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 36831 primary records. [2025-10-21T22:07:21.587281] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:21.587354] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-10-21T22:07:21.587869] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:21.588707] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53381 primary records. [2025-10-21T22:07:21.590183] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-10-21T22:07:21.589713] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52837 primary records. [2025-10-21T22:07:21.590718] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-10-21T22:07:21.614040] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-10-21T22:07:21.618119] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-10-21T22:07:21.621015] [INFO ] [MAIN ] Derivative Progress: 499/2057 symbols completed. DIN took 1.1s. Estimated remaining: 9m 50s. Rate: 158.4 symbols/min [2025-10-21T22:07:21.624918] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:21.625803] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-10-21T22:07:21.626964] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-10-21T22:07:21.629772] [INFO ] [MAIN ] Derivative Progress: 500/2057 symbols completed. DHR took 1.2s. Estimated remaining: 9m 49s. Rate: 158.7 symbols/min [2025-10-21T22:07:21.638545] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:21.645774] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-10-21T22:07:21.646075] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-10-21T22:07:21.648553] [INFO ] [MAIN ] Derivative Progress: 501/2057 symbols completed. DINO took 1.1s. Estimated remaining: 9m 47s. Rate: 159.0 symbols/min [2025-10-21T22:07:21.648854] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:21.668914] [DEBUG] [LOCAL ] DKL: Loaded 17059 existing records from primary storage. [2025-10-21T22:07:21.669138] [INFO ] [MAIN ] DKL: Loaded 17059 primary data records. [2025-10-21T22:07:21.903096] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-21T22:07:22.046165] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-10-21T22:07:22.092337] [DEBUG] [LOCAL ] DKS: Loaded 49449 existing records from primary storage. [2025-10-21T22:07:22.127815] [INFO ] [MAIN ] DKS: Loaded 49449 primary data records. [2025-10-21T22:07:22.701540] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:22.703673] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 17059 primary records. [2025-10-21T22:07:22.704252] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-10-21T22:07:22.730238] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:22.734458] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-10-21T22:07:22.735393] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-10-21T22:07:22.735786] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-10-21T22:07:22.738324] [INFO ] [MAIN ] Derivative Progress: 502/2057 symbols completed. DKL took 1.1s. Estimated remaining: 9m 49s. Rate: 158.4 symbols/min [2025-10-21T22:07:22.738558] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:22.735901] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-10-21T22:07:22.756155] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-10-21T22:07:22.756290] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-10-21T22:07:22.758311] [INFO ] [MAIN ] Derivative Progress: 503/2057 symbols completed. DIS took 1.1s. Estimated remaining: 9m 48s. Rate: 158.7 symbols/min [2025-10-21T22:07:22.758533] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:22.774813] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:22.775571] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49449 primary records. [2025-10-21T22:07:22.775731] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-10-21T22:07:22.804827] [DEBUG] [LOCAL ] DLNG: Loaded 6106 existing records from primary storage. [2025-10-21T22:07:22.805281] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-10-21T22:07:22.805579] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-10-21T22:07:22.808343] [INFO ] [MAIN ] Derivative Progress: 504/2057 symbols completed. DKS took 1.2s. Estimated remaining: 9m 46s. Rate: 158.9 symbols/min [2025-10-21T22:07:22.805682] [INFO ] [MAIN ] DLNG: Loaded 6106 primary data records. [2025-10-21T22:07:22.808588] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:22.906468] [DEBUG] [LOCAL ] DLB: Loaded 32289 existing records from primary storage. [2025-10-21T22:07:22.922875] [INFO ] [MAIN ] DLB: Loaded 32289 primary data records. [2025-10-21T22:07:23.461463] [DEBUG] [LOCAL ] DLR: Loaded 50634 existing records from primary storage. [2025-10-21T22:07:23.462315] [INFO ] [MAIN ] DLR: Loaded 50634 primary data records. [2025-10-21T22:07:23.777430] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:23.778996] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6106 primary records. [2025-10-21T22:07:23.781450] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-10-21T22:07:23.809813] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:23.811070] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32289 primary records. [2025-10-21T22:07:23.810322] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-10-21T22:07:23.811306] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-10-21T22:07:23.813213] [INFO ] [MAIN ] Derivative Progress: 505/2057 symbols completed. DLNG took 1.1s. Estimated remaining: 9m 48s. Rate: 158.4 symbols/min [2025-10-21T22:07:23.811206] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-10-21T22:07:23.814319] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:23.831236] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-10-21T22:07:23.831416] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-10-21T22:07:23.833862] [INFO ] [MAIN ] Derivative Progress: 506/2057 symbols completed. DLB took 1.1s. Estimated remaining: 9m 46s. Rate: 158.7 symbols/min [2025-10-21T22:07:23.834121] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:23.851102] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:23.859071] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 50634 primary records. [2025-10-21T22:07:23.859250] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-10-21T22:07:23.878965] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-10-21T22:07:23.879628] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-10-21T22:07:23.898197] [DEBUG] [LOCAL ] DLX: Loaded 28165 existing records from primary storage. [2025-10-21T22:07:23.896438] [INFO ] [MAIN ] Derivative Progress: 507/2057 symbols completed. DLR took 1.1s. Estimated remaining: 9m 45s. Rate: 159.0 symbols/min [2025-10-21T22:07:23.898917] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:23.899086] [INFO ] [MAIN ] DLX: Loaded 28165 primary data records. [2025-10-21T22:07:23.898720] [DEBUG] [LOCAL ] DLY: Loaded 20743 existing records from primary storage. [2025-10-21T22:07:23.899608] [INFO ] [MAIN ] DLY: Loaded 20743 primary data records. [2025-10-21T22:07:24.072433] [DEBUG] [LOCAL ] DMA: Loaded 4729 existing records from primary storage. [2025-10-21T22:07:24.109471] [INFO ] [MAIN ] DMA: Loaded 4729 primary data records. [2025-10-21T22:07:24.836982] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:24.839298] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 28165 primary records. [2025-10-21T22:07:24.852280] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-10-21T22:07:24.853476] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:24.862703] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 20743 primary records. [2025-10-21T22:07:24.865398] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-10-21T22:07:24.888365] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:24.892218] [INFO ] [MAIN ] DMA: Generated 1794 derivative records from 4729 primary records. [2025-10-21T22:07:24.894710] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-10-21T22:07:24.896622] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-10-21T22:07:24.897562] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-10-21T22:07:24.900510] [INFO ] [MAIN ] Derivative Progress: 508/2057 symbols completed. DLY took 1.1s. Estimated remaining: 9m 47s. Rate: 158.5 symbols/min [2025-10-21T22:07:24.909191] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-10-21T22:07:24.912826] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-10-21T22:07:24.916880] [INFO ] [MAIN ] Derivative Progress: 509/2057 symbols completed. DLX took 1.1s. Estimated remaining: 9m 45s. Rate: 158.8 symbols/min [2025-10-21T22:07:24.916960] [DEBUG] [LOCAL ] DMA: Derivative data saved (1794 records). [2025-10-21T22:07:24.917136] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-10-21T22:07:24.919496] [INFO ] [MAIN ] Derivative Progress: 510/2057 symbols completed. DMA took 1.0s. Estimated remaining: 9m 44s. Rate: 159.1 symbols/min [2025-10-21T22:07:24.919932] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:24.919882] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:24.920049] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:24.933862] [DEBUG] [LOCAL ] DMB: Loaded 10482 existing records from primary storage. [2025-10-21T22:07:24.934040] [INFO ] [MAIN ] DMB: Loaded 10482 primary data records. [2025-10-21T22:07:25.001480] [DEBUG] [LOCAL ] DMO: Loaded 9862 existing records from primary storage. [2025-10-21T22:07:25.001705] [INFO ] [MAIN ] DMO: Loaded 9862 primary data records. [2025-10-21T22:07:25.544357] [DEBUG] [LOCAL ] DNA: Loaded 48547 existing records from primary storage. [2025-10-21T22:07:25.545110] [INFO ] [MAIN ] DNA: Loaded 48547 primary data records. [2025-10-21T22:07:25.912554] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:25.913573] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10482 primary records. [2025-10-21T22:07:25.913847] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-10-21T22:07:25.933901] [DEBUG] [MAIN ] DMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:25.934605] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9862 primary records. [2025-10-21T22:07:25.938313] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-10-21T22:07:25.955105] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-10-21T22:07:25.958390] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-10-21T22:07:25.959311] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-10-21T22:07:25.959428] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-10-21T22:07:25.961749] [INFO ] [MAIN ] Derivative Progress: 511/2057 symbols completed. DMO took 1.0s. Estimated remaining: 9m 45s. Rate: 158.5 symbols/min [2025-10-21T22:07:25.963932] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:25.964184] [INFO ] [MAIN ] Derivative Progress: 512/2057 symbols completed. DMB took 1.0s. Estimated remaining: 9m 44s. Rate: 158.8 symbols/min [2025-10-21T22:07:25.964520] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:25.982877] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:25.983571] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48547 primary records. [2025-10-21T22:07:25.983722] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-10-21T22:07:26.009951] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-10-21T22:07:26.010154] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-10-21T22:07:26.012710] [INFO ] [MAIN ] Derivative Progress: 513/2057 symbols completed. DNA took 1.1s. Estimated remaining: 9m 42s. Rate: 159.1 symbols/min [2025-10-21T22:07:26.012923] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:26.033437] [DEBUG] [LOCAL ] DNP: Loaded 33093 existing records from primary storage. [2025-10-21T22:07:26.033570] [INFO ] [MAIN ] DNP: Loaded 33093 primary data records. [2025-10-21T22:07:26.160288] [DEBUG] [LOCAL ] DNOW: Loaded 43799 existing records from primary storage. [2025-10-21T22:07:26.196713] [INFO ] [MAIN ] DNOW: Loaded 43799 primary data records. [2025-10-21T22:07:26.666471] [DEBUG] [LOCAL ] DOC: Loaded 53555 existing records from primary storage. [2025-10-21T22:07:26.666744] [INFO ] [MAIN ] DOC: Loaded 53555 primary data records. [2025-10-21T22:07:26.981105] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:26.982286] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33093 primary records. [2025-10-21T22:07:26.982390] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-10-21T22:07:27.000852] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-10-21T22:07:27.001311] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-10-21T22:07:27.003744] [INFO ] [MAIN ] Derivative Progress: 514/2057 symbols completed. DNP took 1.0s. Estimated remaining: 9m 44s. Rate: 158.6 symbols/min [2025-10-21T22:07:27.004509] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:27.022118] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:27.023080] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43799 primary records. [2025-10-21T22:07:27.023299] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-10-21T22:07:27.039631] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-10-21T22:07:27.039958] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-10-21T22:07:27.042451] [INFO ] [MAIN ] Derivative Progress: 515/2057 symbols completed. DNOW took 1.1s. Estimated remaining: 9m 42s. Rate: 158.9 symbols/min [2025-10-21T22:07:27.042600] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:27.071965] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:27.072546] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53555 primary records. [2025-10-21T22:07:27.072615] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-10-21T22:07:27.110709] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-10-21T22:07:27.110863] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-10-21T22:07:27.113249] [INFO ] [MAIN ] Derivative Progress: 516/2057 symbols completed. DOC took 1.1s. Estimated remaining: 9m 41s. Rate: 159.1 symbols/min [2025-10-21T22:07:27.114334] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:27.114139] [DEBUG] [LOCAL ] DOCN: Loaded 51135 existing records from primary storage. [2025-10-21T22:07:27.114860] [INFO ] [MAIN ] DOCN: Loaded 51135 primary data records. [2025-10-21T22:07:27.231543] [DEBUG] [LOCAL ] DOUG: Loaded 33846 existing records from primary storage. [2025-10-21T22:07:27.239594] [INFO ] [MAIN ] DOUG: Loaded 33846 primary data records. [2025-10-21T22:07:27.793481] [DEBUG] [LOCAL ] DOV: Loaded 45577 existing records from primary storage. [2025-10-21T22:07:27.793845] [INFO ] [MAIN ] DOV: Loaded 45577 primary data records. [2025-10-21T22:07:28.130925] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:07:28.132187] [INFO ] [MAIN ] DOUG: Generated 1793 derivative records from 33846 primary records. [2025-10-21T22:07:28.131347] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:28.132527] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-10-21T22:07:28.133422] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 51135 primary records. [2025-10-21T22:07:28.134163] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-10-21T22:07:28.161181] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1793 records). [2025-10-21T22:07:28.163252] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-10-21T22:07:28.165785] [INFO ] [MAIN ] Derivative Progress: 517/2057 symbols completed. DOUG took 1.1s. Estimated remaining: 9m 43s. Rate: 158.6 symbols/min [2025-10-21T22:07:28.168436] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:28.168309] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-10-21T22:07:28.168764] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-10-21T22:07:28.172556] [INFO ] [MAIN ] Derivative Progress: 518/2057 symbols completed. DOCN took 1.2s. Estimated remaining: 9m 41s. Rate: 158.9 symbols/min [2025-10-21T22:07:28.172840] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:28.186829] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:28.187414] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45577 primary records. [2025-10-21T22:07:28.191148] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-10-21T22:07:28.212631] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-10-21T22:07:28.212902] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-10-21T22:07:28.213197] [DEBUG] [LOCAL ] DPG: Loaded 13478 existing records from primary storage. [2025-10-21T22:07:28.213297] [INFO ] [MAIN ] DPG: Loaded 13478 primary data records. [2025-10-21T22:07:28.215814] [INFO ] [MAIN ] Derivative Progress: 519/2057 symbols completed. DOV took 1.1s. Estimated remaining: 9m 40s. Rate: 159.2 symbols/min [2025-10-21T22:07:28.221311] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:28.530361] [DEBUG] [LOCAL ] DQ: Loaded 43827 existing records from primary storage. [2025-10-21T22:07:28.538363] [INFO ] [MAIN ] DQ: Loaded 43827 primary data records. [2025-10-21T22:07:28.655135] [DEBUG] [LOCAL ] DRD: Loaded 37887 existing records from primary storage. [2025-10-21T22:07:28.661094] [INFO ] [MAIN ] DRD: Loaded 37887 primary data records. [2025-10-21T22:07:29.162478] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:29.163348] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13478 primary records. [2025-10-21T22:07:29.163600] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-10-21T22:07:29.181708] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-10-21T22:07:29.181966] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-10-21T22:07:29.184516] [INFO ] [MAIN ] Derivative Progress: 520/2057 symbols completed. DPG took 1.0s. Estimated remaining: 9m 41s. Rate: 158.7 symbols/min [2025-10-21T22:07:29.184979] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:29.200586] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:29.201314] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43827 primary records. [2025-10-21T22:07:29.201713] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-10-21T22:07:29.219387] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-10-21T22:07:29.220133] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-10-21T22:07:29.222733] [INFO ] [MAIN ] Derivative Progress: 521/2057 symbols completed. DQ took 1.0s. Estimated remaining: 9m 40s. Rate: 158.9 symbols/min [2025-10-21T22:07:29.223152] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:29.236260] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:29.237016] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 37887 primary records. [2025-10-21T22:07:29.237156] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-10-21T22:07:29.263518] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-10-21T22:07:29.263610] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-10-21T22:07:29.266239] [INFO ] [MAIN ] Derivative Progress: 522/2057 symbols completed. DRD took 1.0s. Estimated remaining: 9m 38s. Rate: 159.2 symbols/min [2025-10-21T22:07:29.266442] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:29.277188] [DEBUG] [LOCAL ] DRLL: Loaded 8769 existing records from primary storage. [2025-10-21T22:07:29.277373] [INFO ] [MAIN ] DRLL: Loaded 8769 primary data records. [2025-10-21T22:07:29.380804] [DEBUG] [LOCAL ] DRH: Loaded 50269 existing records from primary storage. [2025-10-21T22:07:29.406478] [INFO ] [MAIN ] DRH: Loaded 50269 primary data records. [2025-10-21T22:07:29.734337] [DEBUG] [LOCAL ] DRI: Loaded 47615 existing records from primary storage. [2025-10-21T22:07:29.798929] [INFO ] [MAIN ] DRI: Loaded 47615 primary data records. [2025-10-21T22:07:30.277762] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:30.280179] [INFO ] [MAIN ] DRLL: Generated 1794 derivative records from 8769 primary records. [2025-10-21T22:07:30.281071] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-10-21T22:07:30.303364] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:30.309824] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1794 records). [2025-10-21T22:07:30.310717] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50269 primary records. [2025-10-21T22:07:30.310070] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-10-21T22:07:30.311120] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-10-21T22:07:30.313139] [INFO ] [MAIN ] Derivative Progress: 523/2057 symbols completed. DRLL took 1.0s. Estimated remaining: 9m 40s. Rate: 158.7 symbols/min [2025-10-21T22:07:30.329084] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-10-21T22:07:30.329167] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-10-21T22:07:30.331517] [INFO ] [MAIN ] Derivative Progress: 524/2057 symbols completed. DRH took 1.1s. Estimated remaining: 9m 39s. Rate: 159.0 symbols/min [2025-10-21T22:07:30.348476] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:30.349137] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47615 primary records. [2025-10-21T22:07:30.349201] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-10-21T22:07:30.364606] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-10-21T22:07:30.364699] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-10-21T22:07:30.367827] [INFO ] [MAIN ] Derivative Progress: 525/2057 symbols completed. DRI took 1.1s. Estimated remaining: 9m 37s. Rate: 159.2 symbols/min [2025-10-21T22:07:30.368363] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:30.368304] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:30.368238] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:30.389675] [DEBUG] [LOCAL ] DSM: Loaded 14103 existing records from primary storage. [2025-10-21T22:07:30.389808] [INFO ] [MAIN ] DSM: Loaded 14103 primary data records. [2025-10-21T22:07:30.491245] [DEBUG] [LOCAL ] DSX: Loaded 23594 existing records from primary storage. [2025-10-21T22:07:30.490830] [DEBUG] [LOCAL ] DSU: Loaded 23023 existing records from primary storage. [2025-10-21T22:07:30.512730] [INFO ] [MAIN ] DSU: Loaded 23023 primary data records. [2025-10-21T22:07:30.512841] [INFO ] [MAIN ] DSX: Loaded 23594 primary data records. [2025-10-21T22:07:31.342966] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:31.344290] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 14103 primary records. [2025-10-21T22:07:31.344521] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-10-21T22:07:31.376479] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:31.380368] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 23023 primary records. [2025-10-21T22:07:31.380575] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-10-21T22:07:31.379525] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-10-21T22:07:31.381421] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-10-21T22:07:31.395962] [INFO ] [MAIN ] Derivative Progress: 526/2057 symbols completed. DSM took 1.0s. Estimated remaining: 9m 39s. Rate: 158.7 symbols/min [2025-10-21T22:07:31.396697] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:31.406036] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:31.413324] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 23594 primary records. [2025-10-21T22:07:31.414039] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-10-21T22:07:31.414358] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-10-21T22:07:31.414144] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-10-21T22:07:31.416903] [INFO ] [MAIN ] Derivative Progress: 527/2057 symbols completed. DSU took 1.0s. Estimated remaining: 9m 37s. Rate: 159.0 symbols/min [2025-10-21T22:07:31.417891] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:31.433401] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-10-21T22:07:31.433586] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-10-21T22:07:31.436205] [INFO ] [MAIN ] Derivative Progress: 528/2057 symbols completed. DSX took 1.1s. Estimated remaining: 9m 36s. Rate: 159.3 symbols/min [2025-10-21T22:07:31.436471] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:31.442179] [DEBUG] [LOCAL ] DTB: Loaded 4919 existing records from primary storage. [2025-10-21T22:07:31.442456] [INFO ] [MAIN ] DTB: Loaded 4919 primary data records. [2025-10-21T22:07:31.812297] [DEBUG] [LOCAL ] DTE: Loaded 47181 existing records from primary storage. [2025-10-21T22:07:31.813281] [DEBUG] [LOCAL ] DT: Loaded 52954 existing records from primary storage. [2025-10-21T22:07:31.813480] [INFO ] [MAIN ] DTE: Loaded 47181 primary data records. [2025-10-21T22:07:31.813418] [INFO ] [MAIN ] DT: Loaded 52954 primary data records. [2025-10-21T22:07:32.462883] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:32.465182] [INFO ] [MAIN ] DTB: Generated 1794 derivative records from 4919 primary records. [2025-10-21T22:07:32.465572] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-10-21T22:07:32.482824] [DEBUG] [LOCAL ] DTB: Derivative data saved (1794 records). [2025-10-21T22:07:32.483053] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-10-21T22:07:32.485900] [INFO ] [MAIN ] Derivative Progress: 529/2057 symbols completed. DTB took 1.1s. Estimated remaining: 9m 38s. Rate: 158.8 symbols/min [2025-10-21T22:07:32.486169] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:32.506716] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:32.521103] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52954 primary records. [2025-10-21T22:07:32.521575] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-10-21T22:07:32.521924] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:32.523301] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47181 primary records. [2025-10-21T22:07:32.523965] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-10-21T22:07:32.549172] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-10-21T22:07:32.549332] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-10-21T22:07:32.552181] [INFO ] [MAIN ] Derivative Progress: 530/2057 symbols completed. DT took 1.2s. Estimated remaining: 9m 36s. Rate: 159.0 symbols/min [2025-10-21T22:07:32.560804] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:32.568406] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-10-21T22:07:32.568689] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-10-21T22:07:32.571332] [INFO ] [MAIN ] Derivative Progress: 531/2057 symbols completed. DTE took 1.1s. Estimated remaining: 9m 35s. Rate: 159.3 symbols/min [2025-10-21T22:07:32.571633] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:32.586766] [DEBUG] [LOCAL ] DTM: Loaded 43736 existing records from primary storage. [2025-10-21T22:07:32.587062] [INFO ] [MAIN ] DTM: Loaded 43736 primary data records. [2025-10-21T22:07:32.650349] [DEBUG] [LOCAL ] DUKB: Loaded 6174 existing records from primary storage. [2025-10-21T22:07:32.659161] [INFO ] [MAIN ] DUKB: Loaded 6174 primary data records. [2025-10-21T22:07:33.123148] [DEBUG] [LOCAL ] DUK: Loaded 53437 existing records from primary storage. [2025-10-21T22:07:33.124064] [INFO ] [MAIN ] DUK: Loaded 53437 primary data records. [2025-10-21T22:07:33.594456] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:07:33.595969] [INFO ] [MAIN ] DTM: Generated 1793 derivative records from 43736 primary records. [2025-10-21T22:07:33.596259] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-10-21T22:07:33.613550] [DEBUG] [LOCAL ] DTM: Derivative data saved (1793 records). [2025-10-21T22:07:33.614461] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-10-21T22:07:33.617359] [INFO ] [MAIN ] Derivative Progress: 532/2057 symbols completed. DTM took 1.1s. Estimated remaining: 9m 36s. Rate: 158.8 symbols/min [2025-10-21T22:07:33.618421] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:33.633083] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:33.633776] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6174 primary records. [2025-10-21T22:07:33.633952] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-10-21T22:07:33.649566] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-10-21T22:07:33.649768] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-10-21T22:07:33.652131] [INFO ] [MAIN ] Derivative Progress: 533/2057 symbols completed. DUKB took 1.1s. Estimated remaining: 9m 35s. Rate: 159.0 symbols/min [2025-10-21T22:07:33.652304] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:33.669932] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:33.670609] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53437 primary records. [2025-10-21T22:07:33.670820] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-10-21T22:07:33.699552] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-10-21T22:07:33.699725] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-10-21T22:07:33.702299] [INFO ] [MAIN ] Derivative Progress: 534/2057 symbols completed. DUK took 1.1s. Estimated remaining: 9m 34s. Rate: 159.3 symbols/min [2025-10-21T22:07:33.702537] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:33.731816] [DEBUG] [LOCAL ] DV: Loaded 51247 existing records from primary storage. [2025-10-21T22:07:33.732035] [INFO ] [MAIN ] DV: Loaded 51247 primary data records. [2025-10-21T22:07:33.875231] [DEBUG] [LOCAL ] DVA: Loaded 40739 existing records from primary storage. [2025-10-21T22:07:33.914189] [INFO ] [MAIN ] DVA: Loaded 40739 primary data records. [2025-10-21T22:07:34.120513] [DEBUG] [LOCAL ] DXC: Loaded 49925 existing records from primary storage. [2025-10-21T22:07:34.130120] [INFO ] [MAIN ] DXC: Loaded 49925 primary data records. [2025-10-21T22:07:34.688984] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:34.690085] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51247 primary records. [2025-10-21T22:07:34.690208] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-10-21T22:07:34.707359] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-10-21T22:07:34.707907] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-10-21T22:07:34.710226] [INFO ] [MAIN ] Derivative Progress: 535/2057 symbols completed. DV took 1.1s. Estimated remaining: 9m 35s. Rate: 158.8 symbols/min [2025-10-21T22:07:34.710671] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:34.732014] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:34.733032] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 40739 primary records. [2025-10-21T22:07:34.740708] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-10-21T22:07:34.761368] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:34.765990] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49925 primary records. [2025-10-21T22:07:34.766369] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-10-21T22:07:34.779182] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-10-21T22:07:34.792828] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-10-21T22:07:34.796118] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-10-21T22:07:34.796212] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-10-21T22:07:34.799717] [INFO ] [MAIN ] Derivative Progress: 536/2057 symbols completed. DXC took 1.1s. Estimated remaining: 9m 34s. Rate: 159.0 symbols/min [2025-10-21T22:07:34.802513] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:34.795175] [DEBUG] [LOCAL ] DY: Loaded 28120 existing records from primary storage. [2025-10-21T22:07:34.802727] [INFO ] [MAIN ] Derivative Progress: 537/2057 symbols completed. DVA took 1.2s. Estimated remaining: 9m 32s. Rate: 159.3 symbols/min [2025-10-21T22:07:34.803249] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:34.802811] [INFO ] [MAIN ] DY: Loaded 28120 primary data records. [2025-10-21T22:07:35.140051] [DEBUG] [LOCAL ] E: Loaded 33282 existing records from primary storage. [2025-10-21T22:07:35.140412] [INFO ] [MAIN ] E: Loaded 33282 primary data records. [2025-10-21T22:07:35.279616] [DEBUG] [LOCAL ] EAT: Loaded 49741 existing records from primary storage. [2025-10-21T22:07:35.279874] [INFO ] [MAIN ] EAT: Loaded 49741 primary data records. [2025-10-21T22:07:35.829569] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:35.830491] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 28120 primary records. [2025-10-21T22:07:35.830771] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-10-21T22:07:35.850728] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-10-21T22:07:35.851228] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-10-21T22:07:35.853374] [INFO ] [MAIN ] Derivative Progress: 538/2057 symbols completed. DY took 1.1s. Estimated remaining: 9m 34s. Rate: 158.8 symbols/min [2025-10-21T22:07:35.869426] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:35.870165] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33282 primary records. [2025-10-21T22:07:35.870304] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-10-21T22:07:35.900480] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-10-21T22:07:35.900067] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:35.901176] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49741 primary records. [2025-10-21T22:07:35.900617] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-10-21T22:07:35.903388] [INFO ] [MAIN ] Derivative Progress: 539/2057 symbols completed. E took 1.1s. Estimated remaining: 9m 33s. Rate: 159.0 symbols/min [2025-10-21T22:07:35.901285] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-10-21T22:07:35.918945] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-10-21T22:07:35.919008] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-10-21T22:07:35.922630] [INFO ] [MAIN ] Derivative Progress: 540/2057 symbols completed. EAT took 1.1s. Estimated remaining: 9m 31s. Rate: 159.3 symbols/min [2025-10-21T22:07:35.923280] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:35.923178] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:35.923844] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:35.944031] [DEBUG] [LOCAL ] EBF: Loaded 19191 existing records from primary storage. [2025-10-21T22:07:35.944286] [INFO ] [MAIN ] EBF: Loaded 19191 primary data records. [2025-10-21T22:07:36.111367] [DEBUG] [LOCAL ] EBR: Loaded 43373 existing records from primary storage. [2025-10-21T22:07:36.129947] [DEBUG] [LOCAL ] EB: Loaded 36257 existing records from primary storage. [2025-10-21T22:07:36.145565] [INFO ] [MAIN ] EBR: Loaded 43373 primary data records. [2025-10-21T22:07:36.161604] [INFO ] [MAIN ] EB: Loaded 36257 primary data records. [2025-10-21T22:07:36.898933] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:36.900226] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19191 primary records. [2025-10-21T22:07:36.900341] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-10-21T22:07:36.919134] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-10-21T22:07:36.919271] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-10-21T22:07:36.921273] [INFO ] [MAIN ] Derivative Progress: 541/2057 symbols completed. EBF took 1.0s. Estimated remaining: 9m 33s. Rate: 158.8 symbols/min [2025-10-21T22:07:36.921542] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:36.941379] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:36.942321] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 36257 primary records. [2025-10-21T22:07:36.944267] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-10-21T22:07:36.974011] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-10-21T22:07:36.974587] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-10-21T22:07:36.974510] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:36.977083] [INFO ] [MAIN ] Derivative Progress: 542/2057 symbols completed. EB took 1.1s. Estimated remaining: 9m 31s. Rate: 159.1 symbols/min [2025-10-21T22:07:36.977365] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:36.978306] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43373 primary records. [2025-10-21T22:07:36.978401] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-10-21T22:07:36.994418] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-10-21T22:07:36.994627] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-10-21T22:07:36.997695] [INFO ] [MAIN ] Derivative Progress: 543/2057 symbols completed. EBR took 1.1s. Estimated remaining: 9m 30s. Rate: 159.4 symbols/min [2025-10-21T22:07:36.998090] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:37.034829] [DEBUG] [LOCAL ] EC: Loaded 48909 existing records from primary storage. [2025-10-21T22:07:37.035091] [INFO ] [MAIN ] EC: Loaded 48909 primary data records. [2025-10-21T22:07:37.083165] [DEBUG] [LOCAL ] ECAT: Loaded 29262 existing records from primary storage. [2025-10-21T22:07:37.116369] [INFO ] [MAIN ] ECAT: Loaded 29262 primary data records. [2025-10-21T22:07:37.359389] [DEBUG] [LOCAL ] ECC: Loaded 43432 existing records from primary storage. [2025-10-21T22:07:37.486395] [INFO ] [MAIN ] ECC: Loaded 43432 primary data records. [2025-10-21T22:07:38.017177] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:38.020799] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 48909 primary records. [2025-10-21T22:07:38.020992] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-10-21T22:07:38.060200] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:38.062229] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29262 primary records. [2025-10-21T22:07:38.063531] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-10-21T22:07:38.063835] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-10-21T22:07:38.063954] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-10-21T22:07:38.068045] [INFO ] [MAIN ] Derivative Progress: 544/2057 symbols completed. EC took 1.1s. Estimated remaining: 9m 32s. Rate: 158.8 symbols/min [2025-10-21T22:07:38.075857] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:38.086388] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-10-21T22:07:38.086804] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-10-21T22:07:38.089302] [INFO ] [MAIN ] Derivative Progress: 545/2057 symbols completed. ECAT took 1.1s. Estimated remaining: 9m 30s. Rate: 159.1 symbols/min [2025-10-21T22:07:38.089616] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:38.106925] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:38.116588] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43432 primary records. [2025-10-21T22:07:38.116765] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-10-21T22:07:38.149892] [DEBUG] [LOCAL ] ECG: Loaded 32804 existing records from primary storage. [2025-10-21T22:07:38.148392] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-10-21T22:07:38.150311] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-10-21T22:07:38.150192] [INFO ] [MAIN ] ECG: Loaded 32804 primary data records. [2025-10-21T22:07:38.153415] [INFO ] [MAIN ] Derivative Progress: 546/2057 symbols completed. ECC took 1.2s. Estimated remaining: 9m 29s. Rate: 159.3 symbols/min [2025-10-21T22:07:38.153772] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:38.301924] [DEBUG] [LOCAL ] ECL: Loaded 46734 existing records from primary storage. [2025-10-21T22:07:38.302526] [INFO ] [MAIN ] ECL: Loaded 46734 primary data records. [2025-10-21T22:07:38.302275] [DEBUG] [LOCAL ] ECO: Loaded 18099 existing records from primary storage. [2025-10-21T22:07:38.314164] [INFO ] [MAIN ] ECO: Loaded 18099 primary data records. [2025-10-21T22:07:39.139055] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:39.140131] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 32804 primary records. [2025-10-21T22:07:39.140726] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-10-21T22:07:39.168258] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-10-21T22:07:39.185036] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-10-21T22:07:39.187409] [INFO ] [MAIN ] Derivative Progress: 547/2057 symbols completed. ECG took 1.1s. Estimated remaining: 9m 30s. Rate: 158.8 symbols/min [2025-10-21T22:07:39.187693] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:39.185435] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:39.188457] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:39.189213] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46734 primary records. [2025-10-21T22:07:39.189493] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-10-21T22:07:39.190257] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18099 primary records. [2025-10-21T22:07:39.191176] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-10-21T22:07:39.207240] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-10-21T22:07:39.214373] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-10-21T22:07:39.219167] [INFO ] [MAIN ] Derivative Progress: 548/2057 symbols completed. ECL took 1.1s. Estimated remaining: 9m 29s. Rate: 159.1 symbols/min [2025-10-21T22:07:39.226116] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-10-21T22:07:39.226380] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:39.226276] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-10-21T22:07:39.229013] [INFO ] [MAIN ] Derivative Progress: 549/2057 symbols completed. ECO took 1.1s. Estimated remaining: 9m 28s. Rate: 159.4 symbols/min [2025-10-21T22:07:39.229419] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:39.243823] [DEBUG] [LOCAL ] EDF: Loaded 12901 existing records from primary storage. [2025-10-21T22:07:39.244031] [INFO ] [MAIN ] EDF: Loaded 12901 primary data records. [2025-10-21T22:07:39.377146] [DEBUG] [LOCAL ] EDD: Loaded 27227 existing records from primary storage. [2025-10-21T22:07:39.377708] [INFO ] [MAIN ] EDD: Loaded 27227 primary data records. [2025-10-21T22:07:39.689090] [DEBUG] [LOCAL ] ED: Loaded 52606 existing records from primary storage. [2025-10-21T22:07:39.702980] [INFO ] [MAIN ] ED: Loaded 52606 primary data records. [2025-10-21T22:07:40.257355] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:40.258580] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 12901 primary records. [2025-10-21T22:07:40.258752] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-10-21T22:07:40.278862] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-10-21T22:07:40.291464] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-10-21T22:07:40.292252] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:40.292951] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27227 primary records. [2025-10-21T22:07:40.295345] [INFO ] [MAIN ] Derivative Progress: 550/2057 symbols completed. EDF took 1.1s. Estimated remaining: 9m 29s. Rate: 158.9 symbols/min [2025-10-21T22:07:40.295727] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:40.296448] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-10-21T22:07:40.314196] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-10-21T22:07:40.316023] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-10-21T22:07:40.318376] [INFO ] [MAIN ] Derivative Progress: 551/2057 symbols completed. EDD took 1.1s. Estimated remaining: 9m 28s. Rate: 159.1 symbols/min [2025-10-21T22:07:40.318845] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:40.338522] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:40.339426] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52606 primary records. [2025-10-21T22:07:40.339679] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-10-21T22:07:40.362938] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-10-21T22:07:40.363818] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-10-21T22:07:40.366734] [INFO ] [MAIN ] Derivative Progress: 552/2057 symbols completed. ED took 1.2s. Estimated remaining: 9m 27s. Rate: 159.4 symbols/min [2025-10-21T22:07:40.366929] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:40.363605] [DEBUG] [LOCAL ] EDN: Loaded 19252 existing records from primary storage. [2025-10-21T22:07:40.367491] [INFO ] [MAIN ] EDN: Loaded 19252 primary data records. [2025-10-21T22:07:40.487812] [DEBUG] [LOCAL ] EEX: Loaded 9972 existing records from primary storage. [2025-10-21T22:07:40.493708] [INFO ] [MAIN ] EEX: Loaded 9972 primary data records. [2025-10-21T22:07:40.683229] [DEBUG] [LOCAL ] EDU: Loaded 44834 existing records from primary storage. [2025-10-21T22:07:40.725738] [INFO ] [MAIN ] EDU: Loaded 44834 primary data records. [2025-10-21T22:07:41.391902] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:41.394730] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 19252 primary records. [2025-10-21T22:07:41.395024] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-10-21T22:07:41.424726] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-10-21T22:07:41.424964] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:41.425458] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-10-21T22:07:41.428484] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 9972 primary records. [2025-10-21T22:07:41.427707] [INFO ] [MAIN ] Derivative Progress: 553/2057 symbols completed. EDN took 1.1s. Estimated remaining: 9m 28s. Rate: 158.9 symbols/min [2025-10-21T22:07:41.428826] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-10-21T22:07:41.444371] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-10-21T22:07:41.445301] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-10-21T22:07:41.448555] [INFO ] [MAIN ] Derivative Progress: 554/2057 symbols completed. EEX took 1.1s. Estimated remaining: 9m 27s. Rate: 159.1 symbols/min [2025-10-21T22:07:41.462520] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:41.463295] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 44834 primary records. [2025-10-21T22:07:41.463355] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-10-21T22:07:41.478784] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-10-21T22:07:41.478901] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-10-21T22:07:41.481864] [INFO ] [MAIN ] Derivative Progress: 555/2057 symbols completed. EDU took 1.2s. Estimated remaining: 9m 25s. Rate: 159.4 symbols/min [2025-10-21T22:07:41.482322] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:41.482914] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:41.482807] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:41.511068] [DEBUG] [LOCAL ] EFT: Loaded 13016 existing records from primary storage. [2025-10-21T22:07:41.511926] [DEBUG] [LOCAL ] EFR: Loaded 15065 existing records from primary storage. [2025-10-21T22:07:41.512125] [INFO ] [MAIN ] EFR: Loaded 15065 primary data records. [2025-10-21T22:07:41.512302] [INFO ] [MAIN ] EFT: Loaded 13016 primary data records. [2025-10-21T22:07:41.875390] [DEBUG] [LOCAL ] EFC: Loaded 46334 existing records from primary storage. [2025-10-21T22:07:41.896766] [INFO ] [MAIN ] EFC: Loaded 46334 primary data records. [2025-10-21T22:07:42.690985] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:42.692589] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 15065 primary records. [2025-10-21T22:07:42.693064] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-10-21T22:07:42.715899] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-10-21T22:07:42.729157] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-10-21T22:07:42.729610] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:42.732222] [INFO ] [MAIN ] Derivative Progress: 556/2057 symbols completed. EFR took 1.2s. Estimated remaining: 9m 27s. Rate: 158.7 symbols/min [2025-10-21T22:07:42.733194] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 13016 primary records. [2025-10-21T22:07:42.733422] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-10-21T22:07:42.734325] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:42.754065] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-10-21T22:07:42.754323] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-10-21T22:07:42.757470] [INFO ] [MAIN ] Derivative Progress: 557/2057 symbols completed. EFT took 1.3s. Estimated remaining: 9m 26s. Rate: 159.0 symbols/min [2025-10-21T22:07:42.757932] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:42.776172] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:42.777107] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46334 primary records. [2025-10-21T22:07:42.777226] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-10-21T22:07:42.802236] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-10-21T22:07:42.802508] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-10-21T22:07:42.806112] [INFO ] [MAIN ] Derivative Progress: 558/2057 symbols completed. EFC took 1.3s. Estimated remaining: 9m 25s. Rate: 159.2 symbols/min [2025-10-21T22:07:42.806439] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:42.832811] [DEBUG] [LOCAL ] EG: Loaded 27710 existing records from primary storage. [2025-10-21T22:07:42.832967] [INFO ] [MAIN ] EG: Loaded 27710 primary data records. [2025-10-21T22:07:42.968947] [DEBUG] [LOCAL ] EFX: Loaded 44767 existing records from primary storage. [2025-10-21T22:07:42.984593] [INFO ] [MAIN ] EFX: Loaded 44767 primary data records. [2025-10-21T22:07:43.292359] [DEBUG] [LOCAL ] EGO: Loaded 51738 existing records from primary storage. [2025-10-21T22:07:43.297833] [INFO ] [MAIN ] EGO: Loaded 51738 primary data records. [2025-10-21T22:07:43.842285] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:43.843358] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 27710 primary records. [2025-10-21T22:07:43.843529] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-10-21T22:07:43.862430] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-10-21T22:07:43.862753] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-10-21T22:07:43.865249] [INFO ] [MAIN ] Derivative Progress: 559/2057 symbols completed. EG took 1.1s. Estimated remaining: 9m 26s. Rate: 158.7 symbols/min [2025-10-21T22:07:43.866490] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:43.882449] [DEBUG] [MAIN ] EFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:43.883316] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 44767 primary records. [2025-10-21T22:07:43.883504] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-10-21T22:07:43.909908] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-10-21T22:07:43.914594] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-10-21T22:07:43.917829] [INFO ] [MAIN ] Derivative Progress: 560/2057 symbols completed. EFX took 1.2s. Estimated remaining: 9m 25s. Rate: 159.0 symbols/min [2025-10-21T22:07:43.918168] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:43.927558] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51738 primary records. [2025-10-21T22:07:43.927689] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-10-21T22:07:43.926726] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:43.944686] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-10-21T22:07:43.953307] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-10-21T22:07:43.956287] [INFO ] [MAIN ] Derivative Progress: 561/2057 symbols completed. EGO took 1.1s. Estimated remaining: 9m 24s. Rate: 159.2 symbols/min [2025-10-21T22:07:43.956553] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:43.959592] [DEBUG] [LOCAL ] EGP: Loaded 30323 existing records from primary storage. [2025-10-21T22:07:43.959840] [INFO ] [MAIN ] EGP: Loaded 30323 primary data records. [2025-10-21T22:07:44.187749] [DEBUG] [LOCAL ] EGY: Loaded 41354 existing records from primary storage. [2025-10-21T22:07:44.292792] [DEBUG] [LOCAL ] EHAB: Loaded 29287 existing records from primary storage. [2025-10-21T22:07:44.301669] [INFO ] [MAIN ] EGY: Loaded 41354 primary data records. [2025-10-21T22:07:44.301761] [INFO ] [MAIN ] EHAB: Loaded 29287 primary data records. [2025-10-21T22:07:44.933373] [DEBUG] [MAIN ] EGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:44.934974] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 30323 primary records. [2025-10-21T22:07:44.935431] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-10-21T22:07:44.954682] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-10-21T22:07:44.955060] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-10-21T22:07:44.957450] [INFO ] [MAIN ] Derivative Progress: 562/2057 symbols completed. EGP took 1.1s. Estimated remaining: 9m 25s. Rate: 158.8 symbols/min [2025-10-21T22:07:44.958002] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:44.978172] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:44.979044] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 41354 primary records. [2025-10-21T22:07:44.979141] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-10-21T22:07:45.000604] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-10-21T22:07:45.000797] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-10-21T22:07:45.015803] [INFO ] [MAIN ] Derivative Progress: 563/2057 symbols completed. EGY took 1.1s. Estimated remaining: 9m 24s. Rate: 159.0 symbols/min [2025-10-21T22:07:45.016535] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:45.016768] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:45.017606] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 29287 primary records. [2025-10-21T22:07:45.017762] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-10-21T22:07:45.043456] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-10-21T22:07:45.043728] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-10-21T22:07:45.046496] [INFO ] [MAIN ] Derivative Progress: 564/2057 symbols completed. EHAB took 1.1s. Estimated remaining: 9m 23s. Rate: 159.3 symbols/min [2025-10-21T22:07:45.049501] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:45.057241] [DEBUG] [LOCAL ] EHI: Loaded 10531 existing records from primary storage. [2025-10-21T22:07:45.069823] [INFO ] [MAIN ] EHI: Loaded 10531 primary data records. [2025-10-21T22:07:45.105069] [DEBUG] [LOCAL ] EHC: Loaded 40976 existing records from primary storage. [2025-10-21T22:07:45.110454] [INFO ] [MAIN ] EHC: Loaded 40976 primary data records. [2025-10-21T22:07:45.298894] [DEBUG] [LOCAL ] EIC: Loaded 22643 existing records from primary storage. [2025-10-21T22:07:45.331427] [INFO ] [MAIN ] EIC: Loaded 22643 primary data records. [2025-10-21T22:07:46.096619] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:46.097715] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10531 primary records. [2025-10-21T22:07:46.097805] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-10-21T22:07:46.097000] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:46.099058] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 40976 primary records. [2025-10-21T22:07:46.099305] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-10-21T22:07:46.123029] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-10-21T22:07:46.127154] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-10-21T22:07:46.129465] [INFO ] [MAIN ] Derivative Progress: 565/2057 symbols completed. EHI took 1.1s. Estimated remaining: 9m 24s. Rate: 158.7 symbols/min [2025-10-21T22:07:46.134075] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-10-21T22:07:46.134260] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:46.135748] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-10-21T22:07:46.140461] [INFO ] [MAIN ] Derivative Progress: 566/2057 symbols completed. EHC took 1.2s. Estimated remaining: 9m 23s. Rate: 159.0 symbols/min [2025-10-21T22:07:46.141060] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:46.155875] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:46.156710] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 22643 primary records. [2025-10-21T22:07:46.156836] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-10-21T22:07:46.185882] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-10-21T22:07:46.186989] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-10-21T22:07:46.190152] [INFO ] [MAIN ] Derivative Progress: 567/2057 symbols completed. EIC took 1.1s. Estimated remaining: 9m 21s. Rate: 159.2 symbols/min [2025-10-21T22:07:46.190745] [DEBUG] [LOCAL ] EIG: Loaded 20185 existing records from primary storage. [2025-10-21T22:07:46.190973] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:46.191313] [INFO ] [MAIN ] EIG: Loaded 20185 primary data records. [2025-10-21T22:07:46.410721] [DEBUG] [LOCAL ] ELAN: Loaded 53313 existing records from primary storage. [2025-10-21T22:07:46.534878] [INFO ] [MAIN ] ELAN: Loaded 53313 primary data records. [2025-10-21T22:07:46.665937] [DEBUG] [LOCAL ] ELF: Loaded 51917 existing records from primary storage. [2025-10-21T22:07:46.706938] [INFO ] [MAIN ] ELF: Loaded 51917 primary data records. [2025-10-21T22:07:47.180150] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:47.181284] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20185 primary records. [2025-10-21T22:07:47.181583] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-10-21T22:07:47.203577] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-10-21T22:07:47.204726] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-10-21T22:07:47.207540] [INFO ] [MAIN ] Derivative Progress: 568/2057 symbols completed. EIG took 1.1s. Estimated remaining: 9m 23s. Rate: 158.8 symbols/min [2025-10-21T22:07:47.222310] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:47.223194] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53313 primary records. [2025-10-21T22:07:47.223344] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-10-21T22:07:47.249390] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-10-21T22:07:47.251047] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-10-21T22:07:47.254610] [INFO ] [MAIN ] Derivative Progress: 569/2057 symbols completed. ELAN took 1.1s. Estimated remaining: 9m 21s. Rate: 159.0 symbols/min [2025-10-21T22:07:47.268465] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:47.269180] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 51917 primary records. [2025-10-21T22:07:47.269243] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-10-21T22:07:47.285823] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-10-21T22:07:47.285927] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-10-21T22:07:47.289626] [INFO ] [MAIN ] Derivative Progress: 570/2057 symbols completed. ELF took 1.1s. Estimated remaining: 9m 20s. Rate: 159.3 symbols/min [2025-10-21T22:07:47.290252] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:47.290168] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:47.290353] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:47.297524] [DEBUG] [LOCAL ] EMF: Loaded 3131 existing records from primary storage. [2025-10-21T22:07:47.297787] [INFO ] [MAIN ] EMF: Loaded 3131 primary data records. [2025-10-21T22:07:47.418132] [DEBUG] [LOCAL ] EMD: Loaded 20913 existing records from primary storage. [2025-10-21T22:07:47.418399] [INFO ] [MAIN ] EMD: Loaded 20913 primary data records. [2025-10-21T22:07:47.798905] [DEBUG] [LOCAL ] EME: Loaded 30734 existing records from primary storage. [2025-10-21T22:07:47.815309] [INFO ] [MAIN ] EME: Loaded 30734 primary data records. [2025-10-21T22:07:48.320527] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:48.322009] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3131 primary records. [2025-10-21T22:07:48.322253] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-10-21T22:07:48.337266] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-10-21T22:07:48.337495] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-10-21T22:07:48.339977] [INFO ] [MAIN ] Derivative Progress: 571/2057 symbols completed. EMF took 1.0s. Estimated remaining: 9m 22s. Rate: 158.8 symbols/min [2025-10-21T22:07:48.340118] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:48.358223] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:48.358950] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 20913 primary records. [2025-10-21T22:07:48.359111] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-10-21T22:07:48.375782] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-10-21T22:07:48.376881] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-10-21T22:07:48.379262] [INFO ] [MAIN ] Derivative Progress: 572/2057 symbols completed. EMD took 1.1s. Estimated remaining: 9m 20s. Rate: 159.0 symbols/min [2025-10-21T22:07:48.380387] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:48.409574] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:48.410398] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 30734 primary records. [2025-10-21T22:07:48.410540] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-10-21T22:07:48.429454] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-10-21T22:07:48.430315] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-10-21T22:07:48.433433] [INFO ] [MAIN ] Derivative Progress: 573/2057 symbols completed. EME took 1.1s. Estimated remaining: 9m 19s. Rate: 159.3 symbols/min [2025-10-21T22:07:48.439287] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:48.439141] [DEBUG] [LOCAL ] EMO: Loaded 13345 existing records from primary storage. [2025-10-21T22:07:48.454247] [INFO ] [MAIN ] EMO: Loaded 13345 primary data records. [2025-10-21T22:07:48.476753] [DEBUG] [LOCAL ] EMN: Loaded 50825 existing records from primary storage. [2025-10-21T22:07:48.487225] [INFO ] [MAIN ] EMN: Loaded 50825 primary data records. [2025-10-21T22:07:49.089009] [DEBUG] [LOCAL ] EMR: Loaded 53171 existing records from primary storage. [2025-10-21T22:07:49.089282] [INFO ] [MAIN ] EMR: Loaded 53171 primary data records. [2025-10-21T22:07:49.407622] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:49.409019] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 13345 primary records. [2025-10-21T22:07:49.409188] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-10-21T22:07:49.441432] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:49.441927] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-10-21T22:07:49.442739] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50825 primary records. [2025-10-21T22:07:49.442822] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-10-21T22:07:49.442931] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-10-21T22:07:49.445526] [INFO ] [MAIN ] Derivative Progress: 574/2057 symbols completed. EMO took 1.1s. Estimated remaining: 9m 20s. Rate: 158.8 symbols/min [2025-10-21T22:07:49.446786] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:49.465490] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-10-21T22:07:49.465985] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-10-21T22:07:49.468972] [INFO ] [MAIN ] Derivative Progress: 575/2057 symbols completed. EMN took 1.1s. Estimated remaining: 9m 19s. Rate: 159.0 symbols/min [2025-10-21T22:07:49.469914] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:49.486203] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:49.486895] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53171 primary records. [2025-10-21T22:07:49.487001] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-10-21T22:07:49.504251] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-10-21T22:07:49.504780] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-10-21T22:07:49.508968] [INFO ] [MAIN ] Derivative Progress: 576/2057 symbols completed. EMR took 1.1s. Estimated remaining: 9m 18s. Rate: 159.3 symbols/min [2025-10-21T22:07:49.509308] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:49.559959] [DEBUG] [LOCAL ] ENR: Loaded 43882 existing records from primary storage. [2025-10-21T22:07:49.574193] [INFO ] [MAIN ] ENR: Loaded 43882 primary data records. [2025-10-21T22:07:49.587361] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-21T22:07:49.631509] [INFO ] [MAIN ] ENB: Loaded 53511 primary data records. [2025-10-21T22:07:49.773235] [DEBUG] [LOCAL ] ENS: Loaded 29741 existing records from primary storage. [2025-10-21T22:07:49.794190] [INFO ] [MAIN ] ENS: Loaded 29741 primary data records. [2025-10-21T22:07:50.582832] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:50.591130] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:50.592057] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53511 primary records. [2025-10-21T22:07:50.592251] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-10-21T22:07:50.590635] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 43882 primary records. [2025-10-21T22:07:50.593399] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-10-21T22:07:50.624498] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-10-21T22:07:50.625398] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-10-21T22:07:50.628150] [INFO ] [MAIN ] Derivative Progress: 577/2057 symbols completed. ENB took 1.2s. Estimated remaining: 9m 19s. Rate: 158.8 symbols/min [2025-10-21T22:07:50.628306] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:50.640863] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-10-21T22:07:50.646513] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:50.647421] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29741 primary records. [2025-10-21T22:07:50.646190] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-10-21T22:07:50.649480] [INFO ] [MAIN ] Derivative Progress: 578/2057 symbols completed. ENR took 1.2s. Estimated remaining: 9m 18s. Rate: 159.0 symbols/min [2025-10-21T22:07:50.649786] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:50.649582] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-10-21T22:07:50.679064] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-10-21T22:07:50.679326] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-10-21T22:07:50.682082] [INFO ] [MAIN ] Derivative Progress: 579/2057 symbols completed. ENS took 1.2s. Estimated remaining: 9m 17s. Rate: 159.3 symbols/min [2025-10-21T22:07:50.686067] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:50.701180] [DEBUG] [LOCAL ] EOD: Loaded 15024 existing records from primary storage. [2025-10-21T22:07:50.701930] [INFO ] [MAIN ] EOD: Loaded 15024 primary data records. [2025-10-21T22:07:50.702005] [DEBUG] [LOCAL ] ENVA: Loaded 25267 existing records from primary storage. [2025-10-21T22:07:50.745535] [INFO ] [MAIN ] ENVA: Loaded 25267 primary data records. [2025-10-21T22:07:51.355056] [DEBUG] [LOCAL ] EOG: Loaded 53390 existing records from primary storage. [2025-10-21T22:07:51.355455] [INFO ] [MAIN ] EOG: Loaded 53390 primary data records. [2025-10-21T22:07:51.737587] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:51.746398] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 15024 primary records. [2025-10-21T22:07:51.751595] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:51.752259] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25267 primary records. [2025-10-21T22:07:51.751418] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-10-21T22:07:51.752467] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-10-21T22:07:51.783485] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-10-21T22:07:51.787303] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-10-21T22:07:51.787543] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-10-21T22:07:51.789916] [INFO ] [MAIN ] Derivative Progress: 580/2057 symbols completed. EOD took 1.1s. Estimated remaining: 9m 18s. Rate: 158.7 symbols/min [2025-10-21T22:07:51.787627] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-10-21T22:07:51.793232] [INFO ] [MAIN ] Derivative Progress: 581/2057 symbols completed. ENVA took 1.2s. Estimated remaining: 9m 17s. Rate: 159.0 symbols/min [2025-10-21T22:07:51.790397] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:51.793854] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:51.820527] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:51.821459] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53390 primary records. [2025-10-21T22:07:51.821616] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-10-21T22:07:51.844829] [DEBUG] [LOCAL ] EOI: Loaded 10545 existing records from primary storage. [2025-10-21T22:07:51.845291] [INFO ] [MAIN ] EOI: Loaded 10545 primary data records. [2025-10-21T22:07:51.848725] [DEBUG] [LOCAL ] EOS: Loaded 14817 existing records from primary storage. [2025-10-21T22:07:51.861574] [INFO ] [MAIN ] EOS: Loaded 14817 primary data records. [2025-10-21T22:07:51.861500] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-10-21T22:07:51.966873] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-10-21T22:07:52.041201] [INFO ] [MAIN ] Derivative Progress: 582/2057 symbols completed. EOG took 1.4s. Estimated remaining: 9m 16s. Rate: 159.1 symbols/min [2025-10-21T22:07:52.066216] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:52.458615] [DEBUG] [LOCAL ] EOT: Loaded 7050 existing records from primary storage. [2025-10-21T22:07:52.467915] [INFO ] [MAIN ] EOT: Loaded 7050 primary data records. [2025-10-21T22:07:52.812437] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:52.814128] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 14817 primary records. [2025-10-21T22:07:52.813348] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:52.814291] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-10-21T22:07:52.814985] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10545 primary records. [2025-10-21T22:07:52.815432] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-10-21T22:07:52.848632] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-10-21T22:07:52.847510] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-10-21T22:07:52.848896] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-10-21T22:07:52.849024] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-10-21T22:07:52.851671] [INFO ] [MAIN ] Derivative Progress: 583/2057 symbols completed. EOS took 1.1s. Estimated remaining: 9m 17s. Rate: 158.8 symbols/min [2025-10-21T22:07:52.853678] [INFO ] [MAIN ] Derivative Progress: 584/2057 symbols completed. EOI took 1.1s. Estimated remaining: 9m 16s. Rate: 159.1 symbols/min [2025-10-21T22:07:52.869857] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:52.870412] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 7050 primary records. [2025-10-21T22:07:52.870472] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-10-21T22:07:52.884738] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-10-21T22:07:52.884797] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-10-21T22:07:52.887618] [INFO ] [MAIN ] Derivative Progress: 585/2057 symbols completed. EOT took 0.8s. Estimated remaining: 9m 14s. Rate: 159.3 symbols/min [2025-10-21T22:07:52.888139] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:52.888231] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:52.888089] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:52.923192] [DEBUG] [LOCAL ] EPAC: Loaded 26483 existing records from primary storage. [2025-10-21T22:07:52.923498] [INFO ] [MAIN ] EPAC: Loaded 26483 primary data records. [2025-10-21T22:07:53.062372] [DEBUG] [LOCAL ] EPC: Loaded 39777 existing records from primary storage. [2025-10-21T22:07:53.063126] [INFO ] [MAIN ] EPC: Loaded 39777 primary data records. [2025-10-21T22:07:53.187348] [DEBUG] [LOCAL ] EPD: Loaded 53609 existing records from primary storage. [2025-10-21T22:07:53.339368] [INFO ] [MAIN ] EPD: Loaded 53609 primary data records. [2025-10-21T22:07:53.935448] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:53.936486] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26483 primary records. [2025-10-21T22:07:53.936659] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-10-21T22:07:53.955851] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-10-21T22:07:53.956031] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-10-21T22:07:53.958145] [INFO ] [MAIN ] Derivative Progress: 586/2057 symbols completed. EPAC took 1.1s. Estimated remaining: 9m 16s. Rate: 158.8 symbols/min [2025-10-21T22:07:53.958690] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:53.989896] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:53.990863] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39777 primary records. [2025-10-21T22:07:53.991023] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-10-21T22:07:53.990060] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:53.992263] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53609 primary records. [2025-10-21T22:07:53.992406] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-10-21T22:07:54.024129] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-10-21T22:07:54.024323] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-10-21T22:07:54.027318] [INFO ] [MAIN ] Derivative Progress: 587/2057 symbols completed. EPD took 1.1s. Estimated remaining: 9m 15s. Rate: 159.0 symbols/min [2025-10-21T22:07:54.027505] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:54.022873] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-10-21T22:07:54.027825] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-10-21T22:07:54.030863] [INFO ] [MAIN ] Derivative Progress: 588/2057 symbols completed. EPC took 1.1s. Estimated remaining: 9m 13s. Rate: 159.3 symbols/min [2025-10-21T22:07:54.031254] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:54.053403] [DEBUG] [LOCAL ] EQBK: Loaded 11388 existing records from primary storage. [2025-10-21T22:07:54.053619] [INFO ] [MAIN ] EQBK: Loaded 11388 primary data records. [2025-10-21T22:07:54.114099] [DEBUG] [LOCAL ] EPR: Loaded 43777 existing records from primary storage. [2025-10-21T22:07:54.140140] [INFO ] [MAIN ] EPR: Loaded 43777 primary data records. [2025-10-21T22:07:54.708033] [DEBUG] [LOCAL ] EPRT: Loaded 48476 existing records from primary storage. [2025-10-21T22:07:54.708623] [INFO ] [MAIN ] EPRT: Loaded 48476 primary data records. [2025-10-21T22:07:55.042625] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:55.043458] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 11388 primary records. [2025-10-21T22:07:55.043633] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-10-21T22:07:55.064036] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-10-21T22:07:55.077147] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-10-21T22:07:55.079549] [INFO ] [MAIN ] Derivative Progress: 589/2057 symbols completed. EQBK took 1.0s. Estimated remaining: 9m 15s. Rate: 158.8 symbols/min [2025-10-21T22:07:55.077428] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:55.080786] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 43777 primary records. [2025-10-21T22:07:55.081174] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:55.081088] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-10-21T22:07:55.099888] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-10-21T22:07:55.100119] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-10-21T22:07:55.103379] [INFO ] [MAIN ] Derivative Progress: 590/2057 symbols completed. EPR took 1.1s. Estimated remaining: 9m 13s. Rate: 159.1 symbols/min [2025-10-21T22:07:55.103731] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:55.122112] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:55.123021] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48476 primary records. [2025-10-21T22:07:55.123152] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-10-21T22:07:55.141727] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-10-21T22:07:55.141984] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-10-21T22:07:55.145439] [INFO ] [MAIN ] Derivative Progress: 591/2057 symbols completed. EPRT took 1.1s. Estimated remaining: 9m 12s. Rate: 159.3 symbols/min [2025-10-21T22:07:55.145941] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:55.194457] [DEBUG] [LOCAL ] EQH: Loaded 52705 existing records from primary storage. [2025-10-21T22:07:55.194752] [INFO ] [MAIN ] EQH: Loaded 52705 primary data records. [2025-10-21T22:07:55.349011] [DEBUG] [LOCAL ] EQNR: Loaded 53055 existing records from primary storage. [2025-10-21T22:07:55.383021] [INFO ] [MAIN ] EQNR: Loaded 53055 primary data records. [2025-10-21T22:07:55.451195] [DEBUG] [LOCAL ] EQR: Loaded 51808 existing records from primary storage. [2025-10-21T22:07:55.638573] [INFO ] [MAIN ] EQR: Loaded 51808 primary data records. [2025-10-21T22:07:56.278246] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:56.279812] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52705 primary records. [2025-10-21T22:07:56.280158] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-10-21T22:07:56.298501] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-10-21T22:07:56.299041] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-10-21T22:07:56.301884] [INFO ] [MAIN ] Derivative Progress: 592/2057 symbols completed. EQH took 1.2s. Estimated remaining: 9m 14s. Rate: 158.7 symbols/min [2025-10-21T22:07:56.302300] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:56.320340] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:56.321165] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53055 primary records. [2025-10-21T22:07:56.321518] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-10-21T22:07:56.341625] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-10-21T22:07:56.341906] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-10-21T22:07:56.345229] [INFO ] [MAIN ] Derivative Progress: 593/2057 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 12s. Rate: 159.0 symbols/min [2025-10-21T22:07:56.345685] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:56.360072] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:56.361406] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51808 primary records. [2025-10-21T22:07:56.361585] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-10-21T22:07:56.376738] [DEBUG] [LOCAL ] EQV: Loaded 2740 existing records from primary storage. [2025-10-21T22:07:56.381133] [INFO ] [MAIN ] EQV: Loaded 2740 primary data records. [2025-10-21T22:07:56.381216] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-10-21T22:07:56.392509] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-10-21T22:07:56.426475] [INFO ] [MAIN ] Derivative Progress: 594/2057 symbols completed. EQR took 1.3s. Estimated remaining: 9m 11s. Rate: 159.2 symbols/min [2025-10-21T22:07:56.461826] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:56.554356] [DEBUG] [LOCAL ] EQT: Loaded 53685 existing records from primary storage. [2025-10-21T22:07:56.578257] [INFO ] [MAIN ] EQT: Loaded 53685 primary data records. [2025-10-21T22:07:57.057496] [DEBUG] [LOCAL ] ERJ: Loaded 50293 existing records from primary storage. [2025-10-21T22:07:57.058114] [INFO ] [MAIN ] ERJ: Loaded 50293 primary data records. [2025-10-21T22:07:57.377600] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:57.378512] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2740 primary records. [2025-10-21T22:07:57.379458] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-10-21T22:07:57.397401] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-10-21T22:07:57.397590] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-10-21T22:07:57.399563] [INFO ] [MAIN ] Derivative Progress: 595/2057 symbols completed. EQV took 1.1s. Estimated remaining: 9m 12s. Rate: 158.8 symbols/min [2025-10-21T22:07:57.400469] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:57.421869] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:57.423206] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53685 primary records. [2025-10-21T22:07:57.423526] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-10-21T22:07:57.442680] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-10-21T22:07:57.444681] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-10-21T22:07:57.450127] [INFO ] [MAIN ] Derivative Progress: 596/2057 symbols completed. EQT took 1.1s. Estimated remaining: 9m 11s. Rate: 159.0 symbols/min [2025-10-21T22:07:57.450604] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:57.464570] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:57.475399] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50293 primary records. [2025-10-21T22:07:57.475589] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-10-21T22:07:57.495178] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-10-21T22:07:57.495448] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-10-21T22:07:57.498328] [INFO ] [MAIN ] Derivative Progress: 597/2057 symbols completed. ERJ took 1.0s. Estimated remaining: 9m 10s. Rate: 159.2 symbols/min [2025-10-21T22:07:57.499400] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:57.522899] [DEBUG] [LOCAL ] ERO: Loaded 42158 existing records from primary storage. [2025-10-21T22:07:57.523288] [INFO ] [MAIN ] ERO: Loaded 42158 primary data records. [2025-10-21T22:07:57.637414] [DEBUG] [LOCAL ] ESAB: Loaded 25989 existing records from primary storage. [2025-10-21T22:07:57.654456] [DEBUG] [LOCAL ] ESE: Loaded 16514 existing records from primary storage. [2025-10-21T22:07:57.660065] [INFO ] [MAIN ] ESAB: Loaded 25989 primary data records. [2025-10-21T22:07:57.670346] [INFO ] [MAIN ] ESE: Loaded 16514 primary data records. [2025-10-21T22:07:58.515812] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:58.517224] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 42158 primary records. [2025-10-21T22:07:58.517435] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-10-21T22:07:58.537075] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-10-21T22:07:58.544898] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-10-21T22:07:58.552104] [INFO ] [MAIN ] Derivative Progress: 598/2057 symbols completed. ERO took 1.2s. Estimated remaining: 9m 11s. Rate: 158.8 symbols/min [2025-10-21T22:07:58.552618] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:58.554021] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16514 primary records. [2025-10-21T22:07:58.554122] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-10-21T22:07:58.571700] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-10-21T22:07:58.572555] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-10-21T22:07:58.575372] [INFO ] [MAIN ] Derivative Progress: 599/2057 symbols completed. ESE took 1.1s. Estimated remaining: 9m 10s. Rate: 159.0 symbols/min [2025-10-21T22:07:58.588079] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:07:58.588729] [INFO ] [MAIN ] ESAB: Generated 1793 derivative records from 25989 primary records. [2025-10-21T22:07:58.588791] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-10-21T22:07:58.604005] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1793 records). [2025-10-21T22:07:58.604060] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-10-21T22:07:58.606794] [INFO ] [MAIN ] Derivative Progress: 600/2057 symbols completed. ESAB took 1.2s. Estimated remaining: 9m 9s. Rate: 159.3 symbols/min [2025-10-21T22:07:58.607332] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:58.607260] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:58.607186] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:58.670347] [DEBUG] [LOCAL ] ESNT: Loaded 38064 existing records from primary storage. [2025-10-21T22:07:58.686196] [DEBUG] [LOCAL ] ESRT: Loaded 46538 existing records from primary storage. [2025-10-21T22:07:58.685380] [INFO ] [MAIN ] ESNT: Loaded 38064 primary data records. [2025-10-21T22:07:58.686375] [INFO ] [MAIN ] ESRT: Loaded 46538 primary data records. [2025-10-21T22:07:58.824042] [DEBUG] [LOCAL ] ESI: Loaded 50624 existing records from primary storage. [2025-10-21T22:07:58.877343] [INFO ] [MAIN ] ESI: Loaded 50624 primary data records. [2025-10-21T22:07:59.691389] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:59.693675] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:59.695328] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46538 primary records. [2025-10-21T22:07:59.694600] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38064 primary records. [2025-10-21T22:07:59.695676] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-10-21T22:07:59.695818] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-10-21T22:07:59.744377] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-10-21T22:07:59.744284] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:07:59.740940] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-10-21T22:07:59.745576] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-10-21T22:07:59.745439] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50624 primary records. [2025-10-21T22:07:59.744677] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-10-21T22:07:59.747948] [INFO ] [MAIN ] Derivative Progress: 601/2057 symbols completed. ESRT took 1.1s. Estimated remaining: 9m 10s. Rate: 158.7 symbols/min [2025-10-21T22:07:59.745755] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-10-21T22:07:59.750901] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:59.751410] [INFO ] [MAIN ] Derivative Progress: 602/2057 symbols completed. ESNT took 1.1s. Estimated remaining: 9m 9s. Rate: 159.0 symbols/min [2025-10-21T22:07:59.752203] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:59.770624] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-10-21T22:07:59.770817] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-10-21T22:07:59.773775] [INFO ] [MAIN ] Derivative Progress: 603/2057 symbols completed. ESI took 1.2s. Estimated remaining: 9m 8s. Rate: 159.2 symbols/min [2025-10-21T22:07:59.774033] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:07:59.813569] [DEBUG] [LOCAL ] ETG: Loaded 16586 existing records from primary storage. [2025-10-21T22:07:59.814623] [DEBUG] [LOCAL ] ETD: Loaded 27258 existing records from primary storage. [2025-10-21T22:07:59.814765] [INFO ] [MAIN ] ETG: Loaded 16586 primary data records. [2025-10-21T22:07:59.824377] [DEBUG] [LOCAL ] ESS: Loaded 30188 existing records from primary storage. [2025-10-21T22:07:59.823986] [INFO ] [MAIN ] ETD: Loaded 27258 primary data records. [2025-10-21T22:07:59.856869] [INFO ] [MAIN ] ESS: Loaded 30188 primary data records. [2025-10-21T22:08:00.819161] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:00.820315] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 16586 primary records. [2025-10-21T22:08:00.820618] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-10-21T22:08:00.846905] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:00.848624] [INFO ] [MAIN ] ESS: Generated 1793 derivative records from 30188 primary records. [2025-10-21T22:08:00.848761] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-10-21T22:08:00.847576] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:00.858963] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27258 primary records. [2025-10-21T22:08:00.862161] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-10-21T22:08:00.882832] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-10-21T22:08:00.883010] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-10-21T22:08:00.885114] [INFO ] [MAIN ] Derivative Progress: 604/2057 symbols completed. ETG took 1.1s. Estimated remaining: 9m 9s. Rate: 158.7 symbols/min [2025-10-21T22:08:00.882749] [DEBUG] [LOCAL ] ESS: Derivative data saved (1793 records). [2025-10-21T22:08:00.885358] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:00.892782] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-10-21T22:08:00.901023] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-10-21T22:08:00.904337] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-10-21T22:08:00.904058] [INFO ] [MAIN ] Derivative Progress: 605/2057 symbols completed. ESS took 1.2s. Estimated remaining: 9m 8s. Rate: 159.0 symbols/min [2025-10-21T22:08:00.904575] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:00.907471] [INFO ] [MAIN ] Derivative Progress: 606/2057 symbols completed. ETD took 1.2s. Estimated remaining: 9m 7s. Rate: 159.2 symbols/min [2025-10-21T22:08:00.908063] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:00.922788] [DEBUG] [LOCAL ] ETO: Loaded 6981 existing records from primary storage. [2025-10-21T22:08:00.929923] [DEBUG] [LOCAL ] ETJ: Loaded 16565 existing records from primary storage. [2025-10-21T22:08:00.929540] [INFO ] [MAIN ] ETO: Loaded 6981 primary data records. [2025-10-21T22:08:00.935352] [INFO ] [MAIN ] ETJ: Loaded 16565 primary data records. [2025-10-21T22:08:01.621608] [DEBUG] [LOCAL ] ETN: Loaded 52573 existing records from primary storage. [2025-10-21T22:08:01.622088] [INFO ] [MAIN ] ETN: Loaded 52573 primary data records. [2025-10-21T22:08:01.971862] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:01.972908] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16565 primary records. [2025-10-21T22:08:01.973115] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-10-21T22:08:01.987401] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:01.988371] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6981 primary records. [2025-10-21T22:08:01.995565] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-10-21T22:08:02.003876] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-10-21T22:08:02.004012] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-10-21T22:08:02.007012] [INFO ] [MAIN ] Derivative Progress: 607/2057 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 8s. Rate: 158.7 symbols/min [2025-10-21T22:08:02.007284] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:02.023086] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-10-21T22:08:02.023506] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-10-21T22:08:02.025675] [INFO ] [MAIN ] Derivative Progress: 608/2057 symbols completed. ETO took 1.1s. Estimated remaining: 9m 7s. Rate: 159.0 symbols/min [2025-10-21T22:08:02.025932] [INFO ] [MAIN ] ETSY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:02.042083] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:02.042762] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52573 primary records. [2025-10-21T22:08:02.042992] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-10-21T22:08:02.063193] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-10-21T22:08:02.063323] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-10-21T22:08:02.066109] [INFO ] [MAIN ] Derivative Progress: 609/2057 symbols completed. ETN took 1.2s. Estimated remaining: 9m 6s. Rate: 159.2 symbols/min [2025-10-21T22:08:02.066322] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:02.120195] [DEBUG] [LOCAL ] ETR: Loaded 53193 existing records from primary storage. [2025-10-21T22:08:02.120493] [INFO ] [MAIN ] ETR: Loaded 53193 primary data records. [2025-10-21T22:08:02.205388] [DEBUG] [LOCAL ] ETW: Loaded 25249 existing records from primary storage. [2025-10-21T22:08:02.205613] [INFO ] [MAIN ] ETW: Loaded 25249 primary data records. [2025-10-21T22:08:02.304853] [DEBUG] [LOCAL ] ETSY: Loaded 53569 existing records from primary storage. [2025-10-21T22:08:02.339799] [INFO ] [MAIN ] ETSY: Loaded 53569 primary data records. [2025-10-21T22:08:03.150232] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:03.153399] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53193 primary records. [2025-10-21T22:08:03.153572] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-10-21T22:08:03.181452] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-10-21T22:08:03.195147] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-10-21T22:08:03.198084] [INFO ] [MAIN ] Derivative Progress: 610/2057 symbols completed. ETR took 1.2s. Estimated remaining: 9m 7s. Rate: 158.7 symbols/min [2025-10-21T22:08:03.195632] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:03.198537] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:03.200019] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25249 primary records. [2025-10-21T22:08:03.200763] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-10-21T22:08:03.223027] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-10-21T22:08:03.223261] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-10-21T22:08:03.226389] [INFO ] [MAIN ] Derivative Progress: 611/2057 symbols completed. ETW took 1.2s. Estimated remaining: 9m 6s. Rate: 158.9 symbols/min [2025-10-21T22:08:03.237818] [DEBUG] [LOCAL ] ETX: Loaded 5311 existing records from primary storage. [2025-10-21T22:08:03.226922] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:03.242630] [INFO ] [MAIN ] ETX: Loaded 5311 primary data records. [2025-10-21T22:08:03.243222] [DEBUG] [MAIN ] ETSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:03.276610] [INFO ] [MAIN ] ETSY: Generated 1794 derivative records from 53569 primary records. [2025-10-21T22:08:03.301630] [DEBUG] [LOCAL ] ETSY: Saving derivative data. [2025-10-21T22:08:03.392129] [DEBUG] [LOCAL ] ETSY: Derivative data saved (1794 records). [2025-10-21T22:08:03.386926] [DEBUG] [LOCAL ] ETY: Loaded 22546 existing records from primary storage. [2025-10-21T22:08:03.397362] [INFO ] [MAIN ] ETSY: Successfully saved derivative data. [2025-10-21T22:08:03.402589] [INFO ] [MAIN ] ETY: Loaded 22546 primary data records. [2025-10-21T22:08:03.423861] [INFO ] [MAIN ] Derivative Progress: 612/2057 symbols completed. ETSY took 1.4s. Estimated remaining: 9m 5s. Rate: 159.0 symbols/min [2025-10-21T22:08:03.447861] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:03.698244] [DEBUG] [LOCAL ] EVC: Loaded 17976 existing records from primary storage. [2025-10-21T22:08:03.709613] [INFO ] [MAIN ] EVC: Loaded 17976 primary data records. [2025-10-21T22:08:04.250794] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:04.252359] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 5311 primary records. [2025-10-21T22:08:04.252585] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-10-21T22:08:04.269943] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-10-21T22:08:04.270298] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-10-21T22:08:04.272441] [INFO ] [MAIN ] Derivative Progress: 613/2057 symbols completed. ETX took 1.1s. Estimated remaining: 9m 6s. Rate: 158.7 symbols/min [2025-10-21T22:08:04.290893] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:04.291747] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 22546 primary records. [2025-10-21T22:08:04.292032] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-10-21T22:08:04.309891] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-10-21T22:08:04.310608] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-10-21T22:08:04.313556] [INFO ] [MAIN ] Derivative Progress: 614/2057 symbols completed. ETY took 1.1s. Estimated remaining: 9m 5s. Rate: 159.0 symbols/min [2025-10-21T22:08:04.326380] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:04.327010] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 17976 primary records. [2025-10-21T22:08:04.327071] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-10-21T22:08:04.341605] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-10-21T22:08:04.341688] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-10-21T22:08:04.344597] [INFO ] [MAIN ] Derivative Progress: 615/2057 symbols completed. EVC took 0.9s. Estimated remaining: 9m 3s. Rate: 159.2 symbols/min [2025-10-21T22:08:04.344993] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:04.345125] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:04.345718] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:04.356407] [DEBUG] [LOCAL ] EVG: Loaded 5831 existing records from primary storage. [2025-10-21T22:08:04.356705] [INFO ] [MAIN ] EVG: Loaded 5831 primary data records. [2025-10-21T22:08:04.416025] [DEBUG] [LOCAL ] EVF: Loaded 9793 existing records from primary storage. [2025-10-21T22:08:04.461562] [INFO ] [MAIN ] EVF: Loaded 9793 primary data records. [2025-10-21T22:08:04.599848] [DEBUG] [LOCAL ] EVEX: Loaded 33007 existing records from primary storage. [2025-10-21T22:08:04.652811] [INFO ] [MAIN ] EVEX: Loaded 33007 primary data records. [2025-10-21T22:08:05.313161] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:05.314879] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5831 primary records. [2025-10-21T22:08:05.314978] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-10-21T22:08:05.330833] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-10-21T22:08:05.331506] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-10-21T22:08:05.335049] [INFO ] [MAIN ] Derivative Progress: 616/2057 symbols completed. EVG took 1.0s. Estimated remaining: 9m 5s. Rate: 158.8 symbols/min [2025-10-21T22:08:05.335432] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:05.349339] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:05.350099] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9793 primary records. [2025-10-21T22:08:05.350194] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-10-21T22:08:05.382462] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-10-21T22:08:05.383097] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-10-21T22:08:05.386128] [INFO ] [MAIN ] Derivative Progress: 617/2057 symbols completed. EVF took 1.0s. Estimated remaining: 9m 3s. Rate: 159.0 symbols/min [2025-10-21T22:08:05.383024] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:05.386955] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 33007 primary records. [2025-10-21T22:08:05.387228] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-10-21T22:08:05.387069] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:05.406097] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-10-21T22:08:05.406346] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-10-21T22:08:05.409122] [INFO ] [MAIN ] Derivative Progress: 618/2057 symbols completed. EVEX took 1.1s. Estimated remaining: 9m 2s. Rate: 159.2 symbols/min [2025-10-21T22:08:05.409581] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:05.425676] [DEBUG] [LOCAL ] EVN: Loaded 10747 existing records from primary storage. [2025-10-21T22:08:05.425814] [INFO ] [MAIN ] EVN: Loaded 10747 primary data records. [2025-10-21T22:08:05.543099] [DEBUG] [LOCAL ] EVH: Loaded 49597 existing records from primary storage. [2025-10-21T22:08:05.559364] [INFO ] [MAIN ] EVH: Loaded 49597 primary data records. [2025-10-21T22:08:05.911495] [DEBUG] [LOCAL ] EVR: Loaded 33850 existing records from primary storage. [2025-10-21T22:08:05.956233] [INFO ] [MAIN ] EVR: Loaded 33850 primary data records. [2025-10-21T22:08:06.411272] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:06.412792] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10747 primary records. [2025-10-21T22:08:06.413112] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-10-21T22:08:06.431208] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-10-21T22:08:06.431429] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-10-21T22:08:06.433443] [INFO ] [MAIN ] Derivative Progress: 619/2057 symbols completed. EVN took 1.0s. Estimated remaining: 9m 3s. Rate: 158.8 symbols/min [2025-10-21T22:08:06.434026] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:06.448281] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:06.448997] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49597 primary records. [2025-10-21T22:08:06.449174] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-10-21T22:08:06.465664] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-10-21T22:08:06.465851] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-10-21T22:08:06.468824] [INFO ] [MAIN ] Derivative Progress: 620/2057 symbols completed. EVH took 1.1s. Estimated remaining: 9m 2s. Rate: 159.0 symbols/min [2025-10-21T22:08:06.469178] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:06.494225] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:06.495093] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 33850 primary records. [2025-10-21T22:08:06.495283] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-10-21T22:08:06.504962] [DEBUG] [LOCAL ] EVTC: Loaded 26869 existing records from primary storage. [2025-10-21T22:08:06.515998] [INFO ] [MAIN ] EVTC: Loaded 26869 primary data records. [2025-10-21T22:08:06.525597] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-10-21T22:08:06.550961] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-10-21T22:08:06.564528] [INFO ] [MAIN ] Derivative Progress: 621/2057 symbols completed. EVR took 1.2s. Estimated remaining: 9m 1s. Rate: 159.2 symbols/min [2025-10-21T22:08:06.573999] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:06.674858] [DEBUG] [LOCAL ] EVTL: Loaded 41214 existing records from primary storage. [2025-10-21T22:08:06.686021] [INFO ] [MAIN ] EVTL: Loaded 41214 primary data records. [2025-10-21T22:08:06.934180] [DEBUG] [LOCAL ] EVTR: Loaded 25297 existing records from primary storage. [2025-10-21T22:08:06.960360] [INFO ] [MAIN ] EVTR: Loaded 25297 primary data records. [2025-10-21T22:08:07.558441] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:07.564298] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26869 primary records. [2025-10-21T22:08:07.564403] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-10-21T22:08:07.565669] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:07.566436] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 41214 primary records. [2025-10-21T22:08:07.574610] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-10-21T22:08:07.581780] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-10-21T22:08:07.582676] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-10-21T22:08:07.584832] [INFO ] [MAIN ] Derivative Progress: 622/2057 symbols completed. EVTC took 1.2s. Estimated remaining: 9m 2s. Rate: 158.8 symbols/min [2025-10-21T22:08:07.585103] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:07.602093] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-10-21T22:08:07.602368] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-10-21T22:08:07.605916] [INFO ] [MAIN ] Derivative Progress: 623/2057 symbols completed. EVTL took 1.1s. Estimated remaining: 9m 1s. Rate: 159.0 symbols/min [2025-10-21T22:08:07.606349] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:07.623802] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:07.624455] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 25297 primary records. [2025-10-21T22:08:07.624587] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-10-21T22:08:07.641065] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-10-21T22:08:07.641280] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-10-21T22:08:07.643919] [INFO ] [MAIN ] Derivative Progress: 624/2057 symbols completed. EVTR took 1.1s. Estimated remaining: 8m 60s. Rate: 159.3 symbols/min [2025-10-21T22:08:07.644345] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:07.679831] [DEBUG] [LOCAL ] EXG: Loaded 33695 existing records from primary storage. [2025-10-21T22:08:07.679974] [INFO ] [MAIN ] EXG: Loaded 33695 primary data records. [2025-10-21T22:08:07.808269] [DEBUG] [LOCAL ] EW: Loaded 53399 existing records from primary storage. [2025-10-21T22:08:07.819593] [INFO ] [MAIN ] EW: Loaded 53399 primary data records. [2025-10-21T22:08:08.152810] [DEBUG] [LOCAL ] EXK: Loaded 53186 existing records from primary storage. [2025-10-21T22:08:08.191705] [INFO ] [MAIN ] EXK: Loaded 53186 primary data records. [2025-10-21T22:08:08.671042] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:08.672104] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 33695 primary records. [2025-10-21T22:08:08.672520] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-10-21T22:08:08.707210] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-10-21T22:08:08.707456] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-10-21T22:08:08.709689] [INFO ] [MAIN ] Derivative Progress: 625/2057 symbols completed. EXG took 1.1s. Estimated remaining: 9m 1s. Rate: 158.8 symbols/min [2025-10-21T22:08:08.710253] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:08.710109] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:08.712216] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53399 primary records. [2025-10-21T22:08:08.712304] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-10-21T22:08:08.730448] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-10-21T22:08:08.730688] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-10-21T22:08:08.735984] [INFO ] [MAIN ] Derivative Progress: 626/2057 symbols completed. EW took 1.2s. Estimated remaining: 8m 60s. Rate: 159.0 symbols/min [2025-10-21T22:08:08.736919] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:08.751287] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:08.752207] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53186 primary records. [2025-10-21T22:08:08.752475] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-10-21T22:08:08.778798] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-10-21T22:08:08.779899] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-10-21T22:08:08.791590] [INFO ] [MAIN ] Derivative Progress: 627/2057 symbols completed. EXK took 1.1s. Estimated remaining: 8m 59s. Rate: 159.2 symbols/min [2025-10-21T22:08:08.793620] [DEBUG] [LOCAL ] EXP: Loaded 29339 existing records from primary storage. [2025-10-21T22:08:08.793904] [INFO ] [MAIN ] EXP: Loaded 29339 primary data records. [2025-10-21T22:08:08.793141] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:08.991000] [DEBUG] [LOCAL ] EXPD: Loaded 47765 existing records from primary storage. [2025-10-21T22:08:09.135929] [INFO ] [MAIN ] EXPD: Loaded 47765 primary data records. [2025-10-21T22:08:09.267563] [DEBUG] [LOCAL ] EXR: Loaded 45544 existing records from primary storage. [2025-10-21T22:08:09.278886] [INFO ] [MAIN ] EXR: Loaded 45544 primary data records. [2025-10-21T22:08:09.837313] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:09.838904] [INFO ] [MAIN ] EXP: Generated 1793 derivative records from 29339 primary records. [2025-10-21T22:08:09.839076] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-10-21T22:08:09.860174] [DEBUG] [LOCAL ] EXP: Derivative data saved (1793 records). [2025-10-21T22:08:09.860443] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-10-21T22:08:09.870520] [INFO ] [MAIN ] Derivative Progress: 628/2057 symbols completed. EXP took 1.2s. Estimated remaining: 9m 0s. Rate: 158.8 symbols/min [2025-10-21T22:08:09.876189] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:09.877092] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 47765 primary records. [2025-10-21T22:08:09.877252] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-10-21T22:08:09.893699] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-10-21T22:08:09.893796] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-10-21T22:08:09.896606] [INFO ] [MAIN ] Derivative Progress: 629/2057 symbols completed. EXPD took 1.2s. Estimated remaining: 8m 59s. Rate: 159.0 symbols/min [2025-10-21T22:08:09.911546] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:09.912206] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45544 primary records. [2025-10-21T22:08:09.912268] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-10-21T22:08:09.927583] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-10-21T22:08:09.927698] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-10-21T22:08:09.930862] [INFO ] [MAIN ] Derivative Progress: 630/2057 symbols completed. EXR took 1.1s. Estimated remaining: 8m 58s. Rate: 159.2 symbols/min [2025-10-21T22:08:09.931283] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:09.931361] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:09.931434] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:10.000298] [DEBUG] [LOCAL ] FAF: Loaded 41479 existing records from primary storage. [2025-10-21T22:08:10.001057] [INFO ] [MAIN ] FAF: Loaded 41479 primary data records. [2025-10-21T22:08:10.089310] [DEBUG] [LOCAL ] FBIN: Loaded 50399 existing records from primary storage. [2025-10-21T22:08:10.136773] [INFO ] [MAIN ] FBIN: Loaded 50399 primary data records. [2025-10-21T22:08:10.141125] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-21T22:08:10.177836] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-10-21T22:08:10.969193] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:10.970900] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 41479 primary records. [2025-10-21T22:08:10.971246] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-10-21T22:08:11.002347] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-10-21T22:08:11.002884] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-10-21T22:08:11.003355] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:11.004337] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50399 primary records. [2025-10-21T22:08:11.006867] [INFO ] [MAIN ] Derivative Progress: 631/2057 symbols completed. FAF took 1.1s. Estimated remaining: 8m 59s. Rate: 158.8 symbols/min [2025-10-21T22:08:11.007150] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-10-21T22:08:11.015391] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:11.028406] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:11.036366] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-10-21T22:08:11.037323] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-10-21T22:08:11.036480] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-10-21T22:08:11.040208] [INFO ] [MAIN ] Derivative Progress: 632/2057 symbols completed. FBIN took 1.1s. Estimated remaining: 8m 58s. Rate: 159.0 symbols/min [2025-10-21T22:08:11.040399] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:11.037570] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-10-21T22:08:11.057258] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-10-21T22:08:11.057438] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-10-21T22:08:11.060383] [INFO ] [MAIN ] Derivative Progress: 633/2057 symbols completed. F took 1.1s. Estimated remaining: 8m 57s. Rate: 159.2 symbols/min [2025-10-21T22:08:11.060611] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:11.084351] [DEBUG] [LOCAL ] FBK: Loaded 27486 existing records from primary storage. [2025-10-21T22:08:11.084527] [INFO ] [MAIN ] FBK: Loaded 27486 primary data records. [2025-10-21T22:08:11.168465] [DEBUG] [LOCAL ] FC: Loaded 14475 existing records from primary storage. [2025-10-21T22:08:11.200638] [INFO ] [MAIN ] FC: Loaded 14475 primary data records. [2025-10-21T22:08:11.226127] [DEBUG] [LOCAL ] FBP: Loaded 45626 existing records from primary storage. [2025-10-21T22:08:11.269839] [INFO ] [MAIN ] FBP: Loaded 45626 primary data records. [2025-10-21T22:08:12.085566] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:12.086525] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 27486 primary records. [2025-10-21T22:08:12.087034] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-10-21T22:08:12.086961] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:12.088375] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 14475 primary records. [2025-10-21T22:08:12.088609] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-10-21T22:08:12.122366] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:12.122074] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-10-21T22:08:12.132779] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-10-21T22:08:12.136793] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 45626 primary records. [2025-10-21T22:08:12.138740] [INFO ] [MAIN ] Derivative Progress: 634/2057 symbols completed. FBK took 1.1s. Estimated remaining: 8m 58s. Rate: 158.8 symbols/min [2025-10-21T22:08:12.138869] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-10-21T22:08:12.139014] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:12.141078] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-10-21T22:08:12.141251] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-10-21T22:08:12.144112] [INFO ] [MAIN ] Derivative Progress: 635/2057 symbols completed. FC took 1.1s. Estimated remaining: 8m 57s. Rate: 159.0 symbols/min [2025-10-21T22:08:12.144489] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:12.160553] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-10-21T22:08:12.160787] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-10-21T22:08:12.163590] [INFO ] [MAIN ] Derivative Progress: 636/2057 symbols completed. FBP took 1.1s. Estimated remaining: 8m 55s. Rate: 159.3 symbols/min [2025-10-21T22:08:12.163807] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:12.196987] [DEBUG] [LOCAL ] FCN: Loaded 25874 existing records from primary storage. [2025-10-21T22:08:12.197275] [INFO ] [MAIN ] FCN: Loaded 25874 primary data records. [2025-10-21T22:08:12.312842] [DEBUG] [LOCAL ] FCF: Loaded 39218 existing records from primary storage. [2025-10-21T22:08:12.324929] [INFO ] [MAIN ] FCF: Loaded 39218 primary data records. [2025-10-21T22:08:12.514479] [DEBUG] [LOCAL ] FCPT: Loaded 37077 existing records from primary storage. [2025-10-21T22:08:12.525480] [INFO ] [MAIN ] FCPT: Loaded 37077 primary data records. [2025-10-21T22:08:13.173863] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:13.174611] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 25874 primary records. [2025-10-21T22:08:13.174957] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-10-21T22:08:13.193957] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-10-21T22:08:13.194291] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-10-21T22:08:13.196269] [INFO ] [MAIN ] Derivative Progress: 637/2057 symbols completed. FCN took 1.1s. Estimated remaining: 8m 56s. Rate: 158.8 symbols/min [2025-10-21T22:08:13.209675] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:13.211004] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:13.212380] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39218 primary records. [2025-10-21T22:08:13.212612] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-10-21T22:08:13.246009] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-10-21T22:08:13.246104] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-10-21T22:08:13.245906] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:13.249790] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37077 primary records. [2025-10-21T22:08:13.249912] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-10-21T22:08:13.248897] [INFO ] [MAIN ] Derivative Progress: 638/2057 symbols completed. FCF took 1.1s. Estimated remaining: 8m 55s. Rate: 159.0 symbols/min [2025-10-21T22:08:13.250044] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:13.264019] [DEBUG] [LOCAL ] FCT: Loaded 14677 existing records from primary storage. [2025-10-21T22:08:13.269673] [INFO ] [MAIN ] FCT: Loaded 14677 primary data records. [2025-10-21T22:08:13.271845] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-10-21T22:08:13.283216] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-10-21T22:08:13.318607] [INFO ] [MAIN ] Derivative Progress: 639/2057 symbols completed. FCPT took 1.2s. Estimated remaining: 8m 54s. Rate: 159.2 symbols/min [2025-10-21T22:08:13.323916] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:13.641907] [DEBUG] [LOCAL ] FDP: Loaded 29749 existing records from primary storage. [2025-10-21T22:08:13.658028] [INFO ] [MAIN ] FDP: Loaded 29749 primary data records. [2025-10-21T22:08:13.679884] [DEBUG] [LOCAL ] FCX: Loaded 53701 existing records from primary storage. [2025-10-21T22:08:13.715181] [INFO ] [MAIN ] FCX: Loaded 53701 primary data records. [2025-10-21T22:08:14.313906] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:14.315412] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14677 primary records. [2025-10-21T22:08:14.316039] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-10-21T22:08:14.334514] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-10-21T22:08:14.334751] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-10-21T22:08:14.337417] [INFO ] [MAIN ] Derivative Progress: 640/2057 symbols completed. FCT took 1.1s. Estimated remaining: 8m 55s. Rate: 158.8 symbols/min [2025-10-21T22:08:14.338881] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:14.357194] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:14.360336] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 29749 primary records. [2025-10-21T22:08:14.360521] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-10-21T22:08:14.373664] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:14.374607] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53701 primary records. [2025-10-21T22:08:14.374715] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-10-21T22:08:14.414374] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-10-21T22:08:14.417193] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-10-21T22:08:14.427810] [INFO ] [MAIN ] Derivative Progress: 641/2057 symbols completed. FCX took 1.2s. Estimated remaining: 8m 54s. Rate: 159.0 symbols/min [2025-10-21T22:08:14.417109] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-10-21T22:08:14.429237] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-10-21T22:08:14.429419] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:14.431970] [INFO ] [MAIN ] Derivative Progress: 642/2057 symbols completed. FDP took 1.1s. Estimated remaining: 8m 53s. Rate: 159.3 symbols/min [2025-10-21T22:08:14.432248] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:14.433665] [DEBUG] [LOCAL ] FDS: Loaded 28015 existing records from primary storage. [2025-10-21T22:08:14.433959] [INFO ] [MAIN ] FDS: Loaded 28015 primary data records. [2025-10-21T22:08:14.795777] [DEBUG] [LOCAL ] FDX: Loaded 51271 existing records from primary storage. [2025-10-21T22:08:14.809881] [INFO ] [MAIN ] FDX: Loaded 51271 primary data records. [2025-10-21T22:08:14.837050] [DEBUG] [LOCAL ] FE: Loaded 53434 existing records from primary storage. [2025-10-21T22:08:14.852267] [INFO ] [MAIN ] FE: Loaded 53434 primary data records. [2025-10-21T22:08:15.460617] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:15.461422] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 28015 primary records. [2025-10-21T22:08:15.461611] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-10-21T22:08:15.481874] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-10-21T22:08:15.482167] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-10-21T22:08:15.484335] [INFO ] [MAIN ] Derivative Progress: 643/2057 symbols completed. FDS took 1.1s. Estimated remaining: 8m 54s. Rate: 158.8 symbols/min [2025-10-21T22:08:15.507341] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:15.508113] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53434 primary records. [2025-10-21T22:08:15.508273] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-10-21T22:08:15.521537] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:15.530186] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51271 primary records. [2025-10-21T22:08:15.532791] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-10-21T22:08:15.536733] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-10-21T22:08:15.537013] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-10-21T22:08:15.539781] [INFO ] [MAIN ] Derivative Progress: 644/2057 symbols completed. FE took 1.1s. Estimated remaining: 8m 53s. Rate: 159.0 symbols/min [2025-10-21T22:08:15.554802] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-10-21T22:08:15.554861] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-10-21T22:08:15.557882] [INFO ] [MAIN ] Derivative Progress: 645/2057 symbols completed. FDX took 1.1s. Estimated remaining: 8m 52s. Rate: 159.3 symbols/min [2025-10-21T22:08:15.558215] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:15.558495] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:15.558694] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:15.578916] [DEBUG] [LOCAL ] FET: Loaded 12922 existing records from primary storage. [2025-10-21T22:08:15.579107] [INFO ] [MAIN ] FET: Loaded 12922 primary data records. [2025-10-21T22:08:15.651871] [DEBUG] [LOCAL ] FF: Loaded 23879 existing records from primary storage. [2025-10-21T22:08:15.679586] [INFO ] [MAIN ] FF: Loaded 23879 primary data records. [2025-10-21T22:08:16.037125] [DEBUG] [LOCAL ] FERG: Loaded 48749 existing records from primary storage. [2025-10-21T22:08:16.041447] [INFO ] [MAIN ] FERG: Loaded 48749 primary data records. [2025-10-21T22:08:16.566267] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:16.567802] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12922 primary records. [2025-10-21T22:08:16.568140] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-10-21T22:08:16.595077] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:16.601765] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-10-21T22:08:16.599544] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 23879 primary records. [2025-10-21T22:08:16.602602] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-10-21T22:08:16.602790] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-10-21T22:08:16.605614] [INFO ] [MAIN ] Derivative Progress: 646/2057 symbols completed. FET took 1.0s. Estimated remaining: 8m 53s. Rate: 158.8 symbols/min [2025-10-21T22:08:16.633252] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:16.636280] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:16.637301] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-10-21T22:08:16.637409] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-10-21T22:08:16.640750] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 48749 primary records. [2025-10-21T22:08:16.639865] [INFO ] [MAIN ] Derivative Progress: 647/2057 symbols completed. FF took 1.1s. Estimated remaining: 8m 52s. Rate: 159.0 symbols/min [2025-10-21T22:08:16.640979] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-10-21T22:08:16.641090] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:16.661954] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-10-21T22:08:16.662186] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-10-21T22:08:16.664885] [INFO ] [MAIN ] Derivative Progress: 648/2057 symbols completed. FERG took 1.1s. Estimated remaining: 8m 51s. Rate: 159.3 symbols/min [2025-10-21T22:08:16.665103] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:16.687003] [DEBUG] [LOCAL ] FGN: Loaded 3610 existing records from primary storage. [2025-10-21T22:08:16.678631] [DEBUG] [LOCAL ] FFC: Loaded 16617 existing records from primary storage. [2025-10-21T22:08:16.687880] [INFO ] [MAIN ] FFC: Loaded 16617 primary data records. [2025-10-21T22:08:16.687820] [INFO ] [MAIN ] FGN: Loaded 3610 primary data records. [2025-10-21T22:08:16.688276] [DEBUG] [LOCAL ] FG: Loaded 21549 existing records from primary storage. [2025-10-21T22:08:16.719719] [INFO ] [MAIN ] FG: Loaded 21549 primary data records. [2025-10-21T22:08:17.665454] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:17.666207] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 3610 primary records. [2025-10-21T22:08:17.666414] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-10-21T22:08:17.684601] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-10-21T22:08:17.685502] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-10-21T22:08:17.688229] [INFO ] [MAIN ] Derivative Progress: 649/2057 symbols completed. FGN took 1.0s. Estimated remaining: 8m 52s. Rate: 158.9 symbols/min [2025-10-21T22:08:17.700822] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:17.701664] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:17.702507] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16617 primary records. [2025-10-21T22:08:17.710012] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-10-21T22:08:17.722571] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:17.724533] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 21549 primary records. [2025-10-21T22:08:17.728573] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-10-21T22:08:17.731700] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-10-21T22:08:17.732151] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-10-21T22:08:17.734759] [INFO ] [MAIN ] Derivative Progress: 650/2057 symbols completed. FFC took 1.1s. Estimated remaining: 8m 51s. Rate: 159.1 symbols/min [2025-10-21T22:08:17.741870] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:17.751367] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-10-21T22:08:17.751667] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-10-21T22:08:17.754369] [INFO ] [MAIN ] Derivative Progress: 651/2057 symbols completed. FG took 1.1s. Estimated remaining: 8m 50s. Rate: 159.3 symbols/min [2025-10-21T22:08:17.754668] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:17.782615] [DEBUG] [LOCAL ] FHI: Loaded 39612 existing records from primary storage. [2025-10-21T22:08:17.783115] [INFO ] [MAIN ] FHI: Loaded 39612 primary data records. [2025-10-21T22:08:18.008082] [DEBUG] [LOCAL ] FHN: Loaded 53399 existing records from primary storage. [2025-10-21T22:08:18.137923] [INFO ] [MAIN ] FHN: Loaded 53399 primary data records. [2025-10-21T22:08:18.138671] [DEBUG] [LOCAL ] FI: Loaded 53588 existing records from primary storage. [2025-10-21T22:08:18.151449] [INFO ] [MAIN ] FI: Loaded 53588 primary data records. [2025-10-21T22:08:18.763518] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:18.765269] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 39612 primary records. [2025-10-21T22:08:18.765530] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-10-21T22:08:18.785103] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-10-21T22:08:18.785508] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-10-21T22:08:18.788343] [INFO ] [MAIN ] Derivative Progress: 652/2057 symbols completed. FHI took 1.1s. Estimated remaining: 8m 51s. Rate: 158.9 symbols/min [2025-10-21T22:08:18.789040] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:18.807135] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:18.808212] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53399 primary records. [2025-10-21T22:08:18.808632] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-10-21T22:08:18.834874] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-10-21T22:08:18.856404] [DEBUG] [LOCAL ] FICO: Loaded 21911 existing records from primary storage. [2025-10-21T22:08:18.855750] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:18.857392] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-10-21T22:08:18.857321] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53588 primary records. [2025-10-21T22:08:18.860418] [INFO ] [MAIN ] Derivative Progress: 653/2057 symbols completed. FHN took 1.1s. Estimated remaining: 8m 50s. Rate: 159.1 symbols/min [2025-10-21T22:08:18.860624] [INFO ] [MAIN ] FICO: Loaded 21911 primary data records. [2025-10-21T22:08:18.860774] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-10-21T22:08:18.873745] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:19.025425] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-10-21T22:08:19.037076] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-10-21T22:08:19.041703] [INFO ] [MAIN ] Derivative Progress: 654/2057 symbols completed. FI took 1.3s. Estimated remaining: 8m 49s. Rate: 159.2 symbols/min [2025-10-21T22:08:19.067854] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:19.235258] [DEBUG] [LOCAL ] FIGS: Loaded 48559 existing records from primary storage. [2025-10-21T22:08:19.236139] [INFO ] [MAIN ] FIGS: Loaded 48559 primary data records. [2025-10-21T22:08:19.602154] [DEBUG] [LOCAL ] FIHL: Loaded 39140 existing records from primary storage. [2025-10-21T22:08:19.603232] [INFO ] [MAIN ] FIHL: Loaded 39140 primary data records. [2025-10-21T22:08:19.747340] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:19.785669] [INFO ] [MAIN ] FICO: Generated 1793 derivative records from 21911 primary records. [2025-10-21T22:08:19.806127] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-10-21T22:08:19.939624] [DEBUG] [LOCAL ] FICO: Derivative data saved (1793 records). [2025-10-21T22:08:19.940549] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-10-21T22:08:19.943271] [INFO ] [MAIN ] Derivative Progress: 655/2057 symbols completed. FICO took 1.2s. Estimated remaining: 8m 50s. Rate: 158.9 symbols/min [2025-10-21T22:08:19.943958] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:19.962249] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:19.963086] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 48559 primary records. [2025-10-21T22:08:19.965376] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-10-21T22:08:19.978887] [DEBUG] [LOCAL ] FINS: Loaded 8297 existing records from primary storage. [2025-10-21T22:08:19.986005] [INFO ] [MAIN ] FINS: Loaded 8297 primary data records. [2025-10-21T22:08:19.985937] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-10-21T22:08:20.007361] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-10-21T22:08:20.020151] [INFO ] [MAIN ] Derivative Progress: 656/2057 symbols completed. FIGS took 1.1s. Estimated remaining: 8m 49s. Rate: 159.1 symbols/min [2025-10-21T22:08:20.025426] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:20.186874] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:20.298913] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 39140 primary records. [2025-10-21T22:08:20.309137] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-10-21T22:08:20.327177] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-10-21T22:08:20.327963] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-10-21T22:08:20.330671] [INFO ] [MAIN ] Derivative Progress: 657/2057 symbols completed. FIHL took 1.3s. Estimated remaining: 8m 48s. Rate: 159.1 symbols/min [2025-10-21T22:08:20.331189] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:20.346279] [DEBUG] [LOCAL ] FINV: Loaded 45256 existing records from primary storage. [2025-10-21T22:08:20.347476] [INFO ] [MAIN ] FINV: Loaded 45256 primary data records. [2025-10-21T22:08:20.679437] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:20.680868] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8297 primary records. [2025-10-21T22:08:20.681454] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-10-21T22:08:20.713677] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-10-21T22:08:20.713853] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-10-21T22:08:20.716002] [INFO ] [MAIN ] Derivative Progress: 658/2057 symbols completed. FINS took 0.8s. Estimated remaining: 8m 48s. Rate: 159.1 symbols/min [2025-10-21T22:08:20.717567] [DEBUG] [LOCAL ] FIS: Loaded 53326 existing records from primary storage. [2025-10-21T22:08:20.718055] [INFO ] [MAIN ] FIS: Loaded 53326 primary data records. [2025-10-21T22:08:21.021339] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:21.022380] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 45256 primary records. [2025-10-21T22:08:21.022462] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-10-21T22:08:21.038943] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-10-21T22:08:21.039362] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-10-21T22:08:21.042163] [INFO ] [MAIN ] Derivative Progress: 659/2057 symbols completed. FINV took 1.0s. Estimated remaining: 8m 47s. Rate: 159.1 symbols/min [2025-10-21T22:08:21.061610] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:21.062189] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53326 primary records. [2025-10-21T22:08:21.062247] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-10-21T22:08:21.076980] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-10-21T22:08:21.077043] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-10-21T22:08:21.079459] [INFO ] [MAIN ] Derivative Progress: 660/2057 symbols completed. FIS took 0.7s. Estimated remaining: 8m 46s. Rate: 159.3 symbols/min [2025-10-21T22:08:21.080103] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:21.080358] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:21.080755] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:21.091734] [DEBUG] [LOCAL ] FLC: Loaded 5426 existing records from primary storage. [2025-10-21T22:08:21.091961] [INFO ] [MAIN ] FLC: Loaded 5426 primary data records. [2025-10-21T22:08:21.262769] [DEBUG] [LOCAL ] FIX: Loaded 28480 existing records from primary storage. [2025-10-21T22:08:21.296228] [INFO ] [MAIN ] FIX: Loaded 28480 primary data records. [2025-10-21T22:08:21.557213] [DEBUG] [LOCAL ] FLG: Loaded 53319 existing records from primary storage. [2025-10-21T22:08:21.575737] [INFO ] [MAIN ] FLG: Loaded 53319 primary data records. [2025-10-21T22:08:22.088254] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:22.090525] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5426 primary records. [2025-10-21T22:08:22.091010] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-10-21T22:08:22.107915] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-10-21T22:08:22.108224] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-10-21T22:08:22.112599] [INFO ] [MAIN ] Derivative Progress: 661/2057 symbols completed. FLC took 1.0s. Estimated remaining: 8m 47s. Rate: 158.9 symbols/min [2025-10-21T22:08:22.114236] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:22.130991] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:22.133219] [INFO ] [MAIN ] FIX: Generated 1793 derivative records from 28480 primary records. [2025-10-21T22:08:22.133477] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-10-21T22:08:22.147582] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:22.159676] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53319 primary records. [2025-10-21T22:08:22.163238] [DEBUG] [LOCAL ] FIX: Derivative data saved (1793 records). [2025-10-21T22:08:22.160386] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-10-21T22:08:22.163370] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-10-21T22:08:22.166037] [INFO ] [MAIN ] Derivative Progress: 662/2057 symbols completed. FIX took 1.1s. Estimated remaining: 8m 46s. Rate: 159.1 symbols/min [2025-10-21T22:08:22.166949] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:22.191905] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-10-21T22:08:22.192158] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-10-21T22:08:22.195138] [INFO ] [MAIN ] Derivative Progress: 663/2057 symbols completed. FLG took 1.1s. Estimated remaining: 8m 45s. Rate: 159.3 symbols/min [2025-10-21T22:08:22.195392] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:22.209283] [DEBUG] [LOCAL ] FLNG: Loaded 33491 existing records from primary storage. [2025-10-21T22:08:22.209477] [INFO ] [MAIN ] FLNG: Loaded 33491 primary data records. [2025-10-21T22:08:22.546245] [DEBUG] [LOCAL ] FLO: Loaded 52075 existing records from primary storage. [2025-10-21T22:08:22.546543] [INFO ] [MAIN ] FLO: Loaded 52075 primary data records. [2025-10-21T22:08:22.658146] [DEBUG] [LOCAL ] FLR: Loaded 53260 existing records from primary storage. [2025-10-21T22:08:22.665969] [INFO ] [MAIN ] FLR: Loaded 53260 primary data records. [2025-10-21T22:08:23.186033] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:23.187063] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 33491 primary records. [2025-10-21T22:08:23.187705] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-10-21T22:08:23.205897] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-10-21T22:08:23.206127] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-10-21T22:08:23.208836] [INFO ] [MAIN ] Derivative Progress: 664/2057 symbols completed. FLNG took 1.1s. Estimated remaining: 8m 46s. Rate: 158.9 symbols/min [2025-10-21T22:08:23.209291] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:23.233235] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:23.235484] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 52075 primary records. [2025-10-21T22:08:23.236733] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-10-21T22:08:23.258264] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:23.265665] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53260 primary records. [2025-10-21T22:08:23.266887] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-10-21T22:08:23.266750] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-10-21T22:08:23.267771] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-10-21T22:08:23.269784] [INFO ] [MAIN ] Derivative Progress: 665/2057 symbols completed. FLO took 1.1s. Estimated remaining: 8m 45s. Rate: 159.1 symbols/min [2025-10-21T22:08:23.269920] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:23.295940] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-10-21T22:08:23.296170] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-10-21T22:08:23.298721] [INFO ] [MAIN ] Derivative Progress: 666/2057 symbols completed. FLR took 1.1s. Estimated remaining: 8m 44s. Rate: 159.4 symbols/min [2025-10-21T22:08:23.299632] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:23.315667] [DEBUG] [LOCAL ] FLS: Loaded 50413 existing records from primary storage. [2025-10-21T22:08:23.315931] [INFO ] [MAIN ] FLS: Loaded 50413 primary data records. [2025-10-21T22:08:23.697165] [DEBUG] [LOCAL ] FLUT: Loaded 50684 existing records from primary storage. [2025-10-21T22:08:23.698169] [INFO ] [MAIN ] FLUT: Loaded 50684 primary data records. [2025-10-21T22:08:23.698957] [DEBUG] [LOCAL ] FMC: Loaded 51887 existing records from primary storage. [2025-10-21T22:08:23.699441] [INFO ] [MAIN ] FMC: Loaded 51887 primary data records. [2025-10-21T22:08:24.330589] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:24.332853] [INFO ] [MAIN ] FLS: Generated 1793 derivative records from 50413 primary records. [2025-10-21T22:08:24.333268] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-10-21T22:08:24.350823] [DEBUG] [LOCAL ] FLS: Derivative data saved (1793 records). [2025-10-21T22:08:24.351607] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-10-21T22:08:24.353980] [INFO ] [MAIN ] Derivative Progress: 667/2057 symbols completed. FLS took 1.1s. Estimated remaining: 8m 45s. Rate: 158.9 symbols/min [2025-10-21T22:08:24.354255] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:24.382543] [DEBUG] [LOCAL ] FMN: Loaded 5499 existing records from primary storage. [2025-10-21T22:08:24.382958] [INFO ] [MAIN ] FMN: Loaded 5499 primary data records. [2025-10-21T22:08:24.394391] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:24.411786] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51887 primary records. [2025-10-21T22:08:24.431252] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-10-21T22:08:24.439012] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:24.509596] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 50684 primary records. [2025-10-21T22:08:24.522044] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-10-21T22:08:24.515740] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-10-21T22:08:24.527270] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-10-21T22:08:24.545752] [INFO ] [MAIN ] Derivative Progress: 668/2057 symbols completed. FMC took 1.2s. Estimated remaining: 8m 44s. Rate: 159.1 symbols/min [2025-10-21T22:08:24.596460] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:24.732205] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-10-21T22:08:24.732502] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-10-21T22:08:24.735057] [INFO ] [MAIN ] Derivative Progress: 669/2057 symbols completed. FLUT took 1.5s. Estimated remaining: 8m 43s. Rate: 159.2 symbols/min [2025-10-21T22:08:24.735251] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:24.766759] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:24.768119] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 5499 primary records. [2025-10-21T22:08:24.768208] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-10-21T22:08:24.788829] [DEBUG] [LOCAL ] FMS: Loaded 30427 existing records from primary storage. [2025-10-21T22:08:24.792166] [INFO ] [MAIN ] FMS: Loaded 30427 primary data records. [2025-10-21T22:08:24.792846] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-10-21T22:08:24.800906] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-10-21T22:08:24.846143] [INFO ] [MAIN ] Derivative Progress: 670/2057 symbols completed. FMN took 0.5s. Estimated remaining: 8m 42s. Rate: 159.3 symbols/min [2025-10-21T22:08:24.889419] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:24.940970] [DEBUG] [LOCAL ] FMX: Loaded 40553 existing records from primary storage. [2025-10-21T22:08:24.967793] [INFO ] [MAIN ] FMX: Loaded 40553 primary data records. [2025-10-21T22:08:25.096229] [DEBUG] [LOCAL ] FMY: Loaded 1377 existing records from primary storage. [2025-10-21T22:08:25.109376] [INFO ] [MAIN ] FMY: Loaded 1377 primary data records. [2025-10-21T22:08:25.753976] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:25.754833] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30427 primary records. [2025-10-21T22:08:25.754929] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-10-21T22:08:25.772877] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-10-21T22:08:25.773004] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-10-21T22:08:25.775476] [INFO ] [MAIN ] Derivative Progress: 671/2057 symbols completed. FMS took 1.2s. Estimated remaining: 8m 43s. Rate: 159.0 symbols/min [2025-10-21T22:08:25.775742] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:25.807936] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:25.808405] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:25.809178] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1377 primary records. [2025-10-21T22:08:25.809772] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40553 primary records. [2025-10-21T22:08:25.809961] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-10-21T22:08:25.809837] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-10-21T22:08:25.842682] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-10-21T22:08:25.846299] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-10-21T22:08:25.846407] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-10-21T22:08:25.848949] [INFO ] [MAIN ] Derivative Progress: 672/2057 symbols completed. FMX took 1.1s. Estimated remaining: 8m 42s. Rate: 159.2 symbols/min [2025-10-21T22:08:25.846526] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-10-21T22:08:25.849142] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:25.851462] [INFO ] [MAIN ] Derivative Progress: 673/2057 symbols completed. FMY took 1.0s. Estimated remaining: 8m 41s. Rate: 159.4 symbols/min [2025-10-21T22:08:25.864737] [DEBUG] [LOCAL ] FN: Loaded 37491 existing records from primary storage. [2025-10-21T22:08:25.864886] [INFO ] [MAIN ] FN: Loaded 37491 primary data records. [2025-10-21T22:08:26.195332] [DEBUG] [LOCAL ] FNB: Loaded 52603 existing records from primary storage. [2025-10-21T22:08:26.196269] [INFO ] [MAIN ] FNB: Loaded 52603 primary data records. [2025-10-21T22:08:26.543493] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:26.544718] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 37491 primary records. [2025-10-21T22:08:26.544857] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-10-21T22:08:26.566596] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-10-21T22:08:26.566763] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-10-21T22:08:26.568878] [INFO ] [MAIN ] Derivative Progress: 674/2057 symbols completed. FN took 0.8s. Estimated remaining: 8m 41s. Rate: 159.2 symbols/min [2025-10-21T22:08:26.588906] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:26.589626] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52603 primary records. [2025-10-21T22:08:26.589717] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-10-21T22:08:26.608867] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-10-21T22:08:26.608940] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-10-21T22:08:26.611299] [INFO ] [MAIN ] Derivative Progress: 675/2057 symbols completed. FNB took 0.8s. Estimated remaining: 8m 40s. Rate: 159.4 symbols/min [2025-10-21T22:08:26.612062] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:26.611983] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:26.612598] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:26.692380] [DEBUG] [LOCAL ] FNF: Loaded 48759 existing records from primary storage. [2025-10-21T22:08:26.692596] [INFO ] [MAIN ] FNF: Loaded 48759 primary data records. [2025-10-21T22:08:26.693542] [DEBUG] [LOCAL ] FNV: Loaded 46145 existing records from primary storage. [2025-10-21T22:08:26.693881] [INFO ] [MAIN ] FNV: Loaded 46145 primary data records. [2025-10-21T22:08:26.860967] [DEBUG] [LOCAL ] FND: Loaded 52080 existing records from primary storage. [2025-10-21T22:08:26.891627] [INFO ] [MAIN ] FND: Loaded 52080 primary data records. [2025-10-21T22:08:27.719044] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:27.725009] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46145 primary records. [2025-10-21T22:08:27.725150] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-10-21T22:08:27.724325] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:27.726202] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 48759 primary records. [2025-10-21T22:08:27.727554] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-10-21T22:08:27.744618] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-10-21T22:08:27.751754] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-10-21T22:08:27.774035] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-10-21T22:08:27.766955] [INFO ] [MAIN ] Derivative Progress: 676/2057 symbols completed. FNV took 1.2s. Estimated remaining: 8m 41s. Rate: 158.9 symbols/min [2025-10-21T22:08:27.774536] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:27.775413] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52080 primary records. [2025-10-21T22:08:27.774263] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-10-21T22:08:27.775676] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-10-21T22:08:27.778461] [INFO ] [MAIN ] Derivative Progress: 677/2057 symbols completed. FNF took 1.2s. Estimated remaining: 8m 40s. Rate: 159.2 symbols/min [2025-10-21T22:08:27.774763] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:27.779044] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:27.795264] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-10-21T22:08:27.797224] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-10-21T22:08:27.799688] [INFO ] [MAIN ] Derivative Progress: 678/2057 symbols completed. FND took 1.2s. Estimated remaining: 8m 39s. Rate: 159.4 symbols/min [2025-10-21T22:08:27.799865] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:27.809097] [DEBUG] [LOCAL ] FOF: Loaded 8614 existing records from primary storage. [2025-10-21T22:08:27.809241] [INFO ] [MAIN ] FOF: Loaded 8614 primary data records. [2025-10-21T22:08:27.863342] [DEBUG] [LOCAL ] FOA: Loaded 13051 existing records from primary storage. [2025-10-21T22:08:27.891383] [INFO ] [MAIN ] FOA: Loaded 13051 primary data records. [2025-10-21T22:08:28.024007] [DEBUG] [LOCAL ] FOR: Loaded 19646 existing records from primary storage. [2025-10-21T22:08:28.058002] [INFO ] [MAIN ] FOR: Loaded 19646 primary data records. [2025-10-21T22:08:28.767259] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:28.768437] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8614 primary records. [2025-10-21T22:08:28.768530] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-10-21T22:08:28.782313] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:28.783419] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13051 primary records. [2025-10-21T22:08:28.783814] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-10-21T22:08:28.807827] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-10-21T22:08:28.808751] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-10-21T22:08:28.817709] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-10-21T22:08:28.819717] [INFO ] [MAIN ] Derivative Progress: 679/2057 symbols completed. FOF took 1.0s. Estimated remaining: 8m 40s. Rate: 159.0 symbols/min [2025-10-21T22:08:28.819880] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-10-21T22:08:28.820064] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:28.822727] [INFO ] [MAIN ] Derivative Progress: 680/2057 symbols completed. FOA took 1.0s. Estimated remaining: 8m 39s. Rate: 159.2 symbols/min [2025-10-21T22:08:28.823109] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:28.838445] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:28.839318] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 19646 primary records. [2025-10-21T22:08:28.839510] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-10-21T22:08:28.862286] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-10-21T22:08:28.862562] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-10-21T22:08:28.865333] [INFO ] [MAIN ] Derivative Progress: 681/2057 symbols completed. FOR took 1.1s. Estimated remaining: 8m 38s. Rate: 159.4 symbols/min [2025-10-21T22:08:28.865509] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:28.874503] [DEBUG] [LOCAL ] FPF: Loaded 18753 existing records from primary storage. [2025-10-21T22:08:28.874841] [INFO ] [MAIN ] FPF: Loaded 18753 primary data records. [2025-10-21T22:08:29.009528] [DEBUG] [LOCAL ] FPH: Loaded 19222 existing records from primary storage. [2025-10-21T22:08:29.020616] [INFO ] [MAIN ] FPH: Loaded 19222 primary data records. [2025-10-21T22:08:29.164921] [DEBUG] [LOCAL ] FOUR: Loaded 49722 existing records from primary storage. [2025-10-21T22:08:29.179596] [INFO ] [MAIN ] FOUR: Loaded 49722 primary data records. [2025-10-21T22:08:29.908889] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:29.909875] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 18753 primary records. [2025-10-21T22:08:29.910167] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-10-21T22:08:29.928834] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-10-21T22:08:29.929059] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-10-21T22:08:29.930969] [INFO ] [MAIN ] Derivative Progress: 682/2057 symbols completed. FPF took 1.1s. Estimated remaining: 8m 39s. Rate: 159.0 symbols/min [2025-10-21T22:08:29.939011] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:29.944711] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:29.946604] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19222 primary records. [2025-10-21T22:08:29.946849] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-10-21T22:08:29.966114] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-10-21T22:08:29.966296] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-10-21T22:08:29.968945] [INFO ] [MAIN ] Derivative Progress: 683/2057 symbols completed. FPH took 1.1s. Estimated remaining: 8m 38s. Rate: 159.2 symbols/min [2025-10-21T22:08:29.969115] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:29.991513] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:29.992315] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49722 primary records. [2025-10-21T22:08:29.992435] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-10-21T22:08:30.009710] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-10-21T22:08:30.010722] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-10-21T22:08:30.013162] [INFO ] [MAIN ] Derivative Progress: 684/2057 symbols completed. FOUR took 1.2s. Estimated remaining: 8m 37s. Rate: 159.4 symbols/min [2025-10-21T22:08:30.013537] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:30.025300] [DEBUG] [LOCAL ] FPI: Loaded 31413 existing records from primary storage. [2025-10-21T22:08:30.025494] [INFO ] [MAIN ] FPI: Loaded 31413 primary data records. [2025-10-21T22:08:30.165196] [DEBUG] [LOCAL ] FRA: Loaded 14225 existing records from primary storage. [2025-10-21T22:08:30.167019] [INFO ] [MAIN ] FRA: Loaded 14225 primary data records. [2025-10-21T22:08:30.221300] [DEBUG] [LOCAL ] FR: Loaded 46672 existing records from primary storage. [2025-10-21T22:08:30.307728] [INFO ] [MAIN ] FR: Loaded 46672 primary data records. [2025-10-21T22:08:31.061904] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:31.063057] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31413 primary records. [2025-10-21T22:08:31.063522] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-10-21T22:08:31.082005] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-10-21T22:08:31.083176] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-10-21T22:08:31.085231] [INFO ] [MAIN ] Derivative Progress: 685/2057 symbols completed. FPI took 1.1s. Estimated remaining: 8m 38s. Rate: 159.0 symbols/min [2025-10-21T22:08:31.087110] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:31.110603] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:31.117066] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46672 primary records. [2025-10-21T22:08:31.117165] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-10-21T22:08:31.116320] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:31.118876] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14225 primary records. [2025-10-21T22:08:31.119172] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-10-21T22:08:31.138731] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-10-21T22:08:31.139118] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-10-21T22:08:31.150192] [INFO ] [MAIN ] Derivative Progress: 686/2057 symbols completed. FR took 1.2s. Estimated remaining: 8m 37s. Rate: 159.2 symbols/min [2025-10-21T22:08:31.154480] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:31.159036] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-10-21T22:08:31.159575] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-10-21T22:08:31.162748] [INFO ] [MAIN ] Derivative Progress: 687/2057 symbols completed. FRA took 1.1s. Estimated remaining: 8m 36s. Rate: 159.4 symbols/min [2025-10-21T22:08:31.169158] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:31.169704] [DEBUG] [LOCAL ] FRGE: Loaded 15653 existing records from primary storage. [2025-10-21T22:08:31.170721] [INFO ] [MAIN ] FRGE: Loaded 15653 primary data records. [2025-10-21T22:08:31.539911] [DEBUG] [LOCAL ] FRT: Loaded 41559 existing records from primary storage. [2025-10-21T22:08:31.540488] [INFO ] [MAIN ] FRT: Loaded 41559 primary data records. [2025-10-21T22:08:31.660435] [DEBUG] [LOCAL ] FRO: Loaded 51688 existing records from primary storage. [2025-10-21T22:08:31.661182] [INFO ] [MAIN ] FRO: Loaded 51688 primary data records. [2025-10-21T22:08:32.068597] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:32.183427] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 15653 primary records. [2025-10-21T22:08:32.183818] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-10-21T22:08:32.210217] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-10-21T22:08:32.211056] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-10-21T22:08:32.213985] [INFO ] [MAIN ] Derivative Progress: 688/2057 symbols completed. FRGE took 1.1s. Estimated remaining: 8m 37s. Rate: 159.0 symbols/min [2025-10-21T22:08:32.239664] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:32.240523] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 41559 primary records. [2025-10-21T22:08:32.240702] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-10-21T22:08:32.254388] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:32.255848] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51688 primary records. [2025-10-21T22:08:32.263027] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-10-21T22:08:32.271234] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-10-21T22:08:32.271531] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-10-21T22:08:32.273617] [INFO ] [MAIN ] Derivative Progress: 689/2057 symbols completed. FRT took 1.1s. Estimated remaining: 8m 36s. Rate: 159.2 symbols/min [2025-10-21T22:08:32.288677] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-10-21T22:08:32.288763] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-10-21T22:08:32.291437] [INFO ] [MAIN ] Derivative Progress: 690/2057 symbols completed. FRO took 1.1s. Estimated remaining: 8m 35s. Rate: 159.4 symbols/min [2025-10-21T22:08:32.291994] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:32.291899] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:32.292057] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:32.357081] [DEBUG] [LOCAL ] FSCO: Loaded 38651 existing records from primary storage. [2025-10-21T22:08:32.357419] [INFO ] [MAIN ] FSCO: Loaded 38651 primary data records. [2025-10-21T22:08:32.479799] [DEBUG] [LOCAL ] FSK: Loaded 49498 existing records from primary storage. [2025-10-21T22:08:32.491431] [INFO ] [MAIN ] FSK: Loaded 49498 primary data records. [2025-10-21T22:08:32.491317] [DEBUG] [LOCAL ] FSLY: Loaded 51318 existing records from primary storage. [2025-10-21T22:08:32.491765] [INFO ] [MAIN ] FSLY: Loaded 51318 primary data records. [2025-10-21T22:08:33.366430] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:33.369765] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 38651 primary records. [2025-10-21T22:08:33.370175] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-10-21T22:08:33.398274] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:33.399929] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51318 primary records. [2025-10-21T22:08:33.404378] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-10-21T22:08:33.404592] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-10-21T22:08:33.404713] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-10-21T22:08:33.406905] [INFO ] [MAIN ] Derivative Progress: 691/2057 symbols completed. FSCO took 1.1s. Estimated remaining: 8m 36s. Rate: 158.9 symbols/min [2025-10-21T22:08:33.420618] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:33.421009] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:33.430543] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49498 primary records. [2025-10-21T22:08:33.437452] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-10-21T22:08:33.437775] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-10-21T22:08:33.437698] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-10-21T22:08:33.441058] [INFO ] [MAIN ] Derivative Progress: 692/2057 symbols completed. FSLY took 1.1s. Estimated remaining: 8m 35s. Rate: 159.1 symbols/min [2025-10-21T22:08:33.441442] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:33.459535] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-10-21T22:08:33.459731] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-10-21T22:08:33.462411] [INFO ] [MAIN ] Derivative Progress: 693/2057 symbols completed. FSK took 1.2s. Estimated remaining: 8m 34s. Rate: 159.4 symbols/min [2025-10-21T22:08:33.462671] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:33.472686] [DEBUG] [LOCAL ] FT: Loaded 6765 existing records from primary storage. [2025-10-21T22:08:33.472909] [INFO ] [MAIN ] FT: Loaded 6765 primary data records. [2025-10-21T22:08:33.606616] [DEBUG] [LOCAL ] FSS: Loaded 33326 existing records from primary storage. [2025-10-21T22:08:33.612751] [INFO ] [MAIN ] FSS: Loaded 33326 primary data records. [2025-10-21T22:08:33.918611] [DEBUG] [LOCAL ] FSM: Loaded 53303 existing records from primary storage. [2025-10-21T22:08:33.930969] [INFO ] [MAIN ] FSM: Loaded 53303 primary data records. [2025-10-21T22:08:34.476699] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:34.478927] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6765 primary records. [2025-10-21T22:08:34.479090] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-10-21T22:08:34.496610] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-10-21T22:08:34.496808] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-10-21T22:08:34.499037] [INFO ] [MAIN ] Derivative Progress: 694/2057 symbols completed. FT took 1.0s. Estimated remaining: 8m 34s. Rate: 159.0 symbols/min [2025-10-21T22:08:34.499338] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:34.514919] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:34.516606] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 33326 primary records. [2025-10-21T22:08:34.516900] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-10-21T22:08:34.531002] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:34.540465] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53303 primary records. [2025-10-21T22:08:34.546457] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-10-21T22:08:34.551457] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-10-21T22:08:34.551683] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-10-21T22:08:34.560721] [INFO ] [MAIN ] Derivative Progress: 695/2057 symbols completed. FSS took 1.1s. Estimated remaining: 8m 33s. Rate: 159.2 symbols/min [2025-10-21T22:08:34.564869] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:34.574193] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-10-21T22:08:34.574602] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-10-21T22:08:34.578173] [DEBUG] [LOCAL ] FTHY: Loaded 12518 existing records from primary storage. [2025-10-21T22:08:34.577333] [INFO ] [MAIN ] Derivative Progress: 696/2057 symbols completed. FSM took 1.2s. Estimated remaining: 8m 32s. Rate: 159.4 symbols/min [2025-10-21T22:08:34.578503] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:34.579024] [INFO ] [MAIN ] FTHY: Loaded 12518 primary data records. [2025-10-21T22:08:34.915266] [DEBUG] [LOCAL ] FTK: Loaded 32948 existing records from primary storage. [2025-10-21T22:08:34.915552] [INFO ] [MAIN ] FTK: Loaded 32948 primary data records. [2025-10-21T22:08:35.065768] [DEBUG] [LOCAL ] FTI: Loaded 53293 existing records from primary storage. [2025-10-21T22:08:35.072407] [INFO ] [MAIN ] FTI: Loaded 53293 primary data records. [2025-10-21T22:08:35.604969] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:35.605934] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 12518 primary records. [2025-10-21T22:08:35.606156] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-10-21T22:08:35.623369] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-10-21T22:08:35.623751] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-10-21T22:08:35.625919] [INFO ] [MAIN ] Derivative Progress: 697/2057 symbols completed. FTHY took 1.1s. Estimated remaining: 8m 33s. Rate: 159.0 symbols/min [2025-10-21T22:08:35.626446] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:35.645728] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:35.646451] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 32948 primary records. [2025-10-21T22:08:35.646733] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-10-21T22:08:35.664280] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-10-21T22:08:35.664415] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-10-21T22:08:35.666460] [INFO ] [MAIN ] Derivative Progress: 698/2057 symbols completed. FTK took 1.1s. Estimated remaining: 8m 32s. Rate: 159.2 symbols/min [2025-10-21T22:08:35.666750] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:35.693375] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:35.694058] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53293 primary records. [2025-10-21T22:08:35.694188] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-10-21T22:08:35.723503] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-10-21T22:08:35.723679] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-10-21T22:08:35.726419] [INFO ] [MAIN ] Derivative Progress: 699/2057 symbols completed. FTI took 1.2s. Estimated remaining: 8m 31s. Rate: 159.4 symbols/min [2025-10-21T22:08:35.728001] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:35.727841] [DEBUG] [LOCAL ] FTS: Loaded 42523 existing records from primary storage. [2025-10-21T22:08:35.728710] [INFO ] [MAIN ] FTS: Loaded 42523 primary data records. [2025-10-21T22:08:35.826984] [DEBUG] [LOCAL ] FTWO: Loaded 1964 existing records from primary storage. [2025-10-21T22:08:35.838822] [INFO ] [MAIN ] FTWO: Loaded 1964 primary data records. [2025-10-21T22:08:35.996373] [DEBUG] [LOCAL ] FTV: Loaded 53034 existing records from primary storage. [2025-10-21T22:08:36.031312] [INFO ] [MAIN ] FTV: Loaded 53034 primary data records. [2025-10-21T22:08:36.701833] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:36.714636] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1964 primary records. [2025-10-21T22:08:36.714981] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-10-21T22:08:36.715144] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:36.716106] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42523 primary records. [2025-10-21T22:08:36.716283] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-10-21T22:08:36.745809] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-10-21T22:08:36.746848] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-10-21T22:08:36.747573] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-10-21T22:08:36.749980] [INFO ] [MAIN ] Derivative Progress: 700/2057 symbols completed. FTS took 1.1s. Estimated remaining: 8m 32s. Rate: 159.0 symbols/min [2025-10-21T22:08:36.750306] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-10-21T22:08:36.750245] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:36.752553] [INFO ] [MAIN ] Derivative Progress: 701/2057 symbols completed. FTWO took 1.0s. Estimated remaining: 8m 31s. Rate: 159.2 symbols/min [2025-10-21T22:08:36.765495] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:36.766104] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:36.767091] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 53034 primary records. [2025-10-21T22:08:36.767157] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-10-21T22:08:36.784357] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-10-21T22:08:36.784494] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-10-21T22:08:36.787301] [INFO ] [MAIN ] Derivative Progress: 702/2057 symbols completed. FTV took 1.1s. Estimated remaining: 8m 30s. Rate: 159.4 symbols/min [2025-10-21T22:08:36.787546] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:36.828567] [DEBUG] [LOCAL ] FUL: Loaded 31998 existing records from primary storage. [2025-10-21T22:08:36.828912] [INFO ] [MAIN ] FUL: Loaded 31998 primary data records. [2025-10-21T22:08:36.980405] [DEBUG] [LOCAL ] FUBO: Loaded 53718 existing records from primary storage. [2025-10-21T22:08:36.985926] [INFO ] [MAIN ] FUBO: Loaded 53718 primary data records. [2025-10-21T22:08:37.007775] [DEBUG] [LOCAL ] FUN: Loaded 52023 existing records from primary storage. [2025-10-21T22:08:37.089785] [INFO ] [MAIN ] FUN: Loaded 52023 primary data records. [2025-10-21T22:08:37.851091] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:37.852749] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 31998 primary records. [2025-10-21T22:08:37.853023] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-10-21T22:08:37.871076] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-10-21T22:08:37.871495] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-10-21T22:08:37.873399] [INFO ] [MAIN ] Derivative Progress: 703/2057 symbols completed. FUL took 1.1s. Estimated remaining: 8m 31s. Rate: 159.0 symbols/min [2025-10-21T22:08:37.886208] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:37.886849] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53718 primary records. [2025-10-21T22:08:37.886990] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-10-21T22:08:37.903928] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-10-21T22:08:37.904714] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-10-21T22:08:37.907253] [INFO ] [MAIN ] Derivative Progress: 704/2057 symbols completed. FUBO took 1.2s. Estimated remaining: 8m 30s. Rate: 159.2 symbols/min [2025-10-21T22:08:37.919935] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:37.920484] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 52023 primary records. [2025-10-21T22:08:37.920545] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-10-21T22:08:37.935613] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-10-21T22:08:37.935699] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-10-21T22:08:37.938462] [INFO ] [MAIN ] Derivative Progress: 705/2057 symbols completed. FUN took 1.2s. Estimated remaining: 8m 29s. Rate: 159.4 symbols/min [2025-10-21T22:08:37.938844] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:37.938940] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:37.939216] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:37.943045] [DEBUG] [LOCAL ] FXED: Loaded 1238 existing records from primary storage. [2025-10-21T22:08:37.943336] [INFO ] [MAIN ] FXED: Loaded 1238 primary data records. [2025-10-21T22:08:38.093251] [DEBUG] [LOCAL ] FVR: Loaded 20869 existing records from primary storage. [2025-10-21T22:08:38.120343] [INFO ] [MAIN ] FVR: Loaded 20869 primary data records. [2025-10-21T22:08:38.365570] [DEBUG] [LOCAL ] FVRR: Loaded 40625 existing records from primary storage. [2025-10-21T22:08:38.384749] [INFO ] [MAIN ] FVRR: Loaded 40625 primary data records. [2025-10-21T22:08:38.903807] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:38.905160] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1238 primary records. [2025-10-21T22:08:38.905388] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-10-21T22:08:38.921674] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-10-21T22:08:38.922409] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-10-21T22:08:38.924467] [INFO ] [MAIN ] Derivative Progress: 706/2057 symbols completed. FXED took 1.0s. Estimated remaining: 8m 30s. Rate: 159.0 symbols/min [2025-10-21T22:08:38.924859] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:38.939042] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:38.939942] [INFO ] [MAIN ] FVR: Generated 1794 derivative records from 20869 primary records. [2025-10-21T22:08:38.940221] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-10-21T22:08:38.958816] [DEBUG] [LOCAL ] FVR: Derivative data saved (1794 records). [2025-10-21T22:08:38.959159] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-10-21T22:08:38.961346] [INFO ] [MAIN ] Derivative Progress: 707/2057 symbols completed. FVR took 1.0s. Estimated remaining: 8m 29s. Rate: 159.2 symbols/min [2025-10-21T22:08:38.974585] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:38.974971] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:38.976043] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40625 primary records. [2025-10-21T22:08:38.976227] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-10-21T22:08:38.992121] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-10-21T22:08:38.992198] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-10-21T22:08:38.995016] [INFO ] [MAIN ] Derivative Progress: 708/2057 symbols completed. FVRR took 1.1s. Estimated remaining: 8m 28s. Rate: 159.4 symbols/min [2025-10-21T22:08:38.995426] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:39.017382] [DEBUG] [LOCAL ] GAM: Loaded 3873 existing records from primary storage. [2025-10-21T22:08:39.017514] [INFO ] [MAIN ] GAM: Loaded 3873 primary data records. [2025-10-21T22:08:39.157610] [DEBUG] [LOCAL ] G: Loaded 50109 existing records from primary storage. [2025-10-21T22:08:39.158477] [DEBUG] [LOCAL ] GAB: Loaded 27631 existing records from primary storage. [2025-10-21T22:08:39.168902] [INFO ] [MAIN ] G: Loaded 50109 primary data records. [2025-10-21T22:08:39.179241] [INFO ] [MAIN ] GAB: Loaded 27631 primary data records. [2025-10-21T22:08:40.012490] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:40.013740] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 3873 primary records. [2025-10-21T22:08:40.014206] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-10-21T22:08:40.035577] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-10-21T22:08:40.036910] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-10-21T22:08:40.038984] [INFO ] [MAIN ] Derivative Progress: 709/2057 symbols completed. GAM took 1.0s. Estimated remaining: 8m 29s. Rate: 159.0 symbols/min [2025-10-21T22:08:40.051607] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:40.059891] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:40.065292] [INFO ] [MAIN ] G: Generated 1794 derivative records from 50109 primary records. [2025-10-21T22:08:40.065756] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:40.065490] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-10-21T22:08:40.067528] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27631 primary records. [2025-10-21T22:08:40.067847] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-10-21T22:08:40.093764] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-10-21T22:08:40.097079] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-10-21T22:08:40.098089] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-10-21T22:08:40.098187] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-10-21T22:08:40.101100] [INFO ] [MAIN ] Derivative Progress: 710/2057 symbols completed. GAB took 1.1s. Estimated remaining: 8m 28s. Rate: 159.2 symbols/min [2025-10-21T22:08:40.103342] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:40.103445] [INFO ] [MAIN ] Derivative Progress: 711/2057 symbols completed. G took 1.2s. Estimated remaining: 8m 27s. Rate: 159.4 symbols/min [2025-10-21T22:08:40.103925] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:40.124522] [DEBUG] [LOCAL ] GBAB: Loaded 12766 existing records from primary storage. [2025-10-21T22:08:40.137082] [INFO ] [MAIN ] GBAB: Loaded 12766 primary data records. [2025-10-21T22:08:40.216041] [DEBUG] [LOCAL ] GATX: Loaded 18144 existing records from primary storage. [2025-10-21T22:08:40.235782] [INFO ] [MAIN ] GATX: Loaded 18144 primary data records. [2025-10-21T22:08:40.351581] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-21T22:08:40.394088] [INFO ] [MAIN ] GAP: Loaded 53653 primary data records. [2025-10-21T22:08:41.200983] [DEBUG] [MAIN ] GBAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:41.207632] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 12766 primary records. [2025-10-21T22:08:41.206619] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:41.208795] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 18144 primary records. [2025-10-21T22:08:41.209810] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-10-21T22:08:41.210681] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-10-21T22:08:41.249075] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:41.248740] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-10-21T22:08:41.253967] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53653 primary records. [2025-10-21T22:08:41.258377] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-10-21T22:08:41.258521] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-10-21T22:08:41.258226] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-10-21T22:08:41.260848] [INFO ] [MAIN ] Derivative Progress: 712/2057 symbols completed. GATX took 1.2s. Estimated remaining: 8m 28s. Rate: 159.0 symbols/min [2025-10-21T22:08:41.261239] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-10-21T22:08:41.263569] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:41.263823] [INFO ] [MAIN ] Derivative Progress: 713/2057 symbols completed. GBAB took 1.2s. Estimated remaining: 8m 27s. Rate: 159.2 symbols/min [2025-10-21T22:08:41.264608] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:41.281087] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-10-21T22:08:41.281289] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-10-21T22:08:41.284159] [INFO ] [MAIN ] Derivative Progress: 714/2057 symbols completed. GAP took 1.2s. Estimated remaining: 8m 25s. Rate: 159.4 symbols/min [2025-10-21T22:08:41.284353] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:41.342566] [DEBUG] [LOCAL ] GBTG: Loaded 40249 existing records from primary storage. [2025-10-21T22:08:41.343469] [DEBUG] [LOCAL ] GBCI: Loaded 41232 existing records from primary storage. [2025-10-21T22:08:41.344738] [INFO ] [MAIN ] GBCI: Loaded 41232 primary data records. [2025-10-21T22:08:41.344686] [INFO ] [MAIN ] GBTG: Loaded 40249 primary data records. [2025-10-21T22:08:41.413522] [DEBUG] [LOCAL ] GBX: Loaded 28402 existing records from primary storage. [2025-10-21T22:08:41.424423] [INFO ] [MAIN ] GBX: Loaded 28402 primary data records. [2025-10-21T22:08:42.293055] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:42.293964] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40249 primary records. [2025-10-21T22:08:42.294273] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-10-21T22:08:42.330635] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:42.333946] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-10-21T22:08:42.334721] [INFO ] [MAIN ] GBCI: Generated 1793 derivative records from 41232 primary records. [2025-10-21T22:08:42.336269] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-10-21T22:08:42.338505] [INFO ] [MAIN ] Derivative Progress: 715/2057 symbols completed. GBTG took 1.1s. Estimated remaining: 8m 26s. Rate: 159.0 symbols/min [2025-10-21T22:08:42.338780] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:42.346506] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-10-21T22:08:42.360134] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:42.361282] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 28402 primary records. [2025-10-21T22:08:42.362848] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-10-21T22:08:42.383721] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1793 records). [2025-10-21T22:08:42.386189] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-10-21T22:08:42.386029] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-10-21T22:08:42.389122] [INFO ] [MAIN ] Derivative Progress: 716/2057 symbols completed. GBCI took 1.1s. Estimated remaining: 8m 25s. Rate: 159.2 symbols/min [2025-10-21T22:08:42.389250] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-10-21T22:08:42.392182] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:42.392391] [INFO ] [MAIN ] Derivative Progress: 717/2057 symbols completed. GBX took 1.1s. Estimated remaining: 8m 24s. Rate: 159.4 symbols/min [2025-10-21T22:08:42.393083] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:42.430070] [DEBUG] [LOCAL ] GCI: Loaded 43632 existing records from primary storage. [2025-10-21T22:08:42.430319] [INFO ] [MAIN ] GCI: Loaded 43632 primary data records. [2025-10-21T22:08:42.520421] [DEBUG] [LOCAL ] GCO: Loaded 23035 existing records from primary storage. [2025-10-21T22:08:42.525985] [DEBUG] [LOCAL ] GCTS: Loaded 20218 existing records from primary storage. [2025-10-21T22:08:42.536931] [INFO ] [MAIN ] GCO: Loaded 23035 primary data records. [2025-10-21T22:08:42.544427] [INFO ] [MAIN ] GCTS: Loaded 20218 primary data records. [2025-10-21T22:08:43.412907] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:43.413636] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 43632 primary records. [2025-10-21T22:08:43.413976] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-10-21T22:08:43.431909] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-10-21T22:08:43.434597] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-10-21T22:08:43.436779] [INFO ] [MAIN ] Derivative Progress: 718/2057 symbols completed. GCI took 1.1s. Estimated remaining: 8m 25s. Rate: 159.0 symbols/min [2025-10-21T22:08:43.451221] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:43.452130] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 20218 primary records. [2025-10-21T22:08:43.452241] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-10-21T22:08:43.480283] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-10-21T22:08:43.480559] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-10-21T22:08:43.480468] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:43.483956] [INFO ] [MAIN ] Derivative Progress: 719/2057 symbols completed. GCTS took 1.1s. Estimated remaining: 8m 24s. Rate: 159.2 symbols/min [2025-10-21T22:08:43.481260] [INFO ] [MAIN ] GCO: Generated 1793 derivative records from 23035 primary records. [2025-10-21T22:08:43.484068] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-10-21T22:08:43.499071] [DEBUG] [LOCAL ] GCO: Derivative data saved (1793 records). [2025-10-21T22:08:43.499134] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-10-21T22:08:43.501612] [INFO ] [MAIN ] Derivative Progress: 720/2057 symbols completed. GCO took 1.1s. Estimated remaining: 8m 23s. Rate: 159.4 symbols/min [2025-10-21T22:08:43.502147] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:43.502071] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:43.502246] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:43.512385] [DEBUG] [LOCAL ] GCV: Loaded 7809 existing records from primary storage. [2025-10-21T22:08:43.512580] [INFO ] [MAIN ] GCV: Loaded 7809 primary data records. [2025-10-21T22:08:43.859929] [DEBUG] [LOCAL ] GDDY: Loaded 49671 existing records from primary storage. [2025-10-21T22:08:43.860341] [INFO ] [MAIN ] GDDY: Loaded 49671 primary data records. [2025-10-21T22:08:43.861616] [DEBUG] [LOCAL ] GD: Loaded 46538 existing records from primary storage. [2025-10-21T22:08:43.905259] [INFO ] [MAIN ] GD: Loaded 46538 primary data records. [2025-10-21T22:08:44.472477] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:44.473712] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7809 primary records. [2025-10-21T22:08:44.473851] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-10-21T22:08:44.490702] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-10-21T22:08:44.492471] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-10-21T22:08:44.495589] [INFO ] [MAIN ] Derivative Progress: 721/2057 symbols completed. GCV took 1.0s. Estimated remaining: 8m 24s. Rate: 159.1 symbols/min [2025-10-21T22:08:44.495781] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:44.503406] [DEBUG] [LOCAL ] GDIV: Loaded 3542 existing records from primary storage. [2025-10-21T22:08:44.504107] [INFO ] [MAIN ] GDIV: Loaded 3542 primary data records. [2025-10-21T22:08:44.643446] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:44.659747] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49671 primary records. [2025-10-21T22:08:44.686968] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-10-21T22:08:44.842863] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:44.859946] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-10-21T22:08:44.860183] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-10-21T22:08:44.859872] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 46538 primary records. [2025-10-21T22:08:44.862356] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-10-21T22:08:44.862218] [INFO ] [MAIN ] Derivative Progress: 722/2057 symbols completed. GDDY took 1.4s. Estimated remaining: 8m 24s. Rate: 159.1 symbols/min [2025-10-21T22:08:44.863127] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:44.882284] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-10-21T22:08:44.882510] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-10-21T22:08:44.885278] [INFO ] [MAIN ] Derivative Progress: 723/2057 symbols completed. GD took 1.4s. Estimated remaining: 8m 22s. Rate: 159.3 symbols/min [2025-10-21T22:08:44.888115] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:44.888303] [DEBUG] [LOCAL ] GDL: Loaded 2519 existing records from primary storage. [2025-10-21T22:08:44.889166] [INFO ] [MAIN ] GDL: Loaded 2519 primary data records. [2025-10-21T22:08:44.987757] [DEBUG] [LOCAL ] GDO: Loaded 5860 existing records from primary storage. [2025-10-21T22:08:44.998725] [INFO ] [MAIN ] GDO: Loaded 5860 primary data records. [2025-10-21T22:08:45.369619] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:45.370330] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3542 primary records. [2025-10-21T22:08:45.370495] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-10-21T22:08:45.571118] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-10-21T22:08:45.579921] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-10-21T22:08:45.582357] [INFO ] [MAIN ] Derivative Progress: 724/2057 symbols completed. GDIV took 1.1s. Estimated remaining: 8m 23s. Rate: 159.1 symbols/min [2025-10-21T22:08:45.582870] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:45.609555] [DEBUG] [MAIN ] GDL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:45.619315] [INFO ] [MAIN ] GDL: Generated 1793 derivative records from 2519 primary records. [2025-10-21T22:08:45.621064] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-10-21T22:08:45.647776] [DEBUG] [LOCAL ] GDL: Derivative data saved (1793 records). [2025-10-21T22:08:45.648323] [DEBUG] [MAIN ] GDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:45.648030] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-10-21T22:08:45.651071] [INFO ] [MAIN ] Derivative Progress: 725/2057 symbols completed. GDL took 0.8s. Estimated remaining: 8m 22s. Rate: 159.3 symbols/min [2025-10-21T22:08:45.652327] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 5860 primary records. [2025-10-21T22:08:45.651292] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:45.652456] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-10-21T22:08:45.665247] [DEBUG] [LOCAL ] GDOT: Loaded 37710 existing records from primary storage. [2025-10-21T22:08:45.671944] [INFO ] [MAIN ] GDOT: Loaded 37710 primary data records. [2025-10-21T22:08:45.716581] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-10-21T22:08:45.749504] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-10-21T22:08:45.752220] [INFO ] [MAIN ] Derivative Progress: 726/2057 symbols completed. GDO took 0.9s. Estimated remaining: 8m 21s. Rate: 159.4 symbols/min [2025-10-21T22:08:45.752379] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:45.998011] [DEBUG] [LOCAL ] GDV: Loaded 19319 existing records from primary storage. [2025-10-21T22:08:46.013196] [INFO ] [MAIN ] GDV: Loaded 19319 primary data records. [2025-10-21T22:08:46.363712] [DEBUG] [LOCAL ] GE: Loaded 53698 existing records from primary storage. [2025-10-21T22:08:46.364180] [INFO ] [MAIN ] GE: Loaded 53698 primary data records. [2025-10-21T22:08:46.688078] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:46.704062] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 37710 primary records. [2025-10-21T22:08:46.704508] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-10-21T22:08:46.732961] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-10-21T22:08:46.743580] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-10-21T22:08:46.752408] [INFO ] [MAIN ] Derivative Progress: 727/2057 symbols completed. GDOT took 1.2s. Estimated remaining: 8m 22s. Rate: 159.1 symbols/min [2025-10-21T22:08:46.753130] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:46.754441] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 19319 primary records. [2025-10-21T22:08:46.754729] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:46.755073] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-10-21T22:08:46.774309] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-10-21T22:08:46.774528] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-10-21T22:08:46.778489] [INFO ] [MAIN ] Derivative Progress: 728/2057 symbols completed. GDV took 1.1s. Estimated remaining: 8m 21s. Rate: 159.3 symbols/min [2025-10-21T22:08:46.779074] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:46.803673] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:46.804595] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53698 primary records. [2025-10-21T22:08:46.804923] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-10-21T22:08:46.831844] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-10-21T22:08:46.831986] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-10-21T22:08:46.834536] [INFO ] [MAIN ] Derivative Progress: 729/2057 symbols completed. GE took 1.1s. Estimated remaining: 8m 20s. Rate: 159.5 symbols/min [2025-10-21T22:08:46.831692] [DEBUG] [LOCAL ] GEF: Loaded 20751 existing records from primary storage. [2025-10-21T22:08:46.834878] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:46.835062] [INFO ] [MAIN ] GEF: Loaded 20751 primary data records. [2025-10-21T22:08:46.991175] [DEBUG] [LOCAL ] GEL: Loaded 31309 existing records from primary storage. [2025-10-21T22:08:47.023534] [INFO ] [MAIN ] GEL: Loaded 31309 primary data records. [2025-10-21T22:08:47.430784] [DEBUG] [LOCAL ] GENI: Loaded 52937 existing records from primary storage. [2025-10-21T22:08:47.448708] [INFO ] [MAIN ] GENI: Loaded 52937 primary data records. [2025-10-21T22:08:47.955434] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:47.956559] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20751 primary records. [2025-10-21T22:08:47.956669] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-10-21T22:08:47.976566] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-10-21T22:08:47.977171] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-10-21T22:08:47.981611] [INFO ] [MAIN ] Derivative Progress: 730/2057 symbols completed. GEF took 1.2s. Estimated remaining: 8m 21s. Rate: 159.0 symbols/min [2025-10-21T22:08:47.983184] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:48.000690] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:48.001844] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 31309 primary records. [2025-10-21T22:08:48.001968] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-10-21T22:08:48.019494] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-10-21T22:08:48.020565] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-10-21T22:08:48.022943] [INFO ] [MAIN ] Derivative Progress: 731/2057 symbols completed. GEL took 1.2s. Estimated remaining: 8m 20s. Rate: 159.2 symbols/min [2025-10-21T22:08:48.023590] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:48.047221] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:48.048244] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52937 primary records. [2025-10-21T22:08:48.048512] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-10-21T22:08:48.065447] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-10-21T22:08:48.065671] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-10-21T22:08:48.070458] [INFO ] [MAIN ] Derivative Progress: 732/2057 symbols completed. GENI took 1.2s. Estimated remaining: 8m 19s. Rate: 159.4 symbols/min [2025-10-21T22:08:48.087204] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:48.139771] [DEBUG] [LOCAL ] GEO: Loaded 51739 existing records from primary storage. [2025-10-21T22:08:48.140442] [DEBUG] [LOCAL ] GES: Loaded 37978 existing records from primary storage. [2025-10-21T22:08:48.140761] [INFO ] [MAIN ] GEO: Loaded 51739 primary data records. [2025-10-21T22:08:48.146263] [INFO ] [MAIN ] GES: Loaded 37978 primary data records. [2025-10-21T22:08:48.276932] [DEBUG] [LOCAL ] GETY: Loaded 35197 existing records from primary storage. [2025-10-21T22:08:48.343419] [INFO ] [MAIN ] GETY: Loaded 35197 primary data records. [2025-10-21T22:08:49.170425] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:49.172622] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 51739 primary records. [2025-10-21T22:08:49.171524] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:49.173799] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-10-21T22:08:49.174592] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 37978 primary records. [2025-10-21T22:08:49.177363] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-10-21T22:08:49.221254] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:49.206723] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-10-21T22:08:49.224761] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-10-21T22:08:49.225979] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 35197 primary records. [2025-10-21T22:08:49.226079] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-10-21T22:08:49.228749] [INFO ] [MAIN ] Derivative Progress: 733/2057 symbols completed. GEO took 1.2s. Estimated remaining: 8m 20s. Rate: 159.0 symbols/min [2025-10-21T22:08:49.228906] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-10-21T22:08:49.232542] [INFO ] [MAIN ] Derivative Progress: 734/2057 symbols completed. GES took 1.2s. Estimated remaining: 8m 19s. Rate: 159.2 symbols/min [2025-10-21T22:08:49.228988] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-10-21T22:08:49.249583] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-10-21T22:08:49.249700] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-10-21T22:08:49.252776] [INFO ] [MAIN ] Derivative Progress: 735/2057 symbols completed. GETY took 1.2s. Estimated remaining: 8m 18s. Rate: 159.4 symbols/min [2025-10-21T22:08:49.253268] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:49.253403] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:49.253528] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:49.261789] [DEBUG] [LOCAL ] GF: Loaded 2646 existing records from primary storage. [2025-10-21T22:08:49.262474] [INFO ] [MAIN ] GF: Loaded 2646 primary data records. [2025-10-21T22:08:49.482479] [DEBUG] [LOCAL ] GFF: Loaded 29542 existing records from primary storage. [2025-10-21T22:08:49.539702] [INFO ] [MAIN ] GFF: Loaded 29542 primary data records. [2025-10-21T22:08:49.772017] [DEBUG] [LOCAL ] GEV: Loaded 52992 existing records from primary storage. [2025-10-21T22:08:49.800713] [INFO ] [MAIN ] GEV: Loaded 52992 primary data records. [2025-10-21T22:08:50.332907] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:50.334585] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 2646 primary records. [2025-10-21T22:08:50.334761] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-10-21T22:08:50.353877] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-10-21T22:08:50.354020] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-10-21T22:08:50.356942] [INFO ] [MAIN ] Derivative Progress: 736/2057 symbols completed. GF took 1.1s. Estimated remaining: 8m 19s. Rate: 159.0 symbols/min [2025-10-21T22:08:50.358037] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:50.377607] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:50.378496] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 29542 primary records. [2025-10-21T22:08:50.378892] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-10-21T22:08:50.397937] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-10-21T22:08:50.398145] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-10-21T22:08:50.402999] [INFO ] [MAIN ] Derivative Progress: 737/2057 symbols completed. GFF took 1.1s. Estimated remaining: 8m 18s. Rate: 159.2 symbols/min [2025-10-21T22:08:50.403545] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:50.420228] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:50.421126] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 52992 primary records. [2025-10-21T22:08:50.421216] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-10-21T22:08:50.451719] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-10-21T22:08:50.451891] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-10-21T22:08:50.454819] [INFO ] [MAIN ] Derivative Progress: 738/2057 symbols completed. GEV took 1.2s. Estimated remaining: 8m 17s. Rate: 159.3 symbols/min [2025-10-21T22:08:50.454974] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:50.468864] [DEBUG] [LOCAL ] GFR: Loaded 7423 existing records from primary storage. [2025-10-21T22:08:50.469096] [INFO ] [MAIN ] GFR: Loaded 7423 primary data records. [2025-10-21T22:08:50.573364] [DEBUG] [LOCAL ] GFI: Loaded 53116 existing records from primary storage. [2025-10-21T22:08:50.584015] [INFO ] [MAIN ] GFI: Loaded 53116 primary data records. [2025-10-21T22:08:50.667536] [DEBUG] [LOCAL ] GFL: Loaded 47521 existing records from primary storage. [2025-10-21T22:08:50.704584] [INFO ] [MAIN ] GFL: Loaded 47521 primary data records. [2025-10-21T22:08:51.576600] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:51.579492] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 7423 primary records. [2025-10-21T22:08:51.579986] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-10-21T22:08:51.599116] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-10-21T22:08:51.607753] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-10-21T22:08:51.616165] [INFO ] [MAIN ] Derivative Progress: 739/2057 symbols completed. GFR took 1.2s. Estimated remaining: 8m 18s. Rate: 158.9 symbols/min [2025-10-21T22:08:51.616350] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:51.618850] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:51.620142] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53116 primary records. [2025-10-21T22:08:51.620359] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-10-21T22:08:51.643389] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:51.653977] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 47521 primary records. [2025-10-21T22:08:51.652812] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-10-21T22:08:51.654231] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-10-21T22:08:51.658137] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-10-21T22:08:51.657997] [INFO ] [MAIN ] Derivative Progress: 740/2057 symbols completed. GFI took 1.3s. Estimated remaining: 8m 17s. Rate: 159.1 symbols/min [2025-10-21T22:08:51.659777] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:51.680438] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-10-21T22:08:51.680671] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-10-21T22:08:51.685316] [INFO ] [MAIN ] Derivative Progress: 741/2057 symbols completed. GFL took 1.3s. Estimated remaining: 8m 16s. Rate: 159.3 symbols/min [2025-10-21T22:08:51.685755] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:51.734122] [DEBUG] [LOCAL ] GGT: Loaded 14524 existing records from primary storage. [2025-10-21T22:08:51.749096] [INFO ] [MAIN ] GGT: Loaded 14524 primary data records. [2025-10-21T22:08:51.768663] [DEBUG] [LOCAL ] GGB: Loaded 51551 existing records from primary storage. [2025-10-21T22:08:51.785255] [INFO ] [MAIN ] GGB: Loaded 51551 primary data records. [2025-10-21T22:08:51.975291] [DEBUG] [LOCAL ] GGG: Loaded 40582 existing records from primary storage. [2025-10-21T22:08:52.053120] [INFO ] [MAIN ] GGG: Loaded 40582 primary data records. [2025-10-21T22:08:52.798839] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:52.799227] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:52.800456] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14524 primary records. [2025-10-21T22:08:52.802205] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 51551 primary records. [2025-10-21T22:08:52.802305] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-10-21T22:08:52.802795] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-10-21T22:08:52.851264] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-10-21T22:08:52.852194] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-10-21T22:08:52.855005] [INFO ] [MAIN ] Derivative Progress: 742/2057 symbols completed. GGT took 1.2s. Estimated remaining: 8m 17s. Rate: 158.8 symbols/min [2025-10-21T22:08:52.852065] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:52.856734] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 40582 primary records. [2025-10-21T22:08:52.857866] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:52.859125] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-10-21T22:08:52.860042] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-10-21T22:08:52.859409] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-10-21T22:08:52.864700] [INFO ] [MAIN ] Derivative Progress: 743/2057 symbols completed. GGB took 1.2s. Estimated remaining: 8m 16s. Rate: 159.0 symbols/min [2025-10-21T22:08:52.867106] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:52.888428] [DEBUG] [LOCAL ] GGZ: Loaded 2395 existing records from primary storage. [2025-10-21T22:08:52.890009] [INFO ] [MAIN ] GGZ: Loaded 2395 primary data records. [2025-10-21T22:08:52.889855] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-10-21T22:08:52.897995] [DEBUG] [LOCAL ] GHC: Loaded 2964 existing records from primary storage. [2025-10-21T22:08:52.895678] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-10-21T22:08:52.910888] [INFO ] [MAIN ] GHC: Loaded 2964 primary data records. [2025-10-21T22:08:52.910756] [INFO ] [MAIN ] Derivative Progress: 744/2057 symbols completed. GGG took 1.3s. Estimated remaining: 8m 15s. Rate: 159.2 symbols/min [2025-10-21T22:08:52.934199] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:53.152605] [DEBUG] [LOCAL ] GHG: Loaded 3279 existing records from primary storage. [2025-10-21T22:08:53.176607] [INFO ] [MAIN ] GHG: Loaded 3279 primary data records. [2025-10-21T22:08:54.177142] [DEBUG] [MAIN ] GHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:54.180086] [INFO ] [MAIN ] GHC: Generated 1794 derivative records from 2964 primary records. [2025-10-21T22:08:54.180252] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-10-21T22:08:54.201279] [DEBUG] [LOCAL ] GHC: Derivative data saved (1794 records). [2025-10-21T22:08:54.213947] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-10-21T22:08:54.226763] [INFO ] [MAIN ] Derivative Progress: 745/2057 symbols completed. GHC took 1.4s. Estimated remaining: 8m 16s. Rate: 158.7 symbols/min [2025-10-21T22:08:54.222619] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:54.228715] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2395 primary records. [2025-10-21T22:08:54.228849] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-10-21T22:08:54.230171] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:54.263699] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-21T22:08:54.267872] [INFO ] [MAIN ] GHG: Generated 1792 derivative records from 3279 primary records. [2025-10-21T22:08:54.267996] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-10-21T22:08:54.284218] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-10-21T22:08:54.289055] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-10-21T22:08:54.294808] [DEBUG] [LOCAL ] GHI: Loaded 7700 existing records from primary storage. [2025-10-21T22:08:54.302709] [INFO ] [MAIN ] GHI: Loaded 7700 primary data records. [2025-10-21T22:08:54.302560] [DEBUG] [LOCAL ] GHG: Derivative data saved (1792 records). [2025-10-21T22:08:54.299681] [INFO ] [MAIN ] Derivative Progress: 746/2057 symbols completed. GGZ took 1.4s. Estimated remaining: 8m 15s. Rate: 158.9 symbols/min [2025-10-21T22:08:54.325462] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-10-21T22:08:54.315504] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:54.347271] [INFO ] [MAIN ] Derivative Progress: 747/2057 symbols completed. GHG took 1.4s. Estimated remaining: 8m 14s. Rate: 159.1 symbols/min [2025-10-21T22:08:54.373149] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:54.428397] [DEBUG] [LOCAL ] GHLD: Loaded 4289 existing records from primary storage. [2025-10-21T22:08:54.444277] [INFO ] [MAIN ] GHLD: Loaded 4289 primary data records. [2025-10-21T22:08:54.748702] [DEBUG] [LOCAL ] GHM: Loaded 14348 existing records from primary storage. [2025-10-21T22:08:54.765772] [INFO ] [MAIN ] GHM: Loaded 14348 primary data records. [2025-10-21T22:08:55.387904] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:55.390044] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 7700 primary records. [2025-10-21T22:08:55.390396] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-10-21T22:08:55.409382] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-10-21T22:08:55.409721] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-10-21T22:08:55.412534] [INFO ] [MAIN ] Derivative Progress: 748/2057 symbols completed. GHI took 1.2s. Estimated remaining: 8m 15s. Rate: 158.7 symbols/min [2025-10-21T22:08:55.433724] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:08:55.434897] [INFO ] [MAIN ] GHLD: Generated 1793 derivative records from 4289 primary records. [2025-10-21T22:08:55.435001] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-10-21T22:08:55.449458] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:55.458026] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14348 primary records. [2025-10-21T22:08:55.464867] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1793 records). [2025-10-21T22:08:55.464519] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-10-21T22:08:55.465482] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-10-21T22:08:55.469075] [INFO ] [MAIN ] Derivative Progress: 749/2057 symbols completed. GHLD took 1.2s. Estimated remaining: 8m 14s. Rate: 158.8 symbols/min [2025-10-21T22:08:55.485115] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-10-21T22:08:55.485251] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-10-21T22:08:55.489089] [INFO ] [MAIN ] Derivative Progress: 750/2057 symbols completed. GHM took 1.1s. Estimated remaining: 8m 13s. Rate: 159.0 symbols/min [2025-10-21T22:08:55.489614] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:55.489776] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:55.489898] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:55.528027] [DEBUG] [LOCAL ] GIC: Loaded 13257 existing records from primary storage. [2025-10-21T22:08:55.528287] [INFO ] [MAIN ] GIC: Loaded 13257 primary data records. [2025-10-21T22:08:55.567185] [DEBUG] [LOCAL ] GHY: Loaded 20916 existing records from primary storage. [2025-10-21T22:08:55.592333] [INFO ] [MAIN ] GHY: Loaded 20916 primary data records. [2025-10-21T22:08:55.691473] [DEBUG] [LOCAL ] GIB: Loaded 31436 existing records from primary storage. [2025-10-21T22:08:55.719440] [INFO ] [MAIN ] GIB: Loaded 31436 primary data records. [2025-10-21T22:08:56.674781] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:56.676957] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13257 primary records. [2025-10-21T22:08:56.677606] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-10-21T22:08:56.696053] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-10-21T22:08:56.697328] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-10-21T22:08:56.700405] [INFO ] [MAIN ] Derivative Progress: 751/2057 symbols completed. GIC took 1.2s. Estimated remaining: 8m 14s. Rate: 158.6 symbols/min [2025-10-21T22:08:56.706080] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:56.720914] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:56.735512] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 31436 primary records. [2025-10-21T22:08:56.736237] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-10-21T22:08:56.735997] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:56.738377] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 20916 primary records. [2025-10-21T22:08:56.738798] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-10-21T22:08:56.773986] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-10-21T22:08:56.774275] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-10-21T22:08:56.777428] [INFO ] [MAIN ] Derivative Progress: 752/2057 symbols completed. GIB took 1.3s. Estimated remaining: 8m 13s. Rate: 158.7 symbols/min [2025-10-21T22:08:56.773519] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-10-21T22:08:56.777781] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:56.778162] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-10-21T22:08:56.782049] [INFO ] [MAIN ] Derivative Progress: 753/2057 symbols completed. GHY took 1.3s. Estimated remaining: 8m 12s. Rate: 159.0 symbols/min [2025-10-21T22:08:56.782462] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:56.820317] [DEBUG] [LOCAL ] GIL: Loaded 43981 existing records from primary storage. [2025-10-21T22:08:56.820970] [INFO ] [MAIN ] GIL: Loaded 43981 primary data records. [2025-10-21T22:08:57.018004] [DEBUG] [LOCAL ] GKOS: Loaded 42499 existing records from primary storage. [2025-10-21T22:08:57.037382] [INFO ] [MAIN ] GKOS: Loaded 42499 primary data records. [2025-10-21T22:08:57.245159] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-21T22:08:57.295596] [INFO ] [MAIN ] GIS: Loaded 53675 primary data records. [2025-10-21T22:08:57.911207] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:57.912969] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43981 primary records. [2025-10-21T22:08:57.913686] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-10-21T22:08:57.933206] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-10-21T22:08:57.937380] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-10-21T22:08:57.942133] [INFO ] [MAIN ] Derivative Progress: 754/2057 symbols completed. GIL took 1.2s. Estimated remaining: 8m 13s. Rate: 158.5 symbols/min [2025-10-21T22:08:57.951149] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:57.961581] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:57.963811] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 42499 primary records. [2025-10-21T22:08:57.963938] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-10-21T22:08:57.982680] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-10-21T22:08:57.983243] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-10-21T22:08:58.000236] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:57.994350] [INFO ] [MAIN ] Derivative Progress: 755/2057 symbols completed. GKOS took 1.2s. Estimated remaining: 8m 12s. Rate: 158.7 symbols/min [2025-10-21T22:08:58.001351] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:58.001222] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53675 primary records. [2025-10-21T22:08:58.001910] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-10-21T22:08:58.020516] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-10-21T22:08:58.033016] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-10-21T22:08:58.036820] [INFO ] [MAIN ] Derivative Progress: 756/2057 symbols completed. GIS took 1.3s. Estimated remaining: 8m 11s. Rate: 158.9 symbols/min [2025-10-21T22:08:58.037212] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:58.043322] [DEBUG] [LOCAL ] GLP: Loaded 9296 existing records from primary storage. [2025-10-21T22:08:58.043563] [INFO ] [MAIN ] GLP: Loaded 9296 primary data records. [2025-10-21T22:08:58.173024] [DEBUG] [LOCAL ] GL: Loaded 37443 existing records from primary storage. [2025-10-21T22:08:58.195282] [INFO ] [MAIN ] GL: Loaded 37443 primary data records. [2025-10-21T22:08:58.599568] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-21T22:08:58.622262] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-10-21T22:08:59.195028] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:59.195961] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9296 primary records. [2025-10-21T22:08:59.196268] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-10-21T22:08:59.214305] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-10-21T22:08:59.214874] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-10-21T22:08:59.217447] [INFO ] [MAIN ] Derivative Progress: 757/2057 symbols completed. GLP took 1.2s. Estimated remaining: 8m 12s. Rate: 158.4 symbols/min [2025-10-21T22:08:59.218157] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:59.239416] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:59.240698] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 37443 primary records. [2025-10-21T22:08:59.241428] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-10-21T22:08:59.261775] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-10-21T22:08:59.262015] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-10-21T22:08:59.265018] [INFO ] [MAIN ] Derivative Progress: 758/2057 symbols completed. GL took 1.3s. Estimated remaining: 8m 11s. Rate: 158.6 symbols/min [2025-10-21T22:08:59.265573] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:59.301450] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:08:59.302501] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-10-21T22:08:59.302719] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-10-21T22:08:59.321508] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-10-21T22:08:59.321764] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-10-21T22:08:59.326614] [INFO ] [MAIN ] Derivative Progress: 759/2057 symbols completed. GLW took 1.3s. Estimated remaining: 8m 10s. Rate: 158.8 symbols/min [2025-10-21T22:08:59.326957] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:08:59.346344] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-21T22:08:59.346858] [INFO ] [MAIN ] GM: Loaded 53729 primary data records. [2025-10-21T22:08:59.530673] [DEBUG] [LOCAL ] GME: Loaded 53781 existing records from primary storage. [2025-10-21T22:08:59.573228] [INFO ] [MAIN ] GME: Loaded 53781 primary data records. [2025-10-21T22:08:59.870055] [DEBUG] [LOCAL ] GMED: Loaded 48118 existing records from primary storage. [2025-10-21T22:08:59.923287] [INFO ] [MAIN ] GMED: Loaded 48118 primary data records. [2025-10-21T22:09:00.307178] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:00.515573] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53729 primary records. [2025-10-21T22:09:00.530274] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-10-21T22:09:00.552394] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-10-21T22:09:00.552609] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-10-21T22:09:00.556611] [INFO ] [MAIN ] Derivative Progress: 760/2057 symbols completed. GM took 1.3s. Estimated remaining: 8m 12s. Rate: 158.3 symbols/min [2025-10-21T22:09:00.557782] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:00.578585] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:00.579734] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53781 primary records. [2025-10-21T22:09:00.580340] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-10-21T22:09:00.597249] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-10-21T22:09:00.597528] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-10-21T22:09:00.601369] [INFO ] [MAIN ] Derivative Progress: 761/2057 symbols completed. GME took 1.3s. Estimated remaining: 8m 11s. Rate: 158.5 symbols/min [2025-10-21T22:09:00.602243] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:00.635793] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:00.636923] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48118 primary records. [2025-10-21T22:09:00.640839] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-10-21T22:09:00.660404] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-10-21T22:09:00.682944] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-10-21T22:09:00.683351] [DEBUG] [LOCAL ] GNE: Loaded 18119 existing records from primary storage. [2025-10-21T22:09:00.687770] [INFO ] [MAIN ] Derivative Progress: 762/2057 symbols completed. GMED took 1.4s. Estimated remaining: 8m 10s. Rate: 158.7 symbols/min [2025-10-21T22:09:00.688150] [INFO ] [MAIN ] GNE: Loaded 18119 primary data records. [2025-10-21T22:09:00.690385] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:00.690065] [DEBUG] [LOCAL ] GMRE: Loaded 36650 existing records from primary storage. [2025-10-21T22:09:00.719744] [INFO ] [MAIN ] GMRE: Loaded 36650 primary data records. [2025-10-21T22:09:01.243405] [DEBUG] [LOCAL ] GNK: Loaded 39630 existing records from primary storage. [2025-10-21T22:09:01.265636] [INFO ] [MAIN ] GNK: Loaded 39630 primary data records. [2025-10-21T22:09:01.820337] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:01.822259] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 18119 primary records. [2025-10-21T22:09:01.822481] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-10-21T22:09:01.847505] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-10-21T22:09:01.847776] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-10-21T22:09:01.850441] [INFO ] [MAIN ] Derivative Progress: 763/2057 symbols completed. GNE took 1.2s. Estimated remaining: 8m 11s. Rate: 158.2 symbols/min [2025-10-21T22:09:01.865364] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:01.866377] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 36650 primary records. [2025-10-21T22:09:01.866555] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-10-21T22:09:01.887478] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-10-21T22:09:01.887802] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-10-21T22:09:01.891406] [INFO ] [MAIN ] Derivative Progress: 764/2057 symbols completed. GMRE took 1.3s. Estimated remaining: 8m 10s. Rate: 158.4 symbols/min [2025-10-21T22:09:01.906580] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:01.907228] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 39630 primary records. [2025-10-21T22:09:01.907294] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-10-21T22:09:01.923065] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-10-21T22:09:01.923136] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-10-21T22:09:01.925986] [INFO ] [MAIN ] Derivative Progress: 765/2057 symbols completed. GNK took 1.2s. Estimated remaining: 8m 9s. Rate: 158.6 symbols/min [2025-10-21T22:09:01.926444] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:01.926538] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:01.926861] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:01.938725] [DEBUG] [LOCAL ] GNT: Loaded 8676 existing records from primary storage. [2025-10-21T22:09:01.938990] [INFO ] [MAIN ] GNT: Loaded 8676 primary data records. [2025-10-21T22:09:02.362454] [DEBUG] [LOCAL ] GNL: Loaded 46556 existing records from primary storage. [2025-10-21T22:09:02.363094] [INFO ] [MAIN ] GNL: Loaded 46556 primary data records. [2025-10-21T22:09:02.365096] [DEBUG] [LOCAL ] GNRC: Loaded 45398 existing records from primary storage. [2025-10-21T22:09:02.402759] [INFO ] [MAIN ] GNRC: Loaded 45398 primary data records. [2025-10-21T22:09:03.072616] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:03.073727] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 8676 primary records. [2025-10-21T22:09:03.074002] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-10-21T22:09:03.092705] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-10-21T22:09:03.094043] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-10-21T22:09:03.098171] [INFO ] [MAIN ] Derivative Progress: 766/2057 symbols completed. GNT took 1.2s. Estimated remaining: 8m 10s. Rate: 158.2 symbols/min [2025-10-21T22:09:03.098768] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:03.112889] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:03.114400] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 46556 primary records. [2025-10-21T22:09:03.115584] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-10-21T22:09:03.137221] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:03.143841] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-10-21T22:09:03.144681] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-10-21T22:09:03.144600] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45398 primary records. [2025-10-21T22:09:03.147232] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-10-21T22:09:03.147094] [INFO ] [MAIN ] Derivative Progress: 767/2057 symbols completed. GNL took 1.2s. Estimated remaining: 8m 9s. Rate: 158.4 symbols/min [2025-10-21T22:09:03.148530] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:03.164751] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-10-21T22:09:03.164986] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-10-21T22:09:03.168024] [INFO ] [MAIN ] Derivative Progress: 768/2057 symbols completed. GNRC took 1.2s. Estimated remaining: 8m 8s. Rate: 158.6 symbols/min [2025-10-21T22:09:03.168246] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:03.211063] [DEBUG] [LOCAL ] GNW: Loaded 51379 existing records from primary storage. [2025-10-21T22:09:03.227490] [INFO ] [MAIN ] GNW: Loaded 51379 primary data records. [2025-10-21T22:09:03.349777] [DEBUG] [LOCAL ] GOLF: Loaded 30473 existing records from primary storage. [2025-10-21T22:09:03.353105] [INFO ] [MAIN ] GOLF: Loaded 30473 primary data records. [2025-10-21T22:09:03.370775] [DEBUG] [LOCAL ] GOF: Loaded 42730 existing records from primary storage. [2025-10-21T22:09:03.429820] [INFO ] [MAIN ] GOF: Loaded 42730 primary data records. [2025-10-21T22:09:04.187874] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:04.188588] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51379 primary records. [2025-10-21T22:09:04.188976] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-10-21T22:09:04.209127] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-10-21T22:09:04.209952] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-10-21T22:09:04.212755] [INFO ] [MAIN ] Derivative Progress: 769/2057 symbols completed. GNW took 1.1s. Estimated remaining: 8m 9s. Rate: 158.2 symbols/min [2025-10-21T22:09:04.212987] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:04.233213] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:04.238140] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:04.238871] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 42730 primary records. [2025-10-21T22:09:04.239838] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-10-21T22:09:04.239774] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 30473 primary records. [2025-10-21T22:09:04.240477] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-10-21T22:09:04.271693] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-10-21T22:09:04.271850] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-10-21T22:09:04.270702] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-10-21T22:09:04.275099] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-10-21T22:09:04.274964] [INFO ] [MAIN ] Derivative Progress: 770/2057 symbols completed. GOLF took 1.1s. Estimated remaining: 8m 8s. Rate: 158.4 symbols/min [2025-10-21T22:09:04.275313] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:04.278255] [INFO ] [MAIN ] Derivative Progress: 771/2057 symbols completed. GOF took 1.1s. Estimated remaining: 8m 7s. Rate: 158.6 symbols/min [2025-10-21T22:09:04.278498] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:04.336910] [DEBUG] [LOCAL ] GOTU: Loaded 37040 existing records from primary storage. [2025-10-21T22:09:04.361835] [INFO ] [MAIN ] GOTU: Loaded 37040 primary data records. [2025-10-21T22:09:04.374792] [DEBUG] [LOCAL ] GOOS: Loaded 44145 existing records from primary storage. [2025-10-21T22:09:04.419702] [INFO ] [MAIN ] GOOS: Loaded 44145 primary data records. [2025-10-21T22:09:04.407335] [DEBUG] [LOCAL ] GPC: Loaded 45944 existing records from primary storage. [2025-10-21T22:09:04.428881] [INFO ] [MAIN ] GPC: Loaded 45944 primary data records. [2025-10-21T22:09:05.341561] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:05.344283] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 37040 primary records. [2025-10-21T22:09:05.344620] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-10-21T22:09:05.375099] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:05.393606] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 45944 primary records. [2025-10-21T22:09:05.387778] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-10-21T22:09:05.394722] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:05.394863] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-10-21T22:09:05.394308] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-10-21T22:09:05.395762] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 44145 primary records. [2025-10-21T22:09:05.398477] [INFO ] [MAIN ] Derivative Progress: 772/2057 symbols completed. GOTU took 1.1s. Estimated remaining: 8m 7s. Rate: 158.2 symbols/min [2025-10-21T22:09:05.398561] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-10-21T22:09:05.400012] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:05.417361] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-10-21T22:09:05.417570] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-10-21T22:09:05.427972] [INFO ] [MAIN ] Derivative Progress: 773/2057 symbols completed. GOOS took 1.2s. Estimated remaining: 8m 6s. Rate: 158.4 symbols/min [2025-10-21T22:09:05.429723] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:05.438223] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-10-21T22:09:05.438362] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-10-21T22:09:05.443256] [INFO ] [MAIN ] Derivative Progress: 774/2057 symbols completed. GPC took 1.2s. Estimated remaining: 8m 6s. Rate: 158.6 symbols/min [2025-10-21T22:09:05.443541] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:05.454401] [DEBUG] [LOCAL ] GPJA: Loaded 4112 existing records from primary storage. [2025-10-21T22:09:05.454877] [INFO ] [MAIN ] GPJA: Loaded 4112 primary data records. [2025-10-21T22:09:05.527519] [DEBUG] [LOCAL ] GPI: Loaded 14752 existing records from primary storage. [2025-10-21T22:09:05.551333] [INFO ] [MAIN ] GPI: Loaded 14752 primary data records. [2025-10-21T22:09:06.095889] [DEBUG] [LOCAL ] GPK: Loaded 52780 existing records from primary storage. [2025-10-21T22:09:06.096201] [INFO ] [MAIN ] GPK: Loaded 52780 primary data records. [2025-10-21T22:09:06.448589] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-21T22:09:06.449749] [INFO ] [MAIN ] GPJA: Generated 1792 derivative records from 4112 primary records. [2025-10-21T22:09:06.450185] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-10-21T22:09:06.470768] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1792 records). [2025-10-21T22:09:06.472167] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-10-21T22:09:06.477606] [INFO ] [MAIN ] Derivative Progress: 775/2057 symbols completed. GPJA took 1.0s. Estimated remaining: 8m 6s. Rate: 158.2 symbols/min [2025-10-21T22:09:06.486064] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:06.493312] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:06.494226] [INFO ] [MAIN ] GPI: Generated 1793 derivative records from 14752 primary records. [2025-10-21T22:09:06.494812] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-10-21T22:09:06.528617] [DEBUG] [LOCAL ] GPI: Derivative data saved (1793 records). [2025-10-21T22:09:06.528768] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-10-21T22:09:06.531786] [INFO ] [MAIN ] Derivative Progress: 776/2057 symbols completed. GPI took 1.1s. Estimated remaining: 8m 5s. Rate: 158.4 symbols/min [2025-10-21T22:09:06.532386] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:06.547313] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:06.548749] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52780 primary records. [2025-10-21T22:09:06.548894] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-10-21T22:09:06.558635] [DEBUG] [LOCAL ] GPMT: Loaded 26021 existing records from primary storage. [2025-10-21T22:09:06.566079] [INFO ] [MAIN ] GPMT: Loaded 26021 primary data records. [2025-10-21T22:09:06.611279] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-10-21T22:09:06.629922] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-10-21T22:09:06.641555] [INFO ] [MAIN ] Derivative Progress: 777/2057 symbols completed. GPK took 1.2s. Estimated remaining: 8m 4s. Rate: 158.5 symbols/min [2025-10-21T22:09:06.641760] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:06.923761] [DEBUG] [LOCAL ] GPOR: Loaded 23342 existing records from primary storage. [2025-10-21T22:09:06.924106] [INFO ] [MAIN ] GPOR: Loaded 23342 primary data records. [2025-10-21T22:09:06.997319] [DEBUG] [LOCAL ] GPN: Loaded 51923 existing records from primary storage. [2025-10-21T22:09:07.012967] [INFO ] [MAIN ] GPN: Loaded 51923 primary data records. [2025-10-21T22:09:07.604101] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:07.605271] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26021 primary records. [2025-10-21T22:09:07.606346] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-10-21T22:09:07.629098] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-10-21T22:09:07.629546] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-10-21T22:09:07.632590] [INFO ] [MAIN ] Derivative Progress: 778/2057 symbols completed. GPMT took 1.1s. Estimated remaining: 8m 5s. Rate: 158.2 symbols/min [2025-10-21T22:09:07.648844] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:07.650217] [INFO ] [MAIN ] GPOR: Generated 1793 derivative records from 23342 primary records. [2025-10-21T22:09:07.650894] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-10-21T22:09:07.675149] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:07.678168] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 51923 primary records. [2025-10-21T22:09:07.678835] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-10-21T22:09:07.680162] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1793 records). [2025-10-21T22:09:07.680229] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-10-21T22:09:07.682406] [INFO ] [MAIN ] Derivative Progress: 779/2057 symbols completed. GPOR took 1.0s. Estimated remaining: 8m 4s. Rate: 158.4 symbols/min [2025-10-21T22:09:07.696667] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-10-21T22:09:07.696730] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-10-21T22:09:07.699332] [INFO ] [MAIN ] Derivative Progress: 780/2057 symbols completed. GPN took 1.2s. Estimated remaining: 8m 3s. Rate: 158.6 symbols/min [2025-10-21T22:09:07.699725] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:07.699879] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:07.699833] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:07.711138] [DEBUG] [LOCAL ] GRC: Loaded 9277 existing records from primary storage. [2025-10-21T22:09:07.711351] [INFO ] [MAIN ] GRC: Loaded 9277 primary data records. [2025-10-21T22:09:07.921773] [DEBUG] [LOCAL ] GPRK: Loaded 39820 existing records from primary storage. [2025-10-21T22:09:08.028242] [INFO ] [MAIN ] GPRK: Loaded 39820 primary data records. [2025-10-21T22:09:08.042938] [DEBUG] [LOCAL ] GRBK: Loaded 26836 existing records from primary storage. [2025-10-21T22:09:08.086628] [INFO ] [MAIN ] GRBK: Loaded 26836 primary data records. [2025-10-21T22:09:08.665793] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:08.666867] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 9277 primary records. [2025-10-21T22:09:08.667121] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-10-21T22:09:08.683672] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-10-21T22:09:08.683884] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-10-21T22:09:08.685864] [INFO ] [MAIN ] Derivative Progress: 781/2057 symbols completed. GRC took 1.0s. Estimated remaining: 8m 4s. Rate: 158.2 symbols/min [2025-10-21T22:09:08.686121] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:08.705481] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:08.706256] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39820 primary records. [2025-10-21T22:09:08.706481] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-10-21T22:09:08.719566] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:08.720351] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 26836 primary records. [2025-10-21T22:09:08.735984] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-10-21T22:09:08.748949] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-10-21T22:09:08.751996] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-10-21T22:09:08.765181] [INFO ] [MAIN ] Derivative Progress: 782/2057 symbols completed. GPRK took 1.1s. Estimated remaining: 8m 3s. Rate: 158.4 symbols/min [2025-10-21T22:09:08.766521] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-10-21T22:09:08.766639] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-10-21T22:09:08.766087] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:08.769342] [INFO ] [MAIN ] Derivative Progress: 783/2057 symbols completed. GRBK took 1.1s. Estimated remaining: 8m 2s. Rate: 158.6 symbols/min [2025-10-21T22:09:08.770360] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:08.770221] [DEBUG] [LOCAL ] GRDN: Loaded 21184 existing records from primary storage. [2025-10-21T22:09:08.770837] [INFO ] [MAIN ] GRDN: Loaded 21184 primary data records. [2025-10-21T22:09:09.136212] [DEBUG] [LOCAL ] GRND: Loaded 50203 existing records from primary storage. [2025-10-21T22:09:09.137065] [DEBUG] [LOCAL ] GRMN: Loaded 39939 existing records from primary storage. [2025-10-21T22:09:09.137295] [INFO ] [MAIN ] GRMN: Loaded 39939 primary data records. [2025-10-21T22:09:09.137343] [INFO ] [MAIN ] GRND: Loaded 50203 primary data records. [2025-10-21T22:09:09.765299] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:09.766563] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 21184 primary records. [2025-10-21T22:09:09.766969] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-10-21T22:09:09.785812] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-10-21T22:09:09.786185] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-10-21T22:09:09.790069] [INFO ] [MAIN ] Derivative Progress: 784/2057 symbols completed. GRDN took 1.1s. Estimated remaining: 8m 3s. Rate: 158.3 symbols/min [2025-10-21T22:09:09.790603] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:09.811122] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:09.812423] [INFO ] [MAIN ] GRMN: Generated 1793 derivative records from 39939 primary records. [2025-10-21T22:09:09.814269] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-10-21T22:09:09.851865] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1793 records). [2025-10-21T22:09:09.851974] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-10-21T22:09:09.864992] [INFO ] [MAIN ] Derivative Progress: 785/2057 symbols completed. GRMN took 1.1s. Estimated remaining: 8m 2s. Rate: 158.4 symbols/min [2025-10-21T22:09:09.850743] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:09.866109] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50203 primary records. [2025-10-21T22:09:09.865213] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:09.867784] [DEBUG] [LOCAL ] GRNT: Loaded 34016 existing records from primary storage. [2025-10-21T22:09:09.866382] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-10-21T22:09:09.868063] [INFO ] [MAIN ] GRNT: Loaded 34016 primary data records. [2025-10-21T22:09:09.941420] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-10-21T22:09:09.955737] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-10-21T22:09:09.975835] [INFO ] [MAIN ] Derivative Progress: 786/2057 symbols completed. GRND took 1.2s. Estimated remaining: 8m 1s. Rate: 158.6 symbols/min [2025-10-21T22:09:09.979866] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:09.993779] [DEBUG] [LOCAL ] GROV: Loaded 8701 existing records from primary storage. [2025-10-21T22:09:09.997614] [INFO ] [MAIN ] GROV: Loaded 8701 primary data records. [2025-10-21T22:09:10.196838] [DEBUG] [LOCAL ] GRX: Loaded 4844 existing records from primary storage. [2025-10-21T22:09:10.295876] [INFO ] [MAIN ] GRX: Loaded 4844 primary data records. [2025-10-21T22:09:10.871800] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:10.872703] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 34016 primary records. [2025-10-21T22:09:10.873304] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-10-21T22:09:10.893256] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-10-21T22:09:10.901433] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-10-21T22:09:10.908580] [INFO ] [MAIN ] Derivative Progress: 787/2057 symbols completed. GRNT took 1.1s. Estimated remaining: 8m 1s. Rate: 158.3 symbols/min [2025-10-21T22:09:10.909476] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:10.909377] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:10.911014] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 8701 primary records. [2025-10-21T22:09:10.911193] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-10-21T22:09:10.942904] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:10.942593] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-10-21T22:09:10.943852] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4844 primary records. [2025-10-21T22:09:10.943106] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-10-21T22:09:10.944017] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-10-21T22:09:10.947531] [INFO ] [MAIN ] Derivative Progress: 788/2057 symbols completed. GROV took 1.1s. Estimated remaining: 8m 1s. Rate: 158.4 symbols/min [2025-10-21T22:09:10.954381] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:10.963528] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-10-21T22:09:10.963720] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-10-21T22:09:10.966295] [INFO ] [MAIN ] Derivative Progress: 789/2057 symbols completed. GRX took 1.0s. Estimated remaining: 7m 60s. Rate: 158.6 symbols/min [2025-10-21T22:09:10.966597] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:11.015196] [DEBUG] [LOCAL ] GS: Loaded 51777 existing records from primary storage. [2025-10-21T22:09:11.015490] [INFO ] [MAIN ] GS: Loaded 51777 primary data records. [2025-10-21T22:09:11.110538] [DEBUG] [LOCAL ] GSBD: Loaded 39579 existing records from primary storage. [2025-10-21T22:09:11.146896] [INFO ] [MAIN ] GSBD: Loaded 39579 primary data records. [2025-10-21T22:09:11.326445] [DEBUG] [LOCAL ] GSK: Loaded 53512 existing records from primary storage. [2025-10-21T22:09:11.337435] [INFO ] [MAIN ] GSK: Loaded 53512 primary data records. [2025-10-21T22:09:12.024758] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:12.027058] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 51777 primary records. [2025-10-21T22:09:12.028435] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-10-21T22:09:12.054279] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:12.055196] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39579 primary records. [2025-10-21T22:09:12.055467] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-10-21T22:09:12.073603] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-10-21T22:09:12.073924] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-10-21T22:09:12.076129] [INFO ] [MAIN ] Derivative Progress: 790/2057 symbols completed. GS took 1.2s. Estimated remaining: 8m 0s. Rate: 158.3 symbols/min [2025-10-21T22:09:12.076513] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:12.080013] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-10-21T22:09:12.080413] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-10-21T22:09:12.082593] [INFO ] [MAIN ] Derivative Progress: 791/2057 symbols completed. GSBD took 1.1s. Estimated remaining: 7m 59s. Rate: 158.4 symbols/min [2025-10-21T22:09:12.082814] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:12.101768] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:12.102597] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53512 primary records. [2025-10-21T22:09:12.102846] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-10-21T22:09:12.121709] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-10-21T22:09:12.121922] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-10-21T22:09:12.133543] [INFO ] [MAIN ] Derivative Progress: 792/2057 symbols completed. GSK took 1.2s. Estimated remaining: 7m 58s. Rate: 158.6 symbols/min [2025-10-21T22:09:12.133890] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:12.160623] [DEBUG] [LOCAL ] GSL: Loaded 33081 existing records from primary storage. [2025-10-21T22:09:12.160786] [INFO ] [MAIN ] GSL: Loaded 33081 primary data records. [2025-10-21T22:09:12.279154] [DEBUG] [LOCAL ] GTES: Loaded 50305 existing records from primary storage. [2025-10-21T22:09:12.300231] [INFO ] [MAIN ] GTES: Loaded 50305 primary data records. [2025-10-21T22:09:12.609436] [DEBUG] [LOCAL ] GTLS: Loaded 43183 existing records from primary storage. [2025-10-21T22:09:12.620031] [INFO ] [MAIN ] GTLS: Loaded 43183 primary data records. [2025-10-21T22:09:13.172409] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:13.174053] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33081 primary records. [2025-10-21T22:09:13.174243] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-10-21T22:09:13.190732] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-10-21T22:09:13.191065] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-10-21T22:09:13.193180] [INFO ] [MAIN ] Derivative Progress: 793/2057 symbols completed. GSL took 1.1s. Estimated remaining: 7m 59s. Rate: 158.3 symbols/min [2025-10-21T22:09:13.211849] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:13.212535] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50305 primary records. [2025-10-21T22:09:13.212608] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-10-21T22:09:13.230830] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-10-21T22:09:13.243301] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-10-21T22:09:13.246400] [INFO ] [MAIN ] Derivative Progress: 794/2057 symbols completed. GTES took 1.2s. Estimated remaining: 7m 58s. Rate: 158.4 symbols/min [2025-10-21T22:09:13.243235] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:13.247251] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 43183 primary records. [2025-10-21T22:09:13.247370] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-10-21T22:09:13.263107] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-10-21T22:09:13.263170] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-10-21T22:09:13.267045] [INFO ] [MAIN ] Derivative Progress: 795/2057 symbols completed. GTLS took 1.1s. Estimated remaining: 7m 57s. Rate: 158.6 symbols/min [2025-10-21T22:09:13.267785] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:13.267905] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:13.267995] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:13.283914] [DEBUG] [LOCAL ] GUG: Loaded 12192 existing records from primary storage. [2025-10-21T22:09:13.284061] [INFO ] [MAIN ] GUG: Loaded 12192 primary data records. [2025-10-21T22:09:13.433194] [DEBUG] [LOCAL ] GTY: Loaded 30068 existing records from primary storage. [2025-10-21T22:09:13.490633] [INFO ] [MAIN ] GTY: Loaded 30068 primary data records. [2025-10-21T22:09:13.659194] [DEBUG] [LOCAL ] GTN: Loaded 44864 existing records from primary storage. [2025-10-21T22:09:13.678336] [INFO ] [MAIN ] GTN: Loaded 44864 primary data records. [2025-10-21T22:09:14.238314] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:14.239470] [INFO ] [MAIN ] GUG: Generated 1794 derivative records from 12192 primary records. [2025-10-21T22:09:14.239568] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-10-21T22:09:14.257842] [DEBUG] [LOCAL ] GUG: Derivative data saved (1794 records). [2025-10-21T22:09:14.258075] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-10-21T22:09:14.260525] [INFO ] [MAIN ] Derivative Progress: 796/2057 symbols completed. GUG took 1.0s. Estimated remaining: 7m 58s. Rate: 158.3 symbols/min [2025-10-21T22:09:14.260691] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:14.296497] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:14.296951] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:14.297711] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 44864 primary records. [2025-10-21T22:09:14.297837] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-10-21T22:09:14.298399] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30068 primary records. [2025-10-21T22:09:14.299084] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-10-21T22:09:14.312669] [DEBUG] [LOCAL ] GUT: Loaded 15651 existing records from primary storage. [2025-10-21T22:09:14.320276] [INFO ] [MAIN ] GUT: Loaded 15651 primary data records. [2025-10-21T22:09:14.332056] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-10-21T22:09:14.332152] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-10-21T22:09:14.335157] [INFO ] [MAIN ] Derivative Progress: 797/2057 symbols completed. GTY took 1.1s. Estimated remaining: 7m 57s. Rate: 158.5 symbols/min [2025-10-21T22:09:14.335628] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:14.343038] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-10-21T22:09:14.343137] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-10-21T22:09:14.352507] [INFO ] [MAIN ] Derivative Progress: 798/2057 symbols completed. GTN took 1.1s. Estimated remaining: 7m 56s. Rate: 158.6 symbols/min [2025-10-21T22:09:14.384620] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:14.671959] [DEBUG] [LOCAL ] GWH: Loaded 19825 existing records from primary storage. [2025-10-21T22:09:14.672176] [INFO ] [MAIN ] GWH: Loaded 19825 primary data records. [2025-10-21T22:09:14.674182] [DEBUG] [LOCAL ] GVA: Loaded 32612 existing records from primary storage. [2025-10-21T22:09:14.711210] [INFO ] [MAIN ] GVA: Loaded 32612 primary data records. [2025-10-21T22:09:15.333402] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:15.335976] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15651 primary records. [2025-10-21T22:09:15.336600] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-10-21T22:09:15.357942] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-10-21T22:09:15.358355] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-10-21T22:09:15.362106] [INFO ] [MAIN ] Derivative Progress: 799/2057 symbols completed. GUT took 1.1s. Estimated remaining: 7m 57s. Rate: 158.3 symbols/min [2025-10-21T22:09:15.370318] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:15.376365] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:15.377181] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 19825 primary records. [2025-10-21T22:09:15.377362] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-10-21T22:09:15.394904] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-10-21T22:09:15.395100] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-10-21T22:09:15.398288] [INFO ] [MAIN ] Derivative Progress: 800/2057 symbols completed. GWH took 1.0s. Estimated remaining: 7m 56s. Rate: 158.5 symbols/min [2025-10-21T22:09:15.399247] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:15.413472] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:15.414198] [INFO ] [MAIN ] GVA: Generated 1793 derivative records from 32612 primary records. [2025-10-21T22:09:15.414366] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-10-21T22:09:15.445469] [DEBUG] [LOCAL ] GVA: Derivative data saved (1793 records). [2025-10-21T22:09:15.445743] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-10-21T22:09:15.448882] [INFO ] [MAIN ] Derivative Progress: 801/2057 symbols completed. GVA took 1.1s. Estimated remaining: 7m 55s. Rate: 158.7 symbols/min [2025-10-21T22:09:15.449066] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:15.459566] [DEBUG] [LOCAL ] GWW: Loaded 19293 existing records from primary storage. [2025-10-21T22:09:15.460500] [INFO ] [MAIN ] GWW: Loaded 19293 primary data records. [2025-10-21T22:09:15.515672] [DEBUG] [LOCAL ] GWRE: Loaded 39681 existing records from primary storage. [2025-10-21T22:09:15.541431] [INFO ] [MAIN ] GWRE: Loaded 39681 primary data records. [2025-10-21T22:09:15.992458] [DEBUG] [LOCAL ] GXO: Loaded 46525 existing records from primary storage. [2025-10-21T22:09:15.998986] [INFO ] [MAIN ] GXO: Loaded 46525 primary data records. [2025-10-21T22:09:16.463283] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:16.462919] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:16.464242] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 39681 primary records. [2025-10-21T22:09:16.464528] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-10-21T22:09:16.465252] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 19293 primary records. [2025-10-21T22:09:16.465543] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-10-21T22:09:16.493779] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-10-21T22:09:16.497125] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-10-21T22:09:16.499890] [INFO ] [MAIN ] Derivative Progress: 802/2057 symbols completed. GWRE took 1.1s. Estimated remaining: 7m 56s. Rate: 158.3 symbols/min [2025-10-21T22:09:16.501259] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-10-21T22:09:16.500324] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:16.501630] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-10-21T22:09:16.504328] [INFO ] [MAIN ] Derivative Progress: 803/2057 symbols completed. GWW took 1.1s. Estimated remaining: 7m 55s. Rate: 158.5 symbols/min [2025-10-21T22:09:16.505520] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:16.523434] [DEBUG] [LOCAL ] GYLD: Loaded 1549 existing records from primary storage. [2025-10-21T22:09:16.524069] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:16.524140] [INFO ] [MAIN ] GYLD: Loaded 1549 primary data records. [2025-10-21T22:09:16.524794] [INFO ] [MAIN ] GXO: Generated 1793 derivative records from 46525 primary records. [2025-10-21T22:09:16.524893] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-10-21T22:09:16.605262] [DEBUG] [LOCAL ] GXO: Derivative data saved (1793 records). [2025-10-21T22:09:16.610536] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-10-21T22:09:16.626086] [INFO ] [MAIN ] Derivative Progress: 804/2057 symbols completed. GXO took 1.2s. Estimated remaining: 7m 54s. Rate: 158.6 symbols/min [2025-10-21T22:09:16.637309] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:16.903469] [DEBUG] [LOCAL ] H: Loaded 44375 existing records from primary storage. [2025-10-21T22:09:16.904344] [INFO ] [MAIN ] H: Loaded 44375 primary data records. [2025-10-21T22:09:17.033445] [DEBUG] [LOCAL ] HAE: Loaded 39378 existing records from primary storage. [2025-10-21T22:09:17.078891] [INFO ] [MAIN ] HAE: Loaded 39378 primary data records. [2025-10-21T22:09:17.443496] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:17.559713] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1549 primary records. [2025-10-21T22:09:17.570817] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-10-21T22:09:17.593239] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-10-21T22:09:17.593990] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-10-21T22:09:17.598365] [INFO ] [MAIN ] Derivative Progress: 805/2057 symbols completed. GYLD took 1.1s. Estimated remaining: 7m 54s. Rate: 158.3 symbols/min [2025-10-21T22:09:17.598609] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:17.622330] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:17.623671] [INFO ] [MAIN ] H: Generated 1794 derivative records from 44375 primary records. [2025-10-21T22:09:17.624047] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-10-21T22:09:17.642835] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-10-21T22:09:17.643439] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-10-21T22:09:17.646238] [INFO ] [MAIN ] Derivative Progress: 806/2057 symbols completed. H took 1.1s. Estimated remaining: 7m 54s. Rate: 158.5 symbols/min [2025-10-21T22:09:17.646466] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:17.677114] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:17.678011] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39378 primary records. [2025-10-21T22:09:17.678195] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-10-21T22:09:17.711272] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-10-21T22:09:17.707877] [DEBUG] [LOCAL ] HAFN: Loaded 42724 existing records from primary storage. [2025-10-21T22:09:17.711730] [INFO ] [MAIN ] HAFN: Loaded 42724 primary data records. [2025-10-21T22:09:17.711579] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-10-21T22:09:17.716371] [INFO ] [MAIN ] Derivative Progress: 807/2057 symbols completed. HAE took 1.1s. Estimated remaining: 7m 53s. Rate: 158.7 symbols/min [2025-10-21T22:09:17.721930] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:18.056609] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-21T22:09:18.057146] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-10-21T22:09:18.240122] [DEBUG] [LOCAL ] HASI: Loaded 47751 existing records from primary storage. [2025-10-21T22:09:18.265668] [INFO ] [MAIN ] HASI: Loaded 47751 primary data records. [2025-10-21T22:09:18.808295] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:18.809236] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 42724 primary records. [2025-10-21T22:09:18.809442] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-10-21T22:09:18.827705] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-10-21T22:09:18.828208] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-10-21T22:09:18.833274] [INFO ] [MAIN ] Derivative Progress: 808/2057 symbols completed. HAFN took 1.2s. Estimated remaining: 7m 53s. Rate: 158.3 symbols/min [2025-10-21T22:09:18.848173] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:18.849540] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-10-21T22:09:18.850516] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-10-21T22:09:18.867263] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-10-21T22:09:18.867350] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-10-21T22:09:18.869983] [INFO ] [MAIN ] Derivative Progress: 809/2057 symbols completed. HAL took 1.2s. Estimated remaining: 7m 53s. Rate: 158.5 symbols/min [2025-10-21T22:09:18.888269] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:18.889070] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47751 primary records. [2025-10-21T22:09:18.889137] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-10-21T22:09:18.905347] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-10-21T22:09:18.905425] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-10-21T22:09:18.909879] [INFO ] [MAIN ] Derivative Progress: 810/2057 symbols completed. HASI took 1.2s. Estimated remaining: 7m 52s. Rate: 158.6 symbols/min [2025-10-21T22:09:18.910358] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:18.910498] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:18.910624] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:19.003021] [DEBUG] [LOCAL ] HBI: Loaded 52933 existing records from primary storage. [2025-10-21T22:09:19.018367] [DEBUG] [LOCAL ] HAYW: Loaded 48821 existing records from primary storage. [2025-10-21T22:09:19.018524] [INFO ] [MAIN ] HBI: Loaded 52933 primary data records. [2025-10-21T22:09:19.018783] [INFO ] [MAIN ] HAYW: Loaded 48821 primary data records. [2025-10-21T22:09:19.025105] [DEBUG] [LOCAL ] HCA: Loaded 46914 existing records from primary storage. [2025-10-21T22:09:19.032073] [INFO ] [MAIN ] HCA: Loaded 46914 primary data records. [2025-10-21T22:09:20.009955] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:20.013917] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 52933 primary records. [2025-10-21T22:09:20.015739] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-10-21T22:09:20.030766] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:20.058979] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-10-21T22:09:20.060073] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48821 primary records. [2025-10-21T22:09:20.060187] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-10-21T22:09:20.060676] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-10-21T22:09:20.060559] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:20.062548] [INFO ] [MAIN ] Derivative Progress: 811/2057 symbols completed. HBI took 1.2s. Estimated remaining: 7m 52s. Rate: 158.2 symbols/min [2025-10-21T22:09:20.064461] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:20.064322] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 46914 primary records. [2025-10-21T22:09:20.065088] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-10-21T22:09:20.082822] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-10-21T22:09:20.090187] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-10-21T22:09:20.097319] [INFO ] [MAIN ] Derivative Progress: 812/2057 symbols completed. HAYW took 1.2s. Estimated remaining: 7m 52s. Rate: 158.4 symbols/min [2025-10-21T22:09:20.100753] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:20.103289] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-10-21T22:09:20.103436] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-10-21T22:09:20.105911] [INFO ] [MAIN ] Derivative Progress: 813/2057 symbols completed. HCA took 1.2s. Estimated remaining: 7m 51s. Rate: 158.6 symbols/min [2025-10-21T22:09:20.106172] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:20.121735] [DEBUG] [LOCAL ] HCI: Loaded 14056 existing records from primary storage. [2025-10-21T22:09:20.133878] [INFO ] [MAIN ] HCI: Loaded 14056 primary data records. [2025-10-21T22:09:20.272577] [DEBUG] [LOCAL ] HCC: Loaded 45053 existing records from primary storage. [2025-10-21T22:09:20.339810] [INFO ] [MAIN ] HCC: Loaded 45053 primary data records. [2025-10-21T22:09:20.539993] [DEBUG] [LOCAL ] HD: Loaded 53476 existing records from primary storage. [2025-10-21T22:09:20.553134] [INFO ] [MAIN ] HD: Loaded 53476 primary data records. [2025-10-21T22:09:21.164521] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:21.165629] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 14056 primary records. [2025-10-21T22:09:21.166068] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-10-21T22:09:21.183553] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-10-21T22:09:21.184009] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-10-21T22:09:21.188589] [INFO ] [MAIN ] Derivative Progress: 814/2057 symbols completed. HCI took 1.1s. Estimated remaining: 7m 51s. Rate: 158.2 symbols/min [2025-10-21T22:09:21.189145] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:21.202907] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:21.203576] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45053 primary records. [2025-10-21T22:09:21.203707] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-10-21T22:09:21.221760] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-10-21T22:09:21.222098] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-10-21T22:09:21.223945] [INFO ] [MAIN ] Derivative Progress: 815/2057 symbols completed. HCC took 1.2s. Estimated remaining: 7m 50s. Rate: 158.4 symbols/min [2025-10-21T22:09:21.236575] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:21.236960] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:21.237932] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53476 primary records. [2025-10-21T22:09:21.238114] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-10-21T22:09:21.255549] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-10-21T22:09:21.255833] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-10-21T22:09:21.258625] [INFO ] [MAIN ] Derivative Progress: 816/2057 symbols completed. HD took 1.2s. Estimated remaining: 7m 49s. Rate: 158.6 symbols/min [2025-10-21T22:09:21.258935] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:21.312744] [DEBUG] [LOCAL ] HDB: Loaded 51909 existing records from primary storage. [2025-10-21T22:09:21.312958] [INFO ] [MAIN ] HDB: Loaded 51909 primary data records. [2025-10-21T22:09:21.416802] [DEBUG] [LOCAL ] HEI: Loaded 30723 existing records from primary storage. [2025-10-21T22:09:21.441059] [INFO ] [MAIN ] HEI: Loaded 30723 primary data records. [2025-10-21T22:09:21.463078] [DEBUG] [LOCAL ] HE: Loaded 48826 existing records from primary storage. [2025-10-21T22:09:21.513800] [INFO ] [MAIN ] HE: Loaded 48826 primary data records. [2025-10-21T22:09:22.310246] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:22.311507] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51909 primary records. [2025-10-21T22:09:22.311723] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-10-21T22:09:22.334217] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-10-21T22:09:22.346950] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-10-21T22:09:22.349179] [INFO ] [MAIN ] Derivative Progress: 817/2057 symbols completed. HDB took 1.2s. Estimated remaining: 7m 50s. Rate: 158.2 symbols/min [2025-10-21T22:09:22.347350] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:22.350109] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:22.349998] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 48826 primary records. [2025-10-21T22:09:22.363192] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-10-21T22:09:22.363986] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:22.364957] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 30723 primary records. [2025-10-21T22:09:22.372454] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-10-21T22:09:22.382154] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-10-21T22:09:22.382289] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-10-21T22:09:22.385068] [INFO ] [MAIN ] Derivative Progress: 818/2057 symbols completed. HE took 1.1s. Estimated remaining: 7m 49s. Rate: 158.4 symbols/min [2025-10-21T22:09:22.385771] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:22.397356] [DEBUG] [LOCAL ] HEQ: Loaded 6795 existing records from primary storage. [2025-10-21T22:09:22.402890] [INFO ] [MAIN ] HEQ: Loaded 6795 primary data records. [2025-10-21T22:09:22.475257] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-10-21T22:09:22.498560] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-10-21T22:09:22.512781] [INFO ] [MAIN ] Derivative Progress: 819/2057 symbols completed. HEI took 1.3s. Estimated remaining: 7m 49s. Rate: 158.5 symbols/min [2025-10-21T22:09:22.513009] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:22.731817] [DEBUG] [LOCAL ] HFRO: Loaded 16466 existing records from primary storage. [2025-10-21T22:09:22.732576] [INFO ] [MAIN ] HFRO: Loaded 16466 primary data records. [2025-10-21T22:09:22.813547] [DEBUG] [LOCAL ] HESM: Loaded 48621 existing records from primary storage. [2025-10-21T22:09:22.836725] [INFO ] [MAIN ] HESM: Loaded 48621 primary data records. [2025-10-21T22:09:23.428191] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:23.429141] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6795 primary records. [2025-10-21T22:09:23.429631] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-10-21T22:09:23.448273] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-10-21T22:09:23.448787] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-10-21T22:09:23.450854] [INFO ] [MAIN ] Derivative Progress: 820/2057 symbols completed. HEQ took 1.1s. Estimated remaining: 7m 49s. Rate: 158.3 symbols/min [2025-10-21T22:09:23.458527] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:23.464596] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:23.465630] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 16466 primary records. [2025-10-21T22:09:23.465795] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-10-21T22:09:23.496966] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:23.499805] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48621 primary records. [2025-10-21T22:09:23.502089] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-10-21T22:09:23.502038] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-10-21T22:09:23.503347] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-10-21T22:09:23.518467] [INFO ] [MAIN ] Derivative Progress: 821/2057 symbols completed. HFRO took 1.0s. Estimated remaining: 7m 48s. Rate: 158.4 symbols/min [2025-10-21T22:09:23.518680] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:23.519243] [DEBUG] [LOCAL ] HGER: Loaded 15479 existing records from primary storage. [2025-10-21T22:09:23.523042] [INFO ] [MAIN ] HGER: Loaded 15479 primary data records. [2025-10-21T22:09:23.563668] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-10-21T22:09:23.563859] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-10-21T22:09:23.585021] [INFO ] [MAIN ] Derivative Progress: 822/2057 symbols completed. HESM took 1.2s. Estimated remaining: 7m 47s. Rate: 158.6 symbols/min [2025-10-21T22:09:23.607816] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:23.690094] [DEBUG] [LOCAL ] HGLB: Loaded 9704 existing records from primary storage. [2025-10-21T22:09:23.834629] [DEBUG] [LOCAL ] HGTY: Loaded 13379 existing records from primary storage. [2025-10-21T22:09:23.834875] [INFO ] [MAIN ] HGTY: Loaded 13379 primary data records. [2025-10-21T22:09:23.834184] [INFO ] [MAIN ] HGLB: Loaded 9704 primary data records. [2025-10-21T22:09:24.464440] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:24.466790] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 15479 primary records. [2025-10-21T22:09:24.467055] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-10-21T22:09:24.484677] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-10-21T22:09:24.484901] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-10-21T22:09:24.486951] [INFO ] [MAIN ] Derivative Progress: 823/2057 symbols completed. HGER took 1.0s. Estimated remaining: 7m 48s. Rate: 158.3 symbols/min [2025-10-21T22:09:24.504734] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:24.505557] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 13379 primary records. [2025-10-21T22:09:24.505669] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-10-21T22:09:24.536215] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:24.537166] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-10-21T22:09:24.538057] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9704 primary records. [2025-10-21T22:09:24.538137] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-10-21T22:09:24.540964] [INFO ] [MAIN ] Derivative Progress: 824/2057 symbols completed. HGTY took 0.9s. Estimated remaining: 7m 47s. Rate: 158.5 symbols/min [2025-10-21T22:09:24.541238] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-10-21T22:09:24.555994] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-10-21T22:09:24.556059] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-10-21T22:09:24.558483] [INFO ] [MAIN ] Derivative Progress: 825/2057 symbols completed. HGLB took 1.0s. Estimated remaining: 7m 46s. Rate: 158.7 symbols/min [2025-10-21T22:09:24.559104] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:24.559389] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:24.559602] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:24.622753] [DEBUG] [LOCAL ] HHH: Loaded 33152 existing records from primary storage. [2025-10-21T22:09:24.623411] [INFO ] [MAIN ] HHH: Loaded 33152 primary data records. [2025-10-21T22:09:24.658867] [DEBUG] [LOCAL ] HI: Loaded 36113 existing records from primary storage. [2025-10-21T22:09:24.659012] [INFO ] [MAIN ] HI: Loaded 36113 primary data records. [2025-10-21T22:09:24.872316] [DEBUG] [LOCAL ] HGV: Loaded 46110 existing records from primary storage. [2025-10-21T22:09:24.873254] [INFO ] [MAIN ] HGV: Loaded 46110 primary data records. [2025-10-21T22:09:25.662290] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:25.661849] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:25.663392] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 36113 primary records. [2025-10-21T22:09:25.672423] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-10-21T22:09:25.672326] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 33152 primary records. [2025-10-21T22:09:25.678234] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-10-21T22:09:25.678563] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:25.690330] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 46110 primary records. [2025-10-21T22:09:25.693328] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-10-21T22:09:25.713193] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-10-21T22:09:25.727856] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-10-21T22:09:25.729785] [INFO ] [MAIN ] Derivative Progress: 826/2057 symbols completed. HHH took 1.2s. Estimated remaining: 7m 47s. Rate: 158.2 symbols/min [2025-10-21T22:09:25.731417] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-10-21T22:09:25.727736] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-10-21T22:09:25.731635] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-10-21T22:09:25.735819] [INFO ] [MAIN ] Derivative Progress: 827/2057 symbols completed. HI took 1.2s. Estimated remaining: 7m 46s. Rate: 158.4 symbols/min [2025-10-21T22:09:25.731965] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-10-21T22:09:25.731788] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:25.739377] [INFO ] [MAIN ] Derivative Progress: 828/2057 symbols completed. HGV took 1.2s. Estimated remaining: 7m 45s. Rate: 158.6 symbols/min [2025-10-21T22:09:25.739294] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:25.740124] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:25.801859] [DEBUG] [LOCAL ] HII: Loaded 33494 existing records from primary storage. [2025-10-21T22:09:25.802111] [INFO ] [MAIN ] HII: Loaded 33494 primary data records. [2025-10-21T22:09:25.953685] [DEBUG] [LOCAL ] HIG: Loaded 51173 existing records from primary storage. [2025-10-21T22:09:25.959466] [INFO ] [MAIN ] HIG: Loaded 51173 primary data records. [2025-10-21T22:09:25.965292] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-21T22:09:25.991327] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-10-21T22:09:26.943183] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:26.958069] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 33494 primary records. [2025-10-21T22:09:26.958372] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:26.958820] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-10-21T22:09:26.960076] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-10-21T22:09:26.960265] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-10-21T22:09:26.989469] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-10-21T22:09:26.990087] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-10-21T22:09:26.994479] [INFO ] [MAIN ] Derivative Progress: 829/2057 symbols completed. HIMS took 1.3s. Estimated remaining: 7m 46s. Rate: 158.2 symbols/min [2025-10-21T22:09:26.994906] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-10-21T22:09:26.995108] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:26.995004] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-10-21T22:09:26.998311] [INFO ] [MAIN ] Derivative Progress: 830/2057 symbols completed. HII took 1.3s. Estimated remaining: 7m 45s. Rate: 158.4 symbols/min [2025-10-21T22:09:27.000068] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:27.025918] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:27.027181] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51173 primary records. [2025-10-21T22:09:27.033563] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-10-21T22:09:27.074405] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-10-21T22:09:27.082714] [DEBUG] [LOCAL ] HIO: Loaded 24124 existing records from primary storage. [2025-10-21T22:09:27.082887] [INFO ] [MAIN ] HIO: Loaded 24124 primary data records. [2025-10-21T22:09:27.082041] [DEBUG] [LOCAL ] HIPO: Loaded 21512 existing records from primary storage. [2025-10-21T22:09:27.083076] [INFO ] [MAIN ] HIPO: Loaded 21512 primary data records. [2025-10-21T22:09:27.094584] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-10-21T22:09:27.181842] [INFO ] [MAIN ] Derivative Progress: 831/2057 symbols completed. HIG took 1.5s. Estimated remaining: 7m 44s. Rate: 158.5 symbols/min [2025-10-21T22:09:27.229760] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:27.732102] [DEBUG] [LOCAL ] HIW: Loaded 44457 existing records from primary storage. [2025-10-21T22:09:27.732511] [INFO ] [MAIN ] HIW: Loaded 44457 primary data records. [2025-10-21T22:09:28.041011] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:28.042694] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 24124 primary records. [2025-10-21T22:09:28.042892] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-10-21T22:09:28.057942] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:28.066490] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 21512 primary records. [2025-10-21T22:09:28.074310] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-10-21T22:09:28.074258] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-10-21T22:09:28.074535] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-10-21T22:09:28.076896] [INFO ] [MAIN ] Derivative Progress: 832/2057 symbols completed. HIO took 1.1s. Estimated remaining: 7m 45s. Rate: 158.2 symbols/min [2025-10-21T22:09:28.078304] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:28.094684] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-10-21T22:09:28.095209] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-10-21T22:09:28.097904] [INFO ] [MAIN ] Derivative Progress: 833/2057 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 44s. Rate: 158.4 symbols/min [2025-10-21T22:09:28.098101] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:28.115163] [DEBUG] [LOCAL ] HIX: Loaded 20379 existing records from primary storage. [2025-10-21T22:09:28.115534] [INFO ] [MAIN ] HIX: Loaded 20379 primary data records. [2025-10-21T22:09:28.168409] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:28.203485] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44457 primary records. [2025-10-21T22:09:28.208727] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-10-21T22:09:28.226583] [DEBUG] [LOCAL ] HKD: Loaded 18717 existing records from primary storage. [2025-10-21T22:09:28.240709] [INFO ] [MAIN ] HKD: Loaded 18717 primary data records. [2025-10-21T22:09:28.326787] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-10-21T22:09:28.346458] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-10-21T22:09:28.352550] [INFO ] [MAIN ] Derivative Progress: 834/2057 symbols completed. HIW took 1.1s. Estimated remaining: 7m 43s. Rate: 158.5 symbols/min [2025-10-21T22:09:28.365740] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:28.827904] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:28.829202] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20379 primary records. [2025-10-21T22:09:28.829483] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-10-21T22:09:28.861611] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-10-21T22:09:28.862893] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-21T22:09:28.863105] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-10-21T22:09:28.866232] [INFO ] [MAIN ] Derivative Progress: 835/2057 symbols completed. HIX took 0.8s. Estimated remaining: 7m 43s. Rate: 158.4 symbols/min [2025-10-21T22:09:28.864332] [INFO ] [MAIN ] HL: Loaded 53676 primary data records. [2025-10-21T22:09:28.867908] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:28.917048] [DEBUG] [MAIN ] HKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:28.945223] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 18717 primary records. [2025-10-21T22:09:28.980217] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-10-21T22:09:29.067432] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-10-21T22:09:29.072823] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-10-21T22:09:29.099959] [INFO ] [MAIN ] Derivative Progress: 836/2057 symbols completed. HKD took 1.0s. Estimated remaining: 7m 42s. Rate: 158.5 symbols/min [2025-10-21T22:09:29.137158] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:29.301458] [DEBUG] [LOCAL ] HLF: Loaded 48506 existing records from primary storage. [2025-10-21T22:09:29.302094] [INFO ] [MAIN ] HLF: Loaded 48506 primary data records. [2025-10-21T22:09:29.638071] [DEBUG] [LOCAL ] HLI: Loaded 30693 existing records from primary storage. [2025-10-21T22:09:29.638696] [INFO ] [MAIN ] HLI: Loaded 30693 primary data records. [2025-10-21T22:09:29.787217] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:29.830198] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53676 primary records. [2025-10-21T22:09:29.850824] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-10-21T22:09:29.995496] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-10-21T22:09:30.007447] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-10-21T22:09:30.011196] [INFO ] [MAIN ] Derivative Progress: 837/2057 symbols completed. HL took 1.6s. Estimated remaining: 7m 43s. Rate: 158.2 symbols/min [2025-10-21T22:09:30.011678] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:30.037392] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:30.038481] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48506 primary records. [2025-10-21T22:09:30.039055] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-10-21T22:09:30.065596] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-10-21T22:09:30.065770] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-10-21T22:09:30.068889] [INFO ] [MAIN ] Derivative Progress: 838/2057 symbols completed. HLF took 1.2s. Estimated remaining: 7m 42s. Rate: 158.4 symbols/min [2025-10-21T22:09:30.080260] [DEBUG] [LOCAL ] HLIO: Loaded 28169 existing records from primary storage. [2025-10-21T22:09:30.080758] [INFO ] [MAIN ] HLIO: Loaded 28169 primary data records. [2025-10-21T22:09:30.272302] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:30.274906] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 30693 primary records. [2025-10-21T22:09:30.278317] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-10-21T22:09:30.408551] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-10-21T22:09:30.408714] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-10-21T22:09:30.412445] [INFO ] [MAIN ] Derivative Progress: 839/2057 symbols completed. HLI took 1.3s. Estimated remaining: 7m 41s. Rate: 158.4 symbols/min [2025-10-21T22:09:30.433213] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:30.433930] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28169 primary records. [2025-10-21T22:09:30.433996] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-10-21T22:09:30.449568] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-10-21T22:09:30.449699] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-10-21T22:09:30.451855] [INFO ] [MAIN ] Derivative Progress: 840/2057 symbols completed. HLIO took 0.4s. Estimated remaining: 7m 41s. Rate: 158.5 symbols/min [2025-10-21T22:09:30.452458] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:30.452585] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:30.452716] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:30.513304] [DEBUG] [LOCAL ] HLLY: Loaded 33260 existing records from primary storage. [2025-10-21T22:09:30.513470] [INFO ] [MAIN ] HLLY: Loaded 33260 primary data records. [2025-10-21T22:09:30.660867] [DEBUG] [LOCAL ] HLT: Loaded 50463 existing records from primary storage. [2025-10-21T22:09:30.687419] [INFO ] [MAIN ] HLT: Loaded 50463 primary data records. [2025-10-21T22:09:30.755633] [DEBUG] [LOCAL ] HLN: Loaded 53131 existing records from primary storage. [2025-10-21T22:09:30.771423] [INFO ] [MAIN ] HLN: Loaded 53131 primary data records. [2025-10-21T22:09:31.530032] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:31.531172] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33260 primary records. [2025-10-21T22:09:31.531500] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-10-21T22:09:31.549936] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-10-21T22:09:31.550887] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-10-21T22:09:31.552631] [INFO ] [MAIN ] Derivative Progress: 841/2057 symbols completed. HLLY took 1.1s. Estimated remaining: 7m 41s. Rate: 158.2 symbols/min [2025-10-21T22:09:31.552928] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:31.566469] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:31.567488] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50463 primary records. [2025-10-21T22:09:31.567826] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-10-21T22:09:31.586729] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-10-21T22:09:31.586961] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-10-21T22:09:31.589855] [INFO ] [MAIN ] Derivative Progress: 842/2057 symbols completed. HLT took 1.1s. Estimated remaining: 7m 40s. Rate: 158.4 symbols/min [2025-10-21T22:09:31.597780] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:31.603854] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:31.604635] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53131 primary records. [2025-10-21T22:09:31.604826] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-10-21T22:09:31.631382] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-10-21T22:09:31.631662] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-10-21T22:09:31.634141] [INFO ] [MAIN ] Derivative Progress: 843/2057 symbols completed. HLN took 1.2s. Estimated remaining: 7m 40s. Rate: 158.5 symbols/min [2025-10-21T22:09:31.634469] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:31.653262] [DEBUG] [LOCAL ] HLX: Loaded 47394 existing records from primary storage. [2025-10-21T22:09:31.653615] [INFO ] [MAIN ] HLX: Loaded 47394 primary data records. [2025-10-21T22:09:31.778318] [DEBUG] [LOCAL ] HMN: Loaded 23409 existing records from primary storage. [2025-10-21T22:09:31.778669] [INFO ] [MAIN ] HMN: Loaded 23409 primary data records. [2025-10-21T22:09:31.887472] [DEBUG] [LOCAL ] HMC: Loaded 46311 existing records from primary storage. [2025-10-21T22:09:31.951528] [INFO ] [MAIN ] HMC: Loaded 46311 primary data records. [2025-10-21T22:09:32.607563] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:32.608608] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 47394 primary records. [2025-10-21T22:09:32.608794] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-10-21T22:09:32.626227] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-10-21T22:09:32.627146] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-10-21T22:09:32.629780] [INFO ] [MAIN ] Derivative Progress: 844/2057 symbols completed. HLX took 1.1s. Estimated remaining: 7m 40s. Rate: 158.2 symbols/min [2025-10-21T22:09:32.637720] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:32.644501] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:32.645714] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23409 primary records. [2025-10-21T22:09:32.645821] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-10-21T22:09:32.663909] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-10-21T22:09:32.665882] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-10-21T22:09:32.680676] [INFO ] [MAIN ] Derivative Progress: 845/2057 symbols completed. HMN took 1.0s. Estimated remaining: 7m 39s. Rate: 158.4 symbols/min [2025-10-21T22:09:32.681402] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:32.681314] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:32.682224] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 46311 primary records. [2025-10-21T22:09:32.682736] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-10-21T22:09:32.698882] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-10-21T22:09:32.711915] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-10-21T22:09:32.714567] [INFO ] [MAIN ] Derivative Progress: 846/2057 symbols completed. HMC took 1.1s. Estimated remaining: 7m 38s. Rate: 158.5 symbols/min [2025-10-21T22:09:32.714892] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:32.752395] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-21T22:09:32.753585] [INFO ] [MAIN ] HMY: Loaded 53166 primary data records. [2025-10-21T22:09:32.754223] [DEBUG] [LOCAL ] HNI: Loaded 29744 existing records from primary storage. [2025-10-21T22:09:32.785520] [INFO ] [MAIN ] HNI: Loaded 29744 primary data records. [2025-10-21T22:09:33.127353] [DEBUG] [LOCAL ] HOG: Loaded 50674 existing records from primary storage. [2025-10-21T22:09:33.308365] [INFO ] [MAIN ] HOG: Loaded 50674 primary data records. [2025-10-21T22:09:33.758177] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:33.759787] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53166 primary records. [2025-10-21T22:09:33.773586] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-10-21T22:09:33.773447] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:33.775377] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 29744 primary records. [2025-10-21T22:09:33.782580] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-10-21T22:09:33.799045] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-10-21T22:09:33.800505] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-10-21T22:09:33.802628] [INFO ] [MAIN ] Derivative Progress: 847/2057 symbols completed. HMY took 1.2s. Estimated remaining: 7m 39s. Rate: 158.2 symbols/min [2025-10-21T22:09:33.802843] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:33.811020] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-10-21T22:09:33.811476] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-10-21T22:09:33.814599] [INFO ] [MAIN ] Derivative Progress: 848/2057 symbols completed. HNI took 1.1s. Estimated remaining: 7m 38s. Rate: 158.4 symbols/min [2025-10-21T22:09:33.815061] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:33.832310] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:33.833038] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 50674 primary records. [2025-10-21T22:09:33.833100] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-10-21T22:09:33.849160] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-10-21T22:09:33.849330] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-10-21T22:09:33.852018] [INFO ] [MAIN ] Derivative Progress: 849/2057 symbols completed. HOG took 1.1s. Estimated remaining: 7m 37s. Rate: 158.5 symbols/min [2025-10-21T22:09:33.852151] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:33.898493] [DEBUG] [LOCAL ] HOV: Loaded 13930 existing records from primary storage. [2025-10-21T22:09:33.899282] [INFO ] [MAIN ] HOV: Loaded 13930 primary data records. [2025-10-21T22:09:33.900402] [DEBUG] [LOCAL ] HOMB: Loaded 43717 existing records from primary storage. [2025-10-21T22:09:33.900821] [INFO ] [MAIN ] HOMB: Loaded 43717 primary data records. [2025-10-21T22:09:34.049609] [DEBUG] [LOCAL ] HOUS: Loaded 45708 existing records from primary storage. [2025-10-21T22:09:34.120929] [INFO ] [MAIN ] HOUS: Loaded 45708 primary data records. [2025-10-21T22:09:34.847852] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:34.849122] [INFO ] [MAIN ] HOV: Generated 1793 derivative records from 13930 primary records. [2025-10-21T22:09:34.849401] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-10-21T22:09:34.867759] [DEBUG] [LOCAL ] HOV: Derivative data saved (1793 records). [2025-10-21T22:09:34.867873] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-10-21T22:09:34.870414] [INFO ] [MAIN ] Derivative Progress: 850/2057 symbols completed. HOV took 1.0s. Estimated remaining: 7m 38s. Rate: 158.2 symbols/min [2025-10-21T22:09:34.870831] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:34.885772] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:34.886962] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43717 primary records. [2025-10-21T22:09:34.887183] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-10-21T22:09:34.906336] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-10-21T22:09:34.906756] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-10-21T22:09:34.908955] [INFO ] [MAIN ] Derivative Progress: 851/2057 symbols completed. HOMB took 1.1s. Estimated remaining: 7m 37s. Rate: 158.4 symbols/min [2025-10-21T22:09:34.909341] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:34.923337] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:34.924213] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 45708 primary records. [2025-10-21T22:09:34.924541] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-10-21T22:09:34.940775] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-10-21T22:09:34.953541] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-10-21T22:09:34.956203] [INFO ] [MAIN ] Derivative Progress: 852/2057 symbols completed. HOUS took 1.1s. Estimated remaining: 7m 36s. Rate: 158.6 symbols/min [2025-10-21T22:09:34.956618] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:34.978686] [DEBUG] [LOCAL ] HPF: Loaded 7532 existing records from primary storage. [2025-10-21T22:09:34.993955] [INFO ] [MAIN ] HPF: Loaded 7532 primary data records. [2025-10-21T22:09:35.039973] [DEBUG] [LOCAL ] HP: Loaded 51425 existing records from primary storage. [2025-10-21T22:09:35.052912] [INFO ] [MAIN ] HP: Loaded 51425 primary data records. [2025-10-21T22:09:35.189387] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-21T22:09:35.236331] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-10-21T22:09:35.979634] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:35.980533] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7532 primary records. [2025-10-21T22:09:35.980760] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-10-21T22:09:35.998361] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-10-21T22:09:35.999193] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-10-21T22:09:36.002496] [INFO ] [MAIN ] Derivative Progress: 853/2057 symbols completed. HPF took 1.0s. Estimated remaining: 7m 37s. Rate: 158.2 symbols/min [2025-10-21T22:09:36.015997] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:36.016850] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51425 primary records. [2025-10-21T22:09:36.016985] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-10-21T22:09:36.029242] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:36.030121] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-10-21T22:09:36.030345] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-10-21T22:09:36.059016] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-10-21T22:09:36.060341] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-10-21T22:09:36.060295] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-10-21T22:09:36.062807] [INFO ] [MAIN ] Derivative Progress: 854/2057 symbols completed. HPE took 1.2s. Estimated remaining: 7m 36s. Rate: 158.4 symbols/min [2025-10-21T22:09:36.062896] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-10-21T22:09:36.065559] [INFO ] [MAIN ] Derivative Progress: 855/2057 symbols completed. HP took 1.2s. Estimated remaining: 7m 35s. Rate: 158.6 symbols/min [2025-10-21T22:09:36.066110] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:36.065979] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:36.066048] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:36.081218] [DEBUG] [LOCAL ] HPI: Loaded 10779 existing records from primary storage. [2025-10-21T22:09:36.081315] [INFO ] [MAIN ] HPI: Loaded 10779 primary data records. [2025-10-21T22:09:36.438910] [DEBUG] [LOCAL ] HPP: Loaded 51238 existing records from primary storage. [2025-10-21T22:09:36.439750] [INFO ] [MAIN ] HPP: Loaded 51238 primary data records. [2025-10-21T22:09:36.440574] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-21T22:09:36.461461] [INFO ] [MAIN ] HPQ: Loaded 53669 primary data records. [2025-10-21T22:09:37.107799] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:37.108810] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 10779 primary records. [2025-10-21T22:09:37.108986] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-10-21T22:09:37.125660] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-10-21T22:09:37.126001] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-10-21T22:09:37.128449] [INFO ] [MAIN ] Derivative Progress: 856/2057 symbols completed. HPI took 1.1s. Estimated remaining: 7m 35s. Rate: 158.2 symbols/min [2025-10-21T22:09:37.129715] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:37.159884] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:37.160190] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:37.161096] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 51238 primary records. [2025-10-21T22:09:37.163592] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-10-21T22:09:37.164599] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53669 primary records. [2025-10-21T22:09:37.164912] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-10-21T22:09:37.205875] [DEBUG] [LOCAL ] HPS: Loaded 10360 existing records from primary storage. [2025-10-21T22:09:37.206027] [INFO ] [MAIN ] HPS: Loaded 10360 primary data records. [2025-10-21T22:09:37.229946] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-10-21T22:09:37.246165] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-10-21T22:09:37.246058] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-10-21T22:09:37.260850] [INFO ] [MAIN ] Derivative Progress: 857/2057 symbols completed. HPP took 1.2s. Estimated remaining: 7m 35s. Rate: 158.4 symbols/min [2025-10-21T22:09:37.281944] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:37.282133] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-10-21T22:09:37.284509] [INFO ] [MAIN ] Derivative Progress: 858/2057 symbols completed. HPQ took 1.2s. Estimated remaining: 7m 34s. Rate: 158.5 symbols/min [2025-10-21T22:09:37.296806] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:37.538908] [DEBUG] [LOCAL ] HQL: Loaded 16952 existing records from primary storage. [2025-10-21T22:09:37.539559] [DEBUG] [LOCAL ] HQH: Loaded 25808 existing records from primary storage. [2025-10-21T22:09:37.539905] [INFO ] [MAIN ] HQH: Loaded 25808 primary data records. [2025-10-21T22:09:37.539810] [INFO ] [MAIN ] HQL: Loaded 16952 primary data records. [2025-10-21T22:09:38.160013] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:38.161111] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10360 primary records. [2025-10-21T22:09:38.161418] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-10-21T22:09:38.179101] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-10-21T22:09:38.180299] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-10-21T22:09:38.184361] [INFO ] [MAIN ] Derivative Progress: 859/2057 symbols completed. HPS took 1.1s. Estimated remaining: 7m 34s. Rate: 158.3 symbols/min [2025-10-21T22:09:38.184772] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:38.199824] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:38.200979] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16952 primary records. [2025-10-21T22:09:38.201890] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-10-21T22:09:38.229051] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:38.233169] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 25808 primary records. [2025-10-21T22:09:38.234332] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-10-21T22:09:38.234781] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-10-21T22:09:38.234512] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-10-21T22:09:38.237249] [INFO ] [MAIN ] Derivative Progress: 860/2057 symbols completed. HQL took 0.9s. Estimated remaining: 7m 33s. Rate: 158.4 symbols/min [2025-10-21T22:09:38.238360] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:38.254048] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-10-21T22:09:38.254176] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-10-21T22:09:38.256572] [INFO ] [MAIN ] Derivative Progress: 861/2057 symbols completed. HQH took 1.0s. Estimated remaining: 7m 32s. Rate: 158.6 symbols/min [2025-10-21T22:09:38.256841] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:38.316216] [DEBUG] [LOCAL ] HR: Loaded 52114 existing records from primary storage. [2025-10-21T22:09:38.316498] [INFO ] [MAIN ] HR: Loaded 52114 primary data records. [2025-10-21T22:09:38.430060] [DEBUG] [LOCAL ] HRB: Loaded 48267 existing records from primary storage. [2025-10-21T22:09:38.444273] [INFO ] [MAIN ] HRB: Loaded 48267 primary data records. [2025-10-21T22:09:38.424291] [DEBUG] [LOCAL ] HRI: Loaded 32283 existing records from primary storage. [2025-10-21T22:09:38.468626] [INFO ] [MAIN ] HRI: Loaded 32283 primary data records. [2025-10-21T22:09:39.312384] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:39.313880] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 52114 primary records. [2025-10-21T22:09:39.314049] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-10-21T22:09:39.328070] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:39.329045] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48267 primary records. [2025-10-21T22:09:39.329499] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-10-21T22:09:39.345923] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-10-21T22:09:39.353002] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-10-21T22:09:39.358405] [INFO ] [MAIN ] Derivative Progress: 862/2057 symbols completed. HR took 1.2s. Estimated remaining: 7m 33s. Rate: 158.3 symbols/min [2025-10-21T22:09:39.362614] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-10-21T22:09:39.363961] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-10-21T22:09:39.362833] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:39.366619] [INFO ] [MAIN ] Derivative Progress: 863/2057 symbols completed. HRB took 1.1s. Estimated remaining: 7m 32s. Rate: 158.4 symbols/min [2025-10-21T22:09:39.368753] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:39.382342] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:39.383048] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 32283 primary records. [2025-10-21T22:09:39.383189] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-10-21T22:09:39.399797] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-10-21T22:09:39.399970] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-10-21T22:09:39.402780] [INFO ] [MAIN ] Derivative Progress: 864/2057 symbols completed. HRI took 1.1s. Estimated remaining: 7m 31s. Rate: 158.6 symbols/min [2025-10-21T22:09:39.403035] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:39.444344] [DEBUG] [LOCAL ] HRTG: Loaded 34543 existing records from primary storage. [2025-10-21T22:09:39.444495] [INFO ] [MAIN ] HRTG: Loaded 34543 primary data records. [2025-10-21T22:09:39.587563] [DEBUG] [LOCAL ] HRL: Loaded 53126 existing records from primary storage. [2025-10-21T22:09:39.594391] [INFO ] [MAIN ] HRL: Loaded 53126 primary data records. [2025-10-21T22:09:39.708708] [DEBUG] [LOCAL ] HSBC: Loaded 50992 existing records from primary storage. [2025-10-21T22:09:39.885802] [INFO ] [MAIN ] HSBC: Loaded 50992 primary data records. [2025-10-21T22:09:40.446514] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:40.448567] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 34543 primary records. [2025-10-21T22:09:40.449700] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-10-21T22:09:40.475467] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-10-21T22:09:40.480399] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-10-21T22:09:40.482362] [INFO ] [MAIN ] Derivative Progress: 865/2057 symbols completed. HRTG took 1.1s. Estimated remaining: 7m 32s. Rate: 158.3 symbols/min [2025-10-21T22:09:40.483011] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:40.482884] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:40.484290] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53126 primary records. [2025-10-21T22:09:40.484686] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-10-21T22:09:40.501091] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-10-21T22:09:40.501422] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-10-21T22:09:40.504074] [INFO ] [MAIN ] Derivative Progress: 866/2057 symbols completed. HRL took 1.1s. Estimated remaining: 7m 31s. Rate: 158.4 symbols/min [2025-10-21T22:09:40.508975] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:40.529266] [DEBUG] [LOCAL ] HSHP: Loaded 14708 existing records from primary storage. [2025-10-21T22:09:40.529538] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:40.530270] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 50992 primary records. [2025-10-21T22:09:40.530448] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-10-21T22:09:40.530404] [INFO ] [MAIN ] HSHP: Loaded 14708 primary data records. [2025-10-21T22:09:40.646464] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-10-21T22:09:40.652100] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-10-21T22:09:40.665367] [INFO ] [MAIN ] Derivative Progress: 867/2057 symbols completed. HSBC took 1.3s. Estimated remaining: 7m 30s. Rate: 158.5 symbols/min [2025-10-21T22:09:40.675943] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:40.870028] [DEBUG] [LOCAL ] HTD: Loaded 14308 existing records from primary storage. [2025-10-21T22:09:40.870193] [INFO ] [MAIN ] HTD: Loaded 14308 primary data records. [2025-10-21T22:09:40.989638] [DEBUG] [LOCAL ] HSY: Loaded 50427 existing records from primary storage. [2025-10-21T22:09:40.993501] [INFO ] [MAIN ] HSY: Loaded 50427 primary data records. [2025-10-21T22:09:41.522672] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:41.531853] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 14708 primary records. [2025-10-21T22:09:41.531946] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-10-21T22:09:41.549937] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-10-21T22:09:41.550429] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-10-21T22:09:41.552923] [INFO ] [MAIN ] Derivative Progress: 868/2057 symbols completed. HSHP took 1.1s. Estimated remaining: 7m 31s. Rate: 158.3 symbols/min [2025-10-21T22:09:41.572677] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:41.573441] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 14308 primary records. [2025-10-21T22:09:41.573591] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-10-21T22:09:41.593586] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-10-21T22:09:41.594500] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-10-21T22:09:41.597467] [INFO ] [MAIN ] Derivative Progress: 869/2057 symbols completed. HTD took 0.9s. Estimated remaining: 7m 30s. Rate: 158.5 symbols/min [2025-10-21T22:09:41.614493] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:41.615324] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50427 primary records. [2025-10-21T22:09:41.615396] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-10-21T22:09:41.634211] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-10-21T22:09:41.634342] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-10-21T22:09:41.637540] [INFO ] [MAIN ] Derivative Progress: 870/2057 symbols completed. HSY took 1.1s. Estimated remaining: 7m 29s. Rate: 158.6 symbols/min [2025-10-21T22:09:41.638023] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:41.638460] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:41.638596] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:41.685904] [DEBUG] [LOCAL ] HTH: Loaded 32547 existing records from primary storage. [2025-10-21T22:09:41.686040] [INFO ] [MAIN ] HTH: Loaded 32547 primary data records. [2025-10-21T22:09:41.836778] [DEBUG] [LOCAL ] HTGC: Loaded 47716 existing records from primary storage. [2025-10-21T22:09:41.838128] [DEBUG] [LOCAL ] HUBB: Loaded 36142 existing records from primary storage. [2025-10-21T22:09:41.854101] [INFO ] [MAIN ] HUBB: Loaded 36142 primary data records. [2025-10-21T22:09:41.853977] [INFO ] [MAIN ] HTGC: Loaded 47716 primary data records. [2025-10-21T22:09:42.675453] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:42.676216] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32547 primary records. [2025-10-21T22:09:42.676484] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-10-21T22:09:42.695016] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-10-21T22:09:42.696319] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-10-21T22:09:42.700281] [INFO ] [MAIN ] Derivative Progress: 871/2057 symbols completed. HTH took 1.1s. Estimated remaining: 7m 30s. Rate: 158.3 symbols/min [2025-10-21T22:09:42.700528] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:42.720347] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:42.721599] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47716 primary records. [2025-10-21T22:09:42.721805] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-10-21T22:09:42.755506] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:42.756664] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 36142 primary records. [2025-10-21T22:09:42.759809] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-10-21T22:09:42.761119] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-10-21T22:09:42.762128] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-10-21T22:09:42.771668] [INFO ] [MAIN ] Derivative Progress: 872/2057 symbols completed. HTGC took 1.1s. Estimated remaining: 7m 29s. Rate: 158.4 symbols/min [2025-10-21T22:09:42.771997] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:42.783436] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-10-21T22:09:42.793250] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-10-21T22:09:42.796340] [INFO ] [MAIN ] Derivative Progress: 873/2057 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 28s. Rate: 158.6 symbols/min [2025-10-21T22:09:42.796701] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:42.814065] [DEBUG] [LOCAL ] HUBS: Loaded 40052 existing records from primary storage. [2025-10-21T22:09:42.814214] [INFO ] [MAIN ] HUBS: Loaded 40052 primary data records. [2025-10-21T22:09:43.190215] [DEBUG] [LOCAL ] HUM: Loaded 49322 existing records from primary storage. [2025-10-21T22:09:43.190397] [INFO ] [MAIN ] HUM: Loaded 49322 primary data records. [2025-10-21T22:09:43.271365] [DEBUG] [LOCAL ] HUN: Loaded 53211 existing records from primary storage. [2025-10-21T22:09:43.277309] [INFO ] [MAIN ] HUN: Loaded 53211 primary data records. [2025-10-21T22:09:43.833081] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:43.834995] [INFO ] [MAIN ] HUBS: Generated 1793 derivative records from 40052 primary records. [2025-10-21T22:09:43.835478] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-10-21T22:09:43.853467] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1793 records). [2025-10-21T22:09:43.853832] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-10-21T22:09:43.856391] [INFO ] [MAIN ] Derivative Progress: 874/2057 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 28s. Rate: 158.3 symbols/min [2025-10-21T22:09:43.856794] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:43.885448] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:43.891497] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 49322 primary records. [2025-10-21T22:09:43.891975] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-10-21T22:09:43.891892] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:43.893440] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53211 primary records. [2025-10-21T22:09:43.893529] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-10-21T22:09:43.911487] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-10-21T22:09:43.922907] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-10-21T22:09:43.928838] [INFO ] [MAIN ] Derivative Progress: 875/2057 symbols completed. HUM took 1.2s. Estimated remaining: 7m 28s. Rate: 158.4 symbols/min [2025-10-21T22:09:43.929156] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:43.929852] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-10-21T22:09:43.939666] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-10-21T22:09:43.943071] [INFO ] [MAIN ] Derivative Progress: 876/2057 symbols completed. HUN took 1.1s. Estimated remaining: 7m 27s. Rate: 158.6 symbols/min [2025-10-21T22:09:43.943269] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:43.965344] [DEBUG] [LOCAL ] HUYA: Loaded 43629 existing records from primary storage. [2025-10-21T22:09:43.971579] [INFO ] [MAIN ] HUYA: Loaded 43629 primary data records. [2025-10-21T22:09:43.971873] [DEBUG] [LOCAL ] HVT: Loaded 14899 existing records from primary storage. [2025-10-21T22:09:43.993587] [INFO ] [MAIN ] HVT: Loaded 14899 primary data records. [2025-10-21T22:09:44.592610] [DEBUG] [LOCAL ] HWM: Loaded 52705 existing records from primary storage. [2025-10-21T22:09:44.602635] [INFO ] [MAIN ] HWM: Loaded 52705 primary data records. [2025-10-21T22:09:44.981977] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:44.983496] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 43629 primary records. [2025-10-21T22:09:44.983881] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-10-21T22:09:44.996847] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:44.997744] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 14899 primary records. [2025-10-21T22:09:45.000019] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-10-21T22:09:45.024998] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-10-21T22:09:45.031562] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-10-21T22:09:45.031970] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-10-21T22:09:45.031899] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-10-21T22:09:45.034720] [INFO ] [MAIN ] Derivative Progress: 877/2057 symbols completed. HVT took 1.1s. Estimated remaining: 7m 27s. Rate: 158.3 symbols/min [2025-10-21T22:09:45.037575] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:45.037693] [INFO ] [MAIN ] Derivative Progress: 878/2057 symbols completed. HUYA took 1.2s. Estimated remaining: 7m 26s. Rate: 158.4 symbols/min [2025-10-21T22:09:45.038463] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:45.059174] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:45.060075] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 52705 primary records. [2025-10-21T22:09:45.060232] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-10-21T22:09:45.065733] [DEBUG] [LOCAL ] HY: Loaded 9945 existing records from primary storage. [2025-10-21T22:09:45.073312] [INFO ] [MAIN ] HY: Loaded 9945 primary data records. [2025-10-21T22:09:45.119459] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-10-21T22:09:45.174765] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-10-21T22:09:45.177332] [INFO ] [MAIN ] Derivative Progress: 879/2057 symbols completed. HWM took 1.2s. Estimated remaining: 7m 26s. Rate: 158.6 symbols/min [2025-10-21T22:09:45.182673] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:45.294406] [DEBUG] [LOCAL ] HXL: Loaded 45797 existing records from primary storage. [2025-10-21T22:09:45.413014] [INFO ] [MAIN ] HXL: Loaded 45797 primary data records. [2025-10-21T22:09:45.413564] [DEBUG] [LOCAL ] HYI: Loaded 9697 existing records from primary storage. [2025-10-21T22:09:45.451295] [INFO ] [MAIN ] HYI: Loaded 9697 primary data records. [2025-10-21T22:09:46.043056] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:46.044704] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 9945 primary records. [2025-10-21T22:09:46.044946] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-10-21T22:09:46.062706] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-10-21T22:09:46.063918] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-10-21T22:09:46.066381] [INFO ] [MAIN ] Derivative Progress: 880/2057 symbols completed. HY took 1.0s. Estimated remaining: 7m 26s. Rate: 158.3 symbols/min [2025-10-21T22:09:46.066716] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:46.085940] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:46.086735] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 45797 primary records. [2025-10-21T22:09:46.087016] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-10-21T22:09:46.106831] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-10-21T22:09:46.107168] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-10-21T22:09:46.109871] [INFO ] [MAIN ] Derivative Progress: 881/2057 symbols completed. HXL took 1.1s. Estimated remaining: 7m 25s. Rate: 158.5 symbols/min [2025-10-21T22:09:46.121274] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:46.140035] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:46.141331] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 9697 primary records. [2025-10-21T22:09:46.141591] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-10-21T22:09:46.183548] [DEBUG] [LOCAL ] HYT: Loaded 33741 existing records from primary storage. [2025-10-21T22:09:46.181857] [DEBUG] [LOCAL ] HYTR: Loaded 3074 existing records from primary storage. [2025-10-21T22:09:46.178620] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-10-21T22:09:46.184005] [INFO ] [MAIN ] HYTR: Loaded 3074 primary data records. [2025-10-21T22:09:46.183906] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-10-21T22:09:46.183835] [INFO ] [MAIN ] HYT: Loaded 33741 primary data records. [2025-10-21T22:09:46.217998] [INFO ] [MAIN ] Derivative Progress: 882/2057 symbols completed. HYI took 1.0s. Estimated remaining: 7m 25s. Rate: 158.6 symbols/min [2025-10-21T22:09:46.251476] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:46.519394] [DEBUG] [LOCAL ] IAE: Loaded 6338 existing records from primary storage. [2025-10-21T22:09:46.603690] [INFO ] [MAIN ] IAE: Loaded 6338 primary data records. [2025-10-21T22:09:47.524160] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:47.526416] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:09:47.525924] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33741 primary records. [2025-10-21T22:09:47.527048] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-10-21T22:09:47.528405] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3074 primary records. [2025-10-21T22:09:47.531072] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-10-21T22:09:47.558750] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-10-21T22:09:47.568165] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-10-21T22:09:47.572380] [INFO ] [MAIN ] Derivative Progress: 883/2057 symbols completed. HYT took 1.5s. Estimated remaining: 7m 25s. Rate: 158.1 symbols/min [2025-10-21T22:09:47.568264] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-10-21T22:09:47.573057] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-10-21T22:09:47.576707] [INFO ] [MAIN ] Derivative Progress: 884/2057 symbols completed. HYTR took 1.5s. Estimated remaining: 7m 25s. Rate: 158.3 symbols/min [2025-10-21T22:09:47.594486] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:47.595208] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 6338 primary records. [2025-10-21T22:09:47.595274] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-10-21T22:09:47.613317] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-10-21T22:09:47.613510] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-10-21T22:09:47.616297] [INFO ] [MAIN ] Derivative Progress: 885/2057 symbols completed. IAE took 1.4s. Estimated remaining: 7m 24s. Rate: 158.5 symbols/min [2025-10-21T22:09:47.617136] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:47.617055] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:47.616972] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:47.732086] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-21T22:09:47.734046] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-21T22:09:47.734269] [INFO ] [MAIN ] IAG: Loaded 53492 primary data records. [2025-10-21T22:09:47.734195] [INFO ] [MAIN ] IBM: Loaded 53628 primary data records. [2025-10-21T22:09:47.735287] [DEBUG] [LOCAL ] IBN: Loaded 52838 existing records from primary storage. [2025-10-21T22:09:47.779573] [INFO ] [MAIN ] IBN: Loaded 52838 primary data records. [2025-10-21T22:09:48.679373] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:48.679195] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:48.680280] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53492 primary records. [2025-10-21T22:09:48.681629] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53628 primary records. [2025-10-21T22:09:48.681751] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-10-21T22:09:48.683632] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-10-21T22:09:48.711600] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-10-21T22:09:48.719826] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:48.718736] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-10-21T22:09:48.726384] [INFO ] [MAIN ] Derivative Progress: 886/2057 symbols completed. IBM took 1.1s. Estimated remaining: 7m 24s. Rate: 158.1 symbols/min [2025-10-21T22:09:48.721891] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52838 primary records. [2025-10-21T22:09:48.726543] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:48.731595] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-10-21T22:09:48.731525] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-10-21T22:09:48.732535] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-10-21T22:09:48.735693] [INFO ] [MAIN ] Derivative Progress: 887/2057 symbols completed. IAG took 1.1s. Estimated remaining: 7m 23s. Rate: 158.3 symbols/min [2025-10-21T22:09:48.735853] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:48.753133] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-10-21T22:09:48.753389] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-10-21T22:09:48.755707] [INFO ] [MAIN ] Derivative Progress: 888/2057 symbols completed. IBN took 1.1s. Estimated remaining: 7m 23s. Rate: 158.5 symbols/min [2025-10-21T22:09:48.755875] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:48.803726] [DEBUG] [LOCAL ] IBP: Loaded 28797 existing records from primary storage. [2025-10-21T22:09:48.803993] [INFO ] [MAIN ] IBP: Loaded 28797 primary data records. [2025-10-21T22:09:48.804496] [DEBUG] [LOCAL ] IBTA: Loaded 36220 existing records from primary storage. [2025-10-21T22:09:48.816706] [INFO ] [MAIN ] IBTA: Loaded 36220 primary data records. [2025-10-21T22:09:49.128893] [DEBUG] [LOCAL ] ICE: Loaded 53011 existing records from primary storage. [2025-10-21T22:09:49.196148] [INFO ] [MAIN ] ICE: Loaded 53011 primary data records. [2025-10-21T22:09:49.837782] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:49.854459] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 28797 primary records. [2025-10-21T22:09:49.855067] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-10-21T22:09:49.854867] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:49.864692] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 36220 primary records. [2025-10-21T22:09:49.874947] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-10-21T22:09:49.874871] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-10-21T22:09:49.877301] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-10-21T22:09:49.879984] [INFO ] [MAIN ] Derivative Progress: 889/2057 symbols completed. IBP took 1.2s. Estimated remaining: 7m 23s. Rate: 158.1 symbols/min [2025-10-21T22:09:49.903891] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:49.908283] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-10-21T22:09:49.909025] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:49.910107] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53011 primary records. [2025-10-21T22:09:49.910182] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-10-21T22:09:49.912757] [INFO ] [MAIN ] Derivative Progress: 890/2057 symbols completed. IBTA took 1.2s. Estimated remaining: 7m 22s. Rate: 158.3 symbols/min [2025-10-21T22:09:49.910324] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-10-21T22:09:49.912987] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:49.931539] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-10-21T22:09:49.931865] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-10-21T22:09:49.935197] [INFO ] [MAIN ] Derivative Progress: 891/2057 symbols completed. ICE took 1.2s. Estimated remaining: 7m 22s. Rate: 158.5 symbols/min [2025-10-21T22:09:49.935680] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:49.962774] [DEBUG] [LOCAL ] IDE: Loaded 9047 existing records from primary storage. [2025-10-21T22:09:49.963123] [INFO ] [MAIN ] IDE: Loaded 9047 primary data records. [2025-10-21T22:09:50.047501] [DEBUG] [LOCAL ] ICL: Loaded 38256 existing records from primary storage. [2025-10-21T22:09:50.061182] [INFO ] [MAIN ] ICL: Loaded 38256 primary data records. [2025-10-21T22:09:50.062111] [DEBUG] [LOCAL ] IDA: Loaded 32767 existing records from primary storage. [2025-10-21T22:09:50.062232] [INFO ] [MAIN ] IDA: Loaded 32767 primary data records. [2025-10-21T22:09:50.917433] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:50.921444] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 9047 primary records. [2025-10-21T22:09:50.921615] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-10-21T22:09:50.961412] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-10-21T22:09:50.961318] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:50.961571] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-10-21T22:09:50.964137] [INFO ] [MAIN ] Derivative Progress: 892/2057 symbols completed. IDE took 1.0s. Estimated remaining: 7m 22s. Rate: 158.2 symbols/min [2025-10-21T22:09:50.964574] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:50.964486] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:50.965606] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32767 primary records. [2025-10-21T22:09:50.965891] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-10-21T22:09:50.962268] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 38256 primary records. [2025-10-21T22:09:50.965979] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-10-21T22:09:50.996602] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-10-21T22:09:50.995308] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-10-21T22:09:50.996786] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-10-21T22:09:50.999473] [INFO ] [MAIN ] Derivative Progress: 893/2057 symbols completed. ICL took 1.1s. Estimated remaining: 7m 21s. Rate: 158.3 symbols/min [2025-10-21T22:09:50.999719] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:50.999622] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-10-21T22:09:51.006552] [INFO ] [MAIN ] Derivative Progress: 894/2057 symbols completed. IDA took 1.1s. Estimated remaining: 7m 20s. Rate: 158.5 symbols/min [2025-10-21T22:09:51.006822] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:51.016332] [DEBUG] [LOCAL ] IDT: Loaded 18558 existing records from primary storage. [2025-10-21T22:09:51.016463] [INFO ] [MAIN ] IDT: Loaded 18558 primary data records. [2025-10-21T22:09:51.393301] [DEBUG] [LOCAL ] IEX: Loaded 38376 existing records from primary storage. [2025-10-21T22:09:51.394176] [INFO ] [MAIN ] IEX: Loaded 38376 primary data records. [2025-10-21T22:09:51.394855] [DEBUG] [LOCAL ] IFF: Loaded 51226 existing records from primary storage. [2025-10-21T22:09:51.395002] [INFO ] [MAIN ] IFF: Loaded 51226 primary data records. [2025-10-21T22:09:52.038005] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:52.038882] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 18558 primary records. [2025-10-21T22:09:52.039290] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-10-21T22:09:52.056450] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-10-21T22:09:52.056764] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-10-21T22:09:52.059273] [INFO ] [MAIN ] Derivative Progress: 895/2057 symbols completed. IDT took 1.1s. Estimated remaining: 7m 21s. Rate: 158.2 symbols/min [2025-10-21T22:09:52.059602] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:52.086713] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:52.096806] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38376 primary records. [2025-10-21T22:09:52.096903] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-10-21T22:09:52.096039] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:52.098161] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 51226 primary records. [2025-10-21T22:09:52.098417] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-10-21T22:09:52.130124] [DEBUG] [LOCAL ] IFN: Loaded 18608 existing records from primary storage. [2025-10-21T22:09:52.131764] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-10-21T22:09:52.131863] [INFO ] [MAIN ] IFN: Loaded 18608 primary data records. [2025-10-21T22:09:52.131964] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-10-21T22:09:52.148236] [INFO ] [MAIN ] Derivative Progress: 896/2057 symbols completed. IEX took 1.1s. Estimated remaining: 7m 20s. Rate: 158.3 symbols/min [2025-10-21T22:09:52.174585] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-10-21T22:09:52.168768] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:52.174846] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-10-21T22:09:52.199031] [INFO ] [MAIN ] Derivative Progress: 897/2057 symbols completed. IFF took 1.2s. Estimated remaining: 7m 19s. Rate: 158.5 symbols/min [2025-10-21T22:09:52.199216] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:52.450972] [DEBUG] [LOCAL ] IGA: Loaded 10213 existing records from primary storage. [2025-10-21T22:09:52.467461] [INFO ] [MAIN ] IGA: Loaded 10213 primary data records. [2025-10-21T22:09:52.468074] [DEBUG] [LOCAL ] IFS: Loaded 22267 existing records from primary storage. [2025-10-21T22:09:52.468249] [INFO ] [MAIN ] IFS: Loaded 22267 primary data records. [2025-10-21T22:09:53.150828] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:53.151811] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18608 primary records. [2025-10-21T22:09:53.152872] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-10-21T22:09:53.171915] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-10-21T22:09:53.172530] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-10-21T22:09:53.174678] [INFO ] [MAIN ] Derivative Progress: 898/2057 symbols completed. IFN took 1.1s. Estimated remaining: 7m 20s. Rate: 158.2 symbols/min [2025-10-21T22:09:53.191608] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:53.192314] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22267 primary records. [2025-10-21T22:09:53.192451] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-10-21T22:09:53.222474] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-10-21T22:09:53.222575] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-10-21T22:09:53.225122] [INFO ] [MAIN ] Derivative Progress: 899/2057 symbols completed. IFS took 1.1s. Estimated remaining: 7m 19s. Rate: 158.3 symbols/min [2025-10-21T22:09:53.222405] [DEBUG] [MAIN ] IGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:53.225895] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 10213 primary records. [2025-10-21T22:09:53.225969] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-10-21T22:09:53.240729] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-10-21T22:09:53.240788] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-10-21T22:09:53.243445] [INFO ] [MAIN ] Derivative Progress: 900/2057 symbols completed. IGA took 1.0s. Estimated remaining: 7m 18s. Rate: 158.5 symbols/min [2025-10-21T22:09:53.243825] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:53.243899] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:53.244008] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:53.252366] [DEBUG] [LOCAL ] IGI: Loaded 4074 existing records from primary storage. [2025-10-21T22:09:53.252700] [INFO ] [MAIN ] IGI: Loaded 4074 primary data records. [2025-10-21T22:09:53.378202] [DEBUG] [LOCAL ] IGD: Loaded 19195 existing records from primary storage. [2025-10-21T22:09:53.378699] [INFO ] [MAIN ] IGD: Loaded 19195 primary data records. [2025-10-21T22:09:53.493538] [DEBUG] [LOCAL ] IGR: Loaded 30433 existing records from primary storage. [2025-10-21T22:09:53.574682] [INFO ] [MAIN ] IGR: Loaded 30433 primary data records. [2025-10-21T22:09:54.216620] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:54.218118] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 4074 primary records. [2025-10-21T22:09:54.218739] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-10-21T22:09:54.236638] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-10-21T22:09:54.236826] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-10-21T22:09:54.238905] [INFO ] [MAIN ] Derivative Progress: 901/2057 symbols completed. IGI took 1.0s. Estimated remaining: 7m 18s. Rate: 158.2 symbols/min [2025-10-21T22:09:54.239044] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:54.253508] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:54.254620] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19195 primary records. [2025-10-21T22:09:54.254817] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-10-21T22:09:54.258389] [DEBUG] [LOCAL ] IH: Loaded 2764 existing records from primary storage. [2025-10-21T22:09:54.264984] [INFO ] [MAIN ] IH: Loaded 2764 primary data records. [2025-10-21T22:09:54.324773] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-10-21T22:09:54.331993] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-10-21T22:09:54.343477] [INFO ] [MAIN ] Derivative Progress: 902/2057 symbols completed. IGD took 1.1s. Estimated remaining: 7m 18s. Rate: 158.3 symbols/min [2025-10-21T22:09:54.373022] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:54.392506] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:54.396633] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30433 primary records. [2025-10-21T22:09:54.396791] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-10-21T22:09:54.544070] [DEBUG] [LOCAL ] IHD: Loaded 7394 existing records from primary storage. [2025-10-21T22:09:54.497545] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-10-21T22:09:54.613728] [INFO ] [MAIN ] IHD: Loaded 7394 primary data records. [2025-10-21T22:09:54.613603] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-10-21T22:09:54.616403] [INFO ] [MAIN ] Derivative Progress: 903/2057 symbols completed. IGR took 1.4s. Estimated remaining: 7m 17s. Rate: 158.4 symbols/min [2025-10-21T22:09:54.628411] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:54.936266] [DEBUG] [LOCAL ] IHG: Loaded 24119 existing records from primary storage. [2025-10-21T22:09:54.936735] [INFO ] [MAIN ] IHG: Loaded 24119 primary data records. [2025-10-21T22:09:55.059154] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:55.065593] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 2764 primary records. [2025-10-21T22:09:55.099317] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-10-21T22:09:55.307692] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-10-21T22:09:55.308125] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-10-21T22:09:55.310271] [INFO ] [MAIN ] Derivative Progress: 904/2057 symbols completed. IH took 1.1s. Estimated remaining: 7m 17s. Rate: 158.2 symbols/min [2025-10-21T22:09:55.311092] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:55.330954] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:55.332134] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7394 primary records. [2025-10-21T22:09:55.332999] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-10-21T22:09:55.348676] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-10-21T22:09:55.357215] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-10-21T22:09:55.359997] [INFO ] [MAIN ] Derivative Progress: 905/2057 symbols completed. IHD took 1.0s. Estimated remaining: 7m 16s. Rate: 158.4 symbols/min [2025-10-21T22:09:55.360388] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:55.378147] [DEBUG] [LOCAL ] IHS: Loaded 37245 existing records from primary storage. [2025-10-21T22:09:55.386151] [INFO ] [MAIN ] IHS: Loaded 37245 primary data records. [2025-10-21T22:09:55.389055] [DEBUG] [LOCAL ] IIF: Loaded 5353 existing records from primary storage. [2025-10-21T22:09:55.393825] [INFO ] [MAIN ] IIF: Loaded 5353 primary data records. [2025-10-21T22:09:55.438015] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:55.482319] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24119 primary records. [2025-10-21T22:09:55.511277] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-10-21T22:09:55.682405] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-10-21T22:09:55.729306] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-10-21T22:09:55.753291] [INFO ] [MAIN ] Derivative Progress: 906/2057 symbols completed. IHG took 1.1s. Estimated remaining: 7m 16s. Rate: 158.4 symbols/min [2025-10-21T22:09:55.888799] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:56.039255] [DEBUG] [LOCAL ] IIIN: Loaded 16300 existing records from primary storage. [2025-10-21T22:09:56.039451] [INFO ] [MAIN ] IIIN: Loaded 16300 primary data records. [2025-10-21T22:09:56.198228] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:56.228506] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:56.251344] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 37245 primary records. [2025-10-21T22:09:56.250750] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5353 primary records. [2025-10-21T22:09:56.251524] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-10-21T22:09:56.314713] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-10-21T22:09:56.394626] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-10-21T22:09:56.397854] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-10-21T22:09:56.400352] [INFO ] [MAIN ] Derivative Progress: 907/2057 symbols completed. IHS took 1.1s. Estimated remaining: 7m 16s. Rate: 158.3 symbols/min [2025-10-21T22:09:56.401149] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-10-21T22:09:56.401311] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-10-21T22:09:56.401435] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:56.403826] [INFO ] [MAIN ] Derivative Progress: 908/2057 symbols completed. IIF took 1.0s. Estimated remaining: 7m 15s. Rate: 158.4 symbols/min [2025-10-21T22:09:56.405597] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:56.425744] [DEBUG] [LOCAL ] IIM: Loaded 15540 existing records from primary storage. [2025-10-21T22:09:56.432765] [INFO ] [MAIN ] IIM: Loaded 15540 primary data records. [2025-10-21T22:09:56.478215] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:56.527301] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16300 primary records. [2025-10-21T22:09:56.553596] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-10-21T22:09:56.566050] [DEBUG] [LOCAL ] IIPR: Loaded 28934 existing records from primary storage. [2025-10-21T22:09:56.566229] [INFO ] [MAIN ] IIPR: Loaded 28934 primary data records. [2025-10-21T22:09:56.727783] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-10-21T22:09:56.766062] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-10-21T22:09:56.786064] [INFO ] [MAIN ] Derivative Progress: 909/2057 symbols completed. IIIN took 0.9s. Estimated remaining: 7m 15s. Rate: 158.4 symbols/min [2025-10-21T22:09:56.900132] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:57.148006] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:57.164371] [DEBUG] [LOCAL ] IMAX: Loaded 43469 existing records from primary storage. [2025-10-21T22:09:57.164666] [INFO ] [MAIN ] IMAX: Loaded 43469 primary data records. [2025-10-21T22:09:57.162906] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15540 primary records. [2025-10-21T22:09:57.208769] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:57.176996] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-10-21T22:09:57.215024] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 28934 primary records. [2025-10-21T22:09:57.233893] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-10-21T22:09:57.308507] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-10-21T22:09:57.321560] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-10-21T22:09:57.333725] [INFO ] [MAIN ] Derivative Progress: 910/2057 symbols completed. IIPR took 0.9s. Estimated remaining: 7m 15s. Rate: 158.4 symbols/min [2025-10-21T22:09:57.346177] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-10-21T22:09:57.346425] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:57.346303] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-10-21T22:09:57.363268] [INFO ] [MAIN ] Derivative Progress: 911/2057 symbols completed. IIM took 1.0s. Estimated remaining: 7m 14s. Rate: 158.5 symbols/min [2025-10-21T22:09:57.402888] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:57.559379] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:57.572086] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 43469 primary records. [2025-10-21T22:09:57.572149] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-10-21T22:09:57.602264] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-10-21T22:09:57.602946] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-10-21T22:09:57.605281] [INFO ] [MAIN ] Derivative Progress: 912/2057 symbols completed. IMAX took 0.7s. Estimated remaining: 7m 13s. Rate: 158.6 symbols/min [2025-10-21T22:09:57.606932] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:57.606756] [DEBUG] [LOCAL ] INFA: Loaded 48721 existing records from primary storage. [2025-10-21T22:09:57.607155] [INFO ] [MAIN ] INFA: Loaded 48721 primary data records. [2025-10-21T22:09:57.697892] [DEBUG] [LOCAL ] INFY: Loaded 53596 existing records from primary storage. [2025-10-21T22:09:57.713819] [INFO ] [MAIN ] INFY: Loaded 53596 primary data records. [2025-10-21T22:09:58.059874] [DEBUG] [LOCAL ] INGM: Loaded 28216 existing records from primary storage. [2025-10-21T22:09:58.066127] [INFO ] [MAIN ] INGM: Loaded 28216 primary data records. [2025-10-21T22:09:58.555172] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:58.557202] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 48721 primary records. [2025-10-21T22:09:58.557422] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-10-21T22:09:58.583011] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:58.584997] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53596 primary records. [2025-10-21T22:09:58.586109] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-10-21T22:09:58.589264] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-10-21T22:09:58.589959] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-10-21T22:09:58.592289] [INFO ] [MAIN ] Derivative Progress: 913/2057 symbols completed. INFA took 1.2s. Estimated remaining: 7m 14s. Rate: 158.3 symbols/min [2025-10-21T22:09:58.608213] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-10-21T22:09:58.608671] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-10-21T22:09:58.612109] [INFO ] [MAIN ] Derivative Progress: 914/2057 symbols completed. INFY took 1.2s. Estimated remaining: 7m 13s. Rate: 158.5 symbols/min [2025-10-21T22:09:58.625327] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:58.625902] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 28216 primary records. [2025-10-21T22:09:58.625964] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-10-21T22:09:58.640715] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-10-21T22:09:58.640779] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-10-21T22:09:58.643279] [INFO ] [MAIN ] Derivative Progress: 915/2057 symbols completed. INGM took 1.0s. Estimated remaining: 7m 12s. Rate: 158.6 symbols/min [2025-10-21T22:09:58.643749] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:58.643855] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:58.644089] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:58.707934] [DEBUG] [LOCAL ] INGR: Loaded 33761 existing records from primary storage. [2025-10-21T22:09:58.710001] [DEBUG] [LOCAL ] INN: Loaded 41558 existing records from primary storage. [2025-10-21T22:09:58.710177] [INFO ] [MAIN ] INN: Loaded 41558 primary data records. [2025-10-21T22:09:58.709485] [INFO ] [MAIN ] INGR: Loaded 33761 primary data records. [2025-10-21T22:09:58.769210] [DEBUG] [LOCAL ] INSP: Loaded 38568 existing records from primary storage. [2025-10-21T22:09:58.797845] [INFO ] [MAIN ] INSP: Loaded 38568 primary data records. [2025-10-21T22:09:59.668344] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:59.669747] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33761 primary records. [2025-10-21T22:09:59.669084] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:59.670021] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-10-21T22:09:59.670770] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41558 primary records. [2025-10-21T22:09:59.671462] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-10-21T22:09:59.696661] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-10-21T22:09:59.696818] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-10-21T22:09:59.703511] [INFO ] [MAIN ] Derivative Progress: 916/2057 symbols completed. INGR took 1.1s. Estimated remaining: 7m 12s. Rate: 158.3 symbols/min [2025-10-21T22:09:59.703921] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:59.705918] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-10-21T22:09:59.713634] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-10-21T22:09:59.720722] [INFO ] [MAIN ] Derivative Progress: 917/2057 symbols completed. INN took 1.1s. Estimated remaining: 7m 12s. Rate: 158.5 symbols/min [2025-10-21T22:09:59.720856] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:59.721229] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:09:59.722351] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 38568 primary records. [2025-10-21T22:09:59.722487] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-10-21T22:09:59.738772] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-10-21T22:09:59.739049] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-10-21T22:09:59.741492] [INFO ] [MAIN ] Derivative Progress: 918/2057 symbols completed. INSP took 1.1s. Estimated remaining: 7m 11s. Rate: 158.6 symbols/min [2025-10-21T22:09:59.741727] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:09:59.792994] [DEBUG] [LOCAL ] INSW: Loaded 39351 existing records from primary storage. [2025-10-21T22:09:59.793236] [INFO ] [MAIN ] INSW: Loaded 39351 primary data records. [2025-10-21T22:09:59.885070] [DEBUG] [LOCAL ] INVX: Loaded 29141 existing records from primary storage. [2025-10-21T22:09:59.903147] [INFO ] [MAIN ] INVX: Loaded 29141 primary data records. [2025-10-21T22:09:59.941015] [DEBUG] [LOCAL ] INVH: Loaded 53194 existing records from primary storage. [2025-10-21T22:09:59.962349] [INFO ] [MAIN ] INVH: Loaded 53194 primary data records. [2025-10-21T22:10:00.784758] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:00.785623] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 39351 primary records. [2025-10-21T22:10:00.785956] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-10-21T22:10:00.803610] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-10-21T22:10:00.804469] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-10-21T22:10:00.807993] [INFO ] [MAIN ] Derivative Progress: 919/2057 symbols completed. INSW took 1.1s. Estimated remaining: 7m 11s. Rate: 158.3 symbols/min [2025-10-21T22:10:00.808260] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:00.834190] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:00.833958] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:00.834934] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53194 primary records. [2025-10-21T22:10:00.835528] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29141 primary records. [2025-10-21T22:10:00.835682] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-10-21T22:10:00.835739] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-10-21T22:10:00.865788] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-10-21T22:10:00.866925] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-10-21T22:10:00.870059] [INFO ] [MAIN ] Derivative Progress: 920/2057 symbols completed. INVH took 1.1s. Estimated remaining: 7m 10s. Rate: 158.5 symbols/min [2025-10-21T22:10:00.870728] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:00.870982] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-10-21T22:10:00.871334] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-10-21T22:10:00.873913] [INFO ] [MAIN ] Derivative Progress: 921/2057 symbols completed. INVX took 1.1s. Estimated remaining: 7m 10s. Rate: 158.6 symbols/min [2025-10-21T22:10:00.874166] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:00.915267] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-21T22:10:00.915500] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-10-21T22:10:01.153302] [DEBUG] [LOCAL ] IP: Loaded 53304 existing records from primary storage. [2025-10-21T22:10:01.186690] [INFO ] [MAIN ] IP: Loaded 53304 primary data records. [2025-10-21T22:10:01.266455] [DEBUG] [LOCAL ] IOT: Loaded 53478 existing records from primary storage. [2025-10-21T22:10:01.303621] [INFO ] [MAIN ] IOT: Loaded 53478 primary data records. [2025-10-21T22:10:01.930354] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:01.932077] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-10-21T22:10:01.932508] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-10-21T22:10:01.951160] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-10-21T22:10:01.952026] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-10-21T22:10:01.954782] [INFO ] [MAIN ] Derivative Progress: 922/2057 symbols completed. IONQ took 1.1s. Estimated remaining: 7m 10s. Rate: 158.3 symbols/min [2025-10-21T22:10:01.955895] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:01.970001] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:01.970886] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53304 primary records. [2025-10-21T22:10:01.970985] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-10-21T22:10:01.990983] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-10-21T22:10:01.991319] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-10-21T22:10:01.993664] [INFO ] [MAIN ] Derivative Progress: 923/2057 symbols completed. IP took 1.1s. Estimated remaining: 7m 9s. Rate: 158.5 symbols/min [2025-10-21T22:10:01.993932] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:02.007925] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:02.008801] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53478 primary records. [2025-10-21T22:10:02.009040] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-10-21T22:10:02.025212] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-10-21T22:10:02.025442] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-10-21T22:10:02.028238] [INFO ] [MAIN ] Derivative Progress: 924/2057 symbols completed. IOT took 1.2s. Estimated remaining: 7m 9s. Rate: 158.6 symbols/min [2025-10-21T22:10:02.028565] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:02.058302] [DEBUG] [LOCAL ] IPI: Loaded 21499 existing records from primary storage. [2025-10-21T22:10:02.058445] [INFO ] [MAIN ] IPI: Loaded 21499 primary data records. [2025-10-21T22:10:02.199427] [DEBUG] [LOCAL ] IQI: Loaded 17852 existing records from primary storage. [2025-10-21T22:10:02.200906] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-21T22:10:02.201523] [INFO ] [MAIN ] IQI: Loaded 17852 primary data records. [2025-10-21T22:10:02.201411] [INFO ] [MAIN ] IPG: Loaded 53330 primary data records. [2025-10-21T22:10:03.133266] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:03.134036] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21499 primary records. [2025-10-21T22:10:03.134119] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-10-21T22:10:03.152461] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-10-21T22:10:03.152727] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-10-21T22:10:03.154530] [INFO ] [MAIN ] Derivative Progress: 925/2057 symbols completed. IPI took 1.2s. Estimated remaining: 7m 9s. Rate: 158.3 symbols/min [2025-10-21T22:10:03.154895] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:03.168235] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:03.169054] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 17852 primary records. [2025-10-21T22:10:03.169624] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-10-21T22:10:03.187894] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-10-21T22:10:03.195509] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-10-21T22:10:03.202586] [INFO ] [MAIN ] Derivative Progress: 926/2057 symbols completed. IQI took 1.2s. Estimated remaining: 7m 8s. Rate: 158.4 symbols/min [2025-10-21T22:10:03.202942] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:03.203836] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53330 primary records. [2025-10-21T22:10:03.203912] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:03.204118] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-10-21T22:10:03.228310] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-10-21T22:10:03.228607] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-10-21T22:10:03.232583] [INFO ] [MAIN ] Derivative Progress: 927/2057 symbols completed. IPG took 1.3s. Estimated remaining: 7m 7s. Rate: 158.6 symbols/min [2025-10-21T22:10:03.233036] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:03.304802] [DEBUG] [LOCAL ] IQV: Loaded 50013 existing records from primary storage. [2025-10-21T22:10:03.305488] [DEBUG] [LOCAL ] IR: Loaded 52756 existing records from primary storage. [2025-10-21T22:10:03.305767] [INFO ] [MAIN ] IR: Loaded 52756 primary data records. [2025-10-21T22:10:03.305892] [INFO ] [MAIN ] IQV: Loaded 50013 primary data records. [2025-10-21T22:10:03.622125] [DEBUG] [LOCAL ] IRM: Loaded 48973 existing records from primary storage. [2025-10-21T22:10:03.699536] [INFO ] [MAIN ] IRM: Loaded 48973 primary data records. [2025-10-21T22:10:04.283247] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:04.284556] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50013 primary records. [2025-10-21T22:10:04.284930] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-10-21T22:10:04.304423] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-10-21T22:10:04.305423] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-10-21T22:10:04.307337] [INFO ] [MAIN ] Derivative Progress: 928/2057 symbols completed. IQV took 1.2s. Estimated remaining: 7m 8s. Rate: 158.3 symbols/min [2025-10-21T22:10:04.320502] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:04.321992] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52756 primary records. [2025-10-21T22:10:04.322254] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-10-21T22:10:04.338916] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-10-21T22:10:04.339041] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-10-21T22:10:04.341293] [INFO ] [MAIN ] Derivative Progress: 929/2057 symbols completed. IR took 1.1s. Estimated remaining: 7m 7s. Rate: 158.4 symbols/min [2025-10-21T22:10:04.357011] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:04.357923] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 48973 primary records. [2025-10-21T22:10:04.358001] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-10-21T22:10:04.375586] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-10-21T22:10:04.375731] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-10-21T22:10:04.378532] [INFO ] [MAIN ] Derivative Progress: 930/2057 symbols completed. IRM took 1.1s. Estimated remaining: 7m 6s. Rate: 158.6 symbols/min [2025-10-21T22:10:04.378971] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:04.379075] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:04.379017] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:04.404171] [DEBUG] [LOCAL ] ISD: Loaded 15750 existing records from primary storage. [2025-10-21T22:10:04.404702] [INFO ] [MAIN ] ISD: Loaded 15750 primary data records. [2025-10-21T22:10:04.412724] [DEBUG] [LOCAL ] IRS: Loaded 23350 existing records from primary storage. [2025-10-21T22:10:04.446129] [INFO ] [MAIN ] IRS: Loaded 23350 primary data records. [2025-10-21T22:10:04.773769] [DEBUG] [LOCAL ] IRT: Loaded 50486 existing records from primary storage. [2025-10-21T22:10:04.912172] [INFO ] [MAIN ] IRT: Loaded 50486 primary data records. [2025-10-21T22:10:05.406636] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:05.406378] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:05.407371] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 23350 primary records. [2025-10-21T22:10:05.408179] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15750 primary records. [2025-10-21T22:10:05.408261] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-10-21T22:10:05.409180] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-10-21T22:10:05.437914] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-10-21T22:10:05.439779] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-10-21T22:10:05.441862] [INFO ] [MAIN ] Derivative Progress: 931/2057 symbols completed. IRS took 1.1s. Estimated remaining: 7m 7s. Rate: 158.3 symbols/min [2025-10-21T22:10:05.440034] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-10-21T22:10:05.442144] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:05.442256] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-10-21T22:10:05.445010] [INFO ] [MAIN ] Derivative Progress: 932/2057 symbols completed. ISD took 1.1s. Estimated remaining: 7m 6s. Rate: 158.5 symbols/min [2025-10-21T22:10:05.445256] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:05.461613] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:05.462374] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50486 primary records. [2025-10-21T22:10:05.462533] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-10-21T22:10:05.501021] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-10-21T22:10:05.501195] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-10-21T22:10:05.504049] [INFO ] [MAIN ] Derivative Progress: 933/2057 symbols completed. IRT took 1.1s. Estimated remaining: 7m 5s. Rate: 158.6 symbols/min [2025-10-21T22:10:05.504322] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:05.517590] [DEBUG] [LOCAL ] ITGR: Loaded 31006 existing records from primary storage. [2025-10-21T22:10:05.529623] [INFO ] [MAIN ] ITGR: Loaded 31006 primary data records. [2025-10-21T22:10:05.568157] [DEBUG] [LOCAL ] IT: Loaded 42230 existing records from primary storage. [2025-10-21T22:10:05.580242] [INFO ] [MAIN ] IT: Loaded 42230 primary data records. [2025-10-21T22:10:05.791488] [DEBUG] [LOCAL ] ITT: Loaded 32438 existing records from primary storage. [2025-10-21T22:10:05.823267] [INFO ] [MAIN ] ITT: Loaded 32438 primary data records. [2025-10-21T22:10:06.488715] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:10:06.495713] [INFO ] [MAIN ] IT: Generated 1793 derivative records from 42230 primary records. [2025-10-21T22:10:06.494819] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:06.495820] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-10-21T22:10:06.498863] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31006 primary records. [2025-10-21T22:10:06.500131] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-10-21T22:10:06.537163] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:06.543174] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 32438 primary records. [2025-10-21T22:10:06.543282] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-10-21T22:10:06.547443] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-10-21T22:10:06.542427] [DEBUG] [LOCAL ] IT: Derivative data saved (1793 records). [2025-10-21T22:10:06.548329] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-10-21T22:10:06.548604] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-10-21T22:10:06.565821] [INFO ] [MAIN ] Derivative Progress: 934/2057 symbols completed. ITGR took 1.1s. Estimated remaining: 7m 6s. Rate: 158.3 symbols/min [2025-10-21T22:10:06.568371] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-10-21T22:10:06.568474] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-10-21T22:10:06.568617] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:06.568801] [INFO ] [MAIN ] Derivative Progress: 935/2057 symbols completed. IT took 1.1s. Estimated remaining: 7m 5s. Rate: 158.5 symbols/min [2025-10-21T22:10:06.571841] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:06.571931] [INFO ] [MAIN ] Derivative Progress: 936/2057 symbols completed. ITT took 1.1s. Estimated remaining: 7m 4s. Rate: 158.6 symbols/min [2025-10-21T22:10:06.572435] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:06.653757] [DEBUG] [LOCAL ] ITUB: Loaded 53322 existing records from primary storage. [2025-10-21T22:10:06.671670] [INFO ] [MAIN ] ITUB: Loaded 53322 primary data records. [2025-10-21T22:10:06.692924] [DEBUG] [LOCAL ] ITW: Loaded 45596 existing records from primary storage. [2025-10-21T22:10:06.709069] [DEBUG] [LOCAL ] IVR: Loaded 47886 existing records from primary storage. [2025-10-21T22:10:06.736421] [INFO ] [MAIN ] ITW: Loaded 45596 primary data records. [2025-10-21T22:10:06.715952] [INFO ] [MAIN ] IVR: Loaded 47886 primary data records. [2025-10-21T22:10:07.635582] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:07.637342] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53322 primary records. [2025-10-21T22:10:07.638367] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-10-21T22:10:07.658361] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-10-21T22:10:07.666034] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-10-21T22:10:07.673110] [INFO ] [MAIN ] Derivative Progress: 937/2057 symbols completed. ITUB took 1.1s. Estimated remaining: 7m 4s. Rate: 158.3 symbols/min [2025-10-21T22:10:07.681317] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:07.686855] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47886 primary records. [2025-10-21T22:10:07.686956] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-10-21T22:10:07.687525] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:07.687202] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:07.689420] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 45596 primary records. [2025-10-21T22:10:07.696368] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-10-21T22:10:07.706129] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-10-21T22:10:07.706575] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-10-21T22:10:07.708974] [INFO ] [MAIN ] Derivative Progress: 938/2057 symbols completed. IVR took 1.1s. Estimated remaining: 7m 4s. Rate: 158.5 symbols/min [2025-10-21T22:10:07.716219] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:07.724965] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-10-21T22:10:07.725161] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-10-21T22:10:07.728582] [INFO ] [MAIN ] Derivative Progress: 939/2057 symbols completed. ITW took 1.2s. Estimated remaining: 7m 3s. Rate: 158.6 symbols/min [2025-10-21T22:10:07.728887] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:07.759222] [DEBUG] [LOCAL ] IVT: Loaded 31476 existing records from primary storage. [2025-10-21T22:10:07.759414] [INFO ] [MAIN ] IVT: Loaded 31476 primary data records. [2025-10-21T22:10:07.843677] [DEBUG] [LOCAL ] IX: Loaded 22198 existing records from primary storage. [2025-10-21T22:10:07.861456] [INFO ] [MAIN ] IX: Loaded 22198 primary data records. [2025-10-21T22:10:08.053066] [DEBUG] [LOCAL ] IVZ: Loaded 53133 existing records from primary storage. [2025-10-21T22:10:08.079965] [INFO ] [MAIN ] IVZ: Loaded 53133 primary data records. [2025-10-21T22:10:08.721617] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:08.723409] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 31476 primary records. [2025-10-21T22:10:08.723570] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-10-21T22:10:08.740389] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:08.752234] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22198 primary records. [2025-10-21T22:10:08.755610] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-10-21T22:10:08.756637] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-10-21T22:10:08.757805] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-10-21T22:10:08.760230] [INFO ] [MAIN ] Derivative Progress: 940/2057 symbols completed. IVT took 1.1s. Estimated remaining: 7m 3s. Rate: 158.3 symbols/min [2025-10-21T22:10:08.762595] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:08.789129] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:08.791529] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53133 primary records. [2025-10-21T22:10:08.792713] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-10-21T22:10:08.792970] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-10-21T22:10:08.792882] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-10-21T22:10:08.795802] [INFO ] [MAIN ] Derivative Progress: 941/2057 symbols completed. IX took 1.1s. Estimated remaining: 7m 2s. Rate: 158.5 symbols/min [2025-10-21T22:10:08.796773] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:08.815859] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-10-21T22:10:08.816082] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-10-21T22:10:08.818724] [INFO ] [MAIN ] Derivative Progress: 942/2057 symbols completed. IVZ took 1.1s. Estimated remaining: 7m 2s. Rate: 158.6 symbols/min [2025-10-21T22:10:08.819087] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:08.869555] [DEBUG] [LOCAL ] J: Loaded 40509 existing records from primary storage. [2025-10-21T22:10:08.869876] [INFO ] [MAIN ] J: Loaded 40509 primary data records. [2025-10-21T22:10:08.998946] [DEBUG] [LOCAL ] JBGS: Loaded 41810 existing records from primary storage. [2025-10-21T22:10:08.999607] [DEBUG] [LOCAL ] JBI: Loaded 42692 existing records from primary storage. [2025-10-21T22:10:08.999917] [INFO ] [MAIN ] JBGS: Loaded 41810 primary data records. [2025-10-21T22:10:09.000285] [INFO ] [MAIN ] JBI: Loaded 42692 primary data records. [2025-10-21T22:10:09.850743] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:09.851851] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40509 primary records. [2025-10-21T22:10:09.852346] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-10-21T22:10:09.872294] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-10-21T22:10:09.872488] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-10-21T22:10:09.874322] [INFO ] [MAIN ] Derivative Progress: 943/2057 symbols completed. J took 1.1s. Estimated remaining: 7m 2s. Rate: 158.3 symbols/min [2025-10-21T22:10:09.892174] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:09.892987] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 41810 primary records. [2025-10-21T22:10:09.893086] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-10-21T22:10:09.916339] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:09.921238] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 42692 primary records. [2025-10-21T22:10:09.922977] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-10-21T22:10:09.937413] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-10-21T22:10:09.938387] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-10-21T22:10:09.942746] [INFO ] [MAIN ] Derivative Progress: 944/2057 symbols completed. JBGS took 1.1s. Estimated remaining: 7m 1s. Rate: 158.5 symbols/min [2025-10-21T22:10:09.944969] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-10-21T22:10:09.945037] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-10-21T22:10:09.947410] [INFO ] [MAIN ] Derivative Progress: 945/2057 symbols completed. JBI took 1.1s. Estimated remaining: 7m 1s. Rate: 158.6 symbols/min [2025-10-21T22:10:09.947876] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:09.947950] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:09.948099] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:09.993740] [DEBUG] [LOCAL ] JBND: Loaded 27324 existing records from primary storage. [2025-10-21T22:10:10.003693] [INFO ] [MAIN ] JBND: Loaded 27324 primary data records. [2025-10-21T22:10:10.135030] [DEBUG] [LOCAL ] JBTM: Loaded 33651 existing records from primary storage. [2025-10-21T22:10:10.140743] [INFO ] [MAIN ] JBTM: Loaded 33651 primary data records. [2025-10-21T22:10:10.177821] [DEBUG] [LOCAL ] JBL: Loaded 48345 existing records from primary storage. [2025-10-21T22:10:10.278540] [INFO ] [MAIN ] JBL: Loaded 48345 primary data records. [2025-10-21T22:10:11.041806] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:11.043578] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 27324 primary records. [2025-10-21T22:10:11.043829] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-10-21T22:10:11.075619] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-10-21T22:10:11.075974] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-10-21T22:10:11.077846] [INFO ] [MAIN ] Derivative Progress: 946/2057 symbols completed. JBND took 1.1s. Estimated remaining: 7m 1s. Rate: 158.3 symbols/min [2025-10-21T22:10:11.078172] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:11.078753] [DEBUG] [MAIN ] JBTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:11.079734] [INFO ] [MAIN ] JBTM: Generated 1794 derivative records from 33651 primary records. [2025-10-21T22:10:11.080250] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-10-21T22:10:11.100281] [DEBUG] [LOCAL ] JBTM: Derivative data saved (1794 records). [2025-10-21T22:10:11.100600] [INFO ] [MAIN ] JBTM: Successfully saved derivative data. [2025-10-21T22:10:11.104216] [INFO ] [MAIN ] Derivative Progress: 947/2057 symbols completed. JBTM took 1.2s. Estimated remaining: 7m 0s. Rate: 158.5 symbols/min [2025-10-21T22:10:11.104479] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:11.110018] [DEBUG] [LOCAL ] JCE: Loaded 7278 existing records from primary storage. [2025-10-21T22:10:11.110508] [INFO ] [MAIN ] JCE: Loaded 7278 primary data records. [2025-10-21T22:10:11.174374] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:10:11.198719] [INFO ] [MAIN ] JBL: Generated 1793 derivative records from 48345 primary records. [2025-10-21T22:10:11.198834] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-10-21T22:10:11.255613] [DEBUG] [LOCAL ] JBL: Derivative data saved (1793 records). [2025-10-21T22:10:11.266851] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-10-21T22:10:11.280018] [INFO ] [MAIN ] Derivative Progress: 948/2057 symbols completed. JBL took 1.3s. Estimated remaining: 6m 60s. Rate: 158.6 symbols/min [2025-10-21T22:10:11.302894] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:11.496000] [DEBUG] [LOCAL ] JCI: Loaded 53519 existing records from primary storage. [2025-10-21T22:10:11.496473] [INFO ] [MAIN ] JCI: Loaded 53519 primary data records. [2025-10-21T22:10:11.825838] [DEBUG] [LOCAL ] JEF: Loaded 50196 existing records from primary storage. [2025-10-21T22:10:11.718577] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:11.834307] [INFO ] [MAIN ] JEF: Loaded 50196 primary data records. [2025-10-21T22:10:11.835952] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 7278 primary records. [2025-10-21T22:10:11.847762] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-10-21T22:10:11.929288] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-10-21T22:10:11.940277] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-10-21T22:10:11.959024] [INFO ] [MAIN ] Derivative Progress: 949/2057 symbols completed. JCE took 0.9s. Estimated remaining: 6m 60s. Rate: 158.4 symbols/min [2025-10-21T22:10:11.959829] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:12.188277] [DEBUG] [MAIN ] JCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:12.190427] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53519 primary records. [2025-10-21T22:10:12.190589] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-10-21T22:10:12.223133] [DEBUG] [LOCAL ] JELD: Loaded 45921 existing records from primary storage. [2025-10-21T22:10:12.222014] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-10-21T22:10:12.223319] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-10-21T22:10:12.226042] [INFO ] [MAIN ] Derivative Progress: 950/2057 symbols completed. JCI took 1.1s. Estimated remaining: 6m 59s. Rate: 158.5 symbols/min [2025-10-21T22:10:12.226390] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:12.226273] [INFO ] [MAIN ] JELD: Loaded 45921 primary data records. [2025-10-21T22:10:12.362161] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:12.378722] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50196 primary records. [2025-10-21T22:10:12.431552] [DEBUG] [LOCAL ] JFR: Loaded 31046 existing records from primary storage. [2025-10-21T22:10:12.413144] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-10-21T22:10:12.453220] [INFO ] [MAIN ] JFR: Loaded 31046 primary data records. [2025-10-21T22:10:12.698300] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-10-21T22:10:12.698491] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-10-21T22:10:12.701085] [INFO ] [MAIN ] Derivative Progress: 951/2057 symbols completed. JEF took 1.4s. Estimated remaining: 6m 59s. Rate: 158.4 symbols/min [2025-10-21T22:10:12.701445] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:12.947286] [DEBUG] [LOCAL ] JGH: Loaded 12652 existing records from primary storage. [2025-10-21T22:10:12.956523] [INFO ] [MAIN ] JGH: Loaded 12652 primary data records. [2025-10-21T22:10:13.091400] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:13.101181] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 45921 primary records. [2025-10-21T22:10:13.107300] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-10-21T22:10:13.198063] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-10-21T22:10:13.304418] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-10-21T22:10:13.314729] [INFO ] [MAIN ] Derivative Progress: 952/2057 symbols completed. JELD took 1.4s. Estimated remaining: 6m 59s. Rate: 158.3 symbols/min [2025-10-21T22:10:13.317219] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:13.333422] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:13.334954] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 31046 primary records. [2025-10-21T22:10:13.335322] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-10-21T22:10:13.362362] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-10-21T22:10:13.362750] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-10-21T22:10:13.366004] [INFO ] [MAIN ] Derivative Progress: 953/2057 symbols completed. JFR took 1.1s. Estimated remaining: 6m 58s. Rate: 158.5 symbols/min [2025-10-21T22:10:13.366524] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:13.388465] [DEBUG] [LOCAL ] JHI: Loaded 4184 existing records from primary storage. [2025-10-21T22:10:13.388750] [INFO ] [MAIN ] JHI: Loaded 4184 primary data records. [2025-10-21T22:10:13.550060] [DEBUG] [LOCAL ] JHG: Loaded 47511 existing records from primary storage. [2025-10-21T22:10:13.550802] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:13.551447] [INFO ] [MAIN ] JHG: Loaded 47511 primary data records. [2025-10-21T22:10:13.557559] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 12652 primary records. [2025-10-21T22:10:13.568120] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-10-21T22:10:13.838244] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-10-21T22:10:13.852540] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-10-21T22:10:13.884247] [INFO ] [MAIN ] Derivative Progress: 954/2057 symbols completed. JGH took 1.2s. Estimated remaining: 6m 58s. Rate: 158.4 symbols/min [2025-10-21T22:10:13.891290] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:13.989070] [DEBUG] [LOCAL ] JHS: Loaded 2986 existing records from primary storage. [2025-10-21T22:10:14.114295] [INFO ] [MAIN ] JHS: Loaded 2986 primary data records. [2025-10-21T22:10:14.447603] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:14.449577] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 4184 primary records. [2025-10-21T22:10:14.449867] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-10-21T22:10:14.467635] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-10-21T22:10:14.467978] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-10-21T22:10:14.470042] [INFO ] [MAIN ] Derivative Progress: 955/2057 symbols completed. JHI took 1.1s. Estimated remaining: 6m 58s. Rate: 158.3 symbols/min [2025-10-21T22:10:14.470612] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:14.494001] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:14.495051] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 47511 primary records. [2025-10-21T22:10:14.495291] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-10-21T22:10:14.513956] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-10-21T22:10:14.514934] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-10-21T22:10:14.517820] [INFO ] [MAIN ] Derivative Progress: 956/2057 symbols completed. JHG took 1.2s. Estimated remaining: 6m 57s. Rate: 158.5 symbols/min [2025-10-21T22:10:14.525894] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:14.531738] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:14.532402] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2986 primary records. [2025-10-21T22:10:14.532518] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-10-21T22:10:14.569735] [DEBUG] [LOCAL ] JILL: Loaded 15442 existing records from primary storage. [2025-10-21T22:10:14.585954] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-10-21T22:10:14.587241] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-10-21T22:10:14.587124] [INFO ] [MAIN ] JILL: Loaded 15442 primary data records. [2025-10-21T22:10:14.599384] [DEBUG] [LOCAL ] JHX: Loaded 53200 existing records from primary storage. [2025-10-21T22:10:14.612257] [INFO ] [MAIN ] Derivative Progress: 957/2057 symbols completed. JHS took 0.7s. Estimated remaining: 6m 56s. Rate: 158.6 symbols/min [2025-10-21T22:10:14.635208] [INFO ] [MAIN ] JHX: Loaded 53200 primary data records. [2025-10-21T22:10:14.635065] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:15.253396] [DEBUG] [LOCAL ] JKS: Loaded 39289 existing records from primary storage. [2025-10-21T22:10:15.254579] [INFO ] [MAIN ] JKS: Loaded 39289 primary data records. [2025-10-21T22:10:15.587382] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:15.589718] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 15442 primary records. [2025-10-21T22:10:15.590071] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-10-21T22:10:15.607168] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-10-21T22:10:15.608301] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-10-21T22:10:15.610569] [INFO ] [MAIN ] Derivative Progress: 958/2057 symbols completed. JILL took 1.1s. Estimated remaining: 6m 56s. Rate: 158.3 symbols/min [2025-10-21T22:10:15.625624] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:15.627382] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 53200 primary records. [2025-10-21T22:10:15.627595] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-10-21T22:10:15.644529] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-10-21T22:10:15.644789] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-10-21T22:10:15.647697] [INFO ] [MAIN ] Derivative Progress: 959/2057 symbols completed. JHX took 1.2s. Estimated remaining: 6m 56s. Rate: 158.5 symbols/min [2025-10-21T22:10:15.663160] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:15.663840] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 39289 primary records. [2025-10-21T22:10:15.663900] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-10-21T22:10:15.679014] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-10-21T22:10:15.679090] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-10-21T22:10:15.681589] [INFO ] [MAIN ] Derivative Progress: 960/2057 symbols completed. JKS took 1.0s. Estimated remaining: 6m 55s. Rate: 158.6 symbols/min [2025-10-21T22:10:15.682077] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:15.682237] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:15.682714] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:15.689869] [DEBUG] [LOCAL ] JLS: Loaded 4074 existing records from primary storage. [2025-10-21T22:10:15.690096] [INFO ] [MAIN ] JLS: Loaded 4074 primary data records. [2025-10-21T22:10:16.050321] [DEBUG] [LOCAL ] JLL: Loaded 31598 existing records from primary storage. [2025-10-21T22:10:16.050991] [INFO ] [MAIN ] JLL: Loaded 31598 primary data records. [2025-10-21T22:10:16.063296] [DEBUG] [LOCAL ] JMIA: Loaded 51203 existing records from primary storage. [2025-10-21T22:10:16.089922] [INFO ] [MAIN ] JMIA: Loaded 51203 primary data records. [2025-10-21T22:10:16.698401] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:16.700012] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4074 primary records. [2025-10-21T22:10:16.700603] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-10-21T22:10:16.717384] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-10-21T22:10:16.718145] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-10-21T22:10:16.720988] [INFO ] [MAIN ] Derivative Progress: 961/2057 symbols completed. JLS took 1.0s. Estimated remaining: 6m 55s. Rate: 158.3 symbols/min [2025-10-21T22:10:16.721410] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:16.740603] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:16.742431] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 31598 primary records. [2025-10-21T22:10:16.742596] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-10-21T22:10:16.772634] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:16.774691] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 51203 primary records. [2025-10-21T22:10:16.773933] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-10-21T22:10:16.774907] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-10-21T22:10:16.774853] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-10-21T22:10:16.777235] [INFO ] [MAIN ] Derivative Progress: 962/2057 symbols completed. JLL took 1.1s. Estimated remaining: 6m 55s. Rate: 158.5 symbols/min [2025-10-21T22:10:16.784950] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:16.808335] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-10-21T22:10:16.808582] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-10-21T22:10:16.811170] [INFO ] [MAIN ] Derivative Progress: 963/2057 symbols completed. JMIA took 1.1s. Estimated remaining: 6m 54s. Rate: 158.6 symbols/min [2025-10-21T22:10:16.811501] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:16.843359] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-21T22:10:16.843688] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-10-21T22:10:16.968732] [DEBUG] [LOCAL ] JOE: Loaded 23783 existing records from primary storage. [2025-10-21T22:10:16.973121] [INFO ] [MAIN ] JOE: Loaded 23783 primary data records. [2025-10-21T22:10:17.110580] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-21T22:10:17.139046] [INFO ] [MAIN ] JOBY: Loaded 53809 primary data records. [2025-10-21T22:10:17.858898] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:17.860115] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-10-21T22:10:17.860473] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-10-21T22:10:17.878005] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-10-21T22:10:17.880270] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-10-21T22:10:17.882500] [INFO ] [MAIN ] Derivative Progress: 964/2057 symbols completed. JNJ took 1.2s. Estimated remaining: 6m 54s. Rate: 158.3 symbols/min [2025-10-21T22:10:17.883436] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:17.901438] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:17.902435] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 23783 primary records. [2025-10-21T22:10:17.904605] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-10-21T22:10:17.918746] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:17.934447] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53809 primary records. [2025-10-21T22:10:17.939140] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-10-21T22:10:17.939346] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-10-21T22:10:17.934849] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-10-21T22:10:17.934746] [DEBUG] [LOCAL ] JOF: Loaded 6932 existing records from primary storage. [2025-10-21T22:10:17.942936] [INFO ] [MAIN ] Derivative Progress: 965/2057 symbols completed. JOE took 1.1s. Estimated remaining: 6m 53s. Rate: 158.5 symbols/min [2025-10-21T22:10:17.943989] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:17.944324] [INFO ] [MAIN ] JOF: Loaded 6932 primary data records. [2025-10-21T22:10:17.981750] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-10-21T22:10:17.981990] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-10-21T22:10:17.995828] [INFO ] [MAIN ] Derivative Progress: 966/2057 symbols completed. JOBY took 1.2s. Estimated remaining: 6m 53s. Rate: 158.6 symbols/min [2025-10-21T22:10:18.001125] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:18.302983] [DEBUG] [LOCAL ] JPC: Loaded 37060 existing records from primary storage. [2025-10-21T22:10:18.303785] [INFO ] [MAIN ] JPC: Loaded 37060 primary data records. [2025-10-21T22:10:18.471580] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-21T22:10:18.500118] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-10-21T22:10:18.852410] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:19.014467] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 6932 primary records. [2025-10-21T22:10:19.014893] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-10-21T22:10:19.032172] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-10-21T22:10:19.032938] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-10-21T22:10:19.035171] [INFO ] [MAIN ] Derivative Progress: 967/2057 symbols completed. JOF took 1.2s. Estimated remaining: 6m 53s. Rate: 158.3 symbols/min [2025-10-21T22:10:19.035611] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:19.053530] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:19.054340] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37060 primary records. [2025-10-21T22:10:19.054455] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-10-21T22:10:19.072182] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-10-21T22:10:19.072503] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-10-21T22:10:19.074966] [INFO ] [MAIN ] Derivative Progress: 968/2057 symbols completed. JPC took 1.1s. Estimated remaining: 6m 52s. Rate: 158.5 symbols/min [2025-10-21T22:10:19.075313] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:19.100784] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:19.101476] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-10-21T22:10:19.101682] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-10-21T22:10:19.117585] [DEBUG] [LOCAL ] JQC: Loaded 33940 existing records from primary storage. [2025-10-21T22:10:19.117952] [INFO ] [MAIN ] JQC: Loaded 33940 primary data records. [2025-10-21T22:10:19.132876] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-10-21T22:10:19.149406] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-10-21T22:10:19.162382] [INFO ] [MAIN ] Derivative Progress: 969/2057 symbols completed. JPM took 1.2s. Estimated remaining: 6m 52s. Rate: 158.6 symbols/min [2025-10-21T22:10:19.197826] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:19.185556] [DEBUG] [LOCAL ] JRI: Loaded 15402 existing records from primary storage. [2025-10-21T22:10:19.211875] [INFO ] [MAIN ] JRI: Loaded 15402 primary data records. [2025-10-21T22:10:19.545164] [DEBUG] [LOCAL ] JRS: Loaded 11594 existing records from primary storage. [2025-10-21T22:10:19.565469] [INFO ] [MAIN ] JRS: Loaded 11594 primary data records. [2025-10-21T22:10:20.093384] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:20.095683] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33940 primary records. [2025-10-21T22:10:20.095860] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-10-21T22:10:20.123886] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-10-21T22:10:20.124398] [DEBUG] [MAIN ] JRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:20.125107] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15402 primary records. [2025-10-21T22:10:20.125292] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-10-21T22:10:20.125625] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-10-21T22:10:20.128299] [INFO ] [MAIN ] Derivative Progress: 970/2057 symbols completed. JQC took 1.1s. Estimated remaining: 6m 52s. Rate: 158.3 symbols/min [2025-10-21T22:10:20.128565] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:20.145520] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-10-21T22:10:20.145850] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-10-21T22:10:20.148467] [INFO ] [MAIN ] Derivative Progress: 971/2057 symbols completed. JRI took 1.1s. Estimated remaining: 6m 51s. Rate: 158.5 symbols/min [2025-10-21T22:10:20.150603] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:20.165373] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:20.166254] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11594 primary records. [2025-10-21T22:10:20.166315] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-10-21T22:10:20.182443] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-10-21T22:10:20.182791] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-10-21T22:10:20.185412] [INFO ] [MAIN ] Derivative Progress: 972/2057 symbols completed. JRS took 1.0s. Estimated remaining: 6m 50s. Rate: 158.6 symbols/min [2025-10-21T22:10:20.185829] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:20.237393] [DEBUG] [LOCAL ] KAI: Loaded 13490 existing records from primary storage. [2025-10-21T22:10:20.238729] [DEBUG] [LOCAL ] JXN: Loaded 44418 existing records from primary storage. [2025-10-21T22:10:20.239102] [INFO ] [MAIN ] JXN: Loaded 44418 primary data records. [2025-10-21T22:10:20.238881] [INFO ] [MAIN ] KAI: Loaded 13490 primary data records. [2025-10-21T22:10:20.397940] [DEBUG] [LOCAL ] K: Loaded 50401 existing records from primary storage. [2025-10-21T22:10:20.437363] [INFO ] [MAIN ] K: Loaded 50401 primary data records. [2025-10-21T22:10:21.294073] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:21.300343] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13490 primary records. [2025-10-21T22:10:21.301367] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-10-21T22:10:21.299389] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:21.303447] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 44418 primary records. [2025-10-21T22:10:21.303557] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-10-21T22:10:21.341099] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-10-21T22:10:21.344104] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:21.348273] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-10-21T22:10:21.349019] [INFO ] [MAIN ] K: Generated 1794 derivative records from 50401 primary records. [2025-10-21T22:10:21.349252] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-10-21T22:10:21.349080] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-10-21T22:10:21.349379] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-10-21T22:10:21.352778] [INFO ] [MAIN ] Derivative Progress: 973/2057 symbols completed. JXN took 1.2s. Estimated remaining: 6m 51s. Rate: 158.3 symbols/min [2025-10-21T22:10:21.362477] [INFO ] [MAIN ] Derivative Progress: 974/2057 symbols completed. KAI took 1.2s. Estimated remaining: 6m 50s. Rate: 158.5 symbols/min [2025-10-21T22:10:21.370475] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-10-21T22:10:21.370547] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-10-21T22:10:21.373117] [INFO ] [MAIN ] Derivative Progress: 975/2057 symbols completed. K took 1.2s. Estimated remaining: 6m 49s. Rate: 158.6 symbols/min [2025-10-21T22:10:21.373680] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:21.373792] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:21.373586] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:21.402913] [DEBUG] [LOCAL ] KB: Loaded 23189 existing records from primary storage. [2025-10-21T22:10:21.420100] [INFO ] [MAIN ] KB: Loaded 23189 primary data records. [2025-10-21T22:10:21.420631] [DEBUG] [LOCAL ] KBDC: Loaded 22747 existing records from primary storage. [2025-10-21T22:10:21.457969] [INFO ] [MAIN ] KBDC: Loaded 22747 primary data records. [2025-10-21T22:10:21.556217] [DEBUG] [LOCAL ] KAR: Loaded 39768 existing records from primary storage. [2025-10-21T22:10:21.616291] [INFO ] [MAIN ] KAR: Loaded 39768 primary data records. [2025-10-21T22:10:22.374727] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:22.381041] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 23189 primary records. [2025-10-21T22:10:22.381172] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-10-21T22:10:22.380228] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:22.382734] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 22747 primary records. [2025-10-21T22:10:22.383185] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-10-21T22:10:22.414047] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-10-21T22:10:22.414152] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-10-21T22:10:22.415114] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-10-21T22:10:22.418472] [INFO ] [MAIN ] Derivative Progress: 976/2057 symbols completed. KBDC took 1.0s. Estimated remaining: 6m 50s. Rate: 158.3 symbols/min [2025-10-21T22:10:22.418610] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-10-21T22:10:22.418738] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:22.421625] [INFO ] [MAIN ] Derivative Progress: 977/2057 symbols completed. KB took 1.0s. Estimated remaining: 6m 49s. Rate: 158.5 symbols/min [2025-10-21T22:10:22.422277] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:22.436176] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:22.436859] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 39768 primary records. [2025-10-21T22:10:22.436983] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-10-21T22:10:22.453691] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-10-21T22:10:22.453954] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-10-21T22:10:22.456725] [INFO ] [MAIN ] Derivative Progress: 978/2057 symbols completed. KAR took 1.1s. Estimated remaining: 6m 48s. Rate: 158.6 symbols/min [2025-10-21T22:10:22.460065] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:22.517226] [DEBUG] [LOCAL ] KBR: Loaded 47999 existing records from primary storage. [2025-10-21T22:10:22.518497] [INFO ] [MAIN ] KBR: Loaded 47999 primary data records. [2025-10-21T22:10:22.540297] [DEBUG] [LOCAL ] KBH: Loaded 48751 existing records from primary storage. [2025-10-21T22:10:22.551011] [INFO ] [MAIN ] KBH: Loaded 48751 primary data records. [2025-10-21T22:10:22.961851] [DEBUG] [LOCAL ] KD: Loaded 52344 existing records from primary storage. [2025-10-21T22:10:23.000103] [INFO ] [MAIN ] KD: Loaded 52344 primary data records. [2025-10-21T22:10:23.570487] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:23.573135] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 47999 primary records. [2025-10-21T22:10:23.574899] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-10-21T22:10:23.605036] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-10-21T22:10:23.598238] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:23.606037] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48751 primary records. [2025-10-21T22:10:23.606374] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-10-21T22:10:23.606274] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-10-21T22:10:23.609506] [INFO ] [MAIN ] Derivative Progress: 979/2057 symbols completed. KBR took 1.2s. Estimated remaining: 6m 49s. Rate: 158.3 symbols/min [2025-10-21T22:10:23.609662] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:23.627169] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-10-21T22:10:23.627593] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-10-21T22:10:23.635445] [DEBUG] [LOCAL ] KEN: Loaded 4665 existing records from primary storage. [2025-10-21T22:10:23.632235] [INFO ] [MAIN ] Derivative Progress: 980/2057 symbols completed. KBH took 1.2s. Estimated remaining: 6m 48s. Rate: 158.5 symbols/min [2025-10-21T22:10:23.636543] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:23.636934] [INFO ] [MAIN ] KEN: Loaded 4665 primary data records. [2025-10-21T22:10:23.743718] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:23.755966] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52344 primary records. [2025-10-21T22:10:23.756411] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-10-21T22:10:23.853670] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-10-21T22:10:23.967535] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-10-21T22:10:23.979157] [INFO ] [MAIN ] Derivative Progress: 981/2057 symbols completed. KD took 1.5s. Estimated remaining: 6m 47s. Rate: 158.5 symbols/min [2025-10-21T22:10:23.989940] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:23.990889] [DEBUG] [LOCAL ] KEP: Loaded 32502 existing records from primary storage. [2025-10-21T22:10:23.990961] [INFO ] [MAIN ] KEP: Loaded 32502 primary data records. [2025-10-21T22:10:24.332272] [DEBUG] [LOCAL ] KEX: Loaded 38788 existing records from primary storage. [2025-10-21T22:10:24.332807] [INFO ] [MAIN ] KEX: Loaded 38788 primary data records. [2025-10-21T22:10:24.357436] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:24.378593] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4665 primary records. [2025-10-21T22:10:24.423170] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-10-21T22:10:24.481873] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-10-21T22:10:24.492442] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-10-21T22:10:24.509712] [INFO ] [MAIN ] Derivative Progress: 982/2057 symbols completed. KEN took 0.9s. Estimated remaining: 6m 47s. Rate: 158.4 symbols/min [2025-10-21T22:10:24.510036] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:24.692261] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:24.693351] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 32502 primary records. [2025-10-21T22:10:24.693679] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-10-21T22:10:24.725593] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-10-21T22:10:24.725976] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-10-21T22:10:24.728352] [INFO ] [MAIN ] Derivative Progress: 983/2057 symbols completed. KEP took 1.1s. Estimated remaining: 6m 47s. Rate: 158.5 symbols/min [2025-10-21T22:10:24.728871] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:24.749133] [DEBUG] [LOCAL ] KF: Loaded 2359 existing records from primary storage. [2025-10-21T22:10:24.746205] [DEBUG] [LOCAL ] KEYS: Loaded 43207 existing records from primary storage. [2025-10-21T22:10:24.749301] [INFO ] [MAIN ] KEYS: Loaded 43207 primary data records. [2025-10-21T22:10:24.749426] [INFO ] [MAIN ] KF: Loaded 2359 primary data records. [2025-10-21T22:10:24.855086] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:24.888004] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 38788 primary records. [2025-10-21T22:10:24.898354] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-10-21T22:10:25.027800] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-10-21T22:10:25.038458] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-10-21T22:10:25.078501] [INFO ] [MAIN ] Derivative Progress: 984/2057 symbols completed. KEX took 1.1s. Estimated remaining: 6m 46s. Rate: 158.5 symbols/min [2025-10-21T22:10:25.142737] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:25.462215] [DEBUG] [LOCAL ] KFRC: Loaded 20800 existing records from primary storage. [2025-10-21T22:10:25.463887] [INFO ] [MAIN ] KFRC: Loaded 20800 primary data records. [2025-10-21T22:10:25.626615] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:25.664581] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43207 primary records. [2025-10-21T22:10:25.668451] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-10-21T22:10:25.816030] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:25.819565] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2359 primary records. [2025-10-21T22:10:25.820098] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-10-21T22:10:25.829755] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-10-21T22:10:25.830049] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-10-21T22:10:25.833046] [INFO ] [MAIN ] Derivative Progress: 985/2057 symbols completed. KEYS took 1.3s. Estimated remaining: 6m 46s. Rate: 158.3 symbols/min [2025-10-21T22:10:25.836853] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:25.842252] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-10-21T22:10:25.842601] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-10-21T22:10:25.844939] [INFO ] [MAIN ] Derivative Progress: 986/2057 symbols completed. KF took 1.1s. Estimated remaining: 6m 45s. Rate: 158.5 symbols/min [2025-10-21T22:10:25.845093] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:25.853705] [DEBUG] [LOCAL ] KFS: Loaded 8691 existing records from primary storage. [2025-10-21T22:10:25.854178] [INFO ] [MAIN ] KFS: Loaded 8691 primary data records. [2025-10-21T22:10:26.046894] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:26.078200] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 20800 primary records. [2025-10-21T22:10:26.078306] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-10-21T22:10:26.195268] [DEBUG] [LOCAL ] KFY: Loaded 29615 existing records from primary storage. [2025-10-21T22:10:26.195921] [INFO ] [MAIN ] KFY: Loaded 29615 primary data records. [2025-10-21T22:10:26.314785] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-10-21T22:10:26.318765] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-10-21T22:10:26.321510] [INFO ] [MAIN ] Derivative Progress: 987/2057 symbols completed. KFRC took 1.2s. Estimated remaining: 6m 45s. Rate: 158.4 symbols/min [2025-10-21T22:10:26.327412] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:26.532560] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:26.546858] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8691 primary records. [2025-10-21T22:10:26.547105] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-10-21T22:10:26.563772] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-10-21T22:10:26.564811] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-10-21T22:10:26.566856] [INFO ] [MAIN ] Derivative Progress: 988/2057 symbols completed. KFS took 0.7s. Estimated remaining: 6m 45s. Rate: 158.5 symbols/min [2025-10-21T22:10:26.584444] [DEBUG] [LOCAL ] KGC: Loaded 53700 existing records from primary storage. [2025-10-21T22:10:26.584816] [INFO ] [MAIN ] KGC: Loaded 53700 primary data records. [2025-10-21T22:10:26.762159] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:26.784106] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 29615 primary records. [2025-10-21T22:10:26.937130] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-10-21T22:10:26.954850] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-10-21T22:10:26.955072] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-10-21T22:10:26.957731] [INFO ] [MAIN ] Derivative Progress: 989/2057 symbols completed. KFY took 1.1s. Estimated remaining: 6m 44s. Rate: 158.5 symbols/min [2025-10-21T22:10:26.977102] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:26.977702] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53700 primary records. [2025-10-21T22:10:26.977766] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-10-21T22:10:26.992725] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-10-21T22:10:26.992780] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-10-21T22:10:26.995031] [INFO ] [MAIN ] Derivative Progress: 990/2057 symbols completed. KGC took 0.7s. Estimated remaining: 6m 44s. Rate: 158.6 symbols/min [2025-10-21T22:10:26.995437] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:26.995509] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:26.995583] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:27.019260] [DEBUG] [LOCAL ] KIO: Loaded 21750 existing records from primary storage. [2025-10-21T22:10:27.019421] [INFO ] [MAIN ] KIO: Loaded 21750 primary data records. [2025-10-21T22:10:27.372959] [DEBUG] [LOCAL ] KIM: Loaded 53000 existing records from primary storage. [2025-10-21T22:10:27.373141] [INFO ] [MAIN ] KIM: Loaded 53000 primary data records. [2025-10-21T22:10:27.411447] [DEBUG] [LOCAL ] KGS: Loaded 46136 existing records from primary storage. [2025-10-21T22:10:27.425780] [INFO ] [MAIN ] KGS: Loaded 46136 primary data records. [2025-10-21T22:10:27.992629] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:27.993554] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21750 primary records. [2025-10-21T22:10:27.994079] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-10-21T22:10:28.012295] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-10-21T22:10:28.013354] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-10-21T22:10:28.016457] [INFO ] [MAIN ] Derivative Progress: 991/2057 symbols completed. KIO took 1.0s. Estimated remaining: 6m 44s. Rate: 158.4 symbols/min [2025-10-21T22:10:28.017267] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:28.032984] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:28.033770] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53000 primary records. [2025-10-21T22:10:28.033990] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-10-21T22:10:28.067559] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-10-21T22:10:28.067720] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-10-21T22:10:28.070582] [INFO ] [MAIN ] Derivative Progress: 992/2057 symbols completed. KIM took 1.1s. Estimated remaining: 6m 43s. Rate: 158.5 symbols/min [2025-10-21T22:10:28.071449] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:28.071684] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:28.072373] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 46136 primary records. [2025-10-21T22:10:28.072990] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-10-21T22:10:28.088909] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-10-21T22:10:28.089128] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-10-21T22:10:28.091875] [INFO ] [MAIN ] Derivative Progress: 993/2057 symbols completed. KGS took 1.1s. Estimated remaining: 6m 42s. Rate: 158.7 symbols/min [2025-10-21T22:10:28.093548] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:28.098566] [DEBUG] [LOCAL ] KKRS: Loaded 5573 existing records from primary storage. [2025-10-21T22:10:28.098796] [INFO ] [MAIN ] KKRS: Loaded 5573 primary data records. [2025-10-21T22:10:28.285177] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-21T22:10:28.300674] [INFO ] [MAIN ] KKR: Loaded 53500 primary data records. [2025-10-21T22:10:28.567692] [DEBUG] [LOCAL ] KLC: Loaded 36207 existing records from primary storage. [2025-10-21T22:10:28.604665] [INFO ] [MAIN ] KLC: Loaded 36207 primary data records. [2025-10-21T22:10:29.116496] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:29.118425] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5573 primary records. [2025-10-21T22:10:29.118604] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-10-21T22:10:29.134932] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-10-21T22:10:29.135050] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-10-21T22:10:29.137490] [INFO ] [MAIN ] Derivative Progress: 994/2057 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 43s. Rate: 158.4 symbols/min [2025-10-21T22:10:29.137667] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:29.156307] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:29.157406] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53500 primary records. [2025-10-21T22:10:29.157606] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-10-21T22:10:29.176054] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-10-21T22:10:29.176324] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-10-21T22:10:29.183738] [INFO ] [MAIN ] Derivative Progress: 995/2057 symbols completed. KKR took 1.2s. Estimated remaining: 6m 42s. Rate: 158.5 symbols/min [2025-10-21T22:10:29.184048] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:29.200223] [DEBUG] [LOCAL ] KMPB: Loaded 3533 existing records from primary storage. [2025-10-21T22:10:29.205148] [INFO ] [MAIN ] KMPB: Loaded 3533 primary data records. [2025-10-21T22:10:29.205515] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:29.256543] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36207 primary records. [2025-10-21T22:10:29.268773] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-10-21T22:10:29.331146] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-10-21T22:10:29.342368] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-10-21T22:10:29.359269] [INFO ] [MAIN ] Derivative Progress: 996/2057 symbols completed. KLC took 1.3s. Estimated remaining: 6m 41s. Rate: 158.6 symbols/min [2025-10-21T22:10:29.366239] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:29.414245] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-21T22:10:29.539873] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-10-21T22:10:29.790775] [DEBUG] [LOCAL ] KMPR: Loaded 40497 existing records from primary storage. [2025-10-21T22:10:29.897601] [INFO ] [MAIN ] KMPR: Loaded 40497 primary data records. [2025-10-21T22:10:30.123761] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:30.246413] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3533 primary records. [2025-10-21T22:10:30.246785] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-10-21T22:10:30.263103] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-10-21T22:10:30.264604] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-10-21T22:10:30.266860] [INFO ] [MAIN ] Derivative Progress: 997/2057 symbols completed. KMPB took 1.1s. Estimated remaining: 6m 42s. Rate: 158.4 symbols/min [2025-10-21T22:10:30.267579] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:30.288619] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:30.289679] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-10-21T22:10:30.290020] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-10-21T22:10:30.307281] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-10-21T22:10:30.307391] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-10-21T22:10:30.309963] [INFO ] [MAIN ] Derivative Progress: 998/2057 symbols completed. KMI took 1.2s. Estimated remaining: 6m 41s. Rate: 158.5 symbols/min [2025-10-21T22:10:30.310418] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:30.336842] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:30.337541] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 40497 primary records. [2025-10-21T22:10:30.337731] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-10-21T22:10:30.366814] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-10-21T22:10:30.367090] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-10-21T22:10:30.371948] [DEBUG] [LOCAL ] KMT: Loaded 42860 existing records from primary storage. [2025-10-21T22:10:30.370505] [INFO ] [MAIN ] Derivative Progress: 999/2057 symbols completed. KMPR took 1.0s. Estimated remaining: 6m 40s. Rate: 158.6 symbols/min [2025-10-21T22:10:30.372227] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:30.372413] [INFO ] [MAIN ] KMT: Loaded 42860 primary data records. [2025-10-21T22:10:30.731367] [DEBUG] [LOCAL ] KMX: Loaded 53285 existing records from primary storage. [2025-10-21T22:10:30.731781] [INFO ] [MAIN ] KMX: Loaded 53285 primary data records. [2025-10-21T22:10:30.796366] [DEBUG] [LOCAL ] KN: Loaded 38436 existing records from primary storage. [2025-10-21T22:10:30.811073] [INFO ] [MAIN ] KN: Loaded 38436 primary data records. [2025-10-21T22:10:31.438089] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:31.439768] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 42860 primary records. [2025-10-21T22:10:31.440151] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-10-21T22:10:31.456557] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-10-21T22:10:31.456965] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-10-21T22:10:31.459737] [INFO ] [MAIN ] Derivative Progress: 1000/2057 symbols completed. KMT took 1.2s. Estimated remaining: 6m 41s. Rate: 158.4 symbols/min [2025-10-21T22:10:31.460678] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:31.480353] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:31.481162] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53285 primary records. [2025-10-21T22:10:31.481384] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-10-21T22:10:31.507442] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-10-21T22:10:31.520605] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-10-21T22:10:31.520915] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:31.523285] [INFO ] [MAIN ] Derivative Progress: 1001/2057 symbols completed. KMX took 1.2s. Estimated remaining: 6m 40s. Rate: 158.5 symbols/min [2025-10-21T22:10:31.523513] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:31.524352] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 38436 primary records. [2025-10-21T22:10:31.524628] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-10-21T22:10:31.551346] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-10-21T22:10:31.554347] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-10-21T22:10:31.556934] [INFO ] [MAIN ] Derivative Progress: 1002/2057 symbols completed. KN took 1.2s. Estimated remaining: 6m 39s. Rate: 158.6 symbols/min [2025-10-21T22:10:31.557132] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:31.558515] [DEBUG] [LOCAL ] KNF: Loaded 36664 existing records from primary storage. [2025-10-21T22:10:31.558774] [INFO ] [MAIN ] KNF: Loaded 36664 primary data records. [2025-10-21T22:10:31.600336] [DEBUG] [LOCAL ] KNOP: Loaded 10137 existing records from primary storage. [2025-10-21T22:10:31.627293] [INFO ] [MAIN ] KNOP: Loaded 10137 primary data records. [2025-10-21T22:10:31.784839] [DEBUG] [LOCAL ] KNSL: Loaded 18446 existing records from primary storage. [2025-10-21T22:10:31.856674] [INFO ] [MAIN ] KNSL: Loaded 18446 primary data records. [2025-10-21T22:10:32.517082] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:32.518869] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 36664 primary records. [2025-10-21T22:10:32.518132] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:32.519765] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 10137 primary records. [2025-10-21T22:10:32.519999] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-10-21T22:10:32.519050] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-10-21T22:10:32.548575] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-10-21T22:10:32.548721] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-10-21T22:10:32.555525] [INFO ] [MAIN ] Derivative Progress: 1003/2057 symbols completed. KNF took 1.1s. Estimated remaining: 6m 39s. Rate: 158.4 symbols/min [2025-10-21T22:10:32.552614] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-10-21T22:10:32.555812] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-10-21T22:10:32.558244] [INFO ] [MAIN ] Derivative Progress: 1004/2057 symbols completed. KNOP took 1.0s. Estimated remaining: 6m 39s. Rate: 158.5 symbols/min [2025-10-21T22:10:32.571555] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:32.572215] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18446 primary records. [2025-10-21T22:10:32.572276] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-10-21T22:10:32.587880] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-10-21T22:10:32.587965] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-10-21T22:10:32.590789] [INFO ] [MAIN ] Derivative Progress: 1005/2057 symbols completed. KNSL took 1.0s. Estimated remaining: 6m 38s. Rate: 158.7 symbols/min [2025-10-21T22:10:32.591203] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:32.591332] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:32.591634] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:32.673615] [DEBUG] [LOCAL ] KNTK: Loaded 47232 existing records from primary storage. [2025-10-21T22:10:32.673880] [INFO ] [MAIN ] KNTK: Loaded 47232 primary data records. [2025-10-21T22:10:32.674393] [DEBUG] [LOCAL ] KODK: Loaded 43762 existing records from primary storage. [2025-10-21T22:10:32.687560] [INFO ] [MAIN ] KODK: Loaded 43762 primary data records. [2025-10-21T22:10:32.828768] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-21T22:10:32.849754] [INFO ] [MAIN ] KNX: Loaded 52645 primary data records. [2025-10-21T22:10:33.690354] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:33.693028] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43762 primary records. [2025-10-21T22:10:33.693240] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-10-21T22:10:33.717856] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:33.731280] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 47232 primary records. [2025-10-21T22:10:33.730072] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:33.732278] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52645 primary records. [2025-10-21T22:10:33.740322] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-10-21T22:10:33.740411] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-10-21T22:10:33.740511] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-10-21T22:10:33.741049] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-10-21T22:10:33.744147] [INFO ] [MAIN ] Derivative Progress: 1006/2057 symbols completed. KODK took 1.2s. Estimated remaining: 6m 38s. Rate: 158.3 symbols/min [2025-10-21T22:10:33.744628] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:33.776593] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-10-21T22:10:33.779699] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-10-21T22:10:33.779830] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-10-21T22:10:33.782212] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-10-21T22:10:33.781954] [INFO ] [MAIN ] Derivative Progress: 1007/2057 symbols completed. KNTK took 1.2s. Estimated remaining: 6m 38s. Rate: 158.5 symbols/min [2025-10-21T22:10:33.785447] [INFO ] [MAIN ] Derivative Progress: 1008/2057 symbols completed. KNX took 1.2s. Estimated remaining: 6m 37s. Rate: 158.6 symbols/min [2025-10-21T22:10:33.785366] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:33.785712] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:33.798585] [DEBUG] [LOCAL ] KORE: Loaded 2184 existing records from primary storage. [2025-10-21T22:10:33.798961] [INFO ] [MAIN ] KORE: Loaded 2184 primary data records. [2025-10-21T22:10:33.897759] [DEBUG] [LOCAL ] KOF: Loaded 26600 existing records from primary storage. [2025-10-21T22:10:33.914114] [INFO ] [MAIN ] KOF: Loaded 26600 primary data records. [2025-10-21T22:10:34.008184] [DEBUG] [LOCAL ] KOP: Loaded 17428 existing records from primary storage. [2025-10-21T22:10:34.055465] [INFO ] [MAIN ] KOP: Loaded 17428 primary data records. [2025-10-21T22:10:34.746398] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:34.747485] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 2184 primary records. [2025-10-21T22:10:34.747582] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-10-21T22:10:34.762553] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-10-21T22:10:34.762862] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-10-21T22:10:34.764759] [INFO ] [MAIN ] Derivative Progress: 1009/2057 symbols completed. KORE took 1.0s. Estimated remaining: 6m 37s. Rate: 158.4 symbols/min [2025-10-21T22:10:34.765142] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:34.787899] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:34.801015] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26600 primary records. [2025-10-21T22:10:34.801163] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-10-21T22:10:34.801766] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:34.803456] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 17428 primary records. [2025-10-21T22:10:34.810470] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-10-21T22:10:34.819524] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-10-21T22:10:34.826899] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-10-21T22:10:34.833044] [INFO ] [MAIN ] Derivative Progress: 1010/2057 symbols completed. KOF took 1.1s. Estimated remaining: 6m 36s. Rate: 158.5 symbols/min [2025-10-21T22:10:34.833293] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:34.838119] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-10-21T22:10:34.853610] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-10-21T22:10:34.856592] [INFO ] [MAIN ] Derivative Progress: 1011/2057 symbols completed. KOP took 1.1s. Estimated remaining: 6m 36s. Rate: 158.7 symbols/min [2025-10-21T22:10:34.856906] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:34.889324] [DEBUG] [LOCAL ] KOS: Loaded 53093 existing records from primary storage. [2025-10-21T22:10:34.889749] [INFO ] [MAIN ] KOS: Loaded 53093 primary data records. [2025-10-21T22:10:35.105691] [DEBUG] [LOCAL ] KRC: Loaded 48149 existing records from primary storage. [2025-10-21T22:10:35.119378] [INFO ] [MAIN ] KRC: Loaded 48149 primary data records. [2025-10-21T22:10:35.099908] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-21T22:10:35.130339] [INFO ] [MAIN ] KR: Loaded 53681 primary data records. [2025-10-21T22:10:35.948701] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:35.950489] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53093 primary records. [2025-10-21T22:10:35.952141] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-10-21T22:10:35.994423] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-10-21T22:10:35.993238] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:35.994903] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:35.995827] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53681 primary records. [2025-10-21T22:10:35.996707] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48149 primary records. [2025-10-21T22:10:35.995940] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-10-21T22:10:35.998828] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-10-21T22:10:35.996868] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-10-21T22:10:35.998760] [INFO ] [MAIN ] Derivative Progress: 1012/2057 symbols completed. KOS took 1.2s. Estimated remaining: 6m 36s. Rate: 158.4 symbols/min [2025-10-21T22:10:36.000444] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:36.023150] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-10-21T22:10:36.024516] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-10-21T22:10:36.031227] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-10-21T22:10:36.034025] [INFO ] [MAIN ] Derivative Progress: 1013/2057 symbols completed. KRC took 1.2s. Estimated remaining: 6m 35s. Rate: 158.5 symbols/min [2025-10-21T22:10:36.031416] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-10-21T22:10:36.037025] [INFO ] [MAIN ] Derivative Progress: 1014/2057 symbols completed. KR took 1.2s. Estimated remaining: 6m 34s. Rate: 158.7 symbols/min [2025-10-21T22:10:36.036908] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:36.037722] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:36.083008] [DEBUG] [LOCAL ] KRO: Loaded 26642 existing records from primary storage. [2025-10-21T22:10:36.083870] [INFO ] [MAIN ] KRO: Loaded 26642 primary data records. [2025-10-21T22:10:36.083710] [DEBUG] [LOCAL ] KREF: Loaded 38066 existing records from primary storage. [2025-10-21T22:10:36.138875] [INFO ] [MAIN ] KREF: Loaded 38066 primary data records. [2025-10-21T22:10:36.342674] [DEBUG] [LOCAL ] KRG: Loaded 49291 existing records from primary storage. [2025-10-21T22:10:36.389340] [INFO ] [MAIN ] KRG: Loaded 49291 primary data records. [2025-10-21T22:10:37.106597] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:37.097407] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:37.107933] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 26642 primary records. [2025-10-21T22:10:37.108879] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 38066 primary records. [2025-10-21T22:10:37.109323] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-10-21T22:10:37.110077] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-10-21T22:10:37.137763] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-10-21T22:10:37.142550] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-10-21T22:10:37.145661] [INFO ] [MAIN ] Derivative Progress: 1015/2057 symbols completed. KREF took 1.1s. Estimated remaining: 6m 35s. Rate: 158.3 symbols/min [2025-10-21T22:10:37.141547] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-10-21T22:10:37.146738] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:37.146819] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-10-21T22:10:37.149571] [INFO ] [MAIN ] Derivative Progress: 1016/2057 symbols completed. KRO took 1.1s. Estimated remaining: 6m 34s. Rate: 158.5 symbols/min [2025-10-21T22:10:37.150216] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:37.163904] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:37.164531] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49291 primary records. [2025-10-21T22:10:37.164702] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-10-21T22:10:37.186686] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-10-21T22:10:37.186945] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-10-21T22:10:37.192173] [INFO ] [MAIN ] Derivative Progress: 1017/2057 symbols completed. KRG took 1.2s. Estimated remaining: 6m 33s. Rate: 158.6 symbols/min [2025-10-21T22:10:37.201011] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:37.232073] [DEBUG] [LOCAL ] KRP: Loaded 36048 existing records from primary storage. [2025-10-21T22:10:37.232406] [INFO ] [MAIN ] KRP: Loaded 36048 primary data records. [2025-10-21T22:10:37.374228] [DEBUG] [LOCAL ] KSS: Loaded 53589 existing records from primary storage. [2025-10-21T22:10:37.385512] [INFO ] [MAIN ] KSS: Loaded 53589 primary data records. [2025-10-21T22:10:37.671627] [DEBUG] [LOCAL ] KT: Loaded 45470 existing records from primary storage. [2025-10-21T22:10:37.683563] [INFO ] [MAIN ] KT: Loaded 45470 primary data records. [2025-10-21T22:10:38.207133] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:38.208677] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 36048 primary records. [2025-10-21T22:10:38.209254] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-10-21T22:10:38.233043] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-10-21T22:10:38.237495] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-10-21T22:10:38.240285] [INFO ] [MAIN ] Derivative Progress: 1018/2057 symbols completed. KRP took 1.1s. Estimated remaining: 6m 34s. Rate: 158.4 symbols/min [2025-10-21T22:10:38.240988] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:38.241965] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53589 primary records. [2025-10-21T22:10:38.243292] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-10-21T22:10:38.267581] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:38.269250] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45470 primary records. [2025-10-21T22:10:38.272363] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-10-21T22:10:38.271714] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-10-21T22:10:38.272489] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-10-21T22:10:38.275452] [INFO ] [MAIN ] Derivative Progress: 1019/2057 symbols completed. KSS took 1.1s. Estimated remaining: 6m 33s. Rate: 158.5 symbols/min [2025-10-21T22:10:38.290051] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-10-21T22:10:38.290109] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-10-21T22:10:38.292402] [INFO ] [MAIN ] Derivative Progress: 1020/2057 symbols completed. KT took 1.1s. Estimated remaining: 6m 32s. Rate: 158.7 symbols/min [2025-10-21T22:10:38.293157] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:38.293212] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:38.293043] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:38.307981] [DEBUG] [LOCAL ] KTF: Loaded 11685 existing records from primary storage. [2025-10-21T22:10:38.308255] [INFO ] [MAIN ] KTF: Loaded 11685 primary data records. [2025-10-21T22:10:38.466613] [DEBUG] [LOCAL ] KTB: Loaded 40377 existing records from primary storage. [2025-10-21T22:10:38.493478] [INFO ] [MAIN ] KTB: Loaded 40377 primary data records. [2025-10-21T22:10:38.757024] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-21T22:10:38.758565] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-10-21T22:10:39.340911] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:39.342069] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 11685 primary records. [2025-10-21T22:10:39.342300] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-10-21T22:10:39.370106] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-10-21T22:10:39.370820] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-10-21T22:10:39.375059] [INFO ] [MAIN ] Derivative Progress: 1021/2057 symbols completed. KTF took 1.1s. Estimated remaining: 6m 33s. Rate: 158.4 symbols/min [2025-10-21T22:10:39.375906] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:39.393792] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:39.394858] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 40377 primary records. [2025-10-21T22:10:39.395198] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-10-21T22:10:39.416598] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-10-21T22:10:39.425100] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-10-21T22:10:39.430616] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:39.432825] [INFO ] [MAIN ] Derivative Progress: 1022/2057 symbols completed. KTB took 1.1s. Estimated remaining: 6m 32s. Rate: 158.5 symbols/min [2025-10-21T22:10:39.433887] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-10-21T22:10:39.434269] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:39.434051] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-10-21T22:10:39.451733] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-10-21T22:10:39.452257] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-10-21T22:10:39.471361] [INFO ] [MAIN ] Derivative Progress: 1023/2057 symbols completed. KVUE took 1.2s. Estimated remaining: 6m 31s. Rate: 158.6 symbols/min [2025-10-21T22:10:39.472014] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:39.498602] [DEBUG] [LOCAL ] KVYO: Loaded 50885 existing records from primary storage. [2025-10-21T22:10:39.515476] [INFO ] [MAIN ] KVYO: Loaded 50885 primary data records. [2025-10-21T22:10:39.577272] [DEBUG] [LOCAL ] KWR: Loaded 15865 existing records from primary storage. [2025-10-21T22:10:39.598592] [INFO ] [MAIN ] KWR: Loaded 15865 primary data records. [2025-10-21T22:10:39.720385] [DEBUG] [LOCAL ] KW: Loaded 40418 existing records from primary storage. [2025-10-21T22:10:39.801524] [INFO ] [MAIN ] KW: Loaded 40418 primary data records. [2025-10-21T22:10:40.699208] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:40.712335] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:40.713891] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 50885 primary records. [2025-10-21T22:10:40.714501] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 15865 primary records. [2025-10-21T22:10:40.714744] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-10-21T22:10:40.714812] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-10-21T22:10:40.733041] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-10-21T22:10:40.744501] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-10-21T22:10:40.748938] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-10-21T22:10:40.752122] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-10-21T22:10:40.752010] [INFO ] [MAIN ] Derivative Progress: 1024/2057 symbols completed. KWR took 1.3s. Estimated remaining: 6m 32s. Rate: 158.3 symbols/min [2025-10-21T22:10:40.755516] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:40.756037] [INFO ] [MAIN ] Derivative Progress: 1025/2057 symbols completed. KVYO took 1.4s. Estimated remaining: 6m 31s. Rate: 158.4 symbols/min [2025-10-21T22:10:40.756418] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:40.778143] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:40.778907] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40418 primary records. [2025-10-21T22:10:40.779091] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-10-21T22:10:40.799073] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-10-21T22:10:40.807545] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-10-21T22:10:40.810521] [INFO ] [MAIN ] Derivative Progress: 1026/2057 symbols completed. KW took 1.4s. Estimated remaining: 6m 30s. Rate: 158.6 symbols/min [2025-10-21T22:10:40.811048] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:40.835063] [DEBUG] [LOCAL ] KYN: Loaded 30292 existing records from primary storage. [2025-10-21T22:10:40.835679] [INFO ] [MAIN ] KYN: Loaded 30292 primary data records. [2025-10-21T22:10:40.911041] [DEBUG] [LOCAL ] L: Loaded 41211 existing records from primary storage. [2025-10-21T22:10:40.943484] [INFO ] [MAIN ] L: Loaded 41211 primary data records. [2025-10-21T22:10:41.322809] [DEBUG] [LOCAL ] LAC: Loaded 52565 existing records from primary storage. [2025-10-21T22:10:41.359616] [INFO ] [MAIN ] LAC: Loaded 52565 primary data records. [2025-10-21T22:10:41.881399] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:41.882980] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30292 primary records. [2025-10-21T22:10:41.883376] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-10-21T22:10:41.900696] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-10-21T22:10:41.900859] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-10-21T22:10:41.903021] [INFO ] [MAIN ] Derivative Progress: 1027/2057 symbols completed. KYN took 1.1s. Estimated remaining: 6m 30s. Rate: 158.3 symbols/min [2025-10-21T22:10:41.903375] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:41.921936] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:41.922830] [INFO ] [MAIN ] L: Generated 1794 derivative records from 41211 primary records. [2025-10-21T22:10:41.923025] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-10-21T22:10:41.944572] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-10-21T22:10:41.946558] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-10-21T22:10:41.949093] [INFO ] [MAIN ] Derivative Progress: 1028/2057 symbols completed. L took 1.2s. Estimated remaining: 6m 30s. Rate: 158.4 symbols/min [2025-10-21T22:10:41.950030] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:41.973005] [DEBUG] [LOCAL ] LAD: Loaded 23222 existing records from primary storage. [2025-10-21T22:10:41.973488] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:41.974359] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52565 primary records. [2025-10-21T22:10:41.974483] [INFO ] [MAIN ] LAD: Loaded 23222 primary data records. [2025-10-21T22:10:41.974588] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-10-21T22:10:42.022512] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-10-21T22:10:42.034706] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-10-21T22:10:42.051320] [INFO ] [MAIN ] Derivative Progress: 1029/2057 symbols completed. LAC took 1.2s. Estimated remaining: 6m 29s. Rate: 158.5 symbols/min [2025-10-21T22:10:42.072497] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:42.155764] [DEBUG] [LOCAL ] LANV: Loaded 2794 existing records from primary storage. [2025-10-21T22:10:42.174869] [INFO ] [MAIN ] LANV: Loaded 2794 primary data records. [2025-10-21T22:10:42.451990] [DEBUG] [LOCAL ] LADR: Loaded 39406 existing records from primary storage. [2025-10-21T22:10:42.457917] [INFO ] [MAIN ] LADR: Loaded 39406 primary data records. [2025-10-21T22:10:43.005081] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:10:43.005884] [INFO ] [MAIN ] LAD: Generated 1793 derivative records from 23222 primary records. [2025-10-21T22:10:43.005985] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-10-21T22:10:43.024807] [DEBUG] [LOCAL ] LAD: Derivative data saved (1793 records). [2025-10-21T22:10:43.025382] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-10-21T22:10:43.027931] [INFO ] [MAIN ] Derivative Progress: 1030/2057 symbols completed. LAD took 1.1s. Estimated remaining: 6m 29s. Rate: 158.3 symbols/min [2025-10-21T22:10:43.028485] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:43.047485] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:10:43.052409] [INFO ] [MAIN ] LANV: Generated 1793 derivative records from 2794 primary records. [2025-10-21T22:10:43.052735] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-10-21T22:10:43.073882] [DEBUG] [LOCAL ] LANV: Derivative data saved (1793 records). [2025-10-21T22:10:43.074034] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-10-21T22:10:43.076787] [INFO ] [MAIN ] Derivative Progress: 1031/2057 symbols completed. LANV took 1.0s. Estimated remaining: 6m 29s. Rate: 158.4 symbols/min [2025-10-21T22:10:43.076925] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:43.077414] [DEBUG] [LOCAL ] LAW: Loaded 14777 existing records from primary storage. [2025-10-21T22:10:43.078037] [INFO ] [MAIN ] LAW: Loaded 14777 primary data records. [2025-10-21T22:10:43.196510] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:43.208428] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 39406 primary records. [2025-10-21T22:10:43.224053] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-10-21T22:10:43.449737] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-10-21T22:10:43.463085] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-10-21T22:10:43.466575] [INFO ] [MAIN ] Derivative Progress: 1032/2057 symbols completed. LADR took 1.5s. Estimated remaining: 6m 28s. Rate: 158.4 symbols/min [2025-10-21T22:10:43.468143] [DEBUG] [LOCAL ] LAZ: Loaded 44474 existing records from primary storage. [2025-10-21T22:10:43.468268] [INFO ] [MAIN ] LAZ: Loaded 44474 primary data records. [2025-10-21T22:10:43.466954] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:43.792974] [DEBUG] [LOCAL ] LB: Loaded 37118 existing records from primary storage. [2025-10-21T22:10:43.793777] [INFO ] [MAIN ] LB: Loaded 37118 primary data records. [2025-10-21T22:10:43.828203] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:43.844473] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 14777 primary records. [2025-10-21T22:10:43.844601] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-10-21T22:10:43.954108] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-10-21T22:10:43.954951] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-10-21T22:10:43.978418] [INFO ] [MAIN ] Derivative Progress: 1033/2057 symbols completed. LAW took 0.9s. Estimated remaining: 6m 28s. Rate: 158.3 symbols/min [2025-10-21T22:10:44.141410] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:44.142263] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 44474 primary records. [2025-10-21T22:10:44.142374] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-10-21T22:10:44.160134] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-10-21T22:10:44.160231] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-10-21T22:10:44.162842] [INFO ] [MAIN ] Derivative Progress: 1034/2057 symbols completed. LAZ took 1.1s. Estimated remaining: 6m 27s. Rate: 158.4 symbols/min [2025-10-21T22:10:44.178733] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:44.179271] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37118 primary records. [2025-10-21T22:10:44.179330] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-10-21T22:10:44.194028] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-10-21T22:10:44.194118] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-10-21T22:10:44.196342] [INFO ] [MAIN ] Derivative Progress: 1035/2057 symbols completed. LB took 0.7s. Estimated remaining: 6m 27s. Rate: 158.6 symbols/min [2025-10-21T22:10:44.196706] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:44.196758] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:44.196838] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:44.279748] [DEBUG] [LOCAL ] LBRT: Loaded 53003 existing records from primary storage. [2025-10-21T22:10:44.293954] [INFO ] [MAIN ] LBRT: Loaded 53003 primary data records. [2025-10-21T22:10:44.315303] [DEBUG] [LOCAL ] LDI: Loaded 45083 existing records from primary storage. [2025-10-21T22:10:44.331602] [DEBUG] [LOCAL ] LC: Loaded 48247 existing records from primary storage. [2025-10-21T22:10:44.350679] [INFO ] [MAIN ] LC: Loaded 48247 primary data records. [2025-10-21T22:10:44.359462] [INFO ] [MAIN ] LDI: Loaded 45083 primary data records. [2025-10-21T22:10:45.243745] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:45.244777] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 53003 primary records. [2025-10-21T22:10:45.245014] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-10-21T22:10:45.265917] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-10-21T22:10:45.266855] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-10-21T22:10:45.268668] [INFO ] [MAIN ] Derivative Progress: 1036/2057 symbols completed. LBRT took 1.1s. Estimated remaining: 6m 27s. Rate: 158.3 symbols/min [2025-10-21T22:10:45.276439] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:45.282210] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:45.294967] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 48247 primary records. [2025-10-21T22:10:45.295338] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-10-21T22:10:45.295782] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:45.296915] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 45083 primary records. [2025-10-21T22:10:45.297045] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-10-21T22:10:45.312599] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-10-21T22:10:45.312721] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-10-21T22:10:45.322427] [INFO ] [MAIN ] Derivative Progress: 1037/2057 symbols completed. LC took 1.1s. Estimated remaining: 6m 26s. Rate: 158.4 symbols/min [2025-10-21T22:10:45.329096] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:45.330293] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-10-21T22:10:45.330426] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-10-21T22:10:45.332846] [INFO ] [MAIN ] Derivative Progress: 1038/2057 symbols completed. LDI took 1.1s. Estimated remaining: 6m 26s. Rate: 158.6 symbols/min [2025-10-21T22:10:45.333017] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:45.365785] [DEBUG] [LOCAL ] LDP: Loaded 12691 existing records from primary storage. [2025-10-21T22:10:45.366222] [INFO ] [MAIN ] LDP: Loaded 12691 primary data records. [2025-10-21T22:10:45.497435] [DEBUG] [LOCAL ] LDOS: Loaded 44723 existing records from primary storage. [2025-10-21T22:10:45.524625] [INFO ] [MAIN ] LDOS: Loaded 44723 primary data records. [2025-10-21T22:10:45.571767] [DEBUG] [LOCAL ] LEA: Loaded 41237 existing records from primary storage. [2025-10-21T22:10:45.587246] [INFO ] [MAIN ] LEA: Loaded 41237 primary data records. [2025-10-21T22:10:46.310518] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:46.323393] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 12691 primary records. [2025-10-21T22:10:46.323637] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:46.324621] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 44723 primary records. [2025-10-21T22:10:46.324760] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-10-21T22:10:46.323942] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-10-21T22:10:46.356510] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-10-21T22:10:46.357600] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-10-21T22:10:46.358013] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-10-21T22:10:46.357901] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-10-21T22:10:46.367299] [INFO ] [MAIN ] Derivative Progress: 1039/2057 symbols completed. LDP took 1.0s. Estimated remaining: 6m 26s. Rate: 158.3 symbols/min [2025-10-21T22:10:46.367440] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:46.374827] [INFO ] [MAIN ] Derivative Progress: 1040/2057 symbols completed. LDOS took 1.1s. Estimated remaining: 6m 25s. Rate: 158.4 symbols/min [2025-10-21T22:10:46.375429] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:46.374972] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:46.376513] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41237 primary records. [2025-10-21T22:10:46.376714] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-10-21T22:10:46.393265] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-10-21T22:10:46.393547] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-10-21T22:10:46.398698] [INFO ] [MAIN ] Derivative Progress: 1041/2057 symbols completed. LEA took 1.1s. Estimated remaining: 6m 24s. Rate: 158.6 symbols/min [2025-10-21T22:10:46.399255] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:46.438581] [DEBUG] [LOCAL ] LEO: Loaded 16799 existing records from primary storage. [2025-10-21T22:10:46.438867] [INFO ] [MAIN ] LEO: Loaded 16799 primary data records. [2025-10-21T22:10:46.524104] [DEBUG] [LOCAL ] LEG: Loaded 50008 existing records from primary storage. [2025-10-21T22:10:46.555574] [INFO ] [MAIN ] LEG: Loaded 50008 primary data records. [2025-10-21T22:10:46.605092] [DEBUG] [LOCAL ] LEN: Loaded 53200 existing records from primary storage. [2025-10-21T22:10:46.627777] [INFO ] [MAIN ] LEN: Loaded 53200 primary data records. [2025-10-21T22:10:47.419712] [DEBUG] [MAIN ] LEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:47.421906] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 16799 primary records. [2025-10-21T22:10:47.422010] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-10-21T22:10:47.443080] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:47.450839] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-10-21T22:10:47.446342] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50008 primary records. [2025-10-21T22:10:47.450939] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-10-21T22:10:47.453725] [INFO ] [MAIN ] Derivative Progress: 1042/2057 symbols completed. LEO took 1.1s. Estimated remaining: 6m 25s. Rate: 158.3 symbols/min [2025-10-21T22:10:47.454820] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-10-21T22:10:47.454604] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:47.484615] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-10-21T22:10:47.485014] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:47.486558] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53200 primary records. [2025-10-21T22:10:47.486745] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-10-21T22:10:47.486930] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-10-21T22:10:47.490013] [INFO ] [MAIN ] Derivative Progress: 1043/2057 symbols completed. LEG took 1.1s. Estimated remaining: 6m 24s. Rate: 158.5 symbols/min [2025-10-21T22:10:47.490294] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:47.509891] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-10-21T22:10:47.510257] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-10-21T22:10:47.513181] [INFO ] [MAIN ] Derivative Progress: 1044/2057 symbols completed. LEN took 1.1s. Estimated remaining: 6m 23s. Rate: 158.6 symbols/min [2025-10-21T22:10:47.513377] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:47.544973] [DEBUG] [LOCAL ] LFT: Loaded 18162 existing records from primary storage. [2025-10-21T22:10:47.545176] [INFO ] [MAIN ] LFT: Loaded 18162 primary data records. [2025-10-21T22:10:47.642764] [DEBUG] [LOCAL ] LGI: Loaded 10022 existing records from primary storage. [2025-10-21T22:10:47.635604] [DEBUG] [LOCAL ] LEVI: Loaded 51823 existing records from primary storage. [2025-10-21T22:10:47.659207] [INFO ] [MAIN ] LGI: Loaded 10022 primary data records. [2025-10-21T22:10:47.648049] [INFO ] [MAIN ] LEVI: Loaded 51823 primary data records. [2025-10-21T22:10:48.482281] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:48.483098] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 18162 primary records. [2025-10-21T22:10:48.483273] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-10-21T22:10:48.499586] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-10-21T22:10:48.500536] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-10-21T22:10:48.503270] [INFO ] [MAIN ] Derivative Progress: 1045/2057 symbols completed. LFT took 1.0s. Estimated remaining: 6m 23s. Rate: 158.4 symbols/min [2025-10-21T22:10:48.506377] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:48.536204] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:10:48.536368] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:48.537159] [INFO ] [MAIN ] LEVI: Generated 1793 derivative records from 51823 primary records. [2025-10-21T22:10:48.537956] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10022 primary records. [2025-10-21T22:10:48.538073] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-10-21T22:10:48.538866] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-10-21T22:10:48.570618] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-10-21T22:10:48.569612] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1793 records). [2025-10-21T22:10:48.570811] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-10-21T22:10:48.573131] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-10-21T22:10:48.576071] [INFO ] [MAIN ] Derivative Progress: 1046/2057 symbols completed. LGI took 1.1s. Estimated remaining: 6m 23s. Rate: 158.5 symbols/min [2025-10-21T22:10:48.578879] [INFO ] [MAIN ] Derivative Progress: 1047/2057 symbols completed. LEVI took 1.1s. Estimated remaining: 6m 22s. Rate: 158.6 symbols/min [2025-10-21T22:10:48.578797] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:48.579173] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:48.606366] [DEBUG] [LOCAL ] LH: Loaded 37192 existing records from primary storage. [2025-10-21T22:10:48.606541] [INFO ] [MAIN ] LH: Loaded 37192 primary data records. [2025-10-21T22:10:48.739624] [DEBUG] [LOCAL ] LII: Loaded 27758 existing records from primary storage. [2025-10-21T22:10:48.750522] [INFO ] [MAIN ] LII: Loaded 27758 primary data records. [2025-10-21T22:10:49.018508] [DEBUG] [LOCAL ] LHX: Loaded 48528 existing records from primary storage. [2025-10-21T22:10:49.029435] [INFO ] [MAIN ] LHX: Loaded 48528 primary data records. [2025-10-21T22:10:49.631413] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:49.632744] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 37192 primary records. [2025-10-21T22:10:49.632923] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-10-21T22:10:49.653922] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-10-21T22:10:49.667098] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-10-21T22:10:49.669906] [INFO ] [MAIN ] Derivative Progress: 1048/2057 symbols completed. LH took 1.2s. Estimated remaining: 6m 22s. Rate: 158.3 symbols/min [2025-10-21T22:10:49.667505] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:49.671201] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 27758 primary records. [2025-10-21T22:10:49.671450] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-10-21T22:10:49.689493] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-10-21T22:10:49.689578] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-10-21T22:10:49.692450] [INFO ] [MAIN ] Derivative Progress: 1049/2057 symbols completed. LII took 1.1s. Estimated remaining: 6m 22s. Rate: 158.5 symbols/min [2025-10-21T22:10:49.705255] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:49.705849] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 48528 primary records. [2025-10-21T22:10:49.705918] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-10-21T22:10:49.721372] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-10-21T22:10:49.721430] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-10-21T22:10:49.724109] [INFO ] [MAIN ] Derivative Progress: 1050/2057 symbols completed. LHX took 1.1s. Estimated remaining: 6m 21s. Rate: 158.6 symbols/min [2025-10-21T22:10:49.724511] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:49.724757] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:49.724638] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:49.732102] [DEBUG] [LOCAL ] LITB: Loaded 3861 existing records from primary storage. [2025-10-21T22:10:49.732299] [INFO ] [MAIN ] LITB: Loaded 3861 primary data records. [2025-10-21T22:10:50.081761] [DEBUG] [LOCAL ] LION: Loaded 46849 existing records from primary storage. [2025-10-21T22:10:50.083087] [INFO ] [MAIN ] LION: Loaded 46849 primary data records. [2025-10-21T22:10:50.208930] [DEBUG] [LOCAL ] LLY: Loaded 53192 existing records from primary storage. [2025-10-21T22:10:50.209304] [INFO ] [MAIN ] LLY: Loaded 53192 primary data records. [2025-10-21T22:10:50.692285] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:50.716604] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 3861 primary records. [2025-10-21T22:10:50.716835] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-10-21T22:10:50.735702] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-10-21T22:10:50.736092] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-10-21T22:10:50.738255] [INFO ] [MAIN ] Derivative Progress: 1051/2057 symbols completed. LITB took 1.0s. Estimated remaining: 6m 21s. Rate: 158.4 symbols/min [2025-10-21T22:10:50.738937] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:50.765638] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:50.766797] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 46849 primary records. [2025-10-21T22:10:50.767062] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-10-21T22:10:50.806449] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:50.806773] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-10-21T22:10:50.820104] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-10-21T22:10:50.820873] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53192 primary records. [2025-10-21T22:10:50.824218] [INFO ] [MAIN ] Derivative Progress: 1052/2057 symbols completed. LION took 1.1s. Estimated remaining: 6m 20s. Rate: 158.5 symbols/min [2025-10-21T22:10:50.824495] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:50.824598] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-10-21T22:10:50.842130] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-10-21T22:10:50.857229] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-10-21T22:10:50.860388] [INFO ] [MAIN ] Derivative Progress: 1053/2057 symbols completed. LLY took 1.1s. Estimated remaining: 6m 20s. Rate: 158.6 symbols/min [2025-10-21T22:10:50.860981] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:50.862579] [DEBUG] [LOCAL ] LMND: Loaded 52124 existing records from primary storage. [2025-10-21T22:10:50.862844] [INFO ] [MAIN ] LMND: Loaded 52124 primary data records. [2025-10-21T22:10:51.210239] [DEBUG] [LOCAL ] LMT: Loaded 49628 existing records from primary storage. [2025-10-21T22:10:51.210429] [INFO ] [MAIN ] LMT: Loaded 49628 primary data records. [2025-10-21T22:10:51.372423] [DEBUG] [LOCAL ] LNC: Loaded 51488 existing records from primary storage. [2025-10-21T22:10:51.378857] [INFO ] [MAIN ] LNC: Loaded 51488 primary data records. [2025-10-21T22:10:51.781444] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:51.782214] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 52124 primary records. [2025-10-21T22:10:51.783340] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-10-21T22:10:51.915199] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-10-21T22:10:51.915323] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-10-21T22:10:51.917339] [INFO ] [MAIN ] Derivative Progress: 1054/2057 symbols completed. LMND took 1.2s. Estimated remaining: 6m 20s. Rate: 158.4 symbols/min [2025-10-21T22:10:51.917602] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:51.928825] [DEBUG] [LOCAL ] LND: Loaded 4930 existing records from primary storage. [2025-10-21T22:10:51.930038] [INFO ] [MAIN ] LND: Loaded 4930 primary data records. [2025-10-21T22:10:51.999298] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:52.023134] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 49628 primary records. [2025-10-21T22:10:52.028695] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-10-21T22:10:52.086329] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-10-21T22:10:52.092492] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-10-21T22:10:52.130807] [INFO ] [MAIN ] Derivative Progress: 1055/2057 symbols completed. LMT took 1.3s. Estimated remaining: 6m 20s. Rate: 158.4 symbols/min [2025-10-21T22:10:52.219822] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:52.280980] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:52.281624] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51488 primary records. [2025-10-21T22:10:52.281714] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-10-21T22:10:52.305981] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-10-21T22:10:52.307183] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-10-21T22:10:52.310452] [INFO ] [MAIN ] Derivative Progress: 1056/2057 symbols completed. LNC took 1.4s. Estimated remaining: 6m 19s. Rate: 158.5 symbols/min [2025-10-21T22:10:52.311028] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:52.333046] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:52.338397] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 4930 primary records. [2025-10-21T22:10:52.338561] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-10-21T22:10:52.338871] [DEBUG] [LOCAL ] LNN: Loaded 11431 existing records from primary storage. [2025-10-21T22:10:52.339678] [INFO ] [MAIN ] LNN: Loaded 11431 primary data records. [2025-10-21T22:10:52.398403] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-10-21T22:10:52.445433] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-10-21T22:10:52.459557] [INFO ] [MAIN ] Derivative Progress: 1057/2057 symbols completed. LND took 0.5s. Estimated remaining: 6m 18s. Rate: 158.6 symbols/min [2025-10-21T22:10:52.476852] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:52.533804] [DEBUG] [LOCAL ] LNG: Loaded 51114 existing records from primary storage. [2025-10-21T22:10:52.571056] [INFO ] [MAIN ] LNG: Loaded 51114 primary data records. [2025-10-21T22:10:53.033462] [DEBUG] [LOCAL ] LOAR: Loaded 42020 existing records from primary storage. [2025-10-21T22:10:53.041977] [INFO ] [MAIN ] LOAR: Loaded 42020 primary data records. [2025-10-21T22:10:53.197916] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:53.215000] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11431 primary records. [2025-10-21T22:10:53.386405] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-10-21T22:10:53.403484] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-10-21T22:10:53.404242] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-10-21T22:10:53.406501] [INFO ] [MAIN ] Derivative Progress: 1058/2057 symbols completed. LNN took 1.1s. Estimated remaining: 6m 18s. Rate: 158.4 symbols/min [2025-10-21T22:10:53.406931] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:53.425988] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:53.427533] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51114 primary records. [2025-10-21T22:10:53.427727] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-10-21T22:10:53.457170] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-10-21T22:10:53.457346] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-10-21T22:10:53.459613] [INFO ] [MAIN ] Derivative Progress: 1059/2057 symbols completed. LNG took 1.2s. Estimated remaining: 6m 18s. Rate: 158.5 symbols/min [2025-10-21T22:10:53.459939] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:53.473445] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:53.484861] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 42020 primary records. [2025-10-21T22:10:53.484021] [DEBUG] [LOCAL ] LOB: Loaded 26778 existing records from primary storage. [2025-10-21T22:10:53.485009] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-10-21T22:10:53.485912] [INFO ] [MAIN ] LOB: Loaded 26778 primary data records. [2025-10-21T22:10:53.496027] [DEBUG] [LOCAL ] LOCL: Loaded 3714 existing records from primary storage. [2025-10-21T22:10:53.525248] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-10-21T22:10:53.535488] [INFO ] [MAIN ] LOCL: Loaded 3714 primary data records. [2025-10-21T22:10:53.547452] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-10-21T22:10:53.582138] [INFO ] [MAIN ] Derivative Progress: 1060/2057 symbols completed. LOAR took 1.1s. Estimated remaining: 6m 17s. Rate: 158.6 symbols/min [2025-10-21T22:10:53.604553] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:54.025627] [DEBUG] [LOCAL ] LOMA: Loaded 32809 existing records from primary storage. [2025-10-21T22:10:54.031486] [INFO ] [MAIN ] LOMA: Loaded 32809 primary data records. [2025-10-21T22:10:54.489145] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:54.498614] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 26778 primary records. [2025-10-21T22:10:54.503243] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-10-21T22:10:54.505000] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:54.505857] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3714 primary records. [2025-10-21T22:10:54.513189] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-10-21T22:10:54.521794] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-10-21T22:10:54.528267] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-10-21T22:10:54.536922] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-10-21T22:10:54.536830] [INFO ] [MAIN ] Derivative Progress: 1061/2057 symbols completed. LOB took 1.1s. Estimated remaining: 6m 17s. Rate: 158.4 symbols/min [2025-10-21T22:10:54.538104] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:54.537814] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-10-21T22:10:54.540817] [INFO ] [MAIN ] Derivative Progress: 1062/2057 symbols completed. LOCL took 1.1s. Estimated remaining: 6m 17s. Rate: 158.5 symbols/min [2025-10-21T22:10:54.541190] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:54.562707] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:54.564015] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 32809 primary records. [2025-10-21T22:10:54.564167] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-10-21T22:10:54.592180] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-10-21T22:10:54.592405] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-10-21T22:10:54.595380] [INFO ] [MAIN ] Derivative Progress: 1063/2057 symbols completed. LOMA took 1.0s. Estimated remaining: 6m 16s. Rate: 158.6 symbols/min [2025-10-21T22:10:54.621289] [DEBUG] [LOCAL ] LPG: Loaded 39396 existing records from primary storage. [2025-10-21T22:10:54.621417] [INFO ] [MAIN ] LPG: Loaded 39396 primary data records. [2025-10-21T22:10:54.754013] [DEBUG] [LOCAL ] LOW: Loaded 52978 existing records from primary storage. [2025-10-21T22:10:54.764388] [INFO ] [MAIN ] LOW: Loaded 52978 primary data records. [2025-10-21T22:10:55.284417] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:55.285438] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 39396 primary records. [2025-10-21T22:10:55.285638] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-10-21T22:10:55.303601] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-10-21T22:10:55.303705] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-10-21T22:10:55.305628] [INFO ] [MAIN ] Derivative Progress: 1064/2057 symbols completed. LPG took 0.8s. Estimated remaining: 6m 16s. Rate: 158.5 symbols/min [2025-10-21T22:10:55.323088] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:55.323967] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52978 primary records. [2025-10-21T22:10:55.324045] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-10-21T22:10:55.343273] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-10-21T22:10:55.343355] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-10-21T22:10:55.345758] [INFO ] [MAIN ] Derivative Progress: 1065/2057 symbols completed. LOW took 0.8s. Estimated remaining: 6m 15s. Rate: 158.6 symbols/min [2025-10-21T22:10:55.346229] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:55.346176] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:55.346360] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:55.411123] [DEBUG] [LOCAL ] LPL: Loaded 28918 existing records from primary storage. [2025-10-21T22:10:55.412321] [INFO ] [MAIN ] LPL: Loaded 28918 primary data records. [2025-10-21T22:10:55.412011] [DEBUG] [LOCAL ] LPX: Loaded 40110 existing records from primary storage. [2025-10-21T22:10:55.412492] [INFO ] [MAIN ] LPX: Loaded 40110 primary data records. [2025-10-21T22:10:55.611125] [DEBUG] [LOCAL ] LRN: Loaded 39446 existing records from primary storage. [2025-10-21T22:10:55.644562] [INFO ] [MAIN ] LRN: Loaded 39446 primary data records. [2025-10-21T22:10:56.365869] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:56.368509] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 28918 primary records. [2025-10-21T22:10:56.368757] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-10-21T22:10:56.398225] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:56.397907] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-10-21T22:10:56.399568] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 40110 primary records. [2025-10-21T22:10:56.399960] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-10-21T22:10:56.401985] [INFO ] [MAIN ] Derivative Progress: 1066/2057 symbols completed. LPL took 1.1s. Estimated remaining: 6m 15s. Rate: 158.4 symbols/min [2025-10-21T22:10:56.399890] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-10-21T22:10:56.402342] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:56.419757] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-10-21T22:10:56.421094] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-10-21T22:10:56.424619] [INFO ] [MAIN ] Derivative Progress: 1067/2057 symbols completed. LPX took 1.1s. Estimated remaining: 6m 15s. Rate: 158.5 symbols/min [2025-10-21T22:10:56.425714] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:56.444272] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:56.445023] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 39446 primary records. [2025-10-21T22:10:56.445098] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-10-21T22:10:56.461718] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-10-21T22:10:56.471683] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-10-21T22:10:56.474441] [INFO ] [MAIN ] Derivative Progress: 1068/2057 symbols completed. LRN took 1.1s. Estimated remaining: 6m 14s. Rate: 158.6 symbols/min [2025-10-21T22:10:56.474755] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:56.501171] [DEBUG] [LOCAL ] LSPD: Loaded 42387 existing records from primary storage. [2025-10-21T22:10:56.501859] [INFO ] [MAIN ] LSPD: Loaded 42387 primary data records. [2025-10-21T22:10:56.550518] [DEBUG] [LOCAL ] LTC: Loaded 30677 existing records from primary storage. [2025-10-21T22:10:56.582523] [INFO ] [MAIN ] LTC: Loaded 30677 primary data records. [2025-10-21T22:10:56.826529] [DEBUG] [LOCAL ] LTH: Loaded 51653 existing records from primary storage. [2025-10-21T22:10:56.848248] [INFO ] [MAIN ] LTH: Loaded 51653 primary data records. [2025-10-21T22:10:57.603044] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:57.616995] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 42387 primary records. [2025-10-21T22:10:57.616173] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:57.617195] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-10-21T22:10:57.618363] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30677 primary records. [2025-10-21T22:10:57.619162] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-10-21T22:10:57.666162] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-10-21T22:10:57.666249] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-10-21T22:10:57.667021] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-10-21T22:10:57.666926] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:57.666612] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-10-21T22:10:57.669402] [INFO ] [MAIN ] Derivative Progress: 1069/2057 symbols completed. LTC took 1.2s. Estimated remaining: 6m 14s. Rate: 158.3 symbols/min [2025-10-21T22:10:57.673046] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51653 primary records. [2025-10-21T22:10:57.672297] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:57.673296] [INFO ] [MAIN ] Derivative Progress: 1070/2057 symbols completed. LSPD took 1.3s. Estimated remaining: 6m 14s. Rate: 158.5 symbols/min [2025-10-21T22:10:57.673521] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:57.673239] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-10-21T22:10:57.691016] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-10-21T22:10:57.691180] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-10-21T22:10:57.694093] [INFO ] [MAIN ] Derivative Progress: 1071/2057 symbols completed. LTH took 1.2s. Estimated remaining: 6m 13s. Rate: 158.6 symbols/min [2025-10-21T22:10:57.694454] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:57.746764] [DEBUG] [LOCAL ] LUCK: Loaded 23955 existing records from primary storage. [2025-10-21T22:10:57.746924] [INFO ] [MAIN ] LUCK: Loaded 23955 primary data records. [2025-10-21T22:10:57.747543] [DEBUG] [LOCAL ] LTM: Loaded 39164 existing records from primary storage. [2025-10-21T22:10:57.779106] [INFO ] [MAIN ] LTM: Loaded 39164 primary data records. [2025-10-21T22:10:57.972191] [DEBUG] [LOCAL ] LU: Loaded 49218 existing records from primary storage. [2025-10-21T22:10:57.978027] [INFO ] [MAIN ] LU: Loaded 49218 primary data records. [2025-10-21T22:10:58.696596] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:58.697739] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 39164 primary records. [2025-10-21T22:10:58.698745] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-10-21T22:10:58.721268] [DEBUG] [MAIN ] LUCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:58.734984] [INFO ] [MAIN ] LUCK: Generated 1794 derivative records from 23955 primary records. [2025-10-21T22:10:58.739243] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-10-21T22:10:58.744462] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-10-21T22:10:58.742814] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:58.745738] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 49218 primary records. [2025-10-21T22:10:58.744679] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-10-21T22:10:58.748741] [INFO ] [MAIN ] Derivative Progress: 1072/2057 symbols completed. LTM took 1.1s. Estimated remaining: 6m 13s. Rate: 158.3 symbols/min [2025-10-21T22:10:58.748958] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-10-21T22:10:58.756473] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:58.765662] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1794 records). [2025-10-21T22:10:58.766133] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-10-21T22:10:58.791474] [INFO ] [MAIN ] Derivative Progress: 1073/2057 symbols completed. LUCK took 1.1s. Estimated remaining: 6m 13s. Rate: 158.5 symbols/min [2025-10-21T22:10:58.791607] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-10-21T22:10:58.792080] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:58.791977] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-10-21T22:10:58.795294] [INFO ] [MAIN ] Derivative Progress: 1074/2057 symbols completed. LU took 1.1s. Estimated remaining: 6m 12s. Rate: 158.6 symbols/min [2025-10-21T22:10:58.795560] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:58.868767] [DEBUG] [LOCAL ] LUMN: Loaded 53645 existing records from primary storage. [2025-10-21T22:10:58.869033] [INFO ] [MAIN ] LUMN: Loaded 53645 primary data records. [2025-10-21T22:10:59.001700] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-21T22:10:59.009698] [DEBUG] [LOCAL ] LVS: Loaded 53570 existing records from primary storage. [2025-10-21T22:10:59.010399] [INFO ] [MAIN ] LVS: Loaded 53570 primary data records. [2025-10-21T22:10:59.010187] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-10-21T22:10:59.885986] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:59.887152] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53645 primary records. [2025-10-21T22:10:59.887462] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-10-21T22:10:59.916549] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-10-21T22:10:59.921121] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-10-21T22:10:59.923434] [INFO ] [MAIN ] Derivative Progress: 1075/2057 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 12s. Rate: 158.3 symbols/min [2025-10-21T22:10:59.936365] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:59.937519] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53570 primary records. [2025-10-21T22:10:59.923576] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:59.938527] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-10-21T22:10:59.937953] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:10:59.940072] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-10-21T22:10:59.941580] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-10-21T22:10:59.969340] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-10-21T22:10:59.973970] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-10-21T22:10:59.969488] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-10-21T22:10:59.974423] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-10-21T22:10:59.977420] [INFO ] [MAIN ] Derivative Progress: 1076/2057 symbols completed. LUV took 1.2s. Estimated remaining: 6m 11s. Rate: 158.5 symbols/min [2025-10-21T22:10:59.980138] [INFO ] [MAIN ] Derivative Progress: 1077/2057 symbols completed. LVS took 1.2s. Estimated remaining: 6m 11s. Rate: 158.6 symbols/min [2025-10-21T22:10:59.977711] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:59.985093] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:10:59.996092] [DEBUG] [LOCAL ] LVWR: Loaded 18596 existing records from primary storage. [2025-10-21T22:10:59.996419] [INFO ] [MAIN ] LVWR: Loaded 18596 primary data records. [2025-10-21T22:11:00.113138] [DEBUG] [LOCAL ] LXFR: Loaded 16437 existing records from primary storage. [2025-10-21T22:11:00.117197] [INFO ] [MAIN ] LXFR: Loaded 16437 primary data records. [2025-10-21T22:11:00.513439] [DEBUG] [LOCAL ] LW: Loaded 51180 existing records from primary storage. [2025-10-21T22:11:00.514080] [INFO ] [MAIN ] LW: Loaded 51180 primary data records. [2025-10-21T22:11:00.983446] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:00.985682] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 18596 primary records. [2025-10-21T22:11:00.985866] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-10-21T22:11:01.004337] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-10-21T22:11:01.017357] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-10-21T22:11:01.019631] [INFO ] [MAIN ] Derivative Progress: 1078/2057 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 11s. Rate: 158.3 symbols/min [2025-10-21T22:11:01.017877] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:01.020822] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 16437 primary records. [2025-10-21T22:11:01.021215] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-10-21T22:11:01.038447] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-10-21T22:11:01.038776] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-10-21T22:11:01.042010] [INFO ] [MAIN ] Derivative Progress: 1079/2057 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 10s. Rate: 158.5 symbols/min [2025-10-21T22:11:01.056065] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:01.056665] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51180 primary records. [2025-10-21T22:11:01.056728] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-10-21T22:11:01.071557] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-10-21T22:11:01.071618] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-10-21T22:11:01.074300] [INFO ] [MAIN ] Derivative Progress: 1080/2057 symbols completed. LW took 1.1s. Estimated remaining: 6m 10s. Rate: 158.6 symbols/min [2025-10-21T22:11:01.074719] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:01.075007] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:01.075210] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:01.143036] [DEBUG] [LOCAL ] LXU: Loaded 31582 existing records from primary storage. [2025-10-21T22:11:01.155690] [INFO ] [MAIN ] LXU: Loaded 31582 primary data records. [2025-10-21T22:11:01.245541] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-21T22:11:01.258042] [INFO ] [MAIN ] LYB: Loaded 53621 primary data records. [2025-10-21T22:11:01.350422] [DEBUG] [LOCAL ] LXP: Loaded 50786 existing records from primary storage. [2025-10-21T22:11:01.378149] [INFO ] [MAIN ] LXP: Loaded 50786 primary data records. [2025-10-21T22:11:02.175919] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:02.177822] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 31582 primary records. [2025-10-21T22:11:02.177955] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-10-21T22:11:02.212577] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-10-21T22:11:02.213103] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:02.213682] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-10-21T22:11:02.214689] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53621 primary records. [2025-10-21T22:11:02.216785] [INFO ] [MAIN ] Derivative Progress: 1081/2057 symbols completed. LXU took 1.1s. Estimated remaining: 6m 10s. Rate: 158.3 symbols/min [2025-10-21T22:11:02.217064] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:02.216852] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-10-21T22:11:02.236397] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-10-21T22:11:02.237543] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-10-21T22:11:02.240231] [INFO ] [MAIN ] Derivative Progress: 1082/2057 symbols completed. LYB took 1.2s. Estimated remaining: 6m 9s. Rate: 158.5 symbols/min [2025-10-21T22:11:02.240499] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:02.254803] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:02.255461] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50786 primary records. [2025-10-21T22:11:02.255736] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-10-21T22:11:02.275126] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-10-21T22:11:02.275426] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-10-21T22:11:02.279559] [INFO ] [MAIN ] Derivative Progress: 1083/2057 symbols completed. LXP took 1.2s. Estimated remaining: 6m 8s. Rate: 158.6 symbols/min [2025-10-21T22:11:02.280195] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:02.334406] [DEBUG] [LOCAL ] LYG: Loaded 52661 existing records from primary storage. [2025-10-21T22:11:02.349686] [INFO ] [MAIN ] LYG: Loaded 52661 primary data records. [2025-10-21T22:11:02.371621] [DEBUG] [LOCAL ] LYV: Loaded 51013 existing records from primary storage. [2025-10-21T22:11:02.406704] [INFO ] [MAIN ] LYV: Loaded 51013 primary data records. [2025-10-21T22:11:02.699081] [DEBUG] [LOCAL ] LZB: Loaded 35070 existing records from primary storage. [2025-10-21T22:11:02.839341] [INFO ] [MAIN ] LZB: Loaded 35070 primary data records. [2025-10-21T22:11:03.454729] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:03.455849] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52661 primary records. [2025-10-21T22:11:03.467986] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-10-21T22:11:03.470508] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:03.485614] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51013 primary records. [2025-10-21T22:11:03.485888] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-10-21T22:11:03.487570] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-10-21T22:11:03.488509] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-10-21T22:11:03.490334] [INFO ] [MAIN ] Derivative Progress: 1084/2057 symbols completed. LYG took 1.3s. Estimated remaining: 6m 9s. Rate: 158.3 symbols/min [2025-10-21T22:11:03.490600] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:03.506873] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-10-21T22:11:03.507075] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-10-21T22:11:03.510025] [INFO ] [MAIN ] Derivative Progress: 1085/2057 symbols completed. LYV took 1.3s. Estimated remaining: 6m 8s. Rate: 158.4 symbols/min [2025-10-21T22:11:03.510301] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:03.533863] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:03.535317] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35070 primary records. [2025-10-21T22:11:03.535700] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-10-21T22:11:03.557159] [DEBUG] [LOCAL ] LZM: Loaded 14736 existing records from primary storage. [2025-10-21T22:11:03.559911] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-10-21T22:11:03.560246] [INFO ] [MAIN ] LZM: Loaded 14736 primary data records. [2025-10-21T22:11:03.560188] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-10-21T22:11:03.564036] [INFO ] [MAIN ] Derivative Progress: 1086/2057 symbols completed. LZB took 1.3s. Estimated remaining: 6m 7s. Rate: 158.5 symbols/min [2025-10-21T22:11:03.564334] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:03.754772] [DEBUG] [LOCAL ] M: Loaded 53544 existing records from primary storage. [2025-10-21T22:11:03.899716] [INFO ] [MAIN ] M: Loaded 53544 primary data records. [2025-10-21T22:11:04.116134] [DEBUG] [LOCAL ] MA: Loaded 52465 existing records from primary storage. [2025-10-21T22:11:04.229751] [INFO ] [MAIN ] MA: Loaded 52465 primary data records. [2025-10-21T22:11:04.547819] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:04.549265] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 14736 primary records. [2025-10-21T22:11:04.550142] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-10-21T22:11:04.572431] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-10-21T22:11:04.572772] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-10-21T22:11:04.575133] [INFO ] [MAIN ] Derivative Progress: 1087/2057 symbols completed. LZM took 1.1s. Estimated remaining: 6m 8s. Rate: 158.3 symbols/min [2025-10-21T22:11:04.575537] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:04.594859] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:04.595816] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53544 primary records. [2025-10-21T22:11:04.596068] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-10-21T22:11:04.613111] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-10-21T22:11:04.613379] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-10-21T22:11:04.615737] [INFO ] [MAIN ] Derivative Progress: 1088/2057 symbols completed. M took 1.1s. Estimated remaining: 6m 7s. Rate: 158.4 symbols/min [2025-10-21T22:11:04.615884] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:04.642522] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:04.643268] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52465 primary records. [2025-10-21T22:11:04.643327] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-10-21T22:11:04.659842] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-10-21T22:11:04.660022] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-10-21T22:11:04.663277] [INFO ] [MAIN ] Derivative Progress: 1089/2057 symbols completed. MA took 1.1s. Estimated remaining: 6m 6s. Rate: 158.5 symbols/min [2025-10-21T22:11:04.663997] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:04.679325] [DEBUG] [LOCAL ] MAA: Loaded 42974 existing records from primary storage. [2025-10-21T22:11:04.679564] [INFO ] [MAIN ] MAA: Loaded 42974 primary data records. [2025-10-21T22:11:04.885406] [DEBUG] [LOCAL ] MAC: Loaded 49653 existing records from primary storage. [2025-10-21T22:11:04.914845] [INFO ] [MAIN ] MAC: Loaded 49653 primary data records. [2025-10-21T22:11:04.919782] [DEBUG] [LOCAL ] MAGN: Loaded 36252 existing records from primary storage. [2025-10-21T22:11:04.931400] [INFO ] [MAIN ] MAGN: Loaded 36252 primary data records. [2025-10-21T22:11:05.700863] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:05.701711] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 42974 primary records. [2025-10-21T22:11:05.702193] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-10-21T22:11:05.722289] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-10-21T22:11:05.722785] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-10-21T22:11:05.724732] [INFO ] [MAIN ] Derivative Progress: 1090/2057 symbols completed. MAA took 1.1s. Estimated remaining: 6m 7s. Rate: 158.3 symbols/min [2025-10-21T22:11:05.724959] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:05.738739] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:05.739479] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49653 primary records. [2025-10-21T22:11:05.739620] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-10-21T22:11:05.770234] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-10-21T22:11:05.770638] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-10-21T22:11:05.770494] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:05.773293] [INFO ] [MAIN ] Derivative Progress: 1091/2057 symbols completed. MAC took 1.2s. Estimated remaining: 6m 6s. Rate: 158.4 symbols/min [2025-10-21T22:11:05.774167] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 36252 primary records. [2025-10-21T22:11:05.774414] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-10-21T22:11:05.774327] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:05.790876] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-10-21T22:11:05.791119] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-10-21T22:11:05.794460] [INFO ] [MAIN ] Derivative Progress: 1092/2057 symbols completed. MAGN took 1.1s. Estimated remaining: 6m 5s. Rate: 158.6 symbols/min [2025-10-21T22:11:05.794697] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:05.825300] [DEBUG] [LOCAL ] MAIN: Loaded 41978 existing records from primary storage. [2025-10-21T22:11:05.825551] [INFO ] [MAIN ] MAIN: Loaded 41978 primary data records. [2025-10-21T22:11:05.961177] [DEBUG] [LOCAL ] MANU: Loaded 27249 existing records from primary storage. [2025-10-21T22:11:05.961729] [INFO ] [MAIN ] MANU: Loaded 27249 primary data records. [2025-10-21T22:11:06.137318] [DEBUG] [LOCAL ] MAN: Loaded 44311 existing records from primary storage. [2025-10-21T22:11:06.151779] [INFO ] [MAIN ] MAN: Loaded 44311 primary data records. [2025-10-21T22:11:06.820739] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:06.821871] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41978 primary records. [2025-10-21T22:11:06.822210] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-10-21T22:11:06.839372] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-10-21T22:11:06.839628] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-10-21T22:11:06.841794] [INFO ] [MAIN ] Derivative Progress: 1093/2057 symbols completed. MAIN took 1.1s. Estimated remaining: 6m 5s. Rate: 158.3 symbols/min [2025-10-21T22:11:06.857883] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:06.860119] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27249 primary records. [2025-10-21T22:11:06.860813] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-10-21T22:11:06.888888] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-10-21T22:11:06.889095] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:06.889221] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-10-21T22:11:06.892715] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 44311 primary records. [2025-10-21T22:11:06.892007] [INFO ] [MAIN ] Derivative Progress: 1094/2057 symbols completed. MANU took 1.1s. Estimated remaining: 6m 5s. Rate: 158.4 symbols/min [2025-10-21T22:11:06.892891] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-10-21T22:11:06.908053] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-10-21T22:11:06.908109] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-10-21T22:11:06.910751] [INFO ] [MAIN ] Derivative Progress: 1095/2057 symbols completed. MAN took 1.1s. Estimated remaining: 6m 4s. Rate: 158.6 symbols/min [2025-10-21T22:11:06.911411] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:06.911489] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:06.911326] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:07.003278] [DEBUG] [LOCAL ] MATV: Loaded 35183 existing records from primary storage. [2025-10-21T22:11:07.004927] [DEBUG] [LOCAL ] MATX: Loaded 31987 existing records from primary storage. [2025-10-21T22:11:07.019336] [INFO ] [MAIN ] MATV: Loaded 35183 primary data records. [2025-10-21T22:11:07.026312] [INFO ] [MAIN ] MATX: Loaded 31987 primary data records. [2025-10-21T22:11:07.075311] [DEBUG] [LOCAL ] MAS: Loaded 52251 existing records from primary storage. [2025-10-21T22:11:07.135133] [INFO ] [MAIN ] MAS: Loaded 52251 primary data records. [2025-10-21T22:11:08.005345] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:08.007391] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 35183 primary records. [2025-10-21T22:11:08.007624] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-10-21T22:11:08.034415] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:08.033847] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:08.035919] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31987 primary records. [2025-10-21T22:11:08.035294] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52251 primary records. [2025-10-21T22:11:08.036022] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-10-21T22:11:08.051429] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-10-21T22:11:08.051595] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-10-21T22:11:08.053392] [INFO ] [MAIN ] Derivative Progress: 1096/2057 symbols completed. MATV took 1.1s. Estimated remaining: 6m 4s. Rate: 158.3 symbols/min [2025-10-21T22:11:08.042893] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-10-21T22:11:08.053559] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:08.083626] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-10-21T22:11:08.085796] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-10-21T22:11:08.089175] [INFO ] [MAIN ] Derivative Progress: 1097/2057 symbols completed. MAS took 1.2s. Estimated remaining: 6m 4s. Rate: 158.4 symbols/min [2025-10-21T22:11:08.091839] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-10-21T22:11:08.091739] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:08.092494] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-10-21T22:11:08.095430] [INFO ] [MAIN ] Derivative Progress: 1098/2057 symbols completed. MATX took 1.2s. Estimated remaining: 6m 3s. Rate: 158.5 symbols/min [2025-10-21T22:11:08.095788] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:08.135468] [DEBUG] [LOCAL ] MBI: Loaded 24151 existing records from primary storage. [2025-10-21T22:11:08.136232] [INFO ] [MAIN ] MBI: Loaded 24151 primary data records. [2025-10-21T22:11:08.136120] [DEBUG] [LOCAL ] MAX: Loaded 30845 existing records from primary storage. [2025-10-21T22:11:08.141761] [INFO ] [MAIN ] MAX: Loaded 30845 primary data records. [2025-10-21T22:11:08.431750] [DEBUG] [LOCAL ] MBC: Loaded 43908 existing records from primary storage. [2025-10-21T22:11:08.459146] [INFO ] [MAIN ] MBC: Loaded 43908 primary data records. [2025-10-21T22:11:09.116339] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:09.122108] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 24151 primary records. [2025-10-21T22:11:09.122622] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:09.123992] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 30845 primary records. [2025-10-21T22:11:09.124211] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-10-21T22:11:09.122842] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-10-21T22:11:09.159372] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-10-21T22:11:09.159957] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-10-21T22:11:09.160209] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-10-21T22:11:09.163740] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-10-21T22:11:09.163619] [INFO ] [MAIN ] Derivative Progress: 1099/2057 symbols completed. MAX took 1.1s. Estimated remaining: 6m 3s. Rate: 158.3 symbols/min [2025-10-21T22:11:09.166251] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:09.166354] [INFO ] [MAIN ] Derivative Progress: 1100/2057 symbols completed. MBI took 1.1s. Estimated remaining: 6m 2s. Rate: 158.4 symbols/min [2025-10-21T22:11:09.179239] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:09.180392] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:09.181072] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43908 primary records. [2025-10-21T22:11:09.181233] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-10-21T22:11:09.197568] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-10-21T22:11:09.197872] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-10-21T22:11:09.200509] [INFO ] [MAIN ] Derivative Progress: 1101/2057 symbols completed. MBC took 1.1s. Estimated remaining: 6m 2s. Rate: 158.6 symbols/min [2025-10-21T22:11:09.200809] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:09.210841] [DEBUG] [LOCAL ] MCB: Loaded 11340 existing records from primary storage. [2025-10-21T22:11:09.211049] [INFO ] [MAIN ] MCB: Loaded 11340 primary data records. [2025-10-21T22:11:09.326289] [DEBUG] [LOCAL ] MCI: Loaded 6222 existing records from primary storage. [2025-10-21T22:11:09.329557] [INFO ] [MAIN ] MCI: Loaded 6222 primary data records. [2025-10-21T22:11:09.405794] [DEBUG] [LOCAL ] MC: Loaded 43725 existing records from primary storage. [2025-10-21T22:11:09.433768] [INFO ] [MAIN ] MC: Loaded 43725 primary data records. [2025-10-21T22:11:10.178560] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:10.179591] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11340 primary records. [2025-10-21T22:11:10.179722] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-10-21T22:11:10.198281] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-10-21T22:11:10.198661] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-10-21T22:11:10.208289] [INFO ] [MAIN ] Derivative Progress: 1102/2057 symbols completed. MCB took 1.0s. Estimated remaining: 6m 2s. Rate: 158.3 symbols/min [2025-10-21T22:11:10.213739] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:10.213610] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:10.215117] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6222 primary records. [2025-10-21T22:11:10.215202] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-10-21T22:11:10.249882] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-10-21T22:11:10.250321] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-10-21T22:11:10.253129] [INFO ] [MAIN ] Derivative Progress: 1103/2057 symbols completed. MCI took 1.1s. Estimated remaining: 6m 1s. Rate: 158.4 symbols/min [2025-10-21T22:11:10.250206] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:10.253324] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:10.254556] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 43725 primary records. [2025-10-21T22:11:10.255012] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-10-21T22:11:10.270909] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-10-21T22:11:10.279562] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-10-21T22:11:10.282501] [INFO ] [MAIN ] Derivative Progress: 1104/2057 symbols completed. MC took 1.1s. Estimated remaining: 6m 1s. Rate: 158.6 symbols/min [2025-10-21T22:11:10.282761] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:10.299972] [DEBUG] [LOCAL ] MCK: Loaded 38187 existing records from primary storage. [2025-10-21T22:11:10.300150] [INFO ] [MAIN ] MCK: Loaded 38187 primary data records. [2025-10-21T22:11:10.346516] [DEBUG] [LOCAL ] MCR: Loaded 8854 existing records from primary storage. [2025-10-21T22:11:10.388670] [INFO ] [MAIN ] MCR: Loaded 8854 primary data records. [2025-10-21T22:11:10.611319] [DEBUG] [LOCAL ] MCO: Loaded 39453 existing records from primary storage. [2025-10-21T22:11:10.745330] [INFO ] [MAIN ] MCO: Loaded 39453 primary data records. [2025-10-21T22:11:11.315573] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:11.317098] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 38187 primary records. [2025-10-21T22:11:11.317376] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-10-21T22:11:11.349920] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-10-21T22:11:11.350489] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:11.350234] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-10-21T22:11:11.351344] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8854 primary records. [2025-10-21T22:11:11.353701] [INFO ] [MAIN ] Derivative Progress: 1105/2057 symbols completed. MCK took 1.1s. Estimated remaining: 6m 1s. Rate: 158.3 symbols/min [2025-10-21T22:11:11.351598] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-10-21T22:11:11.354037] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:11.370678] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-10-21T22:11:11.372216] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-10-21T22:11:11.375055] [INFO ] [MAIN ] Derivative Progress: 1106/2057 symbols completed. MCR took 1.1s. Estimated remaining: 6m 0s. Rate: 158.4 symbols/min [2025-10-21T22:11:11.375366] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:11.393357] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:11.394853] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39453 primary records. [2025-10-21T22:11:11.395003] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-10-21T22:11:11.418988] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-10-21T22:11:11.419134] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-10-21T22:11:11.417461] [DEBUG] [LOCAL ] MCS: Loaded 21229 existing records from primary storage. [2025-10-21T22:11:11.422256] [INFO ] [MAIN ] Derivative Progress: 1107/2057 symbols completed. MCO took 1.2s. Estimated remaining: 5m 59s. Rate: 158.6 symbols/min [2025-10-21T22:11:11.419364] [INFO ] [MAIN ] MCS: Loaded 21229 primary data records. [2025-10-21T22:11:11.422623] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:11.542406] [DEBUG] [LOCAL ] MCY: Loaded 23711 existing records from primary storage. [2025-10-21T22:11:11.542590] [INFO ] [MAIN ] MCY: Loaded 23711 primary data records. [2025-10-21T22:11:11.945488] [DEBUG] [LOCAL ] MD: Loaded 38586 existing records from primary storage. [2025-10-21T22:11:12.063959] [INFO ] [MAIN ] MD: Loaded 38586 primary data records. [2025-10-21T22:11:12.393100] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:12.395006] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21229 primary records. [2025-10-21T22:11:12.395481] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-10-21T22:11:12.414772] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-10-21T22:11:12.414873] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-10-21T22:11:12.418340] [INFO ] [MAIN ] Derivative Progress: 1108/2057 symbols completed. MCS took 1.1s. Estimated remaining: 5m 60s. Rate: 158.3 symbols/min [2025-10-21T22:11:12.432852] [DEBUG] [MAIN ] MCY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:12.434010] [INFO ] [MAIN ] MCY: Generated 1793 derivative records from 23711 primary records. [2025-10-21T22:11:12.434111] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-10-21T22:11:12.451143] [DEBUG] [LOCAL ] MCY: Derivative data saved (1793 records). [2025-10-21T22:11:12.451245] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-10-21T22:11:12.454186] [INFO ] [MAIN ] Derivative Progress: 1109/2057 symbols completed. MCY took 1.1s. Estimated remaining: 5m 59s. Rate: 158.5 symbols/min [2025-10-21T22:11:12.470421] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:12.471028] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38586 primary records. [2025-10-21T22:11:12.471090] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-10-21T22:11:12.486134] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-10-21T22:11:12.486189] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-10-21T22:11:12.488941] [INFO ] [MAIN ] Derivative Progress: 1110/2057 symbols completed. MD took 1.1s. Estimated remaining: 5m 58s. Rate: 158.6 symbols/min [2025-10-21T22:11:12.489529] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:12.489610] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:12.489702] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:12.504977] [DEBUG] [LOCAL ] MDST: Loaded 6139 existing records from primary storage. [2025-10-21T22:11:12.505188] [INFO ] [MAIN ] MDST: Loaded 6139 primary data records. [2025-10-21T22:11:12.868871] [DEBUG] [LOCAL ] MDU: Loaded 48021 existing records from primary storage. [2025-10-21T22:11:12.869538] [INFO ] [MAIN ] MDU: Loaded 48021 primary data records. [2025-10-21T22:11:12.870527] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-21T22:11:12.882380] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-10-21T22:11:13.533033] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:13.534006] [INFO ] [MAIN ] MDST: Generated 1793 derivative records from 6139 primary records. [2025-10-21T22:11:13.534122] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-10-21T22:11:13.552894] [DEBUG] [LOCAL ] MDST: Derivative data saved (1793 records). [2025-10-21T22:11:13.553504] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-10-21T22:11:13.556750] [INFO ] [MAIN ] Derivative Progress: 1111/2057 symbols completed. MDST took 1.1s. Estimated remaining: 5m 58s. Rate: 158.3 symbols/min [2025-10-21T22:11:13.557061] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:13.578178] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:13.579123] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 48021 primary records. [2025-10-21T22:11:13.579287] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-10-21T22:11:13.594885] [DEBUG] [LOCAL ] MDV: Loaded 8346 existing records from primary storage. [2025-10-21T22:11:13.596890] [INFO ] [MAIN ] MDV: Loaded 8346 primary data records. [2025-10-21T22:11:13.610532] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-10-21T22:11:13.631244] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-10-21T22:11:13.667900] [INFO ] [MAIN ] Derivative Progress: 1112/2057 symbols completed. MDU took 1.2s. Estimated remaining: 5m 58s. Rate: 158.4 symbols/min [2025-10-21T22:11:13.696381] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:13.726082] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:13.737441] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-10-21T22:11:13.742833] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-10-21T22:11:13.940775] [DEBUG] [LOCAL ] MEC: Loaded 16796 existing records from primary storage. [2025-10-21T22:11:13.942265] [INFO ] [MAIN ] MEC: Loaded 16796 primary data records. [2025-10-21T22:11:13.942091] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-10-21T22:11:13.953846] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-10-21T22:11:13.977558] [INFO ] [MAIN ] Derivative Progress: 1113/2057 symbols completed. MDT took 1.5s. Estimated remaining: 5m 57s. Rate: 158.5 symbols/min [2025-10-21T22:11:13.990685] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:14.138158] [DEBUG] [LOCAL ] MED: Loaded 21011 existing records from primary storage. [2025-10-21T22:11:14.276938] [INFO ] [MAIN ] MED: Loaded 21011 primary data records. [2025-10-21T22:11:14.595155] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:14.596148] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8346 primary records. [2025-10-21T22:11:14.596335] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-10-21T22:11:14.617226] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-10-21T22:11:14.617836] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-10-21T22:11:14.620198] [INFO ] [MAIN ] Derivative Progress: 1114/2057 symbols completed. MDV took 1.1s. Estimated remaining: 5m 57s. Rate: 158.4 symbols/min [2025-10-21T22:11:14.620549] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:14.638205] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:14.638912] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16796 primary records. [2025-10-21T22:11:14.639226] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-10-21T22:11:14.655705] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-10-21T22:11:14.655942] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-10-21T22:11:14.658692] [INFO ] [MAIN ] Derivative Progress: 1115/2057 symbols completed. MEC took 1.0s. Estimated remaining: 5m 57s. Rate: 158.5 symbols/min [2025-10-21T22:11:14.666426] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:14.682740] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:14.683552] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21011 primary records. [2025-10-21T22:11:14.683726] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-10-21T22:11:14.714187] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-10-21T22:11:14.714340] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-10-21T22:11:14.713084] [DEBUG] [LOCAL ] MEG: Loaded 31613 existing records from primary storage. [2025-10-21T22:11:14.714448] [INFO ] [MAIN ] MEG: Loaded 31613 primary data records. [2025-10-21T22:11:14.717418] [INFO ] [MAIN ] Derivative Progress: 1116/2057 symbols completed. MED took 0.7s. Estimated remaining: 5m 56s. Rate: 158.6 symbols/min [2025-10-21T22:11:14.722728] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:14.828467] [DEBUG] [LOCAL ] MEGI: Loaded 19774 existing records from primary storage. [2025-10-21T22:11:14.830606] [INFO ] [MAIN ] MEGI: Loaded 19774 primary data records. [2025-10-21T22:11:15.215983] [DEBUG] [LOCAL ] MEI: Loaded 31387 existing records from primary storage. [2025-10-21T22:11:15.368744] [INFO ] [MAIN ] MEI: Loaded 31387 primary data records. [2025-10-21T22:11:15.702354] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:15.703527] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 31613 primary records. [2025-10-21T22:11:15.711796] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-10-21T22:11:15.727369] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:15.732439] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 19774 primary records. [2025-10-21T22:11:15.736802] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-10-21T22:11:15.733756] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-10-21T22:11:15.737068] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-10-21T22:11:15.740009] [INFO ] [MAIN ] Derivative Progress: 1117/2057 symbols completed. MEG took 1.1s. Estimated remaining: 5m 56s. Rate: 158.4 symbols/min [2025-10-21T22:11:15.740297] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:15.756383] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-10-21T22:11:15.756698] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-10-21T22:11:15.759421] [INFO ] [MAIN ] Derivative Progress: 1118/2057 symbols completed. MEGI took 1.1s. Estimated remaining: 5m 55s. Rate: 158.5 symbols/min [2025-10-21T22:11:15.759678] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:15.776177] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:15.776965] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 31387 primary records. [2025-10-21T22:11:15.777080] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-10-21T22:11:15.794089] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-10-21T22:11:15.794287] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-10-21T22:11:15.797137] [INFO ] [MAIN ] Derivative Progress: 1119/2057 symbols completed. MEI took 1.1s. Estimated remaining: 5m 55s. Rate: 158.6 symbols/min [2025-10-21T22:11:15.797490] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:15.827853] [DEBUG] [LOCAL ] MFAN: Loaded 4348 existing records from primary storage. [2025-10-21T22:11:15.828057] [INFO ] [MAIN ] MFAN: Loaded 4348 primary data records. [2025-10-21T22:11:15.967514] [DEBUG] [LOCAL ] MFA: Loaded 45661 existing records from primary storage. [2025-10-21T22:11:15.972751] [INFO ] [MAIN ] MFA: Loaded 45661 primary data records. [2025-10-21T22:11:15.972183] [DEBUG] [LOCAL ] MET: Loaded 53305 existing records from primary storage. [2025-10-21T22:11:15.978240] [INFO ] [MAIN ] MET: Loaded 53305 primary data records. [2025-10-21T22:11:16.796202] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:16.797092] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4348 primary records. [2025-10-21T22:11:16.797293] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-10-21T22:11:16.815632] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-10-21T22:11:16.817179] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-10-21T22:11:16.820172] [INFO ] [MAIN ] Derivative Progress: 1120/2057 symbols completed. MFAN took 1.0s. Estimated remaining: 5m 55s. Rate: 158.4 symbols/min [2025-10-21T22:11:16.834221] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:16.834086] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:16.835723] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45661 primary records. [2025-10-21T22:11:16.835814] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-10-21T22:11:16.849742] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:16.858908] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53305 primary records. [2025-10-21T22:11:16.860247] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-10-21T22:11:16.867869] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-10-21T22:11:16.878329] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-10-21T22:11:16.887533] [INFO ] [MAIN ] Derivative Progress: 1121/2057 symbols completed. MFA took 1.1s. Estimated remaining: 5m 54s. Rate: 158.5 symbols/min [2025-10-21T22:11:16.888346] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:16.871226] [DEBUG] [LOCAL ] MFAO: Loaded 3968 existing records from primary storage. [2025-10-21T22:11:16.892256] [INFO ] [MAIN ] MFAO: Loaded 3968 primary data records. [2025-10-21T22:11:16.891844] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-10-21T22:11:16.903838] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-10-21T22:11:16.916496] [INFO ] [MAIN ] Derivative Progress: 1122/2057 symbols completed. MET took 1.2s. Estimated remaining: 5m 54s. Rate: 158.6 symbols/min [2025-10-21T22:11:16.916784] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:17.269284] [DEBUG] [LOCAL ] MFG: Loaded 49585 existing records from primary storage. [2025-10-21T22:11:17.283710] [INFO ] [MAIN ] MFG: Loaded 49585 primary data records. [2025-10-21T22:11:17.317203] [DEBUG] [LOCAL ] MFC: Loaded 51013 existing records from primary storage. [2025-10-21T22:11:17.349948] [INFO ] [MAIN ] MFC: Loaded 51013 primary data records. [2025-10-21T22:11:17.928830] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:17.930281] [INFO ] [MAIN ] MFAO: Generated 1793 derivative records from 3968 primary records. [2025-10-21T22:11:17.930520] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-10-21T22:11:17.946339] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1793 records). [2025-10-21T22:11:17.947041] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-10-21T22:11:17.949674] [INFO ] [MAIN ] Derivative Progress: 1123/2057 symbols completed. MFAO took 1.1s. Estimated remaining: 5m 54s. Rate: 158.4 symbols/min [2025-10-21T22:11:17.969146] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:17.969919] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 49585 primary records. [2025-10-21T22:11:17.970067] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-10-21T22:11:17.987831] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-10-21T22:11:17.987961] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-10-21T22:11:17.990087] [INFO ] [MAIN ] Derivative Progress: 1124/2057 symbols completed. MFG took 1.1s. Estimated remaining: 5m 53s. Rate: 158.5 symbols/min [2025-10-21T22:11:18.002524] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:18.003111] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51013 primary records. [2025-10-21T22:11:18.003170] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-10-21T22:11:18.018518] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-10-21T22:11:18.018625] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-10-21T22:11:18.021477] [INFO ] [MAIN ] Derivative Progress: 1125/2057 symbols completed. MFC took 1.1s. Estimated remaining: 5m 52s. Rate: 158.6 symbols/min [2025-10-21T22:11:18.022151] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:18.022084] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:18.022302] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:18.035565] [DEBUG] [LOCAL ] MFSG: Loaded 5924 existing records from primary storage. [2025-10-21T22:11:18.035931] [INFO ] [MAIN ] MFSG: Loaded 5924 primary data records. [2025-10-21T22:11:18.104094] [DEBUG] [LOCAL ] MFM: Loaded 14170 existing records from primary storage. [2025-10-21T22:11:18.140236] [INFO ] [MAIN ] MFM: Loaded 14170 primary data records. [2025-10-21T22:11:18.154180] [DEBUG] [LOCAL ] MFSI: Loaded 12557 existing records from primary storage. [2025-10-21T22:11:18.187821] [INFO ] [MAIN ] MFSI: Loaded 12557 primary data records. [2025-10-21T22:11:19.026617] [DEBUG] [MAIN ] MFSG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:19.027500] [INFO ] [MAIN ] MFSG: Generated 1793 derivative records from 5924 primary records. [2025-10-21T22:11:19.027844] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-10-21T22:11:19.069197] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1793 records). [2025-10-21T22:11:19.069736] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:19.074063] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-10-21T22:11:19.075431] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14170 primary records. [2025-10-21T22:11:19.077710] [INFO ] [MAIN ] Derivative Progress: 1126/2057 symbols completed. MFSG took 1.1s. Estimated remaining: 5m 53s. Rate: 158.4 symbols/min [2025-10-21T22:11:19.078121] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:19.077914] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-10-21T22:11:19.079859] [DEBUG] [MAIN ] MFSI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:19.091079] [INFO ] [MAIN ] MFSI: Generated 1793 derivative records from 12557 primary records. [2025-10-21T22:11:19.091281] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-10-21T22:11:19.096784] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-10-21T22:11:19.097231] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-10-21T22:11:19.099740] [INFO ] [MAIN ] Derivative Progress: 1127/2057 symbols completed. MFM took 1.1s. Estimated remaining: 5m 52s. Rate: 158.5 symbols/min [2025-10-21T22:11:19.099975] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:19.114772] [DEBUG] [LOCAL ] MFSV: Loaded 2921 existing records from primary storage. [2025-10-21T22:11:19.118903] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1793 records). [2025-10-21T22:11:19.119048] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-10-21T22:11:19.119229] [INFO ] [MAIN ] MFSV: Loaded 2921 primary data records. [2025-10-21T22:11:19.133020] [INFO ] [MAIN ] Derivative Progress: 1128/2057 symbols completed. MFSI took 1.1s. Estimated remaining: 5m 51s. Rate: 158.7 symbols/min [2025-10-21T22:11:19.142626] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:19.239219] [DEBUG] [LOCAL ] MG: Loaded 15529 existing records from primary storage. [2025-10-21T22:11:19.239824] [INFO ] [MAIN ] MG: Loaded 15529 primary data records. [2025-10-21T22:11:19.645383] [DEBUG] [LOCAL ] MGA: Loaded 50432 existing records from primary storage. [2025-10-21T22:11:19.660841] [INFO ] [MAIN ] MGA: Loaded 50432 primary data records. [2025-10-21T22:11:20.115472] [DEBUG] [MAIN ] MFSV: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-10-21T22:11:20.116517] [INFO ] [MAIN ] MFSV: Generated 1792 derivative records from 2921 primary records. [2025-10-21T22:11:20.116744] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-10-21T22:11:20.147234] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1792 records). [2025-10-21T22:11:20.147966] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:20.148856] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 15529 primary records. [2025-10-21T22:11:20.149052] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-10-21T22:11:20.151590] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-10-21T22:11:20.151511] [INFO ] [MAIN ] Derivative Progress: 1129/2057 symbols completed. MFSV took 1.1s. Estimated remaining: 5m 51s. Rate: 158.4 symbols/min [2025-10-21T22:11:20.152931] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:20.169952] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-10-21T22:11:20.170372] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-10-21T22:11:20.174691] [INFO ] [MAIN ] Derivative Progress: 1130/2057 symbols completed. MG took 1.1s. Estimated remaining: 5m 51s. Rate: 158.6 symbols/min [2025-10-21T22:11:20.175850] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:20.178801] [DEBUG] [LOCAL ] MGF: Loaded 4170 existing records from primary storage. [2025-10-21T22:11:20.179274] [INFO ] [MAIN ] MGF: Loaded 4170 primary data records. [2025-10-21T22:11:20.229825] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:20.269610] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50432 primary records. [2025-10-21T22:11:20.286010] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-10-21T22:11:20.392003] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-10-21T22:11:20.520283] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-10-21T22:11:20.523842] [INFO ] [MAIN ] Derivative Progress: 1131/2057 symbols completed. MGA took 1.4s. Estimated remaining: 5m 50s. Rate: 158.6 symbols/min [2025-10-21T22:11:20.524283] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:20.551846] [DEBUG] [LOCAL ] MGR: Loaded 5572 existing records from primary storage. [2025-10-21T22:11:20.552011] [INFO ] [MAIN ] MGR: Loaded 5572 primary data records. [2025-10-21T22:11:20.574821] [DEBUG] [LOCAL ] MGM: Loaded 53605 existing records from primary storage. [2025-10-21T22:11:20.610700] [INFO ] [MAIN ] MGM: Loaded 53605 primary data records. [2025-10-21T22:11:21.054663] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:21.208115] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4170 primary records. [2025-10-21T22:11:21.221527] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-10-21T22:11:21.237281] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-10-21T22:11:21.238677] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-10-21T22:11:21.240856] [INFO ] [MAIN ] Derivative Progress: 1132/2057 symbols completed. MGF took 1.1s. Estimated remaining: 5m 50s. Rate: 158.4 symbols/min [2025-10-21T22:11:21.241694] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:21.250847] [DEBUG] [LOCAL ] MGRB: Loaded 3996 existing records from primary storage. [2025-10-21T22:11:21.251744] [INFO ] [MAIN ] MGRB: Loaded 3996 primary data records. [2025-10-21T22:11:21.394753] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:21.423239] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5572 primary records. [2025-10-21T22:11:21.464971] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-10-21T22:11:21.465541] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:21.477217] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53605 primary records. [2025-10-21T22:11:21.579786] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-10-21T22:11:21.597468] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-10-21T22:11:21.598123] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-10-21T22:11:21.612683] [INFO ] [MAIN ] Derivative Progress: 1133/2057 symbols completed. MGR took 1.1s. Estimated remaining: 5m 50s. Rate: 158.4 symbols/min [2025-10-21T22:11:21.617291] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:21.619059] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-10-21T22:11:21.619947] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-10-21T22:11:21.622840] [INFO ] [MAIN ] Derivative Progress: 1134/2057 symbols completed. MGM took 1.4s. Estimated remaining: 5m 49s. Rate: 158.6 symbols/min [2025-10-21T22:11:21.623622] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:21.627994] [DEBUG] [LOCAL ] MGRD: Loaded 2207 existing records from primary storage. [2025-10-21T22:11:21.628457] [INFO ] [MAIN ] MGRD: Loaded 2207 primary data records. [2025-10-21T22:11:21.734092] [DEBUG] [LOCAL ] MGRE: Loaded 6470 existing records from primary storage. [2025-10-21T22:11:21.737775] [INFO ] [MAIN ] MGRE: Loaded 6470 primary data records. [2025-10-21T22:11:22.080525] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:22.131193] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 3996 primary records. [2025-10-21T22:11:22.138552] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-10-21T22:11:22.275073] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-10-21T22:11:22.275561] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-10-21T22:11:22.278458] [INFO ] [MAIN ] Derivative Progress: 1135/2057 symbols completed. MGRB took 1.0s. Estimated remaining: 5m 49s. Rate: 158.5 symbols/min [2025-10-21T22:11:22.278724] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:22.303195] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:22.308245] [DEBUG] [LOCAL ] MHD: Loaded 12010 existing records from primary storage. [2025-10-21T22:11:22.309041] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2207 primary records. [2025-10-21T22:11:22.309193] [INFO ] [MAIN ] MHD: Loaded 12010 primary data records. [2025-10-21T22:11:22.309127] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-10-21T22:11:22.408488] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-10-21T22:11:22.419862] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-10-21T22:11:22.445706] [INFO ] [MAIN ] Derivative Progress: 1136/2057 symbols completed. MGRD took 0.8s. Estimated remaining: 5m 49s. Rate: 158.6 symbols/min [2025-10-21T22:11:22.446608] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:22.457262] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:22.458505] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6470 primary records. [2025-10-21T22:11:22.469202] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-10-21T22:11:22.672901] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-10-21T22:11:22.677974] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-10-21T22:11:22.677880] [DEBUG] [LOCAL ] MHF: Loaded 9061 existing records from primary storage. [2025-10-21T22:11:22.680610] [INFO ] [MAIN ] Derivative Progress: 1137/2057 symbols completed. MGRE took 1.1s. Estimated remaining: 5m 48s. Rate: 158.6 symbols/min [2025-10-21T22:11:22.680703] [INFO ] [MAIN ] MHF: Loaded 9061 primary data records. [2025-10-21T22:11:22.680984] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:23.039478] [DEBUG] [LOCAL ] MHK: Loaded 42005 existing records from primary storage. [2025-10-21T22:11:23.039847] [INFO ] [MAIN ] MHK: Loaded 42005 primary data records. [2025-10-21T22:11:23.171376] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:23.200593] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12010 primary records. [2025-10-21T22:11:23.233210] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-10-21T22:11:23.372129] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-10-21T22:11:23.372914] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-10-21T22:11:23.375307] [INFO ] [MAIN ] Derivative Progress: 1138/2057 symbols completed. MHD took 1.1s. Estimated remaining: 5m 48s. Rate: 158.5 symbols/min [2025-10-21T22:11:23.393125] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:23.393987] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 9061 primary records. [2025-10-21T22:11:23.394148] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-10-21T22:11:23.409313] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-10-21T22:11:23.409464] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-10-21T22:11:23.412028] [INFO ] [MAIN ] Derivative Progress: 1139/2057 symbols completed. MHF took 1.0s. Estimated remaining: 5m 47s. Rate: 158.6 symbols/min [2025-10-21T22:11:23.427852] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:23.428413] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42005 primary records. [2025-10-21T22:11:23.428470] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-10-21T22:11:23.443704] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-10-21T22:11:23.443770] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-10-21T22:11:23.446327] [INFO ] [MAIN ] Derivative Progress: 1140/2057 symbols completed. MHK took 0.8s. Estimated remaining: 5m 47s. Rate: 158.7 symbols/min [2025-10-21T22:11:23.446777] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:23.446925] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:23.446836] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:23.460637] [DEBUG] [LOCAL ] MHN: Loaded 7437 existing records from primary storage. [2025-10-21T22:11:23.460901] [INFO ] [MAIN ] MHN: Loaded 7437 primary data records. [2025-10-21T22:11:23.543299] [DEBUG] [LOCAL ] MIN: Loaded 13992 existing records from primary storage. [2025-10-21T22:11:23.561138] [INFO ] [MAIN ] MIN: Loaded 13992 primary data records. [2025-10-21T22:11:23.631203] [DEBUG] [LOCAL ] MHO: Loaded 23733 existing records from primary storage. [2025-10-21T22:11:23.671401] [INFO ] [MAIN ] MHO: Loaded 23733 primary data records. [2025-10-21T22:11:24.442305] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:24.455868] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7437 primary records. [2025-10-21T22:11:24.456476] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-10-21T22:11:24.456404] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:24.457933] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13992 primary records. [2025-10-21T22:11:24.458098] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-10-21T22:11:24.484530] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-10-21T22:11:24.488680] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-10-21T22:11:24.489761] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-10-21T22:11:24.493104] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-10-21T22:11:24.492761] [INFO ] [MAIN ] Derivative Progress: 1141/2057 symbols completed. MHN took 1.0s. Estimated remaining: 5m 47s. Rate: 158.5 symbols/min [2025-10-21T22:11:24.496206] [INFO ] [MAIN ] Derivative Progress: 1142/2057 symbols completed. MIN took 1.0s. Estimated remaining: 5m 46s. Rate: 158.6 symbols/min [2025-10-21T22:11:24.496040] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:24.508722] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:24.510017] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:24.510699] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 23733 primary records. [2025-10-21T22:11:24.510832] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-10-21T22:11:24.527387] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-10-21T22:11:24.527526] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-10-21T22:11:24.530329] [INFO ] [MAIN ] Derivative Progress: 1143/2057 symbols completed. MHO took 1.1s. Estimated remaining: 5m 45s. Rate: 158.8 symbols/min [2025-10-21T22:11:24.533068] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:24.532900] [DEBUG] [LOCAL ] MITP: Loaded 2255 existing records from primary storage. [2025-10-21T22:11:24.533532] [INFO ] [MAIN ] MITP: Loaded 2255 primary data records. [2025-10-21T22:11:24.749347] [DEBUG] [LOCAL ] MITT: Loaded 22416 existing records from primary storage. [2025-10-21T22:11:24.752886] [INFO ] [MAIN ] MITT: Loaded 22416 primary data records. [2025-10-21T22:11:25.031103] [DEBUG] [LOCAL ] MIR: Loaded 51399 existing records from primary storage. [2025-10-21T22:11:25.032033] [INFO ] [MAIN ] MIR: Loaded 51399 primary data records. [2025-10-21T22:11:25.561220] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:25.562270] [INFO ] [MAIN ] MITP: Generated 1794 derivative records from 2255 primary records. [2025-10-21T22:11:25.562494] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-10-21T22:11:25.576858] [DEBUG] [LOCAL ] MITP: Derivative data saved (1794 records). [2025-10-21T22:11:25.578558] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-10-21T22:11:25.580885] [INFO ] [MAIN ] Derivative Progress: 1144/2057 symbols completed. MITP took 1.1s. Estimated remaining: 5m 46s. Rate: 158.5 symbols/min [2025-10-21T22:11:25.581790] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:25.596387] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:25.597071] [INFO ] [MAIN ] MITT: Generated 1793 derivative records from 22416 primary records. [2025-10-21T22:11:25.597333] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-10-21T22:11:25.618395] [DEBUG] [LOCAL ] MIY: Loaded 6214 existing records from primary storage. [2025-10-21T22:11:25.614396] [DEBUG] [LOCAL ] MITT: Derivative data saved (1793 records). [2025-10-21T22:11:25.619187] [INFO ] [MAIN ] MIY: Loaded 6214 primary data records. [2025-10-21T22:11:25.630401] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-10-21T22:11:25.653502] [INFO ] [MAIN ] Derivative Progress: 1145/2057 symbols completed. MITT took 1.1s. Estimated remaining: 5m 45s. Rate: 158.6 symbols/min [2025-10-21T22:11:25.719051] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:25.724585] [DEBUG] [MAIN ] MIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:25.744021] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 51399 primary records. [2025-10-21T22:11:25.744227] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-10-21T22:11:25.949310] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-10-21T22:11:25.957057] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-10-21T22:11:25.960043] [INFO ] [MAIN ] Derivative Progress: 1146/2057 symbols completed. MIR took 1.5s. Estimated remaining: 5m 45s. Rate: 158.6 symbols/min [2025-10-21T22:11:25.960202] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:26.025211] [DEBUG] [LOCAL ] MKC: Loaded 52527 existing records from primary storage. [2025-10-21T22:11:26.030871] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:26.030931] [INFO ] [MAIN ] MKC: Loaded 52527 primary data records. [2025-10-21T22:11:26.031717] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6214 primary records. [2025-10-21T22:11:26.052270] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-10-21T22:11:26.143685] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-10-21T22:11:26.149392] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-10-21T22:11:26.137519] [DEBUG] [LOCAL ] MKL: Loaded 33977 existing records from primary storage. [2025-10-21T22:11:26.160304] [INFO ] [MAIN ] MKL: Loaded 33977 primary data records. [2025-10-21T22:11:26.163386] [INFO ] [MAIN ] Derivative Progress: 1147/2057 symbols completed. MIY took 0.6s. Estimated remaining: 5m 44s. Rate: 158.7 symbols/min [2025-10-21T22:11:26.183963] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:26.681318] [DEBUG] [LOCAL ] MLI: Loaded 43432 existing records from primary storage. [2025-10-21T22:11:26.681822] [INFO ] [MAIN ] MLI: Loaded 43432 primary data records. [2025-10-21T22:11:26.872587] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:27.061287] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52527 primary records. [2025-10-21T22:11:27.063229] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-10-21T22:11:27.095545] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-10-21T22:11:27.095737] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-10-21T22:11:27.091968] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:27.097832] [INFO ] [MAIN ] Derivative Progress: 1148/2057 symbols completed. MKC took 1.4s. Estimated remaining: 5m 44s. Rate: 158.5 symbols/min [2025-10-21T22:11:27.098736] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 33977 primary records. [2025-10-21T22:11:27.098937] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-10-21T22:11:27.099366] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:27.117426] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-10-21T22:11:27.118878] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-10-21T22:11:27.121261] [INFO ] [MAIN ] Derivative Progress: 1149/2057 symbols completed. MKL took 1.2s. Estimated remaining: 5m 43s. Rate: 158.6 symbols/min [2025-10-21T22:11:27.121546] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:27.163161] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:27.164148] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43432 primary records. [2025-10-21T22:11:27.164349] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-10-21T22:11:27.184443] [DEBUG] [LOCAL ] MLNK: Loaded 27266 existing records from primary storage. [2025-10-21T22:11:27.196054] [INFO ] [MAIN ] MLNK: Loaded 27266 primary data records. [2025-10-21T22:11:27.195945] [DEBUG] [LOCAL ] MLM: Loaded 28871 existing records from primary storage. [2025-10-21T22:11:27.201492] [INFO ] [MAIN ] MLM: Loaded 28871 primary data records. [2025-10-21T22:11:27.430036] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-10-21T22:11:27.446168] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-10-21T22:11:27.469891] [INFO ] [MAIN ] Derivative Progress: 1150/2057 symbols completed. MLI took 1.3s. Estimated remaining: 5m 43s. Rate: 158.7 symbols/min [2025-10-21T22:11:27.640012] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:27.825949] [DEBUG] [LOCAL ] MLP: Loaded 3066 existing records from primary storage. [2025-10-21T22:11:27.826461] [INFO ] [MAIN ] MLP: Loaded 3066 primary data records. [2025-10-21T22:11:28.142401] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:28.143792] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 27266 primary records. [2025-10-21T22:11:28.144033] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-10-21T22:11:28.163581] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-10-21T22:11:28.163949] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-10-21T22:11:28.166367] [INFO ] [MAIN ] Derivative Progress: 1151/2057 symbols completed. MLNK took 1.0s. Estimated remaining: 5m 43s. Rate: 158.5 symbols/min [2025-10-21T22:11:28.166677] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:28.181909] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:28.183095] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 28871 primary records. [2025-10-21T22:11:28.183411] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-10-21T22:11:28.200617] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-10-21T22:11:28.201054] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-10-21T22:11:28.203398] [INFO ] [MAIN ] Derivative Progress: 1152/2057 symbols completed. MLM took 1.1s. Estimated remaining: 5m 42s. Rate: 158.7 symbols/min [2025-10-21T22:11:28.203783] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:28.222404] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:28.225580] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 3066 primary records. [2025-10-21T22:11:28.225804] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-10-21T22:11:28.244103] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-10-21T22:11:28.244194] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-10-21T22:11:28.246699] [INFO ] [MAIN ] Derivative Progress: 1153/2057 symbols completed. MLP took 0.6s. Estimated remaining: 5m 42s. Rate: 158.8 symbols/min [2025-10-21T22:11:28.243752] [DEBUG] [LOCAL ] MMD: Loaded 10750 existing records from primary storage. [2025-10-21T22:11:28.247208] [INFO ] [MAIN ] MMD: Loaded 10750 primary data records. [2025-10-21T22:11:28.415769] [DEBUG] [LOCAL ] MMC: Loaded 51948 existing records from primary storage. [2025-10-21T22:11:28.432142] [INFO ] [MAIN ] MMC: Loaded 51948 primary data records. [2025-10-21T22:11:28.962799] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:28.963565] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 10750 primary records. [2025-10-21T22:11:28.963767] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-10-21T22:11:28.983447] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-10-21T22:11:28.983561] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-10-21T22:11:28.986517] [INFO ] [MAIN ] Derivative Progress: 1154/2057 symbols completed. MMD took 0.8s. Estimated remaining: 5m 42s. Rate: 158.6 symbols/min [2025-10-21T22:11:29.000341] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:29.000933] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51948 primary records. [2025-10-21T22:11:29.001057] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-10-21T22:11:29.017826] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-10-21T22:11:29.017914] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-10-21T22:11:29.020904] [INFO ] [MAIN ] Derivative Progress: 1155/2057 symbols completed. MMC took 0.9s. Estimated remaining: 5m 41s. Rate: 158.8 symbols/min [2025-10-21T22:11:29.021618] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:29.021541] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:29.021710] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:29.046836] [DEBUG] [LOCAL ] MMI: Loaded 15428 existing records from primary storage. [2025-10-21T22:11:29.047105] [INFO ] [MAIN ] MMI: Loaded 15428 primary data records. [2025-10-21T22:11:29.207588] [DEBUG] [LOCAL ] MMS: Loaded 33484 existing records from primary storage. [2025-10-21T22:11:29.224536] [INFO ] [MAIN ] MMS: Loaded 33484 primary data records. [2025-10-21T22:11:29.545428] [DEBUG] [LOCAL ] MMM: Loaded 53112 existing records from primary storage. [2025-10-21T22:11:29.545728] [INFO ] [MAIN ] MMM: Loaded 53112 primary data records. [2025-10-21T22:11:30.122358] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:30.123992] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15428 primary records. [2025-10-21T22:11:30.124206] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-10-21T22:11:30.146080] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-10-21T22:11:30.146935] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-10-21T22:11:30.149361] [INFO ] [MAIN ] Derivative Progress: 1156/2057 symbols completed. MMI took 1.1s. Estimated remaining: 5m 41s. Rate: 158.5 symbols/min [2025-10-21T22:11:30.157736] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:30.163465] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:30.165108] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 33484 primary records. [2025-10-21T22:11:30.165330] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-10-21T22:11:30.187540] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-10-21T22:11:30.188569] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-10-21T22:11:30.196337] [DEBUG] [LOCAL ] MMT: Loaded 10203 existing records from primary storage. [2025-10-21T22:11:30.191345] [INFO ] [MAIN ] Derivative Progress: 1157/2057 symbols completed. MMS took 1.2s. Estimated remaining: 5m 40s. Rate: 158.6 symbols/min [2025-10-21T22:11:30.204448] [INFO ] [MAIN ] MMT: Loaded 10203 primary data records. [2025-10-21T22:11:30.221661] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:30.232499] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:30.250228] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53112 primary records. [2025-10-21T22:11:30.250472] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-10-21T22:11:30.382261] [DEBUG] [LOCAL ] MMU: Loaded 16751 existing records from primary storage. [2025-10-21T22:11:30.376707] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-10-21T22:11:30.387613] [INFO ] [MAIN ] MMU: Loaded 16751 primary data records. [2025-10-21T22:11:30.402540] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-10-21T22:11:30.458284] [INFO ] [MAIN ] Derivative Progress: 1158/2057 symbols completed. MMM took 1.4s. Estimated remaining: 5m 40s. Rate: 158.7 symbols/min [2025-10-21T22:11:30.632470] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:30.975382] [DEBUG] [LOCAL ] MNR: Loaded 25091 existing records from primary storage. [2025-10-21T22:11:30.976258] [INFO ] [MAIN ] MNR: Loaded 25091 primary data records. [2025-10-21T22:11:31.149090] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:31.184171] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 10203 primary records. [2025-10-21T22:11:31.298701] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-10-21T22:11:31.335290] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-10-21T22:11:31.349599] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-10-21T22:11:31.350144] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:31.354353] [INFO ] [MAIN ] Derivative Progress: 1159/2057 symbols completed. MMT took 1.2s. Estimated remaining: 5m 40s. Rate: 158.5 symbols/min [2025-10-21T22:11:31.355835] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:31.355499] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16751 primary records. [2025-10-21T22:11:31.356744] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-10-21T22:11:31.376945] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-10-21T22:11:31.377205] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-10-21T22:11:31.380145] [INFO ] [MAIN ] Derivative Progress: 1160/2057 symbols completed. MMU took 1.2s. Estimated remaining: 5m 39s. Rate: 158.6 symbols/min [2025-10-21T22:11:31.380692] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:31.400731] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:31.401476] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 25091 primary records. [2025-10-21T22:11:31.401638] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-10-21T22:11:31.431064] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-10-21T22:11:31.431248] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-10-21T22:11:31.433864] [INFO ] [MAIN ] Derivative Progress: 1161/2057 symbols completed. MNR took 0.8s. Estimated remaining: 5m 39s. Rate: 158.7 symbols/min [2025-10-21T22:11:31.434151] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:31.479380] [DEBUG] [LOCAL ] MNSO: Loaded 44129 existing records from primary storage. [2025-10-21T22:11:31.477453] [DEBUG] [LOCAL ] MOD: Loaded 44532 existing records from primary storage. [2025-10-21T22:11:31.480022] [INFO ] [MAIN ] MNSO: Loaded 44129 primary data records. [2025-10-21T22:11:31.479938] [INFO ] [MAIN ] MOD: Loaded 44532 primary data records. [2025-10-21T22:11:31.822012] [DEBUG] [LOCAL ] MODG: Loaded 51537 existing records from primary storage. [2025-10-21T22:11:31.994374] [INFO ] [MAIN ] MODG: Loaded 51537 primary data records. [2025-10-21T22:11:32.540623] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:32.565147] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 44532 primary records. [2025-10-21T22:11:32.566900] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:32.566499] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-10-21T22:11:32.568168] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44129 primary records. [2025-10-21T22:11:32.568311] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-10-21T22:11:32.606901] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-10-21T22:11:32.607184] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-10-21T22:11:32.610325] [INFO ] [MAIN ] Derivative Progress: 1162/2057 symbols completed. MOD took 1.2s. Estimated remaining: 5m 39s. Rate: 158.4 symbols/min [2025-10-21T22:11:32.617739] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-10-21T22:11:32.617895] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:32.618779] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-10-21T22:11:32.622976] [INFO ] [MAIN ] Derivative Progress: 1163/2057 symbols completed. MNSO took 1.3s. Estimated remaining: 5m 38s. Rate: 158.6 symbols/min [2025-10-21T22:11:32.623955] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:32.648166] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:32.649451] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51537 primary records. [2025-10-21T22:11:32.649596] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-10-21T22:11:32.674933] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-10-21T22:11:32.675366] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-10-21T22:11:32.678942] [INFO ] [MAIN ] Derivative Progress: 1164/2057 symbols completed. MODG took 1.2s. Estimated remaining: 5m 38s. Rate: 158.7 symbols/min [2025-10-21T22:11:32.679318] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:32.739515] [DEBUG] [LOCAL ] MOH: Loaded 43015 existing records from primary storage. [2025-10-21T22:11:32.740482] [INFO ] [MAIN ] MOH: Loaded 43015 primary data records. [2025-10-21T22:11:32.802100] [DEBUG] [LOCAL ] MOS: Loaded 53511 existing records from primary storage. [2025-10-21T22:11:32.830933] [INFO ] [MAIN ] MOS: Loaded 53511 primary data records. [2025-10-21T22:11:32.845940] [DEBUG] [LOCAL ] MOV: Loaded 21325 existing records from primary storage. [2025-10-21T22:11:32.876558] [INFO ] [MAIN ] MOV: Loaded 21325 primary data records. [2025-10-21T22:11:33.940707] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:33.941823] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 43015 primary records. [2025-10-21T22:11:33.942011] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-10-21T22:11:33.966085] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-10-21T22:11:33.988527] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-10-21T22:11:34.001955] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:34.002858] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:34.005461] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53511 primary records. [2025-10-21T22:11:34.005626] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-10-21T22:11:34.004731] [INFO ] [MAIN ] Derivative Progress: 1165/2057 symbols completed. MOH took 1.4s. Estimated remaining: 5m 38s. Rate: 158.3 symbols/min [2025-10-21T22:11:34.006413] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 21325 primary records. [2025-10-21T22:11:34.006539] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:34.006757] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-10-21T22:11:34.048459] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-10-21T22:11:34.048373] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-10-21T22:11:34.048699] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-10-21T22:11:34.048579] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-10-21T22:11:34.051901] [INFO ] [MAIN ] Derivative Progress: 1166/2057 symbols completed. MOS took 1.4s. Estimated remaining: 5m 37s. Rate: 158.5 symbols/min [2025-10-21T22:11:34.055536] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:34.056307] [INFO ] [MAIN ] Derivative Progress: 1167/2057 symbols completed. MOV took 1.4s. Estimated remaining: 5m 37s. Rate: 158.6 symbols/min [2025-10-21T22:11:34.056831] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:34.065234] [DEBUG] [LOCAL ] MPA: Loaded 5218 existing records from primary storage. [2025-10-21T22:11:34.065529] [INFO ] [MAIN ] MPA: Loaded 5218 primary data records. [2025-10-21T22:11:34.251927] [DEBUG] [LOCAL ] MP: Loaded 53744 existing records from primary storage. [2025-10-21T22:11:34.308803] [INFO ] [MAIN ] MP: Loaded 53744 primary data records. [2025-10-21T22:11:34.548752] [DEBUG] [LOCAL ] MPC: Loaded 51933 existing records from primary storage. [2025-10-21T22:11:34.554508] [INFO ] [MAIN ] MPC: Loaded 51933 primary data records. [2025-10-21T22:11:35.113370] [DEBUG] [MAIN ] MPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:35.114805] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5218 primary records. [2025-10-21T22:11:35.115458] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-10-21T22:11:35.131543] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-10-21T22:11:35.132809] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-10-21T22:11:35.135019] [INFO ] [MAIN ] Derivative Progress: 1168/2057 symbols completed. MPA took 1.1s. Estimated remaining: 5m 37s. Rate: 158.3 symbols/min [2025-10-21T22:11:35.152775] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:35.153674] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53744 primary records. [2025-10-21T22:11:35.153775] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-10-21T22:11:35.186545] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-10-21T22:11:35.187059] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:35.187166] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-10-21T22:11:35.189601] [INFO ] [MAIN ] Derivative Progress: 1169/2057 symbols completed. MP took 1.2s. Estimated remaining: 5m 36s. Rate: 158.5 symbols/min [2025-10-21T22:11:35.190614] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 51933 primary records. [2025-10-21T22:11:35.190830] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-10-21T22:11:35.206120] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-10-21T22:11:35.206224] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-10-21T22:11:35.208817] [INFO ] [MAIN ] Derivative Progress: 1170/2057 symbols completed. MPC took 1.2s. Estimated remaining: 5m 36s. Rate: 158.6 symbols/min [2025-10-21T22:11:35.209414] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:35.209534] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:35.209599] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:35.218899] [DEBUG] [LOCAL ] MPV: Loaded 4372 existing records from primary storage. [2025-10-21T22:11:35.219063] [INFO ] [MAIN ] MPV: Loaded 4372 primary data records. [2025-10-21T22:11:35.609900] [DEBUG] [LOCAL ] MPW: Loaded 53486 existing records from primary storage. [2025-10-21T22:11:35.609802] [DEBUG] [LOCAL ] MPLX: Loaded 50784 existing records from primary storage. [2025-10-21T22:11:35.610203] [INFO ] [MAIN ] MPW: Loaded 53486 primary data records. [2025-10-21T22:11:35.610830] [INFO ] [MAIN ] MPLX: Loaded 50784 primary data records. [2025-10-21T22:11:36.243694] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:36.244922] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 4372 primary records. [2025-10-21T22:11:36.245119] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-10-21T22:11:36.262225] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-10-21T22:11:36.262545] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-10-21T22:11:36.265010] [INFO ] [MAIN ] Derivative Progress: 1171/2057 symbols completed. MPV took 1.1s. Estimated remaining: 5m 36s. Rate: 158.3 symbols/min [2025-10-21T22:11:36.265425] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:36.273297] [DEBUG] [LOCAL ] MPX: Loaded 3999 existing records from primary storage. [2025-10-21T22:11:36.273526] [INFO ] [MAIN ] MPX: Loaded 3999 primary data records. [2025-10-21T22:11:36.388059] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:36.404736] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:36.411886] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50784 primary records. [2025-10-21T22:11:36.404418] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53486 primary records. [2025-10-21T22:11:36.424381] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-10-21T22:11:36.425083] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-10-21T22:11:36.503576] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-10-21T22:11:36.522626] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-10-21T22:11:36.522360] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-10-21T22:11:36.540092] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-10-21T22:11:36.545120] [INFO ] [MAIN ] Derivative Progress: 1172/2057 symbols completed. MPW took 1.3s. Estimated remaining: 5m 35s. Rate: 158.4 symbols/min [2025-10-21T22:11:36.552234] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:36.552333] [INFO ] [MAIN ] Derivative Progress: 1173/2057 symbols completed. MPLX took 1.3s. Estimated remaining: 5m 35s. Rate: 158.5 symbols/min [2025-10-21T22:11:36.657473] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:36.678093] [DEBUG] [LOCAL ] MQT: Loaded 8058 existing records from primary storage. [2025-10-21T22:11:36.678479] [INFO ] [MAIN ] MQT: Loaded 8058 primary data records. [2025-10-21T22:11:36.806508] [DEBUG] [LOCAL ] MQY: Loaded 16629 existing records from primary storage. [2025-10-21T22:11:36.818147] [INFO ] [MAIN ] MQY: Loaded 16629 primary data records. [2025-10-21T22:11:37.144704] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:37.167415] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 3999 primary records. [2025-10-21T22:11:37.221934] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-10-21T22:11:37.402903] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-10-21T22:11:37.403198] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-10-21T22:11:37.405250] [INFO ] [MAIN ] Derivative Progress: 1174/2057 symbols completed. MPX took 1.1s. Estimated remaining: 5m 35s. Rate: 158.3 symbols/min [2025-10-21T22:11:37.406592] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:37.435001] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:37.436178] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8058 primary records. [2025-10-21T22:11:37.436474] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-10-21T22:11:37.475981] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-10-21T22:11:37.476388] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-10-21T22:11:37.476731] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:37.479735] [INFO ] [MAIN ] Derivative Progress: 1175/2057 symbols completed. MQT took 0.9s. Estimated remaining: 5m 34s. Rate: 158.5 symbols/min [2025-10-21T22:11:37.480752] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:37.480535] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16629 primary records. [2025-10-21T22:11:37.481457] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-10-21T22:11:37.508386] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-10-21T22:11:37.508551] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-10-21T22:11:37.512350] [DEBUG] [LOCAL ] MRC: Loaded 37214 existing records from primary storage. [2025-10-21T22:11:37.511266] [INFO ] [MAIN ] Derivative Progress: 1176/2057 symbols completed. MQY took 0.9s. Estimated remaining: 5m 33s. Rate: 158.6 symbols/min [2025-10-21T22:11:37.512554] [INFO ] [MAIN ] MRC: Loaded 37214 primary data records. [2025-10-21T22:11:37.512693] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:37.883779] [DEBUG] [LOCAL ] MRK: Loaded 53790 existing records from primary storage. [2025-10-21T22:11:37.884146] [INFO ] [MAIN ] MRK: Loaded 53790 primary data records. [2025-10-21T22:11:37.944092] [DEBUG] [LOCAL ] MS: Loaded 53688 existing records from primary storage. [2025-10-21T22:11:37.977629] [INFO ] [MAIN ] MS: Loaded 53688 primary data records. [2025-10-21T22:11:38.468993] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:38.529511] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37214 primary records. [2025-10-21T22:11:38.530250] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-10-21T22:11:38.549886] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-10-21T22:11:38.551001] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-10-21T22:11:38.553397] [INFO ] [MAIN ] Derivative Progress: 1177/2057 symbols completed. MRC took 1.1s. Estimated remaining: 5m 33s. Rate: 158.3 symbols/min [2025-10-21T22:11:38.553951] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:38.580369] [DEBUG] [LOCAL ] MSB: Loaded 7970 existing records from primary storage. [2025-10-21T22:11:38.581169] [INFO ] [MAIN ] MSB: Loaded 7970 primary data records. [2025-10-21T22:11:38.581095] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:38.593363] [INFO ] [MAIN ] MRK: Generated 1794 derivative records from 53790 primary records. [2025-10-21T22:11:38.593804] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-10-21T22:11:38.714134] [DEBUG] [LOCAL ] MRK: Derivative data saved (1794 records). [2025-10-21T22:11:38.720109] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-10-21T22:11:38.722693] [INFO ] [MAIN ] Derivative Progress: 1178/2057 symbols completed. MRK took 1.2s. Estimated remaining: 5m 33s. Rate: 158.4 symbols/min [2025-10-21T22:11:38.720001] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:38.723806] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53688 primary records. [2025-10-21T22:11:38.734309] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:38.740010] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-10-21T22:11:38.819416] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-10-21T22:11:38.934731] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-10-21T22:11:38.937855] [INFO ] [MAIN ] Derivative Progress: 1179/2057 symbols completed. MS took 1.4s. Estimated remaining: 5m 32s. Rate: 158.5 symbols/min [2025-10-21T22:11:38.938258] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:38.969335] [DEBUG] [LOCAL ] MSD: Loaded 16587 existing records from primary storage. [2025-10-21T22:11:38.969606] [INFO ] [MAIN ] MSD: Loaded 16587 primary data records. [2025-10-21T22:11:39.078970] [DEBUG] [LOCAL ] MSCI: Loaded 34327 existing records from primary storage. [2025-10-21T22:11:39.088826] [INFO ] [MAIN ] MSCI: Loaded 34327 primary data records. [2025-10-21T22:11:39.168119] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:39.174362] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7970 primary records. [2025-10-21T22:11:39.206968] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-10-21T22:11:39.730222] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-10-21T22:11:39.731001] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-10-21T22:11:39.733355] [INFO ] [MAIN ] Derivative Progress: 1180/2057 symbols completed. MSB took 1.2s. Estimated remaining: 5m 32s. Rate: 158.3 symbols/min [2025-10-21T22:11:39.733540] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:39.763765] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:39.764799] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 16587 primary records. [2025-10-21T22:11:39.776268] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-10-21T22:11:39.794436] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-10-21T22:11:39.794614] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-10-21T22:11:39.797638] [INFO ] [MAIN ] Derivative Progress: 1181/2057 symbols completed. MSD took 0.9s. Estimated remaining: 5m 32s. Rate: 158.4 symbols/min [2025-10-21T22:11:39.824492] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:39.825000] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:39.826696] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34327 primary records. [2025-10-21T22:11:39.826926] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-10-21T22:11:39.828009] [DEBUG] [LOCAL ] MSDL: Loaded 38655 existing records from primary storage. [2025-10-21T22:11:39.829006] [INFO ] [MAIN ] MSDL: Loaded 38655 primary data records. [2025-10-21T22:11:39.868598] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-10-21T22:11:39.879687] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-10-21T22:11:39.927750] [INFO ] [MAIN ] Derivative Progress: 1182/2057 symbols completed. MSCI took 1.2s. Estimated remaining: 5m 31s. Rate: 158.5 symbols/min [2025-10-21T22:11:39.950614] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:40.021323] [DEBUG] [LOCAL ] MSGE: Loaded 26990 existing records from primary storage. [2025-10-21T22:11:40.069849] [INFO ] [MAIN ] MSGE: Loaded 26990 primary data records. [2025-10-21T22:11:40.231371] [DEBUG] [LOCAL ] MSGS: Loaded 17296 existing records from primary storage. [2025-10-21T22:11:40.256359] [INFO ] [MAIN ] MSGS: Loaded 17296 primary data records. [2025-10-21T22:11:40.847736] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:40.850566] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38655 primary records. [2025-10-21T22:11:40.851334] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-10-21T22:11:40.874144] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-10-21T22:11:40.874489] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-10-21T22:11:40.876943] [INFO ] [MAIN ] Derivative Progress: 1183/2057 symbols completed. MSDL took 1.1s. Estimated remaining: 5m 31s. Rate: 158.3 symbols/min [2025-10-21T22:11:40.896523] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:40.898918] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 26990 primary records. [2025-10-21T22:11:40.899188] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-10-21T22:11:40.921745] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:40.925488] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 17296 primary records. [2025-10-21T22:11:40.925868] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-10-21T22:11:40.944987] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-10-21T22:11:40.945697] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-10-21T22:11:40.949163] [INFO ] [MAIN ] Derivative Progress: 1184/2057 symbols completed. MSGS took 1.0s. Estimated remaining: 5m 31s. Rate: 158.4 symbols/min [2025-10-21T22:11:40.950438] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-10-21T22:11:40.950502] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-10-21T22:11:40.953245] [INFO ] [MAIN ] Derivative Progress: 1185/2057 symbols completed. MSGE took 1.1s. Estimated remaining: 5m 30s. Rate: 158.6 symbols/min [2025-10-21T22:11:40.953721] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:40.953673] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:40.953841] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:41.004860] [DEBUG] [LOCAL ] MSM: Loaded 35438 existing records from primary storage. [2025-10-21T22:11:41.016220] [INFO ] [MAIN ] MSM: Loaded 35438 primary data records. [2025-10-21T22:11:41.102308] [DEBUG] [LOCAL ] MSI: Loaded 39735 existing records from primary storage. [2025-10-21T22:11:41.135389] [INFO ] [MAIN ] MSI: Loaded 39735 primary data records. [2025-10-21T22:11:41.248479] [DEBUG] [LOCAL ] MT: Loaded 50424 existing records from primary storage. [2025-10-21T22:11:41.274945] [INFO ] [MAIN ] MT: Loaded 50424 primary data records. [2025-10-21T22:11:42.078989] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:42.084855] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35438 primary records. [2025-10-21T22:11:42.086348] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:42.086013] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-10-21T22:11:42.087184] [INFO ] [MAIN ] MSI: Generated 1793 derivative records from 39735 primary records. [2025-10-21T22:11:42.087429] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-10-21T22:11:42.121824] [DEBUG] [LOCAL ] MSI: Derivative data saved (1793 records). [2025-10-21T22:11:42.120709] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-10-21T22:11:42.122079] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-10-21T22:11:42.124573] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-10-21T22:11:42.124491] [INFO ] [MAIN ] Derivative Progress: 1186/2057 symbols completed. MSI took 1.2s. Estimated remaining: 5m 30s. Rate: 158.3 symbols/min [2025-10-21T22:11:42.127155] [INFO ] [MAIN ] Derivative Progress: 1187/2057 symbols completed. MSM took 1.2s. Estimated remaining: 5m 30s. Rate: 158.4 symbols/min [2025-10-21T22:11:42.127055] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:42.127560] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:42.145881] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:42.146607] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50424 primary records. [2025-10-21T22:11:42.146739] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-10-21T22:11:42.167161] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-10-21T22:11:42.167398] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-10-21T22:11:42.170009] [INFO ] [MAIN ] Derivative Progress: 1188/2057 symbols completed. MT took 1.2s. Estimated remaining: 5m 29s. Rate: 158.5 symbols/min [2025-10-21T22:11:42.170281] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:42.177906] [DEBUG] [LOCAL ] MTD: Loaded 15275 existing records from primary storage. [2025-10-21T22:11:42.178043] [INFO ] [MAIN ] MTD: Loaded 15275 primary data records. [2025-10-21T22:11:42.405150] [DEBUG] [LOCAL ] MTB: Loaded 46648 existing records from primary storage. [2025-10-21T22:11:42.531562] [INFO ] [MAIN ] MTB: Loaded 46648 primary data records. [2025-10-21T22:11:42.653903] [DEBUG] [LOCAL ] MTDR: Loaded 51762 existing records from primary storage. [2025-10-21T22:11:42.654200] [INFO ] [MAIN ] MTDR: Loaded 51762 primary data records. [2025-10-21T22:11:43.201187] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:43.202911] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15275 primary records. [2025-10-21T22:11:43.203404] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-10-21T22:11:43.233397] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-10-21T22:11:43.246846] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-10-21T22:11:43.247291] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:43.248200] [INFO ] [MAIN ] MTB: Generated 1793 derivative records from 46648 primary records. [2025-10-21T22:11:43.251085] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-10-21T22:11:43.250978] [INFO ] [MAIN ] Derivative Progress: 1189/2057 symbols completed. MTD took 1.1s. Estimated remaining: 5m 29s. Rate: 158.3 symbols/min [2025-10-21T22:11:43.251478] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:43.268929] [DEBUG] [LOCAL ] MTB: Derivative data saved (1793 records). [2025-10-21T22:11:43.269975] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-10-21T22:11:43.272988] [INFO ] [MAIN ] Derivative Progress: 1190/2057 symbols completed. MTB took 1.1s. Estimated remaining: 5m 28s. Rate: 158.4 symbols/min [2025-10-21T22:11:43.273248] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:43.289535] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:43.290304] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51762 primary records. [2025-10-21T22:11:43.290475] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-10-21T22:11:43.308995] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-10-21T22:11:43.309241] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-10-21T22:11:43.312047] [INFO ] [MAIN ] Derivative Progress: 1191/2057 symbols completed. MTDR took 1.1s. Estimated remaining: 5m 28s. Rate: 158.5 symbols/min [2025-10-21T22:11:43.312497] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:43.378452] [DEBUG] [LOCAL ] MTG: Loaded 51078 existing records from primary storage. [2025-10-21T22:11:43.388380] [INFO ] [MAIN ] MTG: Loaded 51078 primary data records. [2025-10-21T22:11:43.389061] [DEBUG] [LOCAL ] MTH: Loaded 43836 existing records from primary storage. [2025-10-21T22:11:43.410013] [INFO ] [MAIN ] MTH: Loaded 43836 primary data records. [2025-10-21T22:11:43.546363] [DEBUG] [LOCAL ] MTN: Loaded 39441 existing records from primary storage. [2025-10-21T22:11:43.560691] [INFO ] [MAIN ] MTN: Loaded 39441 primary data records. [2025-10-21T22:11:44.382471] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:44.383962] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51078 primary records. [2025-10-21T22:11:44.384291] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-10-21T22:11:44.403519] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-10-21T22:11:44.403699] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-10-21T22:11:44.405614] [INFO ] [MAIN ] Derivative Progress: 1192/2057 symbols completed. MTG took 1.2s. Estimated remaining: 5m 28s. Rate: 158.3 symbols/min [2025-10-21T22:11:44.406037] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:44.421345] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:44.422872] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43836 primary records. [2025-10-21T22:11:44.423105] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-10-21T22:11:44.445028] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:44.451503] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 39441 primary records. [2025-10-21T22:11:44.451678] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-10-21T22:11:44.452623] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-10-21T22:11:44.453068] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-10-21T22:11:44.459398] [INFO ] [MAIN ] Derivative Progress: 1193/2057 symbols completed. MTH took 1.2s. Estimated remaining: 5m 27s. Rate: 158.4 symbols/min [2025-10-21T22:11:44.459602] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:44.482496] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-10-21T22:11:44.482670] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-10-21T22:11:44.482986] [DEBUG] [LOCAL ] MTRN: Loaded 18253 existing records from primary storage. [2025-10-21T22:11:44.485605] [INFO ] [MAIN ] Derivative Progress: 1194/2057 symbols completed. MTN took 1.2s. Estimated remaining: 5m 27s. Rate: 158.5 symbols/min [2025-10-21T22:11:44.485914] [INFO ] [MAIN ] MTRN: Loaded 18253 primary data records. [2025-10-21T22:11:44.486042] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:44.792283] [DEBUG] [LOCAL ] MTUS: Loaded 27534 existing records from primary storage. [2025-10-21T22:11:44.809947] [INFO ] [MAIN ] MTUS: Loaded 27534 primary data records. [2025-10-21T22:11:44.809860] [DEBUG] [LOCAL ] MTW: Loaded 26484 existing records from primary storage. [2025-10-21T22:11:44.810134] [INFO ] [MAIN ] MTW: Loaded 26484 primary data records. [2025-10-21T22:11:45.478542] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:45.479529] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 18253 primary records. [2025-10-21T22:11:45.480242] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-10-21T22:11:45.497964] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-10-21T22:11:45.498426] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-10-21T22:11:45.500814] [INFO ] [MAIN ] Derivative Progress: 1195/2057 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 27s. Rate: 158.3 symbols/min [2025-10-21T22:11:45.501071] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:45.528125] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:45.533759] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 27534 primary records. [2025-10-21T22:11:45.533880] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-10-21T22:11:45.534400] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:45.535994] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26484 primary records. [2025-10-21T22:11:45.541517] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-10-21T22:11:45.557633] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-10-21T22:11:45.557838] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-10-21T22:11:45.560305] [INFO ] [MAIN ] Derivative Progress: 1196/2057 symbols completed. MTUS took 1.1s. Estimated remaining: 5m 26s. Rate: 158.4 symbols/min [2025-10-21T22:11:45.567392] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:45.577038] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-10-21T22:11:45.577278] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-10-21T22:11:45.586438] [INFO ] [MAIN ] Derivative Progress: 1197/2057 symbols completed. MTW took 1.1s. Estimated remaining: 5m 25s. Rate: 158.5 symbols/min [2025-10-21T22:11:45.588160] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:45.588033] [DEBUG] [LOCAL ] MTX: Loaded 22671 existing records from primary storage. [2025-10-21T22:11:45.588801] [INFO ] [MAIN ] MTX: Loaded 22671 primary data records. [2025-10-21T22:11:45.754804] [DEBUG] [LOCAL ] MUA: Loaded 11519 existing records from primary storage. [2025-10-21T22:11:45.782992] [INFO ] [MAIN ] MUA: Loaded 11519 primary data records. [2025-10-21T22:11:45.982706] [DEBUG] [LOCAL ] MTZ: Loaded 42780 existing records from primary storage. [2025-10-21T22:11:45.994623] [INFO ] [MAIN ] MTZ: Loaded 42780 primary data records. [2025-10-21T22:11:46.522336] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:46.523430] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22671 primary records. [2025-10-21T22:11:46.524323] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-10-21T22:11:46.542290] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-10-21T22:11:46.543198] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-10-21T22:11:46.545469] [INFO ] [MAIN ] Derivative Progress: 1198/2057 symbols completed. MTX took 1.0s. Estimated remaining: 5m 26s. Rate: 158.3 symbols/min [2025-10-21T22:11:46.565815] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:46.566679] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 11519 primary records. [2025-10-21T22:11:46.566860] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-10-21T22:11:46.584323] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-10-21T22:11:46.585039] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-10-21T22:11:46.587154] [INFO ] [MAIN ] Derivative Progress: 1199/2057 symbols completed. MUA took 1.0s. Estimated remaining: 5m 25s. Rate: 158.4 symbols/min [2025-10-21T22:11:46.599753] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:46.600379] [INFO ] [MAIN ] MTZ: Generated 1793 derivative records from 42780 primary records. [2025-10-21T22:11:46.600438] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-10-21T22:11:46.615807] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1793 records). [2025-10-21T22:11:46.615923] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-10-21T22:11:46.618719] [INFO ] [MAIN ] Derivative Progress: 1200/2057 symbols completed. MTZ took 1.1s. Estimated remaining: 5m 24s. Rate: 158.6 symbols/min [2025-10-21T22:11:46.619205] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:46.619409] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:46.619329] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:46.640597] [DEBUG] [LOCAL ] MUE: Loaded 12251 existing records from primary storage. [2025-10-21T22:11:46.640945] [INFO ] [MAIN ] MUE: Loaded 12251 primary data records. [2025-10-21T22:11:46.741179] [DEBUG] [LOCAL ] MUC: Loaded 20743 existing records from primary storage. [2025-10-21T22:11:46.752116] [INFO ] [MAIN ] MUC: Loaded 20743 primary data records. [2025-10-21T22:11:47.097197] [DEBUG] [LOCAL ] MUFG: Loaded 52435 existing records from primary storage. [2025-10-21T22:11:47.129868] [INFO ] [MAIN ] MUFG: Loaded 52435 primary data records. [2025-10-21T22:11:47.698272] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:47.697292] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:47.699286] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20743 primary records. [2025-10-21T22:11:47.699384] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-10-21T22:11:47.700427] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 12251 primary records. [2025-10-21T22:11:47.700758] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-10-21T22:11:47.724094] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-10-21T22:11:47.724305] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-10-21T22:11:47.732633] [INFO ] [MAIN ] Derivative Progress: 1201/2057 symbols completed. MUC took 1.1s. Estimated remaining: 5m 24s. Rate: 158.3 symbols/min [2025-10-21T22:11:47.733611] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-10-21T22:11:47.734582] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-10-21T22:11:47.733041] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:47.737185] [INFO ] [MAIN ] Derivative Progress: 1202/2057 symbols completed. MUE took 1.1s. Estimated remaining: 5m 24s. Rate: 158.4 symbols/min [2025-10-21T22:11:47.737892] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:47.754869] [DEBUG] [LOCAL ] MUJ: Loaded 13883 existing records from primary storage. [2025-10-21T22:11:47.755088] [INFO ] [MAIN ] MUJ: Loaded 13883 primary data records. [2025-10-21T22:11:47.824509] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:47.863019] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52435 primary records. [2025-10-21T22:11:47.873975] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-10-21T22:11:48.095847] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-10-21T22:11:48.096112] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-10-21T22:11:48.099210] [INFO ] [MAIN ] Derivative Progress: 1203/2057 symbols completed. MUFG took 1.5s. Estimated remaining: 5m 23s. Rate: 158.4 symbols/min [2025-10-21T22:11:48.099412] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:48.119877] [DEBUG] [LOCAL ] MUR: Loaded 52868 existing records from primary storage. [2025-10-21T22:11:48.120117] [INFO ] [MAIN ] MUR: Loaded 52868 primary data records. [2025-10-21T22:11:48.316060] [DEBUG] [LOCAL ] MUSA: Loaded 24642 existing records from primary storage. [2025-10-21T22:11:48.334419] [INFO ] [MAIN ] MUSA: Loaded 24642 primary data records. [2025-10-21T22:11:48.421608] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:48.522971] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13883 primary records. [2025-10-21T22:11:48.563166] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-10-21T22:11:48.793931] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-10-21T22:11:48.794356] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-10-21T22:11:48.797197] [INFO ] [MAIN ] Derivative Progress: 1204/2057 symbols completed. MUJ took 1.1s. Estimated remaining: 5m 23s. Rate: 158.3 symbols/min [2025-10-21T22:11:48.798396] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:48.825429] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:48.826414] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52868 primary records. [2025-10-21T22:11:48.826570] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-10-21T22:11:48.856430] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-10-21T22:11:48.857442] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-10-21T22:11:48.860930] [INFO ] [MAIN ] Derivative Progress: 1205/2057 symbols completed. MUR took 1.1s. Estimated remaining: 5m 23s. Rate: 158.4 symbols/min [2025-10-21T22:11:48.861576] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:48.877162] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:48.891338] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 24642 primary records. [2025-10-21T22:11:48.891492] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-10-21T22:11:48.896284] [DEBUG] [LOCAL ] MUX: Loaded 43793 existing records from primary storage. [2025-10-21T22:11:48.908124] [INFO ] [MAIN ] MUX: Loaded 43793 primary data records. [2025-10-21T22:11:48.912474] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-10-21T22:11:48.924585] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-10-21T22:11:48.962980] [INFO ] [MAIN ] Derivative Progress: 1206/2057 symbols completed. MUSA took 0.9s. Estimated remaining: 5m 22s. Rate: 158.5 symbols/min [2025-10-21T22:11:48.991080] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:49.006172] [DEBUG] [LOCAL ] MVF: Loaded 12684 existing records from primary storage. [2025-10-21T22:11:49.016793] [INFO ] [MAIN ] MVF: Loaded 12684 primary data records. [2025-10-21T22:11:49.229123] [DEBUG] [LOCAL ] MVO: Loaded 8969 existing records from primary storage. [2025-10-21T22:11:49.307776] [INFO ] [MAIN ] MVO: Loaded 8969 primary data records. [2025-10-21T22:11:49.926201] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:49.927503] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 43793 primary records. [2025-10-21T22:11:49.927602] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-10-21T22:11:49.947068] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-10-21T22:11:49.947328] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-10-21T22:11:49.949571] [INFO ] [MAIN ] Derivative Progress: 1207/2057 symbols completed. MUX took 1.2s. Estimated remaining: 5m 22s. Rate: 158.3 symbols/min [2025-10-21T22:11:49.949872] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:49.963772] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:49.964454] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12684 primary records. [2025-10-21T22:11:49.964663] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-10-21T22:11:49.982961] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-10-21T22:11:49.987432] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-10-21T22:11:49.990163] [INFO ] [MAIN ] Derivative Progress: 1208/2057 symbols completed. MVF took 1.1s. Estimated remaining: 5m 21s. Rate: 158.4 symbols/min [2025-10-21T22:11:49.990488] [DEBUG] [LOCAL ] MVT: Loaded 9911 existing records from primary storage. [2025-10-21T22:11:49.992414] [INFO ] [MAIN ] MVT: Loaded 9911 primary data records. [2025-10-21T22:11:49.993198] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:50.085929] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:50.113174] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 8969 primary records. [2025-10-21T22:11:50.126469] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-10-21T22:11:50.333999] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-10-21T22:11:50.342290] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-10-21T22:11:50.344600] [INFO ] [MAIN ] Derivative Progress: 1209/2057 symbols completed. MVO took 1.4s. Estimated remaining: 5m 21s. Rate: 158.5 symbols/min [2025-10-21T22:11:50.344832] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:50.364593] [DEBUG] [LOCAL ] MWA: Loaded 45796 existing records from primary storage. [2025-10-21T22:11:50.364986] [INFO ] [MAIN ] MWA: Loaded 45796 primary data records. [2025-10-21T22:11:50.495411] [DEBUG] [LOCAL ] MX: Loaded 22280 existing records from primary storage. [2025-10-21T22:11:50.521550] [INFO ] [MAIN ] MX: Loaded 22280 primary data records. [2025-10-21T22:11:50.855965] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:50.894009] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 9911 primary records. [2025-10-21T22:11:50.894454] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-10-21T22:11:51.047073] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-10-21T22:11:51.048953] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-10-21T22:11:51.051837] [INFO ] [MAIN ] Derivative Progress: 1210/2057 symbols completed. MVT took 1.1s. Estimated remaining: 5m 21s. Rate: 158.3 symbols/min [2025-10-21T22:11:51.052416] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:51.065180] [DEBUG] [LOCAL ] MXF: Loaded 5492 existing records from primary storage. [2025-10-21T22:11:51.071460] [INFO ] [MAIN ] MXF: Loaded 5492 primary data records. [2025-10-21T22:11:51.162244] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:51.198376] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 45796 primary records. [2025-10-21T22:11:51.205111] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-10-21T22:11:51.294681] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:51.464533] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22280 primary records. [2025-10-21T22:11:51.478159] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-10-21T22:11:51.498557] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-10-21T22:11:51.499425] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-10-21T22:11:51.502716] [INFO ] [MAIN ] Derivative Progress: 1211/2057 symbols completed. MWA took 1.5s. Estimated remaining: 5m 21s. Rate: 158.3 symbols/min [2025-10-21T22:11:51.504317] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:51.509317] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-10-21T22:11:51.509570] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-10-21T22:11:51.512024] [INFO ] [MAIN ] Derivative Progress: 1212/2057 symbols completed. MX took 1.2s. Estimated remaining: 5m 20s. Rate: 158.4 symbols/min [2025-10-21T22:11:51.512331] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:51.526100] [DEBUG] [LOCAL ] MYD: Loaded 13209 existing records from primary storage. [2025-10-21T22:11:51.527808] [INFO ] [MAIN ] MYD: Loaded 13209 primary data records. [2025-10-21T22:11:51.643203] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:51.655282] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 5492 primary records. [2025-10-21T22:11:51.661479] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-10-21T22:11:51.729809] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-10-21T22:11:51.729727] [DEBUG] [LOCAL ] MYE: Loaded 24090 existing records from primary storage. [2025-10-21T22:11:51.737307] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-10-21T22:11:51.756852] [INFO ] [MAIN ] Derivative Progress: 1213/2057 symbols completed. MXF took 0.7s. Estimated remaining: 5m 20s. Rate: 158.5 symbols/min [2025-10-21T22:11:51.761762] [INFO ] [MAIN ] MYE: Loaded 24090 primary data records. [2025-10-21T22:11:52.229929] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:52.230846] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13209 primary records. [2025-10-21T22:11:52.231547] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-10-21T22:11:52.249303] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-10-21T22:11:52.249524] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-10-21T22:11:52.251882] [INFO ] [MAIN ] Derivative Progress: 1214/2057 symbols completed. MYD took 0.7s. Estimated remaining: 5m 19s. Rate: 158.5 symbols/min [2025-10-21T22:11:52.271581] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:52.272223] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 24090 primary records. [2025-10-21T22:11:52.272283] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-10-21T22:11:52.288072] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-10-21T22:11:52.288135] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-10-21T22:11:52.290672] [INFO ] [MAIN ] Derivative Progress: 1215/2057 symbols completed. MYE took 0.8s. Estimated remaining: 5m 19s. Rate: 158.6 symbols/min [2025-10-21T22:11:52.291130] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:52.291269] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:52.291834] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:52.303779] [DEBUG] [LOCAL ] MYN: Loaded 9986 existing records from primary storage. [2025-10-21T22:11:52.303896] [INFO ] [MAIN ] MYN: Loaded 9986 primary data records. [2025-10-21T22:11:52.430683] [DEBUG] [LOCAL ] MYI: Loaded 19113 existing records from primary storage. [2025-10-21T22:11:52.436765] [INFO ] [MAIN ] MYI: Loaded 19113 primary data records. [2025-10-21T22:11:52.558751] [DEBUG] [LOCAL ] NABL: Loaded 39022 existing records from primary storage. [2025-10-21T22:11:52.613046] [INFO ] [MAIN ] NABL: Loaded 39022 primary data records. [2025-10-21T22:11:53.287209] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:53.288180] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 9986 primary records. [2025-10-21T22:11:53.289879] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-10-21T22:11:53.318727] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-10-21T22:11:53.319166] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-10-21T22:11:53.321292] [INFO ] [MAIN ] Derivative Progress: 1216/2057 symbols completed. MYN took 1.0s. Estimated remaining: 5m 19s. Rate: 158.3 symbols/min [2025-10-21T22:11:53.321535] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:53.322413] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:53.323212] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19113 primary records. [2025-10-21T22:11:53.323425] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-10-21T22:11:53.347470] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-10-21T22:11:53.347598] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-10-21T22:11:53.350337] [INFO ] [MAIN ] Derivative Progress: 1217/2057 symbols completed. MYI took 1.1s. Estimated remaining: 5m 18s. Rate: 158.5 symbols/min [2025-10-21T22:11:53.358109] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:53.363845] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:53.364586] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 39022 primary records. [2025-10-21T22:11:53.364833] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-10-21T22:11:53.388427] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-10-21T22:11:53.389066] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-10-21T22:11:53.391394] [INFO ] [MAIN ] Derivative Progress: 1218/2057 symbols completed. NABL took 1.1s. Estimated remaining: 5m 17s. Rate: 158.6 symbols/min [2025-10-21T22:11:53.388943] [DEBUG] [LOCAL ] NAC: Loaded 24420 existing records from primary storage. [2025-10-21T22:11:53.391676] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:53.391576] [INFO ] [MAIN ] NAC: Loaded 24420 primary data records. [2025-10-21T22:11:53.510221] [DEBUG] [LOCAL ] NAN: Loaded 8463 existing records from primary storage. [2025-10-21T22:11:53.547274] [INFO ] [MAIN ] NAN: Loaded 8463 primary data records. [2025-10-21T22:11:53.578207] [DEBUG] [LOCAL ] NAD: Loaded 33724 existing records from primary storage. [2025-10-21T22:11:53.636995] [INFO ] [MAIN ] NAD: Loaded 33724 primary data records. [2025-10-21T22:11:54.412605] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:54.414132] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24420 primary records. [2025-10-21T22:11:54.414460] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-10-21T22:11:54.434818] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-10-21T22:11:54.435310] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-10-21T22:11:54.437785] [INFO ] [MAIN ] Derivative Progress: 1219/2057 symbols completed. NAC took 1.1s. Estimated remaining: 5m 18s. Rate: 158.4 symbols/min [2025-10-21T22:11:54.437944] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:54.452487] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:54.453475] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 8463 primary records. [2025-10-21T22:11:54.453677] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-10-21T22:11:54.471439] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-10-21T22:11:54.471736] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-10-21T22:11:54.474291] [INFO ] [MAIN ] Derivative Progress: 1220/2057 symbols completed. NAN took 1.1s. Estimated remaining: 5m 17s. Rate: 158.5 symbols/min [2025-10-21T22:11:54.474789] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:54.493414] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:54.494392] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 33724 primary records. [2025-10-21T22:11:54.494473] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-10-21T22:11:54.523850] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-10-21T22:11:54.524027] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-10-21T22:11:54.526990] [INFO ] [MAIN ] Derivative Progress: 1221/2057 symbols completed. NAD took 1.2s. Estimated remaining: 5m 16s. Rate: 158.6 symbols/min [2025-10-21T22:11:54.528172] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:54.551575] [DEBUG] [LOCAL ] NAT: Loaded 49231 existing records from primary storage. [2025-10-21T22:11:54.551921] [INFO ] [MAIN ] NAT: Loaded 49231 primary data records. [2025-10-21T22:11:54.614242] [DEBUG] [LOCAL ] NAZ: Loaded 2684 existing records from primary storage. [2025-10-21T22:11:54.657392] [INFO ] [MAIN ] NAZ: Loaded 2684 primary data records. [2025-10-21T22:11:54.681573] [DEBUG] [LOCAL ] NATL: Loaded 32251 existing records from primary storage. [2025-10-21T22:11:54.735339] [INFO ] [MAIN ] NATL: Loaded 32251 primary data records. [2025-10-21T22:11:55.644955] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:55.646056] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49231 primary records. [2025-10-21T22:11:55.646239] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-10-21T22:11:55.667532] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:55.675936] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-10-21T22:11:55.676955] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2684 primary records. [2025-10-21T22:11:55.677153] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-10-21T22:11:55.676148] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-10-21T22:11:55.680238] [INFO ] [MAIN ] Derivative Progress: 1222/2057 symbols completed. NAT took 1.2s. Estimated remaining: 5m 16s. Rate: 158.3 symbols/min [2025-10-21T22:11:55.680619] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:55.697696] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-10-21T22:11:55.698064] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-10-21T22:11:55.700728] [INFO ] [MAIN ] Derivative Progress: 1223/2057 symbols completed. NAZ took 1.2s. Estimated remaining: 5m 16s. Rate: 158.4 symbols/min [2025-10-21T22:11:55.703434] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:55.718191] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:55.718965] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32251 primary records. [2025-10-21T22:11:55.723329] [DEBUG] [LOCAL ] NBB: Loaded 9040 existing records from primary storage. [2025-10-21T22:11:55.723513] [INFO ] [MAIN ] NBB: Loaded 9040 primary data records. [2025-10-21T22:11:55.729005] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-10-21T22:11:55.866499] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-10-21T22:11:55.880626] [DEBUG] [LOCAL ] NBHC: Loaded 23749 existing records from primary storage. [2025-10-21T22:11:55.880758] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-10-21T22:11:55.880864] [INFO ] [MAIN ] NBHC: Loaded 23749 primary data records. [2025-10-21T22:11:55.883596] [INFO ] [MAIN ] Derivative Progress: 1224/2057 symbols completed. NATL took 1.4s. Estimated remaining: 5m 15s. Rate: 158.5 symbols/min [2025-10-21T22:11:55.974712] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:56.429905] [DEBUG] [LOCAL ] NBR: Loaded 34506 existing records from primary storage. [2025-10-21T22:11:56.430328] [INFO ] [MAIN ] NBR: Loaded 34506 primary data records. [2025-10-21T22:11:56.555451] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:56.577435] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 9040 primary records. [2025-10-21T22:11:56.582752] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-10-21T22:11:56.791743] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:56.792522] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 23749 primary records. [2025-10-21T22:11:56.793445] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-10-21T22:11:56.791347] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-10-21T22:11:56.793842] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-10-21T22:11:56.796081] [INFO ] [MAIN ] Derivative Progress: 1225/2057 symbols completed. NBB took 1.1s. Estimated remaining: 5m 15s. Rate: 158.3 symbols/min [2025-10-21T22:11:56.797047] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:56.813999] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-10-21T22:11:56.814125] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-10-21T22:11:56.816638] [INFO ] [MAIN ] Derivative Progress: 1226/2057 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 15s. Rate: 158.4 symbols/min [2025-10-21T22:11:56.817993] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:56.828415] [DEBUG] [LOCAL ] NC: Loaded 2007 existing records from primary storage. [2025-10-21T22:11:56.828840] [INFO ] [MAIN ] NC: Loaded 2007 primary data records. [2025-10-21T22:11:56.890572] [DEBUG] [LOCAL ] NBXG: Loaded 21795 existing records from primary storage. [2025-10-21T22:11:56.909429] [INFO ] [MAIN ] NBXG: Loaded 21795 primary data records. [2025-10-21T22:11:57.024147] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:11:57.052699] [INFO ] [MAIN ] NBR: Generated 1793 derivative records from 34506 primary records. [2025-10-21T22:11:57.075067] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-10-21T22:11:57.354471] [DEBUG] [LOCAL ] NBR: Derivative data saved (1793 records). [2025-10-21T22:11:57.355124] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-10-21T22:11:57.374170] [INFO ] [MAIN ] Derivative Progress: 1227/2057 symbols completed. NBR took 1.4s. Estimated remaining: 5m 14s. Rate: 158.4 symbols/min [2025-10-21T22:11:57.379591] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:57.554489] [DEBUG] [LOCAL ] NCA: Loaded 9809 existing records from primary storage. [2025-10-21T22:11:57.555253] [INFO ] [MAIN ] NCA: Loaded 9809 primary data records. [2025-10-21T22:11:57.725154] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:57.761906] [INFO ] [MAIN ] NC: Generated 1794 derivative records from 2007 primary records. [2025-10-21T22:11:57.767481] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-10-21T22:11:57.898074] [DEBUG] [LOCAL ] NC: Derivative data saved (1794 records). [2025-10-21T22:11:57.898981] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-10-21T22:11:57.901427] [INFO ] [MAIN ] Derivative Progress: 1228/2057 symbols completed. NC took 1.1s. Estimated remaining: 5m 14s. Rate: 158.3 symbols/min [2025-10-21T22:11:57.916241] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:57.917271] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 21795 primary records. [2025-10-21T22:11:57.917348] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-10-21T22:11:57.934197] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-10-21T22:11:57.934879] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-10-21T22:11:57.937492] [INFO ] [MAIN ] Derivative Progress: 1229/2057 symbols completed. NBXG took 1.1s. Estimated remaining: 5m 14s. Rate: 158.4 symbols/min [2025-10-21T22:11:57.955381] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:57.955958] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 9809 primary records. [2025-10-21T22:11:57.956017] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-10-21T22:11:57.970079] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-10-21T22:11:57.970134] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-10-21T22:11:57.972670] [INFO ] [MAIN ] Derivative Progress: 1230/2057 symbols completed. NCA took 0.6s. Estimated remaining: 5m 13s. Rate: 158.6 symbols/min [2025-10-21T22:11:57.973241] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:57.973394] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:57.973350] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:57.989967] [DEBUG] [LOCAL ] NCV: Loaded 13917 existing records from primary storage. [2025-10-21T22:11:57.994488] [INFO ] [MAIN ] NCV: Loaded 13917 primary data records. [2025-10-21T22:11:58.102834] [DEBUG] [LOCAL ] NCDL: Loaded 21701 existing records from primary storage. [2025-10-21T22:11:58.125427] [INFO ] [MAIN ] NCDL: Loaded 21701 primary data records. [2025-10-21T22:11:58.439756] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-10-21T22:11:58.445511] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-10-21T22:11:58.967079] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:58.968342] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13917 primary records. [2025-10-21T22:11:58.968448] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-10-21T22:11:59.002881] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:58.997605] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-10-21T22:11:59.003060] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-10-21T22:11:59.006323] [INFO ] [MAIN ] Derivative Progress: 1231/2057 symbols completed. NCV took 1.0s. Estimated remaining: 5m 13s. Rate: 158.3 symbols/min [2025-10-21T22:11:59.003773] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21701 primary records. [2025-10-21T22:11:59.006525] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:59.007341] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-10-21T22:11:59.024255] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-10-21T22:11:59.024923] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-10-21T22:11:59.027147] [INFO ] [MAIN ] Derivative Progress: 1232/2057 symbols completed. NCDL took 1.1s. Estimated remaining: 5m 12s. Rate: 158.5 symbols/min [2025-10-21T22:11:59.032225] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:59.052433] [DEBUG] [LOCAL ] NCZ: Loaded 12305 existing records from primary storage. [2025-10-21T22:11:59.052948] [INFO ] [MAIN ] NCZ: Loaded 12305 primary data records. [2025-10-21T22:11:59.052795] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:59.053680] [INFO ] [MAIN ] NCLH: Generated 1794 derivative records from 53753 primary records. [2025-10-21T22:11:59.078471] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-10-21T22:11:59.201475] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1794 records). [2025-10-21T22:11:59.202037] [DEBUG] [LOCAL ] NDMO: Loaded 16942 existing records from primary storage. [2025-10-21T22:11:59.216217] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-10-21T22:11:59.230757] [INFO ] [MAIN ] Derivative Progress: 1233/2057 symbols completed. NCLH took 1.3s. Estimated remaining: 5m 12s. Rate: 158.5 symbols/min [2025-10-21T22:11:59.227704] [INFO ] [MAIN ] NDMO: Loaded 16942 primary data records. [2025-10-21T22:11:59.231021] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:11:59.817965] [DEBUG] [LOCAL ] NE: Loaded 52323 existing records from primary storage. [2025-10-21T22:11:59.818423] [INFO ] [MAIN ] NE: Loaded 52323 primary data records. [2025-10-21T22:11:59.885442] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:11:59.906203] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 12305 primary records. [2025-10-21T22:11:59.911683] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-10-21T22:11:59.976677] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-10-21T22:12:00.009370] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-10-21T22:12:00.033062] [INFO ] [MAIN ] Derivative Progress: 1234/2057 symbols completed. NCZ took 1.0s. Estimated remaining: 5m 12s. Rate: 158.4 symbols/min [2025-10-21T22:12:00.165584] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:00.166670] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:00.167474] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16942 primary records. [2025-10-21T22:12:00.167574] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-10-21T22:12:00.189176] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-10-21T22:12:00.191004] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-10-21T22:12:00.194301] [INFO ] [MAIN ] Derivative Progress: 1235/2057 symbols completed. NDMO took 1.2s. Estimated remaining: 5m 11s. Rate: 158.5 symbols/min [2025-10-21T22:12:00.195120] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:00.222674] [DEBUG] [LOCAL ] NEA: Loaded 35149 existing records from primary storage. [2025-10-21T22:12:00.235612] [INFO ] [MAIN ] NEA: Loaded 35149 primary data records. [2025-10-21T22:12:00.236218] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:00.242236] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52323 primary records. [2025-10-21T22:12:00.242442] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-10-21T22:12:00.350865] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-10-21T22:12:00.362108] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-10-21T22:12:00.378097] [INFO ] [MAIN ] Derivative Progress: 1236/2057 symbols completed. NE took 1.1s. Estimated remaining: 5m 11s. Rate: 158.5 symbols/min [2025-10-21T22:12:00.394053] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:00.592291] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-10-21T22:12:00.592752] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-10-21T22:12:00.945066] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:00.946802] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-10-21T22:12:00.947781] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-10-21T22:12:00.947630] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35149 primary records. [2025-10-21T22:12:00.968897] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-10-21T22:12:01.045584] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-10-21T22:12:01.064376] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-10-21T22:12:01.081369] [INFO ] [MAIN ] Derivative Progress: 1237/2057 symbols completed. NEA took 0.9s. Estimated remaining: 5m 11s. Rate: 158.4 symbols/min [2025-10-21T22:12:01.086847] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:01.286698] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:01.288469] [INFO ] [MAIN ] NEE: Generated 1794 derivative records from 53707 primary records. [2025-10-21T22:12:01.289104] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-10-21T22:12:01.325113] [DEBUG] [LOCAL ] NEE: Derivative data saved (1794 records). [2025-10-21T22:12:01.325498] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-10-21T22:12:01.328451] [INFO ] [MAIN ] Derivative Progress: 1238/2057 symbols completed. NEE took 1.1s. Estimated remaining: 5m 10s. Rate: 158.5 symbols/min [2025-10-21T22:12:01.329044] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:01.366433] [DEBUG] [LOCAL ] NET: Loaded 52821 existing records from primary storage. [2025-10-21T22:12:01.367423] [INFO ] [MAIN ] NET: Loaded 52821 primary data records. [2025-10-21T22:12:01.367292] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:01.368412] [INFO ] [MAIN ] NEM: Generated 1794 derivative records from 53708 primary records. [2025-10-21T22:12:01.373691] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-10-21T22:12:01.395241] [DEBUG] [LOCAL ] NEU: Loaded 8639 existing records from primary storage. [2025-10-21T22:12:01.395389] [INFO ] [MAIN ] NEU: Loaded 8639 primary data records. [2025-10-21T22:12:01.607038] [DEBUG] [LOCAL ] NEM: Derivative data saved (1794 records). [2025-10-21T22:12:01.623088] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-10-21T22:12:01.631160] [INFO ] [MAIN ] Derivative Progress: 1239/2057 symbols completed. NEM took 1.2s. Estimated remaining: 5m 10s. Rate: 158.5 symbols/min [2025-10-21T22:12:01.646926] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:02.050710] [DEBUG] [LOCAL ] NEXA: Loaded 5576 existing records from primary storage. [2025-10-21T22:12:02.051115] [INFO ] [MAIN ] NEXA: Loaded 5576 primary data records. [2025-10-21T22:12:02.390126] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:02.392530] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 52821 primary records. [2025-10-21T22:12:02.392755] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-10-21T22:12:02.424042] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:02.423675] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-10-21T22:12:02.424947] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8639 primary records. [2025-10-21T22:12:02.425219] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-10-21T22:12:02.425679] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-10-21T22:12:02.438777] [INFO ] [MAIN ] Derivative Progress: 1240/2057 symbols completed. NET took 1.4s. Estimated remaining: 5m 10s. Rate: 158.3 symbols/min [2025-10-21T22:12:02.440415] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:02.444210] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-10-21T22:12:02.444344] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-10-21T22:12:02.446566] [INFO ] [MAIN ] Derivative Progress: 1241/2057 symbols completed. NEU took 1.1s. Estimated remaining: 5m 9s. Rate: 158.5 symbols/min [2025-10-21T22:12:02.447005] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:02.464998] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:02.465692] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 5576 primary records. [2025-10-21T22:12:02.465896] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-10-21T22:12:02.485552] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-10-21T22:12:02.485814] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-10-21T22:12:02.488539] [INFO ] [MAIN ] Derivative Progress: 1242/2057 symbols completed. NEXA took 0.8s. Estimated remaining: 5m 8s. Rate: 158.6 symbols/min [2025-10-21T22:12:02.488803] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:02.505472] [DEBUG] [LOCAL ] NFJ: Loaded 19899 existing records from primary storage. [2025-10-21T22:12:02.505716] [INFO ] [MAIN ] NFJ: Loaded 19899 primary data records. [2025-10-21T22:12:02.630314] [DEBUG] [LOCAL ] NFG: Loaded 38359 existing records from primary storage. [2025-10-21T22:12:02.646426] [INFO ] [MAIN ] NFG: Loaded 38359 primary data records. [2025-10-21T22:12:03.049620] [DEBUG] [LOCAL ] NGG: Loaded 46801 existing records from primary storage. [2025-10-21T22:12:03.075292] [INFO ] [MAIN ] NGG: Loaded 46801 primary data records. [2025-10-21T22:12:03.624279] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:03.625272] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 19899 primary records. [2025-10-21T22:12:03.625559] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-10-21T22:12:03.646782] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-10-21T22:12:03.647474] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-10-21T22:12:03.650183] [INFO ] [MAIN ] Derivative Progress: 1243/2057 symbols completed. NFJ took 1.2s. Estimated remaining: 5m 9s. Rate: 158.3 symbols/min [2025-10-21T22:12:03.665173] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:03.666064] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38359 primary records. [2025-10-21T22:12:03.667178] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-10-21T22:12:03.685015] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-10-21T22:12:03.685366] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-10-21T22:12:03.688029] [INFO ] [MAIN ] Derivative Progress: 1244/2057 symbols completed. NFG took 1.2s. Estimated remaining: 5m 8s. Rate: 158.4 symbols/min [2025-10-21T22:12:03.708291] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:03.709007] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46801 primary records. [2025-10-21T22:12:03.709071] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-10-21T22:12:03.728514] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-10-21T22:12:03.728687] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-10-21T22:12:03.731815] [INFO ] [MAIN ] Derivative Progress: 1245/2057 symbols completed. NGG took 1.2s. Estimated remaining: 5m 7s. Rate: 158.5 symbols/min [2025-10-21T22:12:03.732241] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:03.732338] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:03.732410] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:03.746859] [DEBUG] [LOCAL ] NGS: Loaded 11017 existing records from primary storage. [2025-10-21T22:12:03.747204] [INFO ] [MAIN ] NGS: Loaded 11017 primary data records. [2025-10-21T22:12:03.891180] [DEBUG] [LOCAL ] NGVC: Loaded 22809 existing records from primary storage. [2025-10-21T22:12:03.892378] [INFO ] [MAIN ] NGVC: Loaded 22809 primary data records. [2025-10-21T22:12:03.946715] [DEBUG] [LOCAL ] NGL: Loaded 30056 existing records from primary storage. [2025-10-21T22:12:04.010070] [INFO ] [MAIN ] NGL: Loaded 30056 primary data records. [2025-10-21T22:12:04.766227] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:04.767836] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11017 primary records. [2025-10-21T22:12:04.770092] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-10-21T22:12:04.805727] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-10-21T22:12:04.807966] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:04.805889] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-10-21T22:12:04.808855] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22809 primary records. [2025-10-21T22:12:04.811551] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-10-21T22:12:04.811244] [INFO ] [MAIN ] Derivative Progress: 1246/2057 symbols completed. NGS took 1.1s. Estimated remaining: 5m 7s. Rate: 158.3 symbols/min [2025-10-21T22:12:04.811819] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:04.841320] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-10-21T22:12:04.841825] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:04.842630] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30056 primary records. [2025-10-21T22:12:04.841482] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-10-21T22:12:04.845372] [INFO ] [MAIN ] Derivative Progress: 1247/2057 symbols completed. NGVC took 1.1s. Estimated remaining: 5m 7s. Rate: 158.4 symbols/min [2025-10-21T22:12:04.845537] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-10-21T22:12:04.845698] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:04.870113] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-10-21T22:12:04.870299] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-10-21T22:12:04.872984] [INFO ] [MAIN ] Derivative Progress: 1248/2057 symbols completed. NGL took 1.1s. Estimated remaining: 5m 6s. Rate: 158.5 symbols/min [2025-10-21T22:12:04.873263] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:04.888514] [DEBUG] [LOCAL ] NGVT: Loaded 23894 existing records from primary storage. [2025-10-21T22:12:04.888815] [INFO ] [MAIN ] NGVT: Loaded 23894 primary data records. [2025-10-21T22:12:04.991298] [DEBUG] [LOCAL ] NHI: Loaded 21970 existing records from primary storage. [2025-10-21T22:12:05.010159] [INFO ] [MAIN ] NHI: Loaded 21970 primary data records. [2025-10-21T22:12:05.434543] [DEBUG] [LOCAL ] NI: Loaded 53409 existing records from primary storage. [2025-10-21T22:12:05.435446] [INFO ] [MAIN ] NI: Loaded 53409 primary data records. [2025-10-21T22:12:05.916184] [DEBUG] [MAIN ] NGVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:05.917559] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 23894 primary records. [2025-10-21T22:12:05.917709] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-10-21T22:12:05.945080] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-10-21T22:12:05.950259] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-10-21T22:12:05.952789] [INFO ] [MAIN ] Derivative Progress: 1249/2057 symbols completed. NGVT took 1.1s. Estimated remaining: 5m 6s. Rate: 158.3 symbols/min [2025-10-21T22:12:05.953381] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:05.953236] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:05.954575] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 21970 primary records. [2025-10-21T22:12:05.954793] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-10-21T22:12:05.971890] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-10-21T22:12:05.972043] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-10-21T22:12:05.976921] [INFO ] [MAIN ] Derivative Progress: 1250/2057 symbols completed. NHI took 1.1s. Estimated remaining: 5m 6s. Rate: 158.4 symbols/min [2025-10-21T22:12:05.977742] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:05.992498] [DEBUG] [LOCAL ] NIC: Loaded 8865 existing records from primary storage. [2025-10-21T22:12:05.997499] [INFO ] [MAIN ] NIC: Loaded 8865 primary data records. [2025-10-21T22:12:06.022038] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:06.042265] [INFO ] [MAIN ] NI: Generated 1794 derivative records from 53409 primary records. [2025-10-21T22:12:06.042376] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-10-21T22:12:06.077916] [DEBUG] [LOCAL ] NIE: Loaded 11830 existing records from primary storage. [2025-10-21T22:12:06.095527] [INFO ] [MAIN ] NIE: Loaded 11830 primary data records. [2025-10-21T22:12:06.168391] [DEBUG] [LOCAL ] NI: Derivative data saved (1794 records). [2025-10-21T22:12:06.187463] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-10-21T22:12:06.198888] [INFO ] [MAIN ] Derivative Progress: 1251/2057 symbols completed. NI took 1.3s. Estimated remaining: 5m 5s. Rate: 158.5 symbols/min [2025-10-21T22:12:06.199042] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:06.291017] [DEBUG] [LOCAL ] NIM: Loaded 3540 existing records from primary storage. [2025-10-21T22:12:06.445871] [INFO ] [MAIN ] NIM: Loaded 3540 primary data records. [2025-10-21T22:12:06.975896] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:06.983998] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8865 primary records. [2025-10-21T22:12:06.988724] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-10-21T22:12:06.990182] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:06.997879] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11830 primary records. [2025-10-21T22:12:06.999124] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-10-21T22:12:07.018340] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-10-21T22:12:07.018879] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-10-21T22:12:07.023116] [INFO ] [MAIN ] Derivative Progress: 1252/2057 symbols completed. NIC took 1.1s. Estimated remaining: 5m 5s. Rate: 158.3 symbols/min [2025-10-21T22:12:07.023878] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:07.026576] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-10-21T22:12:07.026795] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-10-21T22:12:07.029619] [INFO ] [MAIN ] Derivative Progress: 1253/2057 symbols completed. NIE took 1.1s. Estimated remaining: 5m 4s. Rate: 158.4 symbols/min [2025-10-21T22:12:07.030090] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:07.048700] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:07.049674] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 3540 primary records. [2025-10-21T22:12:07.049826] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-10-21T22:12:07.072146] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-10-21T22:12:07.072290] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-10-21T22:12:07.075032] [INFO ] [MAIN ] Derivative Progress: 1254/2057 symbols completed. NIM took 0.9s. Estimated remaining: 5m 4s. Rate: 158.6 symbols/min [2025-10-21T22:12:07.075263] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:07.086545] [DEBUG] [LOCAL ] NINE: Loaded 28646 existing records from primary storage. [2025-10-21T22:12:07.086706] [INFO ] [MAIN ] NINE: Loaded 28646 primary data records. [2025-10-21T22:12:07.283351] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-10-21T22:12:07.308425] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-10-21T22:12:07.543556] [DEBUG] [LOCAL ] NJR: Loaded 37972 existing records from primary storage. [2025-10-21T22:12:07.547406] [INFO ] [MAIN ] NJR: Loaded 37972 primary data records. [2025-10-21T22:12:08.103996] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:08.106097] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 28646 primary records. [2025-10-21T22:12:08.106331] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-10-21T22:12:08.136825] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-10-21T22:12:08.142198] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:08.142303] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-10-21T22:12:08.143744] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-10-21T22:12:08.146240] [INFO ] [MAIN ] Derivative Progress: 1255/2057 symbols completed. NINE took 1.1s. Estimated remaining: 5m 4s. Rate: 158.3 symbols/min [2025-10-21T22:12:08.147885] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:08.147138] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-10-21T22:12:08.174782] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:08.177878] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 37972 primary records. [2025-10-21T22:12:08.178048] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-10-21T22:12:08.177020] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-10-21T22:12:08.178764] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-10-21T22:12:08.181089] [INFO ] [MAIN ] Derivative Progress: 1256/2057 symbols completed. NIO took 1.2s. Estimated remaining: 5m 3s. Rate: 158.4 symbols/min [2025-10-21T22:12:08.194775] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:08.204311] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-10-21T22:12:08.204713] [DEBUG] [LOCAL ] NLOP: Loaded 11626 existing records from primary storage. [2025-10-21T22:12:08.204829] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-10-21T22:12:08.207503] [INFO ] [MAIN ] Derivative Progress: 1257/2057 symbols completed. NJR took 1.1s. Estimated remaining: 5m 3s. Rate: 158.6 symbols/min [2025-10-21T22:12:08.207744] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:08.207844] [INFO ] [MAIN ] NLOP: Loaded 11626 primary data records. [2025-10-21T22:12:08.322333] [DEBUG] [LOCAL ] NMAI: Loaded 12611 existing records from primary storage. [2025-10-21T22:12:08.364192] [INFO ] [MAIN ] NMAI: Loaded 12611 primary data records. [2025-10-21T22:12:08.629073] [DEBUG] [LOCAL ] NLY: Loaded 53564 existing records from primary storage. [2025-10-21T22:12:08.649304] [INFO ] [MAIN ] NLY: Loaded 53564 primary data records. [2025-10-21T22:12:09.213193] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:09.214301] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11626 primary records. [2025-10-21T22:12:09.214539] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-10-21T22:12:09.250086] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-10-21T22:12:09.250411] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:09.250626] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-10-21T22:12:09.251416] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 12611 primary records. [2025-10-21T22:12:09.254043] [INFO ] [MAIN ] Derivative Progress: 1258/2057 symbols completed. NLOP took 1.1s. Estimated remaining: 5m 3s. Rate: 158.3 symbols/min [2025-10-21T22:12:09.254735] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-10-21T22:12:09.272959] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-10-21T22:12:09.273104] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-10-21T22:12:09.275536] [INFO ] [MAIN ] Derivative Progress: 1259/2057 symbols completed. NMAI took 1.1s. Estimated remaining: 5m 2s. Rate: 158.5 symbols/min [2025-10-21T22:12:09.288136] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:09.288802] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53564 primary records. [2025-10-21T22:12:09.288864] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-10-21T22:12:09.304261] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-10-21T22:12:09.304324] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-10-21T22:12:09.306980] [INFO ] [MAIN ] Derivative Progress: 1260/2057 symbols completed. NLY took 1.1s. Estimated remaining: 5m 2s. Rate: 158.6 symbols/min [2025-10-21T22:12:09.307384] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:09.307473] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:09.307840] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:09.314628] [DEBUG] [LOCAL ] NMI: Loaded 4051 existing records from primary storage. [2025-10-21T22:12:09.314873] [INFO ] [MAIN ] NMI: Loaded 4051 primary data records. [2025-10-21T22:12:09.413057] [DEBUG] [LOCAL ] NMG: Loaded 11780 existing records from primary storage. [2025-10-21T22:12:09.441357] [INFO ] [MAIN ] NMG: Loaded 11780 primary data records. [2025-10-21T22:12:09.480237] [DEBUG] [LOCAL ] NMCO: Loaded 16621 existing records from primary storage. [2025-10-21T22:12:09.523455] [INFO ] [MAIN ] NMCO: Loaded 16621 primary data records. [2025-10-21T22:12:10.320484] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:10.321571] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4051 primary records. [2025-10-21T22:12:10.321775] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-10-21T22:12:10.343098] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:10.345038] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 11780 primary records. [2025-10-21T22:12:10.359052] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-10-21T22:12:10.351381] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-10-21T22:12:10.363499] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-10-21T22:12:10.366102] [INFO ] [MAIN ] Derivative Progress: 1261/2057 symbols completed. NMI took 1.1s. Estimated remaining: 5m 2s. Rate: 158.3 symbols/min [2025-10-21T22:12:10.367096] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:10.376225] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:10.379733] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16621 primary records. [2025-10-21T22:12:10.379854] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-10-21T22:12:10.385086] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-10-21T22:12:10.399828] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-10-21T22:12:10.397318] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-10-21T22:12:10.400047] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-10-21T22:12:10.402762] [INFO ] [MAIN ] Derivative Progress: 1262/2057 symbols completed. NMG took 1.1s. Estimated remaining: 5m 1s. Rate: 158.5 symbols/min [2025-10-21T22:12:10.405721] [INFO ] [MAIN ] Derivative Progress: 1263/2057 symbols completed. NMCO took 1.1s. Estimated remaining: 5m 0s. Rate: 158.6 symbols/min [2025-10-21T22:12:10.402983] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:10.409762] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:10.418312] [DEBUG] [LOCAL ] NMM: Loaded 14252 existing records from primary storage. [2025-10-21T22:12:10.418472] [INFO ] [MAIN ] NMM: Loaded 14252 primary data records. [2025-10-21T22:12:10.484003] [DEBUG] [LOCAL ] NMS: Loaded 2903 existing records from primary storage. [2025-10-21T22:12:10.512185] [INFO ] [MAIN ] NMS: Loaded 2903 primary data records. [2025-10-21T22:12:10.840970] [DEBUG] [LOCAL ] NMR: Loaded 35555 existing records from primary storage. [2025-10-21T22:12:10.851405] [INFO ] [MAIN ] NMR: Loaded 35555 primary data records. [2025-10-21T22:12:11.505027] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:11.506598] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14252 primary records. [2025-10-21T22:12:11.506947] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-10-21T22:12:11.525854] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-10-21T22:12:11.526013] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-10-21T22:12:11.540381] [INFO ] [MAIN ] Derivative Progress: 1264/2057 symbols completed. NMM took 1.2s. Estimated remaining: 5m 1s. Rate: 158.3 symbols/min [2025-10-21T22:12:11.543489] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:11.543605] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:11.544853] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2903 primary records. [2025-10-21T22:12:11.545528] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-10-21T22:12:11.564954] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-10-21T22:12:11.565173] [DEBUG] [LOCAL ] NMT: Loaded 2817 existing records from primary storage. [2025-10-21T22:12:11.565389] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-10-21T22:12:11.568201] [INFO ] [MAIN ] NMT: Loaded 2817 primary data records. [2025-10-21T22:12:11.568103] [INFO ] [MAIN ] Derivative Progress: 1265/2057 symbols completed. NMS took 1.2s. Estimated remaining: 4m 60s. Rate: 158.5 symbols/min [2025-10-21T22:12:11.568730] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:11.784964] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:11.890484] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35555 primary records. [2025-10-21T22:12:11.895781] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-10-21T22:12:11.784403] [DEBUG] [LOCAL ] NMZ: Loaded 21449 existing records from primary storage. [2025-10-21T22:12:11.912504] [INFO ] [MAIN ] NMZ: Loaded 21449 primary data records. [2025-10-21T22:12:11.921231] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-10-21T22:12:11.942032] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-10-21T22:12:11.945410] [INFO ] [MAIN ] Derivative Progress: 1266/2057 symbols completed. NMR took 1.5s. Estimated remaining: 4m 60s. Rate: 158.5 symbols/min [2025-10-21T22:12:11.973604] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:12.228402] [DEBUG] [LOCAL ] NNI: Loaded 10538 existing records from primary storage. [2025-10-21T22:12:12.228824] [INFO ] [MAIN ] NNI: Loaded 10538 primary data records. [2025-10-21T22:12:12.407074] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:12.438834] [INFO ] [MAIN ] NMT: Generated 1794 derivative records from 2817 primary records. [2025-10-21T22:12:12.552825] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-10-21T22:12:12.587816] [DEBUG] [LOCAL ] NMT: Derivative data saved (1794 records). [2025-10-21T22:12:12.588715] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-10-21T22:12:12.592821] [INFO ] [MAIN ] Derivative Progress: 1267/2057 symbols completed. NMT took 1.0s. Estimated remaining: 4m 59s. Rate: 158.4 symbols/min [2025-10-21T22:12:12.593391] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:12.615130] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:12.616237] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21449 primary records. [2025-10-21T22:12:12.616469] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-10-21T22:12:12.633706] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-10-21T22:12:12.634212] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-10-21T22:12:12.637224] [INFO ] [MAIN ] Derivative Progress: 1268/2057 symbols completed. NMZ took 1.1s. Estimated remaining: 4m 59s. Rate: 158.5 symbols/min [2025-10-21T22:12:12.637567] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:12.662158] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:12.662443] [DEBUG] [LOCAL ] NNY: Loaded 5694 existing records from primary storage. [2025-10-21T22:12:12.663696] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 10538 primary records. [2025-10-21T22:12:12.663806] [INFO ] [MAIN ] NNY: Loaded 5694 primary data records. [2025-10-21T22:12:12.664067] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-10-21T22:12:12.811228] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-10-21T22:12:12.833478] [DEBUG] [LOCAL ] NNN: Loaded 48194 existing records from primary storage. [2025-10-21T22:12:12.869886] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-10-21T22:12:12.893490] [INFO ] [MAIN ] Derivative Progress: 1269/2057 symbols completed. NNI took 0.9s. Estimated remaining: 4m 58s. Rate: 158.5 symbols/min [2025-10-21T22:12:12.888848] [INFO ] [MAIN ] NNN: Loaded 48194 primary data records. [2025-10-21T22:12:12.894032] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:13.184037] [DEBUG] [LOCAL ] NOA: Loaded 15834 existing records from primary storage. [2025-10-21T22:12:13.204003] [INFO ] [MAIN ] NOA: Loaded 15834 primary data records. [2025-10-21T22:12:13.747562] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:13.749790] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5694 primary records. [2025-10-21T22:12:13.750212] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-10-21T22:12:13.769415] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-10-21T22:12:13.770340] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-10-21T22:12:13.772918] [INFO ] [MAIN ] Derivative Progress: 1270/2057 symbols completed. NNY took 1.1s. Estimated remaining: 4m 58s. Rate: 158.3 symbols/min [2025-10-21T22:12:13.774536] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:13.794410] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:13.795895] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48194 primary records. [2025-10-21T22:12:13.796325] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-10-21T22:12:13.828222] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-10-21T22:12:13.847377] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-10-21T22:12:13.853210] [INFO ] [MAIN ] Derivative Progress: 1271/2057 symbols completed. NNN took 1.3s. Estimated remaining: 4m 58s. Rate: 158.4 symbols/min [2025-10-21T22:12:13.853609] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:13.860458] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:13.861378] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 15834 primary records. [2025-10-21T22:12:13.863075] [DEBUG] [LOCAL ] NOAH: Loaded 20006 existing records from primary storage. [2025-10-21T22:12:13.862727] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-10-21T22:12:13.864152] [INFO ] [MAIN ] NOAH: Loaded 20006 primary data records. [2025-10-21T22:12:13.955420] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-10-21T22:12:13.979888] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-10-21T22:12:14.012568] [INFO ] [MAIN ] Derivative Progress: 1272/2057 symbols completed. NOA took 1.1s. Estimated remaining: 4m 57s. Rate: 158.5 symbols/min [2025-10-21T22:12:14.081112] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:14.228317] [DEBUG] [LOCAL ] NOC: Loaded 41646 existing records from primary storage. [2025-10-21T22:12:14.229457] [INFO ] [MAIN ] NOC: Loaded 41646 primary data records. [2025-10-21T22:12:14.582860] [DEBUG] [LOCAL ] NOG: Loaded 51364 existing records from primary storage. [2025-10-21T22:12:14.583399] [INFO ] [MAIN ] NOG: Loaded 51364 primary data records. [2025-10-21T22:12:14.681065] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:14.707165] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20006 primary records. [2025-10-21T22:12:14.717209] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-10-21T22:12:14.924259] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-10-21T22:12:14.924797] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-10-21T22:12:14.928218] [INFO ] [MAIN ] Derivative Progress: 1273/2057 symbols completed. NOAH took 1.2s. Estimated remaining: 4m 57s. Rate: 158.3 symbols/min [2025-10-21T22:12:14.947773] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:14.948482] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 41646 primary records. [2025-10-21T22:12:14.948835] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-10-21T22:12:14.967003] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-10-21T22:12:14.967207] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-10-21T22:12:14.970913] [INFO ] [MAIN ] Derivative Progress: 1274/2057 symbols completed. NOC took 1.1s. Estimated remaining: 4m 56s. Rate: 158.5 symbols/min [2025-10-21T22:12:14.986107] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:14.986730] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51364 primary records. [2025-10-21T22:12:14.986791] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-10-21T22:12:15.002324] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-10-21T22:12:15.002409] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-10-21T22:12:15.004968] [INFO ] [MAIN ] Derivative Progress: 1275/2057 symbols completed. NOG took 0.9s. Estimated remaining: 4m 56s. Rate: 158.6 symbols/min [2025-10-21T22:12:15.005489] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:15.005437] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:15.005558] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:15.071778] [DEBUG] [LOCAL ] NOTE: Loaded 39700 existing records from primary storage. [2025-10-21T22:12:15.099548] [INFO ] [MAIN ] NOTE: Loaded 39700 primary data records. [2025-10-21T22:12:15.144551] [DEBUG] [LOCAL ] NOMD: Loaded 43178 existing records from primary storage. [2025-10-21T22:12:15.156825] [INFO ] [MAIN ] NOMD: Loaded 43178 primary data records. [2025-10-21T22:12:15.167028] [DEBUG] [LOCAL ] NOK: Loaded 53622 existing records from primary storage. [2025-10-21T22:12:15.184160] [INFO ] [MAIN ] NOK: Loaded 53622 primary data records. [2025-10-21T22:12:16.119592] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:16.120506] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 39700 primary records. [2025-10-21T22:12:16.121149] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-10-21T22:12:16.139106] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-10-21T22:12:16.139370] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-10-21T22:12:16.141358] [INFO ] [MAIN ] Derivative Progress: 1276/2057 symbols completed. NOTE took 1.1s. Estimated remaining: 4m 56s. Rate: 158.3 symbols/min [2025-10-21T22:12:16.154126] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:16.157490] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:16.158775] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 43178 primary records. [2025-10-21T22:12:16.158974] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-10-21T22:12:16.187010] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:16.188737] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-10-21T22:12:16.189043] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-10-21T22:12:16.194109] [INFO ] [MAIN ] Derivative Progress: 1277/2057 symbols completed. NOMD took 1.2s. Estimated remaining: 4m 55s. Rate: 158.4 symbols/min [2025-10-21T22:12:16.194522] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:16.194301] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53622 primary records. [2025-10-21T22:12:16.195202] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-10-21T22:12:16.211515] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-10-21T22:12:16.211622] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-10-21T22:12:16.214178] [INFO ] [MAIN ] Derivative Progress: 1278/2057 symbols completed. NOK took 1.2s. Estimated remaining: 4m 55s. Rate: 158.5 symbols/min [2025-10-21T22:12:16.214370] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:16.246105] [DEBUG] [LOCAL ] NPCT: Loaded 16499 existing records from primary storage. [2025-10-21T22:12:16.246300] [INFO ] [MAIN ] NPCT: Loaded 16499 primary data records. [2025-10-21T22:12:16.316143] [DEBUG] [LOCAL ] NOV: Loaded 53168 existing records from primary storage. [2025-10-21T22:12:16.337844] [INFO ] [MAIN ] NOV: Loaded 53168 primary data records. [2025-10-21T22:12:16.551893] [DEBUG] [LOCAL ] NOW: Loaded 47904 existing records from primary storage. [2025-10-21T22:12:16.571269] [INFO ] [MAIN ] NOW: Loaded 47904 primary data records. [2025-10-21T22:12:17.251028] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:17.251983] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 16499 primary records. [2025-10-21T22:12:17.252090] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-10-21T22:12:17.270403] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-10-21T22:12:17.270624] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-10-21T22:12:17.272635] [INFO ] [MAIN ] Derivative Progress: 1279/2057 symbols completed. NPCT took 1.1s. Estimated remaining: 4m 55s. Rate: 158.3 symbols/min [2025-10-21T22:12:17.281315] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:17.287073] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:17.287966] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53168 primary records. [2025-10-21T22:12:17.288476] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-10-21T22:12:17.307474] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-10-21T22:12:17.308712] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-10-21T22:12:17.311212] [INFO ] [MAIN ] Derivative Progress: 1280/2057 symbols completed. NOV took 1.2s. Estimated remaining: 4m 54s. Rate: 158.4 symbols/min [2025-10-21T22:12:17.311574] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:17.329163] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:17.330075] [INFO ] [MAIN ] NOW: Generated 1794 derivative records from 47904 primary records. [2025-10-21T22:12:17.330300] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-10-21T22:12:17.336439] [DEBUG] [LOCAL ] NPFD: Loaded 10016 existing records from primary storage. [2025-10-21T22:12:17.345572] [INFO ] [MAIN ] NPFD: Loaded 10016 primary data records. [2025-10-21T22:12:17.360287] [DEBUG] [LOCAL ] NOW: Derivative data saved (1794 records). [2025-10-21T22:12:17.360542] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-10-21T22:12:17.372455] [INFO ] [MAIN ] Derivative Progress: 1281/2057 symbols completed. NOW took 1.2s. Estimated remaining: 4m 54s. Rate: 158.5 symbols/min [2025-10-21T22:12:17.386684] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:17.430455] [DEBUG] [LOCAL ] NPK: Loaded 8461 existing records from primary storage. [2025-10-21T22:12:17.471273] [INFO ] [MAIN ] NPK: Loaded 8461 primary data records. [2025-10-21T22:12:18.054460] [DEBUG] [LOCAL ] NPKI: Loaded 40462 existing records from primary storage. [2025-10-21T22:12:18.063775] [INFO ] [MAIN ] NPKI: Loaded 40462 primary data records. [2025-10-21T22:12:18.381091] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:18.381936] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 10016 primary records. [2025-10-21T22:12:18.382032] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-10-21T22:12:18.413046] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-10-21T22:12:18.413670] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-10-21T22:12:18.415697] [INFO ] [MAIN ] Derivative Progress: 1282/2057 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 54s. Rate: 158.3 symbols/min [2025-10-21T22:12:18.416189] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:18.415850] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:18.417819] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8461 primary records. [2025-10-21T22:12:18.418053] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-10-21T22:12:18.434575] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-10-21T22:12:18.434790] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-10-21T22:12:18.437257] [INFO ] [MAIN ] Derivative Progress: 1283/2057 symbols completed. NPK took 1.1s. Estimated remaining: 4m 53s. Rate: 158.4 symbols/min [2025-10-21T22:12:18.441372] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:18.451271] [DEBUG] [LOCAL ] NPO: Loaded 13573 existing records from primary storage. [2025-10-21T22:12:18.465058] [INFO ] [MAIN ] NPO: Loaded 13573 primary data records. [2025-10-21T22:12:18.465385] [DEBUG] [MAIN ] NPKI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:18.466174] [INFO ] [MAIN ] NPKI: Generated 1794 derivative records from 40462 primary records. [2025-10-21T22:12:18.506779] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-10-21T22:12:18.507190] [DEBUG] [LOCAL ] NPV: Loaded 5390 existing records from primary storage. [2025-10-21T22:12:18.535600] [INFO ] [MAIN ] NPV: Loaded 5390 primary data records. [2025-10-21T22:12:18.674478] [DEBUG] [LOCAL ] NPKI: Derivative data saved (1794 records). [2025-10-21T22:12:18.695609] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-10-21T22:12:18.710110] [INFO ] [MAIN ] Derivative Progress: 1284/2057 symbols completed. NPKI took 1.3s. Estimated remaining: 4m 53s. Rate: 158.5 symbols/min [2025-10-21T22:12:18.788935] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:19.134158] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:19.135606] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 13573 primary records. [2025-10-21T22:12:19.136033] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-10-21T22:12:19.170464] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-10-21T22:12:19.170815] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-10-21T22:12:19.183713] [DEBUG] [LOCAL ] NPWR: Loaded 43381 existing records from primary storage. [2025-10-21T22:12:19.184126] [INFO ] [MAIN ] NPWR: Loaded 43381 primary data records. [2025-10-21T22:12:19.186221] [INFO ] [MAIN ] Derivative Progress: 1285/2057 symbols completed. NPO took 0.8s. Estimated remaining: 4m 52s. Rate: 158.4 symbols/min [2025-10-21T22:12:19.186369] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:19.184344] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:19.218405] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 5390 primary records. [2025-10-21T22:12:19.224405] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-10-21T22:12:19.289680] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-10-21T22:12:19.300629] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-10-21T22:12:19.314215] [INFO ] [MAIN ] Derivative Progress: 1286/2057 symbols completed. NPV took 0.9s. Estimated remaining: 4m 52s. Rate: 158.5 symbols/min [2025-10-21T22:12:19.336070] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:19.357223] [DEBUG] [LOCAL ] NQP: Loaded 9224 existing records from primary storage. [2025-10-21T22:12:19.372484] [INFO ] [MAIN ] NQP: Loaded 9224 primary data records. [2025-10-21T22:12:19.871748] [DEBUG] [LOCAL ] NRDY: Loaded 32274 existing records from primary storage. [2025-10-21T22:12:19.872396] [INFO ] [MAIN ] NRDY: Loaded 32274 primary data records. [2025-10-21T22:12:20.006952] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:20.023888] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 43381 primary records. [2025-10-21T22:12:20.029840] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-10-21T22:12:20.218167] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:20.221583] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9224 primary records. [2025-10-21T22:12:20.226323] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-10-21T22:12:20.226422] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-10-21T22:12:20.229940] [INFO ] [MAIN ] Derivative Progress: 1287/2057 symbols completed. NPWR took 1.4s. Estimated remaining: 4m 52s. Rate: 158.3 symbols/min [2025-10-21T22:12:20.230417] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:20.230315] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-10-21T22:12:20.250786] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-10-21T22:12:20.250926] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-10-21T22:12:20.253393] [INFO ] [MAIN ] Derivative Progress: 1288/2057 symbols completed. NQP took 1.1s. Estimated remaining: 4m 51s. Rate: 158.5 symbols/min [2025-10-21T22:12:20.261118] [DEBUG] [LOCAL ] NREF: Loaded 7839 existing records from primary storage. [2025-10-21T22:12:20.261410] [INFO ] [MAIN ] NREF: Loaded 7839 primary data records. [2025-10-21T22:12:20.439024] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:20.457146] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 32274 primary records. [2025-10-21T22:12:20.460523] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-10-21T22:12:20.589102] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-10-21T22:12:20.589719] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-10-21T22:12:20.592568] [INFO ] [MAIN ] Derivative Progress: 1289/2057 symbols completed. NRDY took 1.3s. Estimated remaining: 4m 51s. Rate: 158.5 symbols/min [2025-10-21T22:12:20.613151] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:20.613768] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7839 primary records. [2025-10-21T22:12:20.613827] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-10-21T22:12:20.628345] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-10-21T22:12:20.628400] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-10-21T22:12:20.630617] [INFO ] [MAIN ] Derivative Progress: 1290/2057 symbols completed. NREF took 0.4s. Estimated remaining: 4m 50s. Rate: 158.6 symbols/min [2025-10-21T22:12:20.631200] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:20.631270] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:20.631418] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:20.654054] [DEBUG] [LOCAL ] NRK: Loaded 20410 existing records from primary storage. [2025-10-21T22:12:20.654306] [INFO ] [MAIN ] NRK: Loaded 20410 primary data records. [2025-10-21T22:12:20.870319] [DEBUG] [LOCAL ] NRG: Loaded 52818 existing records from primary storage. [2025-10-21T22:12:20.892070] [DEBUG] [LOCAL ] NRGV: Loaded 43875 existing records from primary storage. [2025-10-21T22:12:20.892176] [INFO ] [MAIN ] NRG: Loaded 52818 primary data records. [2025-10-21T22:12:20.892272] [INFO ] [MAIN ] NRGV: Loaded 43875 primary data records. [2025-10-21T22:12:21.673548] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:21.674597] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 20410 primary records. [2025-10-21T22:12:21.674715] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-10-21T22:12:21.692112] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-10-21T22:12:21.692891] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-10-21T22:12:21.695492] [INFO ] [MAIN ] Derivative Progress: 1291/2057 symbols completed. NRK took 1.1s. Estimated remaining: 4m 50s. Rate: 158.4 symbols/min [2025-10-21T22:12:21.695718] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:21.711199] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:21.712072] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 43875 primary records. [2025-10-21T22:12:21.720613] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-10-21T22:12:21.727692] [DEBUG] [MAIN ] NRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:21.736621] [INFO ] [MAIN ] NRG: Generated 1794 derivative records from 52818 primary records. [2025-10-21T22:12:21.739354] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-10-21T22:12:21.745095] [DEBUG] [LOCAL ] NRP: Loaded 4194 existing records from primary storage. [2025-10-21T22:12:21.746243] [INFO ] [MAIN ] NRP: Loaded 4194 primary data records. [2025-10-21T22:12:21.746175] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-10-21T22:12:21.747055] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-10-21T22:12:21.750478] [INFO ] [MAIN ] Derivative Progress: 1292/2057 symbols completed. NRGV took 1.1s. Estimated remaining: 4m 50s. Rate: 158.5 symbols/min [2025-10-21T22:12:21.771556] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:21.872820] [DEBUG] [LOCAL ] NRT: Loaded 4885 existing records from primary storage. [2025-10-21T22:12:21.873250] [INFO ] [MAIN ] NRT: Loaded 4885 primary data records. [2025-10-21T22:12:21.874737] [DEBUG] [LOCAL ] NRG: Derivative data saved (1794 records). [2025-10-21T22:12:21.890356] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-10-21T22:12:21.935353] [INFO ] [MAIN ] Derivative Progress: 1293/2057 symbols completed. NRG took 1.3s. Estimated remaining: 4m 49s. Rate: 158.5 symbols/min [2025-10-21T22:12:21.977468] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:22.204002] [DEBUG] [LOCAL ] NRUC: Loaded 3108 existing records from primary storage. [2025-10-21T22:12:22.231281] [INFO ] [MAIN ] NRUC: Loaded 3108 primary data records. [2025-10-21T22:12:22.709274] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:22.710796] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4194 primary records. [2025-10-21T22:12:22.710897] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-10-21T22:12:22.727583] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-10-21T22:12:22.728583] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-10-21T22:12:22.730786] [INFO ] [MAIN ] Derivative Progress: 1294/2057 symbols completed. NRP took 1.0s. Estimated remaining: 4m 49s. Rate: 158.4 symbols/min [2025-10-21T22:12:22.731488] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:22.746292] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:22.747047] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4885 primary records. [2025-10-21T22:12:22.747234] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-10-21T22:12:22.763098] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-10-21T22:12:22.763317] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-10-21T22:12:22.765812] [INFO ] [MAIN ] Derivative Progress: 1295/2057 symbols completed. NRT took 1.0s. Estimated remaining: 4m 48s. Rate: 158.5 symbols/min [2025-10-21T22:12:22.765978] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:22.782267] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:22.783044] [INFO ] [MAIN ] NRUC: Generated 1794 derivative records from 3108 primary records. [2025-10-21T22:12:22.783248] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-10-21T22:12:22.797805] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1794 records). [2025-10-21T22:12:22.798111] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-10-21T22:12:22.800515] [INFO ] [MAIN ] Derivative Progress: 1296/2057 symbols completed. NRUC took 0.8s. Estimated remaining: 4m 48s. Rate: 158.6 symbols/min [2025-10-21T22:12:22.800813] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:22.842684] [DEBUG] [LOCAL ] NSA: Loaded 45119 existing records from primary storage. [2025-10-21T22:12:22.842975] [INFO ] [MAIN ] NSA: Loaded 45119 primary data records. [2025-10-21T22:12:22.951832] [DEBUG] [LOCAL ] NSC: Loaded 48688 existing records from primary storage. [2025-10-21T22:12:22.978100] [INFO ] [MAIN ] NSC: Loaded 48688 primary data records. [2025-10-21T22:12:23.075437] [DEBUG] [LOCAL ] NSP: Loaded 35740 existing records from primary storage. [2025-10-21T22:12:23.125090] [INFO ] [MAIN ] NSP: Loaded 35740 primary data records. [2025-10-21T22:12:23.877981] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:23.879620] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 45119 primary records. [2025-10-21T22:12:23.880140] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-10-21T22:12:23.900563] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-10-21T22:12:23.902357] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-10-21T22:12:23.905504] [INFO ] [MAIN ] Derivative Progress: 1297/2057 symbols completed. NSA took 1.2s. Estimated remaining: 4m 48s. Rate: 158.4 symbols/min [2025-10-21T22:12:23.905759] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:23.929139] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:23.935557] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 35740 primary records. [2025-10-21T22:12:23.934755] [DEBUG] [MAIN ] NSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:23.935775] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-10-21T22:12:23.936802] [INFO ] [MAIN ] NSC: Generated 1794 derivative records from 48688 primary records. [2025-10-21T22:12:23.936923] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-10-21T22:12:23.970078] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-10-21T22:12:23.969808] [DEBUG] [LOCAL ] NSC: Derivative data saved (1794 records). [2025-10-21T22:12:23.970231] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-10-21T22:12:23.970344] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-10-21T22:12:23.972941] [INFO ] [MAIN ] Derivative Progress: 1298/2057 symbols completed. NSC took 1.2s. Estimated remaining: 4m 47s. Rate: 158.5 symbols/min [2025-10-21T22:12:23.980760] [INFO ] [MAIN ] Derivative Progress: 1299/2057 symbols completed. NSP took 1.2s. Estimated remaining: 4m 47s. Rate: 158.6 symbols/min [2025-10-21T22:12:23.980697] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:23.981003] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:23.991768] [DEBUG] [LOCAL ] NTB: Loaded 20289 existing records from primary storage. [2025-10-21T22:12:23.991977] [INFO ] [MAIN ] NTB: Loaded 20289 primary data records. [2025-10-21T22:12:24.336482] [DEBUG] [LOCAL ] NTST: Loaded 44086 existing records from primary storage. [2025-10-21T22:12:24.336995] [INFO ] [MAIN ] NTST: Loaded 44086 primary data records. [2025-10-21T22:12:24.443766] [DEBUG] [LOCAL ] NTR: Loaded 52637 existing records from primary storage. [2025-10-21T22:12:24.461791] [INFO ] [MAIN ] NTR: Loaded 52637 primary data records. [2025-10-21T22:12:25.000162] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:25.001955] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20289 primary records. [2025-10-21T22:12:25.002134] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-10-21T22:12:25.025176] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-10-21T22:12:25.025759] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-10-21T22:12:25.028183] [INFO ] [MAIN ] Derivative Progress: 1300/2057 symbols completed. NTB took 1.1s. Estimated remaining: 4m 47s. Rate: 158.4 symbols/min [2025-10-21T22:12:25.028360] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:25.045453] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:25.046153] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 44086 primary records. [2025-10-21T22:12:25.046368] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-10-21T22:12:25.064466] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-10-21T22:12:25.064751] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-10-21T22:12:25.067841] [INFO ] [MAIN ] Derivative Progress: 1301/2057 symbols completed. NTST took 1.1s. Estimated remaining: 4m 46s. Rate: 158.5 symbols/min [2025-10-21T22:12:25.068366] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:25.081949] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:25.082567] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52637 primary records. [2025-10-21T22:12:25.082866] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-10-21T22:12:25.112049] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-10-21T22:12:25.112354] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-10-21T22:12:25.114984] [INFO ] [MAIN ] Derivative Progress: 1302/2057 symbols completed. NTR took 1.1s. Estimated remaining: 4m 46s. Rate: 158.6 symbols/min [2025-10-21T22:12:25.115184] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:25.149104] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-10-21T22:12:25.149360] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-10-21T22:12:25.209084] [DEBUG] [LOCAL ] NUV: Loaded 23448 existing records from primary storage. [2025-10-21T22:12:25.263122] [INFO ] [MAIN ] NUV: Loaded 23448 primary data records. [2025-10-21T22:12:25.269383] [DEBUG] [LOCAL ] NUS: Loaded 36101 existing records from primary storage. [2025-10-21T22:12:25.316326] [INFO ] [MAIN ] NUS: Loaded 36101 primary data records. [2025-10-21T22:12:26.158617] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:26.159680] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-10-21T22:12:26.160615] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-10-21T22:12:26.192962] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-10-21T22:12:26.205635] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:26.205722] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-10-21T22:12:26.206350] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:26.209444] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23448 primary records. [2025-10-21T22:12:26.208687] [INFO ] [MAIN ] Derivative Progress: 1303/2057 symbols completed. NU took 1.2s. Estimated remaining: 4m 46s. Rate: 158.4 symbols/min [2025-10-21T22:12:26.210342] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36101 primary records. [2025-10-21T22:12:26.210416] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-10-21T22:12:26.210728] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-10-21T22:12:26.240238] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-10-21T22:12:26.240327] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-10-21T22:12:26.242734] [INFO ] [MAIN ] Derivative Progress: 1304/2057 symbols completed. NUV took 1.1s. Estimated remaining: 4m 45s. Rate: 158.5 symbols/min [2025-10-21T22:12:26.244073] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-10-21T22:12:26.244190] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-10-21T22:12:26.246764] [INFO ] [MAIN ] Derivative Progress: 1305/2057 symbols completed. NUS took 1.2s. Estimated remaining: 4m 44s. Rate: 158.6 symbols/min [2025-10-21T22:12:26.247213] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:26.247159] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:26.247539] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:26.258081] [DEBUG] [LOCAL ] NUW: Loaded 6674 existing records from primary storage. [2025-10-21T22:12:26.258253] [INFO ] [MAIN ] NUW: Loaded 6674 primary data records. [2025-10-21T22:12:26.377102] [DEBUG] [LOCAL ] NVG: Loaded 27482 existing records from primary storage. [2025-10-21T22:12:26.393333] [INFO ] [MAIN ] NVG: Loaded 27482 primary data records. [2025-10-21T22:12:26.743870] [DEBUG] [LOCAL ] NUVB: Loaded 51709 existing records from primary storage. [2025-10-21T22:12:26.777355] [INFO ] [MAIN ] NUVB: Loaded 51709 primary data records. [2025-10-21T22:12:27.216665] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:27.218347] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 6674 primary records. [2025-10-21T22:12:27.218444] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-10-21T22:12:27.237155] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-10-21T22:12:27.237431] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-10-21T22:12:27.239683] [INFO ] [MAIN ] Derivative Progress: 1306/2057 symbols completed. NUW took 1.0s. Estimated remaining: 4m 44s. Rate: 158.4 symbols/min [2025-10-21T22:12:27.247728] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:27.253591] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:27.254582] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27482 primary records. [2025-10-21T22:12:27.255100] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-10-21T22:12:27.271868] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-10-21T22:12:27.272082] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-10-21T22:12:27.274237] [INFO ] [MAIN ] Derivative Progress: 1307/2057 symbols completed. NVG took 1.0s. Estimated remaining: 4m 44s. Rate: 158.5 symbols/min [2025-10-21T22:12:27.274403] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:27.291770] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:27.292416] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51709 primary records. [2025-10-21T22:12:27.292683] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-10-21T22:12:27.316248] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-10-21T22:12:27.316310] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-10-21T22:12:27.319018] [INFO ] [MAIN ] Derivative Progress: 1308/2057 symbols completed. NUVB took 1.1s. Estimated remaining: 4m 43s. Rate: 158.6 symbols/min [2025-10-21T22:12:27.319235] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:27.332611] [DEBUG] [LOCAL ] NVGS: Loaded 30102 existing records from primary storage. [2025-10-21T22:12:27.332848] [INFO ] [MAIN ] NVGS: Loaded 30102 primary data records. [2025-10-21T22:12:27.461078] [DEBUG] [LOCAL ] NVR: Loaded 18543 existing records from primary storage. [2025-10-21T22:12:27.461239] [INFO ] [MAIN ] NVR: Loaded 18543 primary data records. [2025-10-21T22:12:27.627559] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-10-21T22:12:27.802441] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-10-21T22:12:28.324926] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:28.326253] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 30102 primary records. [2025-10-21T22:12:28.326530] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-10-21T22:12:28.339833] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:12:28.348593] [INFO ] [MAIN ] NVR: Generated 1793 derivative records from 18543 primary records. [2025-10-21T22:12:28.349916] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-10-21T22:12:28.356750] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-10-21T22:12:28.357133] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-10-21T22:12:28.361522] [INFO ] [MAIN ] Derivative Progress: 1309/2057 symbols completed. NVGS took 1.1s. Estimated remaining: 4m 43s. Rate: 158.4 symbols/min [2025-10-21T22:12:28.388426] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:28.391095] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-10-21T22:12:28.390350] [DEBUG] [LOCAL ] NVR: Derivative data saved (1793 records). [2025-10-21T22:12:28.388793] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:28.391293] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-10-21T22:12:28.391425] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-10-21T22:12:28.393689] [INFO ] [MAIN ] Derivative Progress: 1310/2057 symbols completed. NVR took 1.1s. Estimated remaining: 4m 43s. Rate: 158.5 symbols/min [2025-10-21T22:12:28.394077] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:28.410941] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-10-21T22:12:28.411174] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-10-21T22:12:28.414239] [INFO ] [MAIN ] Derivative Progress: 1311/2057 symbols completed. NVO took 1.1s. Estimated remaining: 4m 42s. Rate: 158.6 symbols/min [2025-10-21T22:12:28.414538] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:28.462285] [DEBUG] [LOCAL ] NVRI: Loaded 39040 existing records from primary storage. [2025-10-21T22:12:28.462481] [INFO ] [MAIN ] NVRI: Loaded 39040 primary data records. [2025-10-21T22:12:28.596045] [DEBUG] [LOCAL ] NVS: Loaded 51339 existing records from primary storage. [2025-10-21T22:12:28.633159] [DEBUG] [LOCAL ] NVST: Loaded 51463 existing records from primary storage. [2025-10-21T22:12:28.616930] [INFO ] [MAIN ] NVS: Loaded 51339 primary data records. [2025-10-21T22:12:28.638440] [INFO ] [MAIN ] NVST: Loaded 51463 primary data records. [2025-10-21T22:12:29.462787] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:29.463498] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 39040 primary records. [2025-10-21T22:12:29.463715] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-10-21T22:12:29.480088] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-10-21T22:12:29.480338] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-10-21T22:12:29.482363] [INFO ] [MAIN ] Derivative Progress: 1312/2057 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 42s. Rate: 158.4 symbols/min [2025-10-21T22:12:29.483444] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:29.500601] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:29.513547] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:29.513300] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51339 primary records. [2025-10-21T22:12:29.513777] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-10-21T22:12:29.514336] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51463 primary records. [2025-10-21T22:12:29.514883] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-10-21T22:12:29.545112] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-10-21T22:12:29.546380] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-10-21T22:12:29.546534] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-10-21T22:12:29.550200] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-10-21T22:12:29.550117] [INFO ] [MAIN ] Derivative Progress: 1313/2057 symbols completed. NVS took 1.2s. Estimated remaining: 4m 42s. Rate: 158.5 symbols/min [2025-10-21T22:12:29.550445] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:29.553276] [INFO ] [MAIN ] Derivative Progress: 1314/2057 symbols completed. NVST took 1.1s. Estimated remaining: 4m 41s. Rate: 158.6 symbols/min [2025-10-21T22:12:29.553506] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:29.608951] [DEBUG] [LOCAL ] NVT: Loaded 51413 existing records from primary storage. [2025-10-21T22:12:29.609587] [DEBUG] [LOCAL ] NWN: Loaded 26539 existing records from primary storage. [2025-10-21T22:12:29.609698] [INFO ] [MAIN ] NVT: Loaded 51413 primary data records. [2025-10-21T22:12:29.609870] [INFO ] [MAIN ] NWN: Loaded 26539 primary data records. [2025-10-21T22:12:29.926476] [DEBUG] [LOCAL ] NWG: Loaded 51412 existing records from primary storage. [2025-10-21T22:12:30.011009] [INFO ] [MAIN ] NWG: Loaded 51412 primary data records. [2025-10-21T22:12:30.587879] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:12:30.588680] [INFO ] [MAIN ] NVT: Generated 1793 derivative records from 51413 primary records. [2025-10-21T22:12:30.588802] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-10-21T22:12:30.618674] [DEBUG] [LOCAL ] NVT: Derivative data saved (1793 records). [2025-10-21T22:12:30.619336] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-10-21T22:12:30.619249] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:30.620057] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26539 primary records. [2025-10-21T22:12:30.622178] [INFO ] [MAIN ] Derivative Progress: 1315/2057 symbols completed. NVT took 1.1s. Estimated remaining: 4m 41s. Rate: 158.4 symbols/min [2025-10-21T22:12:30.622332] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-10-21T22:12:30.622511] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:30.647012] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:30.650900] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51412 primary records. [2025-10-21T22:12:30.651059] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-10-21T22:12:30.652148] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-10-21T22:12:30.652809] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-10-21T22:12:30.654928] [INFO ] [MAIN ] Derivative Progress: 1316/2057 symbols completed. NWN took 1.1s. Estimated remaining: 4m 40s. Rate: 158.5 symbols/min [2025-10-21T22:12:30.655114] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:30.672276] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-10-21T22:12:30.681013] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-10-21T22:12:30.684581] [INFO ] [MAIN ] Derivative Progress: 1317/2057 symbols completed. NWG took 1.1s. Estimated remaining: 4m 40s. Rate: 158.6 symbols/min [2025-10-21T22:12:30.684858] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:30.688220] [DEBUG] [LOCAL ] NXC: Loaded 4031 existing records from primary storage. [2025-10-21T22:12:30.688378] [INFO ] [MAIN ] NXC: Loaded 4031 primary data records. [2025-10-21T22:12:30.788564] [DEBUG] [LOCAL ] NX: Loaded 33386 existing records from primary storage. [2025-10-21T22:12:30.808294] [INFO ] [MAIN ] NX: Loaded 33386 primary data records. [2025-10-21T22:12:30.896058] [DEBUG] [LOCAL ] NXDT: Loaded 14863 existing records from primary storage. [2025-10-21T22:12:30.932989] [INFO ] [MAIN ] NXDT: Loaded 14863 primary data records. [2025-10-21T22:12:31.695434] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:31.696468] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4031 primary records. [2025-10-21T22:12:31.697552] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-10-21T22:12:31.728867] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-10-21T22:12:31.729231] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:31.730101] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33386 primary records. [2025-10-21T22:12:31.729368] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-10-21T22:12:31.732203] [INFO ] [MAIN ] Derivative Progress: 1318/2057 symbols completed. NXC took 1.1s. Estimated remaining: 4m 40s. Rate: 158.4 symbols/min [2025-10-21T22:12:31.733255] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-10-21T22:12:31.751426] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-10-21T22:12:31.764084] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-10-21T22:12:31.766941] [INFO ] [MAIN ] Derivative Progress: 1319/2057 symbols completed. NX took 1.1s. Estimated remaining: 4m 39s. Rate: 158.5 symbols/min [2025-10-21T22:12:31.767447] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:31.768766] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 14863 primary records. [2025-10-21T22:12:31.768841] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-10-21T22:12:31.783585] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-10-21T22:12:31.783698] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-10-21T22:12:31.786395] [INFO ] [MAIN ] Derivative Progress: 1320/2057 symbols completed. NXDT took 1.1s. Estimated remaining: 4m 39s. Rate: 158.6 symbols/min [2025-10-21T22:12:31.787110] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:31.787002] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:31.786868] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:31.805385] [DEBUG] [LOCAL ] NXG: Loaded 10499 existing records from primary storage. [2025-10-21T22:12:31.805566] [INFO ] [MAIN ] NXG: Loaded 10499 primary data records. [2025-10-21T22:12:31.857231] [DEBUG] [LOCAL ] NXJ: Loaded 14817 existing records from primary storage. [2025-10-21T22:12:31.878431] [INFO ] [MAIN ] NXJ: Loaded 14817 primary data records. [2025-10-21T22:12:32.320212] [DEBUG] [LOCAL ] NXE: Loaded 53062 existing records from primary storage. [2025-10-21T22:12:32.328738] [INFO ] [MAIN ] NXE: Loaded 53062 primary data records. [2025-10-21T22:12:32.784097] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:32.785430] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10499 primary records. [2025-10-21T22:12:32.785697] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-10-21T22:12:32.801759] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-10-21T22:12:32.802011] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-10-21T22:12:32.804309] [INFO ] [MAIN ] Derivative Progress: 1321/2057 symbols completed. NXG took 1.0s. Estimated remaining: 4m 39s. Rate: 158.4 symbols/min [2025-10-21T22:12:32.804475] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:32.811863] [DEBUG] [LOCAL ] NXN: Loaded 2287 existing records from primary storage. [2025-10-21T22:12:32.819729] [INFO ] [MAIN ] NXN: Loaded 2287 primary data records. [2025-10-21T22:12:32.839892] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:32.861399] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14817 primary records. [2025-10-21T22:12:32.879542] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-10-21T22:12:32.938417] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-10-21T22:12:32.938519] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-10-21T22:12:32.944893] [INFO ] [MAIN ] Derivative Progress: 1322/2057 symbols completed. NXJ took 1.2s. Estimated remaining: 4m 38s. Rate: 158.5 symbols/min [2025-10-21T22:12:32.945077] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:33.038081] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:33.142137] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 53062 primary records. [2025-10-21T22:12:33.150761] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-10-21T22:12:33.156744] [DEBUG] [LOCAL ] NXP: Loaded 12283 existing records from primary storage. [2025-10-21T22:12:33.168738] [INFO ] [MAIN ] NXP: Loaded 12283 primary data records. [2025-10-21T22:12:33.227629] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-10-21T22:12:33.264029] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-10-21T22:12:33.277913] [INFO ] [MAIN ] Derivative Progress: 1323/2057 symbols completed. NXE took 1.5s. Estimated remaining: 4m 38s. Rate: 158.5 symbols/min [2025-10-21T22:12:33.278085] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:33.518501] [DEBUG] [LOCAL ] NXRT: Loaded 18938 existing records from primary storage. [2025-10-21T22:12:33.519528] [INFO ] [MAIN ] NXRT: Loaded 18938 primary data records. [2025-10-21T22:12:33.570612] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:33.578989] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2287 primary records. [2025-10-21T22:12:33.584291] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-10-21T22:12:33.633727] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-10-21T22:12:33.639488] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-10-21T22:12:33.658942] [INFO ] [MAIN ] Derivative Progress: 1324/2057 symbols completed. NXN took 0.9s. Estimated remaining: 4m 37s. Rate: 158.5 symbols/min [2025-10-21T22:12:33.675489] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:33.882378] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:33.883126] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12283 primary records. [2025-10-21T22:12:33.883875] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-10-21T22:12:33.902725] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-10-21T22:12:33.903025] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-10-21T22:12:33.906709] [INFO ] [MAIN ] Derivative Progress: 1325/2057 symbols completed. NXP took 1.0s. Estimated remaining: 4m 37s. Rate: 158.6 symbols/min [2025-10-21T22:12:33.907394] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:33.947835] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:33.962605] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 18938 primary records. [2025-10-21T22:12:33.962824] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-10-21T22:12:33.964177] [DEBUG] [LOCAL ] NYT: Loaded 49485 existing records from primary storage. [2025-10-21T22:12:33.964873] [INFO ] [MAIN ] NYT: Loaded 49485 primary data records. [2025-10-21T22:12:33.995843] [DEBUG] [LOCAL ] NZF: Loaded 28757 existing records from primary storage. [2025-10-21T22:12:34.009985] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-10-21T22:12:34.020231] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-10-21T22:12:34.005234] [INFO ] [MAIN ] NZF: Loaded 28757 primary data records. [2025-10-21T22:12:34.027636] [INFO ] [MAIN ] Derivative Progress: 1326/2057 symbols completed. NXRT took 0.7s. Estimated remaining: 4m 36s. Rate: 158.7 symbols/min [2025-10-21T22:12:34.055209] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:34.619624] [DEBUG] [LOCAL ] OBDC: Loaded 51730 existing records from primary storage. [2025-10-21T22:12:34.620030] [INFO ] [MAIN ] OBDC: Loaded 51730 primary data records. [2025-10-21T22:12:34.945712] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:34.952082] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 49485 primary records. [2025-10-21T22:12:34.952725] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-10-21T22:12:34.952427] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:34.954382] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 28757 primary records. [2025-10-21T22:12:34.954510] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-10-21T22:12:34.987085] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-10-21T22:12:34.993047] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-10-21T22:12:34.993279] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-10-21T22:12:34.994006] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-10-21T22:12:34.996942] [INFO ] [MAIN ] Derivative Progress: 1327/2057 symbols completed. NYT took 1.3s. Estimated remaining: 4m 36s. Rate: 158.5 symbols/min [2025-10-21T22:12:35.000138] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:35.002104] [INFO ] [MAIN ] Derivative Progress: 1328/2057 symbols completed. NZF took 1.1s. Estimated remaining: 4m 36s. Rate: 158.6 symbols/min [2025-10-21T22:12:35.002478] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:35.016195] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:35.016916] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51730 primary records. [2025-10-21T22:12:35.017056] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-10-21T22:12:35.040477] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-10-21T22:12:35.040617] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-10-21T22:12:35.049623] [INFO ] [MAIN ] Derivative Progress: 1329/2057 symbols completed. OBDC took 1.0s. Estimated remaining: 4m 35s. Rate: 158.7 symbols/min [2025-10-21T22:12:35.050562] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:35.050264] [DEBUG] [LOCAL ] OBK: Loaded 16436 existing records from primary storage. [2025-10-21T22:12:35.050818] [INFO ] [MAIN ] OBK: Loaded 16436 primary data records. [2025-10-21T22:12:35.169627] [DEBUG] [LOCAL ] OCFT: Loaded 7172 existing records from primary storage. [2025-10-21T22:12:35.170619] [INFO ] [MAIN ] OCFT: Loaded 7172 primary data records. [2025-10-21T22:12:35.274111] [DEBUG] [LOCAL ] OC: Loaded 44951 existing records from primary storage. [2025-10-21T22:12:35.286512] [INFO ] [MAIN ] OC: Loaded 44951 primary data records. [2025-10-21T22:12:36.021110] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:36.023072] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16436 primary records. [2025-10-21T22:12:36.023479] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-10-21T22:12:36.039970] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-10-21T22:12:36.040256] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-10-21T22:12:36.042397] [INFO ] [MAIN ] Derivative Progress: 1330/2057 symbols completed. OBK took 1.0s. Estimated remaining: 4m 35s. Rate: 158.5 symbols/min [2025-10-21T22:12:36.042669] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:36.060297] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:36.063062] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 7172 primary records. [2025-10-21T22:12:36.063818] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-10-21T22:12:36.094149] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-10-21T22:12:36.094877] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-10-21T22:12:36.094774] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:36.097422] [INFO ] [MAIN ] Derivative Progress: 1331/2057 symbols completed. OCFT took 1.0s. Estimated remaining: 4m 35s. Rate: 158.6 symbols/min [2025-10-21T22:12:36.098438] [INFO ] [MAIN ] OC: Generated 1794 derivative records from 44951 primary records. [2025-10-21T22:12:36.102914] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-10-21T22:12:36.102468] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:36.102752] [DEBUG] [LOCAL ] ODC: Loaded 8680 existing records from primary storage. [2025-10-21T22:12:36.104397] [INFO ] [MAIN ] ODC: Loaded 8680 primary data records. [2025-10-21T22:12:36.171245] [DEBUG] [LOCAL ] OC: Derivative data saved (1794 records). [2025-10-21T22:12:36.190287] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-10-21T22:12:36.204989] [INFO ] [MAIN ] Derivative Progress: 1332/2057 symbols completed. OC took 1.2s. Estimated remaining: 4m 34s. Rate: 158.7 symbols/min [2025-10-21T22:12:36.210919] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:36.440279] [DEBUG] [LOCAL ] ODV: Loaded 29925 existing records from primary storage. [2025-10-21T22:12:36.440611] [INFO ] [MAIN ] ODV: Loaded 29925 primary data records. [2025-10-21T22:12:36.566937] [DEBUG] [LOCAL ] OEC: Loaded 37212 existing records from primary storage. [2025-10-21T22:12:36.583028] [INFO ] [MAIN ] OEC: Loaded 37212 primary data records. [2025-10-21T22:12:37.125560] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:37.126478] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8680 primary records. [2025-10-21T22:12:37.126694] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-10-21T22:12:37.144007] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-10-21T22:12:37.144122] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-10-21T22:12:37.146104] [INFO ] [MAIN ] Derivative Progress: 1333/2057 symbols completed. ODC took 1.1s. Estimated remaining: 4m 34s. Rate: 158.5 symbols/min [2025-10-21T22:12:37.162473] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:37.163122] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 29925 primary records. [2025-10-21T22:12:37.163275] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-10-21T22:12:37.178917] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-10-21T22:12:37.179044] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-10-21T22:12:37.181272] [INFO ] [MAIN ] Derivative Progress: 1334/2057 symbols completed. ODV took 1.1s. Estimated remaining: 4m 33s. Rate: 158.6 symbols/min [2025-10-21T22:12:37.196730] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:37.197261] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37212 primary records. [2025-10-21T22:12:37.197319] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-10-21T22:12:37.212063] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-10-21T22:12:37.212119] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-10-21T22:12:37.214682] [INFO ] [MAIN ] Derivative Progress: 1335/2057 symbols completed. OEC took 1.0s. Estimated remaining: 4m 33s. Rate: 158.7 symbols/min [2025-10-21T22:12:37.215005] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:37.215098] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:37.215144] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:37.236394] [DEBUG] [LOCAL ] OFG: Loaded 20625 existing records from primary storage. [2025-10-21T22:12:37.236579] [INFO ] [MAIN ] OFG: Loaded 20625 primary data records. [2025-10-21T22:12:37.589190] [DEBUG] [LOCAL ] OGE: Loaded 45791 existing records from primary storage. [2025-10-21T22:12:37.589455] [INFO ] [MAIN ] OGE: Loaded 45791 primary data records. [2025-10-21T22:12:37.590166] [DEBUG] [LOCAL ] OGN: Loaded 53103 existing records from primary storage. [2025-10-21T22:12:37.601950] [INFO ] [MAIN ] OGN: Loaded 53103 primary data records. [2025-10-21T22:12:38.197254] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:38.199005] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 20625 primary records. [2025-10-21T22:12:38.199135] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-10-21T22:12:38.216523] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-10-21T22:12:38.217794] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-10-21T22:12:38.220761] [INFO ] [MAIN ] Derivative Progress: 1336/2057 symbols completed. OFG took 1.0s. Estimated remaining: 4m 33s. Rate: 158.5 symbols/min [2025-10-21T22:12:38.221103] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:38.240531] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:38.242384] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53103 primary records. [2025-10-21T22:12:38.242479] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-10-21T22:12:38.277551] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-10-21T22:12:38.285917] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-10-21T22:12:38.288197] [INFO ] [MAIN ] Derivative Progress: 1337/2057 symbols completed. OGN took 1.1s. Estimated remaining: 4m 32s. Rate: 158.6 symbols/min [2025-10-21T22:12:38.286243] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:38.289268] [INFO ] [MAIN ] OGE: Generated 1794 derivative records from 45791 primary records. [2025-10-21T22:12:38.289388] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:38.289636] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-10-21T22:12:38.316997] [DEBUG] [LOCAL ] OGE: Derivative data saved (1794 records). [2025-10-21T22:12:38.318025] [DEBUG] [LOCAL ] OGS: Loaded 34004 existing records from primary storage. [2025-10-21T22:12:38.318118] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-10-21T22:12:38.320639] [INFO ] [MAIN ] Derivative Progress: 1338/2057 symbols completed. OGE took 1.1s. Estimated remaining: 4m 32s. Rate: 158.7 symbols/min [2025-10-21T22:12:38.321047] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:38.320820] [INFO ] [MAIN ] OGS: Loaded 34004 primary data records. [2025-10-21T22:12:38.665616] [DEBUG] [LOCAL ] OHI: Loaded 51895 existing records from primary storage. [2025-10-21T22:12:38.665983] [INFO ] [MAIN ] OHI: Loaded 51895 primary data records. [2025-10-21T22:12:38.775961] [DEBUG] [LOCAL ] OI: Loaded 47059 existing records from primary storage. [2025-10-21T22:12:38.787309] [INFO ] [MAIN ] OI: Loaded 47059 primary data records. [2025-10-21T22:12:39.339071] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:39.339967] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 34004 primary records. [2025-10-21T22:12:39.340904] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-10-21T22:12:39.373504] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-10-21T22:12:39.373917] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-10-21T22:12:39.376058] [INFO ] [MAIN ] Derivative Progress: 1339/2057 symbols completed. OGS took 1.2s. Estimated remaining: 4m 32s. Rate: 158.5 symbols/min [2025-10-21T22:12:39.376686] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:39.376204] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:39.377494] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 51895 primary records. [2025-10-21T22:12:39.377611] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-10-21T22:12:39.394816] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-10-21T22:12:39.396296] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-10-21T22:12:39.398517] [INFO ] [MAIN ] Derivative Progress: 1340/2057 symbols completed. OHI took 1.1s. Estimated remaining: 4m 31s. Rate: 158.6 symbols/min [2025-10-21T22:12:39.398806] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:39.415428] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:39.416098] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47059 primary records. [2025-10-21T22:12:39.416206] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-10-21T22:12:39.423088] [DEBUG] [LOCAL ] OIA: Loaded 13046 existing records from primary storage. [2025-10-21T22:12:39.423390] [INFO ] [MAIN ] OIA: Loaded 13046 primary data records. [2025-10-21T22:12:39.465242] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-10-21T22:12:39.482485] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-10-21T22:12:39.484899] [INFO ] [MAIN ] Derivative Progress: 1341/2057 symbols completed. OI took 1.2s. Estimated remaining: 4m 31s. Rate: 158.7 symbols/min [2025-10-21T22:12:39.485164] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:39.787280] [DEBUG] [LOCAL ] OII: Loaded 41827 existing records from primary storage. [2025-10-21T22:12:39.788039] [INFO ] [MAIN ] OII: Loaded 41827 primary data records. [2025-10-21T22:12:39.901157] [DEBUG] [LOCAL ] OIS: Loaded 39895 existing records from primary storage. [2025-10-21T22:12:39.904562] [INFO ] [MAIN ] OIS: Loaded 39895 primary data records. [2025-10-21T22:12:40.408321] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:40.409760] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13046 primary records. [2025-10-21T22:12:40.410060] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-10-21T22:12:40.427233] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-10-21T22:12:40.427626] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-10-21T22:12:40.430705] [INFO ] [MAIN ] Derivative Progress: 1342/2057 symbols completed. OIA took 1.1s. Estimated remaining: 4m 31s. Rate: 158.5 symbols/min [2025-10-21T22:12:40.430876] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:40.446716] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:40.447411] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 41827 primary records. [2025-10-21T22:12:40.447589] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-10-21T22:12:40.467748] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-10-21T22:12:40.480288] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-10-21T22:12:40.483009] [INFO ] [MAIN ] Derivative Progress: 1343/2057 symbols completed. OII took 1.1s. Estimated remaining: 4m 30s. Rate: 158.6 symbols/min [2025-10-21T22:12:40.483454] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:40.483897] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:40.484902] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 39895 primary records. [2025-10-21T22:12:40.485050] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-10-21T22:12:40.500854] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-10-21T22:12:40.501066] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-10-21T22:12:40.503238] [INFO ] [MAIN ] Derivative Progress: 1344/2057 symbols completed. OIS took 1.0s. Estimated remaining: 4m 29s. Rate: 158.8 symbols/min [2025-10-21T22:12:40.503617] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:40.547744] [DEBUG] [LOCAL ] OLP: Loaded 10120 existing records from primary storage. [2025-10-21T22:12:40.542931] [DEBUG] [LOCAL ] OKE: Loaded 53576 existing records from primary storage. [2025-10-21T22:12:40.547993] [INFO ] [MAIN ] OLP: Loaded 10120 primary data records. [2025-10-21T22:12:40.548062] [INFO ] [MAIN ] OKE: Loaded 53576 primary data records. [2025-10-21T22:12:41.016047] [DEBUG] [LOCAL ] OLN: Loaded 52011 existing records from primary storage. [2025-10-21T22:12:41.060487] [INFO ] [MAIN ] OLN: Loaded 52011 primary data records. [2025-10-21T22:12:41.557581] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:41.571873] [INFO ] [MAIN ] OKE: Generated 1794 derivative records from 53576 primary records. [2025-10-21T22:12:41.572193] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:41.572262] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-10-21T22:12:41.574197] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 10120 primary records. [2025-10-21T22:12:41.583129] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-10-21T22:12:41.598557] [DEBUG] [LOCAL ] OKE: Derivative data saved (1794 records). [2025-10-21T22:12:41.603732] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-10-21T22:12:41.606894] [INFO ] [MAIN ] Derivative Progress: 1345/2057 symbols completed. OKE took 1.2s. Estimated remaining: 4m 29s. Rate: 158.5 symbols/min [2025-10-21T22:12:41.607120] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:41.609087] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-10-21T22:12:41.609198] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-10-21T22:12:41.611885] [INFO ] [MAIN ] Derivative Progress: 1346/2057 symbols completed. OLP took 1.1s. Estimated remaining: 4m 29s. Rate: 158.6 symbols/min [2025-10-21T22:12:41.612231] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:41.633763] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:41.634593] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 52011 primary records. [2025-10-21T22:12:41.634738] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-10-21T22:12:41.654263] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-10-21T22:12:41.654411] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-10-21T22:12:41.656867] [INFO ] [MAIN ] Derivative Progress: 1347/2057 symbols completed. OLN took 1.2s. Estimated remaining: 4m 28s. Rate: 158.7 symbols/min [2025-10-21T22:12:41.657066] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:41.704584] [DEBUG] [LOCAL ] OMF: Loaded 46466 existing records from primary storage. [2025-10-21T22:12:41.721012] [INFO ] [MAIN ] OMF: Loaded 46466 primary data records. [2025-10-21T22:12:41.734882] [DEBUG] [LOCAL ] OMC: Loaded 53292 existing records from primary storage. [2025-10-21T22:12:41.747055] [INFO ] [MAIN ] OMC: Loaded 53292 primary data records. [2025-10-21T22:12:41.974905] [DEBUG] [LOCAL ] OMI: Loaded 46212 existing records from primary storage. [2025-10-21T22:12:41.993989] [INFO ] [MAIN ] OMI: Loaded 46212 primary data records. [2025-10-21T22:12:42.885559] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:42.886881] [INFO ] [MAIN ] OMC: Generated 1794 derivative records from 53292 primary records. [2025-10-21T22:12:42.899989] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-10-21T22:12:42.901828] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:42.921719] [DEBUG] [LOCAL ] OMC: Derivative data saved (1794 records). [2025-10-21T22:12:42.920166] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46466 primary records. [2025-10-21T22:12:42.922384] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-10-21T22:12:42.923007] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-10-21T22:12:42.927302] [INFO ] [MAIN ] Derivative Progress: 1348/2057 symbols completed. OMC took 1.3s. Estimated remaining: 4m 28s. Rate: 158.5 symbols/min [2025-10-21T22:12:42.968216] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-10-21T22:12:42.968795] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-10-21T22:12:42.968615] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:42.972550] [INFO ] [MAIN ] Derivative Progress: 1349/2057 symbols completed. OMF took 1.4s. Estimated remaining: 4m 28s. Rate: 158.6 symbols/min [2025-10-21T22:12:42.973897] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 46212 primary records. [2025-10-21T22:12:42.974007] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-10-21T22:12:42.998914] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-10-21T22:12:42.999092] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-10-21T22:12:43.002885] [INFO ] [MAIN ] Derivative Progress: 1350/2057 symbols completed. OMI took 1.3s. Estimated remaining: 4m 27s. Rate: 158.7 symbols/min [2025-10-21T22:12:43.003459] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:43.003718] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:43.003586] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:43.018460] [DEBUG] [LOCAL ] ONIT: Loaded 7582 existing records from primary storage. [2025-10-21T22:12:43.018878] [INFO ] [MAIN ] ONIT: Loaded 7582 primary data records. [2025-10-21T22:12:43.189633] [DEBUG] [LOCAL ] ONL: Loaded 29123 existing records from primary storage. [2025-10-21T22:12:43.212566] [INFO ] [MAIN ] ONL: Loaded 29123 primary data records. [2025-10-21T22:12:43.397425] [DEBUG] [LOCAL ] ONON: Loaded 53614 existing records from primary storage. [2025-10-21T22:12:43.440961] [INFO ] [MAIN ] ONON: Loaded 53614 primary data records. [2025-10-21T22:12:44.170197] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:44.171373] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7582 primary records. [2025-10-21T22:12:44.173627] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-10-21T22:12:44.198812] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:44.202140] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 29123 primary records. [2025-10-21T22:12:44.202669] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-10-21T22:12:44.203822] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-10-21T22:12:44.203887] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-10-21T22:12:44.212613] [INFO ] [MAIN ] Derivative Progress: 1351/2057 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 27s. Rate: 158.4 symbols/min [2025-10-21T22:12:44.226034] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:44.226438] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-10-21T22:12:44.229837] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-10-21T22:12:44.232842] [INFO ] [MAIN ] Derivative Progress: 1352/2057 symbols completed. ONL took 1.2s. Estimated remaining: 4m 27s. Rate: 158.5 symbols/min [2025-10-21T22:12:44.233252] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:44.247311] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:44.248005] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53614 primary records. [2025-10-21T22:12:44.248066] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-10-21T22:12:44.269015] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-10-21T22:12:44.269215] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-10-21T22:12:44.271740] [INFO ] [MAIN ] Derivative Progress: 1353/2057 symbols completed. ONON took 1.3s. Estimated remaining: 4m 26s. Rate: 158.6 symbols/min [2025-10-21T22:12:44.272021] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:44.281770] [DEBUG] [LOCAL ] ONTF: Loaded 22574 existing records from primary storage. [2025-10-21T22:12:44.281875] [INFO ] [MAIN ] ONTF: Loaded 22574 primary data records. [2025-10-21T22:12:44.431631] [DEBUG] [LOCAL ] OOMA: Loaded 18367 existing records from primary storage. [2025-10-21T22:12:44.442742] [INFO ] [MAIN ] OOMA: Loaded 18367 primary data records. [2025-10-21T22:12:44.737126] [DEBUG] [LOCAL ] ONTO: Loaded 47225 existing records from primary storage. [2025-10-21T22:12:44.741430] [INFO ] [MAIN ] ONTO: Loaded 47225 primary data records. [2025-10-21T22:12:45.269840] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:45.270740] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 22574 primary records. [2025-10-21T22:12:45.271276] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-10-21T22:12:45.289242] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-10-21T22:12:45.289516] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-10-21T22:12:45.291582] [INFO ] [MAIN ] Derivative Progress: 1354/2057 symbols completed. ONTF took 1.1s. Estimated remaining: 4m 26s. Rate: 158.4 symbols/min [2025-10-21T22:12:45.292124] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:45.306037] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:45.306760] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 18367 primary records. [2025-10-21T22:12:45.306878] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-10-21T22:12:45.325785] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-10-21T22:12:45.326067] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-10-21T22:12:45.340811] [INFO ] [MAIN ] Derivative Progress: 1355/2057 symbols completed. OOMA took 1.1s. Estimated remaining: 4m 26s. Rate: 158.5 symbols/min [2025-10-21T22:12:45.348466] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:45.348735] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:45.349550] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 47225 primary records. [2025-10-21T22:12:45.349765] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-10-21T22:12:45.367145] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-10-21T22:12:45.376331] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-10-21T22:12:45.378846] [INFO ] [MAIN ] Derivative Progress: 1356/2057 symbols completed. ONTO took 1.1s. Estimated remaining: 4m 25s. Rate: 158.7 symbols/min [2025-10-21T22:12:45.379019] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:45.380566] [DEBUG] [LOCAL ] OPAD: Loaded 26134 existing records from primary storage. [2025-10-21T22:12:45.380940] [INFO ] [MAIN ] OPAD: Loaded 26134 primary data records. [2025-10-21T22:12:45.512907] [DEBUG] [LOCAL ] OPP: Loaded 12372 existing records from primary storage. [2025-10-21T22:12:45.529535] [INFO ] [MAIN ] OPP: Loaded 12372 primary data records. [2025-10-21T22:12:45.854091] [DEBUG] [LOCAL ] OPFI: Loaded 46049 existing records from primary storage. [2025-10-21T22:12:45.876438] [INFO ] [MAIN ] OPFI: Loaded 46049 primary data records. [2025-10-21T22:12:46.376823] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:12:46.379052] [INFO ] [MAIN ] OPAD: Generated 1793 derivative records from 26134 primary records. [2025-10-21T22:12:46.379427] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-10-21T22:12:46.411334] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1793 records). [2025-10-21T22:12:46.412463] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:46.413517] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 12372 primary records. [2025-10-21T22:12:46.412636] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-10-21T22:12:46.416245] [INFO ] [MAIN ] Derivative Progress: 1357/2057 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 25s. Rate: 158.4 symbols/min [2025-10-21T22:12:46.416743] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:46.416592] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-10-21T22:12:46.433555] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-10-21T22:12:46.434322] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-10-21T22:12:46.437217] [INFO ] [MAIN ] Derivative Progress: 1358/2057 symbols completed. OPP took 1.1s. Estimated remaining: 4m 25s. Rate: 158.6 symbols/min [2025-10-21T22:12:46.437453] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:46.453793] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:46.454596] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46049 primary records. [2025-10-21T22:12:46.454849] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-10-21T22:12:46.474166] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-10-21T22:12:46.474377] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-10-21T22:12:46.477000] [INFO ] [MAIN ] Derivative Progress: 1359/2057 symbols completed. OPFI took 1.1s. Estimated remaining: 4m 24s. Rate: 158.7 symbols/min [2025-10-21T22:12:46.477215] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:46.537465] [DEBUG] [LOCAL ] OR: Loaded 46840 existing records from primary storage. [2025-10-21T22:12:46.537824] [INFO ] [MAIN ] OR: Loaded 46840 primary data records. [2025-10-21T22:12:46.543997] [DEBUG] [LOCAL ] ORA: Loaded 33184 existing records from primary storage. [2025-10-21T22:12:46.598517] [INFO ] [MAIN ] ORA: Loaded 33184 primary data records. [2025-10-21T22:12:46.806264] [DEBUG] [LOCAL ] ORC: Loaded 52485 existing records from primary storage. [2025-10-21T22:12:46.989855] [INFO ] [MAIN ] ORC: Loaded 52485 primary data records. [2025-10-21T22:12:47.576089] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:47.577565] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 46840 primary records. [2025-10-21T22:12:47.578030] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-10-21T22:12:47.597466] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-10-21T22:12:47.597856] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-10-21T22:12:47.601442] [INFO ] [MAIN ] Derivative Progress: 1360/2057 symbols completed. OR took 1.2s. Estimated remaining: 4m 24s. Rate: 158.4 symbols/min [2025-10-21T22:12:47.601624] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:47.619544] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:47.620675] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 33184 primary records. [2025-10-21T22:12:47.620897] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-10-21T22:12:47.640197] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-10-21T22:12:47.640444] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-10-21T22:12:47.643020] [INFO ] [MAIN ] Derivative Progress: 1361/2057 symbols completed. ORA took 1.2s. Estimated remaining: 4m 23s. Rate: 158.5 symbols/min [2025-10-21T22:12:47.643351] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:47.660370] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:47.669615] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52485 primary records. [2025-10-21T22:12:47.669858] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-10-21T22:12:47.700067] [DEBUG] [LOCAL ] ORN: Loaded 30771 existing records from primary storage. [2025-10-21T22:12:47.700167] [INFO ] [MAIN ] ORN: Loaded 30771 primary data records. [2025-10-21T22:12:47.699195] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-10-21T22:12:47.712296] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-10-21T22:12:47.715352] [INFO ] [MAIN ] Derivative Progress: 1362/2057 symbols completed. ORC took 1.2s. Estimated remaining: 4m 23s. Rate: 158.6 symbols/min [2025-10-21T22:12:47.742883] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:48.045169] [DEBUG] [LOCAL ] OSCR: Loaded 53769 existing records from primary storage. [2025-10-21T22:12:48.045470] [INFO ] [MAIN ] OSCR: Loaded 53769 primary data records. [2025-10-21T22:12:48.221506] [DEBUG] [LOCAL ] OTIS: Loaded 52718 existing records from primary storage. [2025-10-21T22:12:48.252041] [INFO ] [MAIN ] OTIS: Loaded 52718 primary data records. [2025-10-21T22:12:48.586089] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:48.613395] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 30771 primary records. [2025-10-21T22:12:48.725992] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-10-21T22:12:48.751694] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-10-21T22:12:48.752444] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-10-21T22:12:48.755102] [INFO ] [MAIN ] Derivative Progress: 1363/2057 symbols completed. ORN took 1.2s. Estimated remaining: 4m 23s. Rate: 158.4 symbols/min [2025-10-21T22:12:48.772873] [DEBUG] [MAIN ] OSCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:48.773738] [INFO ] [MAIN ] OSCR: Generated 1794 derivative records from 53769 primary records. [2025-10-21T22:12:48.774053] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-10-21T22:12:48.790598] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1794 records). [2025-10-21T22:12:48.790833] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-10-21T22:12:48.793130] [INFO ] [MAIN ] Derivative Progress: 1364/2057 symbols completed. OSCR took 1.1s. Estimated remaining: 4m 22s. Rate: 158.5 symbols/min [2025-10-21T22:12:48.808575] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:48.809210] [INFO ] [MAIN ] OTIS: Generated 1794 derivative records from 52718 primary records. [2025-10-21T22:12:48.809269] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-10-21T22:12:48.824139] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1794 records). [2025-10-21T22:12:48.824194] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-10-21T22:12:48.827089] [INFO ] [MAIN ] Derivative Progress: 1365/2057 symbols completed. OTIS took 1.1s. Estimated remaining: 4m 22s. Rate: 158.6 symbols/min [2025-10-21T22:12:48.827754] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:48.827828] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:48.828021] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:48.913732] [DEBUG] [LOCAL ] OVV: Loaded 53467 existing records from primary storage. [2025-10-21T22:12:48.914826] [INFO ] [MAIN ] OVV: Loaded 53467 primary data records. [2025-10-21T22:12:48.915464] [DEBUG] [LOCAL ] OUT: Loaded 47722 existing records from primary storage. [2025-10-21T22:12:48.926728] [INFO ] [MAIN ] OUT: Loaded 47722 primary data records. [2025-10-21T22:12:49.093070] [DEBUG] [LOCAL ] OWL: Loaded 53557 existing records from primary storage. [2025-10-21T22:12:49.123632] [INFO ] [MAIN ] OWL: Loaded 53557 primary data records. [2025-10-21T22:12:49.897365] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:49.902916] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53467 primary records. [2025-10-21T22:12:49.903541] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-10-21T22:12:49.903876] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:49.904480] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 47722 primary records. [2025-10-21T22:12:49.905342] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-10-21T22:12:49.934836] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-10-21T22:12:49.935043] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-10-21T22:12:49.953000] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:12:49.938199] [INFO ] [MAIN ] Derivative Progress: 1366/2057 symbols completed. OVV took 1.1s. Estimated remaining: 4m 22s. Rate: 158.4 symbols/min [2025-10-21T22:12:49.954058] [INFO ] [MAIN ] OWL: Generated 1793 derivative records from 53557 primary records. [2025-10-21T22:12:49.954150] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-10-21T22:12:49.955316] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:49.969451] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-10-21T22:12:49.972358] [DEBUG] [LOCAL ] OWL: Derivative data saved (1793 records). [2025-10-21T22:12:49.972494] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-10-21T22:12:49.972712] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-10-21T22:12:49.975299] [INFO ] [MAIN ] Derivative Progress: 1367/2057 symbols completed. OUT took 1.1s. Estimated remaining: 4m 21s. Rate: 158.5 symbols/min [2025-10-21T22:12:49.977865] [INFO ] [MAIN ] Derivative Progress: 1368/2057 symbols completed. OWL took 1.1s. Estimated remaining: 4m 21s. Rate: 158.6 symbols/min [2025-10-21T22:12:49.977790] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:49.980592] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:49.986737] [DEBUG] [LOCAL ] OWLT: Loaded 9535 existing records from primary storage. [2025-10-21T22:12:49.987016] [INFO ] [MAIN ] OWLT: Loaded 9535 primary data records. [2025-10-21T22:12:50.294473] [DEBUG] [LOCAL ] OXM: Loaded 33200 existing records from primary storage. [2025-10-21T22:12:50.315064] [INFO ] [MAIN ] OXM: Loaded 33200 primary data records. [2025-10-21T22:12:50.459687] [DEBUG] [LOCAL ] PAAS: Loaded 53625 existing records from primary storage. [2025-10-21T22:12:50.461107] [INFO ] [MAIN ] PAAS: Loaded 53625 primary data records. [2025-10-21T22:12:50.999288] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:51.000416] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 9535 primary records. [2025-10-21T22:12:51.001802] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-10-21T22:12:51.021108] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-10-21T22:12:51.021389] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-10-21T22:12:51.023516] [INFO ] [MAIN ] Derivative Progress: 1369/2057 symbols completed. OWLT took 1.1s. Estimated remaining: 4m 21s. Rate: 158.4 symbols/min [2025-10-21T22:12:51.024365] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:51.058000] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:51.058794] [DEBUG] [LOCAL ] PAC: Loaded 11632 existing records from primary storage. [2025-10-21T22:12:51.059917] [INFO ] [MAIN ] PAC: Loaded 11632 primary data records. [2025-10-21T22:12:51.059694] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33200 primary records. [2025-10-21T22:12:51.060211] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-10-21T22:12:51.144809] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-10-21T22:12:51.158104] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-10-21T22:12:51.172212] [INFO ] [MAIN ] Derivative Progress: 1370/2057 symbols completed. OXM took 1.2s. Estimated remaining: 4m 20s. Rate: 158.5 symbols/min [2025-10-21T22:12:51.172428] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:51.260849] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:51.295668] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53625 primary records. [2025-10-21T22:12:51.411939] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-10-21T22:12:51.437304] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-10-21T22:12:51.438592] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-10-21T22:12:51.442127] [INFO ] [MAIN ] Derivative Progress: 1371/2057 symbols completed. PAAS took 1.5s. Estimated remaining: 4m 20s. Rate: 158.5 symbols/min [2025-10-21T22:12:51.443024] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:51.456276] [DEBUG] [LOCAL ] PACK: Loaded 31920 existing records from primary storage. [2025-10-21T22:12:51.456743] [INFO ] [MAIN ] PACK: Loaded 31920 primary data records. [2025-10-21T22:12:51.659417] [DEBUG] [LOCAL ] PACS: Loaded 34755 existing records from primary storage. [2025-10-21T22:12:51.681375] [INFO ] [MAIN ] PACS: Loaded 34755 primary data records. [2025-10-21T22:12:51.856538] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:51.881180] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11632 primary records. [2025-10-21T22:12:51.908366] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-10-21T22:12:51.959934] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-10-21T22:12:51.981106] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-10-21T22:12:52.001730] [INFO ] [MAIN ] Derivative Progress: 1372/2057 symbols completed. PAC took 1.0s. Estimated remaining: 4m 19s. Rate: 158.5 symbols/min [2025-10-21T22:12:52.016967] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:52.196982] [DEBUG] [LOCAL ] PAG: Loaded 21325 existing records from primary storage. [2025-10-21T22:12:52.197504] [INFO ] [MAIN ] PAG: Loaded 21325 primary data records. [2025-10-21T22:12:52.197337] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:52.210939] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 31920 primary records. [2025-10-21T22:12:52.211280] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-10-21T22:12:52.336586] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-10-21T22:12:52.337714] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-10-21T22:12:52.351684] [INFO ] [MAIN ] Derivative Progress: 1373/2057 symbols completed. PACK took 1.2s. Estimated remaining: 4m 19s. Rate: 158.5 symbols/min [2025-10-21T22:12:52.358948] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:52.558553] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:52.568953] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 34755 primary records. [2025-10-21T22:12:52.569168] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-10-21T22:12:52.598674] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-10-21T22:12:52.599461] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-10-21T22:12:52.602773] [INFO ] [MAIN ] Derivative Progress: 1374/2057 symbols completed. PACS took 1.2s. Estimated remaining: 4m 19s. Rate: 158.5 symbols/min [2025-10-21T22:12:52.603337] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:52.612294] [DEBUG] [LOCAL ] PAI: Loaded 2836 existing records from primary storage. [2025-10-21T22:12:52.612808] [INFO ] [MAIN ] PAI: Loaded 2836 primary data records. [2025-10-21T22:12:52.959356] [DEBUG] [LOCAL ] PAGS: Loaded 52807 existing records from primary storage. [2025-10-21T22:12:52.970697] [INFO ] [MAIN ] PAGS: Loaded 52807 primary data records. [2025-10-21T22:12:52.970540] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:52.971487] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 21325 primary records. [2025-10-21T22:12:53.012223] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-10-21T22:12:53.106457] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-10-21T22:12:53.123191] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-10-21T22:12:53.125568] [INFO ] [MAIN ] Derivative Progress: 1375/2057 symbols completed. PAG took 1.1s. Estimated remaining: 4m 18s. Rate: 158.5 symbols/min [2025-10-21T22:12:53.153515] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:53.361986] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:53.362834] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2836 primary records. [2025-10-21T22:12:53.363816] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-10-21T22:12:53.389562] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-10-21T22:12:53.389931] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-10-21T22:12:53.392144] [INFO ] [MAIN ] Derivative Progress: 1376/2057 symbols completed. PAI took 0.8s. Estimated remaining: 4m 18s. Rate: 158.5 symbols/min [2025-10-21T22:12:53.392505] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:53.394286] [DEBUG] [LOCAL ] PAM: Loaded 29042 existing records from primary storage. [2025-10-21T22:12:53.394946] [INFO ] [MAIN ] PAM: Loaded 29042 primary data records. [2025-10-21T22:12:53.526632] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:53.598544] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52807 primary records. [2025-10-21T22:12:53.603317] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-10-21T22:12:53.779085] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-10-21T22:12:53.789812] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-10-21T22:12:53.794192] [INFO ] [MAIN ] Derivative Progress: 1377/2057 symbols completed. PAGS took 1.4s. Estimated remaining: 4m 17s. Rate: 158.5 symbols/min [2025-10-21T22:12:53.795780] [DEBUG] [LOCAL ] PAR: Loaded 34301 existing records from primary storage. [2025-10-21T22:12:53.796123] [INFO ] [MAIN ] PAR: Loaded 34301 primary data records. [2025-10-21T22:12:53.796543] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:54.150390] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:54.164866] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 29042 primary records. [2025-10-21T22:12:54.166990] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-10-21T22:12:54.170197] [DEBUG] [LOCAL ] PARR: Loaded 47969 existing records from primary storage. [2025-10-21T22:12:54.178384] [INFO ] [MAIN ] PARR: Loaded 47969 primary data records. [2025-10-21T22:12:54.222280] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-10-21T22:12:54.258202] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-10-21T22:12:54.273805] [INFO ] [MAIN ] Derivative Progress: 1378/2057 symbols completed. PAM took 1.1s. Estimated remaining: 4m 17s. Rate: 158.5 symbols/min [2025-10-21T22:12:54.520731] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:54.521683] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 34301 primary records. [2025-10-21T22:12:54.521818] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-10-21T22:12:54.539410] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-10-21T22:12:54.539697] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-10-21T22:12:54.541933] [INFO ] [MAIN ] Derivative Progress: 1379/2057 symbols completed. PAR took 1.1s. Estimated remaining: 4m 17s. Rate: 158.5 symbols/min [2025-10-21T22:12:54.560941] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:54.561569] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 47969 primary records. [2025-10-21T22:12:54.561629] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-10-21T22:12:54.577164] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-10-21T22:12:54.577239] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-10-21T22:12:54.579550] [INFO ] [MAIN ] Derivative Progress: 1380/2057 symbols completed. PARR took 0.8s. Estimated remaining: 4m 16s. Rate: 158.6 symbols/min [2025-10-21T22:12:54.580096] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:54.580229] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:54.580024] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:54.616764] [DEBUG] [LOCAL ] PAXS: Loaded 21037 existing records from primary storage. [2025-10-21T22:12:54.617069] [INFO ] [MAIN ] PAXS: Loaded 21037 primary data records. [2025-10-21T22:12:54.757156] [DEBUG] [LOCAL ] PAY: Loaded 38642 existing records from primary storage. [2025-10-21T22:12:54.763023] [INFO ] [MAIN ] PAY: Loaded 38642 primary data records. [2025-10-21T22:12:54.853495] [DEBUG] [LOCAL ] PATH: Loaded 53680 existing records from primary storage. [2025-10-21T22:12:54.925667] [INFO ] [MAIN ] PATH: Loaded 53680 primary data records. [2025-10-21T22:12:55.665917] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:55.667712] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 21037 primary records. [2025-10-21T22:12:55.668984] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-10-21T22:12:55.694391] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-10-21T22:12:55.699388] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-10-21T22:12:55.701898] [INFO ] [MAIN ] Derivative Progress: 1381/2057 symbols completed. PAXS took 1.1s. Estimated remaining: 4m 16s. Rate: 158.4 symbols/min [2025-10-21T22:12:55.702164] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:55.699996] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:55.703520] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38642 primary records. [2025-10-21T22:12:55.703681] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-10-21T22:12:55.722959] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-10-21T22:12:55.723291] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-10-21T22:12:55.733741] [INFO ] [MAIN ] Derivative Progress: 1382/2057 symbols completed. PAY took 1.2s. Estimated remaining: 4m 16s. Rate: 158.5 symbols/min [2025-10-21T22:12:55.738705] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:55.739707] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:55.740309] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53680 primary records. [2025-10-21T22:12:55.740419] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-10-21T22:12:55.756668] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-10-21T22:12:55.756893] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-10-21T22:12:55.759709] [INFO ] [MAIN ] Derivative Progress: 1383/2057 symbols completed. PATH took 1.2s. Estimated remaining: 4m 15s. Rate: 158.6 symbols/min [2025-10-21T22:12:55.759988] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:55.786143] [DEBUG] [LOCAL ] PAYC: Loaded 36168 existing records from primary storage. [2025-10-21T22:12:55.786363] [INFO ] [MAIN ] PAYC: Loaded 36168 primary data records. [2025-10-21T22:12:55.945783] [DEBUG] [LOCAL ] PB: Loaded 42332 existing records from primary storage. [2025-10-21T22:12:55.964449] [INFO ] [MAIN ] PB: Loaded 42332 primary data records. [2025-10-21T22:12:56.227022] [DEBUG] [LOCAL ] PBA: Loaded 49217 existing records from primary storage. [2025-10-21T22:12:56.236473] [INFO ] [MAIN ] PBA: Loaded 49217 primary data records. [2025-10-21T22:12:56.771547] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:56.773567] [INFO ] [MAIN ] PAYC: Generated 1794 derivative records from 36168 primary records. [2025-10-21T22:12:56.776194] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-10-21T22:12:56.806693] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1794 records). [2025-10-21T22:12:56.807963] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-10-21T22:12:56.811084] [INFO ] [MAIN ] Derivative Progress: 1384/2057 symbols completed. PAYC took 1.1s. Estimated remaining: 4m 15s. Rate: 158.4 symbols/min [2025-10-21T22:12:56.811414] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:56.811737] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:56.813114] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 42332 primary records. [2025-10-21T22:12:56.813224] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-10-21T22:12:56.831545] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-10-21T22:12:56.831993] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-10-21T22:12:56.834200] [INFO ] [MAIN ] Derivative Progress: 1385/2057 symbols completed. PB took 1.1s. Estimated remaining: 4m 14s. Rate: 158.5 symbols/min [2025-10-21T22:12:56.834594] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:56.849130] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:56.849829] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 49217 primary records. [2025-10-21T22:12:56.849985] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-10-21T22:12:56.866316] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-10-21T22:12:56.866593] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-10-21T22:12:56.869134] [INFO ] [MAIN ] Derivative Progress: 1386/2057 symbols completed. PBA took 1.1s. Estimated remaining: 4m 14s. Rate: 158.6 symbols/min [2025-10-21T22:12:56.869383] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:56.911361] [DEBUG] [LOCAL ] PBH: Loaded 32532 existing records from primary storage. [2025-10-21T22:12:56.912154] [INFO ] [MAIN ] PBH: Loaded 32532 primary data records. [2025-10-21T22:12:57.029405] [DEBUG] [LOCAL ] PBF: Loaded 53110 existing records from primary storage. [2025-10-21T22:12:57.054527] [INFO ] [MAIN ] PBF: Loaded 53110 primary data records. [2025-10-21T22:12:57.386522] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-10-21T22:12:57.410767] [INFO ] [MAIN ] PBR: Loaded 53713 primary data records. [2025-10-21T22:12:57.951852] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:57.952808] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 32532 primary records. [2025-10-21T22:12:57.952988] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-10-21T22:12:57.977741] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:57.978692] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53110 primary records. [2025-10-21T22:12:57.979232] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-10-21T22:12:57.992215] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-10-21T22:12:57.992357] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-10-21T22:12:57.995346] [INFO ] [MAIN ] Derivative Progress: 1387/2057 symbols completed. PBH took 1.2s. Estimated remaining: 4m 14s. Rate: 158.4 symbols/min [2025-10-21T22:12:57.999272] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:58.003797] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-10-21T22:12:58.004712] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-10-21T22:12:58.008181] [INFO ] [MAIN ] Derivative Progress: 1388/2057 symbols completed. PBF took 1.2s. Estimated remaining: 4m 13s. Rate: 158.5 symbols/min [2025-10-21T22:12:58.008587] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:58.022697] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:58.023533] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53713 primary records. [2025-10-21T22:12:58.023769] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-10-21T22:12:58.051342] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-10-21T22:12:58.051819] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-10-21T22:12:58.051610] [DEBUG] [LOCAL ] PCF: Loaded 9109 existing records from primary storage. [2025-10-21T22:12:58.054974] [INFO ] [MAIN ] Derivative Progress: 1389/2057 symbols completed. PBR took 1.2s. Estimated remaining: 4m 13s. Rate: 158.6 symbols/min [2025-10-21T22:12:58.055193] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:58.055335] [INFO ] [MAIN ] PCF: Loaded 9109 primary data records. [2025-10-21T22:12:58.130753] [DEBUG] [LOCAL ] PBT: Loaded 17447 existing records from primary storage. [2025-10-21T22:12:58.166346] [INFO ] [MAIN ] PBT: Loaded 17447 primary data records. [2025-10-21T22:12:58.700666] [DEBUG] [LOCAL ] PCG: Loaded 53719 existing records from primary storage. [2025-10-21T22:12:58.703302] [INFO ] [MAIN ] PCG: Loaded 53719 primary data records. [2025-10-21T22:12:59.027838] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:59.029844] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 9109 primary records. [2025-10-21T22:12:59.030429] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-10-21T22:12:59.065730] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-10-21T22:12:59.066074] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:59.067416] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17447 primary records. [2025-10-21T22:12:59.068275] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-10-21T22:12:59.067488] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-10-21T22:12:59.071516] [INFO ] [MAIN ] Derivative Progress: 1390/2057 symbols completed. PCF took 1.1s. Estimated remaining: 4m 13s. Rate: 158.4 symbols/min [2025-10-21T22:12:59.071950] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:59.088895] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-10-21T22:12:59.089396] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-10-21T22:12:59.092277] [INFO ] [MAIN ] Derivative Progress: 1391/2057 symbols completed. PBT took 1.1s. Estimated remaining: 4m 12s. Rate: 158.5 symbols/min [2025-10-21T22:12:59.092493] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:59.101594] [DEBUG] [LOCAL ] PCM: Loaded 6878 existing records from primary storage. [2025-10-21T22:12:59.102005] [INFO ] [MAIN ] PCM: Loaded 6878 primary data records. [2025-10-21T22:12:59.267154] [DEBUG] [MAIN ] PCG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:59.266866] [DEBUG] [LOCAL ] PCN: Loaded 25456 existing records from primary storage. [2025-10-21T22:12:59.267976] [INFO ] [MAIN ] PCG: Generated 1794 derivative records from 53719 primary records. [2025-10-21T22:12:59.268083] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-10-21T22:12:59.269151] [INFO ] [MAIN ] PCN: Loaded 25456 primary data records. [2025-10-21T22:12:59.304560] [DEBUG] [LOCAL ] PCG: Derivative data saved (1794 records). [2025-10-21T22:12:59.324267] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-10-21T22:12:59.365063] [INFO ] [MAIN ] Derivative Progress: 1392/2057 symbols completed. PCG took 1.3s. Estimated remaining: 4m 12s. Rate: 158.5 symbols/min [2025-10-21T22:12:59.404679] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:12:59.872276] [DEBUG] [LOCAL ] PCOR: Loaded 47534 existing records from primary storage. [2025-10-21T22:12:59.873508] [INFO ] [MAIN ] PCOR: Loaded 47534 primary data records. [2025-10-21T22:12:59.987928] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:12:59.992310] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6878 primary records. [2025-10-21T22:12:59.992453] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-10-21T22:13:00.184888] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-10-21T22:13:00.193432] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-10-21T22:13:00.195667] [INFO ] [MAIN ] Derivative Progress: 1393/2057 symbols completed. PCM took 1.1s. Estimated remaining: 4m 12s. Rate: 158.4 symbols/min [2025-10-21T22:13:00.212417] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:00.213473] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 25456 primary records. [2025-10-21T22:13:00.213550] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-10-21T22:13:00.229972] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-10-21T22:13:00.230052] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-10-21T22:13:00.232532] [INFO ] [MAIN ] Derivative Progress: 1394/2057 symbols completed. PCN took 1.1s. Estimated remaining: 4m 11s. Rate: 158.5 symbols/min [2025-10-21T22:13:00.249052] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:00.249552] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 47534 primary records. [2025-10-21T22:13:00.249607] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-10-21T22:13:00.264024] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-10-21T22:13:00.264079] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-10-21T22:13:00.266414] [INFO ] [MAIN ] Derivative Progress: 1395/2057 symbols completed. PCOR took 0.9s. Estimated remaining: 4m 10s. Rate: 158.6 symbols/min [2025-10-21T22:13:00.266874] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:00.266932] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:00.266817] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:00.280310] [DEBUG] [LOCAL ] PCQ: Loaded 12158 existing records from primary storage. [2025-10-21T22:13:00.280433] [INFO ] [MAIN ] PCQ: Loaded 12158 primary data records. [2025-10-21T22:13:00.610230] [DEBUG] [LOCAL ] PD: Loaded 48330 existing records from primary storage. [2025-10-21T22:13:00.610992] [INFO ] [MAIN ] PD: Loaded 48330 primary data records. [2025-10-21T22:13:00.730682] [DEBUG] [LOCAL ] PDI: Loaded 50192 existing records from primary storage. [2025-10-21T22:13:00.737001] [INFO ] [MAIN ] PDI: Loaded 50192 primary data records. [2025-10-21T22:13:01.240936] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:01.242137] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12158 primary records. [2025-10-21T22:13:01.242612] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-10-21T22:13:01.258662] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-10-21T22:13:01.258784] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-10-21T22:13:01.261264] [INFO ] [MAIN ] Derivative Progress: 1396/2057 symbols completed. PCQ took 1.0s. Estimated remaining: 4m 10s. Rate: 158.4 symbols/min [2025-10-21T22:13:01.261506] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:01.280965] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:01.281862] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 48330 primary records. [2025-10-21T22:13:01.282253] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-10-21T22:13:01.310371] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-10-21T22:13:01.312322] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-10-21T22:13:01.315166] [INFO ] [MAIN ] Derivative Progress: 1397/2057 symbols completed. PD took 1.0s. Estimated remaining: 4m 10s. Rate: 158.5 symbols/min [2025-10-21T22:13:01.315577] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:01.332200] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:01.333065] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50192 primary records. [2025-10-21T22:13:01.333780] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-10-21T22:13:01.355905] [DEBUG] [LOCAL ] PDM: Loaded 39841 existing records from primary storage. [2025-10-21T22:13:01.358809] [INFO ] [MAIN ] PDM: Loaded 39841 primary data records. [2025-10-21T22:13:01.459928] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-10-21T22:13:01.472844] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-10-21T22:13:01.487304] [INFO ] [MAIN ] Derivative Progress: 1398/2057 symbols completed. PDI took 1.2s. Estimated remaining: 4m 9s. Rate: 158.6 symbols/min [2025-10-21T22:13:01.488822] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:01.536957] [DEBUG] [LOCAL ] PDO: Loaded 31531 existing records from primary storage. [2025-10-21T22:13:01.667540] [INFO ] [MAIN ] PDO: Loaded 31531 primary data records. [2025-10-21T22:13:01.749459] [DEBUG] [LOCAL ] PDS: Loaded 16771 existing records from primary storage. [2025-10-21T22:13:01.766387] [INFO ] [MAIN ] PDS: Loaded 16771 primary data records. [2025-10-21T22:13:02.405121] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:02.406197] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39841 primary records. [2025-10-21T22:13:02.406350] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-10-21T22:13:02.431547] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-10-21T22:13:02.431674] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-10-21T22:13:02.442263] [INFO ] [MAIN ] Derivative Progress: 1399/2057 symbols completed. PDM took 1.2s. Estimated remaining: 4m 9s. Rate: 158.4 symbols/min [2025-10-21T22:13:02.447754] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:02.448531] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:02.449312] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31531 primary records. [2025-10-21T22:13:02.449757] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-10-21T22:13:02.477188] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-10-21T22:13:02.483012] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-10-21T22:13:02.490820] [INFO ] [MAIN ] Derivative Progress: 1400/2057 symbols completed. PDO took 1.2s. Estimated remaining: 4m 9s. Rate: 158.5 symbols/min [2025-10-21T22:13:02.483337] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:02.491819] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 16771 primary records. [2025-10-21T22:13:02.492069] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:02.492277] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-10-21T22:13:02.500804] [DEBUG] [LOCAL ] PDT: Loaded 17479 existing records from primary storage. [2025-10-21T22:13:02.510014] [INFO ] [MAIN ] PDT: Loaded 17479 primary data records. [2025-10-21T22:13:02.566972] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-10-21T22:13:02.579207] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-10-21T22:13:02.602393] [INFO ] [MAIN ] Derivative Progress: 1401/2057 symbols completed. PDS took 1.1s. Estimated remaining: 4m 8s. Rate: 158.6 symbols/min [2025-10-21T22:13:02.614138] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:02.634889] [DEBUG] [LOCAL ] PDX: Loaded 14225 existing records from primary storage. [2025-10-21T22:13:02.638775] [INFO ] [MAIN ] PDX: Loaded 14225 primary data records. [2025-10-21T22:13:03.161965] [DEBUG] [LOCAL ] PEB: Loaded 50735 existing records from primary storage. [2025-10-21T22:13:03.164013] [INFO ] [MAIN ] PEB: Loaded 50735 primary data records. [2025-10-21T22:13:03.534420] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:03.536096] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17479 primary records. [2025-10-21T22:13:03.536773] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-10-21T22:13:03.570363] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-10-21T22:13:03.571027] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:03.571457] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-10-21T22:13:03.572416] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14225 primary records. [2025-10-21T22:13:03.574826] [INFO ] [MAIN ] Derivative Progress: 1402/2057 symbols completed. PDT took 1.1s. Estimated remaining: 4m 8s. Rate: 158.4 symbols/min [2025-10-21T22:13:03.575298] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:03.574941] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-10-21T22:13:03.593105] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-10-21T22:13:03.593529] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-10-21T22:13:03.596261] [INFO ] [MAIN ] Derivative Progress: 1403/2057 symbols completed. PDX took 1.1s. Estimated remaining: 4m 8s. Rate: 158.5 symbols/min [2025-10-21T22:13:03.596563] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:03.613290] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:03.614136] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50735 primary records. [2025-10-21T22:13:03.614289] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-10-21T22:13:03.630744] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-10-21T22:13:03.630933] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-10-21T22:13:03.633458] [INFO ] [MAIN ] Derivative Progress: 1404/2057 symbols completed. PEB took 1.0s. Estimated remaining: 4m 7s. Rate: 158.6 symbols/min [2025-10-21T22:13:03.633826] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:03.668666] [DEBUG] [LOCAL ] PEN: Loaded 29689 existing records from primary storage. [2025-10-21T22:13:03.669634] [INFO ] [MAIN ] PEN: Loaded 29689 primary data records. [2025-10-21T22:13:03.710464] [DEBUG] [LOCAL ] PEO: Loaded 11168 existing records from primary storage. [2025-10-21T22:13:03.781903] [DEBUG] [LOCAL ] PEG: Loaded 53139 existing records from primary storage. [2025-10-21T22:13:03.789402] [INFO ] [MAIN ] PEO: Loaded 11168 primary data records. [2025-10-21T22:13:03.792620] [INFO ] [MAIN ] PEG: Loaded 53139 primary data records. [2025-10-21T22:13:04.652305] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:04.654374] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 29689 primary records. [2025-10-21T22:13:04.654473] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-10-21T22:13:04.673140] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-10-21T22:13:04.674748] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-10-21T22:13:04.677164] [INFO ] [MAIN ] Derivative Progress: 1405/2057 symbols completed. PEN took 1.1s. Estimated remaining: 4m 7s. Rate: 158.4 symbols/min [2025-10-21T22:13:04.677918] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:04.693509] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:04.696316] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 11168 primary records. [2025-10-21T22:13:04.700475] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-10-21T22:13:04.729669] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-10-21T22:13:04.721448] [DEBUG] [MAIN ] PEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:04.735182] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-10-21T22:13:04.737569] [INFO ] [MAIN ] Derivative Progress: 1406/2057 symbols completed. PEO took 1.1s. Estimated remaining: 4m 6s. Rate: 158.5 symbols/min [2025-10-21T22:13:04.737804] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:04.738618] [INFO ] [MAIN ] PEG: Generated 1794 derivative records from 53139 primary records. [2025-10-21T22:13:04.739377] [DEBUG] [LOCAL ] PERF: Loaded 14530 existing records from primary storage. [2025-10-21T22:13:04.739857] [INFO ] [MAIN ] PERF: Loaded 14530 primary data records. [2025-10-21T22:13:04.784843] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-10-21T22:13:04.829876] [DEBUG] [LOCAL ] PFD: Loaded 5399 existing records from primary storage. [2025-10-21T22:13:04.861156] [INFO ] [MAIN ] PFD: Loaded 5399 primary data records. [2025-10-21T22:13:05.038300] [DEBUG] [LOCAL ] PEG: Derivative data saved (1794 records). [2025-10-21T22:13:05.051820] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-10-21T22:13:05.173954] [INFO ] [MAIN ] Derivative Progress: 1407/2057 symbols completed. PEG took 1.6s. Estimated remaining: 4m 6s. Rate: 158.5 symbols/min [2025-10-21T22:13:05.185809] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:05.410981] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:05.411787] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14530 primary records. [2025-10-21T22:13:05.412143] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-10-21T22:13:05.467169] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-10-21T22:13:05.467417] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-10-21T22:13:05.470356] [INFO ] [MAIN ] Derivative Progress: 1408/2057 symbols completed. PERF took 0.8s. Estimated remaining: 4m 6s. Rate: 158.5 symbols/min [2025-10-21T22:13:05.465736] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:05.473086] [DEBUG] [LOCAL ] PFE: Loaded 53813 existing records from primary storage. [2025-10-21T22:13:05.474560] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5399 primary records. [2025-10-21T22:13:05.473514] [INFO ] [MAIN ] PFE: Loaded 53813 primary data records. [2025-10-21T22:13:05.474754] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-10-21T22:13:05.604050] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-10-21T22:13:05.614481] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-10-21T22:13:05.635004] [INFO ] [MAIN ] Derivative Progress: 1409/2057 symbols completed. PFD took 0.9s. Estimated remaining: 4m 5s. Rate: 158.6 symbols/min [2025-10-21T22:13:05.832941] [DEBUG] [MAIN ] PFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:05.833685] [INFO ] [MAIN ] PFE: Generated 1794 derivative records from 53813 primary records. [2025-10-21T22:13:05.833782] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-10-21T22:13:05.849586] [DEBUG] [LOCAL ] PFE: Derivative data saved (1794 records). [2025-10-21T22:13:05.849665] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-10-21T22:13:05.852292] [INFO ] [MAIN ] Derivative Progress: 1410/2057 symbols completed. PFE took 0.7s. Estimated remaining: 4m 5s. Rate: 158.6 symbols/min [2025-10-21T22:13:05.853224] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:05.853123] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:05.853537] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:05.868501] [DEBUG] [LOCAL ] PFH: Loaded 6451 existing records from primary storage. [2025-10-21T22:13:05.868615] [INFO ] [MAIN ] PFH: Loaded 6451 primary data records. [2025-10-21T22:13:05.910831] [DEBUG] [LOCAL ] PFL: Loaded 14565 existing records from primary storage. [2025-10-21T22:13:05.930040] [INFO ] [MAIN ] PFL: Loaded 14565 primary data records. [2025-10-21T22:13:06.365550] [DEBUG] [LOCAL ] PFGC: Loaded 46930 existing records from primary storage. [2025-10-21T22:13:06.389667] [INFO ] [MAIN ] PFGC: Loaded 46930 primary data records. [2025-10-21T22:13:06.846020] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:06.848105] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6451 primary records. [2025-10-21T22:13:06.850485] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-10-21T22:13:06.876852] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:06.880572] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-10-21T22:13:06.881746] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 14565 primary records. [2025-10-21T22:13:06.882018] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-10-21T22:13:06.880907] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-10-21T22:13:06.884403] [INFO ] [MAIN ] Derivative Progress: 1411/2057 symbols completed. PFH took 1.0s. Estimated remaining: 4m 5s. Rate: 158.4 symbols/min [2025-10-21T22:13:06.885498] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:06.903254] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-10-21T22:13:06.903516] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-10-21T22:13:06.905868] [INFO ] [MAIN ] Derivative Progress: 1412/2057 symbols completed. PFL took 1.1s. Estimated remaining: 4m 4s. Rate: 158.5 symbols/min [2025-10-21T22:13:06.906023] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:06.924475] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:06.925225] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 46930 primary records. [2025-10-21T22:13:06.925430] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-10-21T22:13:06.941451] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-10-21T22:13:06.941633] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-10-21T22:13:06.944135] [INFO ] [MAIN ] Derivative Progress: 1413/2057 symbols completed. PFGC took 1.1s. Estimated remaining: 4m 4s. Rate: 158.6 symbols/min [2025-10-21T22:13:06.944458] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:06.970073] [DEBUG] [LOCAL ] PFN: Loaded 22317 existing records from primary storage. [2025-10-21T22:13:06.970255] [INFO ] [MAIN ] PFN: Loaded 22317 primary data records. [2025-10-21T22:13:06.973776] [DEBUG] [LOCAL ] PFO: Loaded 6109 existing records from primary storage. [2025-10-21T22:13:06.994706] [INFO ] [MAIN ] PFO: Loaded 6109 primary data records. [2025-10-21T22:13:07.136836] [DEBUG] [LOCAL ] PFLT: Loaded 44325 existing records from primary storage. [2025-10-21T22:13:07.182766] [INFO ] [MAIN ] PFLT: Loaded 44325 primary data records. [2025-10-21T22:13:07.958018] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:07.960065] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 22317 primary records. [2025-10-21T22:13:07.960254] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-10-21T22:13:08.001786] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-10-21T22:13:08.002214] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-10-21T22:13:08.003700] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:08.006105] [INFO ] [MAIN ] Derivative Progress: 1414/2057 symbols completed. PFN took 1.1s. Estimated remaining: 4m 3s. Rate: 158.4 symbols/min [2025-10-21T22:13:08.006912] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 44325 primary records. [2025-10-21T22:13:08.002989] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:08.007266] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-10-21T22:13:08.007065] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:08.008185] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 6109 primary records. [2025-10-21T22:13:08.008778] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-10-21T22:13:08.036574] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-10-21T22:13:08.038267] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-10-21T22:13:08.041965] [INFO ] [MAIN ] Derivative Progress: 1415/2057 symbols completed. PFO took 1.1s. Estimated remaining: 4m 3s. Rate: 158.5 symbols/min [2025-10-21T22:13:08.043440] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:08.043302] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-10-21T22:13:08.043674] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-10-21T22:13:08.046813] [INFO ] [MAIN ] Derivative Progress: 1416/2057 symbols completed. PFLT took 1.2s. Estimated remaining: 4m 2s. Rate: 158.7 symbols/min [2025-10-21T22:13:08.046973] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:08.076392] [DEBUG] [LOCAL ] PFS: Loaded 35763 existing records from primary storage. [2025-10-21T22:13:08.084697] [INFO ] [MAIN ] PFS: Loaded 35763 primary data records. [2025-10-21T22:13:08.194516] [DEBUG] [LOCAL ] PFSI: Loaded 29123 existing records from primary storage. [2025-10-21T22:13:08.197998] [INFO ] [MAIN ] PFSI: Loaded 29123 primary data records. [2025-10-21T22:13:08.535841] [DEBUG] [LOCAL ] PG: Loaded 53753 existing records from primary storage. [2025-10-21T22:13:08.541759] [INFO ] [MAIN ] PG: Loaded 53753 primary data records. [2025-10-21T22:13:09.065079] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:09.066558] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35763 primary records. [2025-10-21T22:13:09.067306] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-10-21T22:13:09.097500] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-10-21T22:13:09.097944] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-10-21T22:13:09.098116] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:09.098866] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 29123 primary records. [2025-10-21T22:13:09.101742] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-10-21T22:13:09.101635] [INFO ] [MAIN ] Derivative Progress: 1417/2057 symbols completed. PFS took 1.1s. Estimated remaining: 4m 2s. Rate: 158.5 symbols/min [2025-10-21T22:13:09.102809] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:09.121126] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-10-21T22:13:09.122992] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-10-21T22:13:09.125191] [INFO ] [MAIN ] Derivative Progress: 1418/2057 symbols completed. PFSI took 1.1s. Estimated remaining: 4m 2s. Rate: 158.6 symbols/min [2025-10-21T22:13:09.128677] [DEBUG] [LOCAL ] PGP: Loaded 5696 existing records from primary storage. [2025-10-21T22:13:09.128877] [INFO ] [MAIN ] PGP: Loaded 5696 primary data records. [2025-10-21T22:13:09.140162] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:09.186069] [DEBUG] [MAIN ] PG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:09.214493] [INFO ] [MAIN ] PG: Generated 1794 derivative records from 53753 primary records. [2025-10-21T22:13:09.221029] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-10-21T22:13:09.276197] [DEBUG] [LOCAL ] PG: Derivative data saved (1794 records). [2025-10-21T22:13:09.306264] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-10-21T22:13:09.347383] [INFO ] [MAIN ] Derivative Progress: 1419/2057 symbols completed. PG took 1.3s. Estimated remaining: 4m 1s. Rate: 158.6 symbols/min [2025-10-21T22:13:09.496190] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:09.552879] [DEBUG] [LOCAL ] PGR: Loaded 52868 existing records from primary storage. [2025-10-21T22:13:09.553452] [INFO ] [MAIN ] PGR: Loaded 52868 primary data records. [2025-10-21T22:13:09.702773] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:09.708683] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5696 primary records. [2025-10-21T22:13:09.710102] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-10-21T22:13:09.709473] [DEBUG] [LOCAL ] PGRE: Loaded 46973 existing records from primary storage. [2025-10-21T22:13:09.716437] [INFO ] [MAIN ] PGRE: Loaded 46973 primary data records. [2025-10-21T22:13:09.836839] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-10-21T22:13:09.845609] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-10-21T22:13:09.863410] [INFO ] [MAIN ] Derivative Progress: 1420/2057 symbols completed. PGP took 0.8s. Estimated remaining: 4m 1s. Rate: 158.6 symbols/min [2025-10-21T22:13:09.898734] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:10.071466] [DEBUG] [LOCAL ] PGZ: Loaded 5560 existing records from primary storage. [2025-10-21T22:13:10.076803] [INFO ] [MAIN ] PGZ: Loaded 5560 primary data records. [2025-10-21T22:13:10.584528] [DEBUG] [MAIN ] PGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:10.586741] [INFO ] [MAIN ] PGR: Generated 1794 derivative records from 52868 primary records. [2025-10-21T22:13:10.587213] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-10-21T22:13:10.615518] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:10.619935] [DEBUG] [LOCAL ] PGR: Derivative data saved (1794 records). [2025-10-21T22:13:10.620606] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-10-21T22:13:10.621503] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46973 primary records. [2025-10-21T22:13:10.625233] [INFO ] [MAIN ] Derivative Progress: 1421/2057 symbols completed. PGR took 1.5s. Estimated remaining: 4m 1s. Rate: 158.5 symbols/min [2025-10-21T22:13:10.625567] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:10.626080] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-10-21T22:13:10.659415] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-10-21T22:13:10.660247] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-10-21T22:13:10.662689] [INFO ] [MAIN ] Derivative Progress: 1422/2057 symbols completed. PGRE took 1.2s. Estimated remaining: 4m 0s. Rate: 158.6 symbols/min [2025-10-21T22:13:10.659957] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:10.663031] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:10.664313] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5560 primary records. [2025-10-21T22:13:10.664472] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-10-21T22:13:10.680584] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-10-21T22:13:10.680820] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-10-21T22:13:10.683459] [INFO ] [MAIN ] Derivative Progress: 1423/2057 symbols completed. PGZ took 0.8s. Estimated remaining: 3m 60s. Rate: 158.7 symbols/min [2025-10-21T22:13:10.727164] [DEBUG] [LOCAL ] PH: Loaded 36700 existing records from primary storage. [2025-10-21T22:13:10.727456] [INFO ] [MAIN ] PH: Loaded 36700 primary data records. [2025-10-21T22:13:10.848997] [DEBUG] [LOCAL ] PHG: Loaded 45554 existing records from primary storage. [2025-10-21T22:13:10.860390] [INFO ] [MAIN ] PHG: Loaded 45554 primary data records. [2025-10-21T22:13:11.401464] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:13:11.403268] [INFO ] [MAIN ] PH: Generated 1793 derivative records from 36700 primary records. [2025-10-21T22:13:11.403358] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-10-21T22:13:11.418493] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:11.426789] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 45554 primary records. [2025-10-21T22:13:11.428258] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-10-21T22:13:11.436765] [DEBUG] [LOCAL ] PH: Derivative data saved (1793 records). [2025-10-21T22:13:11.449632] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-10-21T22:13:11.455162] [INFO ] [MAIN ] Derivative Progress: 1424/2057 symbols completed. PH took 0.8s. Estimated remaining: 3m 60s. Rate: 158.5 symbols/min [2025-10-21T22:13:11.456605] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-10-21T22:13:11.456718] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-10-21T22:13:11.459055] [INFO ] [MAIN ] Derivative Progress: 1425/2057 symbols completed. PHG took 0.8s. Estimated remaining: 3m 59s. Rate: 158.7 symbols/min [2025-10-21T22:13:11.459561] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:11.459483] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:11.460367] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:11.477437] [DEBUG] [LOCAL ] PHI: Loaded 15197 existing records from primary storage. [2025-10-21T22:13:11.477535] [INFO ] [MAIN ] PHI: Loaded 15197 primary data records. [2025-10-21T22:13:11.665183] [DEBUG] [LOCAL ] PHIN: Loaded 31536 existing records from primary storage. [2025-10-21T22:13:11.672536] [DEBUG] [LOCAL ] PHK: Loaded 26917 existing records from primary storage. [2025-10-21T22:13:11.696705] [INFO ] [MAIN ] PHIN: Loaded 31536 primary data records. [2025-10-21T22:13:11.702326] [INFO ] [MAIN ] PHK: Loaded 26917 primary data records. [2025-10-21T22:13:12.524123] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:12.525805] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 15197 primary records. [2025-10-21T22:13:12.525990] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-10-21T22:13:12.545281] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-10-21T22:13:12.545848] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-10-21T22:13:12.548142] [INFO ] [MAIN ] Derivative Progress: 1426/2057 symbols completed. PHI took 1.1s. Estimated remaining: 3m 59s. Rate: 158.4 symbols/min [2025-10-21T22:13:12.548562] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:12.578790] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:12.581216] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 31536 primary records. [2025-10-21T22:13:12.582158] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-10-21T22:13:12.616130] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-10-21T22:13:12.616353] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-10-21T22:13:12.616011] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:12.618984] [INFO ] [MAIN ] Derivative Progress: 1427/2057 symbols completed. PHIN took 1.2s. Estimated remaining: 3m 58s. Rate: 158.5 symbols/min [2025-10-21T22:13:12.620339] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26917 primary records. [2025-10-21T22:13:12.634017] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-10-21T22:13:12.619369] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:12.654054] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-10-21T22:13:12.654307] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-10-21T22:13:12.658919] [INFO ] [MAIN ] Derivative Progress: 1428/2057 symbols completed. PHK took 1.2s. Estimated remaining: 3m 58s. Rate: 158.6 symbols/min [2025-10-21T22:13:12.659245] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:12.684771] [DEBUG] [LOCAL ] PHM: Loaded 51692 existing records from primary storage. [2025-10-21T22:13:12.685033] [INFO ] [MAIN ] PHM: Loaded 51692 primary data records. [2025-10-21T22:13:12.782282] [DEBUG] [LOCAL ] PHR: Loaded 37942 existing records from primary storage. [2025-10-21T22:13:12.808753] [INFO ] [MAIN ] PHR: Loaded 37942 primary data records. [2025-10-21T22:13:13.203078] [DEBUG] [LOCAL ] PII: Loaded 48742 existing records from primary storage. [2025-10-21T22:13:13.239424] [INFO ] [MAIN ] PII: Loaded 48742 primary data records. [2025-10-21T22:13:13.728222] [DEBUG] [MAIN ] PHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:13.729460] [INFO ] [MAIN ] PHM: Generated 1794 derivative records from 51692 primary records. [2025-10-21T22:13:13.729587] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-10-21T22:13:13.760621] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:13.766985] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37942 primary records. [2025-10-21T22:13:13.767519] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-10-21T22:13:13.791349] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-10-21T22:13:13.792026] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-10-21T22:13:13.793694] [DEBUG] [LOCAL ] PHM: Derivative data saved (1794 records). [2025-10-21T22:13:13.800326] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-10-21T22:13:13.798383] [INFO ] [MAIN ] Derivative Progress: 1429/2057 symbols completed. PHR took 1.2s. Estimated remaining: 3m 58s. Rate: 158.4 symbols/min [2025-10-21T22:13:13.804508] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:13.804692] [INFO ] [MAIN ] Derivative Progress: 1430/2057 symbols completed. PHM took 1.3s. Estimated remaining: 3m 57s. Rate: 158.5 symbols/min [2025-10-21T22:13:13.818787] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:13.819519] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:13.820394] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 48742 primary records. [2025-10-21T22:13:13.820989] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-10-21T22:13:13.844353] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-10-21T22:13:13.844145] [DEBUG] [LOCAL ] PIM: Loaded 4874 existing records from primary storage. [2025-10-21T22:13:13.844532] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-10-21T22:13:13.844624] [INFO ] [MAIN ] PIM: Loaded 4874 primary data records. [2025-10-21T22:13:13.876294] [INFO ] [MAIN ] Derivative Progress: 1431/2057 symbols completed. PII took 1.2s. Estimated remaining: 3m 57s. Rate: 158.6 symbols/min [2025-10-21T22:13:13.900877] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:13.972029] [DEBUG] [LOCAL ] PINE: Loaded 14364 existing records from primary storage. [2025-10-21T22:13:13.978266] [INFO ] [MAIN ] PINE: Loaded 14364 primary data records. [2025-10-21T22:13:14.538725] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-10-21T22:13:14.540768] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-10-21T22:13:14.752104] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:14.762697] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4874 primary records. [2025-10-21T22:13:14.777457] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-10-21T22:13:14.913149] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-10-21T22:13:14.913576] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-10-21T22:13:14.928220] [INFO ] [MAIN ] Derivative Progress: 1432/2057 symbols completed. PIM took 1.1s. Estimated remaining: 3m 57s. Rate: 158.4 symbols/min [2025-10-21T22:13:14.929149] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:14.930073] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14364 primary records. [2025-10-21T22:13:14.930490] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-10-21T22:13:14.930737] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:14.948696] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-10-21T22:13:14.949135] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-10-21T22:13:14.951498] [INFO ] [MAIN ] Derivative Progress: 1433/2057 symbols completed. PINE took 1.1s. Estimated remaining: 3m 56s. Rate: 158.5 symbols/min [2025-10-21T22:13:14.951761] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:14.964116] [DEBUG] [LOCAL ] PIPR: Loaded 15094 existing records from primary storage. [2025-10-21T22:13:14.966595] [INFO ] [MAIN ] PIPR: Loaded 15094 primary data records. [2025-10-21T22:13:15.093798] [DEBUG] [LOCAL ] PJT: Loaded 21350 existing records from primary storage. [2025-10-21T22:13:15.093403] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:15.093969] [INFO ] [MAIN ] PJT: Loaded 21350 primary data records. [2025-10-21T22:13:15.094726] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-10-21T22:13:15.141103] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-10-21T22:13:15.405533] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-10-21T22:13:15.405898] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-10-21T22:13:15.413950] [INFO ] [MAIN ] Derivative Progress: 1434/2057 symbols completed. PINS took 1.5s. Estimated remaining: 3m 56s. Rate: 158.5 symbols/min [2025-10-21T22:13:15.414308] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:15.681510] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:15.682303] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 15094 primary records. [2025-10-21T22:13:15.682567] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-10-21T22:13:15.699330] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-10-21T22:13:15.714682] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-10-21T22:13:15.717220] [INFO ] [MAIN ] Derivative Progress: 1435/2057 symbols completed. PIPR took 0.8s. Estimated remaining: 3m 55s. Rate: 158.5 symbols/min [2025-10-21T22:13:15.717419] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:15.718605] [DEBUG] [LOCAL ] PK: Loaded 52756 existing records from primary storage. [2025-10-21T22:13:15.720183] [INFO ] [MAIN ] PK: Loaded 52756 primary data records. [2025-10-21T22:13:15.829309] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:15.844219] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 21350 primary records. [2025-10-21T22:13:15.847876] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-10-21T22:13:15.853562] [DEBUG] [LOCAL ] PKE: Loaded 14243 existing records from primary storage. [2025-10-21T22:13:15.853704] [INFO ] [MAIN ] PKE: Loaded 14243 primary data records. [2025-10-21T22:13:15.900024] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-10-21T22:13:15.900128] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-10-21T22:13:15.932112] [INFO ] [MAIN ] Derivative Progress: 1436/2057 symbols completed. PJT took 1.0s. Estimated remaining: 3m 55s. Rate: 158.6 symbols/min [2025-10-21T22:13:16.023074] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:16.404169] [DEBUG] [LOCAL ] PKG: Loaded 38576 existing records from primary storage. [2025-10-21T22:13:16.412163] [INFO ] [MAIN ] PKG: Loaded 38576 primary data records. [2025-10-21T22:13:16.451168] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:16.477480] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52756 primary records. [2025-10-21T22:13:16.487397] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-10-21T22:13:16.556445] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-10-21T22:13:16.571136] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-10-21T22:13:16.578589] [INFO ] [MAIN ] Derivative Progress: 1437/2057 symbols completed. PK took 1.2s. Estimated remaining: 3m 55s. Rate: 158.5 symbols/min [2025-10-21T22:13:16.583703] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:16.613272] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:16.628385] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 14243 primary records. [2025-10-21T22:13:16.646776] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-10-21T22:13:16.793629] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-10-21T22:13:16.801199] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-10-21T22:13:16.803793] [INFO ] [MAIN ] Derivative Progress: 1438/2057 symbols completed. PKE took 1.1s. Estimated remaining: 3m 54s. Rate: 158.5 symbols/min [2025-10-21T22:13:16.800798] [DEBUG] [LOCAL ] PKST: Loaded 18231 existing records from primary storage. [2025-10-21T22:13:16.804417] [INFO ] [MAIN ] PKST: Loaded 18231 primary data records. [2025-10-21T22:13:17.130773] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:17.131624] [INFO ] [MAIN ] PKG: Generated 1794 derivative records from 38576 primary records. [2025-10-21T22:13:17.132836] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-10-21T22:13:17.151802] [DEBUG] [LOCAL ] PKG: Derivative data saved (1794 records). [2025-10-21T22:13:17.152188] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-10-21T22:13:17.154308] [INFO ] [MAIN ] Derivative Progress: 1439/2057 symbols completed. PKG took 1.1s. Estimated remaining: 3m 54s. Rate: 158.5 symbols/min [2025-10-21T22:13:17.173009] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:17.173791] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 18231 primary records. [2025-10-21T22:13:17.173855] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-10-21T22:13:17.190148] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-10-21T22:13:17.190318] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-10-21T22:13:17.192890] [INFO ] [MAIN ] Derivative Progress: 1440/2057 symbols completed. PKST took 0.6s. Estimated remaining: 3m 53s. Rate: 158.6 symbols/min [2025-10-21T22:13:17.193449] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:17.193711] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:17.193786] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:17.222128] [DEBUG] [LOCAL ] PKX: Loaded 22782 existing records from primary storage. [2025-10-21T22:13:17.222259] [INFO ] [MAIN ] PKX: Loaded 22782 primary data records. [2025-10-21T22:13:17.441612] [DEBUG] [LOCAL ] PL: Loaded 53209 existing records from primary storage. [2025-10-21T22:13:17.464811] [INFO ] [MAIN ] PL: Loaded 53209 primary data records. [2025-10-21T22:13:17.607862] [DEBUG] [LOCAL ] PLD: Loaded 53418 existing records from primary storage. [2025-10-21T22:13:17.635518] [INFO ] [MAIN ] PLD: Loaded 53418 primary data records. [2025-10-21T22:13:18.259935] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:18.260938] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 22782 primary records. [2025-10-21T22:13:18.261268] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-10-21T22:13:18.278819] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-10-21T22:13:18.278996] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-10-21T22:13:18.281328] [INFO ] [MAIN ] Derivative Progress: 1441/2057 symbols completed. PKX took 1.1s. Estimated remaining: 3m 53s. Rate: 158.4 symbols/min [2025-10-21T22:13:18.281667] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:18.299784] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:18.301215] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53209 primary records. [2025-10-21T22:13:18.301392] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-10-21T22:13:18.336907] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-10-21T22:13:18.337556] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-10-21T22:13:18.337507] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:18.340135] [INFO ] [MAIN ] Derivative Progress: 1442/2057 symbols completed. PL took 1.1s. Estimated remaining: 3m 53s. Rate: 158.5 symbols/min [2025-10-21T22:13:18.340364] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:18.341215] [INFO ] [MAIN ] PLD: Generated 1794 derivative records from 53418 primary records. [2025-10-21T22:13:18.341567] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-10-21T22:13:18.368011] [DEBUG] [LOCAL ] PLD: Derivative data saved (1794 records). [2025-10-21T22:13:18.368200] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-10-21T22:13:18.370529] [INFO ] [MAIN ] Derivative Progress: 1443/2057 symbols completed. PLD took 1.2s. Estimated remaining: 3m 52s. Rate: 158.6 symbols/min [2025-10-21T22:13:18.370904] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:18.392322] [DEBUG] [LOCAL ] PLNT: Loaded 48051 existing records from primary storage. [2025-10-21T22:13:18.392587] [INFO ] [MAIN ] PLNT: Loaded 48051 primary data records. [2025-10-21T22:13:18.443731] [DEBUG] [LOCAL ] PLOW: Loaded 19800 existing records from primary storage. [2025-10-21T22:13:18.456543] [INFO ] [MAIN ] PLOW: Loaded 19800 primary data records. [2025-10-21T22:13:18.912066] [DEBUG] [LOCAL ] PLYM: Loaded 34464 existing records from primary storage. [2025-10-21T22:13:18.913277] [INFO ] [MAIN ] PLYM: Loaded 34464 primary data records. [2025-10-21T22:13:19.373731] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:19.375522] [INFO ] [MAIN ] PLNT: Generated 1794 derivative records from 48051 primary records. [2025-10-21T22:13:19.375624] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-10-21T22:13:19.405668] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:19.406920] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1794 records). [2025-10-21T22:13:19.407623] [INFO ] [MAIN ] PLOW: Generated 1794 derivative records from 19800 primary records. [2025-10-21T22:13:19.407769] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-10-21T22:13:19.408779] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-10-21T22:13:19.411636] [INFO ] [MAIN ] Derivative Progress: 1444/2057 symbols completed. PLNT took 1.1s. Estimated remaining: 3m 52s. Rate: 158.4 symbols/min [2025-10-21T22:13:19.411838] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:19.429187] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1794 records). [2025-10-21T22:13:19.429391] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-10-21T22:13:19.431972] [INFO ] [MAIN ] Derivative Progress: 1445/2057 symbols completed. PLOW took 1.1s. Estimated remaining: 3m 52s. Rate: 158.5 symbols/min [2025-10-21T22:13:19.432221] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:19.450264] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:19.451196] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 34464 primary records. [2025-10-21T22:13:19.451333] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-10-21T22:13:19.474945] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-10-21T22:13:19.482557] [DEBUG] [LOCAL ] PML: Loaded 21933 existing records from primary storage. [2025-10-21T22:13:19.482712] [INFO ] [MAIN ] PML: Loaded 21933 primary data records. [2025-10-21T22:13:19.482172] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-10-21T22:13:19.485326] [INFO ] [MAIN ] Derivative Progress: 1446/2057 symbols completed. PLYM took 1.1s. Estimated remaining: 3m 51s. Rate: 158.6 symbols/min [2025-10-21T22:13:19.497097] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:19.687003] [DEBUG] [LOCAL ] PM: Loaded 53674 existing records from primary storage. [2025-10-21T22:13:19.687325] [DEBUG] [LOCAL ] PMM: Loaded 10018 existing records from primary storage. [2025-10-21T22:13:19.695816] [INFO ] [MAIN ] PM: Loaded 53674 primary data records. [2025-10-21T22:13:19.696222] [INFO ] [MAIN ] PMM: Loaded 10018 primary data records. [2025-10-21T22:13:20.521040] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:20.522534] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 21933 primary records. [2025-10-21T22:13:20.522856] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-10-21T22:13:20.557984] [DEBUG] [MAIN ] PM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:20.560018] [INFO ] [MAIN ] PM: Generated 1794 derivative records from 53674 primary records. [2025-10-21T22:13:20.561134] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-10-21T22:13:20.562810] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-10-21T22:13:20.564794] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-10-21T22:13:20.567134] [INFO ] [MAIN ] Derivative Progress: 1447/2057 symbols completed. PML took 1.1s. Estimated remaining: 3m 51s. Rate: 158.4 symbols/min [2025-10-21T22:13:20.567813] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:20.592479] [DEBUG] [LOCAL ] PM: Derivative data saved (1794 records). [2025-10-21T22:13:20.597727] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-10-21T22:13:20.600390] [INFO ] [MAIN ] Derivative Progress: 1448/2057 symbols completed. PM took 1.2s. Estimated remaining: 3m 50s. Rate: 158.5 symbols/min [2025-10-21T22:13:20.600741] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:20.600878] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:20.601703] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10018 primary records. [2025-10-21T22:13:20.604244] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-10-21T22:13:20.620670] [DEBUG] [LOCAL ] PMO: Loaded 9593 existing records from primary storage. [2025-10-21T22:13:20.620912] [INFO ] [MAIN ] PMO: Loaded 9593 primary data records. [2025-10-21T22:13:20.645520] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-10-21T22:13:20.645788] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-10-21T22:13:20.670360] [INFO ] [MAIN ] Derivative Progress: 1449/2057 symbols completed. PMM took 1.2s. Estimated remaining: 3m 50s. Rate: 158.6 symbols/min [2025-10-21T22:13:20.690874] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:20.951730] [DEBUG] [LOCAL ] PMT: Loaded 40721 existing records from primary storage. [2025-10-21T22:13:20.952083] [INFO ] [MAIN ] PMT: Loaded 40721 primary data records. [2025-10-21T22:13:21.153998] [DEBUG] [LOCAL ] PNC: Loaded 52077 existing records from primary storage. [2025-10-21T22:13:21.290487] [INFO ] [MAIN ] PNC: Loaded 52077 primary data records. [2025-10-21T22:13:21.527865] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:21.702882] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 9593 primary records. [2025-10-21T22:13:21.704086] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-10-21T22:13:21.727542] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-10-21T22:13:21.729715] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-10-21T22:13:21.733575] [INFO ] [MAIN ] Derivative Progress: 1450/2057 symbols completed. PMO took 1.2s. Estimated remaining: 3m 50s. Rate: 158.4 symbols/min [2025-10-21T22:13:21.733748] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:21.760064] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:21.761184] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40721 primary records. [2025-10-21T22:13:21.761299] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-10-21T22:13:21.775306] [DEBUG] [LOCAL ] PNI: Loaded 6905 existing records from primary storage. [2025-10-21T22:13:21.784797] [INFO ] [MAIN ] PNI: Loaded 6905 primary data records. [2025-10-21T22:13:21.784470] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-10-21T22:13:21.816395] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-10-21T22:13:21.833113] [INFO ] [MAIN ] Derivative Progress: 1451/2057 symbols completed. PMT took 1.2s. Estimated remaining: 3m 49s. Rate: 158.5 symbols/min [2025-10-21T22:13:21.877202] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:21.992075] [DEBUG] [MAIN ] PNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:22.106355] [INFO ] [MAIN ] PNC: Generated 1794 derivative records from 52077 primary records. [2025-10-21T22:13:22.107142] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-10-21T22:13:22.133907] [DEBUG] [LOCAL ] PNC: Derivative data saved (1794 records). [2025-10-21T22:13:22.134259] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-10-21T22:13:22.136894] [INFO ] [MAIN ] Derivative Progress: 1452/2057 symbols completed. PNC took 1.4s. Estimated remaining: 3m 49s. Rate: 158.5 symbols/min [2025-10-21T22:13:22.137124] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:22.151609] [DEBUG] [LOCAL ] PNNT: Loaded 33432 existing records from primary storage. [2025-10-21T22:13:22.152042] [INFO ] [MAIN ] PNNT: Loaded 33432 primary data records. [2025-10-21T22:13:22.470114] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:22.470991] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6905 primary records. [2025-10-21T22:13:22.471079] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-10-21T22:13:22.502196] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-10-21T22:13:22.503733] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-10-21T22:13:22.506179] [INFO ] [MAIN ] Derivative Progress: 1453/2057 symbols completed. PNI took 0.8s. Estimated remaining: 3m 49s. Rate: 158.5 symbols/min [2025-10-21T22:13:22.507888] [DEBUG] [LOCAL ] PNR: Loaded 47493 existing records from primary storage. [2025-10-21T22:13:22.508091] [INFO ] [MAIN ] PNR: Loaded 47493 primary data records. [2025-10-21T22:13:22.824625] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:22.825790] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 33432 primary records. [2025-10-21T22:13:22.826356] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-10-21T22:13:22.845897] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-10-21T22:13:22.846080] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-10-21T22:13:22.848971] [INFO ] [MAIN ] Derivative Progress: 1454/2057 symbols completed. PNNT took 1.0s. Estimated remaining: 3m 48s. Rate: 158.5 symbols/min [2025-10-21T22:13:22.866729] [DEBUG] [MAIN ] PNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:22.867395] [INFO ] [MAIN ] PNR: Generated 1794 derivative records from 47493 primary records. [2025-10-21T22:13:22.867456] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-10-21T22:13:22.883032] [DEBUG] [LOCAL ] PNR: Derivative data saved (1794 records). [2025-10-21T22:13:22.883095] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-10-21T22:13:22.885338] [INFO ] [MAIN ] Derivative Progress: 1455/2057 symbols completed. PNR took 0.7s. Estimated remaining: 3m 48s. Rate: 158.6 symbols/min [2025-10-21T22:13:22.886106] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:22.886014] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:22.886299] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:22.960240] [DEBUG] [LOCAL ] POST: Loaded 38568 existing records from primary storage. [2025-10-21T22:13:22.960944] [DEBUG] [LOCAL ] PNW: Loaded 45576 existing records from primary storage. [2025-10-21T22:13:22.961319] [INFO ] [MAIN ] POST: Loaded 38568 primary data records. [2025-10-21T22:13:22.961444] [INFO ] [MAIN ] PNW: Loaded 45576 primary data records. [2025-10-21T22:13:23.094985] [DEBUG] [LOCAL ] POR: Loaded 46776 existing records from primary storage. [2025-10-21T22:13:23.138409] [INFO ] [MAIN ] POR: Loaded 46776 primary data records. [2025-10-21T22:13:23.951215] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:23.964390] [INFO ] [MAIN ] PNW: Generated 1794 derivative records from 45576 primary records. [2025-10-21T22:13:23.964610] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-10-21T22:13:23.965759] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:23.975689] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38568 primary records. [2025-10-21T22:13:23.985521] [DEBUG] [LOCAL ] PNW: Derivative data saved (1794 records). [2025-10-21T22:13:23.985673] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-10-21T22:13:23.999200] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-10-21T22:13:24.008028] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:24.010144] [INFO ] [MAIN ] Derivative Progress: 1456/2057 symbols completed. PNW took 1.1s. Estimated remaining: 3m 48s. Rate: 158.4 symbols/min [2025-10-21T22:13:24.016991] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-10-21T22:13:24.017165] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:24.018187] [INFO ] [MAIN ] POR: Generated 1794 derivative records from 46776 primary records. [2025-10-21T22:13:24.018763] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-10-21T22:13:24.017420] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-10-21T22:13:24.020814] [INFO ] [MAIN ] Derivative Progress: 1457/2057 symbols completed. POST took 1.1s. Estimated remaining: 3m 47s. Rate: 158.5 symbols/min [2025-10-21T22:13:24.021996] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:24.038990] [DEBUG] [LOCAL ] POR: Derivative data saved (1794 records). [2025-10-21T22:13:24.039290] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-10-21T22:13:24.043186] [INFO ] [MAIN ] Derivative Progress: 1458/2057 symbols completed. POR took 1.2s. Estimated remaining: 3m 47s. Rate: 158.6 symbols/min [2025-10-21T22:13:24.043404] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:24.090737] [DEBUG] [LOCAL ] PPT: Loaded 19747 existing records from primary storage. [2025-10-21T22:13:24.090885] [INFO ] [MAIN ] PPT: Loaded 19747 primary data records. [2025-10-21T22:13:24.225157] [DEBUG] [LOCAL ] PPG: Loaded 50524 existing records from primary storage. [2025-10-21T22:13:24.247538] [INFO ] [MAIN ] PPG: Loaded 50524 primary data records. [2025-10-21T22:13:24.237141] [DEBUG] [LOCAL ] PPL: Loaded 53506 existing records from primary storage. [2025-10-21T22:13:24.322403] [INFO ] [MAIN ] PPL: Loaded 53506 primary data records. [2025-10-21T22:13:25.030966] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:25.032375] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 19747 primary records. [2025-10-21T22:13:25.032889] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-10-21T22:13:25.052859] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-10-21T22:13:25.053738] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-10-21T22:13:25.068118] [INFO ] [MAIN ] Derivative Progress: 1459/2057 symbols completed. PPT took 1.0s. Estimated remaining: 3m 46s. Rate: 158.4 symbols/min [2025-10-21T22:13:25.068810] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:25.069912] [INFO ] [MAIN ] PPG: Generated 1794 derivative records from 50524 primary records. [2025-10-21T22:13:25.070014] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-10-21T22:13:25.082406] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:25.083710] [DEBUG] [MAIN ] PPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:25.093517] [INFO ] [MAIN ] PPL: Generated 1794 derivative records from 53506 primary records. [2025-10-21T22:13:25.096333] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-10-21T22:13:25.101278] [DEBUG] [LOCAL ] PPG: Derivative data saved (1794 records). [2025-10-21T22:13:25.101693] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-10-21T22:13:25.103915] [INFO ] [MAIN ] Derivative Progress: 1460/2057 symbols completed. PPG took 1.1s. Estimated remaining: 3m 46s. Rate: 158.5 symbols/min [2025-10-21T22:13:25.112783] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:25.120546] [DEBUG] [LOCAL ] PPL: Derivative data saved (1794 records). [2025-10-21T22:13:25.120744] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-10-21T22:13:25.123341] [INFO ] [MAIN ] Derivative Progress: 1461/2057 symbols completed. PPL took 1.1s. Estimated remaining: 3m 45s. Rate: 158.6 symbols/min [2025-10-21T22:13:25.123490] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:25.129378] [DEBUG] [LOCAL ] PRCS: Loaded 2800 existing records from primary storage. [2025-10-21T22:13:25.129639] [INFO ] [MAIN ] PRCS: Loaded 2800 primary data records. [2025-10-21T22:13:25.285375] [DEBUG] [LOCAL ] PRA: Loaded 34582 existing records from primary storage. [2025-10-21T22:13:25.295871] [INFO ] [MAIN ] PRA: Loaded 34582 primary data records. [2025-10-21T22:13:25.349348] [DEBUG] [LOCAL ] PR: Loaded 53611 existing records from primary storage. [2025-10-21T22:13:25.554237] [INFO ] [MAIN ] PR: Loaded 53611 primary data records. [2025-10-21T22:13:26.148805] [DEBUG] [MAIN ] PRCS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:13:26.151459] [INFO ] [MAIN ] PRCS: Generated 1793 derivative records from 2800 primary records. [2025-10-21T22:13:26.151618] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-10-21T22:13:26.172320] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:26.180033] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1793 records). [2025-10-21T22:13:26.180292] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-10-21T22:13:26.183095] [INFO ] [MAIN ] Derivative Progress: 1462/2057 symbols completed. PRCS took 1.1s. Estimated remaining: 3m 45s. Rate: 158.4 symbols/min [2025-10-21T22:13:26.181272] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34582 primary records. [2025-10-21T22:13:26.183932] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-10-21T22:13:26.183461] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:26.205226] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-10-21T22:13:26.206212] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-10-21T22:13:26.209008] [INFO ] [MAIN ] Derivative Progress: 1463/2057 symbols completed. PRA took 1.1s. Estimated remaining: 3m 45s. Rate: 158.5 symbols/min [2025-10-21T22:13:26.209357] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:26.223194] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:26.224074] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53611 primary records. [2025-10-21T22:13:26.224192] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-10-21T22:13:26.248227] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-10-21T22:13:26.248442] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-10-21T22:13:26.250893] [INFO ] [MAIN ] Derivative Progress: 1464/2057 symbols completed. PR took 1.2s. Estimated remaining: 3m 44s. Rate: 158.6 symbols/min [2025-10-21T22:13:26.251194] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:26.275556] [DEBUG] [LOCAL ] PRG: Loaded 29630 existing records from primary storage. [2025-10-21T22:13:26.275940] [INFO ] [MAIN ] PRG: Loaded 29630 primary data records. [2025-10-21T22:13:26.300756] [DEBUG] [LOCAL ] PRH: Loaded 4716 existing records from primary storage. [2025-10-21T22:13:26.335576] [INFO ] [MAIN ] PRH: Loaded 4716 primary data records. [2025-10-21T22:13:26.784251] [DEBUG] [LOCAL ] PRGO: Loaded 47142 existing records from primary storage. [2025-10-21T22:13:26.788205] [INFO ] [MAIN ] PRGO: Loaded 47142 primary data records. [2025-10-21T22:13:27.241722] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:27.242966] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 29630 primary records. [2025-10-21T22:13:27.243112] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-10-21T22:13:27.262257] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-10-21T22:13:27.262469] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-10-21T22:13:27.264623] [INFO ] [MAIN ] Derivative Progress: 1465/2057 symbols completed. PRG took 1.1s. Estimated remaining: 3m 44s. Rate: 158.5 symbols/min [2025-10-21T22:13:27.264953] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:27.279820] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:27.280939] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4716 primary records. [2025-10-21T22:13:27.281038] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-10-21T22:13:27.296776] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-10-21T22:13:27.296842] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-10-21T22:13:27.299154] [INFO ] [MAIN ] Derivative Progress: 1466/2057 symbols completed. PRH took 1.0s. Estimated remaining: 3m 44s. Rate: 158.6 symbols/min [2025-10-21T22:13:27.299458] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:27.314360] [DEBUG] [LOCAL ] PRI: Loaded 17836 existing records from primary storage. [2025-10-21T22:13:27.316162] [INFO ] [MAIN ] PRI: Loaded 17836 primary data records. [2025-10-21T22:13:27.400595] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:27.423252] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 47142 primary records. [2025-10-21T22:13:27.423400] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-10-21T22:13:27.480973] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-10-21T22:13:27.506153] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-10-21T22:13:27.543529] [INFO ] [MAIN ] Derivative Progress: 1467/2057 symbols completed. PRGO took 1.3s. Estimated remaining: 3m 43s. Rate: 158.6 symbols/min [2025-10-21T22:13:27.548198] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:27.712380] [DEBUG] [LOCAL ] PRIM: Loaded 44099 existing records from primary storage. [2025-10-21T22:13:27.712732] [INFO ] [MAIN ] PRIM: Loaded 44099 primary data records. [2025-10-21T22:13:28.051035] [DEBUG] [LOCAL ] PRKS: Loaded 42343 existing records from primary storage. [2025-10-21T22:13:28.052074] [INFO ] [MAIN ] PRKS: Loaded 42343 primary data records. [2025-10-21T22:13:28.237224] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:28.256198] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 17836 primary records. [2025-10-21T22:13:28.260029] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-10-21T22:13:28.389800] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-10-21T22:13:28.390669] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-10-21T22:13:28.392746] [INFO ] [MAIN ] Derivative Progress: 1468/2057 symbols completed. PRI took 1.1s. Estimated remaining: 3m 43s. Rate: 158.5 symbols/min [2025-10-21T22:13:28.412315] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:28.413372] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44099 primary records. [2025-10-21T22:13:28.413599] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-10-21T22:13:28.432393] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-10-21T22:13:28.432502] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-10-21T22:13:28.435293] [INFO ] [MAIN ] Derivative Progress: 1469/2057 symbols completed. PRIM took 1.1s. Estimated remaining: 3m 43s. Rate: 158.6 symbols/min [2025-10-21T22:13:28.450156] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:28.450786] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42343 primary records. [2025-10-21T22:13:28.450846] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-10-21T22:13:28.465923] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-10-21T22:13:28.466000] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-10-21T22:13:28.469027] [INFO ] [MAIN ] Derivative Progress: 1470/2057 symbols completed. PRKS took 0.9s. Estimated remaining: 3m 42s. Rate: 158.7 symbols/min [2025-10-21T22:13:28.469721] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:28.469621] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:28.469545] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:28.493135] [DEBUG] [LOCAL ] PRLB: Loaded 20323 existing records from primary storage. [2025-10-21T22:13:28.493284] [INFO ] [MAIN ] PRLB: Loaded 20323 primary data records. [2025-10-21T22:13:28.704215] [DEBUG] [LOCAL ] PRM: Loaded 44377 existing records from primary storage. [2025-10-21T22:13:28.815263] [INFO ] [MAIN ] PRM: Loaded 44377 primary data records. [2025-10-21T22:13:28.905866] [DEBUG] [LOCAL ] PRMB: Loaded 53109 existing records from primary storage. [2025-10-21T22:13:28.918481] [INFO ] [MAIN ] PRMB: Loaded 53109 primary data records. [2025-10-21T22:13:29.481843] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:29.482914] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20323 primary records. [2025-10-21T22:13:29.483106] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-10-21T22:13:29.502009] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-10-21T22:13:29.502434] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-10-21T22:13:29.504785] [INFO ] [MAIN ] Derivative Progress: 1471/2057 symbols completed. PRLB took 1.0s. Estimated remaining: 3m 42s. Rate: 158.5 symbols/min [2025-10-21T22:13:29.505137] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:29.525235] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:29.526413] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44377 primary records. [2025-10-21T22:13:29.527308] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-10-21T22:13:29.559582] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:29.562291] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53109 primary records. [2025-10-21T22:13:29.572885] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-10-21T22:13:29.572806] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-10-21T22:13:29.573850] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-10-21T22:13:29.576159] [INFO ] [MAIN ] Derivative Progress: 1472/2057 symbols completed. PRM took 1.1s. Estimated remaining: 3m 41s. Rate: 158.6 symbols/min [2025-10-21T22:13:29.576683] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:29.607336] [DEBUG] [LOCAL ] PRO: Loaded 40193 existing records from primary storage. [2025-10-21T22:13:29.608712] [INFO ] [MAIN ] PRO: Loaded 40193 primary data records. [2025-10-21T22:13:29.608594] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-10-21T22:13:29.608952] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-10-21T22:13:29.611842] [INFO ] [MAIN ] Derivative Progress: 1473/2057 symbols completed. PRMB took 1.1s. Estimated remaining: 3m 41s. Rate: 158.7 symbols/min [2025-10-21T22:13:29.623702] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:29.718922] [DEBUG] [LOCAL ] PRSU: Loaded 23232 existing records from primary storage. [2025-10-21T22:13:29.735167] [INFO ] [MAIN ] PRSU: Loaded 23232 primary data records. [2025-10-21T22:13:29.731934] [DEBUG] [LOCAL ] PRT: Loaded 5138 existing records from primary storage. [2025-10-21T22:13:29.771541] [INFO ] [MAIN ] PRT: Loaded 5138 primary data records. [2025-10-21T22:13:30.575967] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:30.578608] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 40193 primary records. [2025-10-21T22:13:30.579334] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-10-21T22:13:30.609672] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-10-21T22:13:30.610814] [DEBUG] [MAIN ] PRSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:30.611701] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-10-21T22:13:30.614036] [INFO ] [MAIN ] Derivative Progress: 1474/2057 symbols completed. PRO took 1.1s. Estimated remaining: 3m 41s. Rate: 158.5 symbols/min [2025-10-21T22:13:30.614318] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:30.615442] [INFO ] [MAIN ] PRSU: Generated 1794 derivative records from 23232 primary records. [2025-10-21T22:13:30.615879] [DEBUG] [LOCAL ] PRSU: Saving derivative data. [2025-10-21T22:13:30.629699] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:30.641182] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5138 primary records. [2025-10-21T22:13:30.644824] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-10-21T22:13:30.645399] [DEBUG] [LOCAL ] PRSU: Derivative data saved (1794 records). [2025-10-21T22:13:30.646263] [INFO ] [MAIN ] PRSU: Successfully saved derivative data. [2025-10-21T22:13:30.648949] [INFO ] [MAIN ] Derivative Progress: 1475/2057 symbols completed. PRSU took 1.1s. Estimated remaining: 3m 40s. Rate: 158.6 symbols/min [2025-10-21T22:13:30.649401] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:30.663204] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-10-21T22:13:30.663377] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-10-21T22:13:30.665868] [INFO ] [MAIN ] Derivative Progress: 1476/2057 symbols completed. PRT took 1.0s. Estimated remaining: 3m 40s. Rate: 158.7 symbols/min [2025-10-21T22:13:30.666608] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:30.681171] [DEBUG] [LOCAL ] PSBD: Loaded 8213 existing records from primary storage. [2025-10-21T22:13:30.681347] [INFO ] [MAIN ] PSBD: Loaded 8213 primary data records. [2025-10-21T22:13:30.832160] [DEBUG] [LOCAL ] PRU: Loaded 51187 existing records from primary storage. [2025-10-21T22:13:30.878554] [INFO ] [MAIN ] PRU: Loaded 51187 primary data records. [2025-10-21T22:13:30.925111] [DEBUG] [LOCAL ] PSA: Loaded 42179 existing records from primary storage. [2025-10-21T22:13:31.085538] [INFO ] [MAIN ] PSA: Loaded 42179 primary data records. [2025-10-21T22:13:31.721869] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:31.722968] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 8213 primary records. [2025-10-21T22:13:31.723297] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-10-21T22:13:31.741799] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-10-21T22:13:31.742521] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-10-21T22:13:31.744526] [INFO ] [MAIN ] Derivative Progress: 1477/2057 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 40s. Rate: 158.5 symbols/min [2025-10-21T22:13:31.744951] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:31.764949] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:31.770035] [INFO ] [MAIN ] PRU: Generated 1794 derivative records from 51187 primary records. [2025-10-21T22:13:31.771061] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-10-21T22:13:31.770274] [DEBUG] [LOCAL ] PSF: Loaded 6992 existing records from primary storage. [2025-10-21T22:13:31.772007] [INFO ] [MAIN ] PSF: Loaded 6992 primary data records. [2025-10-21T22:13:31.843239] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:31.858558] [INFO ] [MAIN ] PSA: Generated 1794 derivative records from 42179 primary records. [2025-10-21T22:13:31.859996] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-10-21T22:13:31.859928] [DEBUG] [LOCAL ] PRU: Derivative data saved (1794 records). [2025-10-21T22:13:31.874387] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-10-21T22:13:31.876960] [INFO ] [MAIN ] Derivative Progress: 1478/2057 symbols completed. PRU took 1.3s. Estimated remaining: 3m 39s. Rate: 158.5 symbols/min [2025-10-21T22:13:31.899524] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:31.926782] [DEBUG] [LOCAL ] PSA: Derivative data saved (1794 records). [2025-10-21T22:13:31.926988] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-10-21T22:13:31.929719] [INFO ] [MAIN ] Derivative Progress: 1479/2057 symbols completed. PSA took 1.3s. Estimated remaining: 3m 39s. Rate: 158.6 symbols/min [2025-10-21T22:13:31.930470] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:32.144259] [DEBUG] [LOCAL ] PSFE: Loaded 29751 existing records from primary storage. [2025-10-21T22:13:32.155510] [INFO ] [MAIN ] PSFE: Loaded 29751 primary data records. [2025-10-21T22:13:32.274667] [DEBUG] [LOCAL ] PSN: Loaded 45263 existing records from primary storage. [2025-10-21T22:13:32.285858] [INFO ] [MAIN ] PSN: Loaded 45263 primary data records. [2025-10-21T22:13:32.603027] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:32.610120] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6992 primary records. [2025-10-21T22:13:32.641160] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-10-21T22:13:32.799290] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-10-21T22:13:32.800171] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-10-21T22:13:32.802417] [INFO ] [MAIN ] Derivative Progress: 1480/2057 symbols completed. PSF took 1.1s. Estimated remaining: 3m 38s. Rate: 158.5 symbols/min [2025-10-21T22:13:32.803029] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:32.830500] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:32.831438] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 29751 primary records. [2025-10-21T22:13:32.847988] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-10-21T22:13:32.854101] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:32.862974] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 45263 primary records. [2025-10-21T22:13:32.867789] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-10-21T22:13:32.870306] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-10-21T22:13:32.870533] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-10-21T22:13:32.873917] [INFO ] [MAIN ] Derivative Progress: 1481/2057 symbols completed. PSFE took 1.0s. Estimated remaining: 3m 38s. Rate: 158.6 symbols/min [2025-10-21T22:13:32.881089] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:32.900714] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-10-21T22:13:32.901001] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-10-21T22:13:32.903925] [INFO ] [MAIN ] Derivative Progress: 1482/2057 symbols completed. PSN took 1.0s. Estimated remaining: 3m 37s. Rate: 158.7 symbols/min [2025-10-21T22:13:32.904200] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:32.905516] [DEBUG] [LOCAL ] PSO: Loaded 36731 existing records from primary storage. [2025-10-21T22:13:32.905948] [INFO ] [MAIN ] PSO: Loaded 36731 primary data records. [2025-10-21T22:13:33.203686] [DEBUG] [LOCAL ] PSQH: Loaded 35346 existing records from primary storage. [2025-10-21T22:13:33.230705] [INFO ] [MAIN ] PSQH: Loaded 35346 primary data records. [2025-10-21T22:13:33.355382] [DEBUG] [LOCAL ] PSTG: Loaded 52836 existing records from primary storage. [2025-10-21T22:13:33.362287] [INFO ] [MAIN ] PSTG: Loaded 52836 primary data records. [2025-10-21T22:13:33.902723] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:33.903999] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 36731 primary records. [2025-10-21T22:13:33.904217] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-10-21T22:13:33.925971] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-10-21T22:13:33.926543] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-10-21T22:13:33.929041] [INFO ] [MAIN ] Derivative Progress: 1483/2057 symbols completed. PSO took 1.1s. Estimated remaining: 3m 37s. Rate: 158.5 symbols/min [2025-10-21T22:13:33.947600] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:33.948606] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 35346 primary records. [2025-10-21T22:13:33.948809] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-10-21T22:13:33.966269] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-10-21T22:13:33.968000] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-10-21T22:13:33.971181] [INFO ] [MAIN ] Derivative Progress: 1484/2057 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 37s. Rate: 158.6 symbols/min [2025-10-21T22:13:33.983934] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:33.984498] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52836 primary records. [2025-10-21T22:13:33.984557] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-10-21T22:13:33.999296] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-10-21T22:13:33.999353] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-10-21T22:13:34.001841] [INFO ] [MAIN ] Derivative Progress: 1485/2057 symbols completed. PSTG took 1.1s. Estimated remaining: 3m 36s. Rate: 158.7 symbols/min [2025-10-21T22:13:34.002274] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:34.002392] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:34.002967] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:34.023848] [DEBUG] [LOCAL ] PTA: Loaded 15492 existing records from primary storage. [2025-10-21T22:13:34.023997] [INFO ] [MAIN ] PTA: Loaded 15492 primary data records. [2025-10-21T22:13:34.087252] [DEBUG] [LOCAL ] PSTL: Loaded 19964 existing records from primary storage. [2025-10-21T22:13:34.101963] [INFO ] [MAIN ] PSTL: Loaded 19964 primary data records. [2025-10-21T22:13:34.430666] [DEBUG] [LOCAL ] PSX: Loaded 53132 existing records from primary storage. [2025-10-21T22:13:34.646345] [INFO ] [MAIN ] PSX: Loaded 53132 primary data records. [2025-10-21T22:13:35.012671] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:35.013155] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:35.014328] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 15492 primary records. [2025-10-21T22:13:35.016398] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 19964 primary records. [2025-10-21T22:13:35.016724] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-10-21T22:13:35.016609] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-10-21T22:13:35.047625] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-10-21T22:13:35.049480] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-10-21T22:13:35.050839] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-10-21T22:13:35.051183] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-10-21T22:13:35.053232] [INFO ] [MAIN ] Derivative Progress: 1486/2057 symbols completed. PTA took 1.1s. Estimated remaining: 3m 36s. Rate: 158.5 symbols/min [2025-10-21T22:13:35.056059] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:35.056402] [INFO ] [MAIN ] Derivative Progress: 1487/2057 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 36s. Rate: 158.6 symbols/min [2025-10-21T22:13:35.056894] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:35.073443] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:35.074308] [INFO ] [MAIN ] PSX: Generated 1794 derivative records from 53132 primary records. [2025-10-21T22:13:35.074417] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-10-21T22:13:35.090612] [DEBUG] [LOCAL ] PSX: Derivative data saved (1794 records). [2025-10-21T22:13:35.090914] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-10-21T22:13:35.093353] [INFO ] [MAIN ] Derivative Progress: 1488/2057 symbols completed. PSX took 1.1s. Estimated remaining: 3m 35s. Rate: 158.7 symbols/min [2025-10-21T22:13:35.093715] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:35.134262] [DEBUG] [LOCAL ] PTY: Loaded 37954 existing records from primary storage. [2025-10-21T22:13:35.147596] [INFO ] [MAIN ] PTY: Loaded 37954 primary data records. [2025-10-21T22:13:35.148401] [DEBUG] [LOCAL ] PUK: Loaded 44388 existing records from primary storage. [2025-10-21T22:13:35.170186] [INFO ] [MAIN ] PUK: Loaded 44388 primary data records. [2025-10-21T22:13:35.448133] [DEBUG] [LOCAL ] PUMP: Loaded 49434 existing records from primary storage. [2025-10-21T22:13:35.482168] [INFO ] [MAIN ] PUMP: Loaded 49434 primary data records. [2025-10-21T22:13:36.169990] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:36.171364] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37954 primary records. [2025-10-21T22:13:36.171582] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-10-21T22:13:36.195794] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-10-21T22:13:36.196173] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-10-21T22:13:36.212456] [INFO ] [MAIN ] Derivative Progress: 1489/2057 symbols completed. PTY took 1.2s. Estimated remaining: 3m 35s. Rate: 158.5 symbols/min [2025-10-21T22:13:36.212938] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:36.213451] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:36.214998] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 44388 primary records. [2025-10-21T22:13:36.216173] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-10-21T22:13:36.249899] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-10-21T22:13:36.250258] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-10-21T22:13:36.254002] [INFO ] [MAIN ] Derivative Progress: 1490/2057 symbols completed. PUK took 1.2s. Estimated remaining: 3m 35s. Rate: 158.6 symbols/min [2025-10-21T22:13:36.254311] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:36.256937] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:36.257969] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49434 primary records. [2025-10-21T22:13:36.258117] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-10-21T22:13:36.284901] [DEBUG] [LOCAL ] PVL: Loaded 4717 existing records from primary storage. [2025-10-21T22:13:36.285857] [INFO ] [MAIN ] PVL: Loaded 4717 primary data records. [2025-10-21T22:13:36.382209] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-10-21T22:13:36.408531] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-10-21T22:13:36.438243] [INFO ] [MAIN ] Derivative Progress: 1491/2057 symbols completed. PUMP took 1.3s. Estimated remaining: 3m 34s. Rate: 158.6 symbols/min [2025-10-21T22:13:36.452230] [DEBUG] [LOCAL ] PVH: Loaded 49613 existing records from primary storage. [2025-10-21T22:13:36.457746] [INFO ] [MAIN ] PVH: Loaded 49613 primary data records. [2025-10-21T22:13:36.450295] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:37.172773] [DEBUG] [LOCAL ] PWR: Loaded 46503 existing records from primary storage. [2025-10-21T22:13:37.173155] [INFO ] [MAIN ] PWR: Loaded 46503 primary data records. [2025-10-21T22:13:37.357250] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:37.369915] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4717 primary records. [2025-10-21T22:13:37.514274] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-10-21T22:13:37.532039] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-10-21T22:13:37.533273] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-10-21T22:13:37.535565] [INFO ] [MAIN ] Derivative Progress: 1492/2057 symbols completed. PVL took 1.3s. Estimated remaining: 3m 34s. Rate: 158.4 symbols/min [2025-10-21T22:13:37.536289] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:37.556336] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:37.557264] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 49613 primary records. [2025-10-21T22:13:37.557613] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-10-21T22:13:37.575718] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-10-21T22:13:37.576423] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-10-21T22:13:37.579107] [INFO ] [MAIN ] Derivative Progress: 1493/2057 symbols completed. PVH took 1.4s. Estimated remaining: 3m 33s. Rate: 158.5 symbols/min [2025-10-21T22:13:37.579424] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:37.606104] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:37.606937] [INFO ] [MAIN ] PWR: Generated 1794 derivative records from 46503 primary records. [2025-10-21T22:13:37.607086] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-10-21T22:13:37.624762] [DEBUG] [LOCAL ] PWR: Derivative data saved (1794 records). [2025-10-21T22:13:37.643313] [DEBUG] [LOCAL ] PX: Loaded 34132 existing records from primary storage. [2025-10-21T22:13:37.642434] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-10-21T22:13:37.646464] [INFO ] [MAIN ] PX: Loaded 34132 primary data records. [2025-10-21T22:13:37.646353] [INFO ] [MAIN ] Derivative Progress: 1494/2057 symbols completed. PWR took 1.2s. Estimated remaining: 3m 33s. Rate: 158.6 symbols/min [2025-10-21T22:13:37.646877] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:37.737304] [DEBUG] [LOCAL ] QD: Loaded 27677 existing records from primary storage. [2025-10-21T22:13:37.754214] [INFO ] [MAIN ] QD: Loaded 27677 primary data records. [2025-10-21T22:13:38.333860] [DEBUG] [LOCAL ] QGEN: Loaded 49069 existing records from primary storage. [2025-10-21T22:13:38.334758] [INFO ] [MAIN ] QGEN: Loaded 49069 primary data records. [2025-10-21T22:13:38.674290] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:38.676101] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 34132 primary records. [2025-10-21T22:13:38.676369] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-10-21T22:13:38.711792] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-10-21T22:13:38.712193] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-10-21T22:13:38.714886] [INFO ] [MAIN ] Derivative Progress: 1495/2057 symbols completed. PX took 1.2s. Estimated remaining: 3m 33s. Rate: 158.4 symbols/min [2025-10-21T22:13:38.715247] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:38.716758] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27677 primary records. [2025-10-21T22:13:38.715597] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:38.716858] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-10-21T22:13:38.747557] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-10-21T22:13:38.747702] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-10-21T22:13:38.750184] [INFO ] [MAIN ] Derivative Progress: 1496/2057 symbols completed. QD took 1.2s. Estimated remaining: 3m 32s. Rate: 158.5 symbols/min [2025-10-21T22:13:38.750333] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:38.751450] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:38.752080] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49069 primary records. [2025-10-21T22:13:38.752139] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-10-21T22:13:38.768200] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-10-21T22:13:38.768449] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-10-21T22:13:38.770849] [INFO ] [MAIN ] Derivative Progress: 1497/2057 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 32s. Rate: 158.6 symbols/min [2025-10-21T22:13:38.771084] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:38.825763] [DEBUG] [LOCAL ] QS: Loaded 53760 existing records from primary storage. [2025-10-21T22:13:38.836078] [INFO ] [MAIN ] QS: Loaded 53760 primary data records. [2025-10-21T22:13:38.960478] [DEBUG] [LOCAL ] QSR: Loaded 52480 existing records from primary storage. [2025-10-21T22:13:38.971551] [INFO ] [MAIN ] QSR: Loaded 52480 primary data records. [2025-10-21T22:13:38.972490] [DEBUG] [LOCAL ] QTWO: Loaded 39479 existing records from primary storage. [2025-10-21T22:13:38.972975] [INFO ] [MAIN ] QTWO: Loaded 39479 primary data records. [2025-10-21T22:13:39.859760] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:39.861177] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53760 primary records. [2025-10-21T22:13:39.861341] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-10-21T22:13:39.885423] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-10-21T22:13:39.885682] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-10-21T22:13:39.888364] [INFO ] [MAIN ] Derivative Progress: 1498/2057 symbols completed. QS took 1.2s. Estimated remaining: 3m 32s. Rate: 158.4 symbols/min [2025-10-21T22:13:39.914162] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:39.915193] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52480 primary records. [2025-10-21T22:13:39.914391] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:39.915347] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-10-21T22:13:39.916147] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 39479 primary records. [2025-10-21T22:13:39.916253] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-10-21T22:13:39.946721] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-10-21T22:13:39.947095] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-10-21T22:13:39.950098] [INFO ] [MAIN ] Derivative Progress: 1499/2057 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 31s. Rate: 158.5 symbols/min [2025-10-21T22:13:39.950319] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-10-21T22:13:39.950410] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-10-21T22:13:39.952930] [INFO ] [MAIN ] Derivative Progress: 1500/2057 symbols completed. QSR took 1.2s. Estimated remaining: 3m 31s. Rate: 158.6 symbols/min [2025-10-21T22:13:39.953315] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:39.953434] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:39.953909] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:39.962122] [DEBUG] [LOCAL ] QVCD: Loaded 4584 existing records from primary storage. [2025-10-21T22:13:39.962489] [INFO ] [MAIN ] QVCD: Loaded 4584 primary data records. [2025-10-21T22:13:40.054039] [DEBUG] [LOCAL ] QVCC: Loaded 8725 existing records from primary storage. [2025-10-21T22:13:40.065128] [INFO ] [MAIN ] QVCC: Loaded 8725 primary data records. [2025-10-21T22:13:40.170770] [DEBUG] [LOCAL ] QUAD: Loaded 23058 existing records from primary storage. [2025-10-21T22:13:40.187741] [INFO ] [MAIN ] QUAD: Loaded 23058 primary data records. [2025-10-21T22:13:40.936243] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:40.939155] [INFO ] [MAIN ] QVCD: Generated 1794 derivative records from 4584 primary records. [2025-10-21T22:13:40.940121] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-10-21T22:13:40.954470] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:40.961268] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 8725 primary records. [2025-10-21T22:13:40.968806] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1794 records). [2025-10-21T22:13:40.965197] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-10-21T22:13:40.969327] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-10-21T22:13:40.971842] [INFO ] [MAIN ] Derivative Progress: 1501/2057 symbols completed. QVCD took 1.0s. Estimated remaining: 3m 31s. Rate: 158.4 symbols/min [2025-10-21T22:13:40.972216] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:40.991327] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-10-21T22:13:40.992329] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-10-21T22:13:40.995291] [INFO ] [MAIN ] Derivative Progress: 1502/2057 symbols completed. QVCC took 1.0s. Estimated remaining: 3m 30s. Rate: 158.5 symbols/min [2025-10-21T22:13:40.995596] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:41.009074] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:41.009732] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 23058 primary records. [2025-10-21T22:13:41.009934] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-10-21T22:13:41.026468] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-10-21T22:13:41.026557] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-10-21T22:13:41.028929] [INFO ] [MAIN ] Derivative Progress: 1503/2057 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 30s. Rate: 158.6 symbols/min [2025-10-21T22:13:41.029235] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:41.071588] [DEBUG] [LOCAL ] R: Loaded 27949 existing records from primary storage. [2025-10-21T22:13:41.087059] [INFO ] [MAIN ] R: Loaded 27949 primary data records. [2025-10-21T22:13:41.131999] [DEBUG] [LOCAL ] RA: Loaded 21936 existing records from primary storage. [2025-10-21T22:13:41.120621] [DEBUG] [LOCAL ] QXO: Loaded 53470 existing records from primary storage. [2025-10-21T22:13:41.156819] [INFO ] [MAIN ] QXO: Loaded 53470 primary data records. [2025-10-21T22:13:41.156727] [INFO ] [MAIN ] RA: Loaded 21936 primary data records. [2025-10-21T22:13:42.117618] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:42.118577] [INFO ] [MAIN ] R: Generated 1794 derivative records from 27949 primary records. [2025-10-21T22:13:42.119006] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-10-21T22:13:42.154143] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-10-21T22:13:42.154531] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-10-21T22:13:42.154973] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:42.157134] [INFO ] [MAIN ] Derivative Progress: 1504/2057 symbols completed. R took 1.2s. Estimated remaining: 3m 29s. Rate: 158.4 symbols/min [2025-10-21T22:13:42.158190] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21936 primary records. [2025-10-21T22:13:42.165736] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:42.170946] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-10-21T22:13:42.171781] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:42.172605] [INFO ] [MAIN ] QXO: Generated 1794 derivative records from 53470 primary records. [2025-10-21T22:13:42.172863] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-10-21T22:13:42.190071] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-10-21T22:13:42.190228] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-10-21T22:13:42.193605] [INFO ] [MAIN ] Derivative Progress: 1505/2057 symbols completed. RA took 1.2s. Estimated remaining: 3m 29s. Rate: 158.5 symbols/min [2025-10-21T22:13:42.201294] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:42.210127] [DEBUG] [LOCAL ] QXO: Derivative data saved (1794 records). [2025-10-21T22:13:42.210486] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-10-21T22:13:42.212901] [INFO ] [MAIN ] Derivative Progress: 1506/2057 symbols completed. QXO took 1.2s. Estimated remaining: 3m 28s. Rate: 158.6 symbols/min [2025-10-21T22:13:42.213078] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:42.250576] [DEBUG] [LOCAL ] RACE: Loaded 32941 existing records from primary storage. [2025-10-21T22:13:42.250765] [INFO ] [MAIN ] RACE: Loaded 32941 primary data records. [2025-10-21T22:13:42.351514] [DEBUG] [LOCAL ] RAMP: Loaded 37686 existing records from primary storage. [2025-10-21T22:13:42.362040] [INFO ] [MAIN ] RAMP: Loaded 37686 primary data records. [2025-10-21T22:13:42.448570] [DEBUG] [LOCAL ] RBA: Loaded 46100 existing records from primary storage. [2025-10-21T22:13:42.464406] [INFO ] [MAIN ] RBA: Loaded 46100 primary data records. [2025-10-21T22:13:43.280300] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:43.281123] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 32941 primary records. [2025-10-21T22:13:43.281389] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-10-21T22:13:43.309818] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-10-21T22:13:43.326979] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:43.327069] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-10-21T22:13:43.329448] [INFO ] [MAIN ] Derivative Progress: 1507/2057 symbols completed. RACE took 1.2s. Estimated remaining: 3m 28s. Rate: 158.4 symbols/min [2025-10-21T22:13:43.330772] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:43.330281] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37686 primary records. [2025-10-21T22:13:43.330602] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:43.332011] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-10-21T22:13:43.331948] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 46100 primary records. [2025-10-21T22:13:43.332105] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-10-21T22:13:43.360269] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-10-21T22:13:43.360414] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-10-21T22:13:43.363594] [INFO ] [MAIN ] Derivative Progress: 1508/2057 symbols completed. RBA took 1.2s. Estimated remaining: 3m 28s. Rate: 158.5 symbols/min [2025-10-21T22:13:43.364598] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:43.368324] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-10-21T22:13:43.368624] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-10-21T22:13:43.375295] [INFO ] [MAIN ] Derivative Progress: 1509/2057 symbols completed. RAMP took 1.2s. Estimated remaining: 3m 27s. Rate: 158.6 symbols/min [2025-10-21T22:13:43.375699] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:43.382907] [DEBUG] [LOCAL ] RBC: Loaded 15293 existing records from primary storage. [2025-10-21T22:13:43.383094] [INFO ] [MAIN ] RBC: Loaded 15293 primary data records. [2025-10-21T22:13:43.486513] [DEBUG] [LOCAL ] RBOT: Loaded 6199 existing records from primary storage. [2025-10-21T22:13:43.489828] [INFO ] [MAIN ] RBOT: Loaded 6199 primary data records. [2025-10-21T22:13:43.851237] [DEBUG] [LOCAL ] RBLX: Loaded 53718 existing records from primary storage. [2025-10-21T22:13:43.884847] [INFO ] [MAIN ] RBLX: Loaded 53718 primary data records. [2025-10-21T22:13:44.389400] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:44.390693] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15293 primary records. [2025-10-21T22:13:44.398517] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-10-21T22:13:44.411891] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:44.420745] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-10-21T22:13:44.421054] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-10-21T22:13:44.424299] [INFO ] [MAIN ] Derivative Progress: 1510/2057 symbols completed. RBC took 1.1s. Estimated remaining: 3m 27s. Rate: 158.4 symbols/min [2025-10-21T22:13:44.424504] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:44.421956] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 6199 primary records. [2025-10-21T22:13:44.424902] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-10-21T22:13:44.441037] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-10-21T22:13:44.441308] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-10-21T22:13:44.443858] [INFO ] [MAIN ] Derivative Progress: 1511/2057 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 27s. Rate: 158.5 symbols/min [2025-10-21T22:13:44.444078] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:44.462986] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:44.463735] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53718 primary records. [2025-10-21T22:13:44.463894] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-10-21T22:13:44.483254] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-10-21T22:13:44.483593] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-10-21T22:13:44.486422] [INFO ] [MAIN ] Derivative Progress: 1512/2057 symbols completed. RBLX took 1.1s. Estimated remaining: 3m 26s. Rate: 158.6 symbols/min [2025-10-21T22:13:44.486904] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:44.506105] [DEBUG] [LOCAL ] RCD: Loaded 3345 existing records from primary storage. [2025-10-21T22:13:44.506292] [INFO ] [MAIN ] RCD: Loaded 3345 primary data records. [2025-10-21T22:13:44.658071] [DEBUG] [LOCAL ] RBRK: Loaded 53163 existing records from primary storage. [2025-10-21T22:13:44.663411] [INFO ] [MAIN ] RBRK: Loaded 53163 primary data records. [2025-10-21T22:13:44.674388] [DEBUG] [LOCAL ] RC: Loaded 48888 existing records from primary storage. [2025-10-21T22:13:44.700594] [INFO ] [MAIN ] RC: Loaded 48888 primary data records. [2025-10-21T22:13:45.467869] [DEBUG] [MAIN ] RCD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:13:45.468856] [INFO ] [MAIN ] RCD: Generated 1793 derivative records from 3345 primary records. [2025-10-21T22:13:45.469209] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-10-21T22:13:45.487102] [DEBUG] [LOCAL ] RCD: Derivative data saved (1793 records). [2025-10-21T22:13:45.499686] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-10-21T22:13:45.501899] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:45.504166] [INFO ] [MAIN ] Derivative Progress: 1513/2057 symbols completed. RCD took 1.0s. Estimated remaining: 3m 26s. Rate: 158.4 symbols/min [2025-10-21T22:13:45.505433] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53163 primary records. [2025-10-21T22:13:45.505541] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-10-21T22:13:45.518509] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:45.519353] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 48888 primary records. [2025-10-21T22:13:45.526435] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-10-21T22:13:45.534086] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-10-21T22:13:45.534165] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-10-21T22:13:45.536621] [INFO ] [MAIN ] Derivative Progress: 1514/2057 symbols completed. RBRK took 1.1s. Estimated remaining: 3m 26s. Rate: 158.5 symbols/min [2025-10-21T22:13:45.551040] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-10-21T22:13:45.551124] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-10-21T22:13:45.553706] [INFO ] [MAIN ] Derivative Progress: 1515/2057 symbols completed. RC took 1.1s. Estimated remaining: 3m 25s. Rate: 158.6 symbols/min [2025-10-21T22:13:45.554113] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:45.554239] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:45.554868] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:45.569030] [DEBUG] [LOCAL ] RCS: Loaded 12511 existing records from primary storage. [2025-10-21T22:13:45.569330] [INFO ] [MAIN ] RCS: Loaded 12511 primary data records. [2025-10-21T22:13:45.930831] [DEBUG] [LOCAL ] RCUS: Loaded 42978 existing records from primary storage. [2025-10-21T22:13:45.944541] [INFO ] [MAIN ] RCUS: Loaded 42978 primary data records. [2025-10-21T22:13:45.982909] [DEBUG] [LOCAL ] RCI: Loaded 48595 existing records from primary storage. [2025-10-21T22:13:46.011577] [INFO ] [MAIN ] RCI: Loaded 48595 primary data records. [2025-10-21T22:13:46.574716] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:46.575826] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 12511 primary records. [2025-10-21T22:13:46.575989] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-10-21T22:13:46.593428] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-10-21T22:13:46.593768] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-10-21T22:13:46.596207] [INFO ] [MAIN ] Derivative Progress: 1516/2057 symbols completed. RCS took 1.0s. Estimated remaining: 3m 25s. Rate: 158.5 symbols/min [2025-10-21T22:13:46.596363] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:46.613370] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:46.614074] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42978 primary records. [2025-10-21T22:13:46.614277] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-10-21T22:13:46.632962] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-10-21T22:13:46.646607] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:46.647379] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48595 primary records. [2025-10-21T22:13:46.646298] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-10-21T22:13:46.650680] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-10-21T22:13:46.650574] [INFO ] [MAIN ] Derivative Progress: 1517/2057 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 24s. Rate: 158.5 symbols/min [2025-10-21T22:13:46.651943] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:46.668672] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-10-21T22:13:46.668883] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-10-21T22:13:46.671771] [INFO ] [MAIN ] Derivative Progress: 1518/2057 symbols completed. RCI took 1.1s. Estimated remaining: 3m 24s. Rate: 158.6 symbols/min [2025-10-21T22:13:46.672063] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:46.712334] [DEBUG] [LOCAL ] RDDT: Loaded 53772 existing records from primary storage. [2025-10-21T22:13:46.712684] [INFO ] [MAIN ] RDDT: Loaded 53772 primary data records. [2025-10-21T22:13:46.859626] [DEBUG] [LOCAL ] RDN: Loaded 44217 existing records from primary storage. [2025-10-21T22:13:46.860372] [INFO ] [MAIN ] RDN: Loaded 44217 primary data records. [2025-10-21T22:13:47.000040] [DEBUG] [LOCAL ] RDW: Loaded 52286 existing records from primary storage. [2025-10-21T22:13:47.149813] [INFO ] [MAIN ] RDW: Loaded 52286 primary data records. [2025-10-21T22:13:47.768608] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:47.769687] [INFO ] [MAIN ] RDDT: Generated 1794 derivative records from 53772 primary records. [2025-10-21T22:13:47.769785] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-10-21T22:13:47.797954] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1794 records). [2025-10-21T22:13:47.798122] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-10-21T22:13:47.800374] [INFO ] [MAIN ] Derivative Progress: 1519/2057 symbols completed. RDDT took 1.2s. Estimated remaining: 3m 24s. Rate: 158.4 symbols/min [2025-10-21T22:13:47.809602] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:47.816687] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:47.817807] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 44217 primary records. [2025-10-21T22:13:47.818009] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-10-21T22:13:47.846776] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-10-21T22:13:47.847568] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-10-21T22:13:47.850932] [INFO ] [MAIN ] Derivative Progress: 1520/2057 symbols completed. RDN took 1.2s. Estimated remaining: 3m 23s. Rate: 158.5 symbols/min [2025-10-21T22:13:47.847893] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:47.851183] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:47.852397] [INFO ] [MAIN ] RDW: Generated 1794 derivative records from 52286 primary records. [2025-10-21T22:13:47.852631] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-10-21T22:13:47.869018] [DEBUG] [LOCAL ] RDW: Derivative data saved (1794 records). [2025-10-21T22:13:47.869280] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-10-21T22:13:47.872387] [INFO ] [MAIN ] Derivative Progress: 1521/2057 symbols completed. RDW took 1.2s. Estimated remaining: 3m 23s. Rate: 158.6 symbols/min [2025-10-21T22:13:47.872576] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:47.918425] [DEBUG] [LOCAL ] RDY: Loaded 46313 existing records from primary storage. [2025-10-21T22:13:47.918734] [INFO ] [MAIN ] RDY: Loaded 46313 primary data records. [2025-10-21T22:13:48.069338] [DEBUG] [LOCAL ] RELX: Loaded 48574 existing records from primary storage. [2025-10-21T22:13:48.096927] [DEBUG] [LOCAL ] RERE: Loaded 41775 existing records from primary storage. [2025-10-21T22:13:48.114443] [INFO ] [MAIN ] RELX: Loaded 48574 primary data records. [2025-10-21T22:13:48.144802] [INFO ] [MAIN ] RERE: Loaded 41775 primary data records. [2025-10-21T22:13:48.939196] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:48.941276] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 46313 primary records. [2025-10-21T22:13:48.941381] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-10-21T22:13:48.959967] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-10-21T22:13:48.960316] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-10-21T22:13:48.962393] [INFO ] [MAIN ] Derivative Progress: 1522/2057 symbols completed. RDY took 1.2s. Estimated remaining: 3m 23s. Rate: 158.4 symbols/min [2025-10-21T22:13:48.962774] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:48.985535] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:48.986354] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 41775 primary records. [2025-10-21T22:13:48.986690] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-10-21T22:13:49.022544] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-10-21T22:13:49.022982] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:49.024389] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-10-21T22:13:49.024278] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 48574 primary records. [2025-10-21T22:13:49.027927] [INFO ] [MAIN ] Derivative Progress: 1523/2057 symbols completed. RERE took 1.2s. Estimated remaining: 3m 22s. Rate: 158.5 symbols/min [2025-10-21T22:13:49.028146] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:49.024600] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-10-21T22:13:49.056250] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-10-21T22:13:49.056566] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-10-21T22:13:49.060568] [INFO ] [MAIN ] Derivative Progress: 1524/2057 symbols completed. RELX took 1.2s. Estimated remaining: 3m 22s. Rate: 158.6 symbols/min [2025-10-21T22:13:49.060934] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:49.076905] [DEBUG] [LOCAL ] RES: Loaded 46955 existing records from primary storage. [2025-10-21T22:13:49.077199] [INFO ] [MAIN ] RES: Loaded 46955 primary data records. [2025-10-21T22:13:49.210019] [DEBUG] [LOCAL ] REX: Loaded 14379 existing records from primary storage. [2025-10-21T22:13:49.210681] [INFO ] [MAIN ] REX: Loaded 14379 primary data records. [2025-10-21T22:13:49.347999] [DEBUG] [LOCAL ] REVG: Loaded 40260 existing records from primary storage. [2025-10-21T22:13:49.512376] [INFO ] [MAIN ] REVG: Loaded 40260 primary data records. [2025-10-21T22:13:50.113840] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:50.115093] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 46955 primary records. [2025-10-21T22:13:50.115491] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-10-21T22:13:50.133526] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-10-21T22:13:50.134984] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-10-21T22:13:50.138045] [INFO ] [MAIN ] Derivative Progress: 1525/2057 symbols completed. RES took 1.2s. Estimated remaining: 3m 21s. Rate: 158.4 symbols/min [2025-10-21T22:13:50.138393] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:50.153931] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:50.154898] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 14379 primary records. [2025-10-21T22:13:50.155118] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-10-21T22:13:50.175425] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-10-21T22:13:50.175974] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-10-21T22:13:50.179366] [INFO ] [MAIN ] Derivative Progress: 1526/2057 symbols completed. REX took 1.1s. Estimated remaining: 3m 21s. Rate: 158.5 symbols/min [2025-10-21T22:13:50.188119] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:50.193859] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:50.194900] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 40260 primary records. [2025-10-21T22:13:50.195058] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-10-21T22:13:50.211604] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-10-21T22:13:50.211848] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-10-21T22:13:50.214750] [INFO ] [MAIN ] Derivative Progress: 1527/2057 symbols completed. REVG took 1.2s. Estimated remaining: 3m 20s. Rate: 158.6 symbols/min [2025-10-21T22:13:50.228572] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:50.251087] [DEBUG] [LOCAL ] REXR: Loaded 52204 existing records from primary storage. [2025-10-21T22:13:50.260240] [INFO ] [MAIN ] REXR: Loaded 52204 primary data records. [2025-10-21T22:13:50.402305] [DEBUG] [LOCAL ] REZI: Loaded 47128 existing records from primary storage. [2025-10-21T22:13:50.455301] [INFO ] [MAIN ] REZI: Loaded 47128 primary data records. [2025-10-21T22:13:50.705914] [DEBUG] [LOCAL ] RF: Loaded 53633 existing records from primary storage. [2025-10-21T22:13:50.706618] [INFO ] [MAIN ] RF: Loaded 53633 primary data records. [2025-10-21T22:13:51.269351] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:51.271486] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52204 primary records. [2025-10-21T22:13:51.271725] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-10-21T22:13:51.294511] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-10-21T22:13:51.295964] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-10-21T22:13:51.300114] [INFO ] [MAIN ] Derivative Progress: 1528/2057 symbols completed. REXR took 1.2s. Estimated remaining: 3m 20s. Rate: 158.4 symbols/min [2025-10-21T22:13:51.318398] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:51.319179] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 47128 primary records. [2025-10-21T22:13:51.319266] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-10-21T22:13:51.337998] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-10-21T22:13:51.338161] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-10-21T22:13:51.341142] [INFO ] [MAIN ] Derivative Progress: 1529/2057 symbols completed. REZI took 1.2s. Estimated remaining: 3m 20s. Rate: 158.5 symbols/min [2025-10-21T22:13:51.353859] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:51.354568] [INFO ] [MAIN ] RF: Generated 1794 derivative records from 53633 primary records. [2025-10-21T22:13:51.354670] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-10-21T22:13:51.370164] [DEBUG] [LOCAL ] RF: Derivative data saved (1794 records). [2025-10-21T22:13:51.370222] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-10-21T22:13:51.373012] [INFO ] [MAIN ] Derivative Progress: 1530/2057 symbols completed. RF took 1.1s. Estimated remaining: 3m 19s. Rate: 158.6 symbols/min [2025-10-21T22:13:51.373505] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:51.373675] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:51.373775] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:51.381893] [DEBUG] [LOCAL ] RFM: Loaded 4210 existing records from primary storage. [2025-10-21T22:13:51.382108] [INFO ] [MAIN ] RFM: Loaded 4210 primary data records. [2025-10-21T22:13:51.465694] [DEBUG] [LOCAL ] RFL: Loaded 11446 existing records from primary storage. [2025-10-21T22:13:51.472218] [INFO ] [MAIN ] RFL: Loaded 11446 primary data records. [2025-10-21T22:13:51.465360] [DEBUG] [LOCAL ] RFI: Loaded 10308 existing records from primary storage. [2025-10-21T22:13:51.488847] [INFO ] [MAIN ] RFI: Loaded 10308 primary data records. [2025-10-21T22:13:52.401367] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:52.403098] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4210 primary records. [2025-10-21T22:13:52.403880] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-10-21T22:13:52.420039] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-10-21T22:13:52.420142] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-10-21T22:13:52.434373] [INFO ] [MAIN ] Derivative Progress: 1531/2057 symbols completed. RFM took 1.1s. Estimated remaining: 3m 19s. Rate: 158.4 symbols/min [2025-10-21T22:13:52.434564] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:52.436546] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:52.437284] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 11446 primary records. [2025-10-21T22:13:52.437440] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-10-21T22:13:52.469018] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-10-21T22:13:52.473069] [DEBUG] [LOCAL ] RFMZ: Loaded 8978 existing records from primary storage. [2025-10-21T22:13:52.468956] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:52.473251] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-10-21T22:13:52.473174] [INFO ] [MAIN ] RFMZ: Loaded 8978 primary data records. [2025-10-21T22:13:52.475993] [INFO ] [MAIN ] Derivative Progress: 1532/2057 symbols completed. RFL took 1.1s. Estimated remaining: 3m 19s. Rate: 158.5 symbols/min [2025-10-21T22:13:52.487991] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10308 primary records. [2025-10-21T22:13:52.512981] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-10-21T22:13:52.500716] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:52.600668] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-10-21T22:13:52.601176] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-10-21T22:13:52.624568] [INFO ] [MAIN ] Derivative Progress: 1533/2057 symbols completed. RFI took 1.3s. Estimated remaining: 3m 18s. Rate: 158.6 symbols/min [2025-10-21T22:13:52.794874] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:52.817155] [DEBUG] [LOCAL ] RGA: Loaded 29320 existing records from primary storage. [2025-10-21T22:13:52.817923] [INFO ] [MAIN ] RGA: Loaded 29320 primary data records. [2025-10-21T22:13:52.952411] [DEBUG] [LOCAL ] RGR: Loaded 21070 existing records from primary storage. [2025-10-21T22:13:53.009529] [INFO ] [MAIN ] RGR: Loaded 21070 primary data records. [2025-10-21T22:13:53.347235] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:53.466278] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8978 primary records. [2025-10-21T22:13:53.476510] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-10-21T22:13:53.494493] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-10-21T22:13:53.496134] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-10-21T22:13:53.498994] [INFO ] [MAIN ] Derivative Progress: 1534/2057 symbols completed. RFMZ took 1.1s. Estimated remaining: 3m 18s. Rate: 158.4 symbols/min [2025-10-21T22:13:53.500038] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:53.509088] [DEBUG] [LOCAL ] RGT: Loaded 2719 existing records from primary storage. [2025-10-21T22:13:53.509460] [INFO ] [MAIN ] RGT: Loaded 2719 primary data records. [2025-10-21T22:13:53.576841] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:53.586048] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 29320 primary records. [2025-10-21T22:13:53.586311] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-10-21T22:13:53.683557] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-10-21T22:13:53.716223] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-10-21T22:13:53.724691] [INFO ] [MAIN ] Derivative Progress: 1535/2057 symbols completed. RGA took 1.2s. Estimated remaining: 3m 18s. Rate: 158.5 symbols/min [2025-10-21T22:13:53.724949] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:53.864740] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:53.893597] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 21070 primary records. [2025-10-21T22:13:53.894426] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-10-21T22:13:53.911181] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-10-21T22:13:53.911377] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-10-21T22:13:53.914638] [INFO ] [MAIN ] Derivative Progress: 1536/2057 symbols completed. RGR took 1.1s. Estimated remaining: 3m 17s. Rate: 158.5 symbols/min [2025-10-21T22:13:53.915448] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:53.948009] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:53.948632] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2719 primary records. [2025-10-21T22:13:53.948795] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-10-21T22:13:53.963096] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-10-21T22:13:53.975909] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-10-21T22:13:53.978433] [INFO ] [MAIN ] Derivative Progress: 1537/2057 symbols completed. RGT took 0.5s. Estimated remaining: 3m 17s. Rate: 158.6 symbols/min [2025-10-21T22:13:53.987819] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:53.991118] [DEBUG] [LOCAL ] RH: Loaded 47171 existing records from primary storage. [2025-10-21T22:13:53.991413] [INFO ] [MAIN ] RH: Loaded 47171 primary data records. [2025-10-21T22:13:54.118000] [DEBUG] [LOCAL ] RHI: Loaded 49676 existing records from primary storage. [2025-10-21T22:13:54.118281] [INFO ] [MAIN ] RHI: Loaded 49676 primary data records. [2025-10-21T22:13:54.330395] [DEBUG] [LOCAL ] RHP: Loaded 40408 existing records from primary storage. [2025-10-21T22:13:54.439748] [INFO ] [MAIN ] RHP: Loaded 40408 primary data records. [2025-10-21T22:13:54.982698] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:54.985616] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47171 primary records. [2025-10-21T22:13:54.985976] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-10-21T22:13:54.999285] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:55.000220] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49676 primary records. [2025-10-21T22:13:55.007597] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-10-21T22:13:55.016335] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-10-21T22:13:55.016914] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-10-21T22:13:55.019638] [INFO ] [MAIN ] Derivative Progress: 1538/2057 symbols completed. RH took 1.3s. Estimated remaining: 3m 17s. Rate: 158.4 symbols/min [2025-10-21T22:13:55.019990] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:55.036360] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-10-21T22:13:55.038574] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-10-21T22:13:55.042027] [INFO ] [MAIN ] Derivative Progress: 1539/2057 symbols completed. RHI took 1.1s. Estimated remaining: 3m 16s. Rate: 158.5 symbols/min [2025-10-21T22:13:55.042302] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:55.056037] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:55.056743] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 40408 primary records. [2025-10-21T22:13:55.056950] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-10-21T22:13:55.075940] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-10-21T22:13:55.076141] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-10-21T22:13:55.078875] [INFO ] [MAIN ] Derivative Progress: 1540/2057 symbols completed. RHP took 1.1s. Estimated remaining: 3m 16s. Rate: 158.6 symbols/min [2025-10-21T22:13:55.079132] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:55.127943] [DEBUG] [LOCAL ] RIG: Loaded 53675 existing records from primary storage. [2025-10-21T22:13:55.128137] [INFO ] [MAIN ] RIG: Loaded 53675 primary data records. [2025-10-21T22:13:55.261833] [DEBUG] [LOCAL ] RIO: Loaded 53402 existing records from primary storage. [2025-10-21T22:13:55.267661] [INFO ] [MAIN ] RIO: Loaded 53402 primary data records. [2025-10-21T22:13:55.612404] [DEBUG] [LOCAL ] RITM: Loaded 52948 existing records from primary storage. [2025-10-21T22:13:55.635385] [INFO ] [MAIN ] RITM: Loaded 52948 primary data records. [2025-10-21T22:13:56.189580] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:56.190753] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53675 primary records. [2025-10-21T22:13:56.191179] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-10-21T22:13:56.218780] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-10-21T22:13:56.223760] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-10-21T22:13:56.224151] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:56.227014] [INFO ] [MAIN ] Derivative Progress: 1541/2057 symbols completed. RIG took 1.2s. Estimated remaining: 3m 15s. Rate: 158.4 symbols/min [2025-10-21T22:13:56.228901] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53402 primary records. [2025-10-21T22:13:56.229004] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-10-21T22:13:56.229407] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:56.247338] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-10-21T22:13:56.247827] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-10-21T22:13:56.250446] [INFO ] [MAIN ] Derivative Progress: 1542/2057 symbols completed. RIO took 1.2s. Estimated remaining: 3m 15s. Rate: 158.5 symbols/min [2025-10-21T22:13:56.250718] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:56.277553] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:56.279146] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52948 primary records. [2025-10-21T22:13:56.279741] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-10-21T22:13:56.279604] [DEBUG] [LOCAL ] RIV: Loaded 12687 existing records from primary storage. [2025-10-21T22:13:56.280263] [INFO ] [MAIN ] RIV: Loaded 12687 primary data records. [2025-10-21T22:13:56.368602] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-10-21T22:13:56.380857] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-10-21T22:13:56.389310] [INFO ] [MAIN ] Derivative Progress: 1543/2057 symbols completed. RITM took 1.3s. Estimated remaining: 3m 14s. Rate: 158.6 symbols/min [2025-10-21T22:13:56.646611] [DEBUG] [LOCAL ] RJF: Loaded 46561 existing records from primary storage. [2025-10-21T22:13:56.646880] [INFO ] [MAIN ] RJF: Loaded 46561 primary data records. [2025-10-21T22:13:56.994080] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:56.995366] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 12687 primary records. [2025-10-21T22:13:56.995447] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-10-21T22:13:57.012261] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-10-21T22:13:57.012465] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-10-21T22:13:57.014809] [INFO ] [MAIN ] Derivative Progress: 1544/2057 symbols completed. RIV took 0.8s. Estimated remaining: 3m 14s. Rate: 158.5 symbols/min [2025-10-21T22:13:57.031086] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:13:57.031730] [INFO ] [MAIN ] RJF: Generated 1793 derivative records from 46561 primary records. [2025-10-21T22:13:57.031790] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-10-21T22:13:57.047177] [DEBUG] [LOCAL ] RJF: Derivative data saved (1793 records). [2025-10-21T22:13:57.047236] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-10-21T22:13:57.050005] [INFO ] [MAIN ] Derivative Progress: 1545/2057 symbols completed. RJF took 0.8s. Estimated remaining: 3m 14s. Rate: 158.6 symbols/min [2025-10-21T22:13:57.050357] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:57.050532] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:57.050431] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:57.095433] [DEBUG] [LOCAL ] RLI: Loaded 34734 existing records from primary storage. [2025-10-21T22:13:57.108375] [INFO ] [MAIN ] RLI: Loaded 34734 primary data records. [2025-10-21T22:13:57.151109] [DEBUG] [LOCAL ] RL: Loaded 39575 existing records from primary storage. [2025-10-21T22:13:57.163138] [INFO ] [MAIN ] RL: Loaded 39575 primary data records. [2025-10-21T22:13:57.348750] [DEBUG] [LOCAL ] RKT: Loaded 53729 existing records from primary storage. [2025-10-21T22:13:57.399273] [INFO ] [MAIN ] RKT: Loaded 53729 primary data records. [2025-10-21T22:13:58.118062] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:58.121166] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 34734 primary records. [2025-10-21T22:13:58.121329] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-10-21T22:13:58.142119] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-10-21T22:13:58.156292] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-10-21T22:13:58.158619] [INFO ] [MAIN ] Derivative Progress: 1546/2057 symbols completed. RLI took 1.1s. Estimated remaining: 3m 14s. Rate: 158.4 symbols/min [2025-10-21T22:13:58.160229] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:58.160778] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:58.162223] [INFO ] [MAIN ] RL: Generated 1794 derivative records from 39575 primary records. [2025-10-21T22:13:58.162316] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-10-21T22:13:58.197329] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:58.198437] [DEBUG] [LOCAL ] RL: Derivative data saved (1794 records). [2025-10-21T22:13:58.200134] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53729 primary records. [2025-10-21T22:13:58.199163] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-10-21T22:13:58.204918] [INFO ] [MAIN ] Derivative Progress: 1547/2057 symbols completed. RL took 1.2s. Estimated remaining: 3m 13s. Rate: 158.5 symbols/min [2025-10-21T22:13:58.205338] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:58.205088] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-10-21T22:13:58.234181] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-10-21T22:13:58.234336] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-10-21T22:13:58.236943] [INFO ] [MAIN ] Derivative Progress: 1548/2057 symbols completed. RKT took 1.2s. Estimated remaining: 3m 13s. Rate: 158.6 symbols/min [2025-10-21T22:13:58.240984] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:58.248812] [DEBUG] [LOCAL ] RLTY: Loaded 11133 existing records from primary storage. [2025-10-21T22:13:58.249181] [INFO ] [MAIN ] RLTY: Loaded 11133 primary data records. [2025-10-21T22:13:58.373473] [DEBUG] [LOCAL ] RLJ: Loaded 47968 existing records from primary storage. [2025-10-21T22:13:58.378114] [INFO ] [MAIN ] RLJ: Loaded 47968 primary data records. [2025-10-21T22:13:58.796702] [DEBUG] [LOCAL ] RLX: Loaded 48166 existing records from primary storage. [2025-10-21T22:13:58.923186] [INFO ] [MAIN ] RLX: Loaded 48166 primary data records. [2025-10-21T22:13:59.292570] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:59.294519] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11133 primary records. [2025-10-21T22:13:59.296402] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-10-21T22:13:59.321886] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:59.330971] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 47968 primary records. [2025-10-21T22:13:59.330449] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-10-21T22:13:59.331364] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-10-21T22:13:59.334320] [INFO ] [MAIN ] Derivative Progress: 1549/2057 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 12s. Rate: 158.4 symbols/min [2025-10-21T22:13:59.334694] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-10-21T22:13:59.334847] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:59.353517] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-10-21T22:13:59.353746] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-10-21T22:13:59.356516] [INFO ] [MAIN ] Derivative Progress: 1550/2057 symbols completed. RLJ took 1.2s. Estimated remaining: 3m 12s. Rate: 158.5 symbols/min [2025-10-21T22:13:59.356821] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:13:59.365098] [DEBUG] [LOCAL ] RM: Loaded 7555 existing records from primary storage. [2025-10-21T22:13:59.365246] [INFO ] [MAIN ] RM: Loaded 7555 primary data records. [2025-10-21T22:13:59.507432] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:13:59.513309] [DEBUG] [LOCAL ] RMAX: Loaded 21668 existing records from primary storage. [2025-10-21T22:13:59.558367] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48166 primary records. [2025-10-21T22:13:59.583719] [INFO ] [MAIN ] RMAX: Loaded 21668 primary data records. [2025-10-21T22:13:59.594543] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-10-21T22:13:59.836443] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-10-21T22:13:59.906940] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-10-21T22:14:00.078454] [INFO ] [MAIN ] Derivative Progress: 1551/2057 symbols completed. RLX took 1.8s. Estimated remaining: 3m 12s. Rate: 158.4 symbols/min [2025-10-21T22:14:00.087992] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:00.112668] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:00.113380] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7555 primary records. [2025-10-21T22:14:00.113513] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-10-21T22:14:00.142667] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-10-21T22:14:00.143047] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-10-21T22:14:00.152778] [INFO ] [MAIN ] Derivative Progress: 1552/2057 symbols completed. RM took 0.8s. Estimated remaining: 3m 11s. Rate: 158.5 symbols/min [2025-10-21T22:14:00.158472] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:00.158798] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:00.159748] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21668 primary records. [2025-10-21T22:14:00.171147] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-10-21T22:14:00.190571] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-10-21T22:14:00.187074] [DEBUG] [LOCAL ] RMD: Loaded 41958 existing records from primary storage. [2025-10-21T22:14:00.190867] [INFO ] [MAIN ] RMD: Loaded 41958 primary data records. [2025-10-21T22:14:00.190803] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-10-21T22:14:00.196831] [INFO ] [MAIN ] Derivative Progress: 1553/2057 symbols completed. RMAX took 0.8s. Estimated remaining: 3m 11s. Rate: 158.6 symbols/min [2025-10-21T22:14:00.202559] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:00.202459] [DEBUG] [LOCAL ] RMI: Loaded 4731 existing records from primary storage. [2025-10-21T22:14:00.235618] [INFO ] [MAIN ] RMI: Loaded 4731 primary data records. [2025-10-21T22:14:00.421528] [DEBUG] [LOCAL ] RMM: Loaded 10888 existing records from primary storage. [2025-10-21T22:14:00.438005] [INFO ] [MAIN ] RMM: Loaded 10888 primary data records. [2025-10-21T22:14:01.136744] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:01.137997] [INFO ] [MAIN ] RMI: Generated 1794 derivative records from 4731 primary records. [2025-10-21T22:14:01.139381] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-10-21T22:14:01.172695] [DEBUG] [LOCAL ] RMI: Derivative data saved (1794 records). [2025-10-21T22:14:01.172927] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-10-21T22:14:01.175396] [INFO ] [MAIN ] Derivative Progress: 1554/2057 symbols completed. RMI took 1.0s. Estimated remaining: 3m 11s. Rate: 158.4 symbols/min [2025-10-21T22:14:01.173213] [DEBUG] [MAIN ] RMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:01.176470] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:01.176270] [INFO ] [MAIN ] RMD: Generated 1794 derivative records from 41958 primary records. [2025-10-21T22:14:01.176912] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-10-21T22:14:01.203917] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:01.205076] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10888 primary records. [2025-10-21T22:14:01.205789] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-10-21T22:14:01.211975] [DEBUG] [LOCAL ] RMD: Derivative data saved (1794 records). [2025-10-21T22:14:01.212333] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-10-21T22:14:01.222250] [DEBUG] [LOCAL ] RMMZ: Loaded 4789 existing records from primary storage. [2025-10-21T22:14:01.227080] [INFO ] [MAIN ] Derivative Progress: 1555/2057 symbols completed. RMD took 1.1s. Estimated remaining: 3m 10s. Rate: 158.5 symbols/min [2025-10-21T22:14:01.230356] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:01.234506] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-10-21T22:14:01.234699] [INFO ] [MAIN ] RMMZ: Loaded 4789 primary data records. [2025-10-21T22:14:01.246162] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-10-21T22:14:01.258165] [INFO ] [MAIN ] Derivative Progress: 1556/2057 symbols completed. RMM took 1.1s. Estimated remaining: 3m 10s. Rate: 158.6 symbols/min [2025-10-21T22:14:01.292820] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:01.394671] [DEBUG] [LOCAL ] RMT: Loaded 17254 existing records from primary storage. [2025-10-21T22:14:01.410259] [INFO ] [MAIN ] RMT: Loaded 17254 primary data records. [2025-10-21T22:14:01.727250] [DEBUG] [LOCAL ] RNG: Loaded 48007 existing records from primary storage. [2025-10-21T22:14:01.800718] [INFO ] [MAIN ] RNG: Loaded 48007 primary data records. [2025-10-21T22:14:02.253289] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:02.254532] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4789 primary records. [2025-10-21T22:14:02.255125] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-10-21T22:14:02.272345] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-10-21T22:14:02.272785] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-10-21T22:14:02.275294] [INFO ] [MAIN ] Derivative Progress: 1557/2057 symbols completed. RMMZ took 1.1s. Estimated remaining: 3m 9s. Rate: 158.4 symbols/min [2025-10-21T22:14:02.275924] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:02.298827] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:02.305498] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17254 primary records. [2025-10-21T22:14:02.305866] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-10-21T22:14:02.334328] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-10-21T22:14:02.335809] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-10-21T22:14:02.336207] [DEBUG] [LOCAL ] RNGR: Loaded 20828 existing records from primary storage. [2025-10-21T22:14:02.340958] [INFO ] [MAIN ] Derivative Progress: 1558/2057 symbols completed. RMT took 1.1s. Estimated remaining: 3m 9s. Rate: 158.5 symbols/min [2025-10-21T22:14:02.354547] [INFO ] [MAIN ] RNGR: Loaded 20828 primary data records. [2025-10-21T22:14:02.355187] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:02.431063] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 48007 primary records. [2025-10-21T22:14:02.454806] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-10-21T22:14:02.495519] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-10-21T22:14:02.513519] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-10-21T22:14:02.531964] [INFO ] [MAIN ] Derivative Progress: 1559/2057 symbols completed. RNG took 1.2s. Estimated remaining: 3m 8s. Rate: 158.5 symbols/min [2025-10-21T22:14:02.682462] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:02.683103] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20828 primary records. [2025-10-21T22:14:02.683164] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-10-21T22:14:02.698204] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-10-21T22:14:02.698259] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-10-21T22:14:02.700200] [INFO ] [MAIN ] Derivative Progress: 1560/2057 symbols completed. RNGR took 0.4s. Estimated remaining: 3m 8s. Rate: 158.6 symbols/min [2025-10-21T22:14:02.701087] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:02.701350] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:02.700904] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:02.729619] [DEBUG] [LOCAL ] RNP: Loaded 16036 existing records from primary storage. [2025-10-21T22:14:02.742119] [INFO ] [MAIN ] RNP: Loaded 16036 primary data records. [2025-10-21T22:14:02.871119] [DEBUG] [LOCAL ] RNR: Loaded 33624 existing records from primary storage. [2025-10-21T22:14:02.893686] [INFO ] [MAIN ] RNR: Loaded 33624 primary data records. [2025-10-21T22:14:02.868932] [DEBUG] [LOCAL ] RNST: Loaded 36011 existing records from primary storage. [2025-10-21T22:14:02.897588] [INFO ] [MAIN ] RNST: Loaded 36011 primary data records. [2025-10-21T22:14:03.790462] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:03.791832] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 16036 primary records. [2025-10-21T22:14:03.792275] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-10-21T22:14:03.810335] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-10-21T22:14:03.810529] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-10-21T22:14:03.813340] [INFO ] [MAIN ] Derivative Progress: 1561/2057 symbols completed. RNP took 1.1s. Estimated remaining: 3m 8s. Rate: 158.4 symbols/min [2025-10-21T22:14:03.813819] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:03.847822] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:03.849236] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 33624 primary records. [2025-10-21T22:14:03.849486] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-10-21T22:14:03.864402] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:03.872596] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 36011 primary records. [2025-10-21T22:14:03.873848] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-10-21T22:14:03.889895] [DEBUG] [LOCAL ] ROG: Loaded 21822 existing records from primary storage. [2025-10-21T22:14:03.894710] [INFO ] [MAIN ] ROG: Loaded 21822 primary data records. [2025-10-21T22:14:03.896076] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-10-21T22:14:03.940165] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-10-21T22:14:03.948527] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-10-21T22:14:03.951695] [INFO ] [MAIN ] Derivative Progress: 1562/2057 symbols completed. RNR took 1.3s. Estimated remaining: 3m 7s. Rate: 158.5 symbols/min [2025-10-21T22:14:03.979114] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-10-21T22:14:03.979271] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:03.987610] [INFO ] [MAIN ] Derivative Progress: 1563/2057 symbols completed. RNST took 1.3s. Estimated remaining: 3m 7s. Rate: 158.6 symbols/min [2025-10-21T22:14:04.011732] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:04.301376] [DEBUG] [LOCAL ] ROK: Loaded 42879 existing records from primary storage. [2025-10-21T22:14:04.301845] [INFO ] [MAIN ] ROK: Loaded 42879 primary data records. [2025-10-21T22:14:04.421278] [DEBUG] [LOCAL ] ROL: Loaded 50278 existing records from primary storage. [2025-10-21T22:14:04.421632] [INFO ] [MAIN ] ROL: Loaded 50278 primary data records. [2025-10-21T22:14:04.750979] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:04.774231] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 21822 primary records. [2025-10-21T22:14:04.780356] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-10-21T22:14:04.972818] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-10-21T22:14:04.984688] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-10-21T22:14:04.987345] [INFO ] [MAIN ] Derivative Progress: 1564/2057 symbols completed. ROG took 1.2s. Estimated remaining: 3m 7s. Rate: 158.4 symbols/min [2025-10-21T22:14:04.987529] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:05.016914] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:05.018230] [INFO ] [MAIN ] ROK: Generated 1794 derivative records from 42879 primary records. [2025-10-21T22:14:05.018614] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-10-21T22:14:05.056017] [DEBUG] [LOCAL ] ROK: Derivative data saved (1794 records). [2025-10-21T22:14:05.078763] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-10-21T22:14:05.082520] [INFO ] [MAIN ] Derivative Progress: 1565/2057 symbols completed. ROK took 1.1s. Estimated remaining: 3m 6s. Rate: 158.5 symbols/min [2025-10-21T22:14:05.082789] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:05.079302] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:05.085372] [INFO ] [MAIN ] ROL: Generated 1794 derivative records from 50278 primary records. [2025-10-21T22:14:05.084184] [DEBUG] [LOCAL ] RPM: Loaded 42107 existing records from primary storage. [2025-10-21T22:14:05.085682] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-10-21T22:14:05.085602] [INFO ] [MAIN ] RPM: Loaded 42107 primary data records. [2025-10-21T22:14:05.217208] [DEBUG] [LOCAL ] ROL: Derivative data saved (1794 records). [2025-10-21T22:14:05.217444] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-10-21T22:14:05.239229] [INFO ] [MAIN ] Derivative Progress: 1566/2057 symbols completed. ROL took 1.2s. Estimated remaining: 3m 6s. Rate: 158.5 symbols/min [2025-10-21T22:14:05.252379] [DEBUG] [LOCAL ] RPT: Loaded 19031 existing records from primary storage. [2025-10-21T22:14:05.272155] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:05.281784] [INFO ] [MAIN ] RPT: Loaded 19031 primary data records. [2025-10-21T22:14:05.754247] [DEBUG] [LOCAL ] RQI: Loaded 28928 existing records from primary storage. [2025-10-21T22:14:05.754787] [INFO ] [MAIN ] RQI: Loaded 28928 primary data records. [2025-10-21T22:14:05.964411] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:06.111670] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 42107 primary records. [2025-10-21T22:14:06.125346] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-10-21T22:14:06.159109] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-10-21T22:14:06.159804] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-10-21T22:14:06.162410] [INFO ] [MAIN ] Derivative Progress: 1567/2057 symbols completed. RPM took 1.2s. Estimated remaining: 3m 6s. Rate: 158.4 symbols/min [2025-10-21T22:14:06.160277] [DEBUG] [MAIN ] RPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:06.162979] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:06.163881] [INFO ] [MAIN ] RPT: Generated 1794 derivative records from 19031 primary records. [2025-10-21T22:14:06.164054] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-10-21T22:14:06.181894] [DEBUG] [LOCAL ] RPT: Derivative data saved (1794 records). [2025-10-21T22:14:06.182324] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-10-21T22:14:06.184603] [INFO ] [MAIN ] Derivative Progress: 1568/2057 symbols completed. RPT took 1.1s. Estimated remaining: 3m 5s. Rate: 158.5 symbols/min [2025-10-21T22:14:06.185145] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:06.203930] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:06.204612] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 28928 primary records. [2025-10-21T22:14:06.204856] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-10-21T22:14:06.221104] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-10-21T22:14:06.221305] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-10-21T22:14:06.223526] [INFO ] [MAIN ] Derivative Progress: 1569/2057 symbols completed. RQI took 1.0s. Estimated remaining: 3m 5s. Rate: 158.6 symbols/min [2025-10-21T22:14:06.237101] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:06.266500] [DEBUG] [LOCAL ] RRC: Loaded 52921 existing records from primary storage. [2025-10-21T22:14:06.271764] [INFO ] [MAIN ] RRC: Loaded 52921 primary data records. [2025-10-21T22:14:06.341896] [DEBUG] [LOCAL ] RRX: Loaded 40876 existing records from primary storage. [2025-10-21T22:14:06.368298] [INFO ] [MAIN ] RRX: Loaded 40876 primary data records. [2025-10-21T22:14:06.410401] [DEBUG] [LOCAL ] RS: Loaded 24603 existing records from primary storage. [2025-10-21T22:14:06.436457] [INFO ] [MAIN ] RS: Loaded 24603 primary data records. [2025-10-21T22:14:07.215956] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:07.216980] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52921 primary records. [2025-10-21T22:14:07.217159] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-10-21T22:14:07.247948] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-10-21T22:14:07.249908] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:07.249634] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-10-21T22:14:07.250605] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 40876 primary records. [2025-10-21T22:14:07.253212] [INFO ] [MAIN ] Derivative Progress: 1570/2057 symbols completed. RRC took 1.1s. Estimated remaining: 3m 4s. Rate: 158.4 symbols/min [2025-10-21T22:14:07.250715] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-10-21T22:14:07.254315] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:07.278609] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:14:07.279408] [INFO ] [MAIN ] RS: Generated 1793 derivative records from 24603 primary records. [2025-10-21T22:14:07.283921] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-10-21T22:14:07.285483] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-10-21T22:14:07.285788] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-10-21T22:14:07.294872] [INFO ] [MAIN ] Derivative Progress: 1571/2057 symbols completed. RRX took 1.1s. Estimated remaining: 3m 4s. Rate: 158.5 symbols/min [2025-10-21T22:14:07.302466] [DEBUG] [LOCAL ] RS: Derivative data saved (1793 records). [2025-10-21T22:14:07.301977] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:07.302673] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-10-21T22:14:07.307781] [INFO ] [MAIN ] Derivative Progress: 1572/2057 symbols completed. RS took 1.1s. Estimated remaining: 3m 3s. Rate: 158.6 symbols/min [2025-10-21T22:14:07.308044] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:07.308310] [DEBUG] [LOCAL ] RSF: Loaded 4283 existing records from primary storage. [2025-10-21T22:14:07.308623] [INFO ] [MAIN ] RSF: Loaded 4283 primary data records. [2025-10-21T22:14:07.642531] [DEBUG] [LOCAL ] RSI: Loaded 46990 existing records from primary storage. [2025-10-21T22:14:07.643269] [INFO ] [MAIN ] RSI: Loaded 46990 primary data records. [2025-10-21T22:14:07.721123] [DEBUG] [LOCAL ] RSG: Loaded 47364 existing records from primary storage. [2025-10-21T22:14:07.758414] [INFO ] [MAIN ] RSG: Loaded 47364 primary data records. [2025-10-21T22:14:08.296225] [DEBUG] [MAIN ] RSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:08.297025] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4283 primary records. [2025-10-21T22:14:08.297422] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-10-21T22:14:08.315028] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-10-21T22:14:08.315670] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-10-21T22:14:08.317840] [INFO ] [MAIN ] Derivative Progress: 1573/2057 symbols completed. RSF took 1.1s. Estimated remaining: 3m 3s. Rate: 158.4 symbols/min [2025-10-21T22:14:08.335939] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:08.336632] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 46990 primary records. [2025-10-21T22:14:08.336806] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-10-21T22:14:08.354440] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-10-21T22:14:08.354593] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-10-21T22:14:08.356370] [INFO ] [MAIN ] Derivative Progress: 1574/2057 symbols completed. RSI took 1.0s. Estimated remaining: 3m 3s. Rate: 158.5 symbols/min [2025-10-21T22:14:08.368587] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:08.369131] [INFO ] [MAIN ] RSG: Generated 1794 derivative records from 47364 primary records. [2025-10-21T22:14:08.369189] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-10-21T22:14:08.384302] [DEBUG] [LOCAL ] RSG: Derivative data saved (1794 records). [2025-10-21T22:14:08.384357] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-10-21T22:14:08.386806] [INFO ] [MAIN ] Derivative Progress: 1575/2057 symbols completed. RSG took 1.1s. Estimated remaining: 3m 2s. Rate: 158.6 symbols/min [2025-10-21T22:14:08.387579] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:08.387726] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:08.387966] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:08.454978] [DEBUG] [LOCAL ] RSKD: Loaded 33301 existing records from primary storage. [2025-10-21T22:14:08.455167] [INFO ] [MAIN ] RSKD: Loaded 33301 primary data records. [2025-10-21T22:14:08.455840] [DEBUG] [LOCAL ] RTO: Loaded 39798 existing records from primary storage. [2025-10-21T22:14:08.473848] [INFO ] [MAIN ] RTO: Loaded 39798 primary data records. [2025-10-21T22:14:08.645459] [DEBUG] [LOCAL ] RTX: Loaded 53706 existing records from primary storage. [2025-10-21T22:14:08.677901] [INFO ] [MAIN ] RTX: Loaded 53706 primary data records. [2025-10-21T22:14:09.446333] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:09.447769] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 39798 primary records. [2025-10-21T22:14:09.446965] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:09.448597] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 33301 primary records. [2025-10-21T22:14:09.448846] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-10-21T22:14:09.449076] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-10-21T22:14:09.482009] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-10-21T22:14:09.483260] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-10-21T22:14:09.483041] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-10-21T22:14:09.483458] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-10-21T22:14:09.485599] [INFO ] [MAIN ] Derivative Progress: 1576/2057 symbols completed. RSKD took 1.1s. Estimated remaining: 3m 2s. Rate: 158.4 symbols/min [2025-10-21T22:14:09.485896] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:09.495872] [INFO ] [MAIN ] Derivative Progress: 1577/2057 symbols completed. RTO took 1.1s. Estimated remaining: 3m 2s. Rate: 158.5 symbols/min [2025-10-21T22:14:09.502075] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:09.502934] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53706 primary records. [2025-10-21T22:14:09.501769] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:09.503333] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-10-21T22:14:09.519893] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-10-21T22:14:09.520185] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-10-21T22:14:09.522773] [INFO ] [MAIN ] Derivative Progress: 1578/2057 symbols completed. RTX took 1.1s. Estimated remaining: 3m 1s. Rate: 158.6 symbols/min [2025-10-21T22:14:09.523019] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:09.570290] [DEBUG] [LOCAL ] RVT: Loaded 26271 existing records from primary storage. [2025-10-21T22:14:09.570501] [INFO ] [MAIN ] RVT: Loaded 26271 primary data records. [2025-10-21T22:14:09.654911] [DEBUG] [LOCAL ] RWT: Loaded 40481 existing records from primary storage. [2025-10-21T22:14:09.674319] [INFO ] [MAIN ] RWT: Loaded 40481 primary data records. [2025-10-21T22:14:09.740024] [DEBUG] [LOCAL ] RVLV: Loaded 47419 existing records from primary storage. [2025-10-21T22:14:09.783667] [INFO ] [MAIN ] RVLV: Loaded 47419 primary data records. [2025-10-21T22:14:10.551739] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:10.554122] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 26271 primary records. [2025-10-21T22:14:10.554863] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-10-21T22:14:10.579487] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:10.584783] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40481 primary records. [2025-10-21T22:14:10.585112] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-10-21T22:14:10.585976] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-10-21T22:14:10.585857] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-10-21T22:14:10.588754] [INFO ] [MAIN ] Derivative Progress: 1579/2057 symbols completed. RVT took 1.1s. Estimated remaining: 3m 1s. Rate: 158.4 symbols/min [2025-10-21T22:14:10.588980] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:10.613263] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:10.618087] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-10-21T22:14:10.618018] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 47419 primary records. [2025-10-21T22:14:10.618197] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-10-21T22:14:10.618320] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-10-21T22:14:10.621075] [INFO ] [MAIN ] Derivative Progress: 1580/2057 symbols completed. RWT took 1.1s. Estimated remaining: 3m 1s. Rate: 158.5 symbols/min [2025-10-21T22:14:10.621460] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:10.637389] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-10-21T22:14:10.637581] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-10-21T22:14:10.640233] [INFO ] [MAIN ] Derivative Progress: 1581/2057 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 0s. Rate: 158.6 symbols/min [2025-10-21T22:14:10.640602] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:10.697460] [DEBUG] [LOCAL ] RXO: Loaded 48484 existing records from primary storage. [2025-10-21T22:14:10.710907] [INFO ] [MAIN ] RXO: Loaded 48484 primary data records. [2025-10-21T22:14:10.711610] [DEBUG] [LOCAL ] RY: Loaded 47533 existing records from primary storage. [2025-10-21T22:14:10.743914] [INFO ] [MAIN ] RY: Loaded 47533 primary data records. [2025-10-21T22:14:10.835960] [DEBUG] [LOCAL ] RYAM: Loaded 35073 existing records from primary storage. [2025-10-21T22:14:10.885316] [INFO ] [MAIN ] RYAM: Loaded 35073 primary data records. [2025-10-21T22:14:11.656160] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:11.657821] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:11.657400] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 47533 primary records. [2025-10-21T22:14:11.658835] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-10-21T22:14:11.658548] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 48484 primary records. [2025-10-21T22:14:11.659796] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-10-21T22:14:11.676022] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-10-21T22:14:11.684512] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-10-21T22:14:11.690172] [INFO ] [MAIN ] Derivative Progress: 1582/2057 symbols completed. RY took 1.1s. Estimated remaining: 2m 60s. Rate: 158.4 symbols/min [2025-10-21T22:14:11.690788] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:11.696627] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-10-21T22:14:11.697007] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-10-21T22:14:11.699942] [INFO ] [MAIN ] Derivative Progress: 1583/2057 symbols completed. RXO took 1.1s. Estimated remaining: 2m 59s. Rate: 158.5 symbols/min [2025-10-21T22:14:11.712828] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:11.713133] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:11.714216] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35073 primary records. [2025-10-21T22:14:11.714365] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-10-21T22:14:11.730205] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-10-21T22:14:11.730359] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-10-21T22:14:11.732750] [INFO ] [MAIN ] Derivative Progress: 1584/2057 symbols completed. RYAM took 1.1s. Estimated remaining: 2m 59s. Rate: 158.6 symbols/min [2025-10-21T22:14:11.733224] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:11.761787] [DEBUG] [LOCAL ] RYI: Loaded 21755 existing records from primary storage. [2025-10-21T22:14:11.774665] [INFO ] [MAIN ] RYI: Loaded 21755 primary data records. [2025-10-21T22:14:11.796458] [DEBUG] [LOCAL ] RYAN: Loaded 45079 existing records from primary storage. [2025-10-21T22:14:11.811884] [INFO ] [MAIN ] RYAN: Loaded 45079 primary data records. [2025-10-21T22:14:12.255475] [DEBUG] [LOCAL ] RYN: Loaded 45758 existing records from primary storage. [2025-10-21T22:14:12.322068] [INFO ] [MAIN ] RYN: Loaded 45758 primary data records. [2025-10-21T22:14:12.769722] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:12.783434] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:12.783070] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21755 primary records. [2025-10-21T22:14:12.783573] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-10-21T22:14:12.784262] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 45079 primary records. [2025-10-21T22:14:12.784922] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-10-21T22:14:12.813316] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-10-21T22:14:12.815068] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-10-21T22:14:12.817194] [INFO ] [MAIN ] Derivative Progress: 1585/2057 symbols completed. RYI took 1.1s. Estimated remaining: 2m 59s. Rate: 158.4 symbols/min [2025-10-21T22:14:12.817820] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:12.820861] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-10-21T22:14:12.821499] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-10-21T22:14:12.823693] [INFO ] [MAIN ] Derivative Progress: 1586/2057 symbols completed. RYAN took 1.1s. Estimated remaining: 2m 58s. Rate: 158.5 symbols/min [2025-10-21T22:14:12.824025] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:12.833338] [DEBUG] [LOCAL ] RZB: Loaded 5931 existing records from primary storage. [2025-10-21T22:14:12.833515] [INFO ] [MAIN ] RZB: Loaded 5931 primary data records. [2025-10-21T22:14:12.907609] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:12.925234] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45758 primary records. [2025-10-21T22:14:12.925319] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-10-21T22:14:12.956080] [DEBUG] [LOCAL ] RZC: Loaded 6559 existing records from primary storage. [2025-10-21T22:14:12.977318] [INFO ] [MAIN ] RZC: Loaded 6559 primary data records. [2025-10-21T22:14:13.031844] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-10-21T22:14:13.047446] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-10-21T22:14:13.075316] [INFO ] [MAIN ] Derivative Progress: 1587/2057 symbols completed. RYN took 1.3s. Estimated remaining: 2m 58s. Rate: 158.6 symbols/min [2025-10-21T22:14:13.087351] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:13.542599] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:13.543322] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 5931 primary records. [2025-10-21T22:14:13.543805] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-10-21T22:14:13.575891] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-10-21T22:14:13.576226] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-10-21T22:14:13.580601] [INFO ] [MAIN ] Derivative Progress: 1588/2057 symbols completed. RZB took 0.8s. Estimated remaining: 2m 58s. Rate: 158.5 symbols/min [2025-10-21T22:14:13.577410] [DEBUG] [LOCAL ] S: Loaded 53538 existing records from primary storage. [2025-10-21T22:14:13.582746] [INFO ] [MAIN ] S: Loaded 53538 primary data records. [2025-10-21T22:14:13.651089] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:13.685671] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6559 primary records. [2025-10-21T22:14:13.702100] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-10-21T22:14:13.758764] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-10-21T22:14:13.777233] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-10-21T22:14:13.788061] [INFO ] [MAIN ] Derivative Progress: 1589/2057 symbols completed. RZC took 1.0s. Estimated remaining: 2m 57s. Rate: 158.6 symbols/min [2025-10-21T22:14:13.977466] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:13.978155] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53538 primary records. [2025-10-21T22:14:13.978215] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-10-21T22:14:13.993291] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-10-21T22:14:13.993372] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-10-21T22:14:13.995398] [INFO ] [MAIN ] Derivative Progress: 1590/2057 symbols completed. S took 0.9s. Estimated remaining: 2m 57s. Rate: 158.6 symbols/min [2025-10-21T22:14:13.996029] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:13.996585] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:13.996463] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:14.009280] [DEBUG] [LOCAL ] SABA: Loaded 9231 existing records from primary storage. [2025-10-21T22:14:14.009472] [INFO ] [MAIN ] SABA: Loaded 9231 primary data records. [2025-10-21T22:14:14.133059] [DEBUG] [LOCAL ] SAFE: Loaded 30071 existing records from primary storage. [2025-10-21T22:14:14.149200] [INFO ] [MAIN ] SAFE: Loaded 30071 primary data records. [2025-10-21T22:14:14.306969] [DEBUG] [LOCAL ] SA: Loaded 44659 existing records from primary storage. [2025-10-21T22:14:14.331204] [INFO ] [MAIN ] SA: Loaded 44659 primary data records. [2025-10-21T22:14:14.980349] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:14.981389] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9231 primary records. [2025-10-21T22:14:14.981602] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-10-21T22:14:15.012499] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:15.013604] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:15.013360] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30071 primary records. [2025-10-21T22:14:15.020568] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-10-21T22:14:15.021197] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 44659 primary records. [2025-10-21T22:14:15.029229] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-10-21T22:14:15.029282] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-10-21T22:14:15.029384] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-10-21T22:14:15.038717] [INFO ] [MAIN ] Derivative Progress: 1591/2057 symbols completed. SABA took 1.0s. Estimated remaining: 2m 56s. Rate: 158.4 symbols/min [2025-10-21T22:14:15.047316] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-10-21T22:14:15.055896] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-10-21T22:14:15.047623] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:15.058147] [INFO ] [MAIN ] Derivative Progress: 1592/2057 symbols completed. SAFE took 1.1s. Estimated remaining: 2m 56s. Rate: 158.5 symbols/min [2025-10-21T22:14:15.064466] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:15.065745] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-10-21T22:14:15.065917] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-10-21T22:14:15.068384] [INFO ] [MAIN ] Derivative Progress: 1593/2057 symbols completed. SA took 1.1s. Estimated remaining: 2m 55s. Rate: 158.6 symbols/min [2025-10-21T22:14:15.068546] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:15.093021] [DEBUG] [LOCAL ] SAH: Loaded 20845 existing records from primary storage. [2025-10-21T22:14:15.101583] [INFO ] [MAIN ] SAH: Loaded 20845 primary data records. [2025-10-21T22:14:15.102414] [DEBUG] [LOCAL ] SAM: Loaded 21328 existing records from primary storage. [2025-10-21T22:14:15.139594] [INFO ] [MAIN ] SAM: Loaded 21328 primary data records. [2025-10-21T22:14:15.529925] [DEBUG] [LOCAL ] SAN: Loaded 52969 existing records from primary storage. [2025-10-21T22:14:15.539481] [INFO ] [MAIN ] SAN: Loaded 52969 primary data records. [2025-10-21T22:14:16.105198] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:16.106665] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 20845 primary records. [2025-10-21T22:14:16.107025] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-10-21T22:14:16.120218] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:16.120997] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21328 primary records. [2025-10-21T22:14:16.121453] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-10-21T22:14:16.136579] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-10-21T22:14:16.136698] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-10-21T22:14:16.139056] [INFO ] [MAIN ] Derivative Progress: 1594/2057 symbols completed. SAH took 1.1s. Estimated remaining: 2m 55s. Rate: 158.5 symbols/min [2025-10-21T22:14:16.139225] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:16.158095] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-10-21T22:14:16.172563] [DEBUG] [MAIN ] SAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:16.173719] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 52969 primary records. [2025-10-21T22:14:16.172781] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-10-21T22:14:16.173884] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-10-21T22:14:16.176218] [INFO ] [MAIN ] Derivative Progress: 1595/2057 symbols completed. SAM took 1.1s. Estimated remaining: 2m 55s. Rate: 158.5 symbols/min [2025-10-21T22:14:16.176610] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:16.192849] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-10-21T22:14:16.193037] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-10-21T22:14:16.195229] [INFO ] [MAIN ] Derivative Progress: 1596/2057 symbols completed. SAN took 1.1s. Estimated remaining: 2m 54s. Rate: 158.6 symbols/min [2025-10-21T22:14:16.195474] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:16.252506] [DEBUG] [LOCAL ] SAP: Loaded 49869 existing records from primary storage. [2025-10-21T22:14:16.252773] [INFO ] [MAIN ] SAP: Loaded 49869 primary data records. [2025-10-21T22:14:16.385317] [DEBUG] [LOCAL ] SB: Loaded 32516 existing records from primary storage. [2025-10-21T22:14:16.385940] [DEBUG] [LOCAL ] SARO: Loaded 48274 existing records from primary storage. [2025-10-21T22:14:16.386248] [INFO ] [MAIN ] SB: Loaded 32516 primary data records. [2025-10-21T22:14:16.386733] [INFO ] [MAIN ] SARO: Loaded 48274 primary data records. [2025-10-21T22:14:17.202460] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:17.203684] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 49869 primary records. [2025-10-21T22:14:17.216904] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:17.216974] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-10-21T22:14:17.218724] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 32516 primary records. [2025-10-21T22:14:17.227639] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-10-21T22:14:17.236955] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-10-21T22:14:17.237334] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-10-21T22:14:17.245935] [INFO ] [MAIN ] Derivative Progress: 1597/2057 symbols completed. SAP took 1.1s. Estimated remaining: 2m 54s. Rate: 158.5 symbols/min [2025-10-21T22:14:17.259894] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:17.263949] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:17.265059] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48274 primary records. [2025-10-21T22:14:17.265365] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-10-21T22:14:17.269261] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-10-21T22:14:17.277142] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-10-21T22:14:17.285160] [INFO ] [MAIN ] Derivative Progress: 1598/2057 symbols completed. SB took 1.1s. Estimated remaining: 2m 54s. Rate: 158.5 symbols/min [2025-10-21T22:14:17.286477] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:17.286390] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-10-21T22:14:17.287005] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-10-21T22:14:17.288915] [INFO ] [MAIN ] Derivative Progress: 1599/2057 symbols completed. SARO took 1.1s. Estimated remaining: 2m 53s. Rate: 158.6 symbols/min [2025-10-21T22:14:17.289121] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:17.300430] [DEBUG] [LOCAL ] SBI: Loaded 7743 existing records from primary storage. [2025-10-21T22:14:17.303837] [DEBUG] [LOCAL ] SBR: Loaded 7880 existing records from primary storage. [2025-10-21T22:14:17.304108] [INFO ] [MAIN ] SBI: Loaded 7743 primary data records. [2025-10-21T22:14:17.304050] [INFO ] [MAIN ] SBR: Loaded 7880 primary data records. [2025-10-21T22:14:17.648026] [DEBUG] [LOCAL ] SBH: Loaded 49869 existing records from primary storage. [2025-10-21T22:14:17.676825] [INFO ] [MAIN ] SBH: Loaded 49869 primary data records. [2025-10-21T22:14:18.306236] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:18.318778] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:18.319485] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7743 primary records. [2025-10-21T22:14:18.319686] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-10-21T22:14:18.320181] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7880 primary records. [2025-10-21T22:14:18.328388] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-10-21T22:14:18.337055] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-10-21T22:14:18.344545] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-10-21T22:14:18.346991] [INFO ] [MAIN ] Derivative Progress: 1600/2057 symbols completed. SBI took 1.1s. Estimated remaining: 2m 53s. Rate: 158.5 symbols/min [2025-10-21T22:14:18.366301] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:18.366206] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-10-21T22:14:18.366705] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:18.366970] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-10-21T22:14:18.367824] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49869 primary records. [2025-10-21T22:14:18.369870] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-10-21T22:14:18.369787] [INFO ] [MAIN ] Derivative Progress: 1601/2057 symbols completed. SBR took 1.1s. Estimated remaining: 2m 53s. Rate: 158.6 symbols/min [2025-10-21T22:14:18.370776] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:18.386283] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-10-21T22:14:18.386464] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-10-21T22:14:18.388699] [INFO ] [MAIN ] Derivative Progress: 1602/2057 symbols completed. SBH took 1.1s. Estimated remaining: 2m 52s. Rate: 158.7 symbols/min [2025-10-21T22:14:18.388960] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:18.401737] [DEBUG] [LOCAL ] SBSI: Loaded 14915 existing records from primary storage. [2025-10-21T22:14:18.402010] [INFO ] [MAIN ] SBSI: Loaded 14915 primary data records. [2025-10-21T22:14:18.629510] [DEBUG] [LOCAL ] SBS: Loaded 49295 existing records from primary storage. [2025-10-21T22:14:18.668812] [INFO ] [MAIN ] SBS: Loaded 49295 primary data records. [2025-10-21T22:14:18.794639] [DEBUG] [LOCAL ] SBSW: Loaded 53185 existing records from primary storage. [2025-10-21T22:14:18.802619] [INFO ] [MAIN ] SBSW: Loaded 53185 primary data records. [2025-10-21T22:14:19.366702] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:19.369678] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14915 primary records. [2025-10-21T22:14:19.370030] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-10-21T22:14:19.386873] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-10-21T22:14:19.387100] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-10-21T22:14:19.389464] [INFO ] [MAIN ] Derivative Progress: 1603/2057 symbols completed. SBSI took 1.0s. Estimated remaining: 2m 52s. Rate: 158.5 symbols/min [2025-10-21T22:14:19.406362] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:19.407785] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 53185 primary records. [2025-10-21T22:14:19.407876] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-10-21T22:14:19.430044] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:19.433753] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49295 primary records. [2025-10-21T22:14:19.436699] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-10-21T22:14:19.437089] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-10-21T22:14:19.437627] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-10-21T22:14:19.439617] [INFO ] [MAIN ] Derivative Progress: 1604/2057 symbols completed. SBSW took 1.1s. Estimated remaining: 2m 51s. Rate: 158.6 symbols/min [2025-10-21T22:14:19.454040] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-10-21T22:14:19.454098] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-10-21T22:14:19.456092] [INFO ] [MAIN ] Derivative Progress: 1605/2057 symbols completed. SBS took 1.1s. Estimated remaining: 2m 51s. Rate: 158.7 symbols/min [2025-10-21T22:14:19.456745] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:19.456693] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:19.456598] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:19.475488] [DEBUG] [LOCAL ] SCD: Loaded 13518 existing records from primary storage. [2025-10-21T22:14:19.475751] [INFO ] [MAIN ] SCD: Loaded 13518 primary data records. [2025-10-21T22:14:19.842916] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-10-21T22:14:19.843164] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-10-21T22:14:19.967420] [DEBUG] [LOCAL ] SCCO: Loaded 49596 existing records from primary storage. [2025-10-21T22:14:19.978999] [INFO ] [MAIN ] SCCO: Loaded 49596 primary data records. [2025-10-21T22:14:20.486055] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:20.486935] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 13518 primary records. [2025-10-21T22:14:20.487332] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-10-21T22:14:20.504788] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-10-21T22:14:20.504884] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-10-21T22:14:20.507129] [INFO ] [MAIN ] Derivative Progress: 1606/2057 symbols completed. SCD took 1.1s. Estimated remaining: 2m 51s. Rate: 158.5 symbols/min [2025-10-21T22:14:20.507447] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:20.525785] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:20.526555] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-10-21T22:14:20.526788] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-10-21T22:14:20.543358] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-10-21T22:14:20.543607] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-10-21T22:14:20.545724] [INFO ] [MAIN ] Derivative Progress: 1607/2057 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 50s. Rate: 158.6 symbols/min [2025-10-21T22:14:20.545980] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:20.565346] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:20.576005] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49596 primary records. [2025-10-21T22:14:20.576118] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-10-21T22:14:20.595971] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-10-21T22:14:20.601478] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-10-21T22:14:20.601927] [DEBUG] [LOCAL ] SCL: Loaded 15125 existing records from primary storage. [2025-10-21T22:14:20.604109] [INFO ] [MAIN ] Derivative Progress: 1608/2057 symbols completed. SCCO took 1.1s. Estimated remaining: 2m 50s. Rate: 158.7 symbols/min [2025-10-21T22:14:20.616478] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:20.617457] [INFO ] [MAIN ] SCL: Loaded 15125 primary data records. [2025-10-21T22:14:20.649144] [DEBUG] [LOCAL ] SCI: Loaded 46251 existing records from primary storage. [2025-10-21T22:14:20.654492] [INFO ] [MAIN ] SCI: Loaded 46251 primary data records. [2025-10-21T22:14:20.905506] [DEBUG] [LOCAL ] SCM: Loaded 20048 existing records from primary storage. [2025-10-21T22:14:20.953625] [INFO ] [MAIN ] SCM: Loaded 20048 primary data records. [2025-10-21T22:14:21.542766] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:21.555723] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46251 primary records. [2025-10-21T22:14:21.556018] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:21.556721] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 15125 primary records. [2025-10-21T22:14:21.556768] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-10-21T22:14:21.557059] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-10-21T22:14:21.585443] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-10-21T22:14:21.587789] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-10-21T22:14:21.589535] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-10-21T22:14:21.591457] [INFO ] [MAIN ] Derivative Progress: 1609/2057 symbols completed. SCL took 1.0s. Estimated remaining: 2m 50s. Rate: 158.5 symbols/min [2025-10-21T22:14:21.591767] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-10-21T22:14:21.591700] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:21.594255] [INFO ] [MAIN ] Derivative Progress: 1610/2057 symbols completed. SCI took 1.1s. Estimated remaining: 2m 49s. Rate: 158.6 symbols/min [2025-10-21T22:14:21.606849] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:21.607607] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:21.608253] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 20048 primary records. [2025-10-21T22:14:21.608424] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-10-21T22:14:21.625268] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-10-21T22:14:21.625468] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-10-21T22:14:21.627835] [INFO ] [MAIN ] Derivative Progress: 1611/2057 symbols completed. SCM took 1.0s. Estimated remaining: 2m 49s. Rate: 158.7 symbols/min [2025-10-21T22:14:21.628084] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:21.664251] [DEBUG] [LOCAL ] SDHC: Loaded 10367 existing records from primary storage. [2025-10-21T22:14:21.664699] [DEBUG] [LOCAL ] SD: Loaded 28387 existing records from primary storage. [2025-10-21T22:14:21.664843] [INFO ] [MAIN ] SD: Loaded 28387 primary data records. [2025-10-21T22:14:21.664992] [INFO ] [MAIN ] SDHC: Loaded 10367 primary data records. [2025-10-21T22:14:21.885285] [DEBUG] [LOCAL ] SCS: Loaded 43289 existing records from primary storage. [2025-10-21T22:14:21.961692] [INFO ] [MAIN ] SCS: Loaded 43289 primary data records. [2025-10-21T22:14:22.626547] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:22.627863] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 28387 primary records. [2025-10-21T22:14:22.627962] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-10-21T22:14:22.627120] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:22.629481] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10367 primary records. [2025-10-21T22:14:22.629812] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-10-21T22:14:22.652197] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-10-21T22:14:22.653241] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-10-21T22:14:22.655161] [INFO ] [MAIN ] Derivative Progress: 1612/2057 symbols completed. SD took 1.0s. Estimated remaining: 2m 48s. Rate: 158.5 symbols/min [2025-10-21T22:14:22.661877] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:22.661971] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-10-21T22:14:22.662523] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-10-21T22:14:22.665352] [INFO ] [MAIN ] Derivative Progress: 1613/2057 symbols completed. SDHC took 1.0s. Estimated remaining: 2m 48s. Rate: 158.6 symbols/min [2025-10-21T22:14:22.665572] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:22.684976] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:22.685716] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 43289 primary records. [2025-10-21T22:14:22.685878] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-10-21T22:14:22.691539] [DEBUG] [LOCAL ] SDHY: Loaded 11218 existing records from primary storage. [2025-10-21T22:14:22.692117] [INFO ] [MAIN ] SDHY: Loaded 11218 primary data records. [2025-10-21T22:14:22.730385] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-10-21T22:14:22.730685] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-10-21T22:14:22.744717] [INFO ] [MAIN ] Derivative Progress: 1614/2057 symbols completed. SCS took 1.2s. Estimated remaining: 2m 47s. Rate: 158.7 symbols/min [2025-10-21T22:14:22.758474] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:22.898628] [DEBUG] [LOCAL ] SEG: Loaded 12613 existing records from primary storage. [2025-10-21T22:14:22.929462] [INFO ] [MAIN ] SEG: Loaded 12613 primary data records. [2025-10-21T22:14:23.128584] [DEBUG] [LOCAL ] SEE: Loaded 48111 existing records from primary storage. [2025-10-21T22:14:23.153309] [INFO ] [MAIN ] SEE: Loaded 48111 primary data records. [2025-10-21T22:14:23.773260] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:23.775329] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 11218 primary records. [2025-10-21T22:14:23.775587] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-10-21T22:14:23.792529] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-10-21T22:14:23.792957] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-10-21T22:14:23.795162] [INFO ] [MAIN ] Derivative Progress: 1615/2057 symbols completed. SDHY took 1.1s. Estimated remaining: 2m 47s. Rate: 158.5 symbols/min [2025-10-21T22:14:23.795684] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:23.829210] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:23.830707] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48111 primary records. [2025-10-21T22:14:23.830578] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:23.830925] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-10-21T22:14:23.832220] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 12613 primary records. [2025-10-21T22:14:23.832747] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-10-21T22:14:23.861308] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-10-21T22:14:23.861916] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-10-21T22:14:23.864544] [INFO ] [MAIN ] Derivative Progress: 1616/2057 symbols completed. SEE took 1.2s. Estimated remaining: 2m 47s. Rate: 158.6 symbols/min [2025-10-21T22:14:23.867355] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:23.867154] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-10-21T22:14:23.867985] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-10-21T22:14:23.870236] [INFO ] [MAIN ] Derivative Progress: 1617/2057 symbols completed. SEG took 1.1s. Estimated remaining: 2m 46s. Rate: 158.7 symbols/min [2025-10-21T22:14:23.870437] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:23.904488] [DEBUG] [LOCAL ] SEI: Loaded 50023 existing records from primary storage. [2025-10-21T22:14:23.904777] [INFO ] [MAIN ] SEI: Loaded 50023 primary data records. [2025-10-21T22:14:24.141455] [DEBUG] [LOCAL ] SEMR: Loaded 42075 existing records from primary storage. [2025-10-21T22:14:24.264467] [DEBUG] [LOCAL ] SEM: Loaded 43198 existing records from primary storage. [2025-10-21T22:14:24.264728] [INFO ] [MAIN ] SEMR: Loaded 42075 primary data records. [2025-10-21T22:14:24.264633] [INFO ] [MAIN ] SEM: Loaded 43198 primary data records. [2025-10-21T22:14:24.906913] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:24.908021] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 50023 primary records. [2025-10-21T22:14:24.908508] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-10-21T22:14:24.926739] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-10-21T22:14:24.926890] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-10-21T22:14:24.929083] [INFO ] [MAIN ] Derivative Progress: 1618/2057 symbols completed. SEI took 1.1s. Estimated remaining: 2m 46s. Rate: 158.5 symbols/min [2025-10-21T22:14:24.963856] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:24.964184] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:24.965087] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 43198 primary records. [2025-10-21T22:14:24.966080] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 42075 primary records. [2025-10-21T22:14:24.966178] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-10-21T22:14:24.966706] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-10-21T22:14:24.995862] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-10-21T22:14:24.996206] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-10-21T22:14:24.999022] [INFO ] [MAIN ] Derivative Progress: 1619/2057 symbols completed. SEM took 1.1s. Estimated remaining: 2m 46s. Rate: 158.6 symbols/min [2025-10-21T22:14:25.001188] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-10-21T22:14:25.001279] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-10-21T22:14:25.004011] [INFO ] [MAIN ] Derivative Progress: 1620/2057 symbols completed. SEMR took 1.1s. Estimated remaining: 2m 45s. Rate: 158.7 symbols/min [2025-10-21T22:14:25.004490] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:25.004625] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:25.005474] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:25.012112] [DEBUG] [LOCAL ] SFB: Loaded 3739 existing records from primary storage. [2025-10-21T22:14:25.012294] [INFO ] [MAIN ] SFB: Loaded 3739 primary data records. [2025-10-21T22:14:25.348614] [DEBUG] [LOCAL ] SF: Loaded 41371 existing records from primary storage. [2025-10-21T22:14:25.365314] [INFO ] [MAIN ] SF: Loaded 41371 primary data records. [2025-10-21T22:14:25.397639] [DEBUG] [LOCAL ] SES: Loaded 51604 existing records from primary storage. [2025-10-21T22:14:25.437262] [INFO ] [MAIN ] SES: Loaded 51604 primary data records. [2025-10-21T22:14:26.024563] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:26.025387] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 3739 primary records. [2025-10-21T22:14:26.025563] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-10-21T22:14:26.043875] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-10-21T22:14:26.044306] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-10-21T22:14:26.047170] [INFO ] [MAIN ] Derivative Progress: 1621/2057 symbols completed. SFB took 1.0s. Estimated remaining: 2m 45s. Rate: 158.5 symbols/min [2025-10-21T22:14:26.047450] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:26.067793] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:26.073440] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41371 primary records. [2025-10-21T22:14:26.073761] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-10-21T22:14:26.099469] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-10-21T22:14:26.099588] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-10-21T22:14:26.101583] [INFO ] [MAIN ] Derivative Progress: 1622/2057 symbols completed. SF took 1.1s. Estimated remaining: 2m 45s. Rate: 158.6 symbols/min [2025-10-21T22:14:26.101823] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:26.098357] [DEBUG] [LOCAL ] SFBS: Loaded 21362 existing records from primary storage. [2025-10-21T22:14:26.102026] [INFO ] [MAIN ] SFBS: Loaded 21362 primary data records. [2025-10-21T22:14:26.158837] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:26.192403] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51604 primary records. [2025-10-21T22:14:26.219468] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-10-21T22:14:26.427635] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-10-21T22:14:26.436839] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-10-21T22:14:26.451989] [INFO ] [MAIN ] Derivative Progress: 1623/2057 symbols completed. SES took 1.4s. Estimated remaining: 2m 44s. Rate: 158.6 symbols/min [2025-10-21T22:14:26.452251] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:26.453581] [DEBUG] [LOCAL ] SFL: Loaded 45311 existing records from primary storage. [2025-10-21T22:14:26.453781] [INFO ] [MAIN ] SFL: Loaded 45311 primary data records. [2025-10-21T22:14:26.828355] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:14:26.829936] [INFO ] [MAIN ] SFBS: Generated 1793 derivative records from 21362 primary records. [2025-10-21T22:14:26.830143] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-10-21T22:14:26.831075] [DEBUG] [LOCAL ] SG: Loaded 53504 existing records from primary storage. [2025-10-21T22:14:26.840554] [INFO ] [MAIN ] SG: Loaded 53504 primary data records. [2025-10-21T22:14:26.860147] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1793 records). [2025-10-21T22:14:26.870768] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-10-21T22:14:26.895563] [INFO ] [MAIN ] Derivative Progress: 1624/2057 symbols completed. SFBS took 0.8s. Estimated remaining: 2m 44s. Rate: 158.6 symbols/min [2025-10-21T22:14:26.908958] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:27.184738] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:27.185829] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45311 primary records. [2025-10-21T22:14:27.186487] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-10-21T22:14:27.204765] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-10-21T22:14:27.204943] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-10-21T22:14:27.207169] [INFO ] [MAIN ] Derivative Progress: 1625/2057 symbols completed. SFL took 1.1s. Estimated remaining: 2m 43s. Rate: 158.6 symbols/min [2025-10-21T22:14:27.207352] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:27.222340] [DEBUG] [LOCAL ] SGHC: Loaded 47267 existing records from primary storage. [2025-10-21T22:14:27.223909] [INFO ] [MAIN ] SGHC: Loaded 47267 primary data records. [2025-10-21T22:14:27.333054] [DEBUG] [LOCAL ] SGU: Loaded 6532 existing records from primary storage. [2025-10-21T22:14:27.333583] [INFO ] [MAIN ] SGU: Loaded 6532 primary data records. [2025-10-21T22:14:27.628327] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:14:27.662316] [INFO ] [MAIN ] SG: Generated 1793 derivative records from 53504 primary records. [2025-10-21T22:14:27.662492] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-10-21T22:14:27.801015] [DEBUG] [LOCAL ] SG: Derivative data saved (1793 records). [2025-10-21T22:14:27.905293] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-10-21T22:14:27.917408] [INFO ] [MAIN ] Derivative Progress: 1626/2057 symbols completed. SG took 1.5s. Estimated remaining: 2m 43s. Rate: 158.5 symbols/min [2025-10-21T22:14:27.917832] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:27.943764] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:27.944567] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 47267 primary records. [2025-10-21T22:14:27.944841] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-10-21T22:14:27.964816] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-10-21T22:14:27.976023] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-10-21T22:14:27.978259] [INFO ] [MAIN ] Derivative Progress: 1627/2057 symbols completed. SGHC took 1.1s. Estimated remaining: 2m 43s. Rate: 158.6 symbols/min [2025-10-21T22:14:27.978400] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:27.992964] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:27.993704] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6532 primary records. [2025-10-21T22:14:27.993828] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-10-21T22:14:28.011592] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-10-21T22:14:28.025757] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-10-21T22:14:28.028462] [INFO ] [MAIN ] Derivative Progress: 1628/2057 symbols completed. SGU took 0.8s. Estimated remaining: 2m 42s. Rate: 158.7 symbols/min [2025-10-21T22:14:28.028756] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:28.036079] [DEBUG] [LOCAL ] SHAK: Loaded 48675 existing records from primary storage. [2025-10-21T22:14:28.036396] [INFO ] [MAIN ] SHAK: Loaded 48675 primary data records. [2025-10-21T22:14:28.118280] [DEBUG] [LOCAL ] SHCO: Loaded 25262 existing records from primary storage. [2025-10-21T22:14:28.130512] [INFO ] [MAIN ] SHCO: Loaded 25262 primary data records. [2025-10-21T22:14:28.695242] [DEBUG] [LOCAL ] SHEL: Loaded 53675 existing records from primary storage. [2025-10-21T22:14:28.695949] [INFO ] [MAIN ] SHEL: Loaded 53675 primary data records. [2025-10-21T22:14:29.016629] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:14:29.018001] [INFO ] [MAIN ] SHAK: Generated 1793 derivative records from 48675 primary records. [2025-10-21T22:14:29.018164] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-10-21T22:14:29.039303] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1793 records). [2025-10-21T22:14:29.039514] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-10-21T22:14:29.041841] [INFO ] [MAIN ] Derivative Progress: 1629/2057 symbols completed. SHAK took 1.1s. Estimated remaining: 2m 42s. Rate: 158.5 symbols/min [2025-10-21T22:14:29.042163] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:29.058374] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:29.059289] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 25262 primary records. [2025-10-21T22:14:29.059471] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-10-21T22:14:29.086073] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-10-21T22:14:29.088337] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-10-21T22:14:29.090825] [INFO ] [MAIN ] Derivative Progress: 1630/2057 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 42s. Rate: 158.6 symbols/min [2025-10-21T22:14:29.091299] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:29.105535] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:29.114537] [DEBUG] [LOCAL ] SHG: Loaded 26685 existing records from primary storage. [2025-10-21T22:14:29.115567] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53675 primary records. [2025-10-21T22:14:29.115770] [INFO ] [MAIN ] SHG: Loaded 26685 primary data records. [2025-10-21T22:14:29.115867] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-10-21T22:14:29.239429] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-10-21T22:14:29.239991] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-10-21T22:14:29.257806] [INFO ] [MAIN ] Derivative Progress: 1631/2057 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 41s. Rate: 158.7 symbols/min [2025-10-21T22:14:29.283023] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:29.472678] [DEBUG] [LOCAL ] SHO: Loaded 49179 existing records from primary storage. [2025-10-21T22:14:29.473072] [INFO ] [MAIN ] SHO: Loaded 49179 primary data records. [2025-10-21T22:14:29.476482] [DEBUG] [LOCAL ] SHOC: Loaded 3084 existing records from primary storage. [2025-10-21T22:14:29.489952] [INFO ] [MAIN ] SHOC: Loaded 3084 primary data records. [2025-10-21T22:14:30.310897] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:30.312455] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 26685 primary records. [2025-10-21T22:14:30.312805] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-10-21T22:14:30.341369] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-10-21T22:14:30.341586] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-10-21T22:14:30.343948] [INFO ] [MAIN ] Derivative Progress: 1632/2057 symbols completed. SHG took 1.3s. Estimated remaining: 2m 41s. Rate: 158.5 symbols/min [2025-10-21T22:14:30.345011] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:30.369416] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:14:30.370468] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 3084 primary records. [2025-10-21T22:14:30.371450] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-10-21T22:14:30.393901] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:30.401632] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49179 primary records. [2025-10-21T22:14:30.405385] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-10-21T22:14:30.406897] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-10-21T22:14:30.407158] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-10-21T22:14:30.424094] [INFO ] [MAIN ] Derivative Progress: 1633/2057 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 40s. Rate: 158.6 symbols/min [2025-10-21T22:14:30.425604] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-10-21T22:14:30.437179] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-10-21T22:14:30.440978] [INFO ] [MAIN ] Derivative Progress: 1634/2057 symbols completed. SHO took 1.3s. Estimated remaining: 2m 40s. Rate: 158.7 symbols/min [2025-10-21T22:14:30.463712] [DEBUG] [LOCAL ] SHW: Loaded 50402 existing records from primary storage. [2025-10-21T22:14:30.463862] [INFO ] [MAIN ] SHW: Loaded 50402 primary data records. [2025-10-21T22:14:30.793226] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:30.793861] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50402 primary records. [2025-10-21T22:14:30.793924] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-10-21T22:14:30.808974] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-10-21T22:14:30.809030] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-10-21T22:14:30.811104] [INFO ] [MAIN ] Derivative Progress: 1635/2057 symbols completed. SHW took 0.5s. Estimated remaining: 2m 40s. Rate: 158.7 symbols/min [2025-10-21T22:14:30.811451] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:30.811579] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:30.811727] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:30.837111] [DEBUG] [LOCAL ] SII: Loaded 24218 existing records from primary storage. [2025-10-21T22:14:30.837241] [INFO ] [MAIN ] SII: Loaded 24218 primary data records. [2025-10-21T22:14:31.068062] [DEBUG] [LOCAL ] SID: Loaded 42896 existing records from primary storage. [2025-10-21T22:14:31.067298] [DEBUG] [LOCAL ] SIG: Loaded 45374 existing records from primary storage. [2025-10-21T22:14:31.182770] [INFO ] [MAIN ] SIG: Loaded 45374 primary data records. [2025-10-21T22:14:31.183345] [INFO ] [MAIN ] SID: Loaded 42896 primary data records. [2025-10-21T22:14:31.869452] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:31.870260] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 24218 primary records. [2025-10-21T22:14:31.870344] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-10-21T22:14:31.889751] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-10-21T22:14:31.889957] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-10-21T22:14:31.892256] [INFO ] [MAIN ] Derivative Progress: 1636/2057 symbols completed. SII took 1.1s. Estimated remaining: 2m 39s. Rate: 158.5 symbols/min [2025-10-21T22:14:31.892586] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:31.911563] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:31.912564] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42896 primary records. [2025-10-21T22:14:31.912700] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-10-21T22:14:31.940998] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:31.942080] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-10-21T22:14:31.942276] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-10-21T22:14:31.943032] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 45374 primary records. [2025-10-21T22:14:31.946324] [INFO ] [MAIN ] Derivative Progress: 1637/2057 symbols completed. SID took 1.1s. Estimated remaining: 2m 39s. Rate: 158.6 symbols/min [2025-10-21T22:14:31.946719] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:31.946620] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-10-21T22:14:31.971902] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-10-21T22:14:31.972128] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-10-21T22:14:31.974610] [INFO ] [MAIN ] Derivative Progress: 1638/2057 symbols completed. SIG took 1.2s. Estimated remaining: 2m 38s. Rate: 158.7 symbols/min [2025-10-21T22:14:31.974946] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:31.986677] [DEBUG] [LOCAL ] SILA: Loaded 30099 existing records from primary storage. [2025-10-21T22:14:31.986855] [INFO ] [MAIN ] SILA: Loaded 30099 primary data records. [2025-10-21T22:14:32.180061] [DEBUG] [LOCAL ] SITC: Loaded 41712 existing records from primary storage. [2025-10-21T22:14:32.182616] [INFO ] [MAIN ] SITC: Loaded 41712 primary data records. [2025-10-21T22:14:32.416308] [DEBUG] [LOCAL ] SITE: Loaded 35562 existing records from primary storage. [2025-10-21T22:14:32.442022] [INFO ] [MAIN ] SITE: Loaded 35562 primary data records. [2025-10-21T22:14:32.970022] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:32.971258] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 30099 primary records. [2025-10-21T22:14:32.971598] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-10-21T22:14:32.989910] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-10-21T22:14:32.990899] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-10-21T22:14:32.993934] [INFO ] [MAIN ] Derivative Progress: 1639/2057 symbols completed. SILA took 1.1s. Estimated remaining: 2m 38s. Rate: 158.5 symbols/min [2025-10-21T22:14:32.994183] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:33.009008] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:33.010035] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41712 primary records. [2025-10-21T22:14:33.010209] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-10-21T22:14:33.029630] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-10-21T22:14:33.030594] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-10-21T22:14:33.032843] [INFO ] [MAIN ] Derivative Progress: 1640/2057 symbols completed. SITC took 1.1s. Estimated remaining: 2m 38s. Rate: 158.6 symbols/min [2025-10-21T22:14:33.046026] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:33.046694] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:33.047501] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35562 primary records. [2025-10-21T22:14:33.047630] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-10-21T22:14:33.064521] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-10-21T22:14:33.064753] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-10-21T22:14:33.067108] [INFO ] [MAIN ] Derivative Progress: 1641/2057 symbols completed. SITE took 1.1s. Estimated remaining: 2m 37s. Rate: 158.7 symbols/min [2025-10-21T22:14:33.067324] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:33.107844] [DEBUG] [LOCAL ] SJT: Loaded 22756 existing records from primary storage. [2025-10-21T22:14:33.108617] [INFO ] [MAIN ] SJT: Loaded 22756 primary data records. [2025-10-21T22:14:33.197436] [DEBUG] [LOCAL ] SJM: Loaded 50110 existing records from primary storage. [2025-10-21T22:14:33.207817] [INFO ] [MAIN ] SJM: Loaded 50110 primary data records. [2025-10-21T22:14:33.275056] [DEBUG] [LOCAL ] SKE: Loaded 37343 existing records from primary storage. [2025-10-21T22:14:33.301820] [INFO ] [MAIN ] SKE: Loaded 37343 primary data records. [2025-10-21T22:14:34.150519] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:34.165847] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:34.167423] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50110 primary records. [2025-10-21T22:14:34.168439] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22756 primary records. [2025-10-21T22:14:34.168667] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-10-21T22:14:34.168793] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-10-21T22:14:34.183882] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:34.199126] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 37343 primary records. [2025-10-21T22:14:34.203257] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-10-21T22:14:34.210075] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-10-21T22:14:34.218212] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-10-21T22:14:34.226438] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-10-21T22:14:34.231853] [INFO ] [MAIN ] Derivative Progress: 1642/2057 symbols completed. SJM took 1.2s. Estimated remaining: 2m 37s. Rate: 158.5 symbols/min [2025-10-21T22:14:34.232762] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:34.232059] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-10-21T22:14:34.238086] [INFO ] [MAIN ] Derivative Progress: 1643/2057 symbols completed. SJT took 1.2s. Estimated remaining: 2m 37s. Rate: 158.6 symbols/min [2025-10-21T22:14:34.238562] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:34.241113] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-10-21T22:14:34.241306] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-10-21T22:14:34.243845] [INFO ] [MAIN ] Derivative Progress: 1644/2057 symbols completed. SKE took 1.2s. Estimated remaining: 2m 36s. Rate: 158.7 symbols/min [2025-10-21T22:14:34.244050] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:34.259266] [DEBUG] [LOCAL ] SKIL: Loaded 6877 existing records from primary storage. [2025-10-21T22:14:34.259674] [DEBUG] [LOCAL ] SKLZ: Loaded 11495 existing records from primary storage. [2025-10-21T22:14:34.260147] [INFO ] [MAIN ] SKIL: Loaded 6877 primary data records. [2025-10-21T22:14:34.260256] [INFO ] [MAIN ] SKLZ: Loaded 11495 primary data records. [2025-10-21T22:14:34.883976] [DEBUG] [LOCAL ] SKM: Loaded 35237 existing records from primary storage. [2025-10-21T22:14:34.884771] [INFO ] [MAIN ] SKM: Loaded 35237 primary data records. [2025-10-21T22:14:35.224498] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:35.225991] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 11495 primary records. [2025-10-21T22:14:35.237716] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-10-21T22:14:35.247395] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:35.251844] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6877 primary records. [2025-10-21T22:14:35.254955] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-10-21T22:14:35.256048] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-10-21T22:14:35.256892] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-10-21T22:14:35.259200] [INFO ] [MAIN ] Derivative Progress: 1645/2057 symbols completed. SKLZ took 1.0s. Estimated remaining: 2m 36s. Rate: 158.5 symbols/min [2025-10-21T22:14:35.273243] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-10-21T22:14:35.266080] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:35.273392] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-10-21T22:14:35.275725] [INFO ] [MAIN ] Derivative Progress: 1646/2057 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 35s. Rate: 158.6 symbols/min [2025-10-21T22:14:35.276301] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:35.295307] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:35.296056] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35237 primary records. [2025-10-21T22:14:35.297003] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-10-21T22:14:35.313037] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-10-21T22:14:35.313172] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-10-21T22:14:35.315570] [INFO ] [MAIN ] Derivative Progress: 1647/2057 symbols completed. SKM took 1.1s. Estimated remaining: 2m 35s. Rate: 158.7 symbols/min [2025-10-21T22:14:35.333212] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:35.356833] [DEBUG] [LOCAL ] SKY: Loaded 38650 existing records from primary storage. [2025-10-21T22:14:35.369499] [DEBUG] [LOCAL ] SKT: Loaded 42370 existing records from primary storage. [2025-10-21T22:14:35.369692] [INFO ] [MAIN ] SKY: Loaded 38650 primary data records. [2025-10-21T22:14:35.369773] [INFO ] [MAIN ] SKT: Loaded 42370 primary data records. [2025-10-21T22:14:35.452459] [DEBUG] [LOCAL ] SKYH: Loaded 15910 existing records from primary storage. [2025-10-21T22:14:35.507466] [INFO ] [MAIN ] SKYH: Loaded 15910 primary data records. [2025-10-21T22:14:36.335360] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:36.338234] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42370 primary records. [2025-10-21T22:14:36.339196] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-10-21T22:14:36.356804] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:36.366275] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 38650 primary records. [2025-10-21T22:14:36.372314] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-10-21T22:14:36.390160] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-10-21T22:14:36.390689] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-10-21T22:14:36.404196] [INFO ] [MAIN ] Derivative Progress: 1648/2057 symbols completed. SKT took 1.1s. Estimated remaining: 2m 35s. Rate: 158.5 symbols/min [2025-10-21T22:14:36.408347] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-10-21T22:14:36.402109] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:36.409526] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 15910 primary records. [2025-10-21T22:14:36.408635] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-10-21T22:14:36.409674] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-10-21T22:14:36.412165] [INFO ] [MAIN ] Derivative Progress: 1649/2057 symbols completed. SKY took 1.1s. Estimated remaining: 2m 34s. Rate: 158.6 symbols/min [2025-10-21T22:14:36.428210] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-10-21T22:14:36.428279] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-10-21T22:14:36.430677] [INFO ] [MAIN ] Derivative Progress: 1650/2057 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 34s. Rate: 158.7 symbols/min [2025-10-21T22:14:36.431054] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:36.431150] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:36.431579] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:36.499169] [DEBUG] [LOCAL ] SLF: Loaded 38518 existing records from primary storage. [2025-10-21T22:14:36.499335] [INFO ] [MAIN ] SLF: Loaded 38518 primary data records. [2025-10-21T22:14:36.499855] [DEBUG] [LOCAL ] SLGN: Loaded 41036 existing records from primary storage. [2025-10-21T22:14:36.524717] [INFO ] [MAIN ] SLGN: Loaded 41036 primary data records. [2025-10-21T22:14:36.568328] [DEBUG] [LOCAL ] SLG: Loaded 45820 existing records from primary storage. [2025-10-21T22:14:36.635111] [INFO ] [MAIN ] SLG: Loaded 45820 primary data records. [2025-10-21T22:14:37.442377] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:37.445263] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 38518 primary records. [2025-10-21T22:14:37.445544] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-10-21T22:14:37.459762] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:37.468746] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45820 primary records. [2025-10-21T22:14:37.469459] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-10-21T22:14:37.490443] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-10-21T22:14:37.497720] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:37.497406] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-10-21T22:14:37.503488] [INFO ] [MAIN ] Derivative Progress: 1651/2057 symbols completed. SLF took 1.1s. Estimated remaining: 2m 34s. Rate: 158.5 symbols/min [2025-10-21T22:14:37.501718] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 41036 primary records. [2025-10-21T22:14:37.503689] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:37.504018] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-10-21T22:14:37.510151] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-10-21T22:14:37.521255] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-10-21T22:14:37.525256] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-10-21T22:14:37.528036] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-10-21T22:14:37.527942] [INFO ] [MAIN ] Derivative Progress: 1652/2057 symbols completed. SLG took 1.1s. Estimated remaining: 2m 33s. Rate: 158.6 symbols/min [2025-10-21T22:14:37.530790] [INFO ] [MAIN ] Derivative Progress: 1653/2057 symbols completed. SLGN took 1.1s. Estimated remaining: 2m 33s. Rate: 158.7 symbols/min [2025-10-21T22:14:37.530703] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:37.531098] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:37.570597] [DEBUG] [LOCAL ] SLVM: Loaded 27696 existing records from primary storage. [2025-10-21T22:14:37.570990] [INFO ] [MAIN ] SLVM: Loaded 27696 primary data records. [2025-10-21T22:14:37.649427] [DEBUG] [LOCAL ] SLQT: Loaded 43445 existing records from primary storage. [2025-10-21T22:14:37.701036] [INFO ] [MAIN ] SLQT: Loaded 43445 primary data records. [2025-10-21T22:14:37.891177] [DEBUG] [LOCAL ] SM: Loaded 52354 existing records from primary storage. [2025-10-21T22:14:38.040991] [INFO ] [MAIN ] SM: Loaded 52354 primary data records. [2025-10-21T22:14:38.583806] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:38.584860] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 27696 primary records. [2025-10-21T22:14:38.585877] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-10-21T22:14:38.604301] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-10-21T22:14:38.605271] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-10-21T22:14:38.607321] [INFO ] [MAIN ] Derivative Progress: 1654/2057 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 33s. Rate: 158.5 symbols/min [2025-10-21T22:14:38.607485] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:38.624572] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:38.625524] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 43445 primary records. [2025-10-21T22:14:38.625778] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-10-21T22:14:38.645592] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-10-21T22:14:38.652234] [DEBUG] [LOCAL ] SMBK: Loaded 8280 existing records from primary storage. [2025-10-21T22:14:38.652338] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-10-21T22:14:38.653281] [INFO ] [MAIN ] SMBK: Loaded 8280 primary data records. [2025-10-21T22:14:38.656756] [INFO ] [MAIN ] Derivative Progress: 1655/2057 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 32s. Rate: 158.6 symbols/min [2025-10-21T22:14:38.693357] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:38.735522] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:38.783925] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52354 primary records. [2025-10-21T22:14:38.810595] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-10-21T22:14:38.893281] [DEBUG] [LOCAL ] SMC: Loaded 11048 existing records from primary storage. [2025-10-21T22:14:39.030924] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-10-21T22:14:39.031025] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-10-21T22:14:39.029622] [INFO ] [MAIN ] SMC: Loaded 11048 primary data records. [2025-10-21T22:14:39.034042] [INFO ] [MAIN ] Derivative Progress: 1656/2057 symbols completed. SM took 1.5s. Estimated remaining: 2m 32s. Rate: 158.6 symbols/min [2025-10-21T22:14:39.034861] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:39.381558] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:39.383919] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8280 primary records. [2025-10-21T22:14:39.384585] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-10-21T22:14:39.409377] [DEBUG] [LOCAL ] SMFG: Loaded 48330 existing records from primary storage. [2025-10-21T22:14:39.414331] [INFO ] [MAIN ] SMFG: Loaded 48330 primary data records. [2025-10-21T22:14:39.416422] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-10-21T22:14:39.427900] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-10-21T22:14:39.449351] [INFO ] [MAIN ] Derivative Progress: 1657/2057 symbols completed. SMBK took 0.8s. Estimated remaining: 2m 31s. Rate: 158.6 symbols/min [2025-10-21T22:14:39.500485] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:39.565917] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:39.618140] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11048 primary records. [2025-10-21T22:14:39.622819] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-10-21T22:14:39.798907] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-10-21T22:14:39.799369] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-10-21T22:14:39.802956] [INFO ] [MAIN ] Derivative Progress: 1658/2057 symbols completed. SMC took 1.1s. Estimated remaining: 2m 31s. Rate: 158.6 symbols/min [2025-10-21T22:14:39.803201] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:39.841080] [DEBUG] [LOCAL ] SMG: Loaded 42875 existing records from primary storage. [2025-10-21T22:14:39.858158] [INFO ] [MAIN ] SMG: Loaded 42875 primary data records. [2025-10-21T22:14:39.858767] [DEBUG] [LOCAL ] SMHI: Loaded 12854 existing records from primary storage. [2025-10-21T22:14:39.864156] [INFO ] [MAIN ] SMHI: Loaded 12854 primary data records. [2025-10-21T22:14:39.864354] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:39.881304] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48330 primary records. [2025-10-21T22:14:39.934791] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-10-21T22:14:40.102627] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-10-21T22:14:40.107994] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-10-21T22:14:40.136993] [INFO ] [MAIN ] Derivative Progress: 1659/2057 symbols completed. SMFG took 1.1s. Estimated remaining: 2m 31s. Rate: 158.6 symbols/min [2025-10-21T22:14:40.151735] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:40.486011] [DEBUG] [LOCAL ] SMP: Loaded 18732 existing records from primary storage. [2025-10-21T22:14:40.486719] [INFO ] [MAIN ] SMP: Loaded 18732 primary data records. [2025-10-21T22:14:40.780907] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:40.796317] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 42875 primary records. [2025-10-21T22:14:40.796575] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-10-21T22:14:40.824831] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-10-21T22:14:40.832358] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-10-21T22:14:40.834507] [INFO ] [MAIN ] Derivative Progress: 1660/2057 symbols completed. SMG took 1.3s. Estimated remaining: 2m 30s. Rate: 158.5 symbols/min [2025-10-21T22:14:40.834933] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:40.835428] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:40.836528] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 12854 primary records. [2025-10-21T22:14:40.836636] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-10-21T22:14:40.857119] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-10-21T22:14:40.857233] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-10-21T22:14:40.859458] [INFO ] [MAIN ] Derivative Progress: 1661/2057 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 30s. Rate: 158.6 symbols/min [2025-10-21T22:14:40.859767] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:40.878636] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:40.879373] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 18732 primary records. [2025-10-21T22:14:40.879592] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-10-21T22:14:40.911726] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-10-21T22:14:40.911857] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-10-21T22:14:40.914261] [INFO ] [MAIN ] Derivative Progress: 1662/2057 symbols completed. SMP took 0.8s. Estimated remaining: 2m 29s. Rate: 158.7 symbols/min [2025-10-21T22:14:40.914593] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:40.939525] [DEBUG] [LOCAL ] SMWB: Loaded 31817 existing records from primary storage. [2025-10-21T22:14:40.940509] [DEBUG] [LOCAL ] SMRT: Loaded 43792 existing records from primary storage. [2025-10-21T22:14:40.940672] [INFO ] [MAIN ] SMWB: Loaded 31817 primary data records. [2025-10-21T22:14:40.940833] [INFO ] [MAIN ] SMRT: Loaded 43792 primary data records. [2025-10-21T22:14:41.563017] [DEBUG] [LOCAL ] SN: Loaded 49991 existing records from primary storage. [2025-10-21T22:14:41.564295] [INFO ] [MAIN ] SN: Loaded 49991 primary data records. [2025-10-21T22:14:41.942565] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:41.942141] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:41.943432] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 31817 primary records. [2025-10-21T22:14:41.943577] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-10-21T22:14:41.944250] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 43792 primary records. [2025-10-21T22:14:41.944355] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-10-21T22:14:41.976392] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-10-21T22:14:41.977508] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-10-21T22:14:41.977847] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-10-21T22:14:41.980089] [INFO ] [MAIN ] Derivative Progress: 1663/2057 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 29s. Rate: 158.5 symbols/min [2025-10-21T22:14:41.977926] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-10-21T22:14:41.982482] [INFO ] [MAIN ] Derivative Progress: 1664/2057 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 29s. Rate: 158.6 symbols/min [2025-10-21T22:14:42.000191] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:42.000829] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49991 primary records. [2025-10-21T22:14:42.000891] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-10-21T22:14:42.016186] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-10-21T22:14:42.016241] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-10-21T22:14:42.018690] [INFO ] [MAIN ] Derivative Progress: 1665/2057 symbols completed. SN took 1.1s. Estimated remaining: 2m 28s. Rate: 158.7 symbols/min [2025-10-21T22:14:42.019218] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:42.019161] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:42.019099] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:42.026868] [DEBUG] [LOCAL ] SNDA: Loaded 4499 existing records from primary storage. [2025-10-21T22:14:42.027085] [INFO ] [MAIN ] SNDA: Loaded 4499 primary data records. [2025-10-21T22:14:42.342827] [DEBUG] [LOCAL ] SNA: Loaded 25833 existing records from primary storage. [2025-10-21T22:14:42.356634] [INFO ] [MAIN ] SNA: Loaded 25833 primary data records. [2025-10-21T22:14:42.482701] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-10-21T22:14:42.482926] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-10-21T22:14:43.011556] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:43.012603] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4499 primary records. [2025-10-21T22:14:43.012917] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-10-21T22:14:43.031733] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-10-21T22:14:43.032085] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-10-21T22:14:43.035173] [INFO ] [MAIN ] Derivative Progress: 1666/2057 symbols completed. SNDA took 1.0s. Estimated remaining: 2m 28s. Rate: 158.5 symbols/min [2025-10-21T22:14:43.036843] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:43.053277] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:43.054009] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 25833 primary records. [2025-10-21T22:14:43.054317] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-10-21T22:14:43.071965] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-10-21T22:14:43.072161] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-10-21T22:14:43.074664] [INFO ] [MAIN ] Derivative Progress: 1667/2057 symbols completed. SNA took 1.1s. Estimated remaining: 2m 28s. Rate: 158.6 symbols/min [2025-10-21T22:14:43.074950] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:43.102538] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:43.103201] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-10-21T22:14:43.103262] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-10-21T22:14:43.119840] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-10-21T22:14:43.121251] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-10-21T22:14:43.123535] [INFO ] [MAIN ] Derivative Progress: 1668/2057 symbols completed. SNAP took 1.1s. Estimated remaining: 2m 27s. Rate: 158.7 symbols/min [2025-10-21T22:14:43.123803] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:43.138192] [DEBUG] [LOCAL ] SNDR: Loaded 41593 existing records from primary storage. [2025-10-21T22:14:43.138488] [INFO ] [MAIN ] SNDR: Loaded 41593 primary data records. [2025-10-21T22:14:43.356209] [DEBUG] [LOCAL ] SNN: Loaded 44384 existing records from primary storage. [2025-10-21T22:14:43.356512] [INFO ] [MAIN ] SNN: Loaded 44384 primary data records. [2025-10-21T22:14:43.624204] [DEBUG] [LOCAL ] SNV: Loaded 49068 existing records from primary storage. [2025-10-21T22:14:43.634783] [INFO ] [MAIN ] SNV: Loaded 49068 primary data records. [2025-10-21T22:14:44.166283] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:44.168725] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 41593 primary records. [2025-10-21T22:14:44.168915] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-10-21T22:14:44.186820] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-10-21T22:14:44.187211] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-10-21T22:14:44.189667] [INFO ] [MAIN ] Derivative Progress: 1669/2057 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 27s. Rate: 158.5 symbols/min [2025-10-21T22:14:44.190203] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:44.210467] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:44.211263] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44384 primary records. [2025-10-21T22:14:44.211484] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-10-21T22:14:44.230972] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-10-21T22:14:44.231339] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-10-21T22:14:44.233738] [INFO ] [MAIN ] Derivative Progress: 1670/2057 symbols completed. SNN took 1.2s. Estimated remaining: 2m 26s. Rate: 158.6 symbols/min [2025-10-21T22:14:44.234094] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:44.256222] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:44.256966] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 49068 primary records. [2025-10-21T22:14:44.257100] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-10-21T22:14:44.274366] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-10-21T22:14:44.274519] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-10-21T22:14:44.277558] [INFO ] [MAIN ] Derivative Progress: 1671/2057 symbols completed. SNV took 1.2s. Estimated remaining: 2m 26s. Rate: 158.7 symbols/min [2025-10-21T22:14:44.289186] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:44.290349] [DEBUG] [LOCAL ] SNX: Loaded 38922 existing records from primary storage. [2025-10-21T22:14:44.290485] [INFO ] [MAIN ] SNX: Loaded 38922 primary data records. [2025-10-21T22:14:44.652087] [DEBUG] [LOCAL ] SO: Loaded 53615 existing records from primary storage. [2025-10-21T22:14:44.652338] [INFO ] [MAIN ] SO: Loaded 53615 primary data records. [2025-10-21T22:14:44.776042] [DEBUG] [LOCAL ] SOBO: Loaded 39418 existing records from primary storage. [2025-10-21T22:14:44.797503] [INFO ] [MAIN ] SOBO: Loaded 39418 primary data records. [2025-10-21T22:14:45.307205] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:14:45.308953] [INFO ] [MAIN ] SNX: Generated 1793 derivative records from 38922 primary records. [2025-10-21T22:14:45.309212] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-10-21T22:14:45.330530] [DEBUG] [LOCAL ] SNX: Derivative data saved (1793 records). [2025-10-21T22:14:45.330792] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-10-21T22:14:45.333270] [INFO ] [MAIN ] Derivative Progress: 1672/2057 symbols completed. SNX took 1.1s. Estimated remaining: 2m 26s. Rate: 158.5 symbols/min [2025-10-21T22:14:45.333561] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:45.353020] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:45.353803] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53615 primary records. [2025-10-21T22:14:45.354220] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-10-21T22:14:45.371259] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-10-21T22:14:45.371688] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-10-21T22:14:45.373678] [INFO ] [MAIN ] Derivative Progress: 1673/2057 symbols completed. SO took 1.1s. Estimated remaining: 2m 25s. Rate: 158.6 symbols/min [2025-10-21T22:14:45.373956] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:45.409606] [DEBUG] [LOCAL ] SOJC: Loaded 4657 existing records from primary storage. [2025-10-21T22:14:45.410285] [INFO ] [MAIN ] SOJC: Loaded 4657 primary data records. [2025-10-21T22:14:45.410626] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:45.442614] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 39418 primary records. [2025-10-21T22:14:45.481276] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-10-21T22:14:45.590042] [DEBUG] [LOCAL ] SOC: Loaded 51226 existing records from primary storage. [2025-10-21T22:14:45.599306] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-10-21T22:14:45.599235] [INFO ] [MAIN ] SOC: Loaded 51226 primary data records. [2025-10-21T22:14:45.605218] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-10-21T22:14:45.795358] [INFO ] [MAIN ] Derivative Progress: 1674/2057 symbols completed. SOBO took 1.5s. Estimated remaining: 2m 25s. Rate: 158.6 symbols/min [2025-10-21T22:14:45.796263] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:45.904476] [DEBUG] [LOCAL ] SOJD: Loaded 12668 existing records from primary storage. [2025-10-21T22:14:45.938409] [INFO ] [MAIN ] SOJD: Loaded 12668 primary data records. [2025-10-21T22:14:46.418748] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:46.420716] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 4657 primary records. [2025-10-21T22:14:46.420960] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-10-21T22:14:46.438377] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-10-21T22:14:46.438639] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-10-21T22:14:46.440833] [INFO ] [MAIN ] Derivative Progress: 1675/2057 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 25s. Rate: 158.5 symbols/min [2025-10-21T22:14:46.441069] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:46.458630] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:46.459716] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 51226 primary records. [2025-10-21T22:14:46.462184] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-10-21T22:14:46.481583] [DEBUG] [LOCAL ] SOJE: Loaded 8777 existing records from primary storage. [2025-10-21T22:14:46.492761] [INFO ] [MAIN ] SOJE: Loaded 8777 primary data records. [2025-10-21T22:14:46.510517] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:46.531337] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12668 primary records. [2025-10-21T22:14:46.555350] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-10-21T22:14:46.510261] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-10-21T22:14:46.564207] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-10-21T22:14:46.584787] [INFO ] [MAIN ] Derivative Progress: 1676/2057 symbols completed. SOC took 1.3s. Estimated remaining: 2m 24s. Rate: 158.6 symbols/min [2025-10-21T22:14:46.610696] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:46.621830] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-10-21T22:14:46.622031] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-10-21T22:14:46.625328] [INFO ] [MAIN ] Derivative Progress: 1677/2057 symbols completed. SOJD took 0.8s. Estimated remaining: 2m 24s. Rate: 158.7 symbols/min [2025-10-21T22:14:46.625773] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:46.839266] [DEBUG] [LOCAL ] SOL: Loaded 13572 existing records from primary storage. [2025-10-21T22:14:46.840151] [INFO ] [MAIN ] SOL: Loaded 13572 primary data records. [2025-10-21T22:14:47.039406] [DEBUG] [LOCAL ] SOLV: Loaded 43445 existing records from primary storage. [2025-10-21T22:14:47.061769] [INFO ] [MAIN ] SOLV: Loaded 43445 primary data records. [2025-10-21T22:14:47.320003] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:47.342509] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 8777 primary records. [2025-10-21T22:14:47.375571] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-10-21T22:14:47.533070] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-10-21T22:14:47.535054] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-10-21T22:14:47.537329] [INFO ] [MAIN ] Derivative Progress: 1678/2057 symbols completed. SOJE took 1.1s. Estimated remaining: 2m 23s. Rate: 158.6 symbols/min [2025-10-21T22:14:47.557156] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:47.557860] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13572 primary records. [2025-10-21T22:14:47.557937] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-10-21T22:14:47.573908] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-10-21T22:14:47.574014] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-10-21T22:14:47.576287] [INFO ] [MAIN ] Derivative Progress: 1679/2057 symbols completed. SOL took 1.0s. Estimated remaining: 2m 23s. Rate: 158.6 symbols/min [2025-10-21T22:14:47.596318] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:47.597054] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 43445 primary records. [2025-10-21T22:14:47.597117] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-10-21T22:14:47.614281] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-10-21T22:14:47.614373] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-10-21T22:14:47.616974] [INFO ] [MAIN ] Derivative Progress: 1680/2057 symbols completed. SOLV took 1.0s. Estimated remaining: 2m 23s. Rate: 158.7 symbols/min [2025-10-21T22:14:47.617523] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:47.617431] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:47.617364] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:47.623702] [DEBUG] [LOCAL ] SOR: Loaded 2835 existing records from primary storage. [2025-10-21T22:14:47.623990] [INFO ] [MAIN ] SOR: Loaded 2835 primary data records. [2025-10-21T22:14:48.026327] [DEBUG] [LOCAL ] SON: Loaded 43528 existing records from primary storage. [2025-10-21T22:14:48.027979] [DEBUG] [LOCAL ] SONY: Loaded 53378 existing records from primary storage. [2025-10-21T22:14:48.028256] [INFO ] [MAIN ] SONY: Loaded 53378 primary data records. [2025-10-21T22:14:48.028321] [INFO ] [MAIN ] SON: Loaded 43528 primary data records. [2025-10-21T22:14:48.660215] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:48.662696] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2835 primary records. [2025-10-21T22:14:48.662958] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-10-21T22:14:48.679579] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-10-21T22:14:48.680274] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-10-21T22:14:48.682904] [INFO ] [MAIN ] Derivative Progress: 1681/2057 symbols completed. SOR took 1.1s. Estimated remaining: 2m 22s. Rate: 158.6 symbols/min [2025-10-21T22:14:48.683932] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:48.706369] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:48.707489] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53378 primary records. [2025-10-21T22:14:48.707625] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-10-21T22:14:48.732210] [DEBUG] [LOCAL ] SOS: Loaded 9535 existing records from primary storage. [2025-10-21T22:14:48.732792] [INFO ] [MAIN ] SOS: Loaded 9535 primary data records. [2025-10-21T22:14:48.745432] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:48.770826] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 43528 primary records. [2025-10-21T22:14:48.795127] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-10-21T22:14:48.854398] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-10-21T22:14:48.856072] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-10-21T22:14:48.862054] [INFO ] [MAIN ] Derivative Progress: 1682/2057 symbols completed. SONY took 1.2s. Estimated remaining: 2m 22s. Rate: 158.6 symbols/min [2025-10-21T22:14:48.865254] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:48.866511] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-10-21T22:14:48.877177] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-10-21T22:14:48.889702] [INFO ] [MAIN ] Derivative Progress: 1683/2057 symbols completed. SON took 1.3s. Estimated remaining: 2m 21s. Rate: 158.7 symbols/min [2025-10-21T22:14:48.908213] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:49.102550] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:49.103236] [INFO ] [MAIN ] SOS: Generated 1794 derivative records from 9535 primary records. [2025-10-21T22:14:49.103393] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-10-21T22:14:49.128774] [DEBUG] [LOCAL ] SOS: Derivative data saved (1794 records). [2025-10-21T22:14:49.129402] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-10-21T22:14:49.131596] [INFO ] [MAIN ] Derivative Progress: 1684/2057 symbols completed. SOS took 0.4s. Estimated remaining: 2m 21s. Rate: 158.7 symbols/min [2025-10-21T22:14:49.132344] [DEBUG] [LOCAL ] SPB: Loaded 34128 existing records from primary storage. [2025-10-21T22:14:49.147392] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:49.147913] [INFO ] [MAIN ] SPB: Loaded 34128 primary data records. [2025-10-21T22:14:49.160542] [DEBUG] [LOCAL ] SPCE: Loaded 50041 existing records from primary storage. [2025-10-21T22:14:49.205446] [INFO ] [MAIN ] SPCE: Loaded 50041 primary data records. [2025-10-21T22:14:49.335622] [DEBUG] [LOCAL ] SPE: Loaded 6238 existing records from primary storage. [2025-10-21T22:14:49.367999] [INFO ] [MAIN ] SPE: Loaded 6238 primary data records. [2025-10-21T22:14:50.140842] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:50.154838] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34128 primary records. [2025-10-21T22:14:50.141458] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:50.155377] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:50.155455] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-10-21T22:14:50.156401] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6238 primary records. [2025-10-21T22:14:50.158061] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 50041 primary records. [2025-10-21T22:14:50.158420] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-10-21T22:14:50.173853] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-10-21T22:14:50.173960] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-10-21T22:14:50.174201] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-10-21T22:14:50.177170] [INFO ] [MAIN ] Derivative Progress: 1685/2057 symbols completed. SPB took 1.3s. Estimated remaining: 2m 21s. Rate: 158.6 symbols/min [2025-10-21T22:14:50.177559] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:50.205464] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-10-21T22:14:50.206113] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-10-21T22:14:50.208823] [INFO ] [MAIN ] Derivative Progress: 1686/2057 symbols completed. SPE took 1.1s. Estimated remaining: 2m 20s. Rate: 158.6 symbols/min [2025-10-21T22:14:50.209312] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:50.211797] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-10-21T22:14:50.212335] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-10-21T22:14:50.215113] [INFO ] [MAIN ] Derivative Progress: 1687/2057 symbols completed. SPCE took 1.3s. Estimated remaining: 2m 20s. Rate: 158.7 symbols/min [2025-10-21T22:14:50.215410] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:50.240434] [DEBUG] [LOCAL ] SPH: Loaded 16617 existing records from primary storage. [2025-10-21T22:14:50.240796] [INFO ] [MAIN ] SPH: Loaded 16617 primary data records. [2025-10-21T22:14:50.400227] [DEBUG] [LOCAL ] SPGI: Loaded 45905 existing records from primary storage. [2025-10-21T22:14:50.411628] [DEBUG] [LOCAL ] SPG: Loaded 50015 existing records from primary storage. [2025-10-21T22:14:50.410928] [INFO ] [MAIN ] SPGI: Loaded 45905 primary data records. [2025-10-21T22:14:50.422117] [INFO ] [MAIN ] SPG: Loaded 50015 primary data records. [2025-10-21T22:14:51.222822] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:51.224242] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 16617 primary records. [2025-10-21T22:14:51.224478] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-10-21T22:14:51.241373] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-10-21T22:14:51.241796] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-10-21T22:14:51.247289] [INFO ] [MAIN ] Derivative Progress: 1688/2057 symbols completed. SPH took 1.0s. Estimated remaining: 2m 20s. Rate: 158.6 symbols/min [2025-10-21T22:14:51.248546] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:51.262324] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:51.263918] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50015 primary records. [2025-10-21T22:14:51.264567] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-10-21T22:14:51.292812] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:51.293456] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45905 primary records. [2025-10-21T22:14:51.294140] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-10-21T22:14:51.320052] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-10-21T22:14:51.321742] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-10-21T22:14:51.325295] [INFO ] [MAIN ] Derivative Progress: 1689/2057 symbols completed. SPG took 1.1s. Estimated remaining: 2m 19s. Rate: 158.6 symbols/min [2025-10-21T22:14:51.325836] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:51.330777] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-10-21T22:14:51.330919] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-10-21T22:14:51.333755] [INFO ] [MAIN ] Derivative Progress: 1690/2057 symbols completed. SPGI took 1.1s. Estimated remaining: 2m 19s. Rate: 158.7 symbols/min [2025-10-21T22:14:51.345817] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:51.347113] [DEBUG] [LOCAL ] SPHR: Loaded 40695 existing records from primary storage. [2025-10-21T22:14:51.347336] [INFO ] [MAIN ] SPHR: Loaded 40695 primary data records. [2025-10-21T22:14:51.466527] [DEBUG] [LOCAL ] SPMC: Loaded 5407 existing records from primary storage. [2025-10-21T22:14:51.472375] [INFO ] [MAIN ] SPMC: Loaded 5407 primary data records. [2025-10-21T22:14:51.675485] [DEBUG] [LOCAL ] SPIR: Loaded 37525 existing records from primary storage. [2025-10-21T22:14:51.808130] [INFO ] [MAIN ] SPIR: Loaded 37525 primary data records. [2025-10-21T22:14:52.357802] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:52.360772] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40695 primary records. [2025-10-21T22:14:52.361041] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-10-21T22:14:52.381889] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-10-21T22:14:52.394396] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-10-21T22:14:52.397820] [INFO ] [MAIN ] Derivative Progress: 1691/2057 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 18s. Rate: 158.6 symbols/min [2025-10-21T22:14:52.400173] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:52.400508] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:52.402058] [INFO ] [MAIN ] SPMC: Generated 1794 derivative records from 5407 primary records. [2025-10-21T22:14:52.409806] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-10-21T22:14:52.415458] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:52.416790] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37525 primary records. [2025-10-21T22:14:52.427832] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-10-21T22:14:52.431619] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1794 records). [2025-10-21T22:14:52.432417] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-10-21T22:14:52.434411] [INFO ] [MAIN ] Derivative Progress: 1692/2057 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 18s. Rate: 158.7 symbols/min [2025-10-21T22:14:52.441859] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:52.450940] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-10-21T22:14:52.451140] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-10-21T22:14:52.453890] [INFO ] [MAIN ] Derivative Progress: 1693/2057 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 18s. Rate: 158.7 symbols/min [2025-10-21T22:14:52.491276] [DEBUG] [LOCAL ] SPNT: Loaded 34304 existing records from primary storage. [2025-10-21T22:14:52.491434] [INFO ] [MAIN ] SPNT: Loaded 34304 primary data records. [2025-10-21T22:14:52.616176] [DEBUG] [LOCAL ] SPR: Loaded 40875 existing records from primary storage. [2025-10-21T22:14:52.626710] [INFO ] [MAIN ] SPR: Loaded 40875 primary data records. [2025-10-21T22:14:53.135840] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:53.136908] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34304 primary records. [2025-10-21T22:14:53.136988] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-10-21T22:14:53.153189] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-10-21T22:14:53.153366] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-10-21T22:14:53.155392] [INFO ] [MAIN ] Derivative Progress: 1694/2057 symbols completed. SPNT took 0.8s. Estimated remaining: 2m 17s. Rate: 158.7 symbols/min [2025-10-21T22:14:53.172009] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:53.172759] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 40875 primary records. [2025-10-21T22:14:53.172838] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-10-21T22:14:53.188796] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-10-21T22:14:53.188857] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-10-21T22:14:53.191100] [INFO ] [MAIN ] Derivative Progress: 1695/2057 symbols completed. SPR took 0.7s. Estimated remaining: 2m 17s. Rate: 158.7 symbols/min [2025-10-21T22:14:53.191585] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:53.191826] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:53.191744] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:53.207713] [DEBUG] [LOCAL ] SPXX: Loaded 9192 existing records from primary storage. [2025-10-21T22:14:53.208017] [INFO ] [MAIN ] SPXX: Loaded 9192 primary data records. [2025-10-21T22:14:53.296951] [DEBUG] [LOCAL ] SPRU: Loaded 10030 existing records from primary storage. [2025-10-21T22:14:53.317801] [INFO ] [MAIN ] SPRU: Loaded 10030 primary data records. [2025-10-21T22:14:53.345906] [DEBUG] [LOCAL ] SPXC: Loaded 23233 existing records from primary storage. [2025-10-21T22:14:53.356021] [INFO ] [MAIN ] SPXC: Loaded 23233 primary data records. [2025-10-21T22:14:54.212432] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:54.214668] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 9192 primary records. [2025-10-21T22:14:54.230901] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-10-21T22:14:54.231186] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:54.232353] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 10030 primary records. [2025-10-21T22:14:54.233080] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-10-21T22:14:54.257083] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-10-21T22:14:54.261707] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-10-21T22:14:54.263990] [INFO ] [MAIN ] Derivative Progress: 1696/2057 symbols completed. SPXX took 1.1s. Estimated remaining: 2m 17s. Rate: 158.6 symbols/min [2025-10-21T22:14:54.274294] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-10-21T22:14:54.274406] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:54.279547] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-10-21T22:14:54.279917] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:54.282031] [INFO ] [MAIN ] Derivative Progress: 1697/2057 symbols completed. SPRU took 1.1s. Estimated remaining: 2m 16s. Rate: 158.7 symbols/min [2025-10-21T22:14:54.282268] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:54.283197] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23233 primary records. [2025-10-21T22:14:54.283466] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-10-21T22:14:54.302492] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-10-21T22:14:54.302739] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-10-21T22:14:54.305621] [INFO ] [MAIN ] Derivative Progress: 1698/2057 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 16s. Rate: 158.8 symbols/min [2025-10-21T22:14:54.305925] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:54.343789] [DEBUG] [LOCAL ] SQNS: Loaded 27998 existing records from primary storage. [2025-10-21T22:14:54.344764] [INFO ] [MAIN ] SQNS: Loaded 27998 primary data records. [2025-10-21T22:14:54.433979] [DEBUG] [LOCAL ] SQM: Loaded 48969 existing records from primary storage. [2025-10-21T22:14:54.449427] [INFO ] [MAIN ] SQM: Loaded 48969 primary data records. [2025-10-21T22:14:54.492367] [DEBUG] [LOCAL ] SR: Loaded 32385 existing records from primary storage. [2025-10-21T22:14:54.527950] [INFO ] [MAIN ] SR: Loaded 32385 primary data records. [2025-10-21T22:14:55.337326] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:55.340571] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 27998 primary records. [2025-10-21T22:14:55.341209] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-10-21T22:14:55.374125] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:55.385718] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32385 primary records. [2025-10-21T22:14:55.387148] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-10-21T22:14:55.387041] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:55.388535] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-10-21T22:14:55.390019] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-10-21T22:14:55.392249] [INFO ] [MAIN ] Derivative Progress: 1699/2057 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 15s. Rate: 158.6 symbols/min [2025-10-21T22:14:55.389864] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48969 primary records. [2025-10-21T22:14:55.392700] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:55.393119] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-10-21T22:14:55.418185] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-10-21T22:14:55.421160] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-10-21T22:14:55.424433] [INFO ] [MAIN ] Derivative Progress: 1700/2057 symbols completed. SR took 1.1s. Estimated remaining: 2m 15s. Rate: 158.7 symbols/min [2025-10-21T22:14:55.425506] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:55.429582] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-10-21T22:14:55.429811] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-10-21T22:14:55.432249] [INFO ] [MAIN ] Derivative Progress: 1701/2057 symbols completed. SQM took 1.2s. Estimated remaining: 2m 15s. Rate: 158.8 symbols/min [2025-10-21T22:14:55.432493] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:55.444572] [DEBUG] [LOCAL ] SREA: Loaded 9778 existing records from primary storage. [2025-10-21T22:14:55.444875] [INFO ] [MAIN ] SREA: Loaded 9778 primary data records. [2025-10-21T22:14:55.821774] [DEBUG] [LOCAL ] SRE: Loaded 53414 existing records from primary storage. [2025-10-21T22:14:55.822495] [INFO ] [MAIN ] SRE: Loaded 53414 primary data records. [2025-10-21T22:14:55.823254] [DEBUG] [LOCAL ] SRFM: Loaded 39815 existing records from primary storage. [2025-10-21T22:14:55.834848] [INFO ] [MAIN ] SRFM: Loaded 39815 primary data records. [2025-10-21T22:14:56.467396] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:56.469483] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 9778 primary records. [2025-10-21T22:14:56.469707] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-10-21T22:14:56.487484] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-10-21T22:14:56.488036] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-10-21T22:14:56.490745] [INFO ] [MAIN ] Derivative Progress: 1702/2057 symbols completed. SREA took 1.1s. Estimated remaining: 2m 14s. Rate: 158.6 symbols/min [2025-10-21T22:14:56.491258] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:56.527165] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:56.528507] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 39815 primary records. [2025-10-21T22:14:56.527740] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:56.529312] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53414 primary records. [2025-10-21T22:14:56.529505] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-10-21T22:14:56.529459] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-10-21T22:14:56.536376] [DEBUG] [LOCAL ] SRG: Loaded 14827 existing records from primary storage. [2025-10-21T22:14:56.557821] [INFO ] [MAIN ] SRG: Loaded 14827 primary data records. [2025-10-21T22:14:56.561612] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-10-21T22:14:56.565005] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-10-21T22:14:56.578551] [INFO ] [MAIN ] Derivative Progress: 1703/2057 symbols completed. SRFM took 1.1s. Estimated remaining: 2m 14s. Rate: 158.7 symbols/min [2025-10-21T22:14:56.612234] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:56.613061] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-10-21T22:14:56.639872] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-10-21T22:14:56.654628] [INFO ] [MAIN ] Derivative Progress: 1704/2057 symbols completed. SRE took 1.3s. Estimated remaining: 2m 13s. Rate: 158.7 symbols/min [2025-10-21T22:14:56.677400] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:56.919940] [DEBUG] [LOCAL ] SRI: Loaded 26340 existing records from primary storage. [2025-10-21T22:14:56.919098] [DEBUG] [LOCAL ] SRV: Loaded 7446 existing records from primary storage. [2025-10-21T22:14:56.920288] [INFO ] [MAIN ] SRV: Loaded 7446 primary data records. [2025-10-21T22:14:56.920211] [INFO ] [MAIN ] SRI: Loaded 26340 primary data records. [2025-10-21T22:14:57.598636] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:57.600007] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 14827 primary records. [2025-10-21T22:14:57.600753] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-10-21T22:14:57.618083] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-10-21T22:14:57.618681] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-10-21T22:14:57.620757] [INFO ] [MAIN ] Derivative Progress: 1705/2057 symbols completed. SRG took 1.1s. Estimated remaining: 2m 13s. Rate: 158.6 symbols/min [2025-10-21T22:14:57.620937] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:57.643032] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:57.651870] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7446 primary records. [2025-10-21T22:14:57.657318] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:57.656833] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-10-21T22:14:57.658215] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 26340 primary records. [2025-10-21T22:14:57.658316] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-10-21T22:14:57.699689] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-10-21T22:14:57.699578] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-10-21T22:14:57.699987] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-10-21T22:14:57.699915] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-10-21T22:14:57.702594] [INFO ] [MAIN ] Derivative Progress: 1706/2057 symbols completed. SRI took 1.1s. Estimated remaining: 2m 13s. Rate: 158.7 symbols/min [2025-10-21T22:14:57.705428] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:57.705544] [INFO ] [MAIN ] Derivative Progress: 1707/2057 symbols completed. SRV took 1.0s. Estimated remaining: 2m 12s. Rate: 158.8 symbols/min [2025-10-21T22:14:57.706155] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:57.721392] [DEBUG] [LOCAL ] SSB: Loaded 42721 existing records from primary storage. [2025-10-21T22:14:57.721531] [INFO ] [MAIN ] SSB: Loaded 42721 primary data records. [2025-10-21T22:14:58.048930] [DEBUG] [LOCAL ] SSD: Loaded 22487 existing records from primary storage. [2025-10-21T22:14:58.049182] [INFO ] [MAIN ] SSD: Loaded 22487 primary data records. [2025-10-21T22:14:58.095022] [DEBUG] [LOCAL ] SSL: Loaded 41459 existing records from primary storage. [2025-10-21T22:14:58.129486] [INFO ] [MAIN ] SSL: Loaded 41459 primary data records. [2025-10-21T22:14:58.702040] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:58.704434] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42721 primary records. [2025-10-21T22:14:58.704880] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-10-21T22:14:58.723187] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-10-21T22:14:58.723754] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-10-21T22:14:58.727997] [INFO ] [MAIN ] Derivative Progress: 1708/2057 symbols completed. SSB took 1.1s. Estimated remaining: 2m 12s. Rate: 158.6 symbols/min [2025-10-21T22:14:58.742897] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:14:58.744336] [INFO ] [MAIN ] SSD: Generated 1793 derivative records from 22487 primary records. [2025-10-21T22:14:58.745045] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-10-21T22:14:58.771046] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:58.773116] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41459 primary records. [2025-10-21T22:14:58.773746] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-10-21T22:14:58.774414] [DEBUG] [LOCAL ] SSD: Derivative data saved (1793 records). [2025-10-21T22:14:58.775015] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-10-21T22:14:58.777090] [INFO ] [MAIN ] Derivative Progress: 1709/2057 symbols completed. SSD took 1.1s. Estimated remaining: 2m 12s. Rate: 158.7 symbols/min [2025-10-21T22:14:58.791250] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-10-21T22:14:58.791310] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-10-21T22:14:58.793896] [INFO ] [MAIN ] Derivative Progress: 1710/2057 symbols completed. SSL took 1.1s. Estimated remaining: 2m 11s. Rate: 158.8 symbols/min [2025-10-21T22:14:58.794238] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:58.794757] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:58.794897] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:58.817957] [DEBUG] [LOCAL ] SST: Loaded 11434 existing records from primary storage. [2025-10-21T22:14:58.818144] [INFO ] [MAIN ] SST: Loaded 11434 primary data records. [2025-10-21T22:14:58.924986] [DEBUG] [LOCAL ] SSTK: Loaded 25352 existing records from primary storage. [2025-10-21T22:14:58.936192] [INFO ] [MAIN ] SSTK: Loaded 25352 primary data records. [2025-10-21T22:14:59.292118] [DEBUG] [LOCAL ] ST: Loaded 49719 existing records from primary storage. [2025-10-21T22:14:59.314825] [INFO ] [MAIN ] ST: Loaded 49719 primary data records. [2025-10-21T22:14:59.850346] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:14:59.853338] [INFO ] [MAIN ] SST: Generated 1793 derivative records from 11434 primary records. [2025-10-21T22:14:59.853965] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-10-21T22:14:59.881291] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:59.889142] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 25352 primary records. [2025-10-21T22:14:59.889323] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-10-21T22:14:59.911737] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-10-21T22:14:59.912086] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-10-21T22:14:59.907359] [DEBUG] [LOCAL ] SST: Derivative data saved (1793 records). [2025-10-21T22:14:59.914628] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-10-21T22:14:59.914489] [INFO ] [MAIN ] Derivative Progress: 1711/2057 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 11s. Rate: 158.6 symbols/min [2025-10-21T22:14:59.917815] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:59.918351] [INFO ] [MAIN ] Derivative Progress: 1712/2057 symbols completed. SST took 1.1s. Estimated remaining: 2m 10s. Rate: 158.7 symbols/min [2025-10-21T22:14:59.919074] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:59.937800] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:14:59.938891] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49719 primary records. [2025-10-21T22:14:59.944448] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-10-21T22:14:59.962623] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-10-21T22:14:59.972344] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-10-21T22:14:59.972237] [DEBUG] [LOCAL ] STC: Loaded 17388 existing records from primary storage. [2025-10-21T22:14:59.976376] [INFO ] [MAIN ] Derivative Progress: 1713/2057 symbols completed. ST took 1.2s. Estimated remaining: 2m 10s. Rate: 158.8 symbols/min [2025-10-21T22:14:59.976897] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:14:59.977031] [INFO ] [MAIN ] STC: Loaded 17388 primary data records. [2025-10-21T22:15:00.153144] [DEBUG] [LOCAL ] STAG: Loaded 50089 existing records from primary storage. [2025-10-21T22:15:00.180122] [INFO ] [MAIN ] STAG: Loaded 50089 primary data records. [2025-10-21T22:15:00.420185] [DEBUG] [LOCAL ] STE: Loaded 35240 existing records from primary storage. [2025-10-21T22:15:00.437437] [INFO ] [MAIN ] STE: Loaded 35240 primary data records. [2025-10-21T22:15:00.996325] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:00.998880] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17388 primary records. [2025-10-21T22:15:00.999254] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-10-21T22:15:01.018495] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-10-21T22:15:01.018676] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-10-21T22:15:01.021812] [INFO ] [MAIN ] Derivative Progress: 1714/2057 symbols completed. STC took 1.1s. Estimated remaining: 2m 10s. Rate: 158.6 symbols/min [2025-10-21T22:15:01.023592] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:01.037074] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:01.037983] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50089 primary records. [2025-10-21T22:15:01.038080] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-10-21T22:15:01.054284] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-10-21T22:15:01.054622] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-10-21T22:15:01.056963] [INFO ] [MAIN ] Derivative Progress: 1715/2057 symbols completed. STAG took 1.1s. Estimated remaining: 2m 9s. Rate: 158.7 symbols/min [2025-10-21T22:15:01.063342] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:01.077315] [DEBUG] [LOCAL ] STEL: Loaded 22486 existing records from primary storage. [2025-10-21T22:15:01.085468] [INFO ] [MAIN ] STEL: Loaded 22486 primary data records. [2025-10-21T22:15:01.124245] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:01.143930] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35240 primary records. [2025-10-21T22:15:01.176535] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-10-21T22:15:01.274972] [DEBUG] [LOCAL ] STEM: Loaded 38495 existing records from primary storage. [2025-10-21T22:15:01.291901] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-10-21T22:15:01.304732] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-10-21T22:15:01.290780] [INFO ] [MAIN ] STEM: Loaded 38495 primary data records. [2025-10-21T22:15:01.316143] [INFO ] [MAIN ] Derivative Progress: 1716/2057 symbols completed. STE took 1.3s. Estimated remaining: 2m 9s. Rate: 158.7 symbols/min [2025-10-21T22:15:01.461971] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:01.633499] [DEBUG] [LOCAL ] STEW: Loaded 15274 existing records from primary storage. [2025-10-21T22:15:01.652061] [INFO ] [MAIN ] STEW: Loaded 15274 primary data records. [2025-10-21T22:15:02.195516] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:02.196402] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 22486 primary records. [2025-10-21T22:15:02.196775] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-10-21T22:15:02.213432] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-10-21T22:15:02.214922] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-10-21T22:15:02.217141] [INFO ] [MAIN ] Derivative Progress: 1717/2057 symbols completed. STEL took 1.2s. Estimated remaining: 2m 9s. Rate: 158.6 symbols/min [2025-10-21T22:15:02.218096] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:02.240340] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:02.241394] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 38495 primary records. [2025-10-21T22:15:02.241864] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-10-21T22:15:02.255028] [DEBUG] [LOCAL ] STK: Loaded 9780 existing records from primary storage. [2025-10-21T22:15:02.259083] [INFO ] [MAIN ] STK: Loaded 9780 primary data records. [2025-10-21T22:15:02.342967] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-10-21T22:15:02.359905] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-10-21T22:15:02.369842] [INFO ] [MAIN ] Derivative Progress: 1718/2057 symbols completed. STEM took 1.3s. Estimated remaining: 2m 8s. Rate: 158.6 symbols/min [2025-10-21T22:15:02.373788] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:02.430160] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:02.472989] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 15274 primary records. [2025-10-21T22:15:02.594400] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-10-21T22:15:02.616412] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-10-21T22:15:02.617217] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-10-21T22:15:02.620398] [INFO ] [MAIN ] Derivative Progress: 1719/2057 symbols completed. STEW took 1.2s. Estimated remaining: 2m 8s. Rate: 158.7 symbols/min [2025-10-21T22:15:02.620975] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:02.681334] [DEBUG] [LOCAL ] STLA: Loaded 53557 existing records from primary storage. [2025-10-21T22:15:02.679858] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:02.682325] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9780 primary records. [2025-10-21T22:15:02.682389] [INFO ] [MAIN ] STLA: Loaded 53557 primary data records. [2025-10-21T22:15:02.682535] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-10-21T22:15:02.800551] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-10-21T22:15:02.824730] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-10-21T22:15:02.827508] [INFO ] [MAIN ] Derivative Progress: 1720/2057 symbols completed. STK took 0.6s. Estimated remaining: 2m 7s. Rate: 158.7 symbols/min [2025-10-21T22:15:02.847797] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:02.901047] [DEBUG] [LOCAL ] STM: Loaded 53573 existing records from primary storage. [2025-10-21T22:15:03.046083] [INFO ] [MAIN ] STM: Loaded 53573 primary data records. [2025-10-21T22:15:03.233471] [DEBUG] [LOCAL ] STN: Loaded 22707 existing records from primary storage. [2025-10-21T22:15:03.339294] [INFO ] [MAIN ] STN: Loaded 22707 primary data records. [2025-10-21T22:15:03.540768] [DEBUG] [MAIN ] STLA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:03.573389] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53557 primary records. [2025-10-21T22:15:03.594541] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-10-21T22:15:03.776963] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-10-21T22:15:03.777086] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-10-21T22:15:03.779167] [INFO ] [MAIN ] Derivative Progress: 1721/2057 symbols completed. STLA took 1.4s. Estimated remaining: 2m 7s. Rate: 158.6 symbols/min [2025-10-21T22:15:03.779445] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:03.799245] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:03.800600] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53573 primary records. [2025-10-21T22:15:03.800786] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-10-21T22:15:03.818544] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-10-21T22:15:03.819104] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-10-21T22:15:03.821735] [INFO ] [MAIN ] Derivative Progress: 1722/2057 symbols completed. STM took 1.2s. Estimated remaining: 2m 7s. Rate: 158.6 symbols/min [2025-10-21T22:15:03.822132] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:03.861395] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:03.863277] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 22707 primary records. [2025-10-21T22:15:03.862365] [DEBUG] [LOCAL ] STRV: Loaded 10844 existing records from primary storage. [2025-10-21T22:15:03.876235] [INFO ] [MAIN ] STRV: Loaded 10844 primary data records. [2025-10-21T22:15:03.876340] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-10-21T22:15:03.931959] [DEBUG] [LOCAL ] STNG: Loaded 43434 existing records from primary storage. [2025-10-21T22:15:03.955549] [INFO ] [MAIN ] STNG: Loaded 43434 primary data records. [2025-10-21T22:15:04.146728] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-10-21T22:15:04.204964] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-10-21T22:15:04.333543] [INFO ] [MAIN ] Derivative Progress: 1723/2057 symbols completed. STN took 1.5s. Estimated remaining: 2m 6s. Rate: 158.6 symbols/min [2025-10-21T22:15:04.559553] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:04.560296] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 10844 primary records. [2025-10-21T22:15:04.560453] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-10-21T22:15:04.576407] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-10-21T22:15:04.576554] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-10-21T22:15:04.578804] [INFO ] [MAIN ] Derivative Progress: 1724/2057 symbols completed. STRV took 0.8s. Estimated remaining: 2m 6s. Rate: 158.6 symbols/min [2025-10-21T22:15:04.593804] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:04.594355] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 43434 primary records. [2025-10-21T22:15:04.594414] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-10-21T22:15:04.609499] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-10-21T22:15:04.609570] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-10-21T22:15:04.612059] [INFO ] [MAIN ] Derivative Progress: 1725/2057 symbols completed. STNG took 0.8s. Estimated remaining: 2m 5s. Rate: 158.7 symbols/min [2025-10-21T22:15:04.612493] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:04.612554] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:04.612627] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:04.657251] [DEBUG] [LOCAL ] STVN: Loaded 26735 existing records from primary storage. [2025-10-21T22:15:04.657400] [INFO ] [MAIN ] STVN: Loaded 26735 primary data records. [2025-10-21T22:15:04.797419] [DEBUG] [LOCAL ] STT: Loaded 51089 existing records from primary storage. [2025-10-21T22:15:04.803433] [INFO ] [MAIN ] STT: Loaded 51089 primary data records. [2025-10-21T22:15:04.957162] [DEBUG] [LOCAL ] STWD: Loaded 51968 existing records from primary storage. [2025-10-21T22:15:05.085936] [INFO ] [MAIN ] STWD: Loaded 51968 primary data records. [2025-10-21T22:15:05.701495] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:05.702303] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26735 primary records. [2025-10-21T22:15:05.702556] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-10-21T22:15:05.720390] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-10-21T22:15:05.720741] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-10-21T22:15:05.723882] [INFO ] [MAIN ] Derivative Progress: 1726/2057 symbols completed. STVN took 1.1s. Estimated remaining: 2m 5s. Rate: 158.5 symbols/min [2025-10-21T22:15:05.725902] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:05.741811] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:05.742899] [INFO ] [MAIN ] STT: Generated 1793 derivative records from 51089 primary records. [2025-10-21T22:15:05.743081] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-10-21T22:15:05.745353] [DEBUG] [LOCAL ] STXD: Loaded 1345 existing records from primary storage. [2025-10-21T22:15:05.746073] [INFO ] [MAIN ] STXD: Loaded 1345 primary data records. [2025-10-21T22:15:05.858842] [DEBUG] [LOCAL ] STT: Derivative data saved (1793 records). [2025-10-21T22:15:05.876978] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:05.877073] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-10-21T22:15:05.880503] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51968 primary records. [2025-10-21T22:15:05.879804] [INFO ] [MAIN ] Derivative Progress: 1727/2057 symbols completed. STT took 1.3s. Estimated remaining: 2m 5s. Rate: 158.6 symbols/min [2025-10-21T22:15:05.880741] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:05.883994] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-10-21T22:15:06.081818] [DEBUG] [LOCAL ] STXE: Loaded 2078 existing records from primary storage. [2025-10-21T22:15:06.095690] [INFO ] [MAIN ] STXE: Loaded 2078 primary data records. [2025-10-21T22:15:06.169904] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-10-21T22:15:06.182419] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-10-21T22:15:06.185159] [INFO ] [MAIN ] Derivative Progress: 1728/2057 symbols completed. STWD took 1.6s. Estimated remaining: 2m 4s. Rate: 158.6 symbols/min [2025-10-21T22:15:06.190535] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:06.297599] [DEBUG] [LOCAL ] STXG: Loaded 2349 existing records from primary storage. [2025-10-21T22:15:06.300692] [INFO ] [MAIN ] STXG: Loaded 2349 primary data records. [2025-10-21T22:15:06.622385] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:06.745708] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1345 primary records. [2025-10-21T22:15:06.747739] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-10-21T22:15:06.764009] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-10-21T22:15:06.764294] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-10-21T22:15:06.766712] [INFO ] [MAIN ] Derivative Progress: 1729/2057 symbols completed. STXD took 1.0s. Estimated remaining: 2m 4s. Rate: 158.6 symbols/min [2025-10-21T22:15:06.767541] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:06.774560] [DEBUG] [LOCAL ] STXK: Loaded 1487 existing records from primary storage. [2025-10-21T22:15:06.776944] [INFO ] [MAIN ] STXK: Loaded 1487 primary data records. [2025-10-21T22:15:06.874796] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:06.887377] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2078 primary records. [2025-10-21T22:15:06.899178] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-10-21T22:15:07.011103] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-10-21T22:15:07.011471] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-10-21T22:15:07.128410] [INFO ] [MAIN ] Derivative Progress: 1730/2057 symbols completed. STXE took 1.2s. Estimated remaining: 2m 4s. Rate: 158.6 symbols/min [2025-10-21T22:15:07.112709] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:07.130467] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:07.130260] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2349 primary records. [2025-10-21T22:15:07.130768] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-10-21T22:15:07.148068] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-10-21T22:15:07.148889] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-10-21T22:15:07.151683] [DEBUG] [LOCAL ] STXT: Loaded 2505 existing records from primary storage. [2025-10-21T22:15:07.152278] [INFO ] [MAIN ] STXT: Loaded 2505 primary data records. [2025-10-21T22:15:07.155047] [INFO ] [MAIN ] Derivative Progress: 1731/2057 symbols completed. STXG took 1.0s. Estimated remaining: 2m 3s. Rate: 158.7 symbols/min [2025-10-21T22:15:07.176718] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:07.267402] [DEBUG] [LOCAL ] STXV: Loaded 1469 existing records from primary storage. [2025-10-21T22:15:07.267717] [INFO ] [MAIN ] STXV: Loaded 1469 primary data records. [2025-10-21T22:15:07.832725] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:07.833991] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1487 primary records. [2025-10-21T22:15:07.834444] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-10-21T22:15:07.849788] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-10-21T22:15:07.850324] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-10-21T22:15:07.852423] [INFO ] [MAIN ] Derivative Progress: 1732/2057 symbols completed. STXK took 1.1s. Estimated remaining: 2m 3s. Rate: 158.6 symbols/min [2025-10-21T22:15:07.852707] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:07.874016] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:07.874852] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2505 primary records. [2025-10-21T22:15:07.875073] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-10-21T22:15:07.893852] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-10-21T22:15:07.906139] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-10-21T22:15:07.908919] [INFO ] [MAIN ] Derivative Progress: 1733/2057 symbols completed. STXT took 0.8s. Estimated remaining: 2m 3s. Rate: 158.7 symbols/min [2025-10-21T22:15:07.909126] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:07.909840] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:07.910512] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1469 primary records. [2025-10-21T22:15:07.910572] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-10-21T22:15:07.938201] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-10-21T22:15:07.938392] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-10-21T22:15:07.941286] [INFO ] [MAIN ] Derivative Progress: 1734/2057 symbols completed. STXV took 0.8s. Estimated remaining: 2m 2s. Rate: 158.7 symbols/min [2025-10-21T22:15:07.941600] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:07.963836] [DEBUG] [LOCAL ] SU: Loaded 53432 existing records from primary storage. [2025-10-21T22:15:07.964074] [INFO ] [MAIN ] SU: Loaded 53432 primary data records. [2025-10-21T22:15:08.175494] [DEBUG] [LOCAL ] SUI: Loaded 41883 existing records from primary storage. [2025-10-21T22:15:08.291526] [INFO ] [MAIN ] SUI: Loaded 41883 primary data records. [2025-10-21T22:15:08.354267] [DEBUG] [LOCAL ] SUN: Loaded 38843 existing records from primary storage. [2025-10-21T22:15:08.371530] [INFO ] [MAIN ] SUN: Loaded 38843 primary data records. [2025-10-21T22:15:08.927921] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:08.928936] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53432 primary records. [2025-10-21T22:15:08.929441] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-10-21T22:15:08.948579] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-10-21T22:15:08.948914] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-10-21T22:15:08.951465] [INFO ] [MAIN ] Derivative Progress: 1735/2057 symbols completed. SU took 1.1s. Estimated remaining: 2m 2s. Rate: 158.6 symbols/min [2025-10-21T22:15:08.951738] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:08.983629] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:08.984812] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 41883 primary records. [2025-10-21T22:15:08.984027] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:08.984958] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-10-21T22:15:08.986160] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 38843 primary records. [2025-10-21T22:15:08.986445] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-10-21T22:15:09.016616] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-10-21T22:15:09.020784] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-10-21T22:15:09.024105] [INFO ] [MAIN ] Derivative Progress: 1736/2057 symbols completed. SUN took 1.1s. Estimated remaining: 2m 1s. Rate: 158.7 symbols/min [2025-10-21T22:15:09.021789] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-10-21T22:15:09.024329] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-10-21T22:15:09.028231] [INFO ] [MAIN ] Derivative Progress: 1737/2057 symbols completed. SUI took 1.1s. Estimated remaining: 2m 1s. Rate: 158.8 symbols/min [2025-10-21T22:15:09.028093] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:09.028615] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:09.087468] [DEBUG] [LOCAL ] SUPV: Loaded 48049 existing records from primary storage. [2025-10-21T22:15:09.087767] [INFO ] [MAIN ] SUPV: Loaded 48049 primary data records. [2025-10-21T22:15:09.216602] [DEBUG] [LOCAL ] SVV: Loaded 40296 existing records from primary storage. [2025-10-21T22:15:09.217114] [INFO ] [MAIN ] SVV: Loaded 40296 primary data records. [2025-10-21T22:15:09.216106] [DEBUG] [LOCAL ] SUZ: Loaded 45564 existing records from primary storage. [2025-10-21T22:15:09.227855] [INFO ] [MAIN ] SUZ: Loaded 45564 primary data records. [2025-10-21T22:15:10.067581] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:10.069479] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 48049 primary records. [2025-10-21T22:15:10.077574] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-10-21T22:15:10.084339] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:10.085742] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45564 primary records. [2025-10-21T22:15:10.092993] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-10-21T22:15:10.111134] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-10-21T22:15:10.111934] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-10-21T22:15:10.118893] [INFO ] [MAIN ] Derivative Progress: 1738/2057 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 1s. Rate: 158.6 symbols/min [2025-10-21T22:15:10.125945] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-10-21T22:15:10.126109] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-10-21T22:15:10.128961] [INFO ] [MAIN ] Derivative Progress: 1739/2057 symbols completed. SUZ took 1.1s. Estimated remaining: 2m 0s. Rate: 158.7 symbols/min [2025-10-21T22:15:10.143116] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:10.143750] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 40296 primary records. [2025-10-21T22:15:10.143829] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-10-21T22:15:10.159008] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-10-21T22:15:10.159066] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-10-21T22:15:10.161713] [INFO ] [MAIN ] Derivative Progress: 1740/2057 symbols completed. SVV took 1.1s. Estimated remaining: 1m 60s. Rate: 158.8 symbols/min [2025-10-21T22:15:10.162053] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:10.162200] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:10.162106] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:10.196667] [DEBUG] [LOCAL ] SWX: Loaded 30720 existing records from primary storage. [2025-10-21T22:15:10.221442] [INFO ] [MAIN ] SWX: Loaded 30720 primary data records. [2025-10-21T22:15:10.374087] [DEBUG] [LOCAL ] SWK: Loaded 52419 existing records from primary storage. [2025-10-21T22:15:10.373420] [DEBUG] [LOCAL ] SW: Loaded 53179 existing records from primary storage. [2025-10-21T22:15:10.374297] [INFO ] [MAIN ] SW: Loaded 53179 primary data records. [2025-10-21T22:15:10.384666] [INFO ] [MAIN ] SWK: Loaded 52419 primary data records. [2025-10-21T22:15:11.213876] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:11.215869] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 30720 primary records. [2025-10-21T22:15:11.216269] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-10-21T22:15:11.236433] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-10-21T22:15:11.239400] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-10-21T22:15:11.248929] [INFO ] [MAIN ] Derivative Progress: 1741/2057 symbols completed. SWX took 1.1s. Estimated remaining: 1m 60s. Rate: 158.6 symbols/min [2025-10-21T22:15:11.254810] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:11.263758] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:11.269241] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52419 primary records. [2025-10-21T22:15:11.269739] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:11.269797] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-10-21T22:15:11.270399] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53179 primary records. [2025-10-21T22:15:11.271164] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-10-21T22:15:11.295194] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-10-21T22:15:11.295365] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-10-21T22:15:11.301548] [INFO ] [MAIN ] Derivative Progress: 1742/2057 symbols completed. SWK took 1.1s. Estimated remaining: 1m 59s. Rate: 158.7 symbols/min [2025-10-21T22:15:11.305390] [DEBUG] [LOCAL ] SWZ: Loaded 6032 existing records from primary storage. [2025-10-21T22:15:11.304922] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:11.306094] [INFO ] [MAIN ] SWZ: Loaded 6032 primary data records. [2025-10-21T22:15:11.429604] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-10-21T22:15:11.467827] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-10-21T22:15:11.507048] [INFO ] [MAIN ] Derivative Progress: 1743/2057 symbols completed. SW took 1.3s. Estimated remaining: 1m 59s. Rate: 158.7 symbols/min [2025-10-21T22:15:11.647693] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:11.663564] [DEBUG] [LOCAL ] SXC: Loaded 41628 existing records from primary storage. [2025-10-21T22:15:11.664533] [INFO ] [MAIN ] SXC: Loaded 41628 primary data records. [2025-10-21T22:15:11.751730] [DEBUG] [LOCAL ] SXI: Loaded 12082 existing records from primary storage. [2025-10-21T22:15:11.779303] [INFO ] [MAIN ] SXI: Loaded 12082 primary data records. [2025-10-21T22:15:12.280771] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:12.281585] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6032 primary records. [2025-10-21T22:15:12.282181] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-10-21T22:15:12.298970] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-10-21T22:15:12.299833] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-10-21T22:15:12.302075] [INFO ] [MAIN ] Derivative Progress: 1744/2057 symbols completed. SWZ took 1.0s. Estimated remaining: 1m 58s. Rate: 158.6 symbols/min [2025-10-21T22:15:12.302394] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:12.323058] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:12.323763] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41628 primary records. [2025-10-21T22:15:12.323985] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-10-21T22:15:12.348106] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-10-21T22:15:12.348301] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-10-21T22:15:12.351425] [INFO ] [MAIN ] Derivative Progress: 1745/2057 symbols completed. SXC took 1.0s. Estimated remaining: 1m 58s. Rate: 158.7 symbols/min [2025-10-21T22:15:12.351636] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:12.367278] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:12.376106] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 12082 primary records. [2025-10-21T22:15:12.377048] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-10-21T22:15:12.377604] [DEBUG] [LOCAL ] SXT: Loaded 29847 existing records from primary storage. [2025-10-21T22:15:12.378377] [INFO ] [MAIN ] SXT: Loaded 29847 primary data records. [2025-10-21T22:15:12.510852] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-10-21T22:15:12.511080] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-10-21T22:15:12.513545] [INFO ] [MAIN ] Derivative Progress: 1746/2057 symbols completed. SXI took 0.9s. Estimated remaining: 1m 58s. Rate: 158.7 symbols/min [2025-10-21T22:15:12.514138] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:12.733385] [DEBUG] [LOCAL ] SYK: Loaded 46824 existing records from primary storage. [2025-10-21T22:15:12.733682] [INFO ] [MAIN ] SYK: Loaded 46824 primary data records. [2025-10-21T22:15:13.069254] [DEBUG] [LOCAL ] SYY: Loaded 53206 existing records from primary storage. [2025-10-21T22:15:13.069714] [INFO ] [MAIN ] SYY: Loaded 53206 primary data records. [2025-10-21T22:15:13.234715] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:13.275272] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 29847 primary records. [2025-10-21T22:15:13.275539] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-10-21T22:15:13.411814] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-10-21T22:15:13.412745] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-10-21T22:15:13.414917] [INFO ] [MAIN ] Derivative Progress: 1747/2057 symbols completed. SXT took 1.1s. Estimated remaining: 1m 57s. Rate: 158.6 symbols/min [2025-10-21T22:15:13.423519] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:13.430327] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:13.431324] [INFO ] [MAIN ] SYK: Generated 1793 derivative records from 46824 primary records. [2025-10-21T22:15:13.431602] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-10-21T22:15:13.449372] [DEBUG] [LOCAL ] SYK: Derivative data saved (1793 records). [2025-10-21T22:15:13.449692] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-10-21T22:15:13.452174] [INFO ] [MAIN ] Derivative Progress: 1748/2057 symbols completed. SYK took 1.1s. Estimated remaining: 1m 57s. Rate: 158.7 symbols/min [2025-10-21T22:15:13.452575] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:13.472041] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:13.472800] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53206 primary records. [2025-10-21T22:15:13.472994] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-10-21T22:15:13.488807] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-10-21T22:15:13.488981] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-10-21T22:15:13.491430] [INFO ] [MAIN ] Derivative Progress: 1749/2057 symbols completed. SYY took 1.0s. Estimated remaining: 1m 56s. Rate: 158.8 symbols/min [2025-10-21T22:15:13.491701] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:13.550189] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-10-21T22:15:13.550480] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-10-21T22:15:13.551086] [DEBUG] [LOCAL ] TAC: Loaded 43392 existing records from primary storage. [2025-10-21T22:15:13.573248] [INFO ] [MAIN ] TAC: Loaded 43392 primary data records. [2025-10-21T22:15:13.907154] [DEBUG] [LOCAL ] TAK: Loaded 50230 existing records from primary storage. [2025-10-21T22:15:13.984963] [INFO ] [MAIN ] TAK: Loaded 50230 primary data records. [2025-10-21T22:15:14.548412] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:14.549987] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-10-21T22:15:14.550128] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-10-21T22:15:14.575564] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:14.576947] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 43392 primary records. [2025-10-21T22:15:14.577404] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-10-21T22:15:14.597214] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-10-21T22:15:14.598269] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-10-21T22:15:14.600831] [INFO ] [MAIN ] Derivative Progress: 1750/2057 symbols completed. TAC took 1.1s. Estimated remaining: 1m 56s. Rate: 158.6 symbols/min [2025-10-21T22:15:14.598180] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-10-21T22:15:14.601174] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-10-21T22:15:14.604220] [INFO ] [MAIN ] Derivative Progress: 1751/2057 symbols completed. T took 1.2s. Estimated remaining: 1m 56s. Rate: 158.7 symbols/min [2025-10-21T22:15:14.604685] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:14.604128] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:14.622832] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:14.623674] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 50230 primary records. [2025-10-21T22:15:14.623864] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-10-21T22:15:14.642484] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-10-21T22:15:14.642951] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-10-21T22:15:14.646823] [INFO ] [MAIN ] Derivative Progress: 1752/2057 symbols completed. TAK took 1.2s. Estimated remaining: 1m 55s. Rate: 158.8 symbols/min [2025-10-21T22:15:14.647330] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:14.700539] [DEBUG] [LOCAL ] TAL: Loaded 51724 existing records from primary storage. [2025-10-21T22:15:14.700895] [INFO ] [MAIN ] TAL: Loaded 51724 primary data records. [2025-10-21T22:15:14.779920] [DEBUG] [LOCAL ] TALO: Loaded 51003 existing records from primary storage. [2025-10-21T22:15:14.797231] [INFO ] [MAIN ] TALO: Loaded 51003 primary data records. [2025-10-21T22:15:15.178189] [DEBUG] [LOCAL ] TAP: Loaded 52976 existing records from primary storage. [2025-10-21T22:15:15.196334] [INFO ] [MAIN ] TAP: Loaded 52976 primary data records. [2025-10-21T22:15:15.715251] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:15.717827] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 51724 primary records. [2025-10-21T22:15:15.718667] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-10-21T22:15:15.745186] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:15.750823] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-10-21T22:15:15.751039] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-10-21T22:15:15.747593] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 51003 primary records. [2025-10-21T22:15:15.751211] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-10-21T22:15:15.753822] [INFO ] [MAIN ] Derivative Progress: 1753/2057 symbols completed. TAL took 1.1s. Estimated remaining: 1m 55s. Rate: 158.6 symbols/min [2025-10-21T22:15:15.769519] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-10-21T22:15:15.769586] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-10-21T22:15:15.772364] [INFO ] [MAIN ] Derivative Progress: 1754/2057 symbols completed. TALO took 1.2s. Estimated remaining: 1m 55s. Rate: 158.7 symbols/min [2025-10-21T22:15:15.787939] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:15.788483] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52976 primary records. [2025-10-21T22:15:15.788541] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-10-21T22:15:15.803156] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-10-21T22:15:15.803212] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-10-21T22:15:15.805941] [INFO ] [MAIN ] Derivative Progress: 1755/2057 symbols completed. TAP took 1.2s. Estimated remaining: 1m 54s. Rate: 158.8 symbols/min [2025-10-21T22:15:15.806394] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:15.806353] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:15.806539] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:15.820998] [DEBUG] [LOCAL ] TBB: Loaded 11406 existing records from primary storage. [2025-10-21T22:15:15.821242] [INFO ] [MAIN ] TBB: Loaded 11406 primary data records. [2025-10-21T22:15:15.955772] [DEBUG] [LOCAL ] TBI: Loaded 22817 existing records from primary storage. [2025-10-21T22:15:15.981634] [INFO ] [MAIN ] TBI: Loaded 22817 primary data records. [2025-10-21T22:15:16.031012] [DEBUG] [LOCAL ] TBBB: Loaded 35673 existing records from primary storage. [2025-10-21T22:15:16.042396] [INFO ] [MAIN ] TBBB: Loaded 35673 primary data records. [2025-10-21T22:15:16.763116] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:16.765029] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11406 primary records. [2025-10-21T22:15:16.765428] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-10-21T22:15:16.782526] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-10-21T22:15:16.782791] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-10-21T22:15:16.785492] [INFO ] [MAIN ] Derivative Progress: 1756/2057 symbols completed. TBB took 1.0s. Estimated remaining: 1m 54s. Rate: 158.6 symbols/min [2025-10-21T22:15:16.786455] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:16.801583] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:16.802320] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22817 primary records. [2025-10-21T22:15:16.803562] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-10-21T22:15:16.821495] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-10-21T22:15:16.824126] [DEBUG] [LOCAL ] TBN: Loaded 4035 existing records from primary storage. [2025-10-21T22:15:16.821755] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-10-21T22:15:16.826830] [INFO ] [MAIN ] Derivative Progress: 1757/2057 symbols completed. TBI took 1.0s. Estimated remaining: 1m 53s. Rate: 158.7 symbols/min [2025-10-21T22:15:16.827473] [INFO ] [MAIN ] TBN: Loaded 4035 primary data records. [2025-10-21T22:15:16.827189] [INFO ] [MAIN ] TCBX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:16.859203] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:16.889952] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 35673 primary records. [2025-10-21T22:15:16.895295] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-10-21T22:15:16.998358] [DEBUG] [LOCAL ] TCBX: Loaded 10240 existing records from primary storage. [2025-10-21T22:15:17.002861] [INFO ] [MAIN ] TCBX: Loaded 10240 primary data records. [2025-10-21T22:15:17.009209] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-10-21T22:15:17.019988] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-10-21T22:15:17.024608] [INFO ] [MAIN ] Derivative Progress: 1758/2057 symbols completed. TBBB took 1.2s. Estimated remaining: 1m 53s. Rate: 158.7 symbols/min [2025-10-21T22:15:17.029979] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:17.597801] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:17.599386] [DEBUG] [LOCAL ] TD: Loaded 52251 existing records from primary storage. [2025-10-21T22:15:17.599633] [INFO ] [MAIN ] TD: Loaded 52251 primary data records. [2025-10-21T22:15:17.601056] [INFO ] [MAIN ] TBN: Generated 1794 derivative records from 4035 primary records. [2025-10-21T22:15:17.601223] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-10-21T22:15:17.693332] [DEBUG] [LOCAL ] TBN: Derivative data saved (1794 records). [2025-10-21T22:15:17.705125] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-10-21T22:15:17.712329] [INFO ] [MAIN ] Derivative Progress: 1759/2057 symbols completed. TBN took 0.9s. Estimated remaining: 1m 53s. Rate: 158.7 symbols/min [2025-10-21T22:15:17.743046] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:17.743848] [DEBUG] [MAIN ] TCBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:17.750892] [INFO ] [MAIN ] TCBX: Generated 1794 derivative records from 10240 primary records. [2025-10-21T22:15:17.766584] [DEBUG] [LOCAL ] TCBX: Saving derivative data. [2025-10-21T22:15:17.961138] [DEBUG] [LOCAL ] TCBX: Derivative data saved (1794 records). [2025-10-21T22:15:17.961632] [INFO ] [MAIN ] TCBX: Successfully saved derivative data. [2025-10-21T22:15:17.963980] [INFO ] [MAIN ] Derivative Progress: 1760/2057 symbols completed. TCBX took 1.1s. Estimated remaining: 1m 52s. Rate: 158.7 symbols/min [2025-10-21T22:15:17.964399] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:17.986630] [DEBUG] [LOCAL ] TDF: Loaded 6251 existing records from primary storage. [2025-10-21T22:15:17.987635] [INFO ] [MAIN ] TDF: Loaded 6251 primary data records. [2025-10-21T22:15:18.075383] [DEBUG] [LOCAL ] TDC: Loaded 46430 existing records from primary storage. [2025-10-21T22:15:18.113675] [INFO ] [MAIN ] TDC: Loaded 46430 primary data records. [2025-10-21T22:15:18.154211] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:18.213971] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52251 primary records. [2025-10-21T22:15:18.252504] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-10-21T22:15:18.533775] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-10-21T22:15:18.537484] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-10-21T22:15:18.540300] [INFO ] [MAIN ] Derivative Progress: 1761/2057 symbols completed. TD took 1.5s. Estimated remaining: 1m 52s. Rate: 158.7 symbols/min [2025-10-21T22:15:18.540503] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:18.683330] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:18.684165] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6251 primary records. [2025-10-21T22:15:18.684398] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-10-21T22:15:18.704045] [DEBUG] [LOCAL ] TDG: Loaded 22101 existing records from primary storage. [2025-10-21T22:15:18.711099] [INFO ] [MAIN ] TDG: Loaded 22101 primary data records. [2025-10-21T22:15:18.711442] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-10-21T22:15:18.749200] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-10-21T22:15:18.777104] [INFO ] [MAIN ] Derivative Progress: 1762/2057 symbols completed. TDF took 0.8s. Estimated remaining: 1m 52s. Rate: 158.7 symbols/min [2025-10-21T22:15:18.786166] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:18.872882] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:18.900334] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 46430 primary records. [2025-10-21T22:15:18.924328] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-10-21T22:15:19.069369] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-10-21T22:15:19.069716] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-10-21T22:15:19.072036] [INFO ] [MAIN ] Derivative Progress: 1763/2057 symbols completed. TDC took 1.3s. Estimated remaining: 1m 51s. Rate: 158.7 symbols/min [2025-10-21T22:15:19.073374] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:19.096390] [DEBUG] [LOCAL ] TDOC: Loaded 53368 existing records from primary storage. [2025-10-21T22:15:19.096979] [INFO ] [MAIN ] TDOC: Loaded 53368 primary data records. [2025-10-21T22:15:19.302299] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:19.437066] [DEBUG] [LOCAL ] TDS: Loaded 42285 existing records from primary storage. [2025-10-21T22:15:19.438527] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22101 primary records. [2025-10-21T22:15:19.439086] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-10-21T22:15:19.438991] [INFO ] [MAIN ] TDS: Loaded 42285 primary data records. [2025-10-21T22:15:19.525523] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-10-21T22:15:19.542670] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-10-21T22:15:19.580888] [INFO ] [MAIN ] Derivative Progress: 1764/2057 symbols completed. TDG took 1.0s. Estimated remaining: 1m 51s. Rate: 158.7 symbols/min [2025-10-21T22:15:19.585542] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:19.849895] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:19.863609] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53368 primary records. [2025-10-21T22:15:19.863824] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-10-21T22:15:19.865324] [DEBUG] [LOCAL ] TDW: Loaded 44963 existing records from primary storage. [2025-10-21T22:15:19.867092] [INFO ] [MAIN ] TDW: Loaded 44963 primary data records. [2025-10-21T22:15:19.923237] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-10-21T22:15:19.942400] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-10-21T22:15:19.959415] [INFO ] [MAIN ] Derivative Progress: 1765/2057 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 50s. Rate: 158.7 symbols/min [2025-10-21T22:15:19.959747] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:20.222906] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:20.224221] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42285 primary records. [2025-10-21T22:15:20.224406] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-10-21T22:15:20.225845] [DEBUG] [LOCAL ] TDY: Loaded 22123 existing records from primary storage. [2025-10-21T22:15:20.226051] [INFO ] [MAIN ] TDY: Loaded 22123 primary data records. [2025-10-21T22:15:20.282167] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-10-21T22:15:20.289313] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-10-21T22:15:20.317826] [INFO ] [MAIN ] Derivative Progress: 1766/2057 symbols completed. TDS took 1.2s. Estimated remaining: 1m 50s. Rate: 158.7 symbols/min [2025-10-21T22:15:20.329876] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:20.420038] [DEBUG] [LOCAL ] TEAF: Loaded 7398 existing records from primary storage. [2025-10-21T22:15:20.445210] [INFO ] [MAIN ] TEAF: Loaded 7398 primary data records. [2025-10-21T22:15:20.923095] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:20.924417] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 44963 primary records. [2025-10-21T22:15:20.924886] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-10-21T22:15:20.942576] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-10-21T22:15:20.943438] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-10-21T22:15:20.945779] [INFO ] [MAIN ] Derivative Progress: 1767/2057 symbols completed. TDW took 1.4s. Estimated remaining: 1m 50s. Rate: 158.6 symbols/min [2025-10-21T22:15:20.946323] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:20.967055] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:20.968923] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 22123 primary records. [2025-10-21T22:15:20.970981] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-10-21T22:15:20.999413] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-10-21T22:15:21.000136] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:21.000251] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-10-21T22:15:21.001108] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7398 primary records. [2025-10-21T22:15:21.003458] [INFO ] [MAIN ] Derivative Progress: 1768/2057 symbols completed. TDY took 1.0s. Estimated remaining: 1m 49s. Rate: 158.7 symbols/min [2025-10-21T22:15:21.001257] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-10-21T22:15:21.019053] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-10-21T22:15:21.032573] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-10-21T22:15:21.035531] [INFO ] [MAIN ] Derivative Progress: 1769/2057 symbols completed. TEAF took 0.7s. Estimated remaining: 1m 49s. Rate: 158.8 symbols/min [2025-10-21T22:15:21.057975] [DEBUG] [LOCAL ] TECK: Loaded 53435 existing records from primary storage. [2025-10-21T22:15:21.058143] [INFO ] [MAIN ] TECK: Loaded 53435 primary data records. [2025-10-21T22:15:21.364470] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:21.365119] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53435 primary records. [2025-10-21T22:15:21.365179] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-10-21T22:15:21.380143] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-10-21T22:15:21.380242] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-10-21T22:15:21.382758] [INFO ] [MAIN ] Derivative Progress: 1770/2057 symbols completed. TECK took 0.4s. Estimated remaining: 1m 48s. Rate: 158.8 symbols/min [2025-10-21T22:15:21.383449] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:21.383584] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:21.383378] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:21.407845] [DEBUG] [LOCAL ] TEI: Loaded 21227 existing records from primary storage. [2025-10-21T22:15:21.417439] [INFO ] [MAIN ] TEI: Loaded 21227 primary data records. [2025-10-21T22:15:21.508360] [DEBUG] [LOCAL ] TEF: Loaded 36837 existing records from primary storage. [2025-10-21T22:15:21.508473] [INFO ] [MAIN ] TEF: Loaded 36837 primary data records. [2025-10-21T22:15:21.964892] [DEBUG] [LOCAL ] TEL: Loaded 51052 existing records from primary storage. [2025-10-21T22:15:21.982278] [INFO ] [MAIN ] TEL: Loaded 51052 primary data records. [2025-10-21T22:15:22.489285] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:22.490512] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 21227 primary records. [2025-10-21T22:15:22.490626] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-10-21T22:15:22.515477] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-10-21T22:15:22.517621] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-10-21T22:15:22.520228] [INFO ] [MAIN ] Derivative Progress: 1771/2057 symbols completed. TEI took 1.1s. Estimated remaining: 1m 48s. Rate: 158.6 symbols/min [2025-10-21T22:15:22.520538] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:22.536299] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:22.537234] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 36837 primary records. [2025-10-21T22:15:22.537384] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-10-21T22:15:22.558687] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-10-21T22:15:22.559053] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-10-21T22:15:22.561184] [INFO ] [MAIN ] Derivative Progress: 1772/2057 symbols completed. TEF took 1.2s. Estimated remaining: 1m 48s. Rate: 158.7 symbols/min [2025-10-21T22:15:22.561710] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:22.587330] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:22.588634] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51052 primary records. [2025-10-21T22:15:22.588974] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-10-21T22:15:22.608065] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-10-21T22:15:22.608958] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-10-21T22:15:22.621037] [INFO ] [MAIN ] Derivative Progress: 1773/2057 symbols completed. TEL took 1.2s. Estimated remaining: 1m 47s. Rate: 158.8 symbols/min [2025-10-21T22:15:22.622915] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:22.623969] [DEBUG] [LOCAL ] TEN: Loaded 30504 existing records from primary storage. [2025-10-21T22:15:22.624443] [INFO ] [MAIN ] TEN: Loaded 30504 primary data records. [2025-10-21T22:15:22.743306] [DEBUG] [LOCAL ] TEO: Loaded 22817 existing records from primary storage. [2025-10-21T22:15:22.763143] [INFO ] [MAIN ] TEO: Loaded 22817 primary data records. [2025-10-21T22:15:23.070113] [DEBUG] [LOCAL ] TEX: Loaded 43602 existing records from primary storage. [2025-10-21T22:15:23.249980] [INFO ] [MAIN ] TEX: Loaded 43602 primary data records. [2025-10-21T22:15:24.071128] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:24.073028] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 30504 primary records. [2025-10-21T22:15:24.073342] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-10-21T22:15:24.092542] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-10-21T22:15:24.093895] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-10-21T22:15:24.096434] [INFO ] [MAIN ] Derivative Progress: 1774/2057 symbols completed. TEN took 1.6s. Estimated remaining: 1m 47s. Rate: 158.5 symbols/min [2025-10-21T22:15:24.096787] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:24.114161] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:24.115163] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 22817 primary records. [2025-10-21T22:15:24.115496] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-10-21T22:15:24.133512] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-10-21T22:15:24.134675] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-10-21T22:15:24.137340] [INFO ] [MAIN ] Derivative Progress: 1775/2057 symbols completed. TEO took 1.6s. Estimated remaining: 1m 47s. Rate: 158.6 symbols/min [2025-10-21T22:15:24.137709] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:24.153325] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:24.154187] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 43602 primary records. [2025-10-21T22:15:24.154442] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-10-21T22:15:24.171761] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-10-21T22:15:24.171935] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-10-21T22:15:24.174510] [INFO ] [MAIN ] Derivative Progress: 1776/2057 symbols completed. TEX took 1.6s. Estimated remaining: 1m 46s. Rate: 158.7 symbols/min [2025-10-21T22:15:24.174851] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:24.223142] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-10-21T22:15:24.223376] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-10-21T22:15:24.317150] [DEBUG] [LOCAL ] TFIN: Loaded 23764 existing records from primary storage. [2025-10-21T22:15:24.317931] [DEBUG] [LOCAL ] TFII: Loaded 32402 existing records from primary storage. [2025-10-21T22:15:24.317409] [INFO ] [MAIN ] TFIN: Loaded 23764 primary data records. [2025-10-21T22:15:24.328481] [INFO ] [MAIN ] TFII: Loaded 32402 primary data records. [2025-10-21T22:15:25.203999] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:25.205079] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-10-21T22:15:25.205633] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-10-21T22:15:25.223099] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-10-21T22:15:25.223669] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-10-21T22:15:25.227491] [INFO ] [MAIN ] Derivative Progress: 1777/2057 symbols completed. TFC took 1.1s. Estimated remaining: 1m 46s. Rate: 158.5 symbols/min [2025-10-21T22:15:25.231274] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:25.258538] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:25.259937] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23764 primary records. [2025-10-21T22:15:25.259071] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:25.260166] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-10-21T22:15:25.261355] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 32402 primary records. [2025-10-21T22:15:25.261761] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-10-21T22:15:25.286238] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-10-21T22:15:25.286461] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-10-21T22:15:25.296993] [INFO ] [MAIN ] Derivative Progress: 1778/2057 symbols completed. TFII took 1.2s. Estimated remaining: 1m 46s. Rate: 158.6 symbols/min [2025-10-21T22:15:25.297261] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:25.294526] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-10-21T22:15:25.297666] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-10-21T22:15:25.300467] [INFO ] [MAIN ] Derivative Progress: 1779/2057 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 45s. Rate: 158.7 symbols/min [2025-10-21T22:15:25.301081] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:25.325863] [DEBUG] [LOCAL ] TG: Loaded 10652 existing records from primary storage. [2025-10-21T22:15:25.337819] [INFO ] [MAIN ] TG: Loaded 10652 primary data records. [2025-10-21T22:15:25.360362] [DEBUG] [LOCAL ] TFPM: Loaded 39841 existing records from primary storage. [2025-10-21T22:15:25.385894] [INFO ] [MAIN ] TFPM: Loaded 39841 primary data records. [2025-10-21T22:15:25.523044] [DEBUG] [LOCAL ] TFX: Loaded 35780 existing records from primary storage. [2025-10-21T22:15:25.556956] [INFO ] [MAIN ] TFX: Loaded 35780 primary data records. [2025-10-21T22:15:26.387665] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:26.401024] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10652 primary records. [2025-10-21T22:15:26.401471] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-10-21T22:15:26.402095] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:26.403856] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 39841 primary records. [2025-10-21T22:15:26.404125] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-10-21T22:15:26.431180] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-10-21T22:15:26.432403] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-10-21T22:15:26.434523] [INFO ] [MAIN ] Derivative Progress: 1780/2057 symbols completed. TG took 1.1s. Estimated remaining: 1m 45s. Rate: 158.5 symbols/min [2025-10-21T22:15:26.436808] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:26.438007] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-10-21T22:15:26.438462] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-10-21T22:15:26.441368] [INFO ] [MAIN ] Derivative Progress: 1781/2057 symbols completed. TFPM took 1.2s. Estimated remaining: 1m 44s. Rate: 158.6 symbols/min [2025-10-21T22:15:26.441577] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:26.460418] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:26.461311] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 35780 primary records. [2025-10-21T22:15:26.461505] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-10-21T22:15:26.487181] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-10-21T22:15:26.487453] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-10-21T22:15:26.490805] [INFO ] [MAIN ] Derivative Progress: 1782/2057 symbols completed. TFX took 1.2s. Estimated remaining: 1m 44s. Rate: 158.6 symbols/min [2025-10-21T22:15:26.491148] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:26.503009] [DEBUG] [LOCAL ] TGLS: Loaded 27714 existing records from primary storage. [2025-10-21T22:15:26.512595] [INFO ] [MAIN ] TGLS: Loaded 27714 primary data records. [2025-10-21T22:15:26.656084] [DEBUG] [LOCAL ] TGNA: Loaded 48566 existing records from primary storage. [2025-10-21T22:15:26.667061] [INFO ] [MAIN ] TGNA: Loaded 48566 primary data records. [2025-10-21T22:15:26.896762] [DEBUG] [LOCAL ] TGS: Loaded 33875 existing records from primary storage. [2025-10-21T22:15:26.928088] [INFO ] [MAIN ] TGS: Loaded 33875 primary data records. [2025-10-21T22:15:27.459668] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:27.460565] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 27714 primary records. [2025-10-21T22:15:27.461617] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-10-21T22:15:27.478862] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-10-21T22:15:27.479294] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-10-21T22:15:27.481477] [INFO ] [MAIN ] Derivative Progress: 1783/2057 symbols completed. TGLS took 1.0s. Estimated remaining: 1m 44s. Rate: 158.5 symbols/min [2025-10-21T22:15:27.498368] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:27.499032] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48566 primary records. [2025-10-21T22:15:27.499172] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-10-21T22:15:27.515130] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-10-21T22:15:27.516534] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-10-21T22:15:27.519250] [INFO ] [MAIN ] Derivative Progress: 1784/2057 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 43s. Rate: 158.6 symbols/min [2025-10-21T22:15:27.532235] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:27.532984] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 33875 primary records. [2025-10-21T22:15:27.533050] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-10-21T22:15:27.548844] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-10-21T22:15:27.548945] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-10-21T22:15:27.551873] [INFO ] [MAIN ] Derivative Progress: 1785/2057 symbols completed. TGS took 1.1s. Estimated remaining: 1m 43s. Rate: 158.7 symbols/min [2025-10-21T22:15:27.552213] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:27.552537] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:27.552756] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:27.579255] [DEBUG] [LOCAL ] THG: Loaded 21609 existing records from primary storage. [2025-10-21T22:15:27.579387] [INFO ] [MAIN ] THG: Loaded 21609 primary data records. [2025-10-21T22:15:27.807171] [DEBUG] [LOCAL ] THC: Loaded 46709 existing records from primary storage. [2025-10-21T22:15:27.823196] [INFO ] [MAIN ] THC: Loaded 46709 primary data records. [2025-10-21T22:15:27.826699] [DEBUG] [LOCAL ] TGT: Loaded 53777 existing records from primary storage. [2025-10-21T22:15:27.990755] [INFO ] [MAIN ] TGT: Loaded 53777 primary data records. [2025-10-21T22:15:28.642445] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:28.643535] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 21609 primary records. [2025-10-21T22:15:28.643751] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-10-21T22:15:28.663730] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-10-21T22:15:28.663960] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-10-21T22:15:28.666056] [INFO ] [MAIN ] Derivative Progress: 1786/2057 symbols completed. THG took 1.1s. Estimated remaining: 1m 43s. Rate: 158.5 symbols/min [2025-10-21T22:15:28.666380] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:28.674446] [DEBUG] [LOCAL ] THIR: Loaded 2426 existing records from primary storage. [2025-10-21T22:15:28.675414] [INFO ] [MAIN ] THIR: Loaded 2426 primary data records. [2025-10-21T22:15:28.767336] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:28.784799] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 46709 primary records. [2025-10-21T22:15:28.814269] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:28.808673] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-10-21T22:15:28.820324] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53777 primary records. [2025-10-21T22:15:28.850102] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-10-21T22:15:29.029738] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-10-21T22:15:29.034953] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-10-21T22:15:29.035204] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-10-21T22:15:29.035276] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-10-21T22:15:29.037929] [INFO ] [MAIN ] Derivative Progress: 1787/2057 symbols completed. TGT took 1.5s. Estimated remaining: 1m 42s. Rate: 158.5 symbols/min [2025-10-21T22:15:29.040622] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:29.040727] [INFO ] [MAIN ] Derivative Progress: 1788/2057 symbols completed. THC took 1.5s. Estimated remaining: 1m 42s. Rate: 158.6 symbols/min [2025-10-21T22:15:29.040951] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:29.047125] [DEBUG] [LOCAL ] THLV: Loaded 1495 existing records from primary storage. [2025-10-21T22:15:29.047323] [INFO ] [MAIN ] THLV: Loaded 1495 primary data records. [2025-10-21T22:15:29.388320] [DEBUG] [LOCAL ] THO: Loaded 41053 existing records from primary storage. [2025-10-21T22:15:29.390108] [INFO ] [MAIN ] THO: Loaded 41053 primary data records. [2025-10-21T22:15:29.447279] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7829 incomplete bins [2025-10-21T22:15:29.506429] [INFO ] [MAIN ] THIR: Generated 1785 derivative records from 2426 primary records. [2025-10-21T22:15:29.509800] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-10-21T22:15:29.545502] [DEBUG] [LOCAL ] THIR: Derivative data saved (1785 records). [2025-10-21T22:15:29.581275] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-10-21T22:15:29.719422] [INFO ] [MAIN ] Derivative Progress: 1789/2057 symbols completed. THIR took 1.1s. Estimated remaining: 1m 41s. Rate: 158.5 symbols/min [2025-10-21T22:15:29.720032] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:29.742279] [DEBUG] [MAIN ] THLV: Filtered 7001 bins outside market hours, 7824 incomplete bins [2025-10-21T22:15:29.744070] [INFO ] [MAIN ] THLV: Generated 1790 derivative records from 1495 primary records. [2025-10-21T22:15:29.744371] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-10-21T22:15:29.766681] [DEBUG] [LOCAL ] THLV: Derivative data saved (1790 records). [2025-10-21T22:15:29.767113] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-10-21T22:15:29.769631] [INFO ] [MAIN ] Derivative Progress: 1790/2057 symbols completed. THLV took 0.7s. Estimated remaining: 1m 41s. Rate: 158.6 symbols/min [2025-10-21T22:15:29.770311] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:29.782941] [DEBUG] [LOCAL ] THQ: Loaded 25421 existing records from primary storage. [2025-10-21T22:15:29.783318] [INFO ] [MAIN ] THQ: Loaded 25421 primary data records. [2025-10-21T22:15:29.839065] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:29.859978] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 41053 primary records. [2025-10-21T22:15:29.860092] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-10-21T22:15:29.917496] [DEBUG] [LOCAL ] THR: Loaded 19653 existing records from primary storage. [2025-10-21T22:15:29.925576] [INFO ] [MAIN ] THR: Loaded 19653 primary data records. [2025-10-21T22:15:29.932337] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-10-21T22:15:29.932756] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-10-21T22:15:29.946167] [INFO ] [MAIN ] Derivative Progress: 1791/2057 symbols completed. THO took 0.9s. Estimated remaining: 1m 41s. Rate: 158.6 symbols/min [2025-10-21T22:15:29.961726] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:30.496033] [DEBUG] [LOCAL ] THS: Loaded 38685 existing records from primary storage. [2025-10-21T22:15:30.497025] [INFO ] [MAIN ] THS: Loaded 38685 primary data records. [2025-10-21T22:15:30.844359] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:30.846540] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 25421 primary records. [2025-10-21T22:15:30.848581] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-10-21T22:15:30.883330] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:30.883026] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-10-21T22:15:30.883718] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-10-21T22:15:30.884385] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 19653 primary records. [2025-10-21T22:15:30.886626] [INFO ] [MAIN ] Derivative Progress: 1792/2057 symbols completed. THQ took 1.2s. Estimated remaining: 1m 40s. Rate: 158.5 symbols/min [2025-10-21T22:15:30.886914] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-10-21T22:15:30.886841] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:30.903893] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-10-21T22:15:30.904141] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-10-21T22:15:30.906580] [INFO ] [MAIN ] Derivative Progress: 1793/2057 symbols completed. THR took 1.1s. Estimated remaining: 1m 40s. Rate: 158.6 symbols/min [2025-10-21T22:15:30.907108] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:30.930138] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:30.931023] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 38685 primary records. [2025-10-21T22:15:30.931197] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-10-21T22:15:30.950600] [DEBUG] [LOCAL ] THW: Loaded 19658 existing records from primary storage. [2025-10-21T22:15:30.955758] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-10-21T22:15:30.955956] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-10-21T22:15:30.955637] [INFO ] [MAIN ] THW: Loaded 19658 primary data records. [2025-10-21T22:15:30.958958] [INFO ] [MAIN ] Derivative Progress: 1794/2057 symbols completed. THS took 1.0s. Estimated remaining: 1m 39s. Rate: 158.7 symbols/min [2025-10-21T22:15:30.970737] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:31.099473] [DEBUG] [LOCAL ] TISI: Loaded 3247 existing records from primary storage. [2025-10-21T22:15:31.100606] [DEBUG] [LOCAL ] TIMB: Loaded 34863 existing records from primary storage. [2025-10-21T22:15:31.121301] [INFO ] [MAIN ] TIMB: Loaded 34863 primary data records. [2025-10-21T22:15:31.121416] [INFO ] [MAIN ] TISI: Loaded 3247 primary data records. [2025-10-21T22:15:32.050956] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:32.052475] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19658 primary records. [2025-10-21T22:15:32.052983] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-10-21T22:15:32.071750] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-10-21T22:15:32.072054] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-10-21T22:15:32.075046] [INFO ] [MAIN ] Derivative Progress: 1795/2057 symbols completed. THW took 1.2s. Estimated remaining: 1m 39s. Rate: 158.5 symbols/min [2025-10-21T22:15:32.076573] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:32.112019] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:32.113523] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 34863 primary records. [2025-10-21T22:15:32.114028] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-10-21T22:15:32.113821] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:32.115922] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3247 primary records. [2025-10-21T22:15:32.116414] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-10-21T22:15:32.142518] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-10-21T22:15:32.142751] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-10-21T22:15:32.146062] [INFO ] [MAIN ] Derivative Progress: 1796/2057 symbols completed. TIMB took 1.2s. Estimated remaining: 1m 39s. Rate: 158.6 symbols/min [2025-10-21T22:15:32.152511] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:32.162384] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-10-21T22:15:32.172686] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-10-21T22:15:32.173565] [DEBUG] [LOCAL ] TIXT: Loaded 32637 existing records from primary storage. [2025-10-21T22:15:32.177865] [INFO ] [MAIN ] TIXT: Loaded 32637 primary data records. [2025-10-21T22:15:32.177564] [INFO ] [MAIN ] Derivative Progress: 1797/2057 symbols completed. TISI took 1.2s. Estimated remaining: 1m 38s. Rate: 158.6 symbols/min [2025-10-21T22:15:32.178219] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:32.530892] [DEBUG] [LOCAL ] TJX: Loaded 53663 existing records from primary storage. [2025-10-21T22:15:32.531675] [INFO ] [MAIN ] TJX: Loaded 53663 primary data records. [2025-10-21T22:15:32.564319] [DEBUG] [LOCAL ] TK: Loaded 39169 existing records from primary storage. [2025-10-21T22:15:32.574074] [INFO ] [MAIN ] TK: Loaded 39169 primary data records. [2025-10-21T22:15:33.232796] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:33.235956] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 32637 primary records. [2025-10-21T22:15:33.236306] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-10-21T22:15:33.255976] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-10-21T22:15:33.256226] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-10-21T22:15:33.260213] [INFO ] [MAIN ] Derivative Progress: 1798/2057 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 38s. Rate: 158.5 symbols/min [2025-10-21T22:15:33.280790] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:33.281950] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53663 primary records. [2025-10-21T22:15:33.282172] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-10-21T22:15:33.302580] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-10-21T22:15:33.303420] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-10-21T22:15:33.306005] [INFO ] [MAIN ] Derivative Progress: 1799/2057 symbols completed. TJX took 1.2s. Estimated remaining: 1m 38s. Rate: 158.6 symbols/min [2025-10-21T22:15:33.319557] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:33.320550] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39169 primary records. [2025-10-21T22:15:33.320621] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-10-21T22:15:33.336926] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-10-21T22:15:33.337074] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-10-21T22:15:33.339689] [INFO ] [MAIN ] Derivative Progress: 1800/2057 symbols completed. TK took 1.2s. Estimated remaining: 1m 37s. Rate: 158.6 symbols/min [2025-10-21T22:15:33.340123] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:33.340263] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:33.341137] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:33.394949] [DEBUG] [LOCAL ] TKR: Loaded 39382 existing records from primary storage. [2025-10-21T22:15:33.395158] [INFO ] [MAIN ] TKR: Loaded 39382 primary data records. [2025-10-21T22:15:33.484125] [DEBUG] [LOCAL ] TKC: Loaded 39988 existing records from primary storage. [2025-10-21T22:15:33.489513] [INFO ] [MAIN ] TKC: Loaded 39988 primary data records. [2025-10-21T22:15:33.570946] [DEBUG] [LOCAL ] TKO: Loaded 43540 existing records from primary storage. [2025-10-21T22:15:33.571073] [INFO ] [MAIN ] TKO: Loaded 43540 primary data records. [2025-10-21T22:15:34.432041] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:34.435498] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 39382 primary records. [2025-10-21T22:15:34.437399] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-10-21T22:15:34.494854] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:34.496300] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-10-21T22:15:34.497455] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 43540 primary records. [2025-10-21T22:15:34.497573] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-10-21T22:15:34.499908] [INFO ] [MAIN ] Derivative Progress: 1801/2057 symbols completed. TKR took 1.2s. Estimated remaining: 1m 37s. Rate: 158.5 symbols/min [2025-10-21T22:15:34.497822] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-10-21T22:15:34.500149] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:34.501736] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:34.503008] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 39988 primary records. [2025-10-21T22:15:34.503222] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-10-21T22:15:34.537869] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-10-21T22:15:34.542899] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-10-21T22:15:34.544508] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-10-21T22:15:34.548163] [INFO ] [MAIN ] Derivative Progress: 1802/2057 symbols completed. TKO took 1.2s. Estimated remaining: 1m 37s. Rate: 158.5 symbols/min [2025-10-21T22:15:34.548429] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:34.548566] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-10-21T22:15:34.552271] [INFO ] [MAIN ] Derivative Progress: 1803/2057 symbols completed. TKC took 1.2s. Estimated remaining: 1m 36s. Rate: 158.6 symbols/min [2025-10-21T22:15:34.552974] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:34.581032] [DEBUG] [LOCAL ] TLYS: Loaded 16514 existing records from primary storage. [2025-10-21T22:15:34.581234] [INFO ] [MAIN ] TLYS: Loaded 16514 primary data records. [2025-10-21T22:15:34.698210] [DEBUG] [LOCAL ] TLK: Loaded 38728 existing records from primary storage. [2025-10-21T22:15:34.707997] [INFO ] [MAIN ] TLK: Loaded 38728 primary data records. [2025-10-21T22:15:34.894926] [DEBUG] [LOCAL ] TM: Loaded 36158 existing records from primary storage. [2025-10-21T22:15:35.012421] [INFO ] [MAIN ] TM: Loaded 36158 primary data records. [2025-10-21T22:15:35.552851] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:35.554600] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 16514 primary records. [2025-10-21T22:15:35.554828] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-10-21T22:15:35.578108] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-10-21T22:15:35.578449] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-10-21T22:15:35.580828] [INFO ] [MAIN ] Derivative Progress: 1804/2057 symbols completed. TLYS took 1.0s. Estimated remaining: 1m 36s. Rate: 158.5 symbols/min [2025-10-21T22:15:35.595017] [DEBUG] [MAIN ] TLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:35.596063] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 38728 primary records. [2025-10-21T22:15:35.594439] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:35.596290] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-10-21T22:15:35.630141] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-10-21T22:15:35.627894] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:35.632697] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-10-21T22:15:35.635900] [INFO ] [MAIN ] Derivative Progress: 1805/2057 symbols completed. TLK took 1.1s. Estimated remaining: 1m 35s. Rate: 158.5 symbols/min [2025-10-21T22:15:35.633401] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 36158 primary records. [2025-10-21T22:15:35.636218] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-10-21T22:15:35.636806] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:35.653804] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-10-21T22:15:35.654170] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-10-21T22:15:35.656676] [INFO ] [MAIN ] Derivative Progress: 1806/2057 symbols completed. TM took 1.1s. Estimated remaining: 1m 35s. Rate: 158.6 symbols/min [2025-10-21T22:15:35.656942] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:35.709828] [DEBUG] [LOCAL ] TME: Loaded 53206 existing records from primary storage. [2025-10-21T22:15:35.710144] [INFO ] [MAIN ] TME: Loaded 53206 primary data records. [2025-10-21T22:15:35.849601] [DEBUG] [LOCAL ] TMHC: Loaded 45654 existing records from primary storage. [2025-10-21T22:15:35.855365] [INFO ] [MAIN ] TMHC: Loaded 45654 primary data records. [2025-10-21T22:15:35.962917] [DEBUG] [LOCAL ] TMO: Loaded 52404 existing records from primary storage. [2025-10-21T22:15:35.971960] [INFO ] [MAIN ] TMO: Loaded 52404 primary data records. [2025-10-21T22:15:36.770266] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:36.771482] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53206 primary records. [2025-10-21T22:15:36.771855] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-10-21T22:15:36.790858] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-10-21T22:15:36.798788] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-10-21T22:15:36.800626] [INFO ] [MAIN ] Derivative Progress: 1807/2057 symbols completed. TME took 1.2s. Estimated remaining: 1m 35s. Rate: 158.5 symbols/min [2025-10-21T22:15:36.805947] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:36.806449] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:36.807294] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45654 primary records. [2025-10-21T22:15:36.807701] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-10-21T22:15:36.826061] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-10-21T22:15:36.826210] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-10-21T22:15:36.828947] [INFO ] [MAIN ] Derivative Progress: 1808/2057 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 34s. Rate: 158.5 symbols/min [2025-10-21T22:15:36.829214] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:36.846082] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:36.846876] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52404 primary records. [2025-10-21T22:15:36.846953] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-10-21T22:15:36.868637] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-10-21T22:15:36.868770] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-10-21T22:15:36.873299] [INFO ] [MAIN ] Derivative Progress: 1809/2057 symbols completed. TMO took 1.2s. Estimated remaining: 1m 34s. Rate: 158.6 symbols/min [2025-10-21T22:15:36.869105] [DEBUG] [LOCAL ] TNC: Loaded 14293 existing records from primary storage. [2025-10-21T22:15:36.873584] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:36.874175] [INFO ] [MAIN ] TNC: Loaded 14293 primary data records. [2025-10-21T22:15:37.070536] [DEBUG] [LOCAL ] TNET: Loaded 28267 existing records from primary storage. [2025-10-21T22:15:37.191500] [INFO ] [MAIN ] TNET: Loaded 28267 primary data records. [2025-10-21T22:15:37.314464] [DEBUG] [LOCAL ] TNK: Loaded 35374 existing records from primary storage. [2025-10-21T22:15:37.326005] [INFO ] [MAIN ] TNK: Loaded 35374 primary data records. [2025-10-21T22:15:37.866310] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:37.868626] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 14293 primary records. [2025-10-21T22:15:37.869060] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-10-21T22:15:37.892074] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-10-21T22:15:37.892560] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-10-21T22:15:37.895431] [INFO ] [MAIN ] Derivative Progress: 1810/2057 symbols completed. TNC took 1.1s. Estimated remaining: 1m 34s. Rate: 158.5 symbols/min [2025-10-21T22:15:37.896209] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:37.916197] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:37.917019] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 28267 primary records. [2025-10-21T22:15:37.917334] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-10-21T22:15:37.937466] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-10-21T22:15:37.937853] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-10-21T22:15:37.940486] [INFO ] [MAIN ] Derivative Progress: 1811/2057 symbols completed. TNET took 1.1s. Estimated remaining: 1m 33s. Rate: 158.5 symbols/min [2025-10-21T22:15:37.940760] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:37.954499] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:37.964808] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35374 primary records. [2025-10-21T22:15:37.965000] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-10-21T22:15:37.994279] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-10-21T22:15:37.995436] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-10-21T22:15:37.998143] [INFO ] [MAIN ] Derivative Progress: 1812/2057 symbols completed. TNK took 1.1s. Estimated remaining: 1m 33s. Rate: 158.6 symbols/min [2025-10-21T22:15:37.999244] [DEBUG] [LOCAL ] TNL: Loaded 41725 existing records from primary storage. [2025-10-21T22:15:37.999421] [INFO ] [MAIN ] TNL: Loaded 41725 primary data records. [2025-10-21T22:15:37.999524] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:38.234202] [DEBUG] [LOCAL ] TOL: Loaded 50598 existing records from primary storage. [2025-10-21T22:15:38.398625] [INFO ] [MAIN ] TOL: Loaded 50598 primary data records. [2025-10-21T22:15:38.533510] [DEBUG] [LOCAL ] TOST: Loaded 53690 existing records from primary storage. [2025-10-21T22:15:38.557242] [INFO ] [MAIN ] TOST: Loaded 53690 primary data records. [2025-10-21T22:15:38.973905] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:38.997986] [INFO ] [MAIN ] TNL: Generated 1793 derivative records from 41725 primary records. [2025-10-21T22:15:39.001417] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-10-21T22:15:39.137741] [DEBUG] [LOCAL ] TNL: Derivative data saved (1793 records). [2025-10-21T22:15:39.138394] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-10-21T22:15:39.141849] [INFO ] [MAIN ] Derivative Progress: 1813/2057 symbols completed. TNL took 1.2s. Estimated remaining: 1m 32s. Rate: 158.4 symbols/min [2025-10-21T22:15:39.170486] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:39.171714] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 50598 primary records. [2025-10-21T22:15:39.171966] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-10-21T22:15:39.195497] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-10-21T22:15:39.195792] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-10-21T22:15:39.198713] [INFO ] [MAIN ] Derivative Progress: 1814/2057 symbols completed. TOL took 1.3s. Estimated remaining: 1m 32s. Rate: 158.5 symbols/min [2025-10-21T22:15:39.212036] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:39.212630] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53690 primary records. [2025-10-21T22:15:39.212728] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-10-21T22:15:39.228097] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-10-21T22:15:39.228191] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-10-21T22:15:39.231170] [INFO ] [MAIN ] Derivative Progress: 1815/2057 symbols completed. TOST took 1.2s. Estimated remaining: 1m 32s. Rate: 158.6 symbols/min [2025-10-21T22:15:39.231930] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:39.231990] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:39.231823] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:39.262972] [DEBUG] [LOCAL ] TPB: Loaded 26263 existing records from primary storage. [2025-10-21T22:15:39.274034] [INFO ] [MAIN ] TPB: Loaded 26263 primary data records. [2025-10-21T22:15:39.429231] [DEBUG] [LOCAL ] TPC: Loaded 39129 existing records from primary storage. [2025-10-21T22:15:39.462281] [DEBUG] [LOCAL ] TPH: Loaded 44813 existing records from primary storage. [2025-10-21T22:15:39.482636] [INFO ] [MAIN ] TPC: Loaded 39129 primary data records. [2025-10-21T22:15:39.649162] [INFO ] [MAIN ] TPH: Loaded 44813 primary data records. [2025-10-21T22:15:40.293905] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:40.295175] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 26263 primary records. [2025-10-21T22:15:40.295282] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-10-21T22:15:40.312386] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-10-21T22:15:40.313305] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-10-21T22:15:40.315340] [INFO ] [MAIN ] Derivative Progress: 1816/2057 symbols completed. TPB took 1.1s. Estimated remaining: 1m 31s. Rate: 158.4 symbols/min [2025-10-21T22:15:40.315493] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:40.348452] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:40.358500] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 39129 primary records. [2025-10-21T22:15:40.358609] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-10-21T22:15:40.358956] [DEBUG] [LOCAL ] TPL: Loaded 12355 existing records from primary storage. [2025-10-21T22:15:40.359812] [INFO ] [MAIN ] TPL: Loaded 12355 primary data records. [2025-10-21T22:15:40.359308] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:40.388473] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 44813 primary records. [2025-10-21T22:15:40.392049] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-10-21T22:15:40.418874] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-10-21T22:15:40.438231] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-10-21T22:15:40.453234] [INFO ] [MAIN ] Derivative Progress: 1817/2057 symbols completed. TPC took 1.2s. Estimated remaining: 1m 31s. Rate: 158.5 symbols/min [2025-10-21T22:15:40.456364] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:40.470400] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-10-21T22:15:40.475629] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-10-21T22:15:40.489176] [INFO ] [MAIN ] Derivative Progress: 1818/2057 symbols completed. TPH took 1.3s. Estimated remaining: 1m 30s. Rate: 158.6 symbols/min [2025-10-21T22:15:40.497092] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:40.746389] [DEBUG] [LOCAL ] TPVG: Loaded 27256 existing records from primary storage. [2025-10-21T22:15:40.746792] [INFO ] [MAIN ] TPVG: Loaded 27256 primary data records. [2025-10-21T22:15:40.905278] [DEBUG] [LOCAL ] TPR: Loaded 53367 existing records from primary storage. [2025-10-21T22:15:40.928375] [INFO ] [MAIN ] TPR: Loaded 53367 primary data records. [2025-10-21T22:15:41.202039] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:41.206704] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12355 primary records. [2025-10-21T22:15:41.207118] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-10-21T22:15:41.302889] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-10-21T22:15:41.303128] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-10-21T22:15:41.417160] [INFO ] [MAIN ] Derivative Progress: 1819/2057 symbols completed. TPL took 1.1s. Estimated remaining: 1m 30s. Rate: 158.4 symbols/min [2025-10-21T22:15:41.427246] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:41.446903] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:41.448073] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27256 primary records. [2025-10-21T22:15:41.448365] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-10-21T22:15:41.452530] [DEBUG] [LOCAL ] TPYP: Loaded 7931 existing records from primary storage. [2025-10-21T22:15:41.452873] [INFO ] [MAIN ] TPYP: Loaded 7931 primary data records. [2025-10-21T22:15:41.584587] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-10-21T22:15:41.595521] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-10-21T22:15:41.614371] [INFO ] [MAIN ] Derivative Progress: 1820/2057 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 30s. Rate: 158.5 symbols/min [2025-10-21T22:15:41.636321] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:41.814115] [DEBUG] [LOCAL ] TPZ: Loaded 4643 existing records from primary storage. [2025-10-21T22:15:41.814267] [INFO ] [MAIN ] TPZ: Loaded 4643 primary data records. [2025-10-21T22:15:41.813902] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:41.815282] [INFO ] [MAIN ] TPR: Generated 1793 derivative records from 53367 primary records. [2025-10-21T22:15:41.815381] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-10-21T22:15:41.959202] [DEBUG] [LOCAL ] TPR: Derivative data saved (1793 records). [2025-10-21T22:15:41.983820] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-10-21T22:15:42.007545] [INFO ] [MAIN ] Derivative Progress: 1821/2057 symbols completed. TPR took 1.6s. Estimated remaining: 1m 29s. Rate: 158.5 symbols/min [2025-10-21T22:15:42.024038] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:42.166888] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:42.168212] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7931 primary records. [2025-10-21T22:15:42.168721] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-10-21T22:15:42.191973] [DEBUG] [LOCAL ] TR: Loaded 19126 existing records from primary storage. [2025-10-21T22:15:42.191560] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-10-21T22:15:42.192187] [INFO ] [MAIN ] TR: Loaded 19126 primary data records. [2025-10-21T22:15:42.192283] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-10-21T22:15:42.195069] [INFO ] [MAIN ] Derivative Progress: 1822/2057 symbols completed. TPYP took 0.8s. Estimated remaining: 1m 29s. Rate: 158.5 symbols/min [2025-10-21T22:15:42.195373] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:42.359163] [DEBUG] [LOCAL ] TRAK: Loaded 9636 existing records from primary storage. [2025-10-21T22:15:42.383110] [INFO ] [MAIN ] TRAK: Loaded 9636 primary data records. [2025-10-21T22:15:42.661454] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:42.678116] [INFO ] [MAIN ] TPZ: Generated 1794 derivative records from 4643 primary records. [2025-10-21T22:15:42.683410] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-10-21T22:15:42.871732] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1794 records). [2025-10-21T22:15:42.873354] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-10-21T22:15:42.876102] [INFO ] [MAIN ] Derivative Progress: 1823/2057 symbols completed. TPZ took 1.2s. Estimated remaining: 1m 29s. Rate: 158.4 symbols/min [2025-10-21T22:15:42.876724] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:42.896797] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:42.902046] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 19126 primary records. [2025-10-21T22:15:42.902250] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-10-21T22:15:42.922054] [DEBUG] [LOCAL ] TRC: Loaded 15460 existing records from primary storage. [2025-10-21T22:15:42.925028] [INFO ] [MAIN ] TRC: Loaded 15460 primary data records. [2025-10-21T22:15:42.924872] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-10-21T22:15:42.937155] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-10-21T22:15:42.958773] [INFO ] [MAIN ] Derivative Progress: 1824/2057 symbols completed. TR took 0.9s. Estimated remaining: 1m 28s. Rate: 158.5 symbols/min [2025-10-21T22:15:42.964795] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:43.074989] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:43.124261] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9636 primary records. [2025-10-21T22:15:43.235238] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-10-21T22:15:43.279907] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-10-21T22:15:43.281155] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-10-21T22:15:43.284767] [INFO ] [MAIN ] Derivative Progress: 1825/2057 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 28s. Rate: 158.5 symbols/min [2025-10-21T22:15:43.298724] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:43.301390] [DEBUG] [LOCAL ] TREX: Loaded 49829 existing records from primary storage. [2025-10-21T22:15:43.301544] [INFO ] [MAIN ] TREX: Loaded 49829 primary data records. [2025-10-21T22:15:43.637058] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:43.638676] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15460 primary records. [2025-10-21T22:15:43.638754] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-10-21T22:15:43.656873] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-10-21T22:15:43.657074] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-10-21T22:15:43.660851] [INFO ] [MAIN ] Derivative Progress: 1826/2057 symbols completed. TRC took 0.8s. Estimated remaining: 1m 27s. Rate: 158.5 symbols/min [2025-10-21T22:15:43.661562] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:43.678084] [DEBUG] [LOCAL ] TRGP: Loaded 50756 existing records from primary storage. [2025-10-21T22:15:43.679573] [INFO ] [MAIN ] TRGP: Loaded 50756 primary data records. [2025-10-21T22:15:44.013867] [DEBUG] [LOCAL ] TRN: Loaded 36427 existing records from primary storage. [2025-10-21T22:15:44.028231] [INFO ] [MAIN ] TRN: Loaded 36427 primary data records. [2025-10-21T22:15:44.028628] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:44.044056] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49829 primary records. [2025-10-21T22:15:44.044569] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-10-21T22:15:44.166094] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-10-21T22:15:44.167056] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-10-21T22:15:44.174608] [INFO ] [MAIN ] Derivative Progress: 1827/2057 symbols completed. TREX took 1.2s. Estimated remaining: 1m 27s. Rate: 158.5 symbols/min [2025-10-21T22:15:44.180164] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:44.431430] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:44.433186] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50756 primary records. [2025-10-21T22:15:44.433590] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-10-21T22:15:44.464591] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-10-21T22:15:44.477161] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-10-21T22:15:44.482612] [DEBUG] [LOCAL ] TRNO: Loaded 43765 existing records from primary storage. [2025-10-21T22:15:44.480932] [INFO ] [MAIN ] Derivative Progress: 1828/2057 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 27s. Rate: 158.5 symbols/min [2025-10-21T22:15:44.483177] [INFO ] [MAIN ] TRNO: Loaded 43765 primary data records. [2025-10-21T22:15:44.701884] [DEBUG] [MAIN ] TRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:44.788404] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 36427 primary records. [2025-10-21T22:15:44.788933] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-10-21T22:15:44.809390] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-10-21T22:15:44.809964] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-10-21T22:15:44.812582] [INFO ] [MAIN ] Derivative Progress: 1829/2057 symbols completed. TRN took 1.2s. Estimated remaining: 1m 26s. Rate: 158.5 symbols/min [2025-10-21T22:15:44.832974] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:44.833543] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 43765 primary records. [2025-10-21T22:15:44.833605] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-10-21T22:15:44.848486] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-10-21T22:15:44.848543] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-10-21T22:15:44.850763] [INFO ] [MAIN ] Derivative Progress: 1830/2057 symbols completed. TRNO took 0.7s. Estimated remaining: 1m 26s. Rate: 158.6 symbols/min [2025-10-21T22:15:44.851345] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:44.851444] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:44.851229] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:44.917238] [DEBUG] [LOCAL ] TRTX: Loaded 37056 existing records from primary storage. [2025-10-21T22:15:44.917368] [INFO ] [MAIN ] TRTX: Loaded 37056 primary data records. [2025-10-21T22:15:45.068819] [DEBUG] [LOCAL ] TROX: Loaded 52247 existing records from primary storage. [2025-10-21T22:15:45.102116] [DEBUG] [LOCAL ] TRP: Loaded 52128 existing records from primary storage. [2025-10-21T22:15:45.126105] [INFO ] [MAIN ] TRP: Loaded 52128 primary data records. [2025-10-21T22:15:45.101305] [INFO ] [MAIN ] TROX: Loaded 52247 primary data records. [2025-10-21T22:15:45.905943] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:45.906951] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37056 primary records. [2025-10-21T22:15:45.907475] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-10-21T22:15:45.925427] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-10-21T22:15:45.925527] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-10-21T22:15:45.927266] [INFO ] [MAIN ] Derivative Progress: 1831/2057 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 26s. Rate: 158.4 symbols/min [2025-10-21T22:15:45.927501] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:45.946870] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:45.949081] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52128 primary records. [2025-10-21T22:15:45.949290] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-10-21T22:15:45.971011] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:45.977453] [INFO ] [MAIN ] TROX: Generated 1793 derivative records from 52247 primary records. [2025-10-21T22:15:45.977840] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-10-21T22:15:45.987064] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-10-21T22:15:45.987258] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-10-21T22:15:45.991832] [INFO ] [MAIN ] Derivative Progress: 1832/2057 symbols completed. TRP took 1.1s. Estimated remaining: 1m 25s. Rate: 158.5 symbols/min [2025-10-21T22:15:45.994712] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:45.996627] [DEBUG] [LOCAL ] TROX: Derivative data saved (1793 records). [2025-10-21T22:15:45.996723] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-10-21T22:15:45.999563] [INFO ] [MAIN ] Derivative Progress: 1833/2057 symbols completed. TROX took 1.1s. Estimated remaining: 1m 25s. Rate: 158.6 symbols/min [2025-10-21T22:15:45.999928] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:46.036183] [DEBUG] [LOCAL ] TRU: Loaded 51460 existing records from primary storage. [2025-10-21T22:15:46.036527] [INFO ] [MAIN ] TRU: Loaded 51460 primary data records. [2025-10-21T22:15:46.361819] [DEBUG] [LOCAL ] TS: Loaded 51660 existing records from primary storage. [2025-10-21T22:15:46.370563] [INFO ] [MAIN ] TS: Loaded 51660 primary data records. [2025-10-21T22:15:46.442858] [DEBUG] [LOCAL ] TRV: Loaded 47486 existing records from primary storage. [2025-10-21T22:15:46.460316] [INFO ] [MAIN ] TRV: Loaded 47486 primary data records. [2025-10-21T22:15:47.071592] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:47.073246] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51460 primary records. [2025-10-21T22:15:47.073426] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-10-21T22:15:47.092277] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-10-21T22:15:47.093794] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-10-21T22:15:47.095965] [INFO ] [MAIN ] Derivative Progress: 1834/2057 symbols completed. TRU took 1.2s. Estimated remaining: 1m 24s. Rate: 158.4 symbols/min [2025-10-21T22:15:47.096741] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:47.110792] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:47.111578] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51660 primary records. [2025-10-21T22:15:47.111859] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-10-21T22:15:47.128440] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-10-21T22:15:47.128932] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-10-21T22:15:47.131237] [INFO ] [MAIN ] Derivative Progress: 1835/2057 symbols completed. TS took 1.1s. Estimated remaining: 1m 24s. Rate: 158.5 symbols/min [2025-10-21T22:15:47.131469] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:47.167805] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:47.173120] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 47486 primary records. [2025-10-21T22:15:47.173528] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-10-21T22:15:47.174070] [DEBUG] [LOCAL ] TSE: Loaded 27688 existing records from primary storage. [2025-10-21T22:15:47.173381] [DEBUG] [LOCAL ] TSI: Loaded 8226 existing records from primary storage. [2025-10-21T22:15:47.174599] [INFO ] [MAIN ] TSI: Loaded 8226 primary data records. [2025-10-21T22:15:47.175253] [INFO ] [MAIN ] TSE: Loaded 27688 primary data records. [2025-10-21T22:15:47.281524] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-10-21T22:15:47.299766] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-10-21T22:15:47.363486] [INFO ] [MAIN ] Derivative Progress: 1836/2057 symbols completed. TRV took 1.4s. Estimated remaining: 1m 24s. Rate: 158.5 symbols/min [2025-10-21T22:15:47.373954] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:47.839352] [DEBUG] [LOCAL ] TSLX: Loaded 35822 existing records from primary storage. [2025-10-21T22:15:47.840674] [INFO ] [MAIN ] TSLX: Loaded 35822 primary data records. [2025-10-21T22:15:48.203273] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:48.204077] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 8226 primary records. [2025-10-21T22:15:48.204169] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-10-21T22:15:48.229208] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:15:48.232886] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-10-21T22:15:48.234099] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-10-21T22:15:48.234781] [INFO ] [MAIN ] TSE: Generated 1793 derivative records from 27688 primary records. [2025-10-21T22:15:48.235372] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-10-21T22:15:48.238628] [INFO ] [MAIN ] Derivative Progress: 1837/2057 symbols completed. TSI took 1.1s. Estimated remaining: 1m 23s. Rate: 158.4 symbols/min [2025-10-21T22:15:48.245595] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:48.254502] [DEBUG] [LOCAL ] TSE: Derivative data saved (1793 records). [2025-10-21T22:15:48.254872] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-10-21T22:15:48.256956] [INFO ] [MAIN ] Derivative Progress: 1838/2057 symbols completed. TSE took 1.2s. Estimated remaining: 1m 23s. Rate: 158.5 symbols/min [2025-10-21T22:15:48.257111] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:48.280456] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:48.281580] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35822 primary records. [2025-10-21T22:15:48.281665] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-10-21T22:15:48.298572] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-10-21T22:15:48.298910] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-10-21T22:15:48.302094] [INFO ] [MAIN ] Derivative Progress: 1839/2057 symbols completed. TSLX took 0.9s. Estimated remaining: 1m 22s. Rate: 158.6 symbols/min [2025-10-21T22:15:48.316125] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:48.351509] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-10-21T22:15:48.352157] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-10-21T22:15:48.357879] [DEBUG] [LOCAL ] TSQ: Loaded 11587 existing records from primary storage. [2025-10-21T22:15:48.394795] [INFO ] [MAIN ] TSQ: Loaded 11587 primary data records. [2025-10-21T22:15:48.425317] [DEBUG] [LOCAL ] TSN: Loaded 53088 existing records from primary storage. [2025-10-21T22:15:48.476226] [INFO ] [MAIN ] TSN: Loaded 53088 primary data records. [2025-10-21T22:15:49.343189] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:49.344453] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-10-21T22:15:49.345047] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-10-21T22:15:49.365314] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-10-21T22:15:49.365523] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-10-21T22:15:49.367411] [INFO ] [MAIN ] Derivative Progress: 1840/2057 symbols completed. TSM took 1.1s. Estimated remaining: 1m 22s. Rate: 158.4 symbols/min [2025-10-21T22:15:49.392283] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:49.392169] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:49.392551] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:49.393500] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 53088 primary records. [2025-10-21T22:15:49.394836] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 11587 primary records. [2025-10-21T22:15:49.394944] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-10-21T22:15:49.395008] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-10-21T22:15:49.422252] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-10-21T22:15:49.422892] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-10-21T22:15:49.426699] [INFO ] [MAIN ] Derivative Progress: 1841/2057 symbols completed. TSN took 1.2s. Estimated remaining: 1m 22s. Rate: 158.5 symbols/min [2025-10-21T22:15:49.426933] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:49.429731] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-10-21T22:15:49.430115] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-10-21T22:15:49.432464] [INFO ] [MAIN ] Derivative Progress: 1842/2057 symbols completed. TSQ took 1.1s. Estimated remaining: 1m 21s. Rate: 158.6 symbols/min [2025-10-21T22:15:49.432787] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:49.477943] [DEBUG] [LOCAL ] TT: Loaded 47010 existing records from primary storage. [2025-10-21T22:15:49.490460] [INFO ] [MAIN ] TT: Loaded 47010 primary data records. [2025-10-21T22:15:49.502461] [DEBUG] [LOCAL ] TTC: Loaded 41627 existing records from primary storage. [2025-10-21T22:15:49.522285] [INFO ] [MAIN ] TTC: Loaded 41627 primary data records. [2025-10-21T22:15:49.849885] [DEBUG] [LOCAL ] TTE: Loaded 51560 existing records from primary storage. [2025-10-21T22:15:49.858535] [INFO ] [MAIN ] TTE: Loaded 51560 primary data records. [2025-10-21T22:15:50.491720] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:50.500391] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 47010 primary records. [2025-10-21T22:15:50.505525] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:50.505732] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-10-21T22:15:50.507258] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 41627 primary records. [2025-10-21T22:15:50.508434] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-10-21T22:15:50.540372] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-10-21T22:15:50.540582] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-10-21T22:15:50.543231] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-10-21T22:15:50.543462] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-10-21T22:15:50.543007] [INFO ] [MAIN ] Derivative Progress: 1843/2057 symbols completed. TT took 1.2s. Estimated remaining: 1m 21s. Rate: 158.4 symbols/min [2025-10-21T22:15:50.545907] [INFO ] [MAIN ] Derivative Progress: 1844/2057 symbols completed. TTC took 1.1s. Estimated remaining: 1m 21s. Rate: 158.5 symbols/min [2025-10-21T22:15:50.562069] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:50.562594] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51560 primary records. [2025-10-21T22:15:50.562675] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-10-21T22:15:50.577321] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-10-21T22:15:50.577376] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-10-21T22:15:50.580858] [INFO ] [MAIN ] Derivative Progress: 1845/2057 symbols completed. TTE took 1.1s. Estimated remaining: 1m 20s. Rate: 158.6 symbols/min [2025-10-21T22:15:50.581383] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:50.581296] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:50.581515] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:50.645011] [DEBUG] [LOCAL ] TUYA: Loaded 45890 existing records from primary storage. [2025-10-21T22:15:50.659415] [INFO ] [MAIN ] TUYA: Loaded 45890 primary data records. [2025-10-21T22:15:50.681703] [DEBUG] [LOCAL ] TTI: Loaded 46631 existing records from primary storage. [2025-10-21T22:15:50.698075] [INFO ] [MAIN ] TTI: Loaded 46631 primary data records. [2025-10-21T22:15:50.834773] [DEBUG] [LOCAL ] TU: Loaded 49803 existing records from primary storage. [2025-10-21T22:15:50.847716] [INFO ] [MAIN ] TU: Loaded 49803 primary data records. [2025-10-21T22:15:51.592965] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:51.592732] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:51.594452] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 46631 primary records. [2025-10-21T22:15:51.593814] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 45890 primary records. [2025-10-21T22:15:51.595284] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-10-21T22:15:51.595954] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-10-21T22:15:51.633485] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:51.612560] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-10-21T22:15:51.640011] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-10-21T22:15:51.640949] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-10-21T22:15:51.640854] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49803 primary records. [2025-10-21T22:15:51.642783] [INFO ] [MAIN ] Derivative Progress: 1846/2057 symbols completed. TTI took 1.1s. Estimated remaining: 1m 20s. Rate: 158.4 symbols/min [2025-10-21T22:15:51.643052] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:51.643207] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-10-21T22:15:51.642872] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-10-21T22:15:51.646290] [INFO ] [MAIN ] Derivative Progress: 1847/2057 symbols completed. TUYA took 1.1s. Estimated remaining: 1m 19s. Rate: 158.5 symbols/min [2025-10-21T22:15:51.646936] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:51.663157] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-10-21T22:15:51.664161] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-10-21T22:15:51.666904] [INFO ] [MAIN ] Derivative Progress: 1848/2057 symbols completed. TU took 1.1s. Estimated remaining: 1m 19s. Rate: 158.6 symbols/min [2025-10-21T22:15:51.667109] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:51.669883] [DEBUG] [LOCAL ] TVC: Loaded 3141 existing records from primary storage. [2025-10-21T22:15:51.670144] [INFO ] [MAIN ] TVC: Loaded 3141 primary data records. [2025-10-21T22:15:51.765903] [DEBUG] [LOCAL ] TVE: Loaded 2575 existing records from primary storage. [2025-10-21T22:15:51.771191] [INFO ] [MAIN ] TVE: Loaded 2575 primary data records. [2025-10-21T22:15:51.930674] [DEBUG] [LOCAL ] TV: Loaded 41369 existing records from primary storage. [2025-10-21T22:15:52.007193] [INFO ] [MAIN ] TV: Loaded 41369 primary data records. [2025-10-21T22:15:52.728957] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:52.731053] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3141 primary records. [2025-10-21T22:15:52.730190] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:52.731185] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-10-21T22:15:52.733481] [INFO ] [MAIN ] TVE: Generated 1794 derivative records from 2575 primary records. [2025-10-21T22:15:52.733599] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-10-21T22:15:52.749221] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-10-21T22:15:52.749371] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-10-21T22:15:52.757844] [INFO ] [MAIN ] Derivative Progress: 1849/2057 symbols completed. TVC took 1.1s. Estimated remaining: 1m 19s. Rate: 158.4 symbols/min [2025-10-21T22:15:52.764930] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:52.765412] [DEBUG] [LOCAL ] TVE: Derivative data saved (1794 records). [2025-10-21T22:15:52.765809] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-10-21T22:15:52.768368] [INFO ] [MAIN ] Derivative Progress: 1850/2057 symbols completed. TVE took 1.1s. Estimated remaining: 1m 18s. Rate: 158.5 symbols/min [2025-10-21T22:15:52.769059] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:52.788192] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:52.789297] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 41369 primary records. [2025-10-21T22:15:52.789382] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-10-21T22:15:52.806088] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-10-21T22:15:52.806337] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-10-21T22:15:52.811047] [INFO ] [MAIN ] Derivative Progress: 1851/2057 symbols completed. TV took 1.2s. Estimated remaining: 1m 18s. Rate: 158.6 symbols/min [2025-10-21T22:15:52.811551] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:52.827300] [DEBUG] [LOCAL ] TWN: Loaded 3232 existing records from primary storage. [2025-10-21T22:15:52.827726] [INFO ] [MAIN ] TWN: Loaded 3232 primary data records. [2025-10-21T22:15:52.896037] [DEBUG] [LOCAL ] TWI: Loaded 33883 existing records from primary storage. [2025-10-21T22:15:52.916990] [INFO ] [MAIN ] TWI: Loaded 33883 primary data records. [2025-10-21T22:15:53.071512] [DEBUG] [LOCAL ] TWLO: Loaded 52824 existing records from primary storage. [2025-10-21T22:15:53.123118] [INFO ] [MAIN ] TWLO: Loaded 52824 primary data records. [2025-10-21T22:15:53.814712] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:53.817615] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3232 primary records. [2025-10-21T22:15:53.817801] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-10-21T22:15:53.839391] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:53.847091] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-10-21T22:15:53.848105] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 33883 primary records. [2025-10-21T22:15:53.847284] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-10-21T22:15:53.848276] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-10-21T22:15:53.860917] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:53.862361] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52824 primary records. [2025-10-21T22:15:53.862674] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-10-21T22:15:53.871801] [INFO ] [MAIN ] Derivative Progress: 1852/2057 symbols completed. TWN took 1.1s. Estimated remaining: 1m 18s. Rate: 158.4 symbols/min [2025-10-21T22:15:53.872005] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:53.880758] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-10-21T22:15:53.889168] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-10-21T22:15:53.894387] [INFO ] [MAIN ] Derivative Progress: 1853/2057 symbols completed. TWI took 1.1s. Estimated remaining: 1m 17s. Rate: 158.5 symbols/min [2025-10-21T22:15:53.894872] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:53.899493] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-10-21T22:15:53.899557] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-10-21T22:15:53.902146] [INFO ] [MAIN ] Derivative Progress: 1854/2057 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 17s. Rate: 158.6 symbols/min [2025-10-21T22:15:53.902624] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:53.939792] [DEBUG] [LOCAL ] TX: Loaded 23337 existing records from primary storage. [2025-10-21T22:15:53.940081] [INFO ] [MAIN ] TX: Loaded 23337 primary data records. [2025-10-21T22:15:54.087451] [DEBUG] [LOCAL ] TWO: Loaded 48595 existing records from primary storage. [2025-10-21T22:15:54.104573] [DEBUG] [LOCAL ] TXNM: Loaded 42998 existing records from primary storage. [2025-10-21T22:15:54.093364] [INFO ] [MAIN ] TWO: Loaded 48595 primary data records. [2025-10-21T22:15:54.136731] [INFO ] [MAIN ] TXNM: Loaded 42998 primary data records. [2025-10-21T22:15:54.982842] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:54.984143] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23337 primary records. [2025-10-21T22:15:54.984473] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-10-21T22:15:55.005837] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-10-21T22:15:55.006056] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-10-21T22:15:55.008145] [INFO ] [MAIN ] Derivative Progress: 1855/2057 symbols completed. TX took 1.1s. Estimated remaining: 1m 16s. Rate: 158.4 symbols/min [2025-10-21T22:15:55.008634] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:55.026678] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:55.039310] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48595 primary records. [2025-10-21T22:15:55.039789] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-10-21T22:15:55.039978] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:55.041090] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 42998 primary records. [2025-10-21T22:15:55.041438] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-10-21T22:15:55.069483] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-10-21T22:15:55.070416] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-10-21T22:15:55.076123] [INFO ] [MAIN ] Derivative Progress: 1856/2057 symbols completed. TWO took 1.2s. Estimated remaining: 1m 16s. Rate: 158.5 symbols/min [2025-10-21T22:15:55.077402] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:55.080387] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-10-21T22:15:55.080506] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-10-21T22:15:55.082748] [INFO ] [MAIN ] Derivative Progress: 1857/2057 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 16s. Rate: 158.6 symbols/min [2025-10-21T22:15:55.083396] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:55.093773] [DEBUG] [LOCAL ] TXO: Loaded 20033 existing records from primary storage. [2025-10-21T22:15:55.093965] [INFO ] [MAIN ] TXO: Loaded 20033 primary data records. [2025-10-21T22:15:55.199228] [DEBUG] [LOCAL ] TY: Loaded 7550 existing records from primary storage. [2025-10-21T22:15:55.210055] [INFO ] [MAIN ] TY: Loaded 7550 primary data records. [2025-10-21T22:15:55.579817] [DEBUG] [LOCAL ] TXT: Loaded 49516 existing records from primary storage. [2025-10-21T22:15:55.720606] [INFO ] [MAIN ] TXT: Loaded 49516 primary data records. [2025-10-21T22:15:56.036567] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:56.037524] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 20033 primary records. [2025-10-21T22:15:56.037964] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-10-21T22:15:56.065975] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:56.068134] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7550 primary records. [2025-10-21T22:15:56.069992] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-10-21T22:15:56.070061] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-10-21T22:15:56.070670] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-10-21T22:15:56.072832] [INFO ] [MAIN ] Derivative Progress: 1858/2057 symbols completed. TXO took 1.1s. Estimated remaining: 1m 15s. Rate: 158.5 symbols/min [2025-10-21T22:15:56.087868] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-10-21T22:15:56.087931] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-10-21T22:15:56.090119] [INFO ] [MAIN ] Derivative Progress: 1859/2057 symbols completed. TY took 1.0s. Estimated remaining: 1m 15s. Rate: 158.5 symbols/min [2025-10-21T22:15:56.107277] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:56.107840] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49516 primary records. [2025-10-21T22:15:56.107930] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-10-21T22:15:56.122477] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-10-21T22:15:56.122532] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-10-21T22:15:56.125056] [INFO ] [MAIN ] Derivative Progress: 1860/2057 symbols completed. TXT took 1.0s. Estimated remaining: 1m 15s. Rate: 158.6 symbols/min [2025-10-21T22:15:56.125583] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:56.125713] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:56.126010] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:56.174869] [DEBUG] [LOCAL ] TYG: Loaded 13977 existing records from primary storage. [2025-10-21T22:15:56.175120] [INFO ] [MAIN ] TYG: Loaded 13977 primary data records. [2025-10-21T22:15:56.258922] [DEBUG] [LOCAL ] TYL: Loaded 22129 existing records from primary storage. [2025-10-21T22:15:56.275403] [INFO ] [MAIN ] TYL: Loaded 22129 primary data records. [2025-10-21T22:15:56.596156] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-10-21T22:15:56.681315] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-10-21T22:15:57.147481] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:57.148453] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 13977 primary records. [2025-10-21T22:15:57.149024] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-10-21T22:15:57.165731] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-10-21T22:15:57.166622] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-10-21T22:15:57.168741] [INFO ] [MAIN ] Derivative Progress: 1861/2057 symbols completed. TYG took 1.0s. Estimated remaining: 1m 14s. Rate: 158.5 symbols/min [2025-10-21T22:15:57.169432] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:57.185690] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:57.186355] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22129 primary records. [2025-10-21T22:15:57.186515] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-10-21T22:15:57.204904] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-10-21T22:15:57.205098] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-10-21T22:15:57.207746] [INFO ] [MAIN ] Derivative Progress: 1862/2057 symbols completed. TYL took 1.1s. Estimated remaining: 1m 14s. Rate: 158.5 symbols/min [2025-10-21T22:15:57.220117] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:57.221154] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:57.221775] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-10-21T22:15:57.221944] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-10-21T22:15:57.237802] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-10-21T22:15:57.250101] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-10-21T22:15:57.253395] [INFO ] [MAIN ] Derivative Progress: 1863/2057 symbols completed. U took 1.1s. Estimated remaining: 1m 13s. Rate: 158.6 symbols/min [2025-10-21T22:15:57.253732] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:57.276235] [DEBUG] [LOCAL ] UAN: Loaded 5407 existing records from primary storage. [2025-10-21T22:15:57.276474] [INFO ] [MAIN ] UAN: Loaded 5407 primary data records. [2025-10-21T22:15:57.288730] [DEBUG] [LOCAL ] UA: Loaded 50476 existing records from primary storage. [2025-10-21T22:15:57.288840] [INFO ] [MAIN ] UA: Loaded 50476 primary data records. [2025-10-21T22:15:57.633669] [DEBUG] [LOCAL ] UAA: Loaded 53498 existing records from primary storage. [2025-10-21T22:15:57.757877] [INFO ] [MAIN ] UAA: Loaded 53498 primary data records. [2025-10-21T22:15:58.275634] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:58.278997] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5407 primary records. [2025-10-21T22:15:58.281076] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-10-21T22:15:58.309432] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:58.312410] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50476 primary records. [2025-10-21T22:15:58.314242] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-10-21T22:15:58.315021] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-10-21T22:15:58.315233] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-10-21T22:15:58.317355] [INFO ] [MAIN ] Derivative Progress: 1864/2057 symbols completed. UAN took 1.1s. Estimated remaining: 1m 13s. Rate: 158.5 symbols/min [2025-10-21T22:15:58.325887] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:58.334267] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-10-21T22:15:58.334555] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-10-21T22:15:58.337990] [INFO ] [MAIN ] Derivative Progress: 1865/2057 symbols completed. UA took 1.2s. Estimated remaining: 1m 13s. Rate: 158.5 symbols/min [2025-10-21T22:15:58.338468] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:58.354298] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:58.354976] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53498 primary records. [2025-10-21T22:15:58.355103] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-10-21T22:15:58.372996] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-10-21T22:15:58.373062] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-10-21T22:15:58.375789] [INFO ] [MAIN ] Derivative Progress: 1866/2057 symbols completed. UAA took 1.2s. Estimated remaining: 1m 12s. Rate: 158.6 symbols/min [2025-10-21T22:15:58.376056] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:58.431163] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-10-21T22:15:58.431951] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-10-21T22:15:58.522113] [DEBUG] [LOCAL ] UBS: Loaded 52290 existing records from primary storage. [2025-10-21T22:15:58.535076] [INFO ] [MAIN ] UBS: Loaded 52290 primary data records. [2025-10-21T22:15:58.695879] [DEBUG] [LOCAL ] UCB: Loaded 37764 existing records from primary storage. [2025-10-21T22:15:58.714111] [INFO ] [MAIN ] UCB: Loaded 37764 primary data records. [2025-10-21T22:15:59.412681] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:59.413553] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-10-21T22:15:59.413682] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-10-21T22:15:59.447184] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:59.458320] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52290 primary records. [2025-10-21T22:15:59.464346] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-10-21T22:15:59.464454] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-10-21T22:15:59.464671] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-10-21T22:15:59.465532] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:15:59.466402] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 37764 primary records. [2025-10-21T22:15:59.469298] [INFO ] [MAIN ] Derivative Progress: 1867/2057 symbols completed. UBER took 1.1s. Estimated remaining: 1m 12s. Rate: 158.5 symbols/min [2025-10-21T22:15:59.469752] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:59.469879] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-10-21T22:15:59.493798] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-10-21T22:15:59.497426] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-10-21T22:15:59.501727] [INFO ] [MAIN ] Derivative Progress: 1868/2057 symbols completed. UBS took 1.2s. Estimated remaining: 1m 12s. Rate: 158.5 symbols/min [2025-10-21T22:15:59.503199] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:59.504345] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-10-21T22:15:59.504934] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-10-21T22:15:59.507731] [INFO ] [MAIN ] Derivative Progress: 1869/2057 symbols completed. UCB took 1.1s. Estimated remaining: 1m 11s. Rate: 158.6 symbols/min [2025-10-21T22:15:59.508107] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:15:59.522510] [DEBUG] [LOCAL ] UFI: Loaded 8223 existing records from primary storage. [2025-10-21T22:15:59.522747] [INFO ] [MAIN ] UFI: Loaded 8223 primary data records. [2025-10-21T22:15:59.692166] [DEBUG] [LOCAL ] UDR: Loaded 52107 existing records from primary storage. [2025-10-21T22:15:59.860734] [INFO ] [MAIN ] UDR: Loaded 52107 primary data records. [2025-10-21T22:15:59.869565] [DEBUG] [LOCAL ] UE: Loaded 42559 existing records from primary storage. [2025-10-21T22:15:59.869819] [INFO ] [MAIN ] UE: Loaded 42559 primary data records. [2025-10-21T22:16:00.561805] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:00.562958] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8223 primary records. [2025-10-21T22:16:00.563230] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-10-21T22:16:00.579674] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-10-21T22:16:00.580040] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-10-21T22:16:00.582440] [INFO ] [MAIN ] Derivative Progress: 1870/2057 symbols completed. UFI took 1.1s. Estimated remaining: 1m 11s. Rate: 158.5 symbols/min [2025-10-21T22:16:00.582597] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:00.600574] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:00.602595] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 52107 primary records. [2025-10-21T22:16:00.602880] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-10-21T22:16:00.616529] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:00.617532] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 42559 primary records. [2025-10-21T22:16:00.628926] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-10-21T22:16:00.634769] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-10-21T22:16:00.634967] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-10-21T22:16:00.638320] [INFO ] [MAIN ] Derivative Progress: 1871/2057 symbols completed. UDR took 1.2s. Estimated remaining: 1m 10s. Rate: 158.5 symbols/min [2025-10-21T22:16:00.653515] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:00.653412] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-10-21T22:16:00.653819] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-10-21T22:16:00.656485] [INFO ] [MAIN ] Derivative Progress: 1872/2057 symbols completed. UE took 1.2s. Estimated remaining: 1m 10s. Rate: 158.6 symbols/min [2025-10-21T22:16:00.657073] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:00.700353] [DEBUG] [LOCAL ] UGI: Loaded 50513 existing records from primary storage. [2025-10-21T22:16:00.700565] [INFO ] [MAIN ] UGI: Loaded 50513 primary data records. [2025-10-21T22:16:00.792477] [DEBUG] [LOCAL ] UHAL: Loaded 16906 existing records from primary storage. [2025-10-21T22:16:00.821070] [INFO ] [MAIN ] UHAL: Loaded 16906 primary data records. [2025-10-21T22:16:01.156436] [DEBUG] [LOCAL ] UGP: Loaded 42954 existing records from primary storage. [2025-10-21T22:16:01.169594] [INFO ] [MAIN ] UGP: Loaded 42954 primary data records. [2025-10-21T22:16:01.725443] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:01.726602] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50513 primary records. [2025-10-21T22:16:01.726725] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-10-21T22:16:01.761213] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-10-21T22:16:01.762212] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-10-21T22:16:01.764460] [INFO ] [MAIN ] Derivative Progress: 1873/2057 symbols completed. UGI took 1.2s. Estimated remaining: 1m 10s. Rate: 158.5 symbols/min [2025-10-21T22:16:01.762020] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:01.766254] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16906 primary records. [2025-10-21T22:16:01.766321] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-10-21T22:16:01.782525] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-10-21T22:16:01.782808] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-10-21T22:16:01.785700] [INFO ] [MAIN ] Derivative Progress: 1874/2057 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 9s. Rate: 158.5 symbols/min [2025-10-21T22:16:01.801117] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:01.801809] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42954 primary records. [2025-10-21T22:16:01.801873] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-10-21T22:16:01.817180] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-10-21T22:16:01.817236] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-10-21T22:16:01.820119] [INFO ] [MAIN ] Derivative Progress: 1875/2057 symbols completed. UGP took 1.2s. Estimated remaining: 1m 9s. Rate: 158.6 symbols/min [2025-10-21T22:16:01.820540] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:01.820496] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:01.820707] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:01.833273] [DEBUG] [LOCAL ] UHT: Loaded 10251 existing records from primary storage. [2025-10-21T22:16:01.836810] [INFO ] [MAIN ] UHT: Loaded 10251 primary data records. [2025-10-21T22:16:01.897541] [DEBUG] [LOCAL ] UI: Loaded 14137 existing records from primary storage. [2025-10-21T22:16:01.933674] [INFO ] [MAIN ] UI: Loaded 14137 primary data records. [2025-10-21T22:16:02.154007] [DEBUG] [LOCAL ] UHS: Loaded 39747 existing records from primary storage. [2025-10-21T22:16:02.175615] [INFO ] [MAIN ] UHS: Loaded 39747 primary data records. [2025-10-21T22:16:02.879513] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:02.882067] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10251 primary records. [2025-10-21T22:16:02.895752] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-10-21T22:16:02.896317] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:02.898670] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 14137 primary records. [2025-10-21T22:16:02.905634] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-10-21T22:16:02.922461] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-10-21T22:16:02.926197] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-10-21T22:16:02.929769] [INFO ] [MAIN ] Derivative Progress: 1876/2057 symbols completed. UHT took 1.1s. Estimated remaining: 1m 9s. Rate: 158.5 symbols/min [2025-10-21T22:16:02.930338] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:02.933511] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-10-21T22:16:02.933728] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-10-21T22:16:02.937418] [INFO ] [MAIN ] Derivative Progress: 1877/2057 symbols completed. UI took 1.1s. Estimated remaining: 1m 8s. Rate: 158.5 symbols/min [2025-10-21T22:16:02.939250] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:02.952853] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:02.953739] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 39747 primary records. [2025-10-21T22:16:02.953938] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-10-21T22:16:02.970199] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-10-21T22:16:02.970509] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-10-21T22:16:02.973062] [INFO ] [MAIN ] Derivative Progress: 1878/2057 symbols completed. UHS took 1.2s. Estimated remaining: 1m 8s. Rate: 158.6 symbols/min [2025-10-21T22:16:02.973369] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:03.004426] [DEBUG] [LOCAL ] UIS: Loaded 36713 existing records from primary storage. [2025-10-21T22:16:03.017256] [INFO ] [MAIN ] UIS: Loaded 36713 primary data records. [2025-10-21T22:16:03.157250] [DEBUG] [LOCAL ] UL: Loaded 53072 existing records from primary storage. [2025-10-21T22:16:03.173580] [INFO ] [MAIN ] UL: Loaded 53072 primary data records. [2025-10-21T22:16:03.287217] [DEBUG] [LOCAL ] ULS: Loaded 38649 existing records from primary storage. [2025-10-21T22:16:03.400261] [INFO ] [MAIN ] ULS: Loaded 38649 primary data records. [2025-10-21T22:16:04.017562] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:04.018571] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 36713 primary records. [2025-10-21T22:16:04.020199] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-10-21T22:16:04.041294] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-10-21T22:16:04.041621] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-10-21T22:16:04.044040] [INFO ] [MAIN ] Derivative Progress: 1879/2057 symbols completed. UIS took 1.1s. Estimated remaining: 1m 7s. Rate: 158.5 symbols/min [2025-10-21T22:16:04.044265] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:04.058452] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:04.059159] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53072 primary records. [2025-10-21T22:16:04.059503] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-10-21T22:16:04.075942] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-10-21T22:16:04.078023] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-10-21T22:16:04.081838] [INFO ] [MAIN ] Derivative Progress: 1880/2057 symbols completed. UL took 1.1s. Estimated remaining: 1m 7s. Rate: 158.5 symbols/min [2025-10-21T22:16:04.082229] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:04.097690] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:04.098425] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 38649 primary records. [2025-10-21T22:16:04.098546] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-10-21T22:16:04.114494] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-10-21T22:16:04.115355] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-10-21T22:16:04.118091] [INFO ] [MAIN ] Derivative Progress: 1881/2057 symbols completed. ULS took 1.1s. Estimated remaining: 1m 7s. Rate: 158.6 symbols/min [2025-10-21T22:16:04.118422] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:04.152944] [DEBUG] [LOCAL ] UNF: Loaded 11736 existing records from primary storage. [2025-10-21T22:16:04.153079] [INFO ] [MAIN ] UNF: Loaded 11736 primary data records. [2025-10-21T22:16:04.266695] [DEBUG] [LOCAL ] UMH: Loaded 34236 existing records from primary storage. [2025-10-21T22:16:04.291596] [INFO ] [MAIN ] UMH: Loaded 34236 primary data records. [2025-10-21T22:16:04.286227] [DEBUG] [LOCAL ] UMC: Loaded 52685 existing records from primary storage. [2025-10-21T22:16:04.302237] [INFO ] [MAIN ] UMC: Loaded 52685 primary data records. [2025-10-21T22:16:05.173007] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:05.173892] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11736 primary records. [2025-10-21T22:16:05.174056] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-10-21T22:16:05.201037] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-10-21T22:16:05.201192] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-10-21T22:16:05.208368] [INFO ] [MAIN ] Derivative Progress: 1882/2057 symbols completed. UNF took 1.1s. Estimated remaining: 1m 6s. Rate: 158.4 symbols/min [2025-10-21T22:16:05.209086] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:05.208745] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:05.209899] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52685 primary records. [2025-10-21T22:16:05.210896] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-10-21T22:16:05.241459] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:05.246027] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 34236 primary records. [2025-10-21T22:16:05.246153] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-10-21T22:16:05.245184] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-10-21T22:16:05.247110] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-10-21T22:16:05.258632] [INFO ] [MAIN ] Derivative Progress: 1883/2057 symbols completed. UMC took 1.2s. Estimated remaining: 1m 6s. Rate: 158.5 symbols/min [2025-10-21T22:16:05.261707] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:05.266593] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-10-21T22:16:05.266812] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-10-21T22:16:05.269381] [INFO ] [MAIN ] Derivative Progress: 1884/2057 symbols completed. UMH took 1.2s. Estimated remaining: 1m 5s. Rate: 158.6 symbols/min [2025-10-21T22:16:05.269569] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:05.305339] [DEBUG] [LOCAL ] UNFI: Loaded 42625 existing records from primary storage. [2025-10-21T22:16:05.305850] [INFO ] [MAIN ] UNFI: Loaded 42625 primary data records. [2025-10-21T22:16:05.705702] [DEBUG] [LOCAL ] UNH: Loaded 53819 existing records from primary storage. [2025-10-21T22:16:05.705947] [INFO ] [MAIN ] UNH: Loaded 53819 primary data records. [2025-10-21T22:16:05.706774] [DEBUG] [LOCAL ] UNM: Loaded 47997 existing records from primary storage. [2025-10-21T22:16:05.718280] [INFO ] [MAIN ] UNM: Loaded 47997 primary data records. [2025-10-21T22:16:06.330437] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:06.331773] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 42625 primary records. [2025-10-21T22:16:06.332128] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-10-21T22:16:06.350582] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-10-21T22:16:06.351007] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-10-21T22:16:06.354201] [INFO ] [MAIN ] Derivative Progress: 1885/2057 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 5s. Rate: 158.4 symbols/min [2025-10-21T22:16:06.356466] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:06.370435] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:06.371194] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53819 primary records. [2025-10-21T22:16:06.372271] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-10-21T22:16:06.384486] [DEBUG] [LOCAL ] UNMA: Loaded 3456 existing records from primary storage. [2025-10-21T22:16:06.384813] [INFO ] [MAIN ] UNMA: Loaded 3456 primary data records. [2025-10-21T22:16:06.499564] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-10-21T22:16:06.507726] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-10-21T22:16:06.522608] [INFO ] [MAIN ] Derivative Progress: 1886/2057 symbols completed. UNH took 1.3s. Estimated remaining: 1m 5s. Rate: 158.5 symbols/min [2025-10-21T22:16:06.522984] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:06.539408] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 47997 primary records. [2025-10-21T22:16:06.538713] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:06.550228] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-10-21T22:16:06.621767] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-10-21T22:16:06.621900] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-10-21T22:16:06.624591] [INFO ] [MAIN ] Derivative Progress: 1887/2057 symbols completed. UNM took 1.4s. Estimated remaining: 1m 4s. Rate: 158.6 symbols/min [2025-10-21T22:16:06.624843] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:06.826703] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:06.827334] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3456 primary records. [2025-10-21T22:16:06.827448] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-10-21T22:16:06.872737] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-10-21T22:16:06.874140] [DEBUG] [LOCAL ] UNP: Loaded 53362 existing records from primary storage. [2025-10-21T22:16:06.874491] [INFO ] [MAIN ] UNP: Loaded 53362 primary data records. [2025-10-21T22:16:06.874411] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-10-21T22:16:06.875233] [DEBUG] [LOCAL ] UP: Loaded 44384 existing records from primary storage. [2025-10-21T22:16:06.882539] [INFO ] [MAIN ] Derivative Progress: 1888/2057 symbols completed. UNMA took 0.5s. Estimated remaining: 1m 4s. Rate: 158.6 symbols/min [2025-10-21T22:16:06.899618] [INFO ] [MAIN ] UP: Loaded 44384 primary data records. [2025-10-21T22:16:07.534802] [DEBUG] [MAIN ] UP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:07.537530] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 44384 primary records. [2025-10-21T22:16:07.538473] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-10-21T22:16:07.552229] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:07.560327] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53362 primary records. [2025-10-21T22:16:07.561422] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-10-21T22:16:07.582569] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-10-21T22:16:07.585282] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-10-21T22:16:07.585224] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-10-21T22:16:07.588366] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-10-21T22:16:07.588281] [INFO ] [MAIN ] Derivative Progress: 1889/2057 symbols completed. UP took 1.0s. Estimated remaining: 1m 4s. Rate: 158.5 symbols/min [2025-10-21T22:16:07.591155] [INFO ] [MAIN ] Derivative Progress: 1890/2057 symbols completed. UNP took 1.1s. Estimated remaining: 1m 3s. Rate: 158.6 symbols/min [2025-10-21T22:16:07.591580] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:07.591691] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:07.591770] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:07.660370] [DEBUG] [LOCAL ] URI: Loaded 34400 existing records from primary storage. [2025-10-21T22:16:07.660587] [INFO ] [MAIN ] URI: Loaded 34400 primary data records. [2025-10-21T22:16:07.682523] [DEBUG] [LOCAL ] USA: Loaded 36487 existing records from primary storage. [2025-10-21T22:16:07.706042] [INFO ] [MAIN ] USA: Loaded 36487 primary data records. [2025-10-21T22:16:07.870583] [DEBUG] [LOCAL ] UPS: Loaded 53720 existing records from primary storage. [2025-10-21T22:16:07.910282] [INFO ] [MAIN ] UPS: Loaded 53720 primary data records. [2025-10-21T22:16:08.665184] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:08.667154] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 34400 primary records. [2025-10-21T22:16:08.667887] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-10-21T22:16:08.694844] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:08.698308] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36487 primary records. [2025-10-21T22:16:08.699248] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-10-21T22:16:08.699361] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-10-21T22:16:08.698539] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-10-21T22:16:08.702238] [INFO ] [MAIN ] Derivative Progress: 1891/2057 symbols completed. URI took 1.1s. Estimated remaining: 1m 3s. Rate: 158.4 symbols/min [2025-10-21T22:16:08.702559] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:08.720508] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-10-21T22:16:08.722846] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-10-21T22:16:08.725428] [INFO ] [MAIN ] Derivative Progress: 1892/2057 symbols completed. USA took 1.1s. Estimated remaining: 1m 2s. Rate: 158.5 symbols/min [2025-10-21T22:16:08.725663] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:08.745545] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:08.746372] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53720 primary records. [2025-10-21T22:16:08.746516] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-10-21T22:16:08.767267] [DEBUG] [LOCAL ] USAC: Loaded 21711 existing records from primary storage. [2025-10-21T22:16:08.771065] [INFO ] [MAIN ] USAC: Loaded 21711 primary data records. [2025-10-21T22:16:08.837782] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-10-21T22:16:08.866587] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-10-21T22:16:08.879927] [INFO ] [MAIN ] Derivative Progress: 1893/2057 symbols completed. UPS took 1.3s. Estimated remaining: 1m 2s. Rate: 158.6 symbols/min [2025-10-21T22:16:08.890862] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:09.108055] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-10-21T22:16:09.108680] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-10-21T22:16:09.433961] [DEBUG] [LOCAL ] USFD: Loaded 51154 existing records from primary storage. [2025-10-21T22:16:09.441699] [INFO ] [MAIN ] USFD: Loaded 51154 primary data records. [2025-10-21T22:16:09.571324] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:09.583729] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 21711 primary records. [2025-10-21T22:16:09.599905] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-10-21T22:16:09.804328] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-10-21T22:16:09.804546] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-10-21T22:16:09.808066] [INFO ] [MAIN ] Derivative Progress: 1894/2057 symbols completed. USAC took 1.1s. Estimated remaining: 1m 2s. Rate: 158.4 symbols/min [2025-10-21T22:16:09.808285] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:09.840254] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:09.841229] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-10-21T22:16:09.841388] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-10-21T22:16:09.860335] [DEBUG] [LOCAL ] USNA: Loaded 18002 existing records from primary storage. [2025-10-21T22:16:09.864194] [INFO ] [MAIN ] USNA: Loaded 18002 primary data records. [2025-10-21T22:16:09.894097] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-10-21T22:16:09.917616] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-10-21T22:16:09.953320] [INFO ] [MAIN ] Derivative Progress: 1895/2057 symbols completed. USB took 1.2s. Estimated remaining: 1m 1s. Rate: 158.5 symbols/min [2025-10-21T22:16:09.970234] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:09.970588] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:09.976561] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51154 primary records. [2025-10-21T22:16:09.989933] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-10-21T22:16:10.036197] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-10-21T22:16:10.062774] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-10-21T22:16:10.067359] [INFO ] [MAIN ] Derivative Progress: 1896/2057 symbols completed. USFD took 1.2s. Estimated remaining: 1m 1s. Rate: 158.5 symbols/min [2025-10-21T22:16:10.084141] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:10.215797] [DEBUG] [LOCAL ] USPH: Loaded 17099 existing records from primary storage. [2025-10-21T22:16:10.217058] [INFO ] [MAIN ] USPH: Loaded 17099 primary data records. [2025-10-21T22:16:10.393143] [DEBUG] [LOCAL ] UTF: Loaded 31001 existing records from primary storage. [2025-10-21T22:16:10.409083] [INFO ] [MAIN ] UTF: Loaded 31001 primary data records. [2025-10-21T22:16:10.791177] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:10.844788] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 18002 primary records. [2025-10-21T22:16:10.850849] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-10-21T22:16:10.989189] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-10-21T22:16:10.990804] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-10-21T22:16:10.994145] [INFO ] [MAIN ] Derivative Progress: 1897/2057 symbols completed. USNA took 1.2s. Estimated remaining: 1m 1s. Rate: 158.4 symbols/min [2025-10-21T22:16:10.994441] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:11.019782] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:11.020692] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 17099 primary records. [2025-10-21T22:16:11.020913] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-10-21T22:16:11.065261] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:11.067516] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 31001 primary records. [2025-10-21T22:16:11.066622] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-10-21T22:16:11.081321] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-10-21T22:16:11.081538] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-10-21T22:16:11.085370] [DEBUG] [LOCAL ] UTI: Loaded 40317 existing records from primary storage. [2025-10-21T22:16:11.084244] [INFO ] [MAIN ] Derivative Progress: 1898/2057 symbols completed. USPH took 1.1s. Estimated remaining: 1m 0s. Rate: 158.5 symbols/min [2025-10-21T22:16:11.085567] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:11.086549] [INFO ] [MAIN ] UTI: Loaded 40317 primary data records. [2025-10-21T22:16:11.207771] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-10-21T22:16:11.218503] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-10-21T22:16:11.244864] [INFO ] [MAIN ] Derivative Progress: 1899/2057 symbols completed. UTF took 1.2s. Estimated remaining: 59.8s. Rate: 158.5 symbols/min [2025-10-21T22:16:11.258181] [DEBUG] [LOCAL ] UTL: Loaded 11875 existing records from primary storage. [2025-10-21T22:16:11.258564] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:11.274486] [INFO ] [MAIN ] UTL: Loaded 11875 primary data records. [2025-10-21T22:16:11.872352] [DEBUG] [LOCAL ] UTZ: Loaded 44393 existing records from primary storage. [2025-10-21T22:16:11.873361] [INFO ] [MAIN ] UTZ: Loaded 44393 primary data records. [2025-10-21T22:16:12.251344] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:12.252188] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40317 primary records. [2025-10-21T22:16:12.252356] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-10-21T22:16:12.272913] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-10-21T22:16:12.286111] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-10-21T22:16:12.288240] [INFO ] [MAIN ] Derivative Progress: 1900/2057 symbols completed. UTI took 1.3s. Estimated remaining: 59.5s. Rate: 158.4 symbols/min [2025-10-21T22:16:12.288609] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:12.288986] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:12.290123] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 11875 primary records. [2025-10-21T22:16:12.290459] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-10-21T22:16:12.309290] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-10-21T22:16:12.314269] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-10-21T22:16:12.316719] [INFO ] [MAIN ] Derivative Progress: 1901/2057 symbols completed. UTL took 1.2s. Estimated remaining: 59.1s. Rate: 158.5 symbols/min [2025-10-21T22:16:12.317068] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:12.329580] [DEBUG] [LOCAL ] UVE: Loaded 21996 existing records from primary storage. [2025-10-21T22:16:12.329984] [INFO ] [MAIN ] UVE: Loaded 21996 primary data records. [2025-10-21T22:16:12.363116] [DEBUG] [MAIN ] UTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:12.406383] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44393 primary records. [2025-10-21T22:16:12.423272] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-10-21T22:16:12.489916] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-10-21T22:16:12.501572] [DEBUG] [LOCAL ] UVV: Loaded 22842 existing records from primary storage. [2025-10-21T22:16:12.501789] [INFO ] [MAIN ] UVV: Loaded 22842 primary data records. [2025-10-21T22:16:12.501701] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-10-21T22:16:12.517012] [INFO ] [MAIN ] Derivative Progress: 1902/2057 symbols completed. UTZ took 1.3s. Estimated remaining: 58.7s. Rate: 158.5 symbols/min [2025-10-21T22:16:12.565719] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:13.066489] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:13.067317] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21996 primary records. [2025-10-21T22:16:13.067414] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-10-21T22:16:13.069417] [DEBUG] [LOCAL ] UWMC: Loaded 52961 existing records from primary storage. [2025-10-21T22:16:13.081034] [INFO ] [MAIN ] UWMC: Loaded 52961 primary data records. [2025-10-21T22:16:13.085136] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-10-21T22:16:13.085296] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-10-21T22:16:13.098497] [INFO ] [MAIN ] Derivative Progress: 1903/2057 symbols completed. UVE took 0.8s. Estimated remaining: 58.3s. Rate: 158.5 symbols/min [2025-10-21T22:16:13.278606] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:13.391871] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22842 primary records. [2025-10-21T22:16:13.392428] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-10-21T22:16:13.408837] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-10-21T22:16:13.409336] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-10-21T22:16:13.411807] [INFO ] [MAIN ] Derivative Progress: 1904/2057 symbols completed. UVV took 1.1s. Estimated remaining: 57.9s. Rate: 158.5 symbols/min [2025-10-21T22:16:13.431452] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:13.432049] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52961 primary records. [2025-10-21T22:16:13.432111] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-10-21T22:16:13.446436] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-10-21T22:16:13.446495] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-10-21T22:16:13.448723] [INFO ] [MAIN ] Derivative Progress: 1905/2057 symbols completed. UWMC took 0.9s. Estimated remaining: 57.5s. Rate: 158.6 symbols/min [2025-10-21T22:16:13.449166] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:13.449221] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:13.449094] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:13.460309] [DEBUG] [LOCAL ] UZD: Loaded 5886 existing records from primary storage. [2025-10-21T22:16:13.460546] [INFO ] [MAIN ] UZD: Loaded 5886 primary data records. [2025-10-21T22:16:13.527759] [DEBUG] [LOCAL ] UZE: Loaded 7025 existing records from primary storage. [2025-10-21T22:16:13.566370] [INFO ] [MAIN ] UZE: Loaded 7025 primary data records. [2025-10-21T22:16:13.966635] [DEBUG] [LOCAL ] V: Loaded 53751 existing records from primary storage. [2025-10-21T22:16:14.078518] [INFO ] [MAIN ] V: Loaded 53751 primary data records. [2025-10-21T22:16:14.397261] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:14.398543] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 5886 primary records. [2025-10-21T22:16:14.398743] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-10-21T22:16:14.424986] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-10-21T22:16:14.430287] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:14.430060] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-10-21T22:16:14.433084] [INFO ] [MAIN ] Derivative Progress: 1906/2057 symbols completed. UZD took 1.0s. Estimated remaining: 57.2s. Rate: 158.4 symbols/min [2025-10-21T22:16:14.431006] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7025 primary records. [2025-10-21T22:16:14.433573] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:14.433710] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-10-21T22:16:14.450858] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-10-21T22:16:14.451173] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-10-21T22:16:14.453522] [INFO ] [MAIN ] Derivative Progress: 1907/2057 symbols completed. UZE took 1.0s. Estimated remaining: 56.8s. Rate: 158.5 symbols/min [2025-10-21T22:16:14.453746] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:14.470940] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:14.471634] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53751 primary records. [2025-10-21T22:16:14.471930] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-10-21T22:16:14.496809] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-10-21T22:16:14.506912] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-10-21T22:16:14.509376] [INFO ] [MAIN ] Derivative Progress: 1908/2057 symbols completed. V took 1.1s. Estimated remaining: 56.4s. Rate: 158.6 symbols/min [2025-10-21T22:16:14.510365] [DEBUG] [LOCAL ] VAC: Loaded 33699 existing records from primary storage. [2025-10-21T22:16:14.510620] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:14.510542] [INFO ] [MAIN ] VAC: Loaded 33699 primary data records. [2025-10-21T22:16:14.722756] [DEBUG] [LOCAL ] VAL: Loaded 49919 existing records from primary storage. [2025-10-21T22:16:14.867934] [INFO ] [MAIN ] VAL: Loaded 49919 primary data records. [2025-10-21T22:16:15.002483] [DEBUG] [LOCAL ] VALE: Loaded 53693 existing records from primary storage. [2025-10-21T22:16:15.008697] [INFO ] [MAIN ] VALE: Loaded 53693 primary data records. [2025-10-21T22:16:15.513774] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:15.514994] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 33699 primary records. [2025-10-21T22:16:15.515496] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-10-21T22:16:15.532099] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-10-21T22:16:15.532564] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-10-21T22:16:15.534838] [INFO ] [MAIN ] Derivative Progress: 1909/2057 symbols completed. VAC took 1.1s. Estimated remaining: 56.1s. Rate: 158.4 symbols/min [2025-10-21T22:16:15.535420] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:15.545523] [DEBUG] [LOCAL ] VATE: Loaded 5093 existing records from primary storage. [2025-10-21T22:16:15.558782] [DEBUG] [MAIN ] VAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:15.558465] [INFO ] [MAIN ] VATE: Loaded 5093 primary data records. [2025-10-21T22:16:15.565140] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 49919 primary records. [2025-10-21T22:16:15.565456] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-10-21T22:16:15.643600] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-10-21T22:16:15.644460] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-10-21T22:16:15.652715] [INFO ] [MAIN ] Derivative Progress: 1910/2057 symbols completed. VAL took 1.2s. Estimated remaining: 55.7s. Rate: 158.5 symbols/min [2025-10-21T22:16:15.667672] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:15.770761] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:15.801694] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53693 primary records. [2025-10-21T22:16:15.929490] [DEBUG] [LOCAL ] VBF: Loaded 7245 existing records from primary storage. [2025-10-21T22:16:15.929673] [INFO ] [MAIN ] VBF: Loaded 7245 primary data records. [2025-10-21T22:16:15.929749] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-10-21T22:16:16.051452] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-10-21T22:16:16.056868] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-10-21T22:16:16.075982] [INFO ] [MAIN ] Derivative Progress: 1911/2057 symbols completed. VALE took 1.6s. Estimated remaining: 55.3s. Rate: 158.5 symbols/min [2025-10-21T22:16:16.095281] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:16.261915] [DEBUG] [LOCAL ] VCV: Loaded 13321 existing records from primary storage. [2025-10-21T22:16:16.262700] [INFO ] [MAIN ] VCV: Loaded 13321 primary data records. [2025-10-21T22:16:16.289455] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:16.308203] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5093 primary records. [2025-10-21T22:16:16.322111] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-10-21T22:16:16.384676] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-10-21T22:16:16.395211] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-10-21T22:16:16.410389] [INFO ] [MAIN ] Derivative Progress: 1912/2057 symbols completed. VATE took 0.9s. Estimated remaining: 54.9s. Rate: 158.5 symbols/min [2025-10-21T22:16:16.425528] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:16.737137] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:16.738204] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7245 primary records. [2025-10-21T22:16:16.738341] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-10-21T22:16:16.775890] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-10-21T22:16:16.790136] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-10-21T22:16:16.794175] [DEBUG] [LOCAL ] VEEV: Loaded 47200 existing records from primary storage. [2025-10-21T22:16:16.794301] [INFO ] [MAIN ] VEEV: Loaded 47200 primary data records. [2025-10-21T22:16:16.793051] [INFO ] [MAIN ] Derivative Progress: 1913/2057 symbols completed. VBF took 1.1s. Estimated remaining: 54.5s. Rate: 158.5 symbols/min [2025-10-21T22:16:16.795946] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:16.964279] [DEBUG] [LOCAL ] VEL: Loaded 11980 existing records from primary storage. [2025-10-21T22:16:16.983213] [INFO ] [MAIN ] VEL: Loaded 11980 primary data records. [2025-10-21T22:16:17.180675] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:17.224702] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13321 primary records. [2025-10-21T22:16:17.230924] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-10-21T22:16:17.323414] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-10-21T22:16:17.441711] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-10-21T22:16:17.444736] [INFO ] [MAIN ] Derivative Progress: 1914/2057 symbols completed. VCV took 1.3s. Estimated remaining: 54.2s. Rate: 158.4 symbols/min [2025-10-21T22:16:17.445151] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:17.469719] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:17.471119] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47200 primary records. [2025-10-21T22:16:17.471413] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-10-21T22:16:17.498100] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-10-21T22:16:17.498705] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-10-21T22:16:17.501362] [INFO ] [MAIN ] Derivative Progress: 1915/2057 symbols completed. VEEV took 1.1s. Estimated remaining: 53.8s. Rate: 158.5 symbols/min [2025-10-21T22:16:17.502048] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:17.533035] [DEBUG] [LOCAL ] VET: Loaded 44150 existing records from primary storage. [2025-10-21T22:16:17.533700] [INFO ] [MAIN ] VET: Loaded 44150 primary data records. [2025-10-21T22:16:17.533430] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:17.534545] [INFO ] [MAIN ] VEL: Generated 1794 derivative records from 11980 primary records. [2025-10-21T22:16:17.534684] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-10-21T22:16:17.645261] [DEBUG] [LOCAL ] VEL: Derivative data saved (1794 records). [2025-10-21T22:16:17.664938] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-10-21T22:16:17.667340] [INFO ] [MAIN ] Derivative Progress: 1916/2057 symbols completed. VEL took 0.9s. Estimated remaining: 53.4s. Rate: 158.5 symbols/min [2025-10-21T22:16:17.667525] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:17.881259] [DEBUG] [LOCAL ] VGI: Loaded 5225 existing records from primary storage. [2025-10-21T22:16:17.881449] [INFO ] [MAIN ] VGI: Loaded 5225 primary data records. [2025-10-21T22:16:17.992319] [DEBUG] [LOCAL ] VFC: Loaded 53607 existing records from primary storage. [2025-10-21T22:16:18.004168] [INFO ] [MAIN ] VFC: Loaded 53607 primary data records. [2025-10-21T22:16:18.513723] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:18.514605] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44150 primary records. [2025-10-21T22:16:18.514880] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-10-21T22:16:18.531195] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-10-21T22:16:18.532218] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-10-21T22:16:18.534587] [INFO ] [MAIN ] Derivative Progress: 1917/2057 symbols completed. VET took 1.1s. Estimated remaining: 53.0s. Rate: 158.4 symbols/min [2025-10-21T22:16:18.535834] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:18.551773] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:18.552689] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5225 primary records. [2025-10-21T22:16:18.552883] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-10-21T22:16:18.573831] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-10-21T22:16:18.573997] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-10-21T22:16:18.576960] [INFO ] [MAIN ] Derivative Progress: 1918/2057 symbols completed. VGI took 0.9s. Estimated remaining: 52.6s. Rate: 158.5 symbols/min [2025-10-21T22:16:18.584806] [DEBUG] [LOCAL ] VGM: Loaded 18689 existing records from primary storage. [2025-10-21T22:16:18.597249] [INFO ] [MAIN ] VGM: Loaded 18689 primary data records. [2025-10-21T22:16:18.597184] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:18.598012] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53607 primary records. [2025-10-21T22:16:18.642741] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-10-21T22:16:18.719268] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-10-21T22:16:18.724918] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-10-21T22:16:18.732860] [INFO ] [MAIN ] Derivative Progress: 1919/2057 symbols completed. VFC took 1.2s. Estimated remaining: 52.2s. Rate: 158.6 symbols/min [2025-10-21T22:16:18.953561] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:18.954191] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18689 primary records. [2025-10-21T22:16:18.954252] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-10-21T22:16:18.968973] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-10-21T22:16:18.969034] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-10-21T22:16:18.971357] [INFO ] [MAIN ] Derivative Progress: 1920/2057 symbols completed. VGM took 0.4s. Estimated remaining: 51.8s. Rate: 158.6 symbols/min [2025-10-21T22:16:18.972156] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:18.972077] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:18.972600] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:18.978329] [DEBUG] [LOCAL ] VHI: Loaded 2711 existing records from primary storage. [2025-10-21T22:16:18.978553] [INFO ] [MAIN ] VHI: Loaded 2711 primary data records. [2025-10-21T22:16:19.324079] [DEBUG] [LOCAL ] VIK: Loaded 52374 existing records from primary storage. [2025-10-21T22:16:19.324362] [INFO ] [MAIN ] VIK: Loaded 52374 primary data records. [2025-10-21T22:16:19.450891] [DEBUG] [LOCAL ] VICI: Loaded 53653 existing records from primary storage. [2025-10-21T22:16:19.462171] [INFO ] [MAIN ] VICI: Loaded 53653 primary data records. [2025-10-21T22:16:19.955163] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:19.970296] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2711 primary records. [2025-10-21T22:16:19.970457] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-10-21T22:16:19.995398] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-10-21T22:16:19.995988] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-10-21T22:16:19.998847] [INFO ] [MAIN ] Derivative Progress: 1921/2057 symbols completed. VHI took 1.0s. Estimated remaining: 51.5s. Rate: 158.4 symbols/min [2025-10-21T22:16:19.999216] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:20.019042] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:20.020122] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52374 primary records. [2025-10-21T22:16:20.020569] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-10-21T22:16:20.045428] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-10-21T22:16:20.047061] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-10-21T22:16:20.049693] [INFO ] [MAIN ] Derivative Progress: 1922/2057 symbols completed. VIK took 1.1s. Estimated remaining: 51.1s. Rate: 158.5 symbols/min [2025-10-21T22:16:20.049969] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:20.065281] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:20.079886] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53653 primary records. [2025-10-21T22:16:20.080103] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-10-21T22:16:20.099275] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-10-21T22:16:20.099462] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-10-21T22:16:20.102933] [INFO ] [MAIN ] Derivative Progress: 1923/2057 symbols completed. VICI took 1.1s. Estimated remaining: 50.7s. Rate: 158.6 symbols/min [2025-10-21T22:16:20.118472] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:20.119909] [DEBUG] [LOCAL ] VIPS: Loaded 51260 existing records from primary storage. [2025-10-21T22:16:20.120001] [INFO ] [MAIN ] VIPS: Loaded 51260 primary data records. [2025-10-21T22:16:20.461783] [DEBUG] [LOCAL ] VIRT: Loaded 46483 existing records from primary storage. [2025-10-21T22:16:20.461973] [INFO ] [MAIN ] VIRT: Loaded 46483 primary data records. [2025-10-21T22:16:20.600545] [DEBUG] [LOCAL ] VIST: Loaded 46653 existing records from primary storage. [2025-10-21T22:16:20.618941] [INFO ] [MAIN ] VIST: Loaded 46653 primary data records. [2025-10-21T22:16:21.211292] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:21.212251] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51260 primary records. [2025-10-21T22:16:21.213165] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-10-21T22:16:21.230843] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-10-21T22:16:21.231994] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-10-21T22:16:21.234589] [INFO ] [MAIN ] Derivative Progress: 1924/2057 symbols completed. VIPS took 1.2s. Estimated remaining: 50.4s. Rate: 158.4 symbols/min [2025-10-21T22:16:21.235515] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:21.253582] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:21.254321] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 46483 primary records. [2025-10-21T22:16:21.254597] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-10-21T22:16:21.271860] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-10-21T22:16:21.272040] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-10-21T22:16:21.273926] [INFO ] [MAIN ] Derivative Progress: 1925/2057 symbols completed. VIRT took 1.2s. Estimated remaining: 50.0s. Rate: 158.5 symbols/min [2025-10-21T22:16:21.274276] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:21.302315] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:21.306700] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 46653 primary records. [2025-10-21T22:16:21.306896] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-10-21T22:16:21.330053] [DEBUG] [LOCAL ] VKQ: Loaded 17897 existing records from primary storage. [2025-10-21T22:16:21.347622] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-10-21T22:16:21.344835] [INFO ] [MAIN ] VKQ: Loaded 17897 primary data records. [2025-10-21T22:16:21.347821] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-10-21T22:16:21.380458] [DEBUG] [LOCAL ] VIV: Loaded 44664 existing records from primary storage. [2025-10-21T22:16:21.383460] [INFO ] [MAIN ] Derivative Progress: 1926/2057 symbols completed. VIST took 1.3s. Estimated remaining: 49.6s. Rate: 158.6 symbols/min [2025-10-21T22:16:21.408379] [INFO ] [MAIN ] VIV: Loaded 44664 primary data records. [2025-10-21T22:16:21.408287] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:21.968629] [DEBUG] [LOCAL ] VLN: Loaded 30957 existing records from primary storage. [2025-10-21T22:16:21.970452] [INFO ] [MAIN ] VLN: Loaded 30957 primary data records. [2025-10-21T22:16:22.315145] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:22.316521] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 44664 primary records. [2025-10-21T22:16:22.317490] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:22.317275] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-10-21T22:16:22.319945] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17897 primary records. [2025-10-21T22:16:22.320144] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-10-21T22:16:22.336530] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-10-21T22:16:22.337209] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-10-21T22:16:22.346222] [INFO ] [MAIN ] Derivative Progress: 1927/2057 symbols completed. VIV took 1.1s. Estimated remaining: 49.2s. Rate: 158.4 symbols/min [2025-10-21T22:16:22.353729] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:22.355276] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-10-21T22:16:22.355693] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-10-21T22:16:22.358203] [INFO ] [MAIN ] Derivative Progress: 1928/2057 symbols completed. VKQ took 1.1s. Estimated remaining: 48.8s. Rate: 158.5 symbols/min [2025-10-21T22:16:22.359165] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:22.376965] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:22.377857] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 30957 primary records. [2025-10-21T22:16:22.377939] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-10-21T22:16:22.395283] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-10-21T22:16:22.395446] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-10-21T22:16:22.397998] [INFO ] [MAIN ] Derivative Progress: 1929/2057 symbols completed. VLN took 1.0s. Estimated remaining: 48.4s. Rate: 158.6 symbols/min [2025-10-21T22:16:22.398191] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:22.429157] [DEBUG] [LOCAL ] VLT: Loaded 4344 existing records from primary storage. [2025-10-21T22:16:22.429358] [INFO ] [MAIN ] VLT: Loaded 4344 primary data records. [2025-10-21T22:16:22.569666] [DEBUG] [LOCAL ] VLRS: Loaded 39297 existing records from primary storage. [2025-10-21T22:16:22.570535] [DEBUG] [LOCAL ] VLO: Loaded 52963 existing records from primary storage. [2025-10-21T22:16:22.570628] [INFO ] [MAIN ] VLRS: Loaded 39297 primary data records. [2025-10-21T22:16:22.581627] [INFO ] [MAIN ] VLO: Loaded 52963 primary data records. [2025-10-21T22:16:23.480422] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:23.481557] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4344 primary records. [2025-10-21T22:16:23.481903] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-10-21T22:16:23.503489] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-10-21T22:16:23.505795] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-10-21T22:16:23.508386] [INFO ] [MAIN ] Derivative Progress: 1930/2057 symbols completed. VLT took 1.1s. Estimated remaining: 48.1s. Rate: 158.4 symbols/min [2025-10-21T22:16:23.508663] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:23.532367] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:23.539456] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 52963 primary records. [2025-10-21T22:16:23.539886] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:23.540125] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-10-21T22:16:23.541940] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 39297 primary records. [2025-10-21T22:16:23.549693] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-10-21T22:16:23.567868] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-10-21T22:16:23.573559] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-10-21T22:16:23.575789] [INFO ] [MAIN ] Derivative Progress: 1931/2057 symbols completed. VLO took 1.2s. Estimated remaining: 47.7s. Rate: 158.5 symbols/min [2025-10-21T22:16:23.576941] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:23.582111] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-10-21T22:16:23.582708] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-10-21T22:16:23.586093] [INFO ] [MAIN ] Derivative Progress: 1932/2057 symbols completed. VLRS took 1.2s. Estimated remaining: 47.3s. Rate: 158.6 symbols/min [2025-10-21T22:16:23.586788] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:23.614776] [DEBUG] [LOCAL ] VMI: Loaded 14976 existing records from primary storage. [2025-10-21T22:16:23.614920] [INFO ] [MAIN ] VMI: Loaded 14976 primary data records. [2025-10-21T22:16:23.693259] [DEBUG] [LOCAL ] VLTO: Loaded 46100 existing records from primary storage. [2025-10-21T22:16:23.713745] [INFO ] [MAIN ] VLTO: Loaded 46100 primary data records. [2025-10-21T22:16:23.929473] [DEBUG] [LOCAL ] VMC: Loaded 42258 existing records from primary storage. [2025-10-21T22:16:23.961062] [INFO ] [MAIN ] VMC: Loaded 42258 primary data records. [2025-10-21T22:16:24.632224] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:24.634080] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 14976 primary records. [2025-10-21T22:16:24.634386] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-10-21T22:16:24.648827] [DEBUG] [MAIN ] VLTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:24.660472] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46100 primary records. [2025-10-21T22:16:24.664512] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-10-21T22:16:24.664833] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-10-21T22:16:24.664746] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-10-21T22:16:24.667075] [INFO ] [MAIN ] Derivative Progress: 1933/2057 symbols completed. VMI took 1.1s. Estimated remaining: 47.0s. Rate: 158.4 symbols/min [2025-10-21T22:16:24.684671] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-10-21T22:16:24.686270] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-10-21T22:16:24.689140] [INFO ] [MAIN ] Derivative Progress: 1934/2057 symbols completed. VLTO took 1.2s. Estimated remaining: 46.6s. Rate: 158.5 symbols/min [2025-10-21T22:16:24.704268] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:24.704941] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 42258 primary records. [2025-10-21T22:16:24.705002] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-10-21T22:16:24.720966] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-10-21T22:16:24.721043] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-10-21T22:16:24.724755] [INFO ] [MAIN ] Derivative Progress: 1935/2057 symbols completed. VMC took 1.1s. Estimated remaining: 46.2s. Rate: 158.6 symbols/min [2025-10-21T22:16:24.725153] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:24.725227] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:24.725742] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:24.751127] [DEBUG] [LOCAL ] VMO: Loaded 20749 existing records from primary storage. [2025-10-21T22:16:24.751367] [INFO ] [MAIN ] VMO: Loaded 20749 primary data records. [2025-10-21T22:16:24.953779] [DEBUG] [LOCAL ] VNO: Loaded 48874 existing records from primary storage. [2025-10-21T22:16:25.013692] [INFO ] [MAIN ] VNO: Loaded 48874 primary data records. [2025-10-21T22:16:25.162842] [DEBUG] [LOCAL ] VNT: Loaded 43930 existing records from primary storage. [2025-10-21T22:16:25.191194] [INFO ] [MAIN ] VNT: Loaded 43930 primary data records. [2025-10-21T22:16:25.745752] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:25.747068] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20749 primary records. [2025-10-21T22:16:25.747214] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-10-21T22:16:25.765906] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-10-21T22:16:25.766111] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-10-21T22:16:25.768679] [INFO ] [MAIN ] Derivative Progress: 1936/2057 symbols completed. VMO took 1.0s. Estimated remaining: 45.8s. Rate: 158.4 symbols/min [2025-10-21T22:16:25.769077] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:25.786458] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:25.787226] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48874 primary records. [2025-10-21T22:16:25.789715] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-10-21T22:16:25.812929] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-10-21T22:16:25.813144] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-10-21T22:16:25.815844] [INFO ] [MAIN ] Derivative Progress: 1937/2057 symbols completed. VNO took 1.1s. Estimated remaining: 45.4s. Rate: 158.5 symbols/min [2025-10-21T22:16:25.805970] [DEBUG] [LOCAL ] VOC: Loaded 8997 existing records from primary storage. [2025-10-21T22:16:25.816027] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:25.816638] [INFO ] [MAIN ] VOC: Loaded 8997 primary data records. [2025-10-21T22:16:25.863109] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:25.869030] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 43930 primary records. [2025-10-21T22:16:25.875754] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-10-21T22:16:25.950573] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-10-21T22:16:25.951002] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-10-21T22:16:25.953865] [INFO ] [MAIN ] Derivative Progress: 1938/2057 symbols completed. VNT took 1.2s. Estimated remaining: 45.0s. Rate: 158.5 symbols/min [2025-10-21T22:16:25.954057] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:26.181215] [DEBUG] [LOCAL ] VPG: Loaded 16982 existing records from primary storage. [2025-10-21T22:16:26.182518] [INFO ] [MAIN ] VPG: Loaded 16982 primary data records. [2025-10-21T22:16:26.182412] [DEBUG] [LOCAL ] VOYA: Loaded 41929 existing records from primary storage. [2025-10-21T22:16:26.194736] [INFO ] [MAIN ] VOYA: Loaded 41929 primary data records. [2025-10-21T22:16:26.842347] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:26.843865] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8997 primary records. [2025-10-21T22:16:26.843997] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-10-21T22:16:26.861826] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-10-21T22:16:26.862248] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-10-21T22:16:26.864547] [INFO ] [MAIN ] Derivative Progress: 1939/2057 symbols completed. VOC took 1.1s. Estimated remaining: 44.7s. Rate: 158.4 symbols/min [2025-10-21T22:16:26.864964] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:26.887187] [DEBUG] [LOCAL ] VPV: Loaded 5414 existing records from primary storage. [2025-10-21T22:16:26.887809] [INFO ] [MAIN ] VPV: Loaded 5414 primary data records. [2025-10-21T22:16:26.887429] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:26.900512] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 16982 primary records. [2025-10-21T22:16:26.910044] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-10-21T22:16:27.019383] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:27.023847] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-10-21T22:16:27.024010] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-10-21T22:16:27.027273] [INFO ] [MAIN ] Derivative Progress: 1940/2057 symbols completed. VPG took 1.1s. Estimated remaining: 44.3s. Rate: 158.5 symbols/min [2025-10-21T22:16:27.033706] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 41929 primary records. [2025-10-21T22:16:27.032767] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:27.039019] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-10-21T22:16:27.238177] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-10-21T22:16:27.238545] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-10-21T22:16:27.241423] [INFO ] [MAIN ] Derivative Progress: 1941/2057 symbols completed. VOYA took 1.4s. Estimated remaining: 43.9s. Rate: 158.5 symbols/min [2025-10-21T22:16:27.241722] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:27.282466] [DEBUG] [LOCAL ] VRE: Loaded 35322 existing records from primary storage. [2025-10-21T22:16:27.287886] [INFO ] [MAIN ] VRE: Loaded 35322 primary data records. [2025-10-21T22:16:27.287803] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:27.309759] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5414 primary records. [2025-10-21T22:16:27.325365] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-10-21T22:16:27.438374] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-10-21T22:16:27.454757] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-10-21T22:16:27.486081] [INFO ] [MAIN ] Derivative Progress: 1942/2057 symbols completed. VPV took 0.6s. Estimated remaining: 43.5s. Rate: 158.5 symbols/min [2025-10-21T22:16:27.629379] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:27.639729] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-10-21T22:16:27.639978] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-10-21T22:16:27.745034] [DEBUG] [LOCAL ] VRTS: Loaded 9391 existing records from primary storage. [2025-10-21T22:16:27.767375] [INFO ] [MAIN ] VRTS: Loaded 9391 primary data records. [2025-10-21T22:16:28.301205] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:28.302174] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 35322 primary records. [2025-10-21T22:16:28.302278] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-10-21T22:16:28.322300] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-10-21T22:16:28.323172] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-10-21T22:16:28.325523] [INFO ] [MAIN ] Derivative Progress: 1943/2057 symbols completed. VRE took 1.3s. Estimated remaining: 43.2s. Rate: 158.4 symbols/min [2025-10-21T22:16:28.326459] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:28.348496] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:28.349514] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-10-21T22:16:28.349940] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-10-21T22:16:28.370246] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-10-21T22:16:28.370521] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-10-21T22:16:28.373307] [INFO ] [MAIN ] Derivative Progress: 1944/2057 symbols completed. VRT took 1.1s. Estimated remaining: 42.8s. Rate: 158.5 symbols/min [2025-10-21T22:16:28.387341] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:28.401363] [DEBUG] [MAIN ] VRTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:28.402276] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9391 primary records. [2025-10-21T22:16:28.402401] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-10-21T22:16:28.438142] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-10-21T22:16:28.439639] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-10-21T22:16:28.441976] [INFO ] [MAIN ] Derivative Progress: 1945/2057 symbols completed. VRTS took 0.8s. Estimated remaining: 42.4s. Rate: 158.6 symbols/min [2025-10-21T22:16:28.443475] [DEBUG] [LOCAL ] VSCO: Loaded 52708 existing records from primary storage. [2025-10-21T22:16:28.443748] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:28.444385] [INFO ] [MAIN ] VSCO: Loaded 52708 primary data records. [2025-10-21T22:16:28.830180] [DEBUG] [LOCAL ] VSH: Loaded 48240 existing records from primary storage. [2025-10-21T22:16:28.840699] [INFO ] [MAIN ] VSH: Loaded 48240 primary data records. [2025-10-21T22:16:28.961273] [DEBUG] [LOCAL ] VST: Loaded 53709 existing records from primary storage. [2025-10-21T22:16:28.973262] [INFO ] [MAIN ] VST: Loaded 53709 primary data records. [2025-10-21T22:16:29.521628] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:29.522770] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52708 primary records. [2025-10-21T22:16:29.522922] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-10-21T22:16:29.540152] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-10-21T22:16:29.540712] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-10-21T22:16:29.542938] [INFO ] [MAIN ] Derivative Progress: 1946/2057 symbols completed. VSCO took 1.2s. Estimated remaining: 42.0s. Rate: 158.4 symbols/min [2025-10-21T22:16:29.544206] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:29.564246] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:29.565348] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48240 primary records. [2025-10-21T22:16:29.566157] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-10-21T22:16:29.599227] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-10-21T22:16:29.599862] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-10-21T22:16:29.599764] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:29.601735] [INFO ] [MAIN ] Derivative Progress: 1947/2057 symbols completed. VSH took 1.2s. Estimated remaining: 41.6s. Rate: 158.5 symbols/min [2025-10-21T22:16:29.601979] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:29.614189] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53709 primary records. [2025-10-21T22:16:29.614483] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-10-21T22:16:29.631386] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-10-21T22:16:29.631672] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-10-21T22:16:29.634557] [INFO ] [MAIN ] Derivative Progress: 1948/2057 symbols completed. VST took 1.2s. Estimated remaining: 41.2s. Rate: 158.6 symbols/min [2025-10-21T22:16:29.652189] [DEBUG] [LOCAL ] VSTS: Loaded 48872 existing records from primary storage. [2025-10-21T22:16:29.652395] [INFO ] [MAIN ] VSTS: Loaded 48872 primary data records. [2025-10-21T22:16:29.971807] [DEBUG] [LOCAL ] VTEX: Loaded 42894 existing records from primary storage. [2025-10-21T22:16:29.972473] [INFO ] [MAIN ] VTEX: Loaded 42894 primary data records. [2025-10-21T22:16:30.303886] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:30.304861] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 48872 primary records. [2025-10-21T22:16:30.305261] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-10-21T22:16:30.322306] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-10-21T22:16:30.322434] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-10-21T22:16:30.325322] [INFO ] [MAIN ] Derivative Progress: 1949/2057 symbols completed. VSTS took 0.8s. Estimated remaining: 40.9s. Rate: 158.5 symbols/min [2025-10-21T22:16:30.343766] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:30.344405] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 42894 primary records. [2025-10-21T22:16:30.344469] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-10-21T22:16:30.359590] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-10-21T22:16:30.359710] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-10-21T22:16:30.362431] [INFO ] [MAIN ] Derivative Progress: 1950/2057 symbols completed. VTEX took 0.8s. Estimated remaining: 40.5s. Rate: 158.6 symbols/min [2025-10-21T22:16:30.363034] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:30.362962] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:30.363532] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:30.376022] [DEBUG] [LOCAL ] VTN: Loaded 7086 existing records from primary storage. [2025-10-21T22:16:30.376156] [INFO ] [MAIN ] VTN: Loaded 7086 primary data records. [2025-10-21T22:16:30.507872] [DEBUG] [LOCAL ] VTMX: Loaded 17484 existing records from primary storage. [2025-10-21T22:16:30.519173] [INFO ] [MAIN ] VTMX: Loaded 17484 primary data records. [2025-10-21T22:16:30.817555] [DEBUG] [LOCAL ] VTLE: Loaded 47663 existing records from primary storage. [2025-10-21T22:16:30.829878] [INFO ] [MAIN ] VTLE: Loaded 47663 primary data records. [2025-10-21T22:16:31.405229] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:31.406981] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7086 primary records. [2025-10-21T22:16:31.407829] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-10-21T22:16:31.436463] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-10-21T22:16:31.436897] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:31.437027] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-10-21T22:16:31.439250] [INFO ] [MAIN ] Derivative Progress: 1951/2057 symbols completed. VTN took 1.1s. Estimated remaining: 40.1s. Rate: 158.4 symbols/min [2025-10-21T22:16:31.439397] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:31.440545] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17484 primary records. [2025-10-21T22:16:31.440952] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-10-21T22:16:31.460343] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-10-21T22:16:31.460668] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-10-21T22:16:31.479517] [INFO ] [MAIN ] Derivative Progress: 1952/2057 symbols completed. VTMX took 1.1s. Estimated remaining: 39.7s. Rate: 158.5 symbols/min [2025-10-21T22:16:31.480189] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:31.480505] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:31.481610] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 47663 primary records. [2025-10-21T22:16:31.481810] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-10-21T22:16:31.500512] [DEBUG] [LOCAL ] VTOL: Loaded 19443 existing records from primary storage. [2025-10-21T22:16:31.504806] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-10-21T22:16:31.505011] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-10-21T22:16:31.503450] [INFO ] [MAIN ] VTOL: Loaded 19443 primary data records. [2025-10-21T22:16:31.507674] [INFO ] [MAIN ] Derivative Progress: 1953/2057 symbols completed. VTLE took 1.1s. Estimated remaining: 39.4s. Rate: 158.6 symbols/min [2025-10-21T22:16:31.507958] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:31.847002] [DEBUG] [LOCAL ] VTR: Loaded 52712 existing records from primary storage. [2025-10-21T22:16:31.848480] [INFO ] [MAIN ] VTR: Loaded 52712 primary data records. [2025-10-21T22:16:31.849155] [DEBUG] [LOCAL ] VTS: Loaded 29970 existing records from primary storage. [2025-10-21T22:16:31.861526] [INFO ] [MAIN ] VTS: Loaded 29970 primary data records. [2025-10-21T22:16:32.475266] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:32.476390] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19443 primary records. [2025-10-21T22:16:32.477445] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-10-21T22:16:32.497811] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-10-21T22:16:32.498203] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-10-21T22:16:32.500542] [INFO ] [MAIN ] Derivative Progress: 1954/2057 symbols completed. VTOL took 1.1s. Estimated remaining: 39.0s. Rate: 158.4 symbols/min [2025-10-21T22:16:32.500952] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:32.523085] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:32.524127] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52712 primary records. [2025-10-21T22:16:32.524345] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-10-21T22:16:32.538287] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:32.539501] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 29970 primary records. [2025-10-21T22:16:32.539827] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-10-21T22:16:32.575359] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-10-21T22:16:32.575893] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-10-21T22:16:32.591582] [INFO ] [MAIN ] Derivative Progress: 1955/2057 symbols completed. VTR took 1.1s. Estimated remaining: 38.6s. Rate: 158.5 symbols/min [2025-10-21T22:16:32.594133] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-10-21T22:16:32.594515] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:32.594398] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-10-21T22:16:32.595284] [DEBUG] [LOCAL ] VVR: Loaded 31317 existing records from primary storage. [2025-10-21T22:16:32.598121] [INFO ] [MAIN ] VVR: Loaded 31317 primary data records. [2025-10-21T22:16:32.597887] [INFO ] [MAIN ] Derivative Progress: 1956/2057 symbols completed. VTS took 1.1s. Estimated remaining: 38.2s. Rate: 158.6 symbols/min [2025-10-21T22:16:32.603511] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:32.837389] [DEBUG] [LOCAL ] VVX: Loaded 23041 existing records from primary storage. [2025-10-21T22:16:32.982723] [INFO ] [MAIN ] VVX: Loaded 23041 primary data records. [2025-10-21T22:16:33.125112] [DEBUG] [LOCAL ] VVV: Loaded 50174 existing records from primary storage. [2025-10-21T22:16:33.152068] [INFO ] [MAIN ] VVV: Loaded 50174 primary data records. [2025-10-21T22:16:33.804093] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:33.806299] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 31317 primary records. [2025-10-21T22:16:33.806540] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-10-21T22:16:33.831455] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-10-21T22:16:33.832029] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-10-21T22:16:33.835876] [INFO ] [MAIN ] Derivative Progress: 1957/2057 symbols completed. VVR took 1.3s. Estimated remaining: 37.9s. Rate: 158.4 symbols/min [2025-10-21T22:16:33.837032] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:33.858379] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:33.859447] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23041 primary records. [2025-10-21T22:16:33.859885] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-10-21T22:16:33.885084] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-10-21T22:16:33.887212] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-10-21T22:16:33.889964] [INFO ] [MAIN ] Derivative Progress: 1958/2057 symbols completed. VVX took 1.3s. Estimated remaining: 37.5s. Rate: 158.5 symbols/min [2025-10-21T22:16:33.890464] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:33.917406] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:33.918273] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50174 primary records. [2025-10-21T22:16:33.918398] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-10-21T22:16:33.935604] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-10-21T22:16:33.960077] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-10-21T22:16:33.966029] [DEBUG] [LOCAL ] VYX: Loaded 48341 existing records from primary storage. [2025-10-21T22:16:33.966425] [INFO ] [MAIN ] VYX: Loaded 48341 primary data records. [2025-10-21T22:16:33.963740] [INFO ] [MAIN ] Derivative Progress: 1959/2057 symbols completed. VVV took 1.4s. Estimated remaining: 37.1s. Rate: 158.5 symbols/min [2025-10-21T22:16:33.972349] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:34.360602] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-10-21T22:16:34.378461] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-10-21T22:16:34.518897] [DEBUG] [LOCAL ] W: Loaded 53408 existing records from primary storage. [2025-10-21T22:16:34.524423] [INFO ] [MAIN ] W: Loaded 53408 primary data records. [2025-10-21T22:16:35.107542] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:35.108360] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 48341 primary records. [2025-10-21T22:16:35.108777] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-10-21T22:16:35.127878] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-10-21T22:16:35.129396] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-10-21T22:16:35.131915] [INFO ] [MAIN ] Derivative Progress: 1960/2057 symbols completed. VYX took 1.3s. Estimated remaining: 36.8s. Rate: 158.4 symbols/min [2025-10-21T22:16:35.132257] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:35.147353] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:35.148448] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-10-21T22:16:35.148751] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-10-21T22:16:35.167085] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-10-21T22:16:35.167404] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-10-21T22:16:35.169929] [INFO ] [MAIN ] Derivative Progress: 1961/2057 symbols completed. VZ took 1.3s. Estimated remaining: 36.4s. Rate: 158.4 symbols/min [2025-10-21T22:16:35.171139] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:35.186545] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:35.187299] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53408 primary records. [2025-10-21T22:16:35.187419] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-10-21T22:16:35.213443] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-10-21T22:16:35.213602] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-10-21T22:16:35.217438] [INFO ] [MAIN ] Derivative Progress: 1962/2057 symbols completed. W took 1.2s. Estimated remaining: 36.0s. Rate: 158.5 symbols/min [2025-10-21T22:16:35.217870] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:35.235612] [DEBUG] [LOCAL ] WAB: Loaded 43805 existing records from primary storage. [2025-10-21T22:16:35.235874] [INFO ] [MAIN ] WAB: Loaded 43805 primary data records. [2025-10-21T22:16:35.407200] [DEBUG] [LOCAL ] WAL: Loaded 45675 existing records from primary storage. [2025-10-21T22:16:35.435523] [INFO ] [MAIN ] WAL: Loaded 45675 primary data records. [2025-10-21T22:16:35.594931] [DEBUG] [LOCAL ] WAT: Loaded 35721 existing records from primary storage. [2025-10-21T22:16:35.624759] [INFO ] [MAIN ] WAT: Loaded 35721 primary data records. [2025-10-21T22:16:36.227774] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:16:36.229491] [INFO ] [MAIN ] WAB: Generated 1793 derivative records from 43805 primary records. [2025-10-21T22:16:36.229627] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-10-21T22:16:36.248291] [DEBUG] [LOCAL ] WAB: Derivative data saved (1793 records). [2025-10-21T22:16:36.249524] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-10-21T22:16:36.252265] [INFO ] [MAIN ] Derivative Progress: 1963/2057 symbols completed. WAB took 1.1s. Estimated remaining: 35.6s. Rate: 158.4 symbols/min [2025-10-21T22:16:36.267483] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:36.268236] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45675 primary records. [2025-10-21T22:16:36.268376] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-10-21T22:16:36.298589] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:36.298338] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-10-21T22:16:36.299317] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35721 primary records. [2025-10-21T22:16:36.299417] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-10-21T22:16:36.301563] [INFO ] [MAIN ] Derivative Progress: 1964/2057 symbols completed. WAL took 1.1s. Estimated remaining: 35.2s. Rate: 158.4 symbols/min [2025-10-21T22:16:36.299504] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-10-21T22:16:36.317139] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-10-21T22:16:36.317218] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-10-21T22:16:36.320300] [INFO ] [MAIN ] Derivative Progress: 1965/2057 symbols completed. WAT took 1.1s. Estimated remaining: 34.8s. Rate: 158.5 symbols/min [2025-10-21T22:16:36.320825] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:36.320740] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:36.321051] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:36.337156] [DEBUG] [LOCAL ] WBX: Loaded 10081 existing records from primary storage. [2025-10-21T22:16:36.337540] [INFO ] [MAIN ] WBX: Loaded 10081 primary data records. [2025-10-21T22:16:36.472865] [DEBUG] [LOCAL ] WCC: Loaded 38619 existing records from primary storage. [2025-10-21T22:16:36.482606] [INFO ] [MAIN ] WCC: Loaded 38619 primary data records. [2025-10-21T22:16:36.780883] [DEBUG] [LOCAL ] WBS: Loaded 48842 existing records from primary storage. [2025-10-21T22:16:36.808321] [INFO ] [MAIN ] WBS: Loaded 48842 primary data records. [2025-10-21T22:16:37.392092] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:37.393521] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 10081 primary records. [2025-10-21T22:16:37.394003] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-10-21T22:16:37.411517] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-10-21T22:16:37.412913] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-10-21T22:16:37.415250] [INFO ] [MAIN ] Derivative Progress: 1966/2057 symbols completed. WBX took 1.1s. Estimated remaining: 34.5s. Rate: 158.4 symbols/min [2025-10-21T22:16:37.415865] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:37.434255] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:37.435027] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 38619 primary records. [2025-10-21T22:16:37.435222] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-10-21T22:16:37.456775] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-10-21T22:16:37.457157] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-10-21T22:16:37.459842] [INFO ] [MAIN ] Derivative Progress: 1967/2057 symbols completed. WCC took 1.1s. Estimated remaining: 34.1s. Rate: 158.4 symbols/min [2025-10-21T22:16:37.459999] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:37.473490] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:37.474089] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48842 primary records. [2025-10-21T22:16:37.474148] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-10-21T22:16:37.503432] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-10-21T22:16:37.503628] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-10-21T22:16:37.506261] [INFO ] [MAIN ] Derivative Progress: 1968/2057 symbols completed. WBS took 1.2s. Estimated remaining: 33.7s. Rate: 158.5 symbols/min [2025-10-21T22:16:37.506769] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:37.539316] [DEBUG] [LOCAL ] WCN: Loaded 47894 existing records from primary storage. [2025-10-21T22:16:37.538020] [DEBUG] [LOCAL ] WD: Loaded 22704 existing records from primary storage. [2025-10-21T22:16:37.539693] [INFO ] [MAIN ] WD: Loaded 22704 primary data records. [2025-10-21T22:16:37.539581] [INFO ] [MAIN ] WCN: Loaded 47894 primary data records. [2025-10-21T22:16:37.703744] [DEBUG] [LOCAL ] WDH: Loaded 18141 existing records from primary storage. [2025-10-21T22:16:37.739934] [INFO ] [MAIN ] WDH: Loaded 18141 primary data records. [2025-10-21T22:16:38.545519] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:38.546593] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 22704 primary records. [2025-10-21T22:16:38.546928] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-10-21T22:16:38.567995] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-10-21T22:16:38.568447] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-10-21T22:16:38.570884] [INFO ] [MAIN ] Derivative Progress: 1969/2057 symbols completed. WD took 1.1s. Estimated remaining: 33.3s. Rate: 158.4 symbols/min [2025-10-21T22:16:38.583694] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:38.597590] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:38.597426] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:38.599210] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 18141 primary records. [2025-10-21T22:16:38.599339] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 47894 primary records. [2025-10-21T22:16:38.599597] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-10-21T22:16:38.599446] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-10-21T22:16:38.633729] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-10-21T22:16:38.637766] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-10-21T22:16:38.640623] [INFO ] [MAIN ] Derivative Progress: 1970/2057 symbols completed. WCN took 1.2s. Estimated remaining: 32.9s. Rate: 158.4 symbols/min [2025-10-21T22:16:38.641756] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-10-21T22:16:38.641875] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:38.642030] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-10-21T22:16:38.644835] [INFO ] [MAIN ] Derivative Progress: 1971/2057 symbols completed. WDH took 1.1s. Estimated remaining: 32.6s. Rate: 158.5 symbols/min [2025-10-21T22:16:38.645183] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:38.655617] [DEBUG] [LOCAL ] WDI: Loaded 21320 existing records from primary storage. [2025-10-21T22:16:38.655888] [INFO ] [MAIN ] WDI: Loaded 21320 primary data records. [2025-10-21T22:16:38.732675] [DEBUG] [LOCAL ] WEA: Loaded 7901 existing records from primary storage. [2025-10-21T22:16:38.766639] [INFO ] [MAIN ] WEA: Loaded 7901 primary data records. [2025-10-21T22:16:39.117260] [DEBUG] [LOCAL ] WDS: Loaded 43057 existing records from primary storage. [2025-10-21T22:16:39.134672] [INFO ] [MAIN ] WDS: Loaded 43057 primary data records. [2025-10-21T22:16:39.672014] [DEBUG] [MAIN ] WDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:39.673586] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21320 primary records. [2025-10-21T22:16:39.674513] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-10-21T22:16:39.694345] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-10-21T22:16:39.694746] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-10-21T22:16:39.697256] [INFO ] [MAIN ] Derivative Progress: 1972/2057 symbols completed. WDI took 1.1s. Estimated remaining: 32.2s. Rate: 158.4 symbols/min [2025-10-21T22:16:39.697610] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:39.717874] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:39.718722] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7901 primary records. [2025-10-21T22:16:39.719144] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-10-21T22:16:39.737277] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-10-21T22:16:39.737833] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-10-21T22:16:39.740438] [INFO ] [MAIN ] Derivative Progress: 1973/2057 symbols completed. WEA took 1.1s. Estimated remaining: 31.8s. Rate: 158.4 symbols/min [2025-10-21T22:16:39.740914] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:39.768605] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:39.769605] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43057 primary records. [2025-10-21T22:16:39.769746] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-10-21T22:16:39.801434] [DEBUG] [LOCAL ] WEAV: Loaded 42398 existing records from primary storage. [2025-10-21T22:16:39.803109] [INFO ] [MAIN ] WEAV: Loaded 42398 primary data records. [2025-10-21T22:16:39.803031] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-10-21T22:16:39.803247] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-10-21T22:16:39.806185] [INFO ] [MAIN ] Derivative Progress: 1974/2057 symbols completed. WDS took 1.2s. Estimated remaining: 31.4s. Rate: 158.5 symbols/min [2025-10-21T22:16:39.818345] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:40.065670] [DEBUG] [LOCAL ] WEC: Loaded 52175 existing records from primary storage. [2025-10-21T22:16:40.190960] [INFO ] [MAIN ] WEC: Loaded 52175 primary data records. [2025-10-21T22:16:40.315146] [DEBUG] [LOCAL ] WELL: Loaded 52310 existing records from primary storage. [2025-10-21T22:16:40.319424] [INFO ] [MAIN ] WELL: Loaded 52310 primary data records. [2025-10-21T22:16:40.844368] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:40.845407] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42398 primary records. [2025-10-21T22:16:40.845564] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-10-21T22:16:40.866578] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-10-21T22:16:40.866999] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-10-21T22:16:40.870541] [INFO ] [MAIN ] Derivative Progress: 1975/2057 symbols completed. WEAV took 1.2s. Estimated remaining: 31.1s. Rate: 158.4 symbols/min [2025-10-21T22:16:40.871775] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:40.892966] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:40.894844] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52175 primary records. [2025-10-21T22:16:40.895803] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-10-21T22:16:40.924387] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:40.926926] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52310 primary records. [2025-10-21T22:16:40.927046] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-10-21T22:16:40.942868] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-10-21T22:16:40.943507] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-10-21T22:16:40.945702] [INFO ] [MAIN ] Derivative Progress: 1976/2057 symbols completed. WEC took 1.2s. Estimated remaining: 30.7s. Rate: 158.4 symbols/min [2025-10-21T22:16:40.953471] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:40.963122] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-10-21T22:16:40.964081] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-10-21T22:16:40.967040] [INFO ] [MAIN ] Derivative Progress: 1977/2057 symbols completed. WELL took 1.1s. Estimated remaining: 30.3s. Rate: 158.5 symbols/min [2025-10-21T22:16:40.981274] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:40.983979] [DEBUG] [LOCAL ] WES: Loaded 48732 existing records from primary storage. [2025-10-21T22:16:40.984297] [INFO ] [MAIN ] WES: Loaded 48732 primary data records. [2025-10-21T22:16:41.123622] [DEBUG] [LOCAL ] WF: Loaded 10842 existing records from primary storage. [2025-10-21T22:16:41.155736] [INFO ] [MAIN ] WF: Loaded 10842 primary data records. [2025-10-21T22:16:41.235198] [DEBUG] [LOCAL ] WEX: Loaded 32548 existing records from primary storage. [2025-10-21T22:16:41.258700] [INFO ] [MAIN ] WEX: Loaded 32548 primary data records. [2025-10-21T22:16:42.045326] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:42.046521] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48732 primary records. [2025-10-21T22:16:42.047966] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-10-21T22:16:42.068274] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-10-21T22:16:42.076549] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-10-21T22:16:42.083941] [INFO ] [MAIN ] Derivative Progress: 1978/2057 symbols completed. WES took 1.2s. Estimated remaining: 29.9s. Rate: 158.3 symbols/min [2025-10-21T22:16:42.084870] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:42.085918] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 10842 primary records. [2025-10-21T22:16:42.086118] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-10-21T22:16:42.104020] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-10-21T22:16:42.116574] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-10-21T22:16:42.116867] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:42.119388] [INFO ] [MAIN ] Derivative Progress: 1979/2057 symbols completed. WF took 1.1s. Estimated remaining: 29.5s. Rate: 158.4 symbols/min [2025-10-21T22:16:42.120161] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 32548 primary records. [2025-10-21T22:16:42.120251] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-10-21T22:16:42.136415] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-10-21T22:16:42.136593] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-10-21T22:16:42.139352] [INFO ] [MAIN ] Derivative Progress: 1980/2057 symbols completed. WEX took 1.2s. Estimated remaining: 29.2s. Rate: 158.5 symbols/min [2025-10-21T22:16:42.139833] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:42.139964] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:42.140759] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:42.176225] [DEBUG] [LOCAL ] WFG: Loaded 24602 existing records from primary storage. [2025-10-21T22:16:42.176417] [INFO ] [MAIN ] WFG: Loaded 24602 primary data records. [2025-10-21T22:16:42.318535] [DEBUG] [LOCAL ] WGO: Loaded 37930 existing records from primary storage. [2025-10-21T22:16:42.328743] [INFO ] [MAIN ] WGO: Loaded 37930 primary data records. [2025-10-21T22:16:42.437442] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-10-21T22:16:42.571838] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-10-21T22:16:43.236365] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:43.237360] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 24602 primary records. [2025-10-21T22:16:43.237538] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-10-21T22:16:43.257218] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-10-21T22:16:43.271381] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-10-21T22:16:43.274213] [INFO ] [MAIN ] Derivative Progress: 1981/2057 symbols completed. WFG took 1.1s. Estimated remaining: 28.8s. Rate: 158.3 symbols/min [2025-10-21T22:16:43.271725] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:43.274538] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:43.276680] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 37930 primary records. [2025-10-21T22:16:43.277665] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-10-21T22:16:43.310202] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-10-21T22:16:43.310844] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:43.310902] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-10-21T22:16:43.314989] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-10-21T22:16:43.314015] [INFO ] [MAIN ] Derivative Progress: 1982/2057 symbols completed. WGO took 1.2s. Estimated remaining: 28.4s. Rate: 158.4 symbols/min [2025-10-21T22:16:43.315121] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-10-21T22:16:43.316217] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:43.333814] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-10-21T22:16:43.334068] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-10-21T22:16:43.336859] [INFO ] [MAIN ] Derivative Progress: 1983/2057 symbols completed. WFC took 1.2s. Estimated remaining: 28.0s. Rate: 158.5 symbols/min [2025-10-21T22:16:43.337286] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:43.343251] [DEBUG] [LOCAL ] WHG: Loaded 3061 existing records from primary storage. [2025-10-21T22:16:43.353468] [INFO ] [MAIN ] WHG: Loaded 3061 primary data records. [2025-10-21T22:16:43.491761] [DEBUG] [LOCAL ] WH: Loaded 45230 existing records from primary storage. [2025-10-21T22:16:43.524612] [INFO ] [MAIN ] WH: Loaded 45230 primary data records. [2025-10-21T22:16:43.552213] [DEBUG] [LOCAL ] WHD: Loaded 39984 existing records from primary storage. [2025-10-21T22:16:43.592685] [INFO ] [MAIN ] WHD: Loaded 39984 primary data records. [2025-10-21T22:16:44.338181] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:44.339377] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3061 primary records. [2025-10-21T22:16:44.340789] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-10-21T22:16:44.358583] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-10-21T22:16:44.358934] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-10-21T22:16:44.361196] [INFO ] [MAIN ] Derivative Progress: 1984/2057 symbols completed. WHG took 1.0s. Estimated remaining: 27.7s. Rate: 158.3 symbols/min [2025-10-21T22:16:44.361507] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:44.376031] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:16:44.376980] [INFO ] [MAIN ] WH: Generated 1793 derivative records from 45230 primary records. [2025-10-21T22:16:44.377146] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-10-21T22:16:44.409567] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:44.412124] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 39984 primary records. [2025-10-21T22:16:44.411296] [DEBUG] [LOCAL ] WH: Derivative data saved (1793 records). [2025-10-21T22:16:44.412353] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-10-21T22:16:44.412451] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-10-21T22:16:44.415215] [INFO ] [MAIN ] Derivative Progress: 1985/2057 symbols completed. WH took 1.1s. Estimated remaining: 27.3s. Rate: 158.4 symbols/min [2025-10-21T22:16:44.415942] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:44.432470] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-10-21T22:16:44.434051] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-10-21T22:16:44.436855] [INFO ] [MAIN ] Derivative Progress: 1986/2057 symbols completed. WHD took 1.1s. Estimated remaining: 26.9s. Rate: 158.5 symbols/min [2025-10-21T22:16:44.437160] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:44.441283] [DEBUG] [LOCAL ] WIA: Loaded 5024 existing records from primary storage. [2025-10-21T22:16:44.451959] [INFO ] [MAIN ] WIA: Loaded 5024 primary data records. [2025-10-21T22:16:44.567957] [DEBUG] [LOCAL ] WINN: Loaded 11361 existing records from primary storage. [2025-10-21T22:16:44.582883] [INFO ] [MAIN ] WINN: Loaded 11361 primary data records. [2025-10-21T22:16:44.615686] [DEBUG] [LOCAL ] WHR: Loaded 48906 existing records from primary storage. [2025-10-21T22:16:44.631183] [INFO ] [MAIN ] WHR: Loaded 48906 primary data records. [2025-10-21T22:16:45.463794] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:45.464953] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 5024 primary records. [2025-10-21T22:16:45.465188] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-10-21T22:16:45.478860] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:45.486446] [INFO ] [MAIN ] WINN: Generated 1794 derivative records from 11361 primary records. [2025-10-21T22:16:45.488984] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-10-21T22:16:45.496015] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-10-21T22:16:45.504133] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-10-21T22:16:45.513798] [INFO ] [MAIN ] Derivative Progress: 1987/2057 symbols completed. WIA took 1.1s. Estimated remaining: 26.5s. Rate: 158.3 symbols/min [2025-10-21T22:16:45.525672] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:45.525964] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:45.526789] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48906 primary records. [2025-10-21T22:16:45.526956] [DEBUG] [LOCAL ] WINN: Derivative data saved (1794 records). [2025-10-21T22:16:45.526895] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-10-21T22:16:45.527259] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-10-21T22:16:45.530561] [INFO ] [MAIN ] Derivative Progress: 1988/2057 symbols completed. WINN took 1.1s. Estimated remaining: 26.1s. Rate: 158.4 symbols/min [2025-10-21T22:16:45.530733] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:45.549342] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-10-21T22:16:45.549684] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-10-21T22:16:45.552466] [INFO ] [MAIN ] Derivative Progress: 1989/2057 symbols completed. WHR took 1.2s. Estimated remaining: 25.7s. Rate: 158.5 symbols/min [2025-10-21T22:16:45.552942] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:45.583123] [DEBUG] [LOCAL ] WIW: Loaded 20275 existing records from primary storage. [2025-10-21T22:16:45.583301] [INFO ] [MAIN ] WIW: Loaded 20275 primary data records. [2025-10-21T22:16:45.714420] [DEBUG] [LOCAL ] WIT: Loaded 52532 existing records from primary storage. [2025-10-21T22:16:45.725268] [INFO ] [MAIN ] WIT: Loaded 52532 primary data records. [2025-10-21T22:16:45.910133] [DEBUG] [LOCAL ] WK: Loaded 37158 existing records from primary storage. [2025-10-21T22:16:46.035600] [INFO ] [MAIN ] WK: Loaded 37158 primary data records. [2025-10-21T22:16:46.564033] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:46.565235] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20275 primary records. [2025-10-21T22:16:46.565338] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-10-21T22:16:46.583701] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-10-21T22:16:46.584922] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-10-21T22:16:46.587197] [INFO ] [MAIN ] Derivative Progress: 1990/2057 symbols completed. WIW took 1.1s. Estimated remaining: 25.4s. Rate: 158.3 symbols/min [2025-10-21T22:16:46.587422] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:46.600408] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:46.601254] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52532 primary records. [2025-10-21T22:16:46.601591] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-10-21T22:16:46.618040] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-10-21T22:16:46.618167] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-10-21T22:16:46.620687] [INFO ] [MAIN ] Derivative Progress: 1991/2057 symbols completed. WIT took 1.1s. Estimated remaining: 25.0s. Rate: 158.4 symbols/min [2025-10-21T22:16:46.620917] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:46.638636] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:46.639503] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 37158 primary records. [2025-10-21T22:16:46.639711] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-10-21T22:16:46.659450] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-10-21T22:16:46.659887] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-10-21T22:16:46.663296] [INFO ] [MAIN ] Derivative Progress: 1992/2057 symbols completed. WK took 1.1s. Estimated remaining: 24.6s. Rate: 158.5 symbols/min [2025-10-21T22:16:46.663512] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:46.695351] [DEBUG] [LOCAL ] WKC: Loaded 34474 existing records from primary storage. [2025-10-21T22:16:46.697143] [INFO ] [MAIN ] WKC: Loaded 34474 primary data records. [2025-10-21T22:16:46.756967] [DEBUG] [LOCAL ] WLKP: Loaded 7223 existing records from primary storage. [2025-10-21T22:16:46.771632] [INFO ] [MAIN ] WLKP: Loaded 7223 primary data records. [2025-10-21T22:16:46.889327] [DEBUG] [LOCAL ] WLK: Loaded 45878 existing records from primary storage. [2025-10-21T22:16:46.921989] [INFO ] [MAIN ] WLK: Loaded 45878 primary data records. [2025-10-21T22:16:47.684808] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:47.697535] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 34474 primary records. [2025-10-21T22:16:47.697803] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-10-21T22:16:47.713759] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:47.714775] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 7223 primary records. [2025-10-21T22:16:47.723528] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-10-21T22:16:47.719229] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-10-21T22:16:47.724667] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-10-21T22:16:47.726911] [INFO ] [MAIN ] Derivative Progress: 1993/2057 symbols completed. WKC took 1.1s. Estimated remaining: 24.3s. Rate: 158.3 symbols/min [2025-10-21T22:16:47.761408] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:47.762845] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45878 primary records. [2025-10-21T22:16:47.763619] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-10-21T22:16:47.766007] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-10-21T22:16:47.766105] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-10-21T22:16:47.776280] [INFO ] [MAIN ] Derivative Progress: 1994/2057 symbols completed. WLKP took 1.1s. Estimated remaining: 23.9s. Rate: 158.4 symbols/min [2025-10-21T22:16:47.783758] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-10-21T22:16:47.783822] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-10-21T22:16:47.786559] [INFO ] [MAIN ] Derivative Progress: 1995/2057 symbols completed. WLK took 1.2s. Estimated remaining: 23.5s. Rate: 158.5 symbols/min [2025-10-21T22:16:47.786965] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:47.787093] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:47.786909] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:47.833359] [DEBUG] [LOCAL ] WLY: Loaded 29776 existing records from primary storage. [2025-10-21T22:16:47.833484] [INFO ] [MAIN ] WLY: Loaded 29776 primary data records. [2025-10-21T22:16:48.009979] [DEBUG] [LOCAL ] WMB: Loaded 53672 existing records from primary storage. [2025-10-21T22:16:48.021822] [INFO ] [MAIN ] WMB: Loaded 53672 primary data records. [2025-10-21T22:16:48.280876] [DEBUG] [LOCAL ] WM: Loaded 50876 existing records from primary storage. [2025-10-21T22:16:48.300937] [INFO ] [MAIN ] WM: Loaded 50876 primary data records. [2025-10-21T22:16:48.843358] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:48.844274] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 29776 primary records. [2025-10-21T22:16:48.844514] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-10-21T22:16:48.863957] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-10-21T22:16:48.865177] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-10-21T22:16:48.867556] [INFO ] [MAIN ] Derivative Progress: 1996/2057 symbols completed. WLY took 1.1s. Estimated remaining: 23.1s. Rate: 158.3 symbols/min [2025-10-21T22:16:48.867876] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:48.881412] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:48.882238] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53672 primary records. [2025-10-21T22:16:48.882388] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-10-21T22:16:48.905128] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-10-21T22:16:48.912903] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-10-21T22:16:48.918014] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:48.921369] [INFO ] [MAIN ] Derivative Progress: 1997/2057 symbols completed. WMB took 1.1s. Estimated remaining: 22.7s. Rate: 158.4 symbols/min [2025-10-21T22:16:48.921828] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:48.927805] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 50876 primary records. [2025-10-21T22:16:48.927967] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-10-21T22:16:48.929159] [DEBUG] [LOCAL ] WMK: Loaded 14738 existing records from primary storage. [2025-10-21T22:16:48.929399] [INFO ] [MAIN ] WMK: Loaded 14738 primary data records. [2025-10-21T22:16:49.003067] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-10-21T22:16:49.035729] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-10-21T22:16:49.058436] [INFO ] [MAIN ] Derivative Progress: 1998/2057 symbols completed. WM took 1.3s. Estimated remaining: 22.3s. Rate: 158.5 symbols/min [2025-10-21T22:16:49.058975] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:49.316167] [DEBUG] [LOCAL ] WMS: Loaded 39604 existing records from primary storage. [2025-10-21T22:16:49.316471] [INFO ] [MAIN ] WMS: Loaded 39604 primary data records. [2025-10-21T22:16:49.656033] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-10-21T22:16:49.657730] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-10-21T22:16:49.804572] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:49.821020] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14738 primary records. [2025-10-21T22:16:49.821236] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-10-21T22:16:50.006791] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-10-21T22:16:50.007088] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-10-21T22:16:50.009279] [INFO ] [MAIN ] Derivative Progress: 1999/2057 symbols completed. WMK took 1.1s. Estimated remaining: 22.0s. Rate: 158.3 symbols/min [2025-10-21T22:16:50.010365] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:50.029929] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:50.031565] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39604 primary records. [2025-10-21T22:16:50.031716] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-10-21T22:16:50.051507] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-10-21T22:16:50.051961] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-10-21T22:16:50.054782] [INFO ] [MAIN ] Derivative Progress: 2000/2057 symbols completed. WMS took 1.1s. Estimated remaining: 21.6s. Rate: 158.4 symbols/min [2025-10-21T22:16:50.055132] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:50.095719] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:50.098080] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-10-21T22:16:50.098292] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-10-21T22:16:50.099150] [DEBUG] [LOCAL ] WNC: Loaded 38268 existing records from primary storage. [2025-10-21T22:16:50.100151] [INFO ] [MAIN ] WNC: Loaded 38268 primary data records. [2025-10-21T22:16:50.182595] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-10-21T22:16:50.219770] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-10-21T22:16:50.222525] [INFO ] [MAIN ] Derivative Progress: 2001/2057 symbols completed. WMT took 1.2s. Estimated remaining: 21.2s. Rate: 158.5 symbols/min [2025-10-21T22:16:50.239869] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:50.333002] [DEBUG] [LOCAL ] WOLF: Loaded 53084 existing records from primary storage. [2025-10-21T22:16:50.343099] [INFO ] [MAIN ] WOLF: Loaded 53084 primary data records. [2025-10-21T22:16:50.547545] [DEBUG] [LOCAL ] WOR: Loaded 23644 existing records from primary storage. [2025-10-21T22:16:50.559171] [INFO ] [MAIN ] WOR: Loaded 23644 primary data records. [2025-10-21T22:16:51.129892] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:51.131006] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 38268 primary records. [2025-10-21T22:16:51.131364] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-10-21T22:16:51.149660] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-10-21T22:16:51.150610] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-10-21T22:16:51.153397] [INFO ] [MAIN ] Derivative Progress: 2002/2057 symbols completed. WNC took 1.1s. Estimated remaining: 20.8s. Rate: 158.3 symbols/min [2025-10-21T22:16:51.153863] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:51.169603] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:51.170569] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53084 primary records. [2025-10-21T22:16:51.171016] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-10-21T22:16:51.191779] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-10-21T22:16:51.192062] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-10-21T22:16:51.194772] [INFO ] [MAIN ] Derivative Progress: 2003/2057 symbols completed. WOLF took 1.1s. Estimated remaining: 20.5s. Rate: 158.4 symbols/min [2025-10-21T22:16:51.202756] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:51.215926] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:51.216704] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 23644 primary records. [2025-10-21T22:16:51.216997] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-10-21T22:16:51.242430] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-10-21T22:16:51.242560] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-10-21T22:16:51.245919] [INFO ] [MAIN ] Derivative Progress: 2004/2057 symbols completed. WOR took 1.0s. Estimated remaining: 20.1s. Rate: 158.5 symbols/min [2025-10-21T22:16:51.246140] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:51.243041] [DEBUG] [LOCAL ] WOW: Loaded 31132 existing records from primary storage. [2025-10-21T22:16:51.246696] [INFO ] [MAIN ] WOW: Loaded 31132 primary data records. [2025-10-21T22:16:51.600819] [DEBUG] [LOCAL ] WPC: Loaded 48169 existing records from primary storage. [2025-10-21T22:16:51.601082] [INFO ] [MAIN ] WPC: Loaded 48169 primary data records. [2025-10-21T22:16:51.732534] [DEBUG] [LOCAL ] WPM: Loaded 52787 existing records from primary storage. [2025-10-21T22:16:51.785787] [INFO ] [MAIN ] WPM: Loaded 52787 primary data records. [2025-10-21T22:16:52.258044] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:52.258857] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 31132 primary records. [2025-10-21T22:16:52.259125] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-10-21T22:16:52.291379] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-10-21T22:16:52.293290] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-10-21T22:16:52.293207] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:52.295894] [INFO ] [MAIN ] Derivative Progress: 2005/2057 symbols completed. WOW took 1.1s. Estimated remaining: 19.7s. Rate: 158.3 symbols/min [2025-10-21T22:16:52.297017] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48169 primary records. [2025-10-21T22:16:52.297507] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-10-21T22:16:52.297241] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:52.314409] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-10-21T22:16:52.314541] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-10-21T22:16:52.316622] [INFO ] [MAIN ] Derivative Progress: 2006/2057 symbols completed. WPC took 1.1s. Estimated remaining: 19.3s. Rate: 158.4 symbols/min [2025-10-21T22:16:52.316966] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:52.334574] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:52.335287] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52787 primary records. [2025-10-21T22:16:52.335457] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-10-21T22:16:52.371027] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-10-21T22:16:52.371318] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-10-21T22:16:52.374156] [INFO ] [MAIN ] Derivative Progress: 2007/2057 symbols completed. WPM took 1.1s. Estimated remaining: 18.9s. Rate: 158.5 symbols/min [2025-10-21T22:16:52.375272] [DEBUG] [LOCAL ] WPP: Loaded 34389 existing records from primary storage. [2025-10-21T22:16:52.375383] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:52.375808] [INFO ] [MAIN ] WPP: Loaded 34389 primary data records. [2025-10-21T22:16:52.513291] [DEBUG] [LOCAL ] WRB: Loaded 50782 existing records from primary storage. [2025-10-21T22:16:52.523895] [INFO ] [MAIN ] WRB: Loaded 50782 primary data records. [2025-10-21T22:16:53.044889] [DEBUG] [LOCAL ] WRBY: Loaded 50694 existing records from primary storage. [2025-10-21T22:16:53.045150] [INFO ] [MAIN ] WRBY: Loaded 50694 primary data records. [2025-10-21T22:16:53.425448] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:53.426743] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 34389 primary records. [2025-10-21T22:16:53.426943] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-10-21T22:16:53.446724] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-10-21T22:16:53.446936] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-10-21T22:16:53.456961] [INFO ] [MAIN ] Derivative Progress: 2008/2057 symbols completed. WPP took 1.2s. Estimated remaining: 18.6s. Rate: 158.3 symbols/min [2025-10-21T22:16:53.462434] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:53.463210] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50782 primary records. [2025-10-21T22:16:53.463631] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-10-21T22:16:53.480301] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-10-21T22:16:53.480389] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-10-21T22:16:53.483305] [INFO ] [MAIN ] Derivative Progress: 2009/2057 symbols completed. WRB took 1.2s. Estimated remaining: 18.2s. Rate: 158.4 symbols/min [2025-10-21T22:16:53.499801] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:53.500375] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50694 primary records. [2025-10-21T22:16:53.500435] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-10-21T22:16:53.515572] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-10-21T22:16:53.515631] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-10-21T22:16:53.518636] [INFO ] [MAIN ] Derivative Progress: 2010/2057 symbols completed. WRBY took 1.1s. Estimated remaining: 17.8s. Rate: 158.5 symbols/min [2025-10-21T22:16:53.519113] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:53.519218] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:53.519047] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:53.551156] [DEBUG] [LOCAL ] WS: Loaded 23498 existing records from primary storage. [2025-10-21T22:16:53.551320] [INFO ] [MAIN ] WS: Loaded 23498 primary data records. [2025-10-21T22:16:53.646762] [DEBUG] [LOCAL ] WSO: Loaded 25862 existing records from primary storage. [2025-10-21T22:16:53.671672] [INFO ] [MAIN ] WSO: Loaded 25862 primary data records. [2025-10-21T22:16:53.974100] [DEBUG] [LOCAL ] WSM: Loaded 48798 existing records from primary storage. [2025-10-21T22:16:54.004881] [INFO ] [MAIN ] WSM: Loaded 48798 primary data records. [2025-10-21T22:16:54.529187] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:54.530165] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23498 primary records. [2025-10-21T22:16:54.530543] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-10-21T22:16:54.551041] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-10-21T22:16:54.551280] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-10-21T22:16:54.553842] [INFO ] [MAIN ] Derivative Progress: 2011/2057 symbols completed. WS took 1.0s. Estimated remaining: 17.4s. Rate: 158.3 symbols/min [2025-10-21T22:16:54.554142] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:54.572843] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:54.576441] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 25862 primary records. [2025-10-21T22:16:54.576880] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-10-21T22:16:54.611618] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-10-21T22:16:54.611943] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-10-21T22:16:54.608946] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:54.616175] [INFO ] [MAIN ] Derivative Progress: 2012/2057 symbols completed. WSO took 1.1s. Estimated remaining: 17.0s. Rate: 158.4 symbols/min [2025-10-21T22:16:54.622997] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:54.624757] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 48798 primary records. [2025-10-21T22:16:54.625075] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-10-21T22:16:54.644839] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-10-21T22:16:54.645202] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-10-21T22:16:54.648689] [INFO ] [MAIN ] Derivative Progress: 2013/2057 symbols completed. WSM took 1.1s. Estimated remaining: 16.7s. Rate: 158.5 symbols/min [2025-10-21T22:16:54.657658] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:54.658195] [DEBUG] [LOCAL ] WSR: Loaded 22702 existing records from primary storage. [2025-10-21T22:16:54.659125] [INFO ] [MAIN ] WSR: Loaded 22702 primary data records. [2025-10-21T22:16:54.802557] [DEBUG] [LOCAL ] WST: Loaded 36665 existing records from primary storage. [2025-10-21T22:16:54.813058] [INFO ] [MAIN ] WST: Loaded 36665 primary data records. [2025-10-21T22:16:55.145447] [DEBUG] [LOCAL ] WT: Loaded 48173 existing records from primary storage. [2025-10-21T22:16:55.167428] [INFO ] [MAIN ] WT: Loaded 48173 primary data records. [2025-10-21T22:16:55.675994] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:55.677782] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 22702 primary records. [2025-10-21T22:16:55.678019] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-10-21T22:16:55.697981] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-10-21T22:16:55.698296] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-10-21T22:16:55.701894] [INFO ] [MAIN ] Derivative Progress: 2014/2057 symbols completed. WSR took 1.1s. Estimated remaining: 16.3s. Rate: 158.3 symbols/min [2025-10-21T22:16:55.705328] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:55.727079] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:55.728275] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 36665 primary records. [2025-10-21T22:16:55.728479] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-10-21T22:16:55.751187] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-10-21T22:16:55.751556] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-10-21T22:16:55.754374] [INFO ] [MAIN ] Derivative Progress: 2015/2057 symbols completed. WST took 1.1s. Estimated remaining: 15.9s. Rate: 158.4 symbols/min [2025-10-21T22:16:55.754834] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:55.780101] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:55.780970] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 48173 primary records. [2025-10-21T22:16:55.781033] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-10-21T22:16:55.810075] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-10-21T22:16:55.811910] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-10-21T22:16:55.814876] [INFO ] [MAIN ] Derivative Progress: 2016/2057 symbols completed. WT took 1.2s. Estimated remaining: 15.5s. Rate: 158.5 symbols/min [2025-10-21T22:16:55.815766] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:55.818140] [DEBUG] [LOCAL ] WTI: Loaded 44703 existing records from primary storage. [2025-10-21T22:16:55.818343] [INFO ] [MAIN ] WTI: Loaded 44703 primary data records. [2025-10-21T22:16:55.958202] [DEBUG] [LOCAL ] WTS: Loaded 17270 existing records from primary storage. [2025-10-21T22:16:56.024681] [INFO ] [MAIN ] WTS: Loaded 17270 primary data records. [2025-10-21T22:16:56.201402] [DEBUG] [LOCAL ] WTRG: Loaded 50964 existing records from primary storage. [2025-10-21T22:16:56.236291] [INFO ] [MAIN ] WTRG: Loaded 50964 primary data records. [2025-10-21T22:16:56.802399] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:56.805784] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 44703 primary records. [2025-10-21T22:16:56.806760] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-10-21T22:16:56.836017] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:16:56.839210] [INFO ] [MAIN ] WTS: Generated 1793 derivative records from 17270 primary records. [2025-10-21T22:16:56.838346] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-10-21T22:16:56.839442] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-10-21T22:16:56.842411] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-10-21T22:16:56.842284] [INFO ] [MAIN ] Derivative Progress: 2017/2057 symbols completed. WTI took 1.1s. Estimated remaining: 15.2s. Rate: 158.3 symbols/min [2025-10-21T22:16:56.843288] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:56.861935] [DEBUG] [LOCAL ] WTS: Derivative data saved (1793 records). [2025-10-21T22:16:56.862393] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-10-21T22:16:56.865006] [INFO ] [MAIN ] Derivative Progress: 2018/2057 symbols completed. WTS took 1.0s. Estimated remaining: 14.8s. Rate: 158.4 symbols/min [2025-10-21T22:16:56.865289] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:56.878981] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:56.879822] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50964 primary records. [2025-10-21T22:16:56.880023] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-10-21T22:16:56.897037] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-10-21T22:16:56.897309] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-10-21T22:16:56.900354] [INFO ] [MAIN ] Derivative Progress: 2019/2057 symbols completed. WTRG took 1.1s. Estimated remaining: 14.4s. Rate: 158.5 symbols/min [2025-10-21T22:16:56.910524] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:56.930551] [DEBUG] [LOCAL ] WTTR: Loaded 44583 existing records from primary storage. [2025-10-21T22:16:56.944379] [INFO ] [MAIN ] WTTR: Loaded 44583 primary data records. [2025-10-21T22:16:57.099570] [DEBUG] [LOCAL ] WU: Loaded 53494 existing records from primary storage. [2025-10-21T22:16:57.110112] [INFO ] [MAIN ] WU: Loaded 53494 primary data records. [2025-10-21T22:16:57.306364] [DEBUG] [LOCAL ] WWW: Loaded 49270 existing records from primary storage. [2025-10-21T22:16:57.354713] [INFO ] [MAIN ] WWW: Loaded 49270 primary data records. [2025-10-21T22:16:57.939049] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:57.940361] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 44583 primary records. [2025-10-21T22:16:57.940581] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-10-21T22:16:57.959625] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-10-21T22:16:57.959924] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-10-21T22:16:57.962374] [INFO ] [MAIN ] Derivative Progress: 2020/2057 symbols completed. WTTR took 1.1s. Estimated remaining: 14.0s. Rate: 158.3 symbols/min [2025-10-21T22:16:57.962733] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:57.976379] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:57.977121] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53494 primary records. [2025-10-21T22:16:57.977407] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-10-21T22:16:57.993589] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-10-21T22:16:57.993881] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-10-21T22:16:57.996185] [INFO ] [MAIN ] Derivative Progress: 2021/2057 symbols completed. WU took 1.1s. Estimated remaining: 13.6s. Rate: 158.4 symbols/min [2025-10-21T22:16:57.996559] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:58.013451] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:58.014158] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49270 primary records. [2025-10-21T22:16:58.014380] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-10-21T22:16:58.030758] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-10-21T22:16:58.038116] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-10-21T22:16:58.040962] [INFO ] [MAIN ] Derivative Progress: 2022/2057 symbols completed. WWW took 1.1s. Estimated remaining: 13.3s. Rate: 158.5 symbols/min [2025-10-21T22:16:58.041371] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:58.066026] [DEBUG] [LOCAL ] XFLT: Loaded 30047 existing records from primary storage. [2025-10-21T22:16:58.066175] [INFO ] [MAIN ] XFLT: Loaded 30047 primary data records. [2025-10-21T22:16:58.186897] [DEBUG] [LOCAL ] WY: Loaded 53215 existing records from primary storage. [2025-10-21T22:16:58.219182] [INFO ] [MAIN ] WY: Loaded 53215 primary data records. [2025-10-21T22:16:58.283517] [DEBUG] [LOCAL ] XHR: Loaded 43423 existing records from primary storage. [2025-10-21T22:16:58.310495] [INFO ] [MAIN ] XHR: Loaded 43423 primary data records. [2025-10-21T22:16:59.057904] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:59.059969] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 30047 primary records. [2025-10-21T22:16:59.062111] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-10-21T22:16:59.080370] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-10-21T22:16:59.094466] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-10-21T22:16:59.096674] [INFO ] [MAIN ] Derivative Progress: 2023/2057 symbols completed. XFLT took 1.1s. Estimated remaining: 12.9s. Rate: 158.3 symbols/min [2025-10-21T22:16:59.094369] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:59.098699] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53215 primary records. [2025-10-21T22:16:59.098785] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-10-21T22:16:59.128714] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-10-21T22:16:59.128934] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:16:59.129001] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-10-21T22:16:59.132386] [INFO ] [MAIN ] Derivative Progress: 2024/2057 symbols completed. WY took 1.2s. Estimated remaining: 12.5s. Rate: 158.4 symbols/min [2025-10-21T22:16:59.133119] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 43423 primary records. [2025-10-21T22:16:59.133205] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-10-21T22:16:59.148466] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-10-21T22:16:59.148524] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-10-21T22:16:59.152009] [INFO ] [MAIN ] Derivative Progress: 2025/2057 symbols completed. XHR took 1.1s. Estimated remaining: 12.1s. Rate: 158.5 symbols/min [2025-10-21T22:16:59.152639] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:59.152570] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:59.153200] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:16:59.219836] [DEBUG] [LOCAL ] XPER: Loaded 30741 existing records from primary storage. [2025-10-21T22:16:59.220070] [INFO ] [MAIN ] XPER: Loaded 30741 primary data records. [2025-10-21T22:16:59.327264] [DEBUG] [LOCAL ] XPEV: Loaded 53619 existing records from primary storage. [2025-10-21T22:16:59.341940] [INFO ] [MAIN ] XPEV: Loaded 53619 primary data records. [2025-10-21T22:16:59.418466] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-10-21T22:16:59.464734] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-10-21T22:17:00.199584] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:00.202397] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 30741 primary records. [2025-10-21T22:17:00.202672] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-10-21T22:17:00.230910] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-10-21T22:17:00.231551] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-10-21T22:17:00.234142] [INFO ] [MAIN ] Derivative Progress: 2026/2057 symbols completed. XPER took 1.1s. Estimated remaining: 11.7s. Rate: 158.3 symbols/min [2025-10-21T22:17:00.231469] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:00.235073] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:00.236516] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53619 primary records. [2025-10-21T22:17:00.236887] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-10-21T22:17:00.265816] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-10-21T22:17:00.266218] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-10-21T22:17:00.269119] [INFO ] [MAIN ] Derivative Progress: 2027/2057 symbols completed. XPEV took 1.1s. Estimated remaining: 11.4s. Rate: 158.4 symbols/min [2025-10-21T22:17:00.269400] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:00.269723] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:00.270954] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-10-21T22:17:00.271059] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-10-21T22:17:00.287358] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-10-21T22:17:00.287471] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-10-21T22:17:00.290552] [INFO ] [MAIN ] Derivative Progress: 2028/2057 symbols completed. XOM took 1.1s. Estimated remaining: 11.0s. Rate: 158.5 symbols/min [2025-10-21T22:17:00.290730] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:00.339733] [DEBUG] [LOCAL ] XPOF: Loaded 37043 existing records from primary storage. [2025-10-21T22:17:00.339879] [INFO ] [MAIN ] XPOF: Loaded 37043 primary data records. [2025-10-21T22:17:00.459864] [DEBUG] [LOCAL ] XPRO: Loaded 45822 existing records from primary storage. [2025-10-21T22:17:00.478668] [DEBUG] [LOCAL ] XPO: Loaded 47511 existing records from primary storage. [2025-10-21T22:17:00.478000] [INFO ] [MAIN ] XPRO: Loaded 45822 primary data records. [2025-10-21T22:17:00.478910] [INFO ] [MAIN ] XPO: Loaded 47511 primary data records. [2025-10-21T22:17:01.362738] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:01.364259] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 37043 primary records. [2025-10-21T22:17:01.366150] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-10-21T22:17:01.391404] [DEBUG] [MAIN ] XPRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:01.396183] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-10-21T22:17:01.396928] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 45822 primary records. [2025-10-21T22:17:01.397194] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-10-21T22:17:01.397261] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-10-21T22:17:01.399590] [INFO ] [MAIN ] Derivative Progress: 2029/2057 symbols completed. XPOF took 1.1s. Estimated remaining: 10.6s. Rate: 158.3 symbols/min [2025-10-21T22:17:01.400019] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:01.419686] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-10-21T22:17:01.419825] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-10-21T22:17:01.422823] [INFO ] [MAIN ] Derivative Progress: 2030/2057 symbols completed. XPRO took 1.1s. Estimated remaining: 10.2s. Rate: 158.4 symbols/min [2025-10-21T22:17:01.423059] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:01.442039] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:17:01.443241] [INFO ] [MAIN ] XPO: Generated 1793 derivative records from 47511 primary records. [2025-10-21T22:17:01.443553] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-10-21T22:17:01.471269] [DEBUG] [LOCAL ] XPO: Derivative data saved (1793 records). [2025-10-21T22:17:01.473445] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-10-21T22:17:01.484527] [INFO ] [MAIN ] Derivative Progress: 2031/2057 symbols completed. XPO took 1.2s. Estimated remaining: 9.8s. Rate: 158.5 symbols/min [2025-10-21T22:17:01.486249] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:01.486104] [DEBUG] [LOCAL ] XYF: Loaded 27523 existing records from primary storage. [2025-10-21T22:17:01.486988] [INFO ] [MAIN ] XYF: Loaded 27523 primary data records. [2025-10-21T22:17:01.816750] [DEBUG] [LOCAL ] XYL: Loaded 47603 existing records from primary storage. [2025-10-21T22:17:01.816973] [INFO ] [MAIN ] XYL: Loaded 47603 primary data records. [2025-10-21T22:17:01.895961] [DEBUG] [LOCAL ] YALA: Loaded 36483 existing records from primary storage. [2025-10-21T22:17:01.901508] [INFO ] [MAIN ] YALA: Loaded 36483 primary data records. [2025-10-21T22:17:02.460429] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:02.461495] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 27523 primary records. [2025-10-21T22:17:02.461944] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-10-21T22:17:02.481024] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-10-21T22:17:02.481283] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-10-21T22:17:02.484332] [INFO ] [MAIN ] Derivative Progress: 2032/2057 symbols completed. XYF took 1.1s. Estimated remaining: 9.5s. Rate: 158.4 symbols/min [2025-10-21T22:17:02.484614] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:02.507486] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:02.521116] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 47603 primary records. [2025-10-21T22:17:02.521200] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-10-21T22:17:02.521536] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:02.522994] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 36483 primary records. [2025-10-21T22:17:02.523425] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-10-21T22:17:02.540854] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-10-21T22:17:02.541297] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-10-21T22:17:02.543679] [INFO ] [MAIN ] Derivative Progress: 2033/2057 symbols completed. XYL took 1.1s. Estimated remaining: 9.1s. Rate: 158.4 symbols/min [2025-10-21T22:17:02.554216] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:02.569925] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-10-21T22:17:02.570145] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-10-21T22:17:02.573156] [INFO ] [MAIN ] Derivative Progress: 2034/2057 symbols completed. YALA took 1.1s. Estimated remaining: 8.7s. Rate: 158.5 symbols/min [2025-10-21T22:17:02.574226] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:02.588776] [DEBUG] [LOCAL ] YELP: Loaded 45259 existing records from primary storage. [2025-10-21T22:17:02.589031] [INFO ] [MAIN ] YELP: Loaded 45259 primary data records. [2025-10-21T22:17:02.944624] [DEBUG] [LOCAL ] YEXT: Loaded 43105 existing records from primary storage. [2025-10-21T22:17:02.944952] [INFO ] [MAIN ] YEXT: Loaded 43105 primary data records. [2025-10-21T22:17:02.946893] [DEBUG] [LOCAL ] YETI: Loaded 52528 existing records from primary storage. [2025-10-21T22:17:02.980405] [INFO ] [MAIN ] YETI: Loaded 52528 primary data records. [2025-10-21T22:17:03.645640] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:03.647500] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45259 primary records. [2025-10-21T22:17:03.647632] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-10-21T22:17:03.671098] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-10-21T22:17:03.671853] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-10-21T22:17:03.674422] [INFO ] [MAIN ] Derivative Progress: 2035/2057 symbols completed. YELP took 1.2s. Estimated remaining: 8.3s. Rate: 158.3 symbols/min [2025-10-21T22:17:03.675339] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:03.710165] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:03.710453] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:03.712129] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52528 primary records. [2025-10-21T22:17:03.712329] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-10-21T22:17:03.711330] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43105 primary records. [2025-10-21T22:17:03.713037] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-10-21T22:17:03.741021] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-10-21T22:17:03.743984] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-10-21T22:17:03.747063] [INFO ] [MAIN ] Derivative Progress: 2036/2057 symbols completed. YEXT took 1.2s. Estimated remaining: 8.0s. Rate: 158.4 symbols/min [2025-10-21T22:17:03.747288] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:03.749937] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-10-21T22:17:03.768160] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-10-21T22:17:03.771544] [INFO ] [MAIN ] Derivative Progress: 2037/2057 symbols completed. YETI took 1.2s. Estimated remaining: 7.6s. Rate: 158.5 symbols/min [2025-10-21T22:17:03.771946] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:03.809875] [DEBUG] [LOCAL ] YRD: Loaded 11290 existing records from primary storage. [2025-10-21T22:17:03.810098] [INFO ] [MAIN ] YRD: Loaded 11290 primary data records. [2025-10-21T22:17:03.819053] [DEBUG] [LOCAL ] YMM: Loaded 52583 existing records from primary storage. [2025-10-21T22:17:03.834817] [INFO ] [MAIN ] YMM: Loaded 52583 primary data records. [2025-10-21T22:17:04.135267] [DEBUG] [LOCAL ] YPF: Loaded 50761 existing records from primary storage. [2025-10-21T22:17:04.161275] [INFO ] [MAIN ] YPF: Loaded 50761 primary data records. [2025-10-21T22:17:04.868158] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:04.870793] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 11290 primary records. [2025-10-21T22:17:04.872077] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-10-21T22:17:04.891902] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-10-21T22:17:04.892055] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-10-21T22:17:04.907574] [INFO ] [MAIN ] Derivative Progress: 2038/2057 symbols completed. YRD took 1.1s. Estimated remaining: 7.2s. Rate: 158.3 symbols/min [2025-10-21T22:17:04.910230] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:04.911527] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52583 primary records. [2025-10-21T22:17:04.911610] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-10-21T22:17:04.924881] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:04.925989] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50761 primary records. [2025-10-21T22:17:04.926280] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-10-21T22:17:04.950813] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-10-21T22:17:04.950944] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-10-21T22:17:04.955447] [INFO ] [MAIN ] Derivative Progress: 2039/2057 symbols completed. YMM took 1.3s. Estimated remaining: 6.8s. Rate: 158.4 symbols/min [2025-10-21T22:17:04.960114] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-10-21T22:17:04.960402] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-10-21T22:17:04.963393] [INFO ] [MAIN ] Derivative Progress: 2040/2057 symbols completed. YPF took 1.2s. Estimated remaining: 6.4s. Rate: 158.5 symbols/min [2025-10-21T22:17:04.963954] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:04.964302] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:04.964571] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:04.993399] [DEBUG] [LOCAL ] YSG: Loaded 25683 existing records from primary storage. [2025-10-21T22:17:04.993541] [INFO ] [MAIN ] YSG: Loaded 25683 primary data records. [2025-10-21T22:17:05.349501] [DEBUG] [LOCAL ] YUMC: Loaded 52586 existing records from primary storage. [2025-10-21T22:17:05.349766] [DEBUG] [LOCAL ] YUM: Loaded 51171 existing records from primary storage. [2025-10-21T22:17:05.350009] [INFO ] [MAIN ] YUMC: Loaded 52586 primary data records. [2025-10-21T22:17:05.350125] [INFO ] [MAIN ] YUM: Loaded 51171 primary data records. [2025-10-21T22:17:06.063536] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:06.064757] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 25683 primary records. [2025-10-21T22:17:06.065235] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-10-21T22:17:06.083412] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-10-21T22:17:06.083511] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-10-21T22:17:06.086307] [INFO ] [MAIN ] Derivative Progress: 2041/2057 symbols completed. YSG took 1.1s. Estimated remaining: 6.1s. Rate: 158.3 symbols/min [2025-10-21T22:17:06.086446] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:06.106170] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:06.121089] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52586 primary records. [2025-10-21T22:17:06.121461] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-10-21T22:17:06.122252] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:06.123785] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51171 primary records. [2025-10-21T22:17:06.123874] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-10-21T22:17:06.140021] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-10-21T22:17:06.140474] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-10-21T22:17:06.143540] [INFO ] [MAIN ] Derivative Progress: 2042/2057 symbols completed. YUMC took 1.2s. Estimated remaining: 5.7s. Rate: 158.4 symbols/min [2025-10-21T22:17:06.143852] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:06.161799] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-10-21T22:17:06.175252] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-10-21T22:17:06.178259] [INFO ] [MAIN ] Derivative Progress: 2043/2057 symbols completed. YUM took 1.2s. Estimated remaining: 5.3s. Rate: 158.4 symbols/min [2025-10-21T22:17:06.178528] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:06.209045] [DEBUG] [LOCAL ] ZEPP: Loaded 19519 existing records from primary storage. [2025-10-21T22:17:06.209925] [DEBUG] [LOCAL ] ZBH: Loaded 50718 existing records from primary storage. [2025-10-21T22:17:06.210167] [INFO ] [MAIN ] ZEPP: Loaded 19519 primary data records. [2025-10-21T22:17:06.221506] [INFO ] [MAIN ] ZBH: Loaded 50718 primary data records. [2025-10-21T22:17:06.592397] [DEBUG] [LOCAL ] ZETA: Loaded 53618 existing records from primary storage. [2025-10-21T22:17:06.726578] [INFO ] [MAIN ] ZETA: Loaded 53618 primary data records. [2025-10-21T22:17:07.191407] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:07.196410] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 50718 primary records. [2025-10-21T22:17:07.204423] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-10-21T22:17:07.206177] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:07.207104] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 19519 primary records. [2025-10-21T22:17:07.207196] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-10-21T22:17:07.239170] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-10-21T22:17:07.239347] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-10-21T22:17:07.242725] [INFO ] [MAIN ] Derivative Progress: 2044/2057 symbols completed. ZBH took 1.2s. Estimated remaining: 4.9s. Rate: 158.3 symbols/min [2025-10-21T22:17:07.238969] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-10-21T22:17:07.243138] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-10-21T22:17:07.242966] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:07.245493] [INFO ] [MAIN ] Derivative Progress: 2045/2057 symbols completed. ZEPP took 1.1s. Estimated remaining: 4.5s. Rate: 158.4 symbols/min [2025-10-21T22:17:07.246087] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:07.271121] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:07.271992] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53618 primary records. [2025-10-21T22:17:07.272122] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-10-21T22:17:07.296879] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-10-21T22:17:07.297356] [DEBUG] [LOCAL ] ZH: Loaded 24749 existing records from primary storage. [2025-10-21T22:17:07.297556] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-10-21T22:17:07.306070] [INFO ] [MAIN ] ZH: Loaded 24749 primary data records. [2025-10-21T22:17:07.309301] [INFO ] [MAIN ] Derivative Progress: 2046/2057 symbols completed. ZETA took 1.1s. Estimated remaining: 4.2s. Rate: 158.4 symbols/min [2025-10-21T22:17:07.314660] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:07.435727] [DEBUG] [LOCAL ] ZGN: Loaded 40965 existing records from primary storage. [2025-10-21T22:17:07.440124] [INFO ] [MAIN ] ZGN: Loaded 40965 primary data records. [2025-10-21T22:17:08.035297] [DEBUG] [LOCAL ] ZIM: Loaded 53470 existing records from primary storage. [2025-10-21T22:17:08.036543] [INFO ] [MAIN ] ZIM: Loaded 53470 primary data records. [2025-10-21T22:17:08.260969] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:08.308496] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 24749 primary records. [2025-10-21T22:17:08.366761] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-10-21T22:17:08.400122] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-10-21T22:17:08.400486] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-10-21T22:17:08.402681] [INFO ] [MAIN ] Derivative Progress: 2047/2057 symbols completed. ZH took 1.2s. Estimated remaining: 3.8s. Rate: 158.3 symbols/min [2025-10-21T22:17:08.402886] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:08.417410] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:08.418468] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40965 primary records. [2025-10-21T22:17:08.418675] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-10-21T22:17:08.436415] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-10-21T22:17:08.436748] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-10-21T22:17:08.439498] [INFO ] [MAIN ] Derivative Progress: 2048/2057 symbols completed. ZGN took 1.2s. Estimated remaining: 3.4s. Rate: 158.4 symbols/min [2025-10-21T22:17:08.439931] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:08.470321] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:08.471171] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53470 primary records. [2025-10-21T22:17:08.471317] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-10-21T22:17:08.509481] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-10-21T22:17:08.509730] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-10-21T22:17:08.512762] [INFO ] [MAIN ] Derivative Progress: 2049/2057 symbols completed. ZIM took 1.2s. Estimated remaining: 3.0s. Rate: 158.4 symbols/min [2025-10-21T22:17:08.514003] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:08.513798] [DEBUG] [LOCAL ] ZIP: Loaded 43531 existing records from primary storage. [2025-10-21T22:17:08.514587] [INFO ] [MAIN ] ZIP: Loaded 43531 primary data records. [2025-10-21T22:17:08.600070] [DEBUG] [LOCAL ] ZK: Loaded 39001 existing records from primary storage. [2025-10-21T22:17:08.621105] [DEBUG] [LOCAL ] ZKH: Loaded 7360 existing records from primary storage. [2025-10-21T22:17:08.627572] [INFO ] [MAIN ] ZKH: Loaded 7360 primary data records. [2025-10-21T22:17:08.635742] [INFO ] [MAIN ] ZK: Loaded 39001 primary data records. [2025-10-21T22:17:09.517528] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:09.520156] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 43531 primary records. [2025-10-21T22:17:09.520352] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-10-21T22:17:09.534476] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:09.543578] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 39001 primary records. [2025-10-21T22:17:09.547399] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-10-21T22:17:09.552580] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-10-21T22:17:09.552783] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-10-21T22:17:09.554879] [INFO ] [MAIN ] Derivative Progress: 2050/2057 symbols completed. ZIP took 1.2s. Estimated remaining: 2.7s. Rate: 158.3 symbols/min [2025-10-21T22:17:09.555050] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:09.581987] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-10-21T22:17:09.585733] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 7360 primary records. [2025-10-21T22:17:09.585812] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-10-21T22:17:09.586444] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-10-21T22:17:09.586865] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-10-21T22:17:09.589679] [INFO ] [MAIN ] Derivative Progress: 2051/2057 symbols completed. ZK took 1.1s. Estimated remaining: 2.3s. Rate: 158.4 symbols/min [2025-10-21T22:17:09.595834] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:09.605163] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-10-21T22:17:09.605639] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-10-21T22:17:09.608677] [INFO ] [MAIN ] Derivative Progress: 2052/2057 symbols completed. ZKH took 1.1s. Estimated remaining: 1.9s. Rate: 158.4 symbols/min [2025-10-21T22:17:09.608830] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:09.633202] [DEBUG] [LOCAL ] ZTR: Loaded 16602 existing records from primary storage. [2025-10-21T22:17:09.633334] [INFO ] [MAIN ] ZTR: Loaded 16602 primary data records. [2025-10-21T22:17:09.781953] [DEBUG] [LOCAL ] ZTO: Loaded 49407 existing records from primary storage. [2025-10-21T22:17:09.829759] [INFO ] [MAIN ] ZTO: Loaded 49407 primary data records. [2025-10-21T22:17:10.098058] [DEBUG] [LOCAL ] ZTS: Loaded 53131 existing records from primary storage. [2025-10-21T22:17:10.108691] [INFO ] [MAIN ] ZTS: Loaded 53131 primary data records. [2025-10-21T22:17:10.612798] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:10.613767] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16602 primary records. [2025-10-21T22:17:10.613985] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-10-21T22:17:10.631914] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-10-21T22:17:10.633437] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-10-21T22:17:10.635370] [INFO ] [MAIN ] Derivative Progress: 2053/2057 symbols completed. ZTR took 1.0s. Estimated remaining: 1.5s. Rate: 158.3 symbols/min [2025-10-21T22:17:10.649520] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:10.650129] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 49407 primary records. [2025-10-21T22:17:10.650284] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-10-21T22:17:10.666613] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-10-21T22:17:10.666858] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-10-21T22:17:10.669615] [INFO ] [MAIN ] Derivative Progress: 2054/2057 symbols completed. ZTO took 1.1s. Estimated remaining: 1.1s. Rate: 158.4 symbols/min [2025-10-21T22:17:10.684370] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:10.684915] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 53131 primary records. [2025-10-21T22:17:10.684973] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-10-21T22:17:10.702697] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-10-21T22:17:10.702770] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-10-21T22:17:10.705925] [INFO ] [MAIN ] Derivative Progress: 2055/2057 symbols completed. ZTS took 1.1s. Estimated remaining: 0.8s. Rate: 158.5 symbols/min [2025-10-21T22:17:10.706245] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:10.706187] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-10-21T22:17:10.751619] [DEBUG] [LOCAL ] ZVIA: Loaded 35811 existing records from primary storage. [2025-10-21T22:17:10.751878] [INFO ] [MAIN ] ZVIA: Loaded 35811 primary data records. [2025-10-21T22:17:10.837217] [DEBUG] [LOCAL ] ZWS: Loaded 42220 existing records from primary storage. [2025-10-21T22:17:10.850238] [INFO ] [MAIN ] ZWS: Loaded 42220 primary data records. [2025-10-21T22:17:11.439863] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:11.440736] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35811 primary records. [2025-10-21T22:17:11.440933] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-10-21T22:17:11.459004] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-10-21T22:17:11.460018] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-10-21T22:17:11.462699] [INFO ] [MAIN ] Derivative Progress: 2056/2057 symbols completed. ZVIA took 0.8s. Estimated remaining: 0.4s. Rate: 158.4 symbols/min [2025-10-21T22:17:11.475990] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-10-21T22:17:11.476624] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42220 primary records. [2025-10-21T22:17:11.476711] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-10-21T22:17:11.492376] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-10-21T22:17:11.492501] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-10-21T22:17:11.495668] [INFO ] [MAIN ] Derivative Progress: 2057/2057 symbols completed. ZWS took 0.8s. Estimated remaining: 0.0s. Rate: 158.4 symbols/min [2025-10-21T22:17:11.496267] [INFO ] [MAIN ] Parallel derivative generation completed in 12m 59s [2025-10-21T22:17:11.496341] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2057/2057 symbols) [2025-10-21T22:17:12.446441] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2057/2057 @ 100.00%)' [2025-10-21T22:17:12.447150] [INFO ] [MAIN ] Both primary update and derivative generation completed successfully. [2025-10-21T22:17:12.448059] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-10-21T22:17:12.448259] [INFO ] [STATE ] Last completion updated: 2025-10-21T22:17:12.448134